ALBERT

Description: Well prepared traffic scenarios contribute greatly to the success of controller-in-the-loop simulations. This paper describes each stage in the design process of realistic scenarios based on real-world traffic, to be used in the Airspace Operations Laboratory for simulations within the Air Traffic Management Technology Demonstration 1 effort. The steps from the initial analysis of real-world traffic, to the editing of individual aircraft records in the scenario file, until the final testing of the scenarios before the simulation conduct, are all described. The iterative nature of the design process and the various efforts necessary to reach the required fidelity, as well as the applied design strategies, challenges, and tools used during this process are also discussed.

Description: A Human-In-The-Loop air traffic control simulation investigated the impact of uncertainties in trajectory predictions on NextGen Trajectory-Based Operations concepts, seeking to understand when the automation would become unacceptable to controllers or when performance targets could no longer be met. Retired air traffic controllers staffed two en route transition sectors, delivering arrival traffic to the northwest corner-post of Atlanta approach control under time-based metering operations. Using trajectory-based decision-support tools, the participants worked the traffic under varying levels of wind forecast error and aircraft performance model error, impacting the ground automations ability to make accurate predictions. Results suggest that the controllers were able to maintain high levels of performance, despite even the highest levels of trajectory prediction errors.

Description: In this paper we discuss results from a recent high fidelity simulation of air traffic control operations with automated separation assurance in the presence of weather and time-constraints. We report findings from a human-in-the-loop study conducted in the Airspace Operations Laboratory (AOL) at the NASA Ames Research Center. During four afternoons in early 2010, fifteen active and recently retired air traffic controllers and supervisors controlled high levels of traffic in a highly automated environment during three-hour long scenarios, For each scenario, twelve air traffic controllers operated eight sector positions in two air traffic control areas and were supervised by three front line managers, Controllers worked one-hour shifts, were relieved by other controllers, took a 3D-minute break, and worked another one-hour shift. On average, twice today's traffic density was simulated with more than 2200 aircraft per traffic scenario. The scenarios were designed to create peaks and valleys in traffic density, growing and decaying convective weather areas, and expose controllers to heavy and light metering conditions. This design enabled an initial look at a broad spectrum of workload, challenge, boredom, and fatigue in an otherwise uncharted territory of future operations. In this paper we report human/system integration aspects, safety and efficiency results as well as airspace throughput, workload, and operational acceptability. We conclude that, with further refinements. air traffic control operations with ground-based automated separation assurance can be an effective and acceptable means to routinely provide very high traffic throughput in the en route airspace.

Description: A controller-in-the-loop simulation was conducted in the Airspace Operations Laboratory (AOL) at the NASA Ames Research Center to investigate the functional allocation aspects associated with ground-based automated separation assurance in a far-term NextGen environment. In this concept, ground-based automation handled the detection and resolution of strategic and tactical conflicts and alerted the controller to deferred situations. The controller was responsible for monitoring the automation and managing situations by exception. This was done in conditions both with and without arrival time constraints across two levels of traffic density. Results showed that although workload increased with an increase in traffic density, it was still manageable in most situations. The number of conflicts increased similarly with a related increase in the issuance of resolution clearances. Although over 99% of conflicts were resolved, operational errors did occur but were tied to local sector complexities. Feedback from the participants revealed that they thought they maintained reasonable situation awareness in this environment, felt that operations were highly acceptable at the lower traffic density level but were less so as it increased, and felt overall that the concept as it was introduced here was a positive step forward to accommodating the more complex environment envisioned as part of NextGen.

Description: The Technology Capability Level-2 National Campaign (TCL2nc) was conducted at six different test-sites located across the USA, during May and June of 2017. The campaign resulted in over 240 data collection flights using 24 different aircraft and involving 23 flight crews. Flights not only varied in duration, but also in the environments and terrains over which they flew. The TCL2nc highlighted beyond visual line of sight (BVLOS) and altitude-stratified operations, and saw five partners bring their own, independently built, UAS Service Supplier (USS) for use during the flight tests. This document presents data collected during the TCL2nc that informs the 'Operator' section of the 'Requirements/Best Practices' from the UTM Technical Capability Matrix and Guidelines to Operate (Rios, version as of March 2017). A review of the data collected indicated that although teams were well qualified on paper (in terms of both completing training and having experience with flying UAS vehicles), greater consideration should be given to the unique perspectives and backgrounds of future UAS operators. Overall, teams looked at a variety of sources for information, including USS client-displays, and participants became more mindful of the need to be aware of other vehicles, highlighting the value of reporting information. Observations found that flight crews' time to respond to a UTM issue depended heavily on the team structure, communication efficiency, and crew procedures. These points are discussed in more detail below.

Description: With the continued projection of increases in air traffic density, operations in the National Airspace System are expected to exceed human capabilities in the near future. In order to address the bottleneck of human workload capacity, highly automated safety-critical systems are under development to support air traffic controllers. A human-in-the-loop experiment examined controllers transition through four NextGen automation stages: Current-Day, Minimum, Moderate, and Maximum. Maximum NextGen simulated a fully automated environment where the automation was responsible for detecting and resolving conflicts within simulation parameters in high-density airspace. By allocating these tasks to the automation, the controllers task changed. The human moved to primarily a supervisory position- typically only regaining control over separation assurance tasks during conflict situations deferred by the automation. While tasks were allocated a-priori between the controller and automated agent, controllers maintained authority to inhibit the automation from interacting with particular aircraft. Preliminary work is complete, where significant differences were found in inhibition frequency between simulation participants. However, the contexts in which the controllers inhibited the automation, and their reasons for doing so, remain unclear. This analysis attempts to identity factors contributing to human controllers inhibition of the automation in the Maximum NextGen condition.

Description: In this paper we discuss the development and evaluation of our prototype technologies and procedures for far-term air traffic control operations with automation for separation assurance, weather avoidance and schedule conformance. Controller-in-the-loop simulations in the Airspace Operations Laboratory at the NASA Ames Research Center in 2010 have shown very promising results. We found the operations to provide high airspace throughput, excellent efficiency and schedule conformance. The simulation also highlighted areas for improvements: Short-term conflict situations sometimes resulted in separation violations, particularly for transitioning aircraft in complex traffic flows. The combination of heavy metering and growing weather resulted in an increased number of aircraft penetrating convective weather cells. To address these shortcomings technologies and procedures have been improved and the operations are being re-evaluated with the same scenarios. In this paper we will first describe the concept and technologies for automating separation assurance, weather avoidance, and schedule conformance. Second, the results from the 2010 simulation will be reviewed. We report human-systems integration aspects, safety and efficiency results as well as airspace throughput, workload, and operational acceptability. Next, improvements will be discussed that were made to address identified shortcomings. We conclude that, with further refinements, air traffic control operations with ground-based automated separation assurance can routinely provide currently unachievable levels of traffic throughput in the en route airspace.

Description: This paper presents an air/ground functional allocation experiment conducted by the National Aeronautics and Space Administration (NASA) using two human-in-the-Loop simulations to compare airborne and ground-based approaches to NextGen separation assurance. The approaches under investigation are two trajectory-based four-dimensional (4D) concepts; one referred to as "airborne trajectory management with self-separation" (airborne) the other as "ground-based automated separation assurance" (ground-based). In coordinated simulations at NASA's Ames and Langley Research Centers, the primary operational participants -controllers for the ground-based concept and pilots for the airborne concept - manage the same traffic scenario using the two different 4D concepts. The common scenarios are anchored in traffic problems that require a significant increase in airspace capacity - on average, double, and in some local areas, close to 250% over current day levels - in order to enable aircraft to safely and efficiently traverse the test airspace. The simulations vary common independent variables such as traffic density, sequencing and scheduling constraints, and timing of trajectory change events. A set of common metrics is collected to enable a direct comparison of relevant results. The simulations will be conducted in spring 2010. If accepted, this paper will be the first publication of the experimental approach and early results. An initial comparison of safety and efficiency as well as operator acceptability under the two concepts is expected.

Description: A simulation evaluated the feasibility and potential benefits of using decision support tools to support time-based airborne spacing and merging for aircraft arriving in the terminal area on charted Flight Management System (FMS) routes. Sixteen trials were conducted in each treatment combination of a 2X2 repeated-measures design. In trials 'with ground tools' air traffic controller participants managed traffic using sequencing and spacing tools. In trials 'with air tools' approximately seventy-five percent of aircraft assigned to the primary landing runway were equipped for airborne spacing, including flight simulators flown by commercial pilots. The results indicate that airborne spacing improves spacing accuracy and is feasible for FMS operations and mixed spacing equipage. Controllers and pilots can manage spacing clearances that contain two call signs without difficulty. For best effect, both decision support tools and spacing guidance should exhibit consistently predictable performance, and merging traffic flows should be well coordinated.

Description: Investigation of function allocation for the Next Generation Air Transportation System is being conducted by the National Aeronautics and Space Administration (NASA). To provide insight on comparability of different function allocations for separation assurance, two human-in-the-loop simulation experiments were conducted on homogeneous airborne and ground-based approaches to four-dimensional trajectory-based operations, one referred to as ground-based automated separation assurance (groundbased) and the other as airborne trajectory management with self-separation (airborne). In the coordinated simulations at NASA s Ames and Langley Research Centers, controllers for the ground-based concept at Ames and pilots for the airborne concept at Langley managed the same traffic scenarios using the two different concepts. The common scenarios represented a significant increase in airspace demand over current operations. Using common independent variables, the simulations varied traffic density, scheduling constraints, and the timing of trajectory change events. Common metrics were collected to enable a comparison of relevant results. Where comparisons were possible, no substantial differences in performance or operator acceptability were observed. Mean schedule conformance and flight path deviation were considered adequate for both approaches. Conflict detection warning times and resolution times were mostly adequate, but certain conflict situations were detected too late to be resolved in a timely manner. This led to some situations in which safety was compromised and/or workload was rated as being unacceptable in both experiments. Operators acknowledged these issues in their responses and ratings but gave generally positive assessments of the respective concept and operations they experienced. Future studies will evaluate technical improvements and procedural enhancements to achieve the required level of safety and acceptability and will investigate the integration of airborne and ground-based capabilities within the same airspace to leverage the benefits of each concept.