An online pilot manual control behavior identification method, based on recursive low-order time-series model estimation, is presented and validated using experimental data. Eight participants performed compensatory tracking tasks with time-varying vehicle dynamics, where, at an unpredictable moment during a run, a sudden degradation in dynamics could occur. They were instructed to push a button when they detected a change in dynamics. Two methods to automatically detect the moment when pilot adaptation occurs from online estimated parameter traces are discussed. Results show that pilots are more accurate in detecting changes than either algorithm. But when the algorithms are correct, they are often quicker to detect pilot adaptation than pilots themselves. The presented techniques have potential but need improvements.@en

While human control behavior is well-understood in continuous control tasks, little is still known about how human operators detect sudden changes in the controlled element dynamics. This paper focuses on modeling this detection phase for pursuit tracking tasks. Potential triggers for the human operator to detect changes in the controlled element dynamics were investigated via a time-varying computer simulation. Based on the results, hypotheses were generated and later tested in a single-axis pursuit tracking experiment with fifteen participants. Transitions from approximate single to approximate double integrator dynamics and vice versa were investigated, for which participants indicated if they detected the transition by pressing a button. Using the button push data, a model for each transition was developed and validated. The models work under the assumption that human operators use a threshold, a multiple of the steady-state standard deviation, on certain signals to detect transitions. The models developed for the transition from single to double integrator dynamics and vice versa are proposed to trigger on the tracking error and system output acceleration, respectively. They have an accuracy of 88.9% and 99.4%, respectively. However, a consistent underestimation of the detection lag remains a limitation of both models. Nonetheless, this research helped confirm the tracking error can be used in a model for the transition from single to double integrator dynamics, proposed a model for the opposite transition, and identified that the relationship between control inputs and the system's response as a crucial factor for the detection.@en

The identification of time-varying, adaptive behavior of a human operator in basic manual control tasks is currently still a focus area, since most methodologies only account for time-invariant system dynamics. Previous authors have proven that estimation techniques based on ARX model structures can be used to identify time-varying HO model parameters. However, ARX methods do present several problems, such as a persistent bias in the obtained estimates of the HO model poles (neuromuscular parameters) that increases due to coupled noise and system models. Therefore, in this paper a novel identification technique based on Box-Jenkins (BJ) models is proposed, to achieve a better match between the BJ estimator's inherently uncoupled system and noise models and measured HO control dynamics. The identification process was tested offline (batch-fitting) using Ordinary Least Squares and the Prediction Error Method for both ARX and BJ models, respectively, or online when Recursive Least Squares and Recursive PEM are employed. The BJ estimator has excellent potential as an identification tool due to its bias reduction capabilities, as clearly shown in batch-fitting, although the non-linear optimization processes decrease its convergence speed by 500%. An RPEM algorithm with a forgetting factor of λ = 0.99609 and a first-order remnant model incorporated in the BJ structure was tested on Monte Carlo simulation and experimental data. While the recursive BJ estimator showed the same bias-diminishing advantages also seen in batch-fitting, the non-linear RPEM estimator's results showed much slower convergence after HO behavior adaptations and frequent instabilities of the obtained parameter estimates. Hence, further research is needed for implementing a practical bias-free HO model estimator based on the BJ model structure.@en

Providing adequate simulator motion cues for simulated upset and stall scenarios remains challenging. This paper evaluates the potential of novel optimization-based motion cueing algorithms for upset and stall simulation. An offline analysis is performed to compare three Model Predictive Control (MPC) algorithms with varying prediction horizon lengths and prediction strategies (i.e., "Oracle", "Perfect", and "Constant") against two baseline classical washout algorithm implementations from literature. The analysis is performed for a symmetric stall scenario flown with TU Delft's Cessna Citation II laboratory aircraft. Overall, the analysis shows that the objective motion cueing quality expressed in terms of the Root Mean Square Error (RMSE) improves by 29.8% (for specific forces) and 18.7% (for rotational velocities) with the "Oracle" and "Perfect" MPC implementations compared to the reference classical washout results. For the "Constant" MPC algorithm, which in fact does not include any explicit prediction across the MPC algorithm's future prediction window, only a marginal improvement in motion quality was found. Overall, these results imply that, assuming a sufficient future reference motion prediction can be achieved, optimization-based motion cueing algorithms have the potential to provide significantly better motion cueing quality compared to classical motion cueing algorithms.@en

Automation errors may result in human performance issues that are often difficult to grasp. Skraaning and Jamieson (2023) proposed a taxonomy for classifying automation errors into categories based on the visible symptoms of design problems, so as to benefit the design of training scenarios. In this paper, we propose a complementary classification that is based on the mechanisms of human-automation interaction guided by Rasmussen’s Skill, Rule and Knowledge (SRK) taxonomy. We identified four main failure classes and expect that this classification can support automation designers.@en

Understanding human perception of haptic feedback is critical when designing and regulating these interfaces. In recent years, experiments have been conducted to determine the just-noticeable difference (JND) in mass-spring-damper dynamics, using a hydraulic admittance display in the form of a side-stick. These experiments have resulted in a model of JNDs when interacting with linear second-order dynamics. In real-world applications, however, control force dynamics also commonly include nonlinearities, such as friction. This research extends the current understanding of JNDs in linear systems by including the nonlinear case, where friction is also present. Experiments were conducted to determine JNDs in friction when combined with second-order system dynamics. Results indicate that friction JND can be independent of linear system dynamics as long as its value compared to the linear system's impedance is sufficiently large. As a consequence, friction JND follows Weber's law, also when it is combined with mass-spring-damper dynamics, unless the level of friction approaches the detection threshold, which in turn can be influenced by the linear system dynamics. Based on the findings presented, it is possible to conduct targeted experiments to confirm and add to these initial results.

@en

Previous research indicated a need to improve pilot training with regard to understanding of autopilot logic and behavior, especially in non-routine situations. Therefore, we tested the effect of problem-based exploratory training on pilots’ understanding of autopilot functions. Using a moving-base flight simulator, general aviation pilots (n = 45) were trained to diagnose failures either without foreknowledge and guidance (exploratory group), without foreknowledge but with some guidance (exploratory-guidance group) or with foreknowledge and full guidance (control group). They subsequently performed six test scenarios in which their understanding of the effects of failures was tested by requiring them to deduce the failures and select autopilot modes that were still functioning. Those who received exploratory training with guidance were significantly more likely than the other groups to diagnose failures correctly. The exploratory training group also selected the most appropriate functioning autopilot modes significantly faster than the control group. The results suggest that exploratory training with an appropriate level of guidance is useful for gaining a practical understanding of autopilot logic and behavior. Exploratory training may help to improve transfer of training to operational practice, and prevent automation surprises and accidents.

@en

Expert participants may not always be available for evaluation of new displays or support systems, and in some cases, it might be better to use novice participants, particularly when the display or support significantly changes existing work practices. To provide tools and arguments for selecting the expertise level of participants, we propose the use of Rasmussen’s decision ladder to analyze where and how a new visualization or a support tool changes the task, and identify steps where a novice participant may learn to perform the task to an acceptable level. A comparison to the support with the current operational interfaces then shows where an expert might have difficulty in stepping away from learned practice. This analysis is applied to the domain of air traffic control, and a selected set of relevant past research with both expert and novice participants is reviewed, revisiting the decision for a participant level in the study. @en

Background. Previous studies and accident analyses have shown that pilots can make roll reversal errors when responding to bank angles shown by the artificial horizon in the Primary Flight Display (PFD). In the current study, we tested whether adding stereoscopic depth cues to the artificial horizon may lead to better bank angle representation due to an improved figureground separation between the symbols. Method. Stereoscopic depth cues were created by using a half-silvered mirror multi-layer PFD, which presented the horizon symbol on a lower layer and the aircraft symbol on a higher layer. A group of 23 non-pilots and 18 general aviation pilots were shown left or right bank angles on this multi-layer PFD as well as on a normal single-layer PFD, with the task to roll the wings level using a joystick. Results. In the pilot group, a similar amount of roll-reversal errors was made with both displays (median = 3.3%) with no significant difference, p = 0.635. In the non-pilot group, fewer roll-reversal errors were observed with the multi-layer display, but this difference did not reach significance either (median = 3.3% vs. 5.0%, p = 0.182). In both pilots and non-pilots, the reaction time was longer in the multi-layer display, which reached significance in the non-pilots (p = 0.016) but not in pilots (p = 0.215). Participants noticed that the depth was only visible during the start of the session. Conclusions. The results suggest that using stereoscopic depth cues are not a viable manner to enhance the figure-ground relation in the artificial horizon. @en

To alleviate the workload of air traffic controllers, part of the air traffic may be handled by a future automated system. When deciding which flights to delegate, a distinction can be made between basic and non-basic flights, with the former being prime candidates for delegation. The human controller can then focus on the non-basic flights, where human competencies are most valuable and more difficult to automate. The classification of flights is preferably based on objective measures relating to the traffic situation. Existing complexity models are, however, often used for capacity predictions or airspace restructuring and primarily to assess the complexity of a sector as a whole. In this paper we use empirically collected flight complexity ratings from 15 professional en-route air traffic controllers. They indicated which other flights contributed to their complexity assessment of a single flight of interest. This exploratory study was able to build a machine-learning model which adequately classifies these flights, based on a qualified majority of controllers. By analyzing the interactions between the included flights, we discuss whether a classification model can differentiate between basic and non-basic flights, and which traffic features play the largest role. Once this can be done reliably and an appropriate complexity threshold has been chosen, a model can be developed as a starting point for an automatic allocation algorithm that distributes flights between a human controller and the computer.@en

An improved understanding of pilot’s control behavior adaptations in response to sudden changes in the vehicle dynamics is essential for realizing adaptive support systems that remain effective when task characteristics suddenly change. In this paper, we replicate, extend, and validate the ‘adaptive pilot model’ proposed by Hess to verify its effectiveness for predicting human adaptive behavior in pursuit tracking tasks. The model relies on a Triggering function, that compares the current tracking performance to a stored nominal (pre-transition) state, and an Adaptation mechanism which determines new adapted human operator gain settings proportional to the magnitude of the off-nominal error occurrences. For model validation data from a previous experiment were used, where ten participants performed a pursuit tracking task with transitions in controlled element dynamics from a single to a double integrator, and vice versa. Overall, with an added human operator delay and participant-specific inner- and outer-loop gain adjustments, the model was found to accurately describe the measured steady-state tracking behavior for the participants in our data set. The results for the time-varying single integrator to double integrator transitions showed that the model can capture the transient control behavior of participants. However, the adaptive logic could only be tuned to activate for participants that had a pre-transition crossover frequency above 0.9 rad/s. Furthermore, the model was not able to capture the change in control behavior for transitions from a double to a single integrator. Here, as no distinct degradation in tracking performance occurs for such a transition to a more easily controlled system, the model's proposed Triggering logic will not activate. Further investigation and more experiment data are required for improving the applicability of the model's adaptive logic and to enable more accurate prediction of adaptive human control behavior.@en

This paper considers the combined effect of two trends in commercial aviation. On the one hand, there is a continuing demand for pilots, implying that a new generation of pilots, will soon be flying our aircraft. On the other hand, legal aspects have had an adverse effect on innovation in the safety level of established procedures, leading to a trend for aircraft operating companies to adopt manufacturer’s recommended flight deck procedures rather than reviewing these and adapting these where appropriate to local needs. However, with the influx of new pilots to the workforce, the lack of innovation and adaptation of flight deck procedures poses a safety treat. The safety level of the aviation industry relies on the experience of the individual operator (pilot), the demands of the tasks and the available support tools. If the experience is not in the operator (pilot) we have to put the experience in the procedures to maintain the existing safety level in aviation. This conference paper is a plea to develop type, and operation, specific flightdeck procedures, adapted to present day operation and usable by the future pilot population. @en

Background. Mnemonic procedures are currently being taught to airline pilots to manage startle and surprise. We previously tested the effectiveness of a four-item mnemonic. Pilots generally rated it as useful but some remarked that it induced too much additional workload. Therefore, we tested whether a simpler mnemonic, Aviate-Breathe-Check, would be more useful. Method. The experiment took place in a hexapod simulator with a Piper Seneca aerodynamic model and a generic cockpit. Airline pilots (n = 25) were divided into an experimental (“ABC”) and control group. All received ground training on startle and surprise, which included instructions on the ABC mnemonic for the ABC group. The mnemonic aims to support prioritization of flight-path management (Aviate), followed by physiological and mental stress management (Breathe), followed by troubleshooting (Check). All pilots performed four familiarization scenarios, during which the ABC group practiced the ABC mnemonic. Two test scenarios were then performed to evaluate performance, mental effort, stress, and pilot evaluations of the ABC mnemonic. Results. The pilots’ evaluations of the ABC mnemonic were significantly higher than those were for the previously-tested mnemonic in the same scenarios. There were no significant differences between the ABC and control group in mental effort and stress, whereas there were trends towards higher mental effort and stress with the previous mnemonic. No significant effects on performance were found. Conclusions. The results suggest that the ABC mnemonic was more useful and easier to apply than a previously tested mnemonic. This is promising for the development of effective pilot training interventions for startle and surprise. @en

In academic air traffic control research, traffic scenarios are often repeated to increase the sample size and enable paired-sample comparisons, e.g., between different display variants. This comes with the risk that participants recognize scenarios and consequently recall the desired response. In this paper we provide an overview of mitigation techniques found in literature and conclude that rotating scenario geometries is most frequently used. The potential impact of these transformations on participant behavior, as described in this paper, is however not sufficiently addressed in most studies. As an example we, therefore, analyze previously collected eye tracking data from ten professional air traffic controllers, each presented with three repetitions in various rotations of several distinct scenarios. Results imply that researchers wishing to repeat scenarios should more carefully consider whether mitigation techniques might have an impact on their results.@en

The Continuous Descent Approach (CDA) offers reduced aircraft noise emissions and fuel consumption, but the obstacle limiting it to reduced traffic density conditions, is the low predictability of the trajectory and Estimated Time of Arrival (ETA). The solution proposed by this research is to develop a pilot support interface to facilitate the execution of a fixed flight path angle CDA, where thrust is not limited to idle and a velocity profile can be tracked, which will lead to a selected ETA. Initially, the CDA trajectory was investigated through an aerodynamic model, while the solution space of the ETA and the calculation of the stepwise velocity profile were defined. Following the analysis of the pilot’s role, a two-fold support interface was designed based on Ecological Interface Design (EID), with a Vertical Situation Display (VSD) playing a central role for planning and execution. The interface was tested in a MATLAB®/Simulink® setup and five pilots were recruited to execute simulations over different wind conditions. Their on-time performance was satisfactory, while they worked with the provided cues and suggested some interface changes to offer more flexibility. A more robust application of the proposed approach can lead to a wider adoption of the CDA, as a validated procedure.@en

Haptic cues on the side stick are a promising method to reduce loss of control in-flight incidents. They can be intuitively interpreted and provide immediate support, leading to a shared control system. However, haptic interfaces are limited in providing information, and the reason for cues may not always be clear to pilots. This study presents the results of the conceptual development of visual display symbology that supports haptic feedback on the side stick in communicating flight envelope boundaries to pilots. Novel indications for the limits of airspeed, load factor, angle of attack, and angle of bank, which for the first time simultaneously indicate magnitude and direction of the haptic cues, were integrated in an Airbus primary flight display. The symbology was tested in a pilot-in-the-loop experiment with professional Airbus pilots (N=16) flying several approaches in alternate law with haptic feedback. Objective results do not show clear improvements, although the time spent outside the flight envelope is slightly reduced. Subjective results indicate a preference, however, for the new display and an increased understanding of the haptic feedback. Further research is recommended to improve the interface design, remove unused indications, and test a bank scenario using current operational bank limits.@en

In the design of human-like steering support systems, driver models are essential for matching the supporting automation's behavior to that of the human driver. However, current driver models are very limited in capturing the driver's adaptation to key task variables such as road width and visibility (i.e., 'preview' of the road ahead). This paper uses a recently proposed, novel control-theoretical model for centerline tracking to investigate driver steering in lane-keeping tasks with restricted and unrestricted preview, in an attempt to substantially extend this model's validity. Using data from a tailored driving simulator experiment, three driver control loops (feedforward, heading and position feedback) are separately quantified using system identification techniques. The results show that when preview is restricted, drivers use all of the remaining preview to anticipate the curves of the road ahead, and are no longer able to 'smooth' tight curves in the road trajectory (i.e., corner cutting). When sufficient preview and lane width are available, the time to line crossing increases, and steering behavior is less aggressive and more intermittent, or more 'satisficing'. The novel driver steering model captures these adaptations very well (over 95% of the steering actions) and can thereby be instrumental in realizing human-like steering automation and support systems.

@en

Accurate process control through automation is the key to achieving efficient and stable operation of a blast furnace. In this study, we developed an automatic control system of hot metal temperature (HMT). To cope with the slow and complex process dynamics of the blast furnace, we constructed a control algorithm that predicts eight-hour-ahead HMT using a two-dimensional (2D) transient model and calculates optimal target pulverized coal ratio (PCR) and pulverized coal flow rate by non-linear model predictive control (NMPC). An evaluation in a real plant showed that the developed control system suppressed the effects of disturbances, such as changes in the coke ratio and blast volume, on the HMT. The root mean square (RMS) of the control deviation of HMT was successfully reduced by 1.6 °C compared to the conventional manual operation.

@en

In the quest for more efficient air traffic management, a common approach is to allocate an increasing amount of functionality to higher levels of automation, with a supervisory role for humans. This potentially leads to forthcoming issues such as skill degradation and out-of-the-loop phenomenon. If the traffic in an airspace is instead shared between a human operator and an automated system, with specific flights fully delegated to automation, operators can maintain their skills and stay actively involved in controlling the rest of the traffic. This does, however, lead to new forms of mixed conflicts, where two flights are controlled by different agents. A smart flight allocation strategy, starting with the delegation of basic flights requiring little monitoring or cognitive effort, is expected to improve combined human-automation performance. In this paper, we present flowcharts to model en-route air traffic controller cognitive think and action processes in two core tasks: conflict detection and resolution. We qualitatively describe the impact of delegating flights to automation and the associated introduction of mixed conflicts. Once empirically validated and quantified in follow-up research, these models can be used to design flight allocation strategies for future human-automation teams.@en

Mathematical human control models are widely used in tuning manual control systems and understanding human performance. Human behavior is commonly described using linear time-invariant models, averaging-out all non-linear and time-varying effects, which are gathered into the remnant. These models are limited in their capability to capture particular tracking strategies that an experienced subject may learn to use. In this paper, we consider manual control from a different perspective, namely through investigating the probability densities of the tracking error for different regions of the target signal amplitude. Results show that distinct strategies become apparent for compensatory, pursuit and preview tracking tasks. Effects of these strategies are often averaged-out by current models and can only be captured in situation-dependent models. Modeling this systematic human adaptation not captured in linear models could potentially lead to better model fits and explain/reduce part of the remnant.

@en