Remote Pilot Situational Awareness with Mixed Reality Glasses
Thursday, October 08, 2020: 1:00 PM - 1:45 PM
With the use of small unmanned aerial systems (sUAS) proliferating throughout the industry and public safety, it is imperative to ensure the safety of flight. The Federal Aviation Administration (FAA) published regulations for commercial use of sUAS in 2016 and included the requirement to maintain visual line-of-sight with the aircraft at all times. However, due to the nature of the sUAS ground control stations (GCS), remote pilots time-share between observing the aircraft and interacting with the display on the GCS. Time-sharing between the aircraft and GCS can be seen as similar to the cross-check a pilot uses when flying a manned aircraft. While manned aircraft designers have invested in the ergonomics and understanding of the cognitive process to optimize situational awareness, it has not been a design requirement for sUAS. The result is that the unmanned operator must change head orientation, eye-focus, and remove the aircraft from peripheral vision during the cross-check between the GCS and aircraft. This, coupled with the limited field of view of the sUAS GCS displayed camera, leads to loss of situational awareness through task saturation, and misprioritization. Mixed reality (MR), virtual reality (VR), and augmented reality (AR) visual devices are being adopted in the gaming and technical world. The application of these devices to sUAS GCS could mitigate the degradation of situational awareness. Specifically, the incorporation of MR devices where a synthetic display is overlayed on the real-world allows the remote pilot to observe the aircraft, manipulate the camera, and interact with the GCS without changing head position. This field study evaluated the difference between the remote pilot cross-check while flying with a typical GCS display and when flying with an MR headset.
Analyst,Engineering/Technical,Remote Pilot/Operator,Research & Development