RU130963U1 - AERIAL REALITY SYSTEM FOR DISPLAYING INFORMATION FOR AIRCRAFT CONTROL - Google Patents

Abstract

Information display system for aircraft control, including an orientation sensor that allows you to determine the three angular coordinates of the position of the observation line in space, a positioning sensor that allows you to receive three linear coordinates of the observation point in space, which is the receiver of GLONASS / GPS / SBAS high-precision global navigation systems, mobile a computer that generates a three-dimensional three-dimensional visual representation of the calculated trajectory, position forecast or real trajectory, and transparent stereo glasses with microdisplays or projectors of the image on the retina of the eye, allowing the pilot to see virtual three-dimensional objects positioned in real space in stereo mode, characterized in that stereo images of three-dimensional three-dimensional markers are used for visual representation of the calculated trajectory, the graphic properties of which, in particular shape, color, animation effects, display deviations of flight parameters from the calculated ones and are tips to the pilot to keep the air the ear vessel on the calculated trajectory with the given characteristics, while stereoscopic reproduction of three-dimensional volumetric markers allows the pilot to visually accurately assess the angular coordinates of the position of the aircraft.

Description

The utility model relates to aeronautical engineering, namely: to aircraft on-board equipment.

The level of technology.

There are known systems of spatial orientation of aircraft pilots and display of navigation and flight information using computer systems that generate two-dimensional symbols based on signals from aircraft sensors that characterize the spatial, angular position and components of the aircraft’s speed relative to the ground, and visualize the calculated trajectory with information displayed on an electronic display , the windshield of the cockpit, the transparent panel in front of the windshield of the cockpit or head-mounted module (US 4454496, RU 2173660). A method of visualizing a calculated trajectory using markers, which is a perspective sequence of frames that are perpendicular to the calculated trajectory and located along its axis, is known as a “tunnel-in-the-sky”. The image of the sky tunnel can be superimposed on the main flight display (Primary flight display, PFD, see figure 1) or on the display of the synthetic vision system (Synthetic Vision System, SVS, see figure 2)

The disadvantages of the known systems are the presence of a large amount of two-dimensional signographic information (angular position, altitude, speed of the aircraft), which scatters the pilot’s attention and requires mental conversion of symbolic information into an adequate representation of the environment and flight status, as well as the problems of displaying and perceiving three-dimensional objects on two-dimensional flat display. When using the SVS electronic display, there are also problems of dispersing attention, time spent for accommodating the pilot’s vision when switching attention from the space behind the cockpit to the display and vice versa, matching the viewing sectors and the scale of the real world image and the display image.

The technical task of the proposed utility model is to create a display system for controlling aircraft, providing spatial orientation of aircraft pilots, devoid of these shortcomings.

Close to the proposed utility model in terms of technical nature and the technical result achieved is the well-known system of forming the trajectory of an aircraft in space and displaying it to pilots and spectators using conditional virtual objects, demonstrated in the Rocket Racing League air show (http://www.membrana.ru/ articles / technic / 2010/04/27 / 130400.html). For pilots, a complex was used containing a head-mounted module having a positioning system that allows you to determine the linear coordinates of the position of the aircraft in space and the angular coordinates of the position of the pilot’s head, and a computer connected to it. The head module is made in the form of a helmet (Elbit Systems Targo Racer), on the flap of which two-dimensional projections of three-dimensional markers are displayed in the form of a series of virtual objects - flat frames that define the flight path. This method does not provide stereoscopic perception of the volumetric frames of the "sky tunnel", which reduces the effectiveness of spatial orientation.

Closest to the proposed utility model is the spatial orientation system of aircraft pilots during landing, described in the patent for utility model RF 107515. This utility model includes the formation of a virtual landing glide path using a complex containing a head module, a positioning system that includes a means for determining three linear and three angular coordinates of the position of the aircraft in space, a computer and a memory module associated with the coordinates of the landing glide paths, distinct yuschiysya that nagolovnym module is a mixed reality glasses with prisms for output to transparent glasses stereopairs virtual objects - markers landing glide path, the positioning system connected with a computer, generating a stereo pair of virtual objects - markers landing glide path points for the mixed reality. A significant difference of the proposed utility model is that the markers of the calculated trajectory are formed in the form of three-dimensional three-dimensional frames that are located in space along the horizon, which allows the pilot to more easily and quickly visually determine the angular and spatial position of the aircraft relative to these markers.

Disclosure of a utility model.

The technical result of the proposed utility model is to increase the efficiency of the spatial orientation of the pilots.

The specified technical result is achieved by the fact that the system for the spatial orientation of aircraft pilots consists in displaying flight information and the calculated trajectory combined with a real or virtual picture of the surrounding space, and the combination is performed using an augmented reality complex consisting of a head unit including transparent stereo glasses augmented reality with two transparent microdisplays and a positioning system that provides the definition of three linear coordinates AT position of the point of observation and three angular coordinates of the line of sight position in space, and the computer generates and transmits to the microdisplays augmented reality glasses stereo video in real time. Flight information can be supplemented by displaying a calculated forecast of the position or trajectory of the aircraft in the form of three-dimensional objects. The calculated trajectory is displayed as a series of three-dimensional virtual objects - volumetric frames tracing the flight path (see figure 3), which are located in space along the horizon. The stereoscopic perception of the volumetric frames allows the pilot to visually accurately assess the angular coordinates of the aircraft, while he does not experience additional load when mentally converting symbolic information into an adequate representation of the environment and flight status.

Well-noticeable characteristics of the display of frames (color, shape, animation effects, etc.) can be different, and can be used as symbols for the correspondence of the flight characteristics to the calculated ones (for example, red is the excess of the required flight speed). The dimensions, degree of transparency and frequency of displaying frames along the path are determined by the convenience of visual perception. Additionally, the boundaries of permissible deviations from the calculated trajectory can be displayed, in this case, the Sky Tunnel can be identified with a visual representation of the tube of permissible trajectories.

To obtain the linear coordinates in the positioning system, the GLONASS / GPS / SBAS certified compact receiver for high-precision navigation systems with enhanced accuracy for landing has been used (for example, the Garmin GTN 625). The angular coordinates of the position of the pilot’s head are generated by the orientation sensor included in the head module.

A significant difference between the proposed utility model and the closest analogue described in the “BACKGROUND OF THE INVENTION” section (RF patent 107515) is that the calculated trajectory markers are formed in the form of three-dimensional three-dimensional frames that are located in space along the horizon and have distinct spatial dimensions and position that allows the pilot, observing them in stereo 3D mode, with high accuracy to visually evaluate the angular coordinates of the aircraft. Along with fixed-size frames marking the trajectory, it is also proposed to display the boundaries of permissible deviations from the calculated trajectory, forming a visual representation of the tube of permissible trajectories. The difference of the proposed utility model is that the color, shape, animation effects and other visual features of the markers matter and display deviations of the flight parameters from the calculated ones, being for the pilot intuitive clues about keeping the aircraft on the calculated trajectory with the specified characteristics. In addition, a significant difference is the use of the GLONASS / GPS / SBAS receiver as a source of linear coordinates, since GLONASS / GPS receivers do not currently provide the accuracy required for a number of aviation applications.

A brief description of the illustrations.

Figure 1. An example of a sky tunnel display on a primary flight display (PFD). Illustration from a publication: Design of Tunnel-in-the-Sky Display and Curved Trajectory. Kohei Funabiki (Japan Aerospace Exploration Agency), 24th International Congress of the Aeronautical Sciences, 2004.

Figure 2. An example of displaying a sky tunnel on a Synthetic Vision System (SVS) display. Illustration from publication: Curved and steep approach flight tests of a lowcost 3d-display for general aviation aircraft. Sachs G., Speri R., Sturhan I. (Institute of Flight Mechanics and Flight Control, TU Munchen, Germany), 25th International Congress of the Aeronautical Sciences. Hamburg, Germany, 2006.

Figure 3. The proposed system for displaying the forecast of the aircraft position and 3D volumetric markers of the calculated trajectory.

Utility Model Implementation

Implementation of the proposed spatial orientation system for aircraft pilots is as follows.

The computer receives data on the position and speed of the aircraft in space from the positioning system and data on the spatial coordinates of the control point of the trajectory and the parameters of the approach to it. Based on these data, the computer calculates the real trajectory of the aircraft. The parameters of the calculated trajectory can also be calculated in advance and stored in the computer memory module. The computer generates stereopairs of three-dimensional virtual objects - markers for predicting the position or trajectory of the aircraft, volumetric markers-frames of the calculated trajectory, signographic symbols of other flight information and displays them on transparent microdisplays of stereo augmented reality glasses (see Fig. 3). Also, aeronautical information and information about other aircraft in the flight zone (for example, obtained from the ADS-B system) can be displayed on the glasses available on the computer’s memory or accessible via communication channels. In conditions of limited visibility, a stereo image of a three-dimensional model of the earth's surface and ground objects in the flight zone can be additionally displayed.

To implement the proposed utility model, an autonomous mobile computer having pocket sizes can be used. Mixed reality glasses are transparent glasses, or image projectors on the retina of the eye, which output a stereo pair of three-dimensional three-dimensional images of virtual objects formed by a computer. The pilot sees them together with the surrounding space, while the stereo effect allows not only to impose objects on the background, but to position them in space. When moving the observation point and turning the observation line (the observation point moves with the aircraft, the observation line can change independently) virtual objects remain in space “in place”, the pilot sees them as if they were real objects that can be approached , retire, inspect them from different sides. As transparent glasses of mixed reality, appropriate glasses manufactured by the industry, for example, Vuzix STAR 1200, equipped with a built-in orientation sensor, which allows determining three angular coordinates of the observation line in space, can be used. The linear coordinates of the observation point can be obtained using the GLONASS / GPS / SBAS compact GPS receiver (for example, the Garmin GTN 625), certified for aviation applications.

Due to the transparency of the glasses, the pilot retains visual control over the situation, but at the same time he sees markers for predicting the position or trajectory of the aircraft, markers of the calculated trajectory, the stereo three-dimensional images of which change in accordance with the movement of the aircraft, which is ensured by using data from the positioning system. Performing a flight inside the “sky tunnel” with holding the aircraft in the tube of permissible trajectories ensures an unmistakable following of the calculated trajectory at any visibility.

The use of the proposed utility model due to the stereoscopic reproduction of the calculated trajectory markers in the form of three-dimensional three-dimensional frames improves the accuracy and reliability of the spatial orientation of the pilots and enables them to perform error-free maneuvers regardless of weather and visibility conditions, including during landing. Thus, it is possible to solve the problem of the spatial orientation of the pilots, the loss of which is the cause of a number of major air crashes. The proposed utility model is implemented as a compact technical solution that fits in the pilot’s pocket and does not depend on the on-board power supply, which increases its reliability.

Claims (1)

Information display system for aircraft control, including an orientation sensor that allows you to determine the three angular coordinates of the position of the observation line in space, a positioning sensor that allows you to receive three linear coordinates of the observation point in space, which is the receiver of GLONASS / GPS / SBAS high-precision global navigation systems, mobile a computer that generates a three-dimensional three-dimensional visual representation of the calculated trajectory, position forecast or real trajectory, and transparent stereo glasses with microdisplays or projectors of the image on the retina of the eye, allowing the pilot to see virtual three-dimensional objects positioned in real space in stereo mode, characterized in that stereo images of three-dimensional three-dimensional markers are used for visual representation of the calculated trajectory, the graphic properties of which, in particular shape, color, animation effects, display deviations of flight parameters from the calculated ones and are tips to the pilot to keep the air the ear vessel on the calculated trajectory with specified characteristics, while stereoscopic reproduction of three-dimensional volumetric markers allows the pilot to visually accurately assess the angular coordinates of the position of the aircraft.

Images