WO2022078907A1 - Procédé de génération d'images pouvant être représentées par une visière pouvant être portée par un pilote d'un aéronef - Google Patents

Procédé de génération d'images pouvant être représentées par une visière pouvant être portée par un pilote d'un aéronef Download PDF

Info

Publication number
WO2022078907A1
WO2022078907A1 PCT/EP2021/077903 EP2021077903W WO2022078907A1 WO 2022078907 A1 WO2022078907 A1 WO 2022078907A1 EP 2021077903 W EP2021077903 W EP 2021077903W WO 2022078907 A1 WO2022078907 A1 WO 2022078907A1
Authority
WO
WIPO (PCT)
Prior art keywords
aircraft
visor
pitch
roll
yaw
Prior art date
Application number
PCT/EP2021/077903
Other languages
English (en)
Inventor
Felice Vinati
Samuele Vinati
Matteo Vinati
Giacomo Vinati
Mariachiara Vinati
Original Assignee
Ierom S.R.L.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ierom S.R.L. filed Critical Ierom S.R.L.
Priority to EP21783561.0A priority Critical patent/EP4226122A1/fr
Publication of WO2022078907A1 publication Critical patent/WO2022078907A1/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C23/00—Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0017—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information
    • G08G5/0021—Arrangements for implementing traffic-related aircraft activities, e.g. arrangements for generating, displaying, acquiring or managing traffic information located in the aircraft
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0047—Navigation or guidance aids for a single aircraft
    • G08G5/0052—Navigation or guidance aids for a single aircraft for cruising
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/0073—Surveillance aids
    • G08G5/0091—Surveillance aids for monitoring atmospheric conditions
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
    • G08G5/04—Anti-collision systems
    • G08G5/045—Navigation or guidance aids, e.g. determination of anti-collision manoeuvers

Definitions

  • VFR Visual Flight Rules
  • flight simulators are also well known, i . e . devices that use the computational power of current computers to recreate a virtual world closer to the real one than one can imagine .
  • the simulator and flight controls are then associated through actuators that measure exactly the movements of the flight controls, to the computer of the simulator that in turn synchronizes the movements of the flight controls with movements in the space of the simulator cabin that in turn are synchronized with the three- dimensional cartography that represents the virtual world in which the aircraft moves, in order to generate a feeling of maximal realism aimed at training new pilots or to maintain their professional condition.
  • glasses for three-dimensional (3D) visualization wearable by the pilot in training, where said 3D glasses are generally equipped with an inertial platform applied to them, which transmits instantaneous orientation data in space of the pilot ' s head, modifying the image of the virtual world created by the simulator on the basis of such data.
  • the principle of operation of the simulators of flight is the virtual representation of the reality, which in the context of the simulation can be assimilated to a cube (the virtual world) with a point in the center (the aircraft) , where it is the same cube that is moved as long as the software of the simulator calculates the new values of position and the other parameters attributed to the aircraft from the simulation.
  • flight simulators are extremely useful in pilot training, they certainly do not solve the problem of actual flying in bad weather and/or low visibility conditions .
  • An object of the present invention is to provide a means for the pilot to overcome adverse weather conditions or poor visibility on board any aircraft in particular an airplane, helicopter or other aircraft .
  • a further purpose of the present invention is to achieve the above results in a simple and economical manner.
  • the present invention achieves the above-described purposes by means of a method of generating images that can be represented by a visor that can be worn by an aircraft pilot, wherein said method provides for the use of an electronic control unit, equipped with a memory, said electronic control unit being configured to perform the phases of the method, wherein said method comprises at least the following phases :
  • An advantage of this embodiment is that the pilot, when wearing the visor, sees a virtual environment displayed in the same way he would have seen the same environment in which he is flying, but without undesirable atmospheric effects (fog, darkness, rain, etc. . ) .
  • the invention is also capable of ensuring that there is no delay in data processing, no connection disturbance, and that the dynamic graphic representation is always correct .
  • said images are associated with visual and/or acoustic alarms in case said aircraft is in the proximity of or on a collision course with obstacles present on the territory, and wherein the position of said obstacles is stored in the memory associated with said electronic control unit on the basis of pre-made maps .
  • This realization increases flight safety especially at low altitudes .
  • FIG. 2 illustrates a block diagram of the main steps of the method of the invention.
  • FIG. 3 schematically illustrates a calibration step of the spatial orientation of a viewer used in the method of the invention.
  • inertial platform will be understood as meaning, as is it known, a device comprising a set of sensors allowing the determination of the orientation in space of a given object to which said inertial platform is applied.
  • the inertial platforms may each comprise, for example, a three-axis accelerometer and a three-axis gyroscope and a magnetometer, wherein all said components may be managed by an electronic control unit, provided with a microprocessor, and by an appropriate software .
  • a helicopter is concerned (but the invention is applicable to any other types of aircraft such as an airplane or other) , wherein said aircraft 10 is also represented with its three axes of yaw Y, roll R and pitch P.
  • the inertial platform 30 may comprise, for example, a three-axis accelerometer 32 and a three-axis gyroscope 34 as well as a magnetometer 36, wherein all said components may be managed by an electronic control unit 450, equipped with a microprocessor.
  • the electronic control unit 450 is configured to perform the various steps of the method of the invention and makes use of a memory 460 that contains software and operating data.
  • the electronic control unit 450 may be part of a computer or other electronic computing system and is located on board the aircraft 10, as is the memory 460 that contains the aeronautical simulation software .
  • the pilot C is provided with a three-dimensional type of visor 20, which can be constituted by a helmet or simply by 3D glasses; in any case, the visor 10 is provided with screens placed in correspondence of the eyes of the pilot C, said screens being suitable to represent a virtual environment .
  • the visor 20 may be affixed to the helmet of the pilot C or, alternatively, may be affixed to a system that also includes a headset for radio communications .
  • the viewer 20 is also shown in figure 1 with its own yaw Y' , roll R' and pitch P' axes and geographic direction or orientation, for example with respect to North.
  • the viewer 20 allows for graphical visualization of the external virtual world from the pilot ' s point of view, as further discussed below.
  • An inertial platform 40 is also attached to the viewer 20, which has the task of determining instant by instant the orientation in space of the viewer 20 and its geographical orientation with respect to a fixed reference, for example North.
  • the inertial platform 40 may comprise, for example, a three-axis accelerometer 42 and a three-axis gyroscope 44, as well as a magnetometer 46, wherein all said components may also be managed by the electronic control unit 450.
  • connection between the viewer 20, the inertial platform 40 and the electronic control unit 450 may be wireless or may be made by traditional means or by cable.
  • a camera 97 is attached to the viewer 20, which allows the scene outside the viewer 20 to be filmed, in particular the aircraft instrumentation 10 and the flight controls .
  • the invention also provides for the use of the GPS (Global Positioning System) system placed on board the aircraft 10 in order to determine the spatial coordinates of latitude and longitude, as well as of altitude, of the aircraft 10, coordinates provided precisely by the GPS system 50.
  • GPS Global Positioning System
  • the input of the spatial coordinates of latitude, longitude and altitude of the aircraft 10 is an information that allows the computer system representing the virtual world, to generate a representation of the virtual world derived from the position, at that moment, consequent to the GPS - Global Positioning System - coordinates of the aircraft 10 in flight .
  • the method of the invention provides a step of real- time detection of the geographical position of the aircraft that is carried out with the help of a GPS detector placed on board said aircraft .
  • GPS system could be replaced or combined with other known geolocation systems, for example GLONASS, BEIDOU, GALILEO, A-GPS, QZSS or others without going beyond the scope of the invention decriminated and claimed.
  • the speed of the aircraft 10 that gives rise to the realtime change in the virtual world may be inferred or determined by the change in geographic coordinates measured in real-time by the geolocation detector 50.
  • the geolocation detector 50 may also detect the altitude of the aircraft 10 and its variation over time, consequently determining the current flight levels of the aircraft 10 and communicating them to the control unit 450 that manages the simulation of the environment outside the aircraft 10.
  • This calibration can be done using a compass 60 or a magnetometer or using the information given by the known orientation of the runway or by other known means .
  • This calibration can be performed by having a straight-headed pilot C observe a fixed reference 70 placed on the cockpit of the aircraft 10, for example with the aid of the camera 97.
  • Other methods of calibration are however possible (figure 3) .
  • Such a calibration may, alternatively, also be performed in flight, after having worn the visor 20, since it serves solely to calibrate the spatial orientation of the visor 20 with respect to the reference system integral with the aircraft 10, regardless of the geographical position and spatial orientation of the aircraft 10 itself .
  • a calibration step which may for example be performed when the aircraft 10 is initially located and the coordinates measured by the geolocation detector 50 placed on board said aircraft 10 at said position.
  • Figure 2 illustrates a block diagram of the main steps of the method of the invention.
  • the phase of real-time detection of roll, pitch and yaw data of the aircraft 10, as well as of geographic orientation is carried out with the aid of the inertial platform 30 placed on board said aircraft 10 and of the instruments proper to said inertial platform 30, namely the three-axis accelerometer 32, the three-axis gyroscope 34 and the magnetometer 36.
  • the method also includes collecting real-time roll, pitch and yaw data, as well as geographic orientation, from the visor 20 worn by the pilot C (block 110) .
  • the real time detection phase of the roll, pitch and yaw data, as well as of the geographic orientation, of the visor 20 worn by the pilot C is performed with the help of the inertial platform 40 placed on board said visor 20, and of the instruments belonging to said inertial platform 40, i . e . , the three-axis accelerometer 42, the triaxial gyroscope 44 and the magnetometer 46.
  • the method further comprises detecting in real time the geographic position of the aircraft 10 using a geolocation detector 50 placed on board said aircraft 10 (block 120) .
  • the detected data relating to the orientation in space of the aircraft 10 in flight is associated with the current geographical position data of the aircraft itself, determined by means of the geolocation device 50.
  • This calculation step is aimed at determining exactly the orientation of the viewer 20 with respect to the external environment (block 140) .
  • the method according to one aspect of the present invention coirprises representing on the visor 20 virtual images corresponding to the external environment that would be visible to the pilot C under normal visibility conditions (block 150) at the current geographical position and with the current spatial orientation of the aircraft 10.
  • the roll, pitch and yaw data of the aircraft 10 and the worn visor 20 are used to generate images viewable by the visor 20, wherein said images represent the environment outside the aircraft 10 at the current geographic location, taking into account the current orientations of the aircraft 10 and the visor 20.
  • the pilot will be able to "see” where he/she could' t before, he/she will be able to save that life that he/she could' t before .
  • system according to the invention allows for an increase in flight safety in conditions of fog or poor visibility, allowing aircraft flying VFR and also for those equipped with IFR instrumentation to fly in conditions of absolute visibility.
  • the system of the invention makes any aircraft an instrument aircraft at an absolutely affordable cost.
  • VIFR - Visual Instrument Flight Rules - can be considered i .e . the condition made possible by the present invention to be able to practice visual flight with visual flight rules but with assisted or autonomous flight systems equal to instrument flight.
  • the system can also have - in addition - a mapping of the obstacles present at low altitude .
  • the electronic control unit 450 may receive a danger signal or a green light ("landing allowed" ) , as the case may be, signal sent, for example, by rescuers who have arrived on the scene before the helicopter and update the representation of the virtual environment provided to the pilot C accordingly, all to the advantage of flight safety.
  • the transmission of data related to the safety of the aircraft from external sources to the electronic control unit 450 takes place via a data link operating with 5G technology.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Atmospheric Sciences (AREA)
  • Navigation (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'objet de l'invention est de fournir un procédé de génération d'images pouvant être représentées par une visière (20) pouvant être portée par un pilote d'un aéronef (10), ledit procédé comprenant au moins les étapes suivantes consistant à : enregistrer en temps réel au moins les données de roulis, de tangage et de lacet de l'aéronef (10) ; - au moins les données de roulis, de tangage et de lacet de la visière (20) portée en temps réel ; - détecter en temps réel au moins la position géographique de l'aéronef (10) ; - utiliser les données de roulis, de tangage et de lacet de l'aéronef (10) et de la visière usée (20) pour générer des images pouvant être visualisées par ladite visière (20), lesdites images représentant l'environnement extérieur dudit aéronef (10) à ladite position géographique.
PCT/EP2021/077903 2020-10-12 2021-10-08 Procédé de génération d'images pouvant être représentées par une visière pouvant être portée par un pilote d'un aéronef WO2022078907A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP21783561.0A EP4226122A1 (fr) 2020-10-12 2021-10-08 Procédé de génération d'images pouvant être représentées par une visière pouvant être portée par un pilote d'un aéronef

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT102020000024013 2020-10-12
IT102020000024013A IT202000024013A1 (it) 2020-10-12 2020-10-12 Metodo per generare immagini rappresentabili da un visore indossabile da un pilota di un velivolo

Publications (1)

Publication Number Publication Date
WO2022078907A1 true WO2022078907A1 (fr) 2022-04-21

Family

ID=74068432

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2021/077903 WO2022078907A1 (fr) 2020-10-12 2021-10-08 Procédé de génération d'images pouvant être représentées par une visière pouvant être portée par un pilote d'un aéronef

Country Status (3)

Country Link
EP (1) EP4226122A1 (fr)
IT (1) IT202000024013A1 (fr)
WO (1) WO2022078907A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5072218A (en) * 1988-02-24 1991-12-10 Spero Robert E Contact-analog headup display method and apparatus
JPH06265627A (ja) * 1993-03-12 1994-09-22 Mitsubishi Heavy Ind Ltd 飛行体用衝突回避装置
EP0911647A2 (fr) * 1997-08-28 1999-04-28 Japan Defence Agency Système de vol et système d'avion pour générer des images virtuelles
US7266446B1 (en) * 2003-05-13 2007-09-04 Pelosi Michael J Helmet mounted tracking system and method
US20130120164A1 (en) * 2011-11-14 2013-05-16 Safe Flight Instrument Corporation Obstacle detection & notification system
US20160189426A1 (en) * 2014-12-30 2016-06-30 Mike Thomas Virtual representations of real-world objects
US20180075762A1 (en) * 2016-09-09 2018-03-15 Garmin International, Inc. Obstacle determination and display system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5072218A (en) * 1988-02-24 1991-12-10 Spero Robert E Contact-analog headup display method and apparatus
JPH06265627A (ja) * 1993-03-12 1994-09-22 Mitsubishi Heavy Ind Ltd 飛行体用衝突回避装置
EP0911647A2 (fr) * 1997-08-28 1999-04-28 Japan Defence Agency Système de vol et système d'avion pour générer des images virtuelles
US7266446B1 (en) * 2003-05-13 2007-09-04 Pelosi Michael J Helmet mounted tracking system and method
US20130120164A1 (en) * 2011-11-14 2013-05-16 Safe Flight Instrument Corporation Obstacle detection & notification system
US20160189426A1 (en) * 2014-12-30 2016-06-30 Mike Thomas Virtual representations of real-world objects
US20180075762A1 (en) * 2016-09-09 2018-03-15 Garmin International, Inc. Obstacle determination and display system

Also Published As

Publication number Publication date
EP4226122A1 (fr) 2023-08-16
IT202000024013A1 (it) 2022-04-12

Similar Documents

Publication Publication Date Title
US11410571B2 (en) Augmented reality for vehicle operations
JP3052286B2 (ja) 飛行システムおよび航空機用擬似視界形成装置
EP1840861A2 (fr) Imagerie virtuelle avec détection par l'avant
US7215256B2 (en) Method and apparatus for displaying attitude, heading, and terrain data
US20060066459A1 (en) Multi-view head-up synthetic vision display system
US11189189B2 (en) In-flight training simulation displaying a virtual environment
US9389097B2 (en) Aircraft display systems and methods for enhanced display of flight path information
RU2497175C1 (ru) Система визуализации полета и когнитивный пилотажный индикатор одновинтового вертолета
US9864194B2 (en) Systems and methods for displaying FOV boundaries on HUDs
GB2564675A (en) A landing system for an aerial vehicle
WO2024087764A1 (fr) Procédé et système visuels synthétiques de navigation evtol
EP4226122A1 (fr) Procédé de génération d'images pouvant être représentées par une visière pouvant être portée par un pilote d'un aéronef
US20160362190A1 (en) Synthetic vision
US10249267B2 (en) Method for graphically representing a synthetic three-dimensional view of the exterior landscape in an on-board visualisation system for aircraft
CN107591031B (zh) 自动调整外部景观的三维合成表示中的可见范围的方法
CN113409649B (zh) 一种前庭性倾斜错觉模拟方法、装置及飞行错觉模拟器
Waanders et al. Sensor supported pilot assistance for helicopter flight in DVE
WO2003096303A1 (fr) Affichage d'elements
US20240327027A1 (en) Augmented reality system for aircraft pilots using third party data
Reynolds Unusual airborne simulator applications
McDevitt The last 200 feet-A low-cost approach to landing aircraft in zero-zero conditions
CN117222864A (zh) 用于显示关键和非关键信息的系统
JP2024516481A (ja) リモートコントローラを用いてドローンを飛行させる人間のオペレータを支援する装置、方法およびソフトウェア
Day THE USE OF SYSTEM SIMULATION DURING THE DEFINITION PHASE
Ercoline et al. Spatial disorientation, geographic disorientation, loss of situation awareness, and controlled flight into terrain

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21783561

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021783561

Country of ref document: EP

Effective date: 20230512