EP2533095B1 - Piloting assistance system and aircraft - Google Patents

Description

The present invention relates to a piloting assistance system and to an aircraft provided with said system.

More particularly, the piloting assistance system is in the technical field of devices for displaying information on a helmet, sometimes called "helmet visor or visual".

It should be noted that the term "piloting aid system" means a short-term piloting aid system as such, but also a navigation aid system and the monitoring of the aircraft.

Devices are known for presenting an pilot of an aircraft with an image representing the environment external to this aircraft, using night vision or infrared vision sensors or during degraded climatic conditions for example. The image is displayed on a means of viewing the pilot's helmet, for example, or on a means of display known as "head-up".

It is recalled that when the pilot looks at the external environment through the windshield of an aircraft, it is common to indicate that he is in a "head up" position. Conversely, when the pilot looks inside the cockpit and in particular a dashboard, it is common to indicate that the pilot is in a "head down" position.

For example, the device known under the name "VIGILX®" is known.

This device includes infrared optical cameras to determine a panoramic image at night or during flight phases with reduced visibility in particular.

In addition, it is possible to display a digital representation of the environment superimposed on the determined image from a digital terrain model.

The image can be displayed on a “head down” screen or even projected onto a visor of a helmet.

A device is also known for a piloting camera, the line of sight of which is slaved to the position of a pilot's helmet. On the other hand, it is understood that the device is then only controlled by the movements of the head of a single crew member.

Furthermore, it is common to carry out a cyclic redundancy check known by the acronym "CRC" to detect the presence of errors in a signal. Reference is made to the literature for information relating to such a control.

It is possible to carry out such a check for example to verify that the image sent on a “head down” screen or even on a visor of a helmet is not erroneous.

However, it should be noted that the calculations to be performed are relatively complex and time-consuming to perform.

In addition, the technological background notably includes documents EP 1 116 210 B1 , EP 1 344 021 B1 , EP 1 757 906 A2 , WO 2005/124685 A1 , EP 2 254 039 A1 , and EP 1,762,825 A2

The document EP 1 116 210 B1 describes a flat screen system for displaying data relating to system parameters aircraft comprising a flat screen and two processors each interfaced to a graphical color generator.

The document EP 1 344 021 B1 relates to a flat screen display system.

Likewise, the document EP 1 757 906 A2 is aimed at such a system provided with a general processing processor receiving data coming from on-board sensors and a graphics processor for the generation of pixelated images from a video memory, the processing processor comprising an integrity control function for checking at least one pixel of the image.

The document WO 2005/124685 A1 presents a system for verifying the accuracy of an image generated by a display processor, using a correlator circuit.

The document EP 2 254 039 A1 describes a display module provided with means for verifying a part of an image generated by a processor.

The document EP 1,762,825 A2 relates to a flat screen provided with a means of verifying the integrity of an image.

The document US 2010/0123839 presents a method in particular for producing three-dimensional images.

According to this method, an image is produced and information relating to the position of the head of an individual is determined. Consequently, a computer determines the LEDs of a display means to be used for emitting an image respectively and sequentially towards a left eye and a right eye. The document US 4,994,794 A aims at a binocular system generating a stereoscopic effect.

The embodiments are set out in the attached set of claims; other examples called embodiments or aspect in the description are illustrative examples and not embodiments claimed in the present application. The object of the present invention is therefore to propose a piloting assistance system capable of rapidly sending an image to a plurality of pilots.

According to the invention, a system for assisting the piloting of an aircraft is provided with means for determining piloting information.

This piloting assistance system is notably remarkable in that it comprises at least one portable display system on the head of a pilot, the display system being provided with a left display means capable of being facing a left eye of the pilot and a right display means capable of being facing a right eye of this pilot, the determination means including a first means for processing the piloting information as well as a second means for processing this control information comprising stored instructions for requesting the display of the information simultaneously and respectively on the left display means and on the right display means.

Consequently, a determination means is used to determine piloting information, this information possibly including data or even an image representing the environment external to the aircraft for example.

This information is processed not by a single computer but by a first processing means and a second processing means, to be displayed respectively not on a single display means but on a left display means visible to the eye left of a pilot and on a right display visible to the right eye of the same pilot.

Indeed, the left display means and the right display means are two means of a portable display system, arranged on a helmet or goggles worn by a pilot.

This device does not imply the implementation of long processing methods to check the consistency of the information transmitted, such as a cyclic redundancy check. Indeed, if a processing means is defective, the information displayed on the left display means differs from the information displayed on the right display means. The pilot then noted the discrepancy and deduced a dysfunction.

It is understood that the control of the coherence of the information transmitted is finally carried out quickly by the brain of a pilot.

Furthermore, it is noted that the information can be displayed on a plurality of display systems, for example a display system of a pilot and a display system of a co-pilot. Consequently, with the same means of determining information, it is possible to transmit this information to a plurality of display systems.

The invention may further include one or more of the following additional features.

• une vitesse de rotation d'une voilure tournante,
• l'attitude de l'appareil
• une vitesse air de l'aéronef,
• une altitude barométrique de l'aéronef,
• une hauteur de l'aéronef,
• une quantité de carburant restant dans l'aéronef,
• un facteur de charge de l'aéronef, et
• une information de première limitation d'une source motrice de l'aéronef.

For example, the piloting assistance system may comprise at least one primary data sensor of the means for determining piloting information, this primary data sensor being connected to the first processing means and to the second processing means. The first processing means and the second processing means consequently comprise stored instructions for determining at least one item of information relating to a datum to be chosen from a list including at least:

• a speed of rotation of a rotary wing,
• the attitude of the device
• an air speed of the aircraft,
• a barometric altitude of the aircraft,
• a height of the aircraft,
• an amount of fuel remaining in the aircraft,
• an aircraft load factor, and
• first limitation information from a power source of the aircraft.

The system can therefore include a set of data sensors transmitting to each processing means data from said list. These data sensors can be of a usual type. It is understood that by "data sensor" is meant equipment capable of transmitting information useful for piloting an aircraft.

As a result, each processing means determines information to be displayed using the primary data from the data sensors. Each display means then fulfills the function of a symbol generator capable of requiring the display of symbols relating to data.

According to another aspect, the piloting assistance system can comprise a means of capturing images of the means for determining piloting information.

This image capture means is provided with at least one camera connected to the first processing means and / or to the second processing means. The first processing means and the second processing means comprise stored instructions for reconstructing an image of the exterior of the aircraft using the capture means.

It should be noted that the term "image" means a representation of the terrain present outside the aircraft.

In addition, the term “camera” means equipment capable of transmitting an indication relating to the representation of an element of the external environment. Consequently, the capture means can comprise for example at least one camera as such, an infrared optical sensor also called “infrared optical sensor”, or even at least one optical sensor with low light level also called “low optical sensor”. light level ".

The first processing means and the second processing means can reconstitute a representation of the external environment.

Consequently, the first processing means and the second processing means can command the display of information including an image reconstituted simultaneously and respectively on the left display means and on the right display means.

It should be noted that the display of the image can be reduced to certain flight phases.

For example, in normal visual flight mode, the display system can display only primary information relating to the data previously described in particular.

On the other hand, in night view or instrument flight mode, the display system can additionally display an image representing the environment of the terrain located outside the aircraft.

It is therefore conceivable to inhibit the display of the image outside the night or instrument flight phases.

According to one embodiment, the capture means can comprise at least one image sensor of the type used in the "VIGILX®" system connected to the first processing means and to the second processing means.

According to another embodiment, the capture means comprises a plurality of cameras each directed towards a sector of a sphere surrounding said aircraft.

Optionally, two adjacent cameras cover two partially overlapping sectors.

Thus, the same set of cameras can be used to display an external environment on a plurality of display systems.

Furthermore, the piloting assistance system may include means for positioning said display system connected to the first processing means and to the second processing means. The first processing means and the second processing means comprise stored instructions for determining information including an image of the exterior of the aircraft present in the pilot's field of vision.

Consequently, each processing means exploits the indications coming from the image capturing means and from the positioning means to require the display of a representation of the external environment potentially visible to the individual wearing the display system. The image determined is restricted to the field of vision of said individual.

According to another aspect, the positioning means being able to identify a “head down” position of the display system occurring when a pilot looks inside the cockpit of an aircraft, the first processing means and the second processing means comprise stored instructions for suspending the display of the image in said “head down” position.

Thus, the individual wearing the display system is not disturbed by the display of an image representing the external environment when he looks inside the cockpit.

Furthermore, the piloting assistance system may include a digital terrain model connected to the first processing means and to the second processing means. The first processing means and the second processing means comprise stored instructions for controlling the display of information including a digital representation of the terrain simultaneously and respectively on the left display means and on the right display means.

Thus, each processing means may require the display of a digital representation of the terrain superimposed on a reconstructed image of this terrain originating from an image capture means, in order to consolidate the representation of this terrain.

It is noted that the areas of the consolidated digital representation, namely the areas of this digital representation corresponding to areas of the image, and the areas of the unconsolidated digital representation can be displayed in a different manner to allow the individual to quickly carrying the display system to distinguish reliable information from information coming only from a digital terrain model.

In addition, the piloting assistance system may include a means of deactivation of the display of information on at least one of said display means, said deactivation means being operable by the pilot in the event of dissimilarity between the information displayed on the left display means and on the right display means.

When a pilot wearing a display system notices a dissimilarity between the information transmitted to his left eye and the information transmitted to his right eye, this individual can maneuver the deactivation means to possibly deactivate the left display means, or the right display means, or the left display means and the right display means or even a fixed emergency screen if necessary.

The deactivation means can be a rotary button for example.

According to another aspect, the piloting assistance system may comprise at least one fixed on-board screen connected to said first and second processing means for displaying said information.

This fixed screen can in particular be used in the event of a malfunction of the portable display system, the fixed screen therefore representing an emergency screen.

In addition, positioning means capable of locating a “head down” position of the display system occurring when a pilot looks inside the cockpit of an aircraft, the first processing means and the second processing means comprise instructions. stored to display a representation of a virtual dashboard.

In addition, the system may include touch screens arranged on the instrument panel of the aircraft.

Indeed, the dashboard can be a virtual dashboard provided with real touch screens and / or voice commands. For example, touch screens include control boxes that can be configured automatically depending on the flight phase to allow access to the required data. According to one embodiment, it is conceivable to implement two screens, a first screen arranged horizontally and a second screen located above the first screen without nevertheless obstructing the forward vision vision of a pilot.

When the pilot switches to a “head down” vision, the display system presents a representation of the piloting screens, the pilot being able to carry out these usual operations by pressing on the touch screens.

Optionally, the first processing means and the second information processing means comprise stored instructions for requesting the display of said information simultaneously and respectively on the left display means and on the right display means according to a point of view. 'a left eye and a point of view of a right eye to achieve a stereoscopic display.

From a digital terrain model, each processing means can calculate an image according to the eye associated with it, taking into account the orientation of the pilot's head, and thus provide this pilot with stereoscopic vision. This solution uses the natural perception of the relief by stereoscopic vision, so the pilots perceive in a natural way the external environment through the various sensors used.

In addition to a piloting aid system, the invention relates to an aircraft comprising such a piloting aid system

• la figure 1, un schéma d'un aéronef selon l'invention,
• la figure 2, un schéma présentant un affichage de données,
• la figure 3, un schéma présentant un affichage cohérent d'informations,
• la figure 4, un schéma présentant un affichage incohérent d'informations, et
• la figure 5 un schéma présentant deux caméras d'un moyen de captation.

The invention and its advantages will appear in more detail in the context of the description which follows with examples of embodiment given by way of illustration with reference to the appended figures which represent:

• the figure 1 , a diagram of an aircraft according to the invention,
• the figure 2 , a diagram presenting a display of data,
• the figure 3 , a diagram presenting a coherent display of information,
• the figure 4 , a diagram presenting an inconsistent display of information, and
• the figure 5 a diagram showing two cameras of a means of capture.

The elements present in several separate figures are assigned a single reference.

The figure 1 presents an aircraft 1 according to the invention provided with a piloting assistance system 10. It should be noted that the other members of this aircraft are not shown so as not to unnecessarily burden this figure 1 .

The piloting assistance system 10 is provided with a set of instruments 25 communicating with a determination means 20. In fact, these instruments 25 transmit to the determination means 20 indications relating to information useful for piloting the aircraft 1. For example, the instruments 25 transmit signals to the determination means 20 relating to flight data or the environment outside the aircraft.

The piloting assistance system 10 then includes a display device 45 comprising at least one display system 40 of this information which can be worn by an individual. For example, the piloting assistance system 10 includes a first display system 40 arranged on the head of an aircraft pilot and a second display system 40 arranged on the head of a co-pilot of the aircraft.

Each display system 40 is provided with a left display means 41 for presenting the piloting aid information to the left eye of an individual and a right display means 42 for presenting said information to the right eye of the individual.

The left display means 41 and the right display means 42 can be arranged on a helmet or on transparent lenses of a pair of glasses.

The left display means 41 and the right display means 42 can be distinct by having no display area in common, although possibly arranged on the same support.

Consequently, the determination means comprises a first processing means 21 communicating with the instruments 25 and a second processing means 22 communicating with these instruments 25. It is noted that the first processing means 21 can also communicate with the second means of treatment 22.

Consequently, the first processing means 21 comprises a processor type processing unit for example and a memory containing instructions. The processing unit of the first processing means 21 executes the instructions stored in order to process the indications coming from the instruments 25 to require the display of information on the left display means 41 of each display system 40.

Likewise, the second processing means 22 comprises a processor type processing unit for example and a memory containing instructions. The processing unit of the second processing means 22 executes the stored instructions in order to process the indications coming from the instruments 25, to request the display of information on the right display means 42 of each display system 40.

This information can include piloting aid data, and / or images representing the environment external to the aircraft.

Consequently, the instruments 25 can include primary data sensors 35 connected to the first processing means 21 and to the second processing means 22.

• une vitesse de rotation d'une voilure tournante,
• l'attitude de l'appareil
• une vitesse air de l'aéronef,
• une altitude barométrique de l'aéronef,
• une hauteur de l'aéronef
• une quantité de carburant restant dans ledit aéronef,
• un facteur de charge de l'aéronef, et
• une information de première limitation d'une source motrice de l'aéronef.

The term “data sensor” is understood to mean a device capable of determining data facilitating the piloting of the aircraft. Thus, the first processing means 21 and the second processing means 22 comprise stored instructions for determining at least one item of information relating to a datum to be chosen from a list including at least:

• a speed of rotation of a rotary wing,
• the attitude of the device
• an air speed of the aircraft,
• a barometric altitude of the aircraft,
• aircraft height
• an amount of fuel remaining in said aircraft,
• an aircraft load factor, and
• first limitation information from a power source of the aircraft.

• une information de première limitation d'une source motrice de l'aéronef 100
• un vecteur vitesse 101,
• une vitesse air 102 de l'aéronef,
• un horizon artificiel 103,
• une hauteur radiosonde 104 de l'aéronef,
• une quantité de carburant 105 restant dans ledit aéronef,
• le cap 106 suivi par l'aéronef,
• une zone de posé 107,
• une donnée de vent 108 relative à la vitesse et/ou à la direction du vent,
• une donnée de localisation 109 relative à un point de passage du plan de vol à atteindre.

With reference to the figure 2 each processing means 21, 22 may be a symbol generator controlling the display on the display means 41, 42 associated with the following information using the required primary data sensors 35:

• first limitation information from a power source of the aircraft 100
• a speed vector 101,
• an air speed 102 of the aircraft,
• an artificial horizon 103,
• a radiosonde height 104 of the aircraft,
• an amount of fuel 105 remaining in said aircraft,
• heading 106 followed by the aircraft,
• a landing zone 107,
• wind data 108 relating to wind speed and / or direction,
• location data 109 relating to a point in the flight plan to be reached.

Among the “data” type information, it is conceivable to implement a representation of a dashboard. So, when the individual looks inside the cockpit and in a predetermined sector, the determination means can display the representation of usual screens.

The dashboard is then a "virtual" board including real touch screens allowing a pilot to request the display of specific data on his display system.

In addition, with reference to the figure 1 , the instruments 25 can include a means 30 for capturing images of the external environment connected to the first processing means 21 and to the second processing means 22.

Each processing means 21, 22 reconstitutes a representation of this external environment and requires the display of the corresponding image simultaneously on the associated display means 41, 42.

The capture means can comprise at least one camera 31, namely at least one means capable of capturing a representation of the external environment.

For example, with reference to the figure 5 , the capture means comprises a plurality of cameras 31 each directed towards a sector S1, S2 of a sphere surrounding the aircraft 1.

Note that it is possible to overlap the sectors, two adjacent sectors S1, S2 partially overlapping.

At a given instant, the pilot directs his gaze into a field of vision S0 partially covering two adjacent sectors S1, S2 on the example of the figure 5 .

Therefore, with reference to the figure 1 , according to a preferred embodiment, the piloting assistance system 10 includes a means of positioning 43 of each display system 40, each positioning means 43 communicating with the first processing means 21 and the second processing means 22.

Consequently, each processing means can execute instructions to reconstitute an image of the external environment present only in the field of vision S0 of the individual wearing the display system, and require the display of information relating to this image on the associated display means.

For example, the first processing means 21 can on the one hand determine an image seen by the left eye of a pilot wearing a first display system and control the display of this image on the associated left display means , and, on the other hand, determine an image seen by the left eye of a co-pilot wearing a second display system and require the display of this image on the associated left display means.

Likewise, the second processing means 22 can on the one hand determine an image seen by the right eye of a pilot wearing a first display system and require the display of this image on the right display means, and, on the other hand, determining an image seen by the right eye of a co-pilot wearing a second display system and requesting the display of this image on the associated right display means.

Furthermore, the instruments 25 can include a digital terrain model 33, containing a digital representation of the external environment.

The first processing means 21 and the second processing means 22 then comprise stored instructions for requesting the display of information including a representation digital of the terrain simultaneously and respectively on the left display means 41 and on the right display means 42.

This representation can be displayed superimposed on an image of the external environment reconstituted by the determination means 20 using the capture means 30 or “merged” by the processing means 21 and 22.

It should be noted that certain information may not be displayed on the display systems during certain flight phases.

For example, it is possible to display information of the “data” type continuously.

On the other hand, according to one embodiment, the determination means 20 require the display of images representing the external environment during a blind flight or during a night flight.

In addition, the positioning means 43 being able to identify a “head down” position of the display system 40 occurring when a pilot looks inside the cockpit of an aircraft, the first processing means 21 and the second processing means 22 may include stored instructions for suspending the display of an image representing the external environment in the "head down" position.

It is noted that the piloting assistance system can also include a control means 51 so that a user can choose the nature of the information displayed.

• l'affichage d'informations de type « données » uniquement,
• l'affichage d'informations de type « images » uniquement, l'image pouvant inclure une représentation numérique de l'environnement extérieur et/ou une représentation de l'environnement réalisée à l'aide de moyens de captation 30, ou une combinaison des deux,
• l'affichage d'informations de type « données » et « images ».

The control means 51 can, for example, authorize the following choices:

• the display of "data" type information only,
• the display of information of “image” type only, the image being able to include a digital representation of the external environment and / or a representation of the environment produced by means of capture means 30, or a combination of the of them,
• display of “data” and “image” type information.

According to another aspect, the piloting assistance system 10 can include at least one fixed screen 60 on board, connected to the first processing means 21 and to the second processing means 22.

The information displayed on the display system can then also be displayed on the fixed screen 60, this screen can be of the "head up" or "head down" type.

Furthermore, with reference to the figure 3 , the information displayed on the left display means 41 and the right display means 42 of a display means 40 must be similar when the system is operating correctly.

However, with reference to the figure 4 , in the event of a malfunction, significant differences may appear. Consequently, these differences are noted by the brain of the user wearing the display system.

The pilot therefore deduces a dysfunction of the piloting assistance system.

With reference to the figure 1 , the piloting assistance system can then comprise a control means 50 for restricting the display of information to the various left display means 41 or even to the various right display means 42, or even to the screens 60.

In addition, the first processing means 21 and the second processing means 22 of said information can include stored instructions for requesting the display of said information simultaneously and respectively on the left display means 41 and on the right display means 42 from a point of view of a left eye and a point of view of a right eye to achieve a stereoscopic display.

Naturally, the present invention is subject to numerous variations as to its implementation. Although several embodiments have been described, it is understood that it is not conceivable to identify exhaustively all the possible modes.

Claims (14)

1. Piloting assistance system (10) for an aircraft (1) provided with determination means (20) for determining piloting information, comprising at least one display system (40) wearable on the head of a pilot, the display system (40) being provided with left display means (41) suitable for being viewed by a left eye of said pilot and right display means (42) suitable for being viewed by a right eye of said pilot, said determination means (20) including first processor means (21) and second processor means (22) containing stored instructions for causing the same information to be displayed simultaneously and respectively on the left display means (41) and on the right display means (42); and in which the first processor means and the second processor means control the display of said same information simultaneously and respectively on the left display means and on the right display means; and which comprises deactivation means (51) for deactivating the display of the information on at least one of the display means (41, 42), said deactivation means (51) being operable by the pilot in the event of a lack of similarity between the information displayed on the left display means (41) and on the right display means (42).
2. System according to claim 1, characterised in that it comprises at least one primary data sensor (35) connected to the first processor means (21) and to the second processor means (22), said first processor means (21) and said second processor means (22) containing stored instructions for determining at least one item of information relating to data to be selected from a list including at least:

   - a speed of rotation of a rotary wing;

   - the attitude of the aircraft;

   - an air speed of the aircraft;

   - a barometric altitude of the aircraft;

   - a height of the aircraft;

   - a quantity of fuel remaining on board the aircraft;

   - a load factor of said aircraft; and

   - first limit information for a power plant of the aircraft.
3. System according to either claim 1 or 2, characterised in that it comprises image capture means (30) provided with at least one camera (31) connected to the first processor means (21) and to the second processor means (22), the first processor means (21) and the second processor means (22) containing stored instructions for reconstituting an image of the outside of the aircraft by using said capture means (30).
4. System according to claim 3, characterised in that the first processor means (21) and the second processor means (22) cause information including said image to be displayed simultaneously and respectively on the left display means (41) and on the right display means (42).
5. System according to either claim 3 or 4, characterised in that it comprises a plurality of cameras (31), each pointing towards a respective sector of a sphere surrounding said aircraft.
6. System according to claim 5, characterised in that two adjacent cameras (31) cover two sectors (S1, S2) that overlap partially.
7. System according to any one of claims 3 to 6, characterised in that it comprises positioning means (43) for determining the position of said display system (40) connected to the first processor means (21) and to the second processor means (22), the first processor means (21) and the second processor means (22) containing stored instructions for determining information including an image of the outside of the aircraft present in a field of view (S0) of the pilot.
8. System according to claim 7, characterised in that said positioning means (43) are capable of identifying a "head-down" position of the display system (40) as occurs when a pilot looks at the inside of a cockpit of an aircraft, the first processor means (21) and the second processor means (22) containing stored instructions for suspending the display of said image while in the "head-down" position.
9. System according to any one of claims 1 to 8, characterised in that it comprises a digital terrain model (33) connected to the first processor means (21) and to the second processor means (22), containing stored instructions for causing information to be displayed, that includes a digital terrain representation simultaneously and respectively on the left display means and on the right display means.
10. System according to any one of claims 1 to 9, characterised in that it comprises at least one on-board fixed screen (60) connected to said first and second processor means (21, 22) to display said information.
11. System according to any one of claims 1 to 10, characterised in that positioning means (43) are capable of identifying a "head-down" position of the display system (40) as occurs when a pilot looks at the inside of a cockpit of an aircraft, and the first processor means (21) and the second processor means (22) contain stored instructions for displaying a representation of a virtual instrument panel.
12. System according to claim 11, characterised in that it comprises touch screens (70) arranged on the instrument panel of the aircraft.
13. System according to any one of claims 1 to 12, characterised in that the first processor means (21) and the second processor means (22) for processing said information contain stored instructions for causing the information to be displayed simultaneously and respectively on the left display means (41) and on the right display means (42) from a right-eye point of view and from a left-eye point of view so as to produce a stereoscopic display.
14. Aircraft (1), characterised in that it comprises a piloting assistance system (10) according to any one of claim 1 to 13.

Images