FR3098932A1 - Method and system for assisting the piloting of an aircraft by adaptive display on a screen - Google Patents

Abstract

The present invention relates to a method for assisting the piloting of an aircraft (1) using a screen (5.5') on which an external landscape is visible. The method comprises steps for detecting (110,120) a position and an orientation of the head (20) of a pilot of said aircraft (1) and a direction of his gaze as well as steps for determining (210,220,230 ) of a position of a geographical point (50) of said landscape visible via said screen (5.5') and positions on said screen (5.5') according to said position and said orientation of said head ( 20) a first piece of information attached to said geographical point (50) and at least one second piece of information independent of said geographical point (50). The method also includes a fourth determination (320) of a targeted area (A2) centered in said direction of said gaze of said pilot on said screen (5,5') and a first adaptation (410) of a first light characteristic of first and/or second information located in said targeted area (A2) in order to improve the visibility of said first and/or second information for said pilot. Abbreviated Figure: Figure 1

Description

Method and system for assisting the piloting of an aircraft by adaptive display on a screen

The present invention is in the field of assistance in piloting an aircraft, and in particular in the restricted field of assistance in piloting an aircraft by supplying information on a screen equipping an aircraft cockpit.

The present invention relates to a method and a system for assisting the piloting of an aircraft by adaptive display using at least one screen of the aircraft, a landscape outside the aircraft being visible on the screen. This exterior landscape can be displayed on the screen or be visible through the screen which is then transparent or semi-transparent.

Different types of display systems may be available in the cockpit of an aircraft for the attention of the pilot and/or the co-pilot of the aircraft.

For the purpose of simplification, hereinafter, the term “pilot” designates both the pilot and the co-pilot and may be replaced by the term “co-pilot” at any time.

One or more screens are generally arranged on an instrument panel, these screens allowing the display of flight information as well as possibly an image of the landscape outside the aircraft.

A display system can also comprise a glazed surface of the cockpit onto which the required information is projected, the landscape outside the aircraft thus being visible to the pilot through this glazed surface.

For example, the document EP 2361832 describes a cockpit of an aircraft comprising extensions of transparent displays possibly formed by a part of the windshield of the aircraft. The transparency and the opacity of these display extensions can be adjusted by zones, for example according to the luminosity of the external landscape visible through the display extensions, in order to improve in these zones the visibility of the landscape and/or or information displayed.

A display system can also be a transparent or semi-transparent screen arranged in the cockpit of the aircraft. Such a transparent or semi-transparent screen displays the required information and allows the pilot to see the landscape outside the aircraft through this transparent or semi-transparent screen.

For example, the document FR 3026196 describes a display system comprising a semi-transparent screen, image generation devices and a pair of glasses to manage a parallax error problem between the displayed images and the exterior landscape.

A so-called “head up display” also designated by the acronym HUD for the designation in English “Head Up Display” can also be available in a cockpit of the aircraft. This head-up display may for example comprise a transparent screen or else a transparent surface onto which information is projected.

Document FR 3016448 is known in particular, which describes a display system for an aircraft, in particular a head-up display, comprising an at least partially transparent display surface and an information display module on the display surface. The information displayed allows viewing of the landscape outside the aircraft through the display surface. The display module also allows the display of a pop-up window containing information and whose opacity can be increased, in particular depending on the brightness of the exterior landscape.

According to another example, the document FR 3049072 describes a head-up display system comprising a transparent screen, an image projector and at least one sensor detecting the direction of gaze of the pilot of the aircraft. The direction of the pilot's gaze is determined by the technique of eye tracking. The projector takes this direction of gaze into account in order to shift, in particular laterally, the images displayed on the transparent screen, in particular in the presence of a strong side wind.

A display system can also be integrated into the pilot's helmet. Such a display system is often designated by the acronym HMD for the designation in English “Helmet Mounted Display” or HMSD for “Helmet Mounted Sight & Display”. Such a display system can for example comprise a transparent screen or else a transparent surface onto which information is projected.

In addition, document FR 3004817 describes a hybrid display system comprising a first display device, for example a screen, a second display device worn by a helmet of the pilot of the aircraft and a device for detecting the position and the orientation of the helmet. This hybrid display system makes it possible to manage the superimposition in the pilot's field of vision of the images displayed respectively on the first display device and on the second display device. Depending on the circumstances, the hybrid viewing system makes it possible to shift a single image or both images in order to allow simultaneous viewing of all the images. The hybrid display system can also remove an image from the overlapping zone in order to favor the vision of the other image.

One of the advantages of a head-up display and/or a display system integrated into a helmet is in particular to put the most relevant information in front of the pilot's eyes at the right time, in the right place, whatever where the pilot is looking and without this information disturbing the pilot.

In addition, the prior art also includes the following documents.

The document FR 3013852 describes a method and a device for displaying head-up information with improved readability. This display device has a transparent screen. The color of the information displayed on the screen is modified according to the color of the exterior scene visible through the screen so as to improve the readability of this information.

Document EP 2482114 describes a head-up display system comprising a transparent screen which can be darkened in order to form a sun visor for the pilot of the aircraft.

The object of the present invention is therefore to propose a system for assisting the piloting of an aircraft by adaptive display using a screen of the aircraft to facilitate the visualization by the pilot of the aircraft of the necessary information. and relevant.

The present invention relates to a method for assisting the piloting of an aircraft using at least one screen of the aircraft, a landscape outside the aircraft being visible via this at least one screen.

The landscape outside the aircraft is then visible through the screen or an image representative of this landscape is displayed on said screen. This landscape outside the aircraft is preferably located in front of the aircraft.

The piloting assistance method according to the invention can be applied to a single screen or else simultaneously to at least two screens.

The method for assisting the piloting of an aircraft using at least one screen according to the invention is remarkable in that it comprises the following steps:

• first detection of a position and an orientation of the head of a pilot of the aircraft in a local frame of reference of the aircraft,
• second detection of a direction of the pilot's gaze in the local frame,
• first determination of a position in the local reference of at least one geographical point of the landscape visible via said at least one screen,
• second determination of the position on said at least one screen of at least one first item of information attached to said at least one geographical point visible via said at least one screen,
• third determination of the position on said at least one screen of at least one second piece of information independent of a geographical point,
• production of a main image A1 comprising said at least one first piece of information and/or said at least one second piece of information,
• fourth determination of a target area A2 of said at least one screen, the target area A2 being centered in the direction of the pilot's gaze,
• first display on said at least one screen of the main image A1,
• first adaptation of at least a first luminous characteristic of at least a first and/or a second piece of information of the main image A1 located in the targeted area A2 in order to improve the visibility of said at least a first and/or second information information located in the targeted area A2 for the pilot.

In this way, at least one first and/or second piece of information located in the targeted zone A2 centered on the pilot's gaze is highlighted by the adaptation of at least one first luminous characteristic of this at least one first and/or second information. Consequently, the readability of this at least one first and/or second piece of information by the pilot is improved with respect to the numerous pieces of information displayed on each screen. The pilot can thus advantageously take cognizance quickly and efficiently.

Indeed, the pilot's field of vision is filled with numerous displayed information. The pilot may then have difficulty in identifying the relevant information or information to be taken into account at a given moment. The present invention advantageously makes it possible to mitigate this risk by identifying the relevant information for the pilot and highlighting it in the target zone A2 centered on the pilot's gaze.

A first luminous characteristic of at least a first and/or a second piece of information can be the luminance or the opacity.

For example, when the first luminous characteristic is the luminance and/or the opacity, during the first adaptation, a first value of said first luminous characteristic of said at least one first and/or second piece of information located in the targeted zone A2 is increased.

When the first luminous characteristic is the luminance, said at least one first and/or second piece of information located in the targeted area A2 can then appear highlighted vis-à-vis the other information visible on the main image A1.

According to one aspect, the method according to the invention may comprise an additional step of second adaptation of a second light characteristic of the main image A1 outside the targeted area A2, in order to increase in particular the contrast between on the one hand the targeted area A2 and on the other hand the main image A1 outside the targeted area A2 and, consequently, to improve the visibility of the targeted area A2. In this way, the readability of said at least one first and/or second piece of information situated in the targeted zone A2 is advantageously again improved.

For example, when the second luminous characteristic is the luminance, during the second adaptation, a second value of the second luminous characteristic of the main image A1 outside the targeted zone A2 is reduced.

In addition, information considered important for the piloting of the aircraft can also be located on the main image A1, but outside the targeted area A2. A piece of information is for example considered important if this piece of information relates to an alarm. It may also be information attached to a geographical point, the position of this information on the main image A1 of which is not predictable by the pilot and the readability of which should be improved to help in its detection. in the driver's field of vision.

In order to improve the readability of such information considered to be important and to facilitate its taking into account by the pilot, the method according to the invention can also comprise an additional step of third adaptation of a third luminous characteristic of at least information considered important regardless of its position vis-à-vis the targeted area A2.

For example, when the third luminous characteristic is the luminance, during this third adaptation, a third value of this third luminous characteristic of said at least one item of information considered to be important is increased.

According to one aspect, the method may comprise an additional step of measuring a fourth value of at least a fourth luminous characteristic of the landscape visible with the aid of each screen, for example in the direction of the pilot's head. The first adaptation can then adapt the first value of the first luminous characteristic of said at least one first and/or second piece of information located in the targeted zone A2 by taking into account this fourth value of the fourth luminous characteristic in order to improve its visibility for the pilot. In this way, said at least one piece of information is advantageously more easily and quickly discernible with respect to the image of the landscape by the pilot.

For example, when the first luminous characteristic and the fourth luminous characteristic are luminance, during the first adaptation, a first value of the first luminous characteristic of said at least one first and/or second piece of information located in the targeted zone A2 is greater to the fourth value of the fourth light characteristic of the landscape.

Moreover, the third adaptation can take into account the fourth light characteristic. For example, when the first light characteristic and the fourth light characteristic are luminance, during the third adaptation, a third luminance of said at least one piece of information considered to be important is greater than a fourth luminance of the landscape. Thus, the third light characteristic of said at least one item of information considered important is advantageously adapted so as to improve its visibility for the pilot. Here again, said at least one item of information considered important is thus advantageously more easily and quickly discernible from the landscape by the pilot.

For example, when two first light characteristics are luminance and opacity and two fourth light characteristics are luminance and opacity, when a fourth luminance of the landscape is greater than a predetermined limit, during the first adaptation, a first opacity of the targeted area A2 is increased.

In addition, the second determination of the position on a screen of said at least one first item of information can be carried out by taking into account the position of the pilot's head with respect to the screen as well as the position of said at least one geographical point vis-à-vis the screen when this screen is at least partially transparent. Indeed, with a screen that is at least partially transparent, each geographical point is visible to the pilot through this screen and each first piece of information relating to a geographical point visible from the outside landscape is displayed on the screen so as to be aligned with the head of the pilot and this geographical point. Preferably, the position of the head corresponds to the point of rotation of the head.

In addition, the orientation of the pilot's head with respect to the screen can also be taken into account to carry out the second determination of the position on a screen of said at least one first item of information, in particular when the position of the head does not coincide with the point of rotation of the head.

Similarly, the third determination of the position on a screen of at least one second item of information can be performed by taking into account the position and the orientation of the pilot's head with respect to the screen. In this case, said at least one second piece of information is displayed in the pilot's primary field of vision, regardless of the orientation of the pilot's head.

The pilot's primary field of vision is for example defined by angles of +/-15° on either side of a horizontal plane and starts from angles of +/-15° on either side of a plane vertical.

In this way, the first and second information are correctly positioned on the screen according to the position and orientation of the pilot's head.

The position on a screen of at least one second piece of information can also be independent of the position and orientation of the pilot's head with respect to the screen. In this case, this at least one second piece of information is displayed at the same position on the screen, regardless of the orientation of the pilot's head.

Furthermore, the targeted area A2 preferably has a first predetermined area smaller than a second area of the main image A1. The targeted zone A2 can for example be formed by a square corresponding to a solid angle of 20°×20° along an axis aligned with the direction of the pilot's gaze and centered on this axis.

The targeted area A2 may also correspond to a first area substantially equivalent to the foveal area of the eye. The foveal zone corresponds to the zone of the field of vision where the acuity and the precision are maximum and, in fact, where the vision is the sharpest. The target zone A2 therefore has a small area corresponding to a small solid angle. The target zone A2 is for example formed by a square corresponding to a solid angle of 5°×5° along an axis aligned with the direction of the pilot's gaze and centered on this axis.

The first adaptation of at least one first light characteristic of said at least one first and/or one second piece of information located in the targeted area A2 can be applied only to said at least one first and/or one second piece of information, in particular when the first luminous characteristic is the luminance.

The first adaptation of at least a first luminous characteristic of said at least a first and/or a second piece of information located in the targeted area A2 can also be applied to the targeted area A2 in its entirety, in particular when the first luminous characteristic is opacity.

In addition, the first adaptation of at least one first luminous characteristic of said at least one first and/or one second piece of information situated in the targeted zone A2 can be carried out substantially instantaneously, namely without waiting for the direction of gaze of the pilot is fixed for a certain duration, the pilot for example sweeping his gaze over at least part of a screen.

The first adaptation of at least one first luminous characteristic of said at least one first and/or one second piece of information located in the targeted zone A2 can also be carried out after a predetermined period during which the direction of the pilot's gaze is substantially fixed vis- vis-a-vis the screen and is for example aligned with a first and/or a second piece of information. The predetermined duration is for example equal to one second.

In addition, the aircraft includes in particular:

• at least one screen,
• a device for displaying information on said at least one screen,
• a calculator, and
• sensors.

The computer of the aircraft allows the execution of the steps of this piloting assistance method. The computer can for example include at least one processor, at least one integrated circuit, at least one programmable system, at least one logic circuit or any equivalent device, these examples not limiting the scope given to the expression “computer”. The computer may also include a memory storing in particular instructions relating to the steps of the method.

A screen of the aircraft can be at least partially transparent. The landscape outside the aircraft is then visible to a pilot of the aircraft through the at least partially transparent screen and can then be seen by the pilot of the aircraft. The screen is for example a transparent or semi-transparent screen.

A screen can also be opaque, for example arranged on the dashboard of the aircraft. The method according to the invention then comprises an additional step of second display of an image A0 of the landscape outside the aircraft on the screen. In fact, the landscape outside the aircraft is also visible to a pilot of the aircraft via this opaque screen.

The aircraft then comprises at least one camera making it possible to capture images of this external landscape.

The method can then also include an additional step of fourth adaptation of at least one fourth luminous characteristic of the image A0 of the landscape in order to increase the contrast between on the one hand said at least one first and/or second information located in the target area A2 and, where applicable, said at least one piece of information considered important and on the other hand the image A0 of the landscape.

In addition, a screen can have a curved shape. In this case, the second determination is made taking into account the curvature of the screen. Similarly, the third and fourth determinations are also made taking into account the curvature of the screen.

Furthermore, the information display device can project the information onto a screen or be integrated into the screen to allow the display of this information on the screen. The information display device can also allow the display of the image A0 of the landscape outside the aircraft on the screen when the screen is opaque.

The sensors comprise in particular a first set of sensors for detecting a position and an orientation of the head of a pilot of the aircraft in a local frame of reference of the aircraft. The local aircraft fix is a fix attached to the aircraft, for example at the nose of the aircraft. A local reference of the aircraft can for example be formed by the roll, pitch and yaw directions of the aircraft.

The first set of sensors is intended to determine the position and orientation of the pilot's head relative to a local reference point of the aircraft. The sensors of this first set of sensors can be magnetic, optical and/or inertial. This first set of sensors may be known in English under the designation “Head Tracker”. This first set of sensors comprises for example one or more sensors positioned on the pilot's helmet and one or more fixed sensors integral with the cockpit of the aircraft.

The sensors also comprise a second set of sensors for detecting a direction of gaze of the pilot of the aircraft in the local frame of reference of the aircraft. This second set of sensors uses, for example, the technique of eye tracking to determine the direction of the pilot's gaze. This second set of sensors comprises for example one or more fixed sensors positioned in the cockpit of the aircraft and sensing the direction of the pilot's gaze. This second set of sensors can also be attached to a device secured to the pilot's head, typically the pilot's helmet.

The sensors can also comprise a device for detecting a position of at least one geographical point of the landscape visible on each screen. This detection device can make it possible to determine the position of this at least one geographical point directly in the local reference of the aircraft. This detection device comprises for example a radar.

This detection device can also make it possible to determine the position of this at least one geographical point in the local reference of the aircraft by using its coordinates in a terrestrial reference. A transfer from the terrestrial reference to the local reference of the aircraft must then be carried out. For this purpose, the first determination comprises the following sub-steps:

• a third detection of a position in a terrestrial landmark of at least one geographical point of the landscape and,
• a transfer of the position of said at least one geographical point from the terrestrial reference to the local reference of the aircraft.

The position of this at least one geographical point in the terrestrial reference can for example be stored in a memory that includes the computer of the aircraft, typically in a database. The position of this at least one geographical point in a terrestrial reference can also be received by the aircraft, for example by at least one radio wave.

The present invention also relates to a system for assisting the piloting of an aircraft by adaptive display using at least one screen of the aircraft configured to implement the method described above. The assistance system includes:

• at least one screen, a landscape being visible on each screen,
• a device for displaying information on each screen,
• a calculator,
• a first set of sensors for detecting a position and an orientation of the head of a pilot of the aircraft in a local frame of reference of the aircraft,
• a second set of sensors for detecting a direction of the pilot's gaze in the local frame of said aircraft, and
• a device for detecting a position of at least one geographical point of the landscape visible on each screen.

The invention and its advantages will appear in more detail in the context of the following description with examples given by way of illustration with reference to the appended figures which represent:

• FIG. 1, an aircraft comprising a piloting assistance system by adaptive display using at least one screen,
• Figure 2, a screen and the information displayed and
• FIGS. 3 and 4, two synoptic diagrams of a method for assisting the piloting of the aircraft by adaptive display.

The elements present in several distinct figures are assigned a single reference.

The aircraft 1 represented in FIG. 1 comprises a fuselage 4, a main rotor 2, a tail rotor 3, an instrument panel 8 and a piloting assistance system 10 by adaptive display using at least one 5.5' screen. The example illustrated in FIG. 1 therefore relates to a rotorcraft, but the piloting assistance system 10 can be used by any type of aircraft.

The assistance system 10 for piloting an aircraft 1 by adaptive display using at least one screen 5.5' comprises at least one screen 5.5' according to FIG. 1, a display device 6 information on each screen 5.5', a computer 7, a first set of sensors 12,13 for detecting a position and an orientation of the head 20 of a pilot of the aircraft 1 in a reference room of the aircraft 1, a second set of sensors 14,15 for detecting a direction of gaze of the pilot of the aircraft 1 in the local reference of the aircraft 1 and a device 16 for detecting a position of at least one geographical point 50 of the landscape visible via a screen 5. The aircraft 1 can also include a camera 18 making it possible to capture an image A0 of the landscape outside the aircraft 1 and located in front of the aircraft 1 .

According to the example shown in Figure 1, a first screen 5 is positioned above the dashboard 8 and is at least partially transparent, the landscape outside the aircraft 1 being visible through this first screen 5. A second 5' screen is integrated into the dashboard 8 and is opaque. An image A0 of the landscape outside the aircraft 1 is displayed on this screen 5′, for example via the information display device 6.

In this way, the pilot of the aircraft 1 can see the landscape outside the aircraft using each of these two 5.5′ screens.

However, an assistance system 10 for piloting an aircraft 1 according to the invention may comprise a single 5.5′ opaque, semi-transparent or even transparent screen.

The information display device 6 allows on the one hand the display of the image A0 of the landscape outside the aircraft 1 on the second opaque screen 5' and on the other hand the display on each of the two screens 5.5' of information, in particular information necessary for the flight of the aircraft 1.

Different types of information can be displayed by a display device 6 on each screen 5.5', as shown in Figures 1 and 2.

For example, a first item of information 21 is information attached to a geographical point 50 of the landscape outside the aircraft 1 and displayed only when the landscape visible via the screen 5.5' contains this geographical point. A first piece of information 21 indicates for example a landing zone for the aircraft 1 as represented in FIG. 2. A first piece of information can also indicate a waypoint of the trajectory to be followed or a particular point of the environment...

A second piece of information 22,23,24 can be information concerning, for example, the flight conditions or else the piloting of the aircraft 1. A second piece of information 22 typically indicates the altitude of the aircraft 1, its height or even its speed … A second piece of information 23 can also indicate the attitude of the aircraft 1, via its roll angle, its pitch angle and a horizon line. A second piece of information 24 can also indicate piloting information such as the heading of the aircraft 1, its speed vector, etc. A second piece of information can also indicate an operating state of an element of the aircraft 1.

Some of this second information and in particular concerning the flight conditions or the piloting of the aircraft 1 can be displayed in a fixed manner in the center of a 5.5′ screen. This second information can also be displayed on a 5.5' screen depending on the position and orientation of the pilot's head 20 so as to be permanently displayed in the pilot's primary field of vision, regardless of the direction in which the pilot is looking/pointing his head.

Some of this second information, for example that indicating an operating state of an element of the aircraft 1 can be displayed on a screen 5.5' at predetermined positions and independent of the position and orientation of the head of the pilot as well as the direction of his gaze. For example, information 25 on the state of a landing gear of the aircraft 1 is displayed at the bottom center of a 5.5′ screen. A third item of information may also relate to information on the state of a right engine of the aircraft 1 displayed for example at the top right of a screen 5.5' or even information on the state of the main rotor 2 displayed at the top center of a 5.5' screen...

A third piece of information is information considered to be important and relates for example to an alarm. A third piece of information alerts the pilot, for example, of an incident on an engine of the aircraft 1, of an overrun of a flight limitation such as its altitude or its attitude, etc. A piece of information is also considered important if the position of The display of this information on a 5.5' screen is not predictable by the pilot, namely that its display is conditioned on the occurrence of a predetermined event. Information attached to a geographical point 50 of the landscape outside the aircraft 1 may possibly also be considered important.

Other information may also be displayed in the pilot's primary field of vision only when the pilot is looking in a certain area. This is for example information on the attitude of the aircraft 1 displayed simply when the pilot is looking in the front sector of the aircraft 1 or even information related to hovering when the pilot is looking above the horizon line.

The computer 7 comprises for example a processor, an integrated circuit or else a programmable system allowing the execution of the steps of the method for assisting the piloting of the aircraft 1 by adaptive display. The computer 7 can also comprise a memory 71 storing in particular instructions relating to the steps of this method and possibly a terrain database comprising information on the flight environment of the aircraft 1 and in particular on particular geographical points of this environment.

The first set of sensors 12,13 makes it possible to detect a position and an orientation of the head 20 of a pilot of the aircraft 1 in a local reference of the aircraft 1. The local reference is attached to the aircraft 1 and comprises for example the axes X, Y, Z formed respectively by the directions of roll, pitch and yaw of the aircraft 1. The first set of sensors 12,13 comprises for example a first sensor 12 positioned on the pilot's helmet and a second sensor 13 fixed and positioned in the cockpit of the aircraft 1.

The first set of sensors 12,13 may comprise at least one magnetic sensor 12 and/or at least one optical sensor 13.

In the case of a magnetic sensor 12, a set of coils is arranged for example in the cockpit of the aircraft and produce a magnetic field. The magnetic sensor 12 mounted on a pilot's helmet detects changes in the magnetic field picked up during the movements of the pilot's head and thus makes it possible to determine the position and orientation of the head.

In the case of an optical sensor 13, one or more optical transmitters are for example attached to the pilot's helmet. One or more sensors positioned in the cockpit of the aircraft pick up each beam emitted respectively by one or more transmitters and make it possible to accurately deduce the position of the pilot's head. Similarly, each optical transmitter can be fixed in the cockpit of the aircraft, each sensor then being positioned on the pilot's helmet.

The second set of sensors 14,15 makes it possible to detect a direction of gaze of the pilot of the aircraft 1 in the local reference of the aircraft 1. This second set of sensors 14,15 comprises for example two fixed cameras positioned in the cockpit of the aircraft 1 and uses the eye tracking technique to determine this direction of the pilot's gaze. This second set of sensors 14, 15 can also be attached to a device secured to the head 20 of a pilot of the aircraft 1, such as his helmet for example.

However, a single camera may also be sufficient to detect the direction of the pilot's gaze.

The detection device 16 makes it possible to determine a position of at least one geographical point 50 of the landscape visible via a 5.5′ screen. This detection device 16 comprises for example a radar in order to determine the position of each geographical point 50 directly in the local coordinate system of the aircraft 1.

This detection device 16 can also comprise a memory or else use the memory 71 of the computer 7 storing for example the coordinates in a terrestrial coordinate system of each geographical point 50 and information concerning it. A transfer from the terrestrial reference to the local reference of the aircraft 1 must then be carried out, typically via the computer 7.

A first synoptic diagram of a method for assisting the piloting of an aircraft 1 by adaptive display using the two screens 5.5' is shown in FIG. 2, a landscape outside the aircraft 1 being visible on each screen 5.5'. The process comprises the following steps:

A first detection 110 makes it possible to determine a position and an orientation of the head 20 of a pilot of the aircraft 1 in the local frame of the aircraft 1. This first detection 110 can be carried out via the first set of sensors 12,13 and computer 7.

A second detection 120 makes it possible to determine a direction of the pilot's gaze in the local coordinate system. This second detection 120 can be carried out via the second set of sensors 14,15 and the computer 7.

A first determination 210 makes it possible to determine 'a position in the local reference of at least one geographical point 50 of the landscape visible via a 5.5' screen. This first determination 210 can be carried out via the detection device 16, and possibly the computer 7 and its memory 71.

A second determination 220 makes it possible to determine the position on the 5.5′ screen of at least one first piece of information attached to each geographical point 50 visible on the 5.5′ screen. This second determination 220 can be carried out via the computer 7. This second determination 220 can also be carried out according to the position of the head 20 of the pilot vis-à-vis the first screen 5 and the position of the at least a geographical point 50, this first screen 5 being at least partially transparent.

A third determination 230 makes it possible to determine the position on the screen 5.5' of at least one second piece of information independent of a geographical point 50. This third determination 230 can be carried out by means of the computer 7. This third determination 230 can also be made depending on the position and orientation of the pilot's head 20 vis-à-vis a 5.5' screen

A generation step 310 makes it possible to generate a main image A1 comprising this at least one first piece of information and/or this at least one second piece of information. This elaboration step 310 can be carried out via the computer 7.

A fourth determination 320 makes it possible to determine a target area A2 of a 5.5' screen, the target area A2 being centered in the direction of the pilot's gaze. This fourth determination 320 can be carried out via the computer 7.

A first display 330 makes it possible to display the main image A1 on each 5.5' screen. This first display 330 can be produced via the display device 6.

A first adaptation 410 makes it possible to adapt at least one first luminous characteristic of at least one first and/or second piece of information of the main image A1 located in the targeted area A2 in order to improve the visibility of said at least one first and /or second information located in the targeted area A2 for the pilot. For this purpose, the computer 7 controls the display device 6 in order to adapt this at least one first luminous characteristic.

The targeted area A2 has a first area smaller than a second area of the main image A1. The target zone A2 is for example formed by a square corresponding to a solid angle of 20°×20° along an axis aligned with the direction of the pilot's gaze and centered on this axis. The targeted zone A2 can also have a smaller first area and be formed for example by a square corresponding to a solid angle of 5°×5° aligned with the direction of the pilot's gaze and centered on this direction.

In this way, at least one first luminous characteristic of at least one first and/or second piece of information located in the targeted area A2 is adapted so that this at least one first and/or second piece of information is highlighted on the screen 5 .5' and is in fact more quickly and efficiently taken into account by the pilot. The first luminous characteristic is for example the luminance and/or the opacity. A first value of this first luminous characteristic of said at least one first and/or second piece of information situated in the targeted zone A2 is then increased during the first adaptation 410.

Typically, a difference between the first light characteristic of said at least one first and/or second piece of information located in the target area A2 and a second light characteristic of the main image A1 outside the target area A2 greater than 10% of this first luminous characteristic of said at least one first and/or second piece of information located in the targeted area A2 can be envisaged so that said at least one first and/or second piece of information is highlighted vis-à-vis the rest of the image A1 . A difference of between 10% and 30% of this first luminous characteristic may be sufficient for said at least one first and/or second piece of information situated in the targeted zone A2 to be effectively and quickly perceptible by the pilot.

Such a difference can for example be obtained either by an increase in luminance of the central image A2, or by an increase in the opacity of the main image A1 creating a partial opacity thus decreasing the brightness of this main image A1 . These two actions can also be performed simultaneously.

However, a difference greater than 30% of this first luminous characteristic can also be used to increase the contrast between said at least one first and/or second piece of information located in the targeted area A2 and the main image A1 outside the targeted area A2 and thereby improve the highlighting of said at least one first and/or second piece of information situated in the targeted area A2.

The color of said at least one first and/or second piece of information located in the targeted area A2 can also be adapted in order to differ in particular from the color of the landscape visible in this targeted area A2 and to highlight this at least one first and /or second piece of information regarding the landscape.

Furthermore, the method for assisting the piloting of the aircraft 1 according to the invention may comprise additional steps according to the second synoptic diagram represented in FIG. 3.

For example, the method can include an additional step of second adaptation 420 of a second light characteristic of the main image A1 outside the targeted area A2 in order to increase the contrast between the targeted area A2 and the main image A1 outside the target area A2. For example, the luminance of the main image A1 constituting the second luminous characteristic is reduced outside the targeted area A2 during the second adaptation 420.

Typically, the luminance of the main image A1 is reduced so that a difference between the first luminous characteristic of said at least one first and/or second piece of information located in the targeted area A2 and the second luminous characteristic of the main image A1 outside the target zone A2 is greater than 10% of this first luminous characteristic.

According to another example, the method can comprise an additional step of third adaptation 430 of a third luminous characteristic of at least one item of information considered important independently of its position with respect to the targeted area A2 in order to improve the visibility of this at least one piece of information considered important. Information is considered important if the information relates to an alarm or if the information is attached to a geographical point 50 or even if a position of the information on the main image A1 is not foreseeable by the pilot.

Thus, when the third luminous characteristic is the luminance, during the third adaptation 430, a third value of the third luminous characteristic of said at least one item of information considered to be important is increased. Typically, the luminance of information considered important is increased so that a difference between the third luminous characteristic of this information considered important and the second luminous characteristic of the main image A1 outside the targeted area A2 is greater at 10% of this third luminous characteristic.

This difference can in this case be greater than, for example, 30% of this third luminous characteristic in order to maximize the highlighting of said information considered to be important for the pilot of the aircraft 1.

According to another example, the method can include an additional step 140 of measuring a fourth value of at least a fourth luminous characteristic of the visible landscape using a 5.5′ screen, the first adaptation 410 taking into counts the fourth value of the fourth light characteristic in order to adapt the first value of the first light characteristic of said at least one first and/or second piece of information located in the target zone A2 so as to improve its visibility for the pilot. This measurement can for example be performed globally in a longitudinal direction of the aircraft 1 by a luminosity sensor fixed to the structure of the aircraft 1. This measurement can also be performed more precisely by a sensor fixed to the helmet of the pilot of aircraft 1.

The method also comprising a third adaptation 430, the third adaptation 430 takes into account the fourth luminous characteristic in order to adapt the third luminous characteristic of said at least one item of information considered to be important so as to improve its visibility for the pilot.

Typically, the first luminous characteristic and the fourth luminous characteristic being the luminance, during the first adaptation 410, a first value of the first luminous characteristic of said at least one first and/or second piece of information located in the targeted zone A2 is greater than the fourth value of the fourth luminous characteristic of the landscape and, where appropriate, during the third adaptation 430, a third luminous characteristic of said at least one item of information considered to be important is greater than a fourth luminance of the landscape.

In this way, a difference at least greater than 10% between, on the one hand, the first luminous characteristic of said at least one first and/or second piece of information located in the targeted area A2 and possibly the third luminous characteristic of said at least one piece of information considered important and on the other hand the fourth luminous characteristic of the landscape visible using a 5.5' screen can be guaranteed allowing the highlighting of said at least one first and/or second piece of information and possibly of said at least one piece of information considered important with regard to the landscape.

In addition, two first luminous characteristics and two fourth luminous characteristics being the luminance and the opacity, when a fourth luminance of the landscape is greater than a predetermined limit, during the first adaptation 410, a first opacity of the targeted zone A2 is increased. The predetermined limit is, for example, a function of the light performance of the 5.5' screen.

According to another example, the method may include an additional step of second display 340 of an A0 image of the landscape on the 5′ opaque screen.

In this case, the method can also include an additional step of fourth adaptation 440 of at least one fourth luminous characteristic of the image A0 of the landscape in order to increase the contrast between on the one hand said at least one first and/or second piece of information situated in the targeted area A2 and, where appropriate, said at least one piece of information considered important and on the other hand the image A0 of the landscape.

In addition, the position of at least 50 geographical points of the landscape can be known in a terrestrial landmark. The first determination 210 can then include the following sub-steps:

• a third detection 212 of a position in a terrestrial landmark of said at least one geographical point 50 of the landscape and,
• a transfer 215 of the position of at least one geographic point 50 from the terrestrial reference to the local reference.

Of course, the present invention is subject to many variations in its implementation. Although several embodiments have been described, it is clearly understood that it is not conceivable to identify exhaustively all the possible modes. It is of course possible to replace a means described by an equivalent means without departing from the scope of the present invention.

Claims (20)

Method for assisting the piloting of an aircraft (1) by adaptive display using at least one screen (5.5') of said aircraft (1), a landscape outside said aircraft (1) being visible via said at least one screen (5.5'),
characterized in that said method comprises the following steps:

• first detection (110) of a position and an orientation of the head (20) of a pilot of said aircraft (1) in a local reference frame of said aircraft (1),
• second detection (120) of a direction of gaze of said pilot in said local frame,
• first determination (210) of a position in said local landmark of at least one geographical point (50) of said landscape visible via said at least one screen (5.5'),
• second determination (220) of the position on said at least one screen (5.5') of at least one first piece of information attached to said at least one geographical point (50) visible via said at least one screen (5.5') ,
• third determination (230) of the position on said at least one screen (5.5') of at least one second piece of information independent of a geographical point (50),
• generation (310) of a main image (A1) comprising said at least one first piece of information and/or said at least one second piece of information,
• fourth determination (320) of a target area (A2) of said at least one screen (5.5'), said target area (A2) being centered in said direction of said gaze of said pilot,
• first display (330) on said at least one screen (5.5') of said main image (A1),
• first adaptation (410) of at least one first luminous characteristic of at least one first and/or second piece of information of said main image (A1) located in said targeted area (A2) in order to improve the visibility of said at least one first and/or second information located in said target area (A2) for said pilot.

Method according to claim 1,
characterized in that said method comprises an additional step of second adaptation (420) of a second light characteristic of said main image (A1) outside of said targeted area (A2), in order to increase the contrast between said targeted area ( A2) and said main image (A1) outside of said target area (A2). Process according to any one of Claims 1 to 2,
characterized in that said method comprises an additional step of third adaptation (430) of a third luminous characteristic of at least one piece of information considered important independently of its position with respect to said targeted zone (A2) in order to improve the visibility of said at least one piece of information considered important for said pilot. Method according to claim 3,
characterized in that information is considered important if said information relates to an alarm or if said information is attached to a geographical point (50) or if a position of said information on said main image (A1) is not predictable by said pilot. Process according to any one of Claims 3 to 4,
characterized in that a third luminous characteristic being the luminance, during said third adaptation (430), a third value of a third luminous characteristic of said at least one piece of information considered to be important is increased. Process according to any one of Claims 1 to 5,
characterized in that a first luminous characteristic being the luminance and/or the opacity, during the said first adaptation (410), a first value of a first luminous characteristic of the said at least one first and/or second information located in said target area (A2) is increased. Process according to any one of Claims 1 to 6,
characterized in that a second luminous characteristic being the luminance, during said second adaptation (420), a second value of a second luminous characteristic of said main image (A1) outside of said aimed zone (A2) is decreased. Process according to any one of Claims 1 to 7,
characterized in that said method comprises an additional step of measuring (140) a fourth value of at least a fourth luminous characteristic of said landscape visible via said at least one screen (5,5'), said first adaptation (410) adapting said first value of said first luminous characteristic of said at least one first and/or second piece of information situated in said targeted zone (A2) taking into account said fourth value of said fourth luminous characteristic in order to improve its visibility for said pilot. Method according to claim 8,
characterized in that said method comprising a third adaptation (430), said third adaptation (430) takes into account said fourth luminous characteristic in order to adapt said third luminous characteristic of said at least one piece of information considered to be important so as to improve its visibility for that pilot. Process according to any one of Claims 8 to 9,
characterized in that a first luminous characteristic and a fourth luminous characteristic being the luminance, during said first adaptation (410), a first value of said first luminous characteristic of said at least one first and/or second piece of information located in said zone target (A2) is greater than said fourth value of said fourth light characteristic of said landscape. Process according to any one of Claims 8 to 9,
characterized in that said method comprising a third adaptation (430), a third luminous characteristic and a fourth luminous characteristic being the luminance, during said third adaptation (430), a third value of said third luminous characteristic of said at least one piece of information considered important is greater than said fourth value of said fourth luminous characteristic of said landscape. Process according to any one of Claims 9 to 11,
characterized in that two first luminous characteristics being luminance and opacity and two fourth luminous characteristics being luminance and opacity, when a fourth luminance of said landscape is greater than a predetermined limit, during said first adaptation (410) , a first opacity of said target area (A2) is increased. Process according to any one of Claims 1 to 12,
characterized in that said target area (A2) is a square corresponding to a solid angle of 5°x5° along an axis aligned with said direction of said gaze of said pilot and centered on said axis. Process according to any one of Claims 1 to 13,
characterized in that, during said third determination (230), said position on said at least one screen (5,5') of at least one second piece of information is determined as a function of said position and of said orientation of said head ( 20) of said pilot vis-à-vis said at least one screen (5.5'). Process according to any one of Claims 1 to 14,
characterized in that at least one screen (5.5') is at least partially transparent and said landscape is visible through said at least one screen (5.5'). Method according to claim 15,
characterized in that, during said second determination (220), said position on said at least one screen (5,5') of at least one first item of information is determined as a function of said position of said head (20) of said pilot and said position of said at least one geographic point (50) vis-à-vis said at least one screen (5.5'). Process according to any one of Claims 1 to 14,
characterized in that said method comprises an additional step of second display (340) of an image (A0) of said landscape on said at least one screen (5,5'). Method according to claim 17,
characterized in that said method includes an additional step of fourth adaptation (440) of at least a fourth light characteristic of said image (A0) of said landscape. Process according to any one of Claims 1 to 18,
characterized in that said first determination (210) comprises the following sub-steps:

• a third detection (212) of a position in a terrestrial landmark of said at least one geographical point (50) of said landscape and,
• a transfer (215) of said position of said at least one geographical point (50) of said terrestrial reference to said local reference.

Assistance system (10) for piloting an aircraft (1) by adaptive display using at least one screen (5.5') of said aircraft (1), said assistance system (10) including:

• said at least one screen (5.5'), a landscape being visible via said at least one screen (5.5'),
• a device (6) for displaying said information on said at least one screen (5.5'),
• a computer (7),
• a first set of sensors (12,13) for detecting a position and an orientation of the head (20) of a pilot of said aircraft (1) in a local reference frame of said aircraft (1),
• a second set of sensors (14,15) for detecting a direction of gaze of said pilot of said aircraft (1) in said local reference of said aircraft (1), and
• a device (16) for detecting a position of at least one geographical point (50) of said landscape visible via said at least one screen (5.5'),

characterized in that said display system (10) is configured to implement the method according to any one of claims 1 to 19.