DE19834205A1 - Stereoscopic image generation for use in a helmet worn by an aircraft pilot and uses two units to combine environmental images with computer generated images - Google Patents

Abstract

The stereoscopic image is generated and provided as output to the optical elements built into the helmet of a pilot. The output is provided by two units, one of which (10A) provides a view of the environment from a camera and the other (10B) provides computer generated images that can be measured parameters. Computer generated images are in a different depth of field from the real environment view depth of field, preferably in a nearer depth of field.

Description

The invention relates to a device with stereoscopic display, preferably integrated in a pilot's helmet or the like, with a first Unit for the direct and / or indirect consideration of a reverse Exercise section and a second unit for representing computers generated picture elements, such that these elements in the environment cut are visible.

Such devices can be used when carrying air, water or Land vehicles are used. They serve, for example, the Pilots of a helicopter Information about the flight status such. B. the flight altitude, the flight speed, the artificial horizon or the like in the form of computer-generated picture elements in an optical Device such. B. mirror glasses or a helmet visor ("helmet mounted display ") through which he views a section of the surroundings. He is thus of the need especially for fast vehicles liberated, to capture this information head towards separate displays ("head-down displays") and thus the To lose sight of the area.

A common problem with such devices is that the reflected computer-generated picture elements at least cover part of the surrounding area. As a result, z. B. the Helicopter pilots look at an obstacle to avoid or a target to be controlled are covered.

A device of the type mentioned above which avoids this problem is known from FR 25 17 916. The first unit comprises one pilot  helmet or the like integrated partially mirrored and fully mirrored optical elements. These are arranged in such a way that an observer can View of the area directly with one eye and view stereoscopic images of surrounding images. The environmental clipping images are separated by approximately two Eye distance of the viewer distant from each other tungen, z. B. infrared and / or video cameras, and by at least one Picture tube separately provided outside the pilot's helmet or the like and into the optical elements on the helmet for the two eyes of the viewer Mirrored separately. This enables the stereoscopic indirect Examination of the environmental section. The second unit is led by at least one picture tube computer-generated picture elements such that they are presented to the eye of the beholder as a virtual image, which is viewed indirectly and / or directly with the eye Surrounding section is overlaid. Because the computer generated Picture elements are only fed to one eye of the viewer, that is Problem of complete masking of the area avoided. However, the constant viewing of the picture contradicts elements with only one eye the usual seeing with both eyes.

It is therefore an object of the present invention to provide a device to provide the type mentioned above, which the consideration of the Computer-generated image elements with both eyes largely without allows permanent concealment of parts of the environmental section.

This object is achieved in that the second unit has the picture elements so stereoscopic that it makes a choice for the viewer wise definable spatial image depth appear and thus with a view objects with a different spatial depth disrupt gig.  

An advantage of the stereoscopic representation of the invention Picture elements is that these are with both eyes at the same time can be considered what the usual human seeing corresponds.

In this case, the picture elements are preferred in a different from one main difference in spatial image depth of the surrounding area, at are best represented closer to the viewer, so that they appear lying in front of the area.

The representation of the picture elements and the environmental section in different spatial depths largely avoids the above Problem of mutual concealment of the assigned images. The pilot can namely by adjusting the parallax of the eyes and if necessary Refocus the area around the eyes and the computers view generated image elements in different spatial depths. For example, are the picture elements closer to the viewer displayed depth of field, they step further when viewed lying away details of the surrounding area only slightly disturbing Appearance - a concealment of these details takes place at least in in for Interpupillary distance in parallel direction not too large picture elements instead of.

Another advantage of the representation of the computer according to the invention Generated picture elements consists in the possibility to create picture elements that are in the environmental section are assigned in a the spatial image corresponding to the actual distance of the object depict deep.

In order to be able to use the invention particularly advantageously, the second unit preferably represents the picture elements virtually for the viewer, by placing these picture elements outside of the one directly considered  Surrounding section generated and with the help of partially mirrored and fully ver mirrored optical elements in the immediate environment cutout reflected. Similar to looking at a distant one Object in a close mirror, the viewer focuses his eyes not on the helmet visor or close to his eyes the like, but to the more distant place of the picture generation, which allows relaxed viewing of the picture elements. The virtual representation of the computer-generated image elements also has the Advantage that the environmental section continues to be almost undisturbed Review can be viewed immediately.

The second unit can also make the picture elements real for the viewer represent, for example, on two in front of the picture elements Eyes of the viewer arranged LCD screens. Such However, a particularly simple device has disadvantages: First prevent the screens placed in front of the viewer's eyes largely the direct view of the area. Second, the screens must be one of the viewer's eyesight dependent minimum distance on the order of at least approximately Show 20 cm from his eyes so the viewer can keep his eyes open can focus the picture elements shown on the screens. The according to the invention required attachment of the screens on the helmet or The like then leads to a very bulky device. Therefore in the following the virtual representation of the picture elements introduced above described.

To implement the invention it is proposed that the first unit partly mirrored and preferably also fully mirrored optical Elements for immediate viewing of the surroundings cuts in review and to reflect the computer-generated Picture elements and preferably by at least one picture direction, e.g. B. infrared camera or image intensifier camera obtained  Area clipping pictures. The first unit preferably provides the Area clipping images here stereoscopically, so that both the Computer-generated image elements as well as the environmental section images with spatial depth impression can be viewed.

To simplify the structure, the invention preferably includes one electronic image display device, preferably picture tubes, for joint generation of environmental detail images, in particular the infrared camera, as well as the computer-generated image elements. The joint generation of the environmental clipping images and the computers generated picture elements with a single image display device limits the space requirement and the weight, preferably on the pilot helmet or the like attached parts of the device and the Manufacturing costs.

In a development of the invention, the device comprises one with the Image display device connected raster image generator for the Surrounding images and one connected to the image display device Vector graphics generator for the computer generated picture elements. As for Representation of raster images and vector graphics suitable images handing device can z. B. "Raster / Stroke" tubes used become.

Preferably, the device further comprises one with the raster image generator Tor and the vector graphics generator connected image control unit Vector graphic representation in the blanking areas of a raster video image sequence. The raster images generated in a sufficiently rapid sequence and those in the Blanking gaps in the raster video image sequence produced vector graphics unite in the viewer's brain into a common sequence of Area detail images with image elements visible here. At this The type of image generation can be represented by the vector graphic  Computer-generated image elements from those shown as a raster image Check environmental clipping images independently.

This control option for the choice proves to be particularly advantageous the spatial image depth of the computer-generated image elements. It is done preferably such that the image display device has one for each eye Display tube includes and that an auxiliary voltage source in front seen which is with the horizontal deflection voltage input at least one of the two display tubes is connected to the Applying a horizontal displacement voltage in the representation of the computer-generated picture elements such that these picture elements of of the one display tube at an image position which a horizontal distance (parallax distance) from the image position of the of the other display tube generated computer-generated image elements. The parallax chosen in such a device distance defines the spatial image depth of the computer-generated image elements.

In a development of the invention, however, it is also possible that the Auxiliary voltage source for delivering a variable horizontal displacement voltage is designed to change the Parallax distance. It can be used to generate various computer generated Picture elements can be displayed in different spatial depths. Example Ways can include alphanumeric flight guidance information depending on content togetherness or other ergonomic face points can be viewed in different spatial depth ranges. Furthermore, picture elements belonging to a certain one can be found in the surroundings intersecting object are assigned in one of the current Distance of this object is shown corresponding spatial depth are made easier for the pilot to find their way around.

To implement the above-mentioned fixed or variable parallax ver shift by means of a corresponding assigned horizontal ver  the device is preferably designed such that Two differential amplifiers are provided, one of which is output side with the horizontal deflection voltage input one of the two Display tubes and the other output side with the horizontal down steering voltage input of the other display tube connected and that the vector graphics generator and the auxiliary voltage source with the positive or negative input of the one and with the negative or positive input of the other differential amplifier are connected.

The invention is based on preferred embodiments explained using the drawing. It shows:

Figure 1 is a simplified view of a device according to the invention with stereoscopic representation.

Fig. 2 shows a left and a right eye of a viewer view of the surrounding area, each with input computer-generated image elements that are offset by a parallax angle α;

Fig. 3 is a schematic drawing of the electronic and optical structure of an embodiment of the invention, wherein the image display device comprises two raster picture tubes;

Fig. 4 is a schematic drawing similar to Figure 3, but with a two raster / stroke tube Comprehensive image reproduction device for displaying the computer generated picture elements with fixed Parallaxenabstand.

Fig. 5 is a schematic diagram similar to FIG. 4, but with a two raster / stroke tube Comprehensive image reproduction device for displaying the computer generated image elements of variable Parallaxenabstand.

The device 10 according to the invention, shown in simplified form in FIG. 1, comprises a helmet 12 which is worn by the pilot. Partially mirrored and fully mirrored optical elements 14 are attached in the front area of the helmet. They allow the stereoscopic direct viewing of a detail of the surroundings by looking through and of reflected images which are generated by an image reproduction device 16 described with reference to FIGS . 3 to 5. The image display device 16 is arranged in two side housings 18 L (left) and 18 R (right) attached to the helmet. The left and right side housings 18 L and 18 R each contain an image intensifier camera 20 L and 20 R (shown in FIGS. 3-5) through an opening 22 located in each side housing 18 L and 18 R in the viewing direction L or 22 R recorded the environmental cut. The image display device 16 is connected by a multi-core cable 24 for the transmission of control signals to a generator unit 26 (GEN) described with reference to FIGS. 3-5. In the multi-core cable 24 , the power supply lines for the image reproduction device 16 and for the image intensifier cameras 20 L and 20 R can also be accommodated.

The generator unit 26 is connected to a receiving device 28 , which is, for. B. can be an IR (infrared) camera or an image intensifier camera. It is firmly attached to the helicopter or the like and is used for indirect viewing of the environmental section. So the environmental section z. B. detected in an originally invisible wavelength range of light and shown in the form of mirrored ter environmental detail images. Furthermore, a distance-sensitive recording device 28 can be used, e.g. B. an operating in the near infrared or millimeter wave range Radarvor direction, which scans the area with a corresponding beam. The distance from objects in the surrounding area such as e.g. B. obstacles or goals can be determined. These objects can thus be "drawn" as computer-generated image elements in the surrounding area in the correct spatial image or marked with clear warning or target symbols (see FIG. 2) in order to make it easier for the pilot to recognize them.

The generator unit 26 is controlled by an image control unit 30 (“mission computer”, MC), which in turn is supplied by a navigation system 32 (NAV) with information (in particular flight guidance information such as flight altitude, flight speed, artificial horizon, etc.) that are made available to the pilot as mirrored computer-generated image elements.

Fig. 2, the stereoscopic viewing of the ambient cutout and the computer-generated picture elements explained. The left eye 34 L and the right eye 34 R of the pilot are provided with a left image BL and a right image BR, each of which contains the environmental detail and computer-generated image elements.

The environmental detail can be viewed both directly and indirectly in the form of environmental detail images that are generated by the image intensifier cameras 20 L and 20 R or by the image display device 16 and reflected with the aid of the optical elements 14 .

Furthermore, the left image BL and the right image BR contain computer-generated image elements which are generated by the image display device 16 such that the position of these image elements in the left image BL has a horizontal distance (parallax distance) from the position of the image elements in the right image BR. In this way, no part of the environmental section lying in the "infinite" is concealed in both images simultaneously by the computer-generated image elements. The resulting parallax angle α, at which the viewing directions of the left eye 34 L and the right eye 34 R intersect with the assigned computer-generated image elements, determines the spatial image depth at which the computer-generated image elements appear to the viewer: The smaller α, the greater the spatial depth in which the image appears. The landscape in the environmental section lying in "infinity" in FIG. 2 is described by α = 0 °.

FIG. 2 also shows computer-generated picture elements in the form of a flash in both pictures BL and BR, with which a mast lying in the surrounding area is marked for obstacle warning in the manner described above.

By adjusting the parallax of the eyes and, if necessary, refocusing the eyes 34 L and 34 R, the pilot can view the surrounding area and the computer-generated image elements in different spatial depths without losing information due to the mutual concealment of the images that occur when the same spatial image depth is displayed. Here, the viewer focuses his eyes 34 L and 34 R on the immediate view of the surrounding area to the spatial image depth corresponding to the current distance of the objects lying in the surrounding area. In the case of indirect observation of the surrounding area with the aid of the image intensifier cameras 20 L and 20 R or the image reproduction device 16 , the eyes 34 L and 34 R, however, are focused on the distance of the corresponding image device. Likewise, viewing the computer-generated image elements means focusing the eyes 34 L and 34 R on the image display device 16 . If, therefore, the length of the beam paths between the image intensifier cameras 20 L and 20 R and the eyes 34 L and 34 R as well as between the image reproduction device 16 and the eyes 34 L and 34 R are made the same, besides the immediate view of the surrounding area all images (generated environmental detail images and computer-generated image elements) can be viewed without refocusing the eyes 34 L and 34 R. A different spatial image depth impression of these images viewed with the same eye focus can then only be attributed to their different parallax properties.

With reference to FIGS. 3-5 in the following preferred embodiments of the invention are presented for realizing the stereoscopic display as shown in Fig. 2.

In FIGS. 3-5, the above-mentioned first unit (10 A) for direct and / or indirect observation of the surroundings cut by a dashed border and the second unit (10 B) for displaying the computer generated marked pixels by a dot-dash outline .

In the embodiment shown in Fig. 3 embodiment, the picture comprises display device 16 is a left picture tube 16 L and a right picture tube 16 R, which are connected to a left and a right raster image generator 36 L and 36 R (symbol generator, SG) of the generator unit 36 . Both raster image generators 36 L and 36 R are connected to the recording device 28 and the image control unit 30 , which receives data from the navigation system 32 which are represented as computer-generated image elements.

The left and right raster image generators 36 L and 36 R control the left and right picture tubes 16 L and 16 R, respectively, in such a way that they each represent the environmental detail and the computer-generated picture elements as left and right raster images BL and BR . In this embodiment of the invention, the information about the parallax distance between the computer-generated image elements of the left and right image BL or BR required for setting the desired spatial image depth of the computer-generated image elements is in the control signal of the image control unit 30 or in the signal of the recording device 28 contain.

The raster images generated by the two picture tubes 16 L and 16 R are reflected via the optical elements 14 into the left and right eyes 34 L and 34 R of the pilot as well as those from the left and right image intensifier cameras 20 L and 20 R captured environmental sections.

The second embodiment of the invention shown in FIG. 4 differs from that shown in FIG. 3, primarily by its image reproduction device 16 and its generator unit 26 . The image display device 16 comprises a left and a right raster / stroke tube 16 L and 16 R respectively for generating a vector graphic in the blanking intervals of a raster video image sequence. Both raster / stroke tubes 16 L and 16 R generate a raster image of the area captured by the recording device 28 . For this purpose, a raster image generator 38 is connected on the input side to the recording device 28 and the image control unit 30 and on the output side to the two raster / stroke tubes 16 L and 16 R. In the blanking intervals of the raster image sequence, the raster / stroke tubes 16 L and 16 R generate the computer-generated image elements as vector graphics. For the corresponding control, a vector graphics generator 40 is connected on the input side to the receiving device 28 and the image control unit 30 and on the output side to the vertical deflection voltage inputs of the two raster / stroke tubes 16 L and 16 R and is synchronized with the raster image generator 38 . To generate the desired parallax distance of the computer-generated picture elements, an additional voltage source 42 (U) is connected to the positive input and the vector graphics generator 40 is connected to the negative input of a left differential amplifier 44 L, which on the output side is connected to the horizontal deflection voltage input of the left raster / stroke - 16 L tube is connected. In addition, the additional voltage source 42 is connected to the negative input and the vector graphics generator 40 to the positive input of a right-hand amplifier 44 R which is connected on the output side to the horizontal deflection voltage input of the right raster / stroke tube 16 R. By appropriately loading the horizontal deflection voltage inputs of the left and right grid / stroke tubes 16 L and 16 R with fixed, different horizontal displacement voltages, the conditions in the left image BL and in the right image BR are different, under different image positions Computer-generated image elements and thus their fixed parallax distance and their fixed spatial image depth are set.

In the development of the invention shown in FIG. 5, the additional voltage source 42 presented in the embodiment of FIG. 4 is designed as an extension of the vector graphics generator 40 for delivering a variable horizontal displacement voltage. This allows the representation of the computer-generated image elements with variable parallax distances and thus variable spatial image depths. So z. B. target and actual values of flight guidance data are displayed as computer-generated image elements in different spatial image depth areas. Furthermore, it is e.g. B. possible when using a distance-sensitive recording device 28 , lying in the surrounding area, detected by the recording device 28 objects, in particular obstacles such. B. Überlandleitun conditions or individually standing masts, as picture elements in the correct spatial depth, which corresponds to their actual current distance.

Overall, a device 10 is obtained which, in the variants described above, enables stereoscopic viewing of a surrounding detail and computer-generated image elements reflected therein without these images constantly obscuring one another. By adjusting the parallax of the eyes and, if necessary, refocusing the eyes 34 L and 34 R, the viewer can cut out the surrounding area and view the computer-generated image elements in different spatial depths without losing information due to the mutual concealment of the images that occurs when displaying in a single spatial image depth.

The invention is not intended for use in the example Pilot helmet limited, but rather can be with any air, water or Land vehicle are used, the operation of which one should avoid would like to view travel or destination information Turn head in the direction of separate display devices and to lose sight of the surrounding area at the moment.

Claims (13)

1. Device with stereoscopic display, preferably integrated in a pilot's helmet ( 12 ) or the like, with a first unit ( 10 A) for direct and / or indirect viewing of a detail of the surroundings and a second unit ( 10 B) for displaying computer-generated image -Elements, such that these elements are visible in the environmental detail, characterized in that the second unit ( 10 B) represents the image elements in such a stereoscopic manner that they appear to the viewer in an optionally definable spatial image depth. 2. Device according to claim 1, characterized in that the Spatial image depth from a main spatial image depth of the Environmental section differs. 3. Device according to claim 1 or 2, characterized in that the spatial image depths of objects in the surrounding area assigned picture elements to the spatial image depths of these objects essentially correspond. 4. Device according to one of the preceding claims, characterized in that the second unit ( 10 B) represents the picture elements for the viewer virtually. 5. Device according to one of claims 1-3, characterized in that the second unit ( 10 B) represents the picture elements for the viewer real. 6. Device according to one of the preceding claims, characterized in that the first unit ( 10 A) partially mirrored and preferably additionally also fully mirrored optical elements ( 14 ) for direct viewing of the environmental section in a look-through and for reflecting the computer-generated image elements and preferably of by at least one device, for. B. infrared camera ( 28 ) or image intensifier camera ( 20 L; 20 R), obtained environmental detail images. 7. Device according to one of the preceding claims, characterized in that the first unit ( 10 A) stereoscopically represents the environmental images. 8. Device according to one of the preceding claims, characterized by an electronic image display device ( 16 ), preferably picture tubes ( 16 L; 16 R), for the joint generation of environmental detail images, in particular the infrared camera ( 28 ), and the computer-generated picture elements . 9. The device as claimed in claim 8, characterized by a raster image generator ( 38 ) connected to the image display device ( 16 ) for the surrounding images and a vector graphic generator ( 40 ) connected to the image display device ( 16 ) for the computer-generated image elements. 10. The device according to claim 9, characterized by an image control unit ( 30 ) connected to the raster image generator ( 38 ) and the vector graphics generator ( 40 ) for displaying vector graphics in the blanking intervals of a raster video image sequence. 11. The device according to claim 9 or 10, characterized in that the image display device ( 16 ) for each eye ( 34 L; 34 R) comprises a display tube ( 16 L; 16 R) and that an additional voltage source ( 42 ) is provided, which with the horizontal deflection voltage input at least one of the two picture display tubes ( 16 L; 16 R) is connected to the application of a horizontal displacement voltage when displaying the computer-generated picture elements in such a way that these picture elements from the one picture display tube ( 16 L; 16 R ) are generated at an image position which has a horizontal distance (parallax distance) from the image position of the computer-generated image element generated by the other image display tube ( 16 R; 16 L). 12. The apparatus according to claim 11, characterized in that the additional voltage source ( 42 ) is designed to deliver a variable Horizontalver shift voltage for changing the parallax distance accordingly. 13. The apparatus according to claim 11 or 12, characterized in that two differential amplifiers ( 44 L; 44 R) are provided, of which one on the output side with the horizontal deflection voltage input one of the two image display tubes ( 16 L; 16 R) and the other on the output side to the horizontal deflection voltage input of the other display tube ( 16 R; 16 L) and that the vector graphics generator ( 40 ) and the additional voltage source ( 42 ) with the positive and negative input of one ( 44 L; 44 R) and are connected to the negative or positive input of the other differential amplifier ( 44 R; 44 L).