JP2007212577A - Head mounted display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a head mounted display device using a non-coaxial optical system in which the structure of the non-coaxial optical system is simplified and yet the special image free of distortions can be projected to a visor. <P>SOLUTION: The head mounted display device includes the visor 12 which is supported at a helmet 11, and is arranged in front of the eyes, a special camera 13a which photographs forward at the sensitivity different from that of the direct view image observed forward through the visor 12, an image creation section 14a which creates the special image photographed by the special camera 13a, a screen display element 17a which displays the image on a screen, and the non-coaxial optical system 18a which projects the image displayed on the screen to the visor 12 from a diagonal direction so as to make the projected image and the direct view image visible. The image creation section 14 has a distorted image formation section 21a which creates the distorted special image formed by previously distorting the special image in compliance with the distortion produced by the visor and the non-coaxial optical system and outputs the distorted special image to the screen display element 17a. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

The present invention relates to a head-mounted display device that enables an image projected together with a landscape in front of the visor to be visually recognized by projecting an image onto a visor placed in front of the eye. The present invention relates to a head-mounted display device that projects video information acquired by a special camera such as an infrared camera onto a visor as an image.
The head-mounted display device according to the present invention is used in various situations such as when an aircraft or helicopter passenger flies at night, or when a rescuer such as a firefighter or rescue team uses it at a disaster site. The

  It is useful to acquire visual information that cannot be obtained with the naked eye by using a special camera and use it together with visual information with the naked eye. For example, aircraft and helicopter pilots may use night vision devices when flying at night. In general, a night vision device is a monocular type or a binocular type that directly looks at the output of an image intensifier with an eyepiece.

Since the pilot wears a helmet during the flight, a helmet with a night vision device in which a night vision device is attached to the helmet has been proposed. (Patent Document 1, Patent Document 2).
In addition, a system for projecting night vision video information onto a part of a visor attached to a helmet has been proposed (Patent Document 3).

In addition, a head-mounted display device for a firefighter or a rescue squad that incorporates a display device that can see a heat ray or an infrared image into a helmet is disclosed (Patent Document 4).
There has been proposed a head-mounted display device that displays a night vision image or an infrared image in front of the eyes by the display device attached to the helmet.
JP-A-9-188911 JP 2003-533614 A JP 2001-515150 A JP-A-8-54282

  If a binocular-shaped night vision device is attached to the helmet, both the left and right eyes will look into the eyepiece lens at the same time. There is. Moreover, since it will be used in the state which protruded ahead of the helmet in front of eyes, it will be easy to cause damage by giving a shock to a night vision apparatus accidentally.

  A monocular night vision device attached to a helmet is inconvenient until you get used to seeing different visual information between the left and right eyes, but because one eye sees the outside world, visual impairment and safety There is no problem above. However, as in the case of the binoculars shape, since it is used in a state of protruding in front of the helmet in front of the eyes, the point that damage due to accidentally giving an impact to the night vision device is the same. .

  On the other hand, in a visor projection type night vision device that projects a night vision image on a visor supported by a helmet, the scenery in front of the visor can be seen at the same time, and there is no member attached to protrude to the front of the helmet. It is excellent in that it is less likely to break.

  However, in order to project a night vision image toward the visor, a complicated optical system is required. In other words, the visor attached to the helmet is usually curved, and the face faces the front of the visor. Therefore, a so-called non-coaxial optical system is formed.

When an image is displayed through a non-coaxial optical system, a distortion image to which asymmetric distortion is added is formed unless optical correction is performed using an optical element. In order to correct this distorted image with an optical element, it is necessary to significantly increase the number of optical elements including lenses and mirrors for correction. Further, as the number of sheets increases, the volume occupied by the entire optical system increases.
Such a situation is not limited to the case of projecting a night vision image from the night vision camera on the visor, but the same applies to the case of projecting an image captured by another special camera such as an infrared camera onto the visor.

  Therefore, the present invention is a head-mounted type in which a special image such as a night vision image is projected on the visor using a non-coaxial optical system so that a direct-view image and a special image in front of the visor can be visually recognized. An object of the present invention is to provide a head-mounted display device capable of projecting a special image without distortion on a visor while simplifying the structure of the non-coaxial optical system in the display device.

  The head-mounted display device of the present invention, which has been made to solve the above-mentioned problems, is a special device that captures the front with a sensitivity different from a visor that is supported by a helmet and placed in front of the eye and a direct-view image that is observed through the visor. A camera, an image creation unit that creates a special image from the video signal captured by the special camera, a screen display unit that displays the image on the screen, and an image that is projected on the screen and projected from the oblique direction onto the visor and a direct-view image A head-mounted display device including a non-coaxial optical system that makes it possible to visually recognize a special image in advance in accordance with the distortion caused by the visor and the non-coaxial optical system. A distorted image forming unit for creating a distorted special image is provided, and the distorted special image is output to the screen display unit.

  Here, the shape of the helmet is not limited as long as it is a shape that can be worn on the head, but it means a structure that can attach a visor at least in front of the eyes. The visor refers to a transparent or translucent member that is supported by a helmet and placed in front of the eye when in use. The shape of the visor is not particularly limited, but it is necessary that the image is projected through a non-coaxial optical system. For example, it may be a visor shaped like a so-called combiner that is arranged in front of the left and right eyes, or one eye alone, but in this case, it is necessary to project an image via a non-coaxial optical system. .

  A special camera is a camera for obtaining visual information that cannot be obtained by direct visual observation through a visor. For example, the sensitivity to brightness and the sensitivity to wavelength are large compared to the sensitivity of the visual observation performed through the visor. A different camera. Specifically, special cameras with different sensitivities to brightness are used in night vision cameras that use image intensifiers or in situations that are not dark enough to use a night vision camera (such as darkness at dusk). This corresponds to a low-illuminance camera using a CCD or the like. An infrared camera corresponds to the special camera having different sensitivity to the wavelength.

  A special image is an image (image data) created based on the video signal of a special camera. A night vision camera is a night vision image, a low illumination camera is a low illumination image, and an infrared camera In this case, an infrared image (heat ray image) is obtained.

According to the present invention, the visor is placed in front of the eyes, and the scenery in front of the eyes is photographed by the special camera. The video signal of the special camera is output to the image creating unit to create a special image. The distorted image forming unit included in the image creating unit creates a distorted special image obtained by distorting the special image in advance. In other words, when a special image is directly projected onto a visor through a non-coaxial optical system, distortion caused by the shape of the visor, the positional relationship between the visor and the non-coaxial optical system, and the arrangement of the optical elements of the non-coaxial optical system may occur. However, this distortion is planned in advance, and a distortion special image obtained by distorting the special image from the beginning is created using an electronic image processing method in the image creation unit. By projecting to the visor, the distortion is canceled out and a normal special image without distortion is projected onto the visor. The projection onto the visor is preferably performed by superimposing the direct-view image and the projection image, but a small special image may be displayed on a part of the visor.
Thereby, in front of the visor, a direct-view image and a special image (virtual image) without distortion can be visually recognized.

  According to the present invention, even when a special image such as a night vision image is projected on a visor using a non-coaxial optical system, it is possible to use a non-coaxial optical system having a simple structure including a minimum of optical system elements. In addition, a special image without distortion can be projected onto the visor.

(Means and effects for solving other problems)
In the above invention, the special camera may be a night vision camera, a low-illuminance camera, or an infrared camera. By using a night vision camera or a low-illuminance camera as a special camera, the scenery in front can be clearly seen even in the dark and dusk. Moreover, a heat source (for example, a fire source, a high temperature object, an animal, etc.) can be visually recognized by using an infrared camera.

In the above invention, the image creating unit has a scaling unit for adjusting the display magnification of the distortion special image created by the distortion image forming unit, and is projected onto the direct view image and the visor by adjusting the display magnification of the distortion special image. The special image may be displayed in a superimposed manner.
According to this, it is possible to visually recognize an image in which the features of both the direct-view image and the special image are superimposed. In addition, since the size of the special image with respect to the direct-view image can be adjusted, it is possible to attach a different special camera. For example, it is possible to change the special camera according to the situation (weather, brightness, etc.). Become.

In the above invention, there are provided a plurality of types of special cameras for photographing the front with different sensitivities, and the image creation unit comprises an image synthesis unit for creating a synthesized image obtained by synthesizing video signals from at least two types of special cameras as a special image. You may make it have.
According to this, by synthesizing video signals from at least two types of special cameras, it is possible to create a composite image in which the respective optimum detection ranges are fused. Can be visually recognized. The number of types of special cameras may be three or more. However, since the apparatus becomes complicated and the cost increases, about two are preferable for practical use.

In the above invention, the image creation unit includes an external signal input unit for inputting an external signal, and an image synthesis unit for creating a synthesized image obtained by synthesizing the video signal captured by the special camera and the external signal as a special image. You may do it.
According to this, by synthesizing the external signal with the video signal from the special camera, an image to which the external additional information is added can be displayed as the special image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below, and it goes without saying that various aspects are included without departing from the spirit of the present invention.

(Embodiment 1)
FIG. 1 is a block diagram schematically showing a configuration of a head-mounted display device according to an embodiment of the present invention. FIG. 1 (a) is an overall block diagram, and FIG. 1 (b) is a part thereof. It is a functional block diagram of the image creation part which is.

  The head-mounted display device 1 mainly includes a helmet 11, a visor 12, low-illuminance cameras 13a and 13b, image creation units 14a and 14b, screen display units 17a and 17b, and non-coaxial optical systems 18a and 18b. Yes. Hereinafter, unless otherwise specified, the symbol a is assigned to the right eye and the symbol b is assigned to the left eye.

  The helmet 11 covers the head of the wearer (user) and has a shape with the front face open. The visor 12 is supported by the helmet 11 so as to be slidable up and down, and is arranged in front of the eyes when the visor 12 is lowered.

  The low-illuminance cameras 13a and 13b are fixed to the sides of the helmet 11 near the left and right eyes, and are attached so that the same scenery as the front scenery that can be observed with the naked eye can be taken. The low-illuminance cameras 13a and 13b use high-sensitivity CCD cameras so that the scenery in front can be clearly displayed even in a low-illuminance state, that is, a brightness level of about dusk. The video signals photographed by the low-illuminance cameras 13a and 13b are used to form a special image that is different from a direct-view image obtained by the naked eye when looking directly ahead through the visor 12.

  The image creation units 14a and 14b are configured by electronic image processing circuits that form image data and perform image processing based on video signals input from the low-illuminance cameras 13a and 13b. In the present embodiment, special image data is created based on video signals from the low-illuminance cameras 13a and 13b, and various image processes are performed to process the created special image data. The image processing executed by the image creating units 14a and 14b will be described in functional blocks. As shown in FIG. 1B, original image creating units 20a and 20b, distorted image forming units 21a and 21b, scaling units 22a, 22b.

The original image creation units 20a and 20b perform image processing for creating special image data (original image data) based on video signals from the low-illuminance cameras 13a and 13b. In the case of special image data in which halation is caused in part due to spot light or the like mixed into the field of view of the low-illuminance camera, image processing for correcting the halation occurrence area is also performed. That is, an image process is performed in which a region in which the luminance exceeds a preset threshold is corrected in each pixel data included in the special image data, and halation is removed.
The distorted image forming units 21a and 21b plan to distort the generated special image data when the light passes through the visor 12 and the non-coaxial optical systems 18a and 18b, and in a direction opposite to the distorted direction. Image processing is performed to create distorted special image data in which special image data is distorted in advance by adding equivalent distortion.

The scaling units 22a and 22b perform image processing for adjusting the display magnification of the distortion special image data by performing image enlargement processing and image reduction processing on the generated distortion special image data. By this adjustment, the size of the projection image projected onto the visor 12 can be adjusted, so that a visor projection image having the same size as the size of the direct-view image viewed with the naked eye through the visor 12 can be obtained.
Note that the scaling units 22a and 22b may be omitted. In this case, the angle of view of the low-illuminance cameras 13a and 13b is adjusted so that the special image and the direct-view image overlap, or a non-coaxial optical system is used. It is preferable to adjust the 18a and 18b and the screen display units 17a and 17b, or to provide the non-coaxial optical systems 18a and 18b with an optical adjustment mechanism.

  The screen display units 17a and 17b are composed of display screens 15a and 15b composed of display elements and drive circuits 16a and 16b, and are based on the distortion special image data output from the image creation units 14a and 14b. The special image distorted to 15b is displayed on the screen.

  The non-coaxial optical systems 18 a and 18 b project the light of the distorted special image emitted from the display screens 15 a and 15 b from an oblique rear side of the visor 12. That is, since there is a wearer's (user's) head in front of the visor 12, projection is performed toward the visor 12 from between the head and the wall surface of the helmet 11. The light rays from the display screens 15a and 15b are distorted when passing through the non-coaxial optical systems 18a and 18b, but the pre-distorted special image light rays are emitted to the non-coaxial optical systems 18a and 18b. The distortion is canceled and a normal special image is projected onto the visor 12.

The special image projected on the visor 12 is visually recognized in a state where it is combined with a direct-view image (a macroscopic image) observed forward through the visor 12.

Next, an image displayed by the head-mounted display device 1 of the present invention will be described. FIG. 2 is a diagram for explaining the operation of the head-mounted display device 1 of FIG.
Visor 12 and the low illuminance corresponding camera 13a, in front of 13b, shall have the square lattice object _{D 0,} which is assumed to photograph the low illuminance corresponding camera 13a, at 13b.
Image creating unit 14a, the 14b, the low illuminance corresponding cameras 13a, based on the video signal from 13b, firstly, an original image creating unit 20a, by 20b, as the image data of the special image data _{D 1} (original subject _{D 0} Image data) is created. Special image data D ₁ is data obtained directly reflects the features of the square lattice.

Subsequently, distorted image forming unit 21a, in 21b, a special image data _{D 1,} distortion distorted special image data _{D 2} was is created. This distortion is previously non-coaxial optical system 18a using a standard sample (for example a square grid pattern, such as a D _0), to measure the distortion factor by the 18b and the visor 12, in the distortion rate in the special image data D ₁ Created by giving the corresponding distortion in the opposite direction.

Then, to create the scaling unit 22a, in 22b, distortion special image data _{D 3} adjusted for magnification distortion special image data _{D 2.} The magnification is also obtained in advance by using a standard sample to display on the visor 12 through the non-coaxial optical systems 18a and 18b and adjusting the magnification so that the direct view image observed through the visor 12 and the image coincide with each other.

Subsequently, the image display unit 17a, the 17b, on the basis of the distorted special image data _{D 3,} the display screen 15a so to form a distorted special image _{D 4} was screen display 15b.

Subsequently, the distortion special image _{D 4} displayed on the screen, a non-coaxial optical system 18a, through 18b projected on the visor 12. Non-coaxial optical system 18a, passes through the 18b, distortion special image D ₄ are distorted is canceled, the normal special image D ₅ undistorted projected on the visor 12.

Wearer (user) can visually recognize the direct image of the object D _1, an image obtained by superimposing the normal special image D ₅ undistorted.
Thus, for example, when the brightness of the front changes abruptly, when the bright state is only visible with direct view image D _1, superimposed normal special image D ₅ undistorted when changes to dark By visually recognizing the image, it becomes possible to visually recognize a clear image continuously. In this case, an illuminance sensor for monitoring the brightness in front can be attached, and the switching can be automatically performed according to the brightness.
Further, by superimposing the special images from which the halation occurrence area is removed, it is possible to visually recognize an image obtained by combining the portions that are clearly projected from the direct-view image and the projected image.

  In the above-described embodiment, a pair of left and right special cameras are attached, and separate special images are projected onto the left and right eyes, but instead of this, a single special camera is used as a video from there. The signal may be branched, and the same special image may be projected to the left and right eyes via the respective non-coaxial optical systems.

  In the above embodiment, the projection onto the visor 12 is performed by superimposing the direct-view image and the projection image. However, by displaying a small special image on a part of the visor 12, It can also be displayed separately from the direct view image. That is, by reducing the magnification of the distorted special image data by the scaling unit 22 (the display position on the visor 12 is also moved as necessary), a special image is displayed on a part of the visor 12, and a direct-view image and a projection are displayed. Two images can be viewed side by side.

(Embodiment 2)
FIG. 3 is a block diagram showing a configuration of a head-mounted display device according to another embodiment of the present invention. FIG. 3A is an overall block diagram and FIG. 3B is a part thereof. It is a functional block diagram of a certain image creation part.
In the present embodiment, two types of special cameras having different types (different sensitivities) are used, and a composite image of images taken by each camera is superposed on a direct-view image and visually recognized. In FIG. 3, the same components as those in FIG.

In the head-mounted display device 2, an infrared camera 19 a is attached to the right eye side and a night vision camera 19 b is attached to the left eye side, and respective video signals are output to the image creation unit 24.
The image creation unit 24 includes an image composition unit 25 in addition to the original image creation unit 20, the distorted image creation unit 21, and the scaling unit 22 that execute the same functions as those in FIG. 1.
The image synthesis unit 25 performs processing for receiving two different video signals output from the night vision camera 19a and the infrared camera 19b, and creating synthesized image data by synthesizing these signals at an arbitrary intensity ratio. The created composite image data is sequentially sent to the original image creation unit 20, the distorted image creation unit 21, and the scaling unit 22, and the same processing as in the above-described embodiment is performed. Thereafter, the output from the image creating unit 24 (scaling unit 22) is sent to the left and right image display units 17a and 17b simultaneously in parallel, and then to the left and right eyes via the non-coaxial optical systems 18a and 18b and the visor 12. The same special image is projected.

Next, an image displayed by the head-mounted display device of the present invention will be described. FIG. 4 is a diagram for explaining the operation of the head-mounted display device 2 of FIG.
Assume that the subject E ₀ is in front of the visor 12, the infrared camera 19a, and the night vision camera 19b. It is assumed that the subject E ₀ has a square lattice pattern and a heat generation area along the diagonal and the outer periphery. And this shall be image | photographed with the infrared camera 19a and the night vision camera 19b.

The video signal taken by an infrared camera 19a, and includes an image information E ₁ in a shape corresponding to the heat generating region. Further, the image signal captured by a night-vision camera 19b, contains image information E ₂ corresponding to the square lattice pattern. These two video signals are sent to the image creation unit 24. The image creating unit 24, the image synthesizing unit 25 based on the two video signals to create a composite image data E ₃ synthesized them. When creating the composite image data E _3, or adjusted to match the size of one square to the size of the other square, synthesis in a desired ratio arbitrarily set the intensity ratio of the video signal image data E ₃ is preferably created.

Subsequently, the synthesized image data E ₃ are sent to the original image creating section 20, the special image data E ₄ is created. Special image data E _4, based on the composite image data E _3, is created by the image processing such as correction to remove the halation generating area is performed.

Subsequently, similarly to the above-described embodiment, the distorted image forming unit 21 generates distorted special image data E _{5 obtained} by distorting the special image data E ₄ , and the scaling unit 22 distorts special image data E _5. scaling distortion special image data E ₆ that is created.

Subsequently, the output distorted special image data E ₆ from the scaling unit 22, which is branched into two and sent the left and right image display unit 17a, and 17b at the same time. The screen display unit 17a, 17b, on the basis of the distorted special image data _{E 6,} the display screen 15a, on 15b, distorted special image _{E 7} is displayed.

Subsequently, the distortion special image _{E 7} displayed on the screen, a non-coaxial optical system 18a, through 18b projected on the visor 12. By passing through the non-coaxial optical systems 18 a and 18 b, the distortion special image E ₇ is canceled out, and a normal special image E ₈ without distortion is projected onto the visor 12.

Comparing the normal special image E ₈ are projected on the visor 12 and the object E _0, rather than the image obtained by directly viewing the object E _0, you can see the image shape (diagonal) applied in the heat generating region of its internal ing.

The wearer (user) will be visible and direct image of the object E _0, the image obtained by superposing the normal special image E _8.
In this case as well, two types of special images from which the halation occurrence area has been removed are superimposed, and the direct-view image and the projected image are also superimposed, so that the images that clearly show off the parts that are clearly displayed are visually recognized. can do.

  In the present embodiment, the composite image created by the video signals of the infrared camera 19a and the night vision camera 19b is used simultaneously by the left and right eyes, but an infrared camera and a night vision camera are attached to the left and right respectively. A total of four special cameras may be used. In this case, a composite image is created independently for the left eye and the right eye.

(Embodiment 3)
FIG. 5 is a block diagram showing a configuration of a head-mounted display device which is another embodiment of the present invention, FIG. 5 (a) is an overall block diagram thereof, and FIG. 5 (b) is a part thereof. It is a functional block diagram of a certain image creation part.
In the present embodiment, a composite image of an image photographed by one special camera and additional information is visually recognized by superimposing it on a direct view image. In FIG. 5, the same components as those in FIGS. 1 and 3 are denoted by the same reference numerals, and a part of the description is omitted.

In the head-mounted display device 3, an infrared camera 19 a is attached to the right eye side, and a video signal is output to the image creation unit 31.
The image creation unit 31 includes an external signal input unit 32 in addition to the original image creation unit 20, the distorted image creation unit 21, the scaling unit 22, and the image composition unit 25 that execute the same functions as those in FIG. 1 or FIG. 3. ing.

  The external signal input unit 32 can input an external signal 41 useful for a wearer (user). Useful external signals 41 are, for example, speedometers, altimeters, and flight speed information (altitude information, fuel information, etc.) from a speedometer, altimeter, and fuel gauge, which are not shown in the case of an aircraft / helicopter pilot, map information, weather information, etc. Information, time information, and the like. Moreover, the video information etc. which were image | photographed in the past may be sufficient. These pieces of information are sent as text information or image information.

The image composition unit 25 performs a process of creating composite image data based on the video signal from the infrared camera 19 a and the external signal 41 input from the external signal input unit 32.
The created composite image data is sequentially sent to the original image creation unit 20, the distorted image creation unit 21, and the scaling unit 22, and the same processing as in the above-described embodiment is performed. Thereafter, the output from the image creation unit 31 (scaling unit 22) is sent to the left and right image display units 17a and 17b simultaneously in parallel, and then to the left and right eyes via the non-coaxial optical systems 18a and 18b and the visor 12. The same special image is projected.

Next, an image displayed by the head-mounted display device 3 of the present invention will be described. FIG. 6 is a diagram for explaining the operation of the head-mounted display device 3 of FIG.
It is assumed that there is a subject F ₀ having a square lattice pattern in front of the visor 12 and the infrared camera 19a. And this shall be image | photographed with the infrared camera 19a.

The video signal taken by an infrared camera 19a, and includes an image information corresponding to the square lattice pattern of the object F _0. This video signal is sent to the image creation unit 31. The image composition unit 25 of the image creation unit 31 creates composite image data F ₁ by combining these based on the external signal 41 (including the character information “OO”) and the video signal from the infrared camera 19a. To do.

Subsequently, the composite image data F ₁ is sent to the original image creation unit 20 to create special image data F ₂ (original image data). The special image data F ₂ is created by performing image processing such as correction for deleting the halation occurrence region based on the composite image data F ₂ .

Subsequently, similarly to the above-described embodiment, the distorted image forming unit 21 creates distorted special image data F _{3 obtained} by distorting the special image data F ₂ , and the scaling unit 22 distorts special image data F _3. scaling the distorted special image data F ₄ are prepared.

Subsequently, the output distorted special image data F ₄ from the scaling unit 22, which is branched into two and sent the left and right image display unit 17a, and 17b at the same time. The screen display unit 17a, 17b, on the basis of the distorted special image data _{F 4,} the display screen 15a, on the 15b, the distorted special image _{F 5} is displayed.

Subsequently, the distortion special image _{F 5} displayed on the screen, a non-coaxial optical system 18a, through 18b projected on the visor 12. Non-coaxial optical system 18a, passes through the 18b, distorted special image F ₅ is distorted is canceled, normal special image F ₆ undistorted is projected visor 12.

Comparing the normal special image F ₆ is projected on the visor 12 and the object F _0, to the image of the same square grid with the image viewed directly subject F _0, will see an image applied character "○○" .

Then, the wearer (user) views the image obtained by superimposing the direct-view image of the subject F ₀ and the normal special image F ₆ .
Also in this case, by superimposing the special image from which the halation occurrence area or the like is removed and the direct-view image, it is possible to visually recognize an image that highlights the portions that are clearly displayed. In addition, useful external information can be displayed simultaneously.

  The present invention can be used for manufacturing a head-mounted display device that projects video information acquired by a special camera such as a night vision camera or an infrared camera onto a visor as an image.

1 is a block diagram showing a configuration of a head-mounted display device that is an embodiment of the present invention. The figure explaining operation | movement of the head mounted display apparatus of FIG. The block diagram which shows the structure of the head mounted display apparatus which is other one Embodiment of this invention. The figure explaining operation | movement of the head mounted display apparatus of FIG. The block diagram which shows the structure of the head mounted display apparatus which is other one Embodiment of this invention. The figure explaining operation | movement of the head mounted display apparatus of FIG.

Explanation of symbols

1, 2, 3: Head-mounted display device 11: Helmet 12: Visor 13a, 13b: Low illumination camera (special camera)
14a, 14b: Image creation unit 15a, 15b: Display screen 17a, 17b: Screen display unit 18a, 18b: Non-coaxial optical system 19a: Night vision camera (special camera)
19b: Infrared camera (special camera)
20a, 20b: Original image creation unit 21a, 21b: Distorted image formation unit 22a, 22b: Scaling unit 24: Image creation unit 25: Image composition unit 31: Image creation unit 32: External signal input unit

Claims (5)

A visor that is supported by a helmet and placed in front of the eye, a special camera that shoots the front with a sensitivity different from the direct-view image observed through the visor, and an image creation unit that creates a special image from the video signal captured by the special camera; A head-mounted display device comprising: a screen display unit that displays an image; and a non-coaxial optical system that projects the image displayed on the screen to the visor from an oblique direction so that the projected image and the direct-view image can be viewed. Because
The image creating unit has a distorted image forming unit that creates a distorted special image in which a special image is distorted in advance according to the distortion caused by the visor and the non-coaxial optical system, and outputs the distorted special image to the screen display unit. A head-mounted display device characterized by the above.   The head-mounted display device according to claim 1, wherein the special camera is a night vision camera, a low-illuminance camera, or an infrared camera.   The image creation unit has a scaling unit that adjusts the display magnification of the distortion special image created by the distortion image formation unit, and adjusts the display magnification of the distortion special image to display the direct view image and the special image projected on the visor. The head-mounted display device according to claim 1 or 2, wherein the head-mounted display device displays the images in a superimposed manner.   It is provided with a plurality of types of special cameras that photograph the front with different sensitivities, and the image creation unit has an image synthesis unit that creates a synthesized image obtained by synthesizing video signals from at least two types of special cameras as a special image The head-mounted display device according to any one of claims 1 to 3.   The image creation unit has an external signal input unit for inputting an external signal, and an image synthesis unit for creating a composite image obtained by synthesizing a video signal photographed by a special camera and the external signal as a special image. The head-mounted display device according to any one of claims 1 to 3.

Images