JP2002244074A - Picture display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a picture display device which permits the outer light regulation with a small amount of resources in the picture display device which has an outer light regulating function. SOLUTION: This picture display device is provided with a color LCD 102 which performs picture display, an eyepiece optical system 106 for guiding the light from the color LCD 102 to eyes by reflecting the same, a half mirror 109 which takes in the light from the outside and a monochromatic LCD 101 for light shielding which has a display picture element corresponding to at least one picture element of a projection image of the color LCD 102 and is disposed on the outside of the half mirror 109. Therein, display data (RGB) of the color LCD 102 or one part thereof and display data of the monochromatic LCD 101 for light shielding or one part thereof are stored in the same frame memory.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for displaying an image, and more particularly, to an apparatus for displaying an image based on an image signal from an external device such as a computer, and reflecting light from the image display. The present invention relates to an image display apparatus provided with an eyepiece optical system for guiding the light to the eye and an optical element for taking in light from the outside world.

[0002]

2. Description of the Related Art Conventionally, an image display section for displaying an image based on an image signal from a computer or the like is provided, and an image displayed on the image display section is viewed through a transmission type light splitting / combining means such as a half mirror. There is known an optical see-through type head mounted image display device (hereinafter referred to as HMD) capable of presenting a virtual image to a user and observing the outside world in the same field of view through a light division / synthesis unit.

[0003] Such an optical see-through type HMD
In, the image displayed on the image display unit is presented to the observer as a virtual image, so that it is observed as a transparent image.
Therefore, when the outside is very bright, it is difficult to observe a virtual image. Therefore, an optical see-through type HMD using a single-segment type liquid crystal shutter to control the amount of incident light from the outside has been proposed.

Hereinafter, a conventional HMD with an external light adjusting function will be described with reference to FIGS. FIG. 8 is a perspective view showing a state in which an observer wears a conventional HMD with an external light adjustment function, and FIG. 9 is a diagram showing an optical system configuration example of a conventional HMD with an external light adjustment function. 8, reference numeral 102 denotes a color LCD which displays an image based on an image signal from an external device such as a computer, which is supplied via an interface cable 107; 103, a backlight which is a light source of the color LCD 102; A half mirror; 106, an eyepiece optical system; 114, an imaging optical system for imaging incident light from the outside onto a monochrome LCD 701 described later;
7, an interface cable for connecting the HMD to an image output device such as a computer; 108, an eye of a wearer of the HMD; 701, a single-segment monochrome LCD for blocking light from the outside;
02 is the central axis of the image light that has passed through, 111 is the central axis of the light from the outside, 112 is the monochrome 111 of the light 111 from the outside.
The central axis of light after passing through D701, 113 is the central axis of light entering the eyes of the HMD wearer, and is a color LCD.
Image light 110 from 102 and monochrome LCD 701
The external light 112 passing through the superimposed light is overlapped.

[0005] In FIGS. 8 and 9, “a” attached to the end of the symbol in the drawings indicates that the component is for the right eye, and “b” is a component for the left eye. Also, as shown in FIG. 9, the color LCD 102 and the monochrome LCD 701 are arranged at an equal distance L from the half mirror 109, so that the observer can view the (virtual image) displayed on the color LCD 102 and the monochrome LCD 701. It is possible to observe the external image formed on the object in focus.

FIG. 10 is a view for explaining the structure of a composite image observed by a wearer of a conventional optical see-through HMD with an external light adjusting function. In FIG. 10, reference numeral 201 denotes a color LC.
An image displayed on D102; 202, an external world in the field of view of the HMD wearer (observer); 801 and 804, a (display) state of a monochrome LCD 701 of a single segment type;
Reference numerals 802 and 805 denote external world images formed on a single-segment type monochrome LCD 701;
Reference numeral 6 denotes an image in which the external image formed on the monochrome LCD 701 of the single segment type and the virtual image of the image displayed on the color LCD 102 overlap each other, which is finally visually recognized by the HMD wearer.

Next, the circuit configuration of the image display unit (FIG. 11A) and the external light adjustment unit (FIG. 11B) of the conventional HMD with an external light adjustment function will be described with reference to FIG. . These circuits are implemented in the control circuit 104. In the image display unit shown in FIG.
, For temporarily storing color image data to be displayed, for example, a 32-bit frame memory; 302, a timing generator for generating timing for displaying the color image data on the color LCD 102; 303, timing generated by the timing generator 302 , A color LCD controller for reading color image data from the frame memory 301 and transferring the color image data to the color LCD 102; a driver 305 for converting the color image data output from the color LCD controller 303 into a waveform for driving the color LCD 102; 102a)
Also, color LCDs 350 to 353 for the left eye (102b) are signal lines between the elements.

In the external light adjusting section shown in FIG. 11B, reference numeral 901 denotes a single segment type monochrome LCD.
A pulse generator 702 for generating a pulse to be applied to 701, a volume 902 for changing the transmittance of the monochrome LCD 701, and a pulse generator 903
701 is a driver for amplifying the pulse generated in accordance with the value of the volume 902, 701 is a single segment type monochrome LCD used for external light adjustment for the right eye (701a) and left eye (701b), and 950 and 951 are It is a signal line between each component.

FIG. 12 is a timing chart of the image display section and the external light adjusting section. FIGS. 12A and 12B are timing charts of the image display section, and FIG. 12C is a timing chart of the external light adjusting section. Are respectively shown. FIG.
4A, VSYNC is a vertical synchronization signal transmitted from an image output device such as a computer via an interface cable 107, and HSYNC is a horizontal synchronization signal transmitted from an image output device such as a computer via the interface cable 107. The synchronizing signal, R / L is a signal transmitted from an image output device such as a computer via the interface cable 107 and indicates whether the image is for the right eye or the left eye, and VST_R is the right signal via the signal line 351. A vertical synchronization signal, VS, supplied to the color LCD 102a for the eye
T_L is a color LCD 1 for the left eye via a signal line 352.
VCK is supplied to the signal line 350b.
A vertical clock supplied to the color LCD 102 via
HST is a horizontal synchronizing signal supplied to the color LCD 102 via the signal line 350, HCK is a horizontal clock supplied to the color LCD 102 via the signal line 350, and RGB is a color LCD1 via the signal line 353 and the driver 305.
02 is color image data to be supplied. FIG.
FIG. 12B is an enlarged view of HST, HCK and RGB of FIG.

In FIG. 12C, P is a pulse generated by the pulse generator 901, PD_O is an output signal of the driver 903 when the volume 902 is adjusted to maximize the transmittance of the monochrome LCD 701,
PD_C is the driver 90 when the volume 902 is adjusted so that the transmittance of the monochrome LCD 701 is minimized.
3 is an output signal.

A conventional optical see-through type HMD with an external light adjusting function will be further described. A conventional optical see-through HMD with an external light adjusting function has a configuration as shown in FIGS. That is, light emitted from the backlight 103 and transmitted through the color LCD 102 has an optical path indicated by 110. Light from the outside world has an optical path indicated by 111, and furthermore, a monochrome LCD 701 is provided.
Is transmitted through the optical path to form an optical path as shown by 112, and 110
The light indicated by 112 and the light indicated by 112 overlap and enter the eye of the person wearing the HMD on the optical path indicated by 113. Also, 1
In order to match the amount of image light of the color LCD 102 guided by the optical path shown by 10 with the amount of external light guided by the optical path shown by 111, a monochrome LCD 701 for controlling the amount of external light is provided.

FIG. 10 shows a configuration of an image observed by a person wearing the HMD having such a configuration. That is, 20
Reference numeral 1 denotes an image displayed on the color LCD 102, which is an image of light guided by an optical path indicated by reference numeral 110.
Reference numeral 202 denotes an image of light from the outside in the field of view of the HMD wearer, which is an image of light guided by the optical path 111 and formed on the monochrome LCD 701 by the imaging optical system 114. Reference numeral 801 denotes a state when the transmittance is adjusted to be maximum in the single-segment type monochrome LCD 701, and reference numeral 802 denotes a monochrome LCD guided by an optical path 112 when the monochrome LCD 701 is in the state 801. This is an image of the external light transmitted through the LCD 701, and the images 201 and 802 are superimposed on each other.
An image 803 is observed in the eye of the wearer wearing D.

Reference numeral 804 denotes a state when the transmittance is adjusted to be minimum in the single-segment type monochrome LCD 701, and reference numeral 805 denotes a state 112 when the monochrome LCD 701 is in the state of 804. This is an image of the external light transmitted through the monochrome LCD 701 guided by the optical path. The images 201 and 805 are superimposed, and an image 806 is observed in the eyes of the wearer of the HMD.

Further, a color LCD 102 or a monochrome LC
A circuit for driving D701 is mounted on the control circuit 104, and FIG. 11 shows a schematic circuit configuration thereof. That is, color stereoscopic image data (R7 to _{RGB8) of} 8 bits each for RGB generated by image processing of a computer or the like transferred via the interface cable 107.
₀ , G _7-0 , B _7-0 ) are sequentially written to the frame memory 301 in the left and right frames.

At the same time, the vertical and horizontal synchronization signals (VSYNC, HSYNC) and the left and right signals (R
/ L) is input to the timing generator 302, and the vertical and horizontal synchronization signals (VS) for the color LCD 102 are output.
T, HST), vertical, horizontal clock (VCK, HC)
K), and other signals are generated.

Next, the color LCD controller 303 reads RGB color stereoscopic image data from the frame memory 301 in synchronization with the vertical and horizontal synchronizing signals generated by the timing generator 302 and the vertical and horizontal clocks. Left and right color LCD1
02.

In the circuit for adjusting external light, the pulse P (950) generated by the pulse generator 901 is completely independent of the color stereoscopic image display circuit, and the pulse P (950) is adjusted according to the value of the volume 902 for adjusting external light. The signal is amplified by a driver 903 and applied to a monochrome LCD 701 of a single segment type. That is, the waveform when the volume 902 is adjusted to maximize the transmittance is PD_O (951), and the state at that time is 801. The waveform when the volume 902 is adjusted to minimize the transmittance is PD_C (951), and the state at that time is 803. FIG. 12 shows a timing waveform of a main part in these circuits.

[0018]

However, in the conventional optical see-through type HMD with an external light adjusting function, when the external luminance is higher than the luminance of the color stereoscopic image display, a color LCD as shown by 803 in FIG. The outside world can be seen through behind the color stereoscopic image displayed by. In order to avoid this, if the external light is blocked by lowering the transmittance with the external light adjustment volume, if the color stereoscopic image is adjusted so as not to be transparent, the outside world becomes extremely dark as shown by 806 in FIG. In some cases, however, there is a problem that a dark part of the outside world cannot be seen at all.

In order to solve this problem, a monochrome LCD for adjusting external light is changed from a single segment type to a dot matrix type, and a color image is formed using a black image (a virtual image of a shadow) corresponding to a virtual image of a color stereo image. A technology for improving the visibility of an image virtual image is proposed in Japanese Patent No. 2,840,692. However, in this patent, there is no suggestion about external light adjustment according to the brightness of external light or external light adjustment of a background portion of a virtual image of a color stereoscopic image. The display content of the monochrome LCD is determined regardless of the brightness of the outside world. In addition, no mention is made of digital image signal processing, matching of color image display light with luminance of external light, and the like.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems of the prior art, and an object of the present invention is to provide an image display device capable of adjusting external light with a small amount of resources.
An object of the present invention is to provide an image display device having an external light adjustment function, which is capable of adjusting the external light of a background portion of a virtual image. Another object of the present invention is to provide an image display device having an external light adjustment function, in which the external light can be adjusted according to the brightness of the external environment.

[0021]

That is, the gist of the present invention is to provide an eyepiece optical system having image display means for guiding light to the eye by reflecting light from the image display means and an optical element for taking in light from the outside world. Image display means provided with light-shielding image display means having display pixels corresponding to at least one pixel of a projected image of the image display means, and a transmissive display device capable of gradation display for each pixel as light-shielding image display means In the image display device, the display data of the image display means or a part thereof and the display data of the light-shielding image display means or a part thereof are stored in the same display memory.

Further, another gist of the present invention is to provide an image display means, an eyepiece optical system for guiding light to the eye by reflecting light from the image display means, and an optical element for taking in light from the outside world. In an image display apparatus using a transmissive display device that includes a light-shielding image display unit having a display pixel corresponding to at least one pixel of a projection image of the image display unit, and that can perform gradation display for each pixel as the light-shielding image display unit, ,
The display data of the light-shielding image display means is one bit per pixel. If the one-bit data is data indicating light-shielding, the corresponding pixel is set to a predetermined light-shielding density, and if the one-bit data is data indicating transmission, it is supported. The image display device further includes a control unit that controls the light-shielding image display unit so that the pixel to be displayed is displayed at a predetermined density.

Further, another gist of the present invention is to provide an image display unit, and project an image displayed on the image display unit as a virtual image on an optical element which allows the outside world to be seen through, so that a virtual image is displayed to the observer outside. In an image display device for combining and presenting, the light amount adjusting means for controlling the amount of light incident on the optical element from the outside, an image displayed on the image display section, and light amount control information created based on the image are stored. And a light amount control unit that reads out light amount control information from the storage unit and adjusts the light amount so as to reduce a predetermined ratio of incident light from the outside to an area on the optical element corresponding to a predetermined area of a virtual image of an image displayed on the image display unit. An image display device having a control means for controlling the means.

[0024]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail based on preferred embodiments with reference to the drawings. In addition, in FIGS. 1 to 7 according to the following embodiments, FIGS.
The same components as those in 2 are denoted by the same reference numerals. In the following embodiments, a head-mounted image display device that presents a three-dimensional image will be described as an example of an image display device according to the present invention. It goes without saying that the present invention can be applied to any image display device as long as it is an image display device that combines and presents it to the observer.

(First Embodiment) FIG. 1 is a view showing a configuration example of a head mounted image display device (head mounted display; hereinafter also referred to as HMD) according to the present embodiment.
FIG. 2 is a perspective view showing the appearance at the time of mounting and the arrangement of main components, and FIG. 2 is a view showing the configuration of an optical system. 1 and 2
102, a color LCD for displaying a stereoscopic image based on an image signal from a computer or the like; 103, a backlight which is a light source of the color LCD 102;
A control circuit for controlling the MD, 109 is a half mirror, 1
06 is an eyepiece optical system, 114 is an imaging optical system for imaging incident light from the outside on the monochrome LCD 101 described later, 107 is an interface cable for connecting the HMD to an image output device such as a computer, Reference numeral 108 denotes an eye of the HMD wearer, and 120 denotes a sensor for detecting the brightness of the outside world.

Reference numeral 110 denotes a central axis of image light transmitted through the color LCD 102, 111 denotes a central axis of light from the outside,
Reference numeral 112 denotes a central axis of light after light 111 from the outside passes through the monochrome LCD 701, and reference numeral 113 denotes a central axis of light entering the eyes of the HMD wearer, and transmits the image light 110 from the color LCD 102 and the monochrome LCD 701. The external light 112 coming out overlaps.

Also, in FIGS. 1 and 2, a given at the end of the symbol in the drawings indicates that the component is for the right eye, and that b is a component for the left eye. Also, as shown in FIG. 2, the color LCD 102 and the monochrome LCD 101 are arranged at an equal distance L from the half mirror 109, so that the observer can view the image (virtual image) displayed on the color LCD 102 and the monochrome LCD 101. It is possible to observe the external image formed on the object in focus.

The present embodiment differs from the configuration of the conventional HMD shown in FIGS. 8 and 9 in that the sensor 120 for detecting the brightness of the external world and the image light of the color LCD 102 guided by the optical path indicated by 110 And the amount of external light guided by the optical path indicated by 111,
A monochrome LCD 10 for controlling the amount of external light for adjusting how the virtual image of the image of the color LCD 102 is transparent.
First, a dot matrix type monochrome LCD capable of displaying gradations is provided.

In such an HMD, light emitted from the backlight 103 and transmitted through the color LCD 102 has an optical path indicated by 110. Light from the outside is imaged on the monochrome LCD 101 via the imaging optical system 114 via an optical path indicated by 111 and further transmitted through the monochrome LCD 101 to the half mirror 109 via an optical path indicated by 112. Incident. Then, the light beam from the monochrome LCD 101 transmitted through the half mirror and the light beam from the color LCD 102 reflected by the half mirror 109 via the imaging optical system 105 are overlapped with each other.
Is observed by the HMD wearer in the optical path shown in FIG.

In the present embodiment, as described later,
By generating a luminance signal to be displayed on a monochrome LCD from the brightness of the external world detected by the sensor 120 and image data for displaying a virtual image of a color stereoscopic image supplied from the outside, and controlling the monochrome LCD, The method is characterized by adjusting how the three-dimensional image virtual image is transparent, and at the same time, relieving a sense of discomfort between the brightness of the outside world and the brightness of the color three-dimensional image virtual image.

FIG. 3 is a block diagram showing a configuration example of the display control circuit of the HMD in the present embodiment. These circuits can be implemented in the control circuit 104 of the HMD.
The display control circuit in the present embodiment has both functions of the image display unit and the external light adjustment unit having the conventional configuration shown in FIGS. 11A and 11B.

In the figure, reference numeral 309 denotes color stereoscopic image data (R _{7 to 0} , R _{7 to 0} , 8 bits) for each color of RGB to be displayed on the color LCD 102 and supplied from an external device such as a computer device via the interface cable 107.
G _7-0 , B _7-0 ) and the sensor 120 provided in the HMD
Inputs data on the brightness of the external world detected in
A luminance data generation unit that outputs GB color image data and luminance data. Reference numeral 301 denotes a luminance data generation unit 3
A 32-bit frame memory 302 for temporarily storing the color image data and the luminance data output by 09;
Is a timing generator that generates timing for displaying color image data on the color LCD 102 and displaying monochrome image data on the monochrome LCD 101.

Reference numeral 303 denotes a timing generated by the timing generator 302 from the frame memory 301 to RGB.
The color image data of 8 bits for each color is read and the color L
Color LCD controller for transferring to CD 102, 30
4 reads out 8-bit monochrome image data (luminance data) from the frame memory 301 at the timing generated by the timing generator 302 and
And 305, an RG for generating a driving waveform of the color LCD 102 based on the color image data output from the color LCD controller 303.
B driver 306, monochrome LCD controller 30
4 based on monochrome image data output by monochrome LCD
A monochrome driver for generating a driving waveform of 101;
Is a color LCD for the right eye (102a) and the left eye (102b); 101 is a dot matrix type monochrome LCD capable of gradation display for the right eye (101a) and the left eye (101b); Is a signal line between each component.

In the control circuit having such a configuration, color stereoscopic image data of 8 bits each of RGB generated by an external device such as a computer is converted into a luminance data generation unit 30.
9 is input. The output data from the optical sensor 120 is supplied to the luminance data generation unit 309, and the luminance data generation unit 309 generates monochrome gradation data (luminance data) to be displayed on the monochrome LCD from these data.

In this case, in order to prevent see-through of a color stereoscopic image, a black image corresponding to a display image is displayed on a monochrome LCD.
, The corresponding area is black according to a predetermined condition such as an area where the RGB image data exists or an area where at least one of the RGB image data is equal to or greater than a predetermined value. Data). In other areas, luminance data of a predetermined density is set according to the output signal of the sensor 120 and the image data.

The display density of the monochrome LCD in the background area where the color three-dimensional image is not displayed, that is, the amount of light shielding may be determined depending only on the brightness of the outside world, but also in consideration of the brightness and color tone of the color three-dimensional image. May be determined.
When the brightness and color tone of the color stereoscopic image are taken into account, the visibility of the stereoscopic image can be improved. Specifically, for example, when the color stereoscopic image is an image with low contrast, it is difficult to recognize the details of the color stereoscopic image if the background is bright. In such a case, the details of the color stereoscopic image can be recognized by darkening the background.

The conditions for determining the gray density of the background portion are determined in advance by preparing a table in which sensor input values and / or characteristic values of image data are input and stored in the luminance data generation unit 309. Any method can be adopted, such as calculating each time using the calculation formula.

Further, not only the area corresponding to the color stereoscopic image is made completely black (luminance 0), but depending on the display content, luminance is given to a part or all of the area, so that a display having a transmission effect is provided. Will be possible. In this case, the luminance data generation unit can determine whether or not to provide the transmission effect, receive information on the area to be displayed with the transmission effect from the image data supply source, or register the information in advance. It is only necessary to generate luminance data reflecting the above.

The image data and the luminance data output from the luminance data generation unit 309 are written into a 32-bit frame memory 301 in the order of left and right frames. At the same time, the vertical and horizontal synchronizing signals (VSYNC,
HSYNC) and a left / right signal (R / L) are input to the timing generator 302, and the color LCD 10
2 and monochrome LCD 101, vertical and horizontal synchronization signals (VST, HST), vertical and horizontal clocks (VC
K, HCK) and other signals are generated.

Next, the color LCD controller 303 reads out 8-bit color stereoscopic image data of RGB each from the frame memory 301 in synchronization with the vertical and horizontal synchronizing signals generated by the timing generator 302 and the vertical and horizontal clocks. The data is transferred to the left and right color LCDs 102 via the 305. At the same time, the monochrome LCD controller 304 reads 8-bit monochrome stereoscopic image data (luminance data) from the frame memory 301 in synchronization with the vertical and horizontal synchronization signals generated by the timing generator 302 and the vertical and horizontal clocks. The data is transferred to the left and right monochrome LCDs 101a and 101b via the driver 306.

FIG. 4 is a timing chart of the display control circuit shown in FIG. FIG. 4B is an enlarged view of a part of FIG. 4A. The numbers in parentheses after the signal names indicate the signal lines to which the signals are transmitted by the numbers in FIG. In FIG. 4, VSYNC is a vertical synchronization signal transmitted from an image output device such as a computer via the interface cable 107, and HSYNC is a horizontal synchronization signal transmitted from an image output device such as a computer via the interface cable 107. The signal and R / L are signals transmitted from an image output device such as a computer via the interface cable 107 and indicating whether the image is for the right eye or the image for the left eye.

VST_R is a color LCD for the right eye
VST_L, a vertical synchronization signal supplied to the monochrome LCD 102a and the monochrome LCD 101a, is a color LCD 102b for the left eye.
VCK is a vertical synchronizing signal supplied to the monochrome LCD 101b and the color LCD 102 and the monochrome LCD
HST is a color LCD supplied to the vertical clock 101
HCK is a horizontal synchronizing signal supplied to the color LCD 102 and the monochrome LC
Horizontal clock supplied to D101, RGB is color LC
8 bits of RGB color image data to be supplied to the D 102, and 8 bits of 8 bit luminance image data to be supplied to the monochrome LCD 101.

FIG. 5 shows a color LCD 102 and a monochrome LCD 1 of the HMD according to the present embodiment.
FIG. 11 is a diagram illustrating a relationship between an image displayed at 01 and an image observed by an HMD wearer. In FIG. 5, reference numeral 201 denotes an image to be displayed on the color LCD 102; 202, an external field which is in the field of view of the HMD wearer (observer); Reference numeral 206 denotes an image when the transmittance is minimized in the dot matrix type monochrome LCD 101 capable of gradation display.

Reference numeral 204 denotes a monochrome L guided by the optical path indicated by 112 when the monochrome LCD 101 is in the state of 203.
Images of external light transmitted through CD 101, 201 and 20
4 are superimposed, and an image as shown at 205 is observed in the eyes of the HMD wearer. Conversely, reference numeral 207 denotes an image of external light transmitted through the monochrome LCD 101 guided by the optical path indicated by 112 when the monochrome LCD 101 is in the state of 206, and H and 201 are superimposed on each other.
An image as shown at 208 is observed in the eyes of the MD wearer.

As described above, according to the HMD according to the present embodiment, it is possible to prevent the see-through of a three-dimensional virtual image, or to display a three-dimensional virtual image by giving an arbitrary transmission effect. Also, by storing image data and luminance data in a common frame memory, an image display unit and an external light control unit, which were separately configured in the past, are integrated, and an LCD for displaying a stereoscopic image is provided.
And a timing generator used for display control of the LCD for controlling external light. Further, by controlling the brightness of the background portion according to the brightness of the external world and the stereoscopic image, the visibility of the stereoscopic image can be improved.

(Second Embodiment) Next, an HMD according to a second embodiment of the present invention will be described with reference to FIGS. 6 and 7, the same reference numerals are given to the same components as those in FIGS. 3 and 4 used in the description of the first embodiment. Further, the hardware configuration of the HMD (excluding the display control circuit) according to the present embodiment may be the same as that of FIGS.

The HMD according to this embodiment is shown in FIGS.
Is provided with a transmittance adjusting circuit 505 and a selector 506 for the HMD according to the first embodiment described with reference to
The difference is that the HMD wearer can adjust the outside light and the frame memory 501 has a 16-bit configuration. That is, in the display control circuit of the HMD according to the first embodiment,
Using a 32-bit frame memory 301, RGB
The configuration is such that 8-bit stereoscopic image data for each color and 8-bit luminance data (8 × 3 + 8 = 32) are stored. However, in the present embodiment, the stereoscopic image data is 5 bits for each color of RGB, and the luminance data is 1 bit, and 16 bits. Stored in bit frame memory. Then, instead of setting the luminance data to 1 bit, the transmissivity adjusting circuit generates 5-bit luminance data to supply gradation display data to the monochrome LCD. With this configuration,
It is possible to reduce the capacity of the frame memory.

In FIG. 6, reference numeral 509 denotes color image data (R _{4 to 0} , G _{4 to 0} , R _{4 to 0} , R 5 to R 5) for each color of RGB displayed on the color LCD 102 and supplied from an external device such as a computer device via the interface cable 107.
B _{4 to 0)} and receives the output of the sensor 120 which detects the brightness of the outside world provided the HMD, a luminance data generating unit for generating a 1-bit luminance data (Y). The luminance data generation unit 509 outputs the generated luminance data and 5-bit RGB color image data supplied from an external device.

501 is a 5-bit color LC for each color of RGB
A 16-bit frame memory for temporarily storing color image data to be displayed on the D102 and 1-bit monochrome image data (luminance data) to be displayed on the 5-bit monochrome LCD 101. The output image data and luminance data are written to the frame memory 501 in the order of left and right frames.

Reference numeral 302 denotes a color LCD for converting color image data.
509, and monochrome image data to the monochrome LCD1.
01 is a timing generator for generating a timing for displaying the image on the display unit 01. Timing generator 302
Are vertical and horizontal synchronization signals (VSYNC, HSYNC) and left and right signals (R) supplied together with image data from an external device via the interface cable 107.
/ L), vertical and horizontal synchronization signals (VST, HST),
Generate vertical and horizontal clocks (VCK, HCK) and other timing signals.

Reference numeral 303 denotes a color LCD 10 which reads 5-bit RGB color image data from the frame memory 501 in synchronization with the vertical and horizontal synchronization signals generated by the timing generator 302 and the vertical and horizontal clocks.
2 is a color LCD controller that transfers the data to the LCD.

Reference numeral 304 denotes a color LCD controller 303
Similarly, the monochrome image data (Y) output from the selector 506 in synchronization with the vertical and horizontal synchronization signals generated by the timing generator 302 and the vertical and horizontal clocks
Is transferred to a monochrome LCD 510 capable of displaying gradation.

Reference numeral 505 denotes a monochrome LCD 510.
A transmittance adjusting circuit that adjusts the transmittance of a background area other than the light-shielding portion (the area corresponding to the color image).
Volume and adjustment buttons (not shown)
, And an A / D converter. In the present embodiment, the transmittance adjusting circuit 50
The luminance data output by 5 is 5 bits in addition to the color image data stored in the frame memory 501, but the number of bits can be arbitrarily set.

Reference numeral 506 denotes luminance data of “0” when the monochrome image data read from the frame memory 501 is “0 (ie, light-shielded)”, and Is used to select the output data of the transmittance adjusting circuit 505 and to select the monochrome LCD controller 3
04, an RGB driver for generating a drive waveform for the color LCD 509 based on the color image data output from the color LCD controller 303;
Reference numeral 08 denotes a monochrome driver for generating a driving waveform of the monochrome LCD 101 based on monochrome image data output from the monochrome LCD controller 304, and reference numeral 102 denotes a right eye (10
2a) and color LCD for left eye (102b), 10
Reference numeral 1 denotes a dot matrix type monochrome LC capable of gradation display for the right eye (101a) and the left eye (101b).
D, 350 to 354, 554, and 555 are signal lines between the components.

FIG. 7 is a timing chart of the display control circuit shown in FIG. FIG. 7B is an enlarged view of a part of FIG. 7A, and the numbers in parentheses after the signal names indicate the signal lines to which the signals are transmitted by the numbers in FIG. In FIG. 7, VSYNC is a vertical synchronizing signal sent from an external device such as a computer via an interface cable 107, and HSYNC is an interface signal.
The horizontal synchronization signal and R / L transmitted from an external device such as a computer via the cable 107 are interface /
This signal is a signal transmitted from an external device such as a computer via the cable 107 and indicating whether the image is for the right eye or the image for the left eye.

VST_R is a color LCD for the right eye.
VST_L, a vertical synchronization signal supplied to the monochrome LCD 102a and the monochrome LCD 101a, is a color LCD 102b for the left eye.
VCK is a vertical synchronizing signal supplied to the monochrome LCD 101b and the color LCD 102 and the monochrome LCD
HST is a color LCD supplied to the vertical clock 101
HCK is a horizontal synchronizing signal supplied to the color LCD 102 and the monochrome LC
D101 is a horizontal clock, and these timing signals are supplied to each unit by the timing generator 302.

RGB is color image data supplied to the color LCD 102, and Y is luminance data supplied to the monochrome LCD 101. Here, Y (554) is 1-bit luminance data read from the frame memory 501, and Y (5)
55) is a 5-bit luminance value adjusted by the transmittance adjusting circuit 505, and Y (354) is 1-bit luminance data Y (55).
4 shows a 5-bit luminance signal selected by 4).

As is apparent from FIG. 7B, when the luminance data read from the frame memory 501 is "transparent", that is, "0", the set value of the transmittance adjusting circuit 505 is selected and the monochrome LCD controller 304 is selected. Is output to

As described above, in the HMD according to the present embodiment, the capacity of the frame memory can be saved, and the wearer of the HMD can freely set the light amount of the background portion.

[0060]

[Other Embodiments] In the above embodiment, the luminance data generating section may be provided in an external device for generating color stereoscopic image data, and the HMD may receive RGB image data and luminance data Y. In this case, the output signal of the sensor 120 provided in the HMD is transmitted to an external luminance data generation unit. Further, a frame memory, an LCD controller, a timing generator, a driver, and the like may be included in a circuit configuration of an external device, such as a video board, and may not be mounted on the main body of the HMD.

Further, in the embodiment, the LCD is described with respect to the 8-bit LCD and the 5-bit LCD. However, the present invention is not limited to this, and the LCD can be similarly realized by using an LCD having another bit configuration. . In the embodiment,
Although the description is made in such a manner that the gradation expression of the LCD is fully used, the present invention is not limited to this.
However, it is also possible to use a method in which only 7 bits are valid and only 7 bits for each color are stored in the frame memory, and the remaining 1 bit is applied to luminance data.

In the embodiment, the bit configuration of the color LCD and the monochrome LCD has been described as being the same. However, the present invention is not limited to this.
The same can be realized by using D. In the embodiment, the bit configuration of the frame memory is 32 bits, 1 bit,
Although described as 6 bits, the present invention is not limited to this, and can be similarly realized by using a frame memory having another bit configuration.

In the first embodiment, the frame memory is described as one having a 32-bit configuration. However, for example, two frame memories having a 16-bit configuration can be similarly realized. In the second embodiment, the frame memory is described as one having a 16-bit configuration. However, for example, three frame memories having an 8-bit configuration are provided for each color, and an empty space of one color or all colors is used. The same can be realized by including luminance data in any of the bits.

Further, the transmittance adjusting circuit 505 in the second embodiment can be added to the display control circuit in the first embodiment. In this case, in the first embodiment, the luminance data output from the luminance data generation unit 309 is 8-bit data. However, if all 8 bits are transparent, that is, “0”, the luminance data generation unit 309 is selected and output. The selector 506 may be configured to perform

Of course, the transmittance adjustment circuit 505 may be capable of adjusting the brightness data output from the brightness data generation unit 309 to less than a predetermined value. In this case, instead of the selector 506, an adder or an OR operation circuit or the like that receives the luminance data output from the luminance data generation unit 309 and the luminance data output from the transmittance adjusting circuit 505 as inputs is used, and both are reflected. The output luminance data can be output to the monochrome LCD controller 304.

In the above-described embodiment, the display pixels of the monochrome LCD and the display pixels of the color LCD have a one-to-one correspondence.
Has been described, but one pixel of a monochrome LCD is, for example, a color L
A configuration corresponding to a plurality of pixels of a CD may be employed.

[0067]

As described above, according to the present invention, in an optical see-through HMD, an LCD that shields a region corresponding to an image displayed as a stereoscopic virtual image is used, and an HMD from the outside in the background region of the image is used. By adjusting the amount of light according to the external luminance, it is possible to prevent the external world from being seen behind the stereoscopic virtual image even when the external luminance is brighter than the luminance of the color stereoscopic image display. In addition, it is possible to perform luminance matching between the stereoscopic virtual image and the external light, and it is possible to provide an excellent visibility of the stereoscopic virtual image regardless of the brightness of the external environment.

Further, by storing the luminance data used for the display control of the light-shielding LCD in the same memory as the image data for the stereoscopic virtual image, it is possible to adjust the external light without increasing the memory capacity. is there.

[Brief description of the drawings]

FIG. 1 is a perspective view showing an external appearance and an arrangement of a main part configuration of an HMD with an external light adjusting function according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating an optical system configuration of an HMD with an external light adjustment function according to the first embodiment of the present invention.

FIG. 3 is a diagram illustrating a configuration example of a display control circuit in the HMD according to the first embodiment of the present invention.

FIG. 4 is a timing chart illustrating an operation of the display control unit illustrated in FIG. 3;

FIG. 5 is a diagram illustrating a configuration of an image observed by a wearer at a main position of the HMD according to the first embodiment of the present invention.

FIG. 6 is a diagram illustrating a configuration example of a display control circuit in an HMD according to a second embodiment of the present invention.

FIG. 7 is a timing chart showing the operation of the display control unit shown in FIG.

FIG. 8 is a perspective view showing the appearance of a conventional HMD with an external light adjusting function and the arrangement of main components.

FIG. 9 is a diagram showing an optical system configuration of a conventional HMD with an external light adjusting function.

FIG. 10 is a diagram illustrating a configuration of an image observed by a wearer at a main position of a conventional HMD with an external light adjustment function.

FIG. 11 is a diagram illustrating a circuit configuration example of an image display unit and an external light adjustment unit of a conventional HMD with an external light adjustment function.

12 is a timing chart showing the operation of the image display unit and the external light adjustment unit shown in FIG.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G09G 3/20 660 G09G 3/20 660K 680 680A 3/36 3/36 H04N 5/64 511 H04N 5/64 511A F-term (reference) 2H088 EA10 HA06 HA22 MA13 MA20 2H093 NC16 NC24 NC29 NC53 NC66 ND02 ND06 ND58 NE06 NG07 5C006 AA22 AF03 BB11 BC16 BF02 EC02 EC12 EC13 EC14 5C080 AA10 BB05 CC03 CG01 EJ01 GG02

Claims (11)

[Claims] 1. An image display means, comprising: an eyepiece optical system for reflecting light from the image display means to guide the light to the eye; and an optical element for taking in light from the outside world, wherein a projected image of the image display means is provided. An image display device provided with light-shielding image display means having display pixels corresponding to at least one pixel of the image display device, wherein the light-shielding image display means uses a transmissive display device capable of gradation display for each pixel. Wherein the display data or a part thereof and the display data of the light shielding image display means or a part thereof are stored in the same display memory. 2. When the display data of the light-shielding image display means is data indicating light-shielding, a corresponding pixel is set to a predetermined light-shielding density, and when the display data of the light-shielding image display means is data indicating transmission, 2. The image display device according to claim 1, further comprising control means for controlling said light-shielding image display means so as to display a corresponding pixel at a preset density. A detecting means for detecting the brightness of the outside world; and, when display data of the light-shielding image display means is data indicating light-shielding, a corresponding pixel is set to a predetermined light-shielding density, and the light-shielding image display is performed. When the display data of the means is data representing transmission, the control means for controlling the light-shielding image display means so as to display a corresponding pixel at a density determined based on the brightness of the outside world detected by the detection means. The image display device according to claim 1, further comprising: 4. A detecting means for detecting the brightness of the outside world, and, when display data of the light-shielding image display means is data indicating light-shielding, a corresponding pixel is set to a predetermined light-shielding density, and the light-shielding image display is performed. If the display data of the means is data representing transmission, the light-shielding is performed so that the corresponding pixel is displayed at a density determined based on the brightness of the external world detected by the detection means and / or a value set from the external means. 2. The image display device according to claim 1, further comprising control means for controlling the image display means for use. 5. An image display means, comprising: an eyepiece optical system for reflecting light from the image display means to guide the light to the eye; and an optical element for taking in light from the outside world, and a projected image of the image display means. A light-shielding image display means having a display pixel corresponding to at least one pixel of the image display device, wherein the light-shielding image display means uses a transmissive display device capable of gradation display for each pixel. The display data of the display means is 1 per pixel.
If the 1-bit data is light-shielded data, the corresponding pixel is set to a predetermined light-shielding density, and if the 1-bit data is transmission data, the corresponding pixel is displayed at a predetermined density. An image display device comprising a control means for controlling the light-shielding image display means as described above. 6. The stereoscopic display according to claim 1, wherein the image display means and the light-shielding image display means are provided two each on the left and right sides, and the left and right parallax images are displayed, thereby enabling a three-dimensional display. Item 10. The image display device according to Item 1. 7. The display device according to claim 1, wherein a display pixel of the image display unit and a display pixel of the light-shielding image display unit are in one-to-one correspondence. Image display device. 8. An image display unit, wherein an image displayed on the image display unit is projected as a virtual image on an optical element that allows the outside world to be seen through, so that the virtual image is synthesized and presented to the observer. In the image display device, a light amount adjusting unit configured to control a light amount incident on the optical element from the outside world, and an image displayed on the image display unit and light amount control information created based on the image. Means for reading out the light quantity control information from the storage means, and reducing a predetermined ratio of incident light from the outside to an area on the optical element corresponding to a predetermined area of the virtual image of the image displayed on the image display unit. An image display device comprising a control means for controlling the light quantity adjusting means as described above. 9. The transmission type display device, wherein a display unit of the transmission type display device corresponds to at least one display pixel of the image display unit, and the light amount control information is the transmission type display device. 9. The image display device according to claim 8, wherein the image is a display image of the device. 10. The control unit supplies a display pixel of the light amount control unit corresponding to a pixel having a value indicating transmission in an image displayed on the image display unit to a predetermined value from the outside. 10. The image display device according to claim 9, wherein the display is controlled based on one of a value and a value determined by a combination thereof. 11. The light quantity control means further comprising a detection means for detecting the brightness of the external world, wherein the control means corresponds to a pixel having a value indicating transmission in an image displayed on the image display section. 10. The image display device according to claim 9, wherein the display pixel is controlled to be displayed based on a value determined based on the brightness of the outside world detected by the detection unit.