JPH1185095A - Image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate the need for matching images, etc., and to enable the opening and closing control of a shutter array at a high speed by specifying the lens position of a photodetecting means. SOLUTION: This image display device has a display 1, the shutter array 2 having apertures and light shielding parts capable of separating the light from respective pixels in arbitrary directions and the photodetecting means 5 for detecting an observer 4 by the reflected light from the observer 4 and controls the opening positions and opening width of the apertures of the shutter array 2 by a detection signal. The lens position of the photodetecting means 5 is disposed in parallel with the shutter array regulated by the equation. In the equation, Ds denotes the max. moving quantity of the imaging position of the photodetecting means 5, (b) denotes the distance from the sensor surface of the photodetecting means 5 to the main plane of the lens, L denotes the observation distance from the observer 4 to the display surface of the display 1, 1 denotes the distance from the display surface of the display 1 to the shutter array 2. ΔL denotes the distance from the main plane of the lens to the display surface of the display 1 and PA denotes the movable distance of the shutter array 2.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus for projecting an image corresponding to an observation position at a high speed to an observer. Depending on the display content of the personal computer, the display content needs to be different depending on the position of the person. For example, confidential display (invisible to anyone other than the person), multi-person multi-display (only one display screen, a plurality of persons observe different screens, respectively), motion parallax images (screen switches according to the viewing direction) ), Stereoscopic display (projecting a parallax image according to the position of the viewing eye), and the like. There is a demand for the development of an image display device capable of realizing these simultaneously.

[0002]

2. Description of the Related Art As a conventional image display device, for example, there is one as shown in FIG. In FIG. 46, 101
Denotes a display for displaying an image, and the display 101 comprises a liquid crystal display panel. Reference numeral 102 denotes a shutter array, and the shutter array 102 includes a liquid crystal slit shutter.
A light-blocking portion that blocks light from the pixels of the display 101 and an opening that transmits light from the pixels of the display 101 are provided.
The display 101 and the shutter array 102 are arranged at a predetermined interval.

[0003] The light reflected from the light source 103 is
The light reflected at 04 is incident on the two-dimensional optical sensor 105. The optical sensor 105 detects the face of the observer 104.
The image detected by the optical sensor 105 is used as a face image of the observer 104 as shown in FIG.
06 is output. Reference numeral 107 denotes an image dictionary. In the image dictionary 107, for example, human eyes as shown in FIG. 48 are registered. The matching circuit 106 includes the optical sensor 10
5 is matched with the image of the human eye registered in the image dictionary 107 as shown in FIG. If the eye part of the face image matches the eye image,
A position detection circuit 108 detects the position of the observer 104, and a control signal generation circuit 109 generates a control signal for controlling the opening and closing of the shutter array 102 based on the detected position signal. The control signal generation circuit 109 sends the generated control signal to the shutter array 102 and controls the shutter array 102.

FIG. 50 is a flow chart for explaining the operation of FIG. In FIG. 50, first, at step S10
In step 1, an image of the face of the observer 104 detected by the optical sensor 105 is input. As the input image, for example, a face image as shown in FIG. 47 is input. The input image is developed on the memory in step S102.

Next, in step S103, the image dictionary 107
, An image of the human eye registered in the image dictionary 107 is selected, and the selected image of the human eye and the image of the face of the observer 104 from the optical sensor 105 are matched as shown in FIG. When the matching result matches, the observer 104 is determined to be a predetermined person, and the position of the observer 104 is detected by the position detection circuit 108.

Next, in step S105, the position detection circuit 1
Control signal generation circuit 1 based on the position detection signal
In step 09, a control signal for controlling the opening and closing of the shutter array 102 is generated. Then, the control signal generated in step S106 is sent to the shutter array 102, and the shutter array 102 is opened and closed. Thus, an image corresponding to the observation position is projected to the observer 104.

[0007]

However, in the conventional image display device, it is necessary to match images for controlling the opening and closing of the shutter array. It was difficult to detect the position, and it took time to control the opening and closing of the shutter array.

The present invention has been made in view of such a conventional problem, and does not require matching of images for controlling the shutter array, and can control opening and closing of the shutter array at high speed. It is an object of the present invention to provide an image display device capable of performing the above.

[0009]

In order to achieve this object, the present invention is configured as shown in FIG. According to the first aspect of the present invention, a display device 1 in which each pixel is arranged in a horizontal direction, a shutter array 2 having an opening and a light-shielding portion capable of separating light from each pixel in an arbitrary direction, and reflection from an observer 4 A light detecting means 5 for detecting the observer 4 by light, and controlling an opening position and an opening width of the opening of the shutter array 2 by a detection signal;
, The observation distance from the sensor surface of the light detecting means 5 to the lens main plane is b, and the distance between the lens main plane and the display surface of the display 1 is ΔL. When the distance from the display surface of the display 1 to the shutter array 2 is l, the movable distance of the shutter array 2 is PA, and the maximum moving amount of the imaging position of the light detecting means 5 is Ds,

[0010]

(Equation 2)

As defined in the above, the lens position of the light detecting means 5 is provided in parallel with the shutter array. The invention according to claim 2 is provided with an opening width correcting means for always selecting the same opening width based on the detection signal detected by the light detecting means 5 and correcting the opening width. According to a third aspect of the present invention, a signal obtained by adding a part or all of lines in the vertical direction of the area sensor by using an area sensor composed of M × N pixels as the light detecting means 5 is used. It is used as a detection signal for detecting the observer, or a signal obtained by selecting a part of the horizontal line of the area sensor is used as a detection signal for detecting the observer 4.

According to a fourth aspect of the present invention, a face for measuring the face width of the observer 4 from the detection signal detected by the light detecting means 5 when the observation area moves in the perspective direction of the observation position of the observer 4. A width measuring means is provided to control the opening width in proportion to the measured face width. According to a fifth aspect of the present invention, a pair of light sources disposed outside the left and right ends of the display device 1, light source control means for controlling blinking of the light sources, and a left parallax image and a right parallax image are created for each pixel. An image creating means, and an array of left and right parallax images to be displayed on the display 1 for each half face detected by the light detecting means 5 based on a display position signal from the image creating means and a light source position signal from the light source controlling means; Right and left parallax image correspondence means for matching the arrangement of the openings of the shutter array 2.

According to a sixth aspect of the present invention, there is provided a pair of light sources which are disposed outside the left and right ends of the display device and emit light of different wavelengths, and are used as the light detecting means 5, and only the light of the one wavelength is used. A pair of CCD line sensors each equipped with a filter that transmits light and does not transmit light of the other wavelength, a video creating unit that creates a left parallax image and a right parallax image for each pixel, and a display position signal from the video creating unit A pair of left and right parallax images displayed on the display 1 for each half face detected by the pair of CCD line sensors and a pair of left and right parallax images corresponding to the arrangement of the openings of the shutter array 2.

According to a seventh aspect of the present invention, the shutter array 2
And a reflected light detecting means for driving the shutter array 2 at high speed and outputting a video signal when detecting reflected light from the face of the observer 4. According to the present invention having such a configuration, the lens of the optical sensor as the light detecting means 5 is configured such that the amount of movement of the imaging position of the optical sensor and the movable distance of the line shutter 2 are defined by a predetermined formula. Since the position is arranged in parallel with the shutter array 2, image matching or the like for controlling the shutter array 2 becomes unnecessary, the opening position and the opening width of the shutter array 2 can be controlled at high speed, and observation can be performed at high speed. An image corresponding to the observation position of the observer 4 can be projected to the observer 4.

Since any one of the detection signals for detecting the face of the observer 4 is determined and a signal having the same width is always selected, an image can be projected only to the same observer 4. Further, since an area sensor is used as the optical sensor and a part or all of the lines in the vertical direction are added to generate a detection signal, image noise can be reduced. Further, since an area sensor is used as the optical sensor and a part of the horizontal line is selected and used as a detection signal, the height direction can be adjusted.

Since the face width of the observer 4 is measured and the opening width is controlled in proportion to the face width, the observation position can be controlled in the depth direction. Further, since a pair of light sources are arranged outside the left and right ends of the display 1 to detect a half surface of the face and correspond to the left and right parallax images, a stereoscopic image can be displayed. In addition, since a pair of light sources that emit light of two different wavelengths is used and a pair of optical sensors using two different filters is used to detect the left and right half faces, a stereoscopic image display is possible.

Further, since a light source is arranged at the rear of the shutter array 2 and the shutter array 2 is driven to detect the reflected light from the face and output an image, an image can be projected at a desired place. .

[0018]

FIG. 2 is an overall configuration diagram showing a first embodiment of the present invention. In FIG. 2, reference numeral 1 denotes a display, and the display 1 comprises a liquid crystal display panel. This display 1
Is composed of a plurality of pixels. Reference numeral 2 denotes a shutter array, and the shutter array 2 includes a liquid crystal slit shutter. In the shutter array 2, a plurality of openings and light-shielding portions are formed alternately. The display 1 and the shutter array 2 are arranged at a predetermined interval. Reference numeral 3 denotes a light source from which light is projected to an observer 4. Reference numeral 5 denotes an optical sensor as light detecting means. Light from the light source 3 is reflected by the observer 4 on the optical sensor 5, and the reflected light enters. The optical sensor 5 detects the face of the observer 4 and outputs it to the conversion circuit 6 as a detection signal.

The conversion circuit 6 includes an initialization circuit, a binarization circuit,
It is composed of an aperture width correction circuit, a periodic circuit, a discrete value correction circuit, a gain correction circuit, a shutter control signal generation circuit, etc., and binarizes the detection signal of the face of the observer 4 from the optical sensor 5 to correct the aperture width. Is performed, and is periodically expanded to a shutter width, and is output to the shutter array 2 as a shutter control signal. In the shutter array 2, the opening position and the opening width of the opening are controlled by a shutter control signal.

The lens position of the optical sensor 5 is set in parallel with the shutter array 2 as defined by a predetermined formula described later. That is, the similarity relationship between the moving amount of the imaging position of the optical sensor 5 and the movable distance of the shutter array 2 is as follows.
The distance from the optical sensor surface to the lens main plane, the distance from the display surface of the display 1 to the observer 4, the lens main plane and the display 1
, And the distance from the display surface of the display 1 to the shutter array 2, and the lens position of the optical sensor 5 is determined by the similar relationship.
Is set in parallel with

Reference numeral 7 denotes a display circuit. The display circuit 7 converts a display image in the observation area 8 of the observer 4 into an image forming circuit (in synchronization with the timing at which a shutter control signal is output from the conversion circuit 6 to the shutter array 2). The video signal created in (not shown) is output to the display 1. Thus, an image corresponding to the observation area 8 of the observer 4 is projected onto the observer 8 at high speed. Reference numeral 9 denotes a non-observation area.

As shown in FIG. 3, the optical sensor 5 as a light detecting means includes a CCD line sensor 5A and a cylindrical lens 5B. A cylindrical lens 5B is used as an imaging lens, and the cylindrical lens 5 is arranged in parallel with the shutter array 2, the cross section in the horizontal direction is formed in an elliptical shape, and the upper and lower surfaces of the elliptical shape are formed in a plane. I have. This cylindrical lens 5B is formed flat in the vertical direction. By using such a cylindrical lens 5B, it is possible to eliminate the displacement in the height direction.

FIG. 4 is an explanatory diagram for explaining the control of the projection direction by the shutter array 2. In FIG. 4, reference numeral 1 denotes a display, and the display 1 includes a plurality of pixels 1, 2, and 3. The R, G, and B colors are mixed for each of the pixels 1, 2, and 3, and the display 1 displays a color image. Cw indicates the light emission width of each of the pixels 1, 2, and 3, and is smaller than the pixel pitch of each of the pixels 1, 2, and 3. On a front surface of the display 1, a shutter array 2 is installed at a predetermined distance l. Shutter array 2
Has a light-shielding portion 2A that shields light from each of the pixels 1, 2, and 3, and an opening 2B that transmits light from each of the pixels 1, 2, and 3. Bt indicates the opening width of the opening 2B of the shutter array 2. This opening width Bt is determined from the display surface of the display 1
Is L, the distance from the display surface of the display 1 to the shutter array 2 is l, and the light emission width of each of the pixels 1, 2, 3 is Cw.

[0024]

(Equation 3)

Is determined by An image by the pixel 1 is observed by the observer 4 through the opening 2B, an image by the pixel 2 is observed by the observer 4 through the opening 2B, and an image by the pixel 3 is observed by the observer 4 on the opening. Observed via 2B. FIG. 5 is an explanatory diagram for explaining the movement in the projection direction by driving the shutter array 2.

As shown in FIG. 5, when the shutter array 2 installed in parallel with the display 1 is moved rightward as shown by an arrow d, the observation area of the observer 4 is indicated by an arrow e. As shown, the shutter array 2 moves in proportion to the moving distance. Assuming that the amount of movement of the opening 2B of the shutter array 2 is g, the amount of movement of the observation region is indicated by h. FIG. 6 is a view showing an observation region, and FIG. 7 is a partially enlarged view of FIG. 6, showing the positions of the display 1 and the shutter array 2.

In FIG. 6, 1 is a display, 2 is a shutter array, the distance from the display 1 to the shutter array 2 is 2 mm, and the observation distance from the display 1 to the observer 4 is 5 mm.
00 mm. The observation area at this observation distance is indicated by 8. At this time, the light from the pixels 1, 2, and 3 of the display 1 is transmitted to the aperture 2 of the shutter array 2 as shown in FIG.
The light is transmitted through B and projected to the observer 4.

Here, as shown in FIG. 9, the shutter array 2 moves in the horizontal direction (see FIG.
(Upward), the observation area 8 moves in proportion to the parallel movement distance of the shutter array 2 as shown in FIG. That is, the movement amount of the observation region 8 is indicated by h. FIG. 10 is an explanatory diagram of the movement of the shutter array 2.

In FIG. 10, reference numeral 1 denotes a display. The pixel pitch of each pixel of the display 1 is indicated by P, and the light emission width of each pixel is indicated by Cw. 1 indicates the distance from the display surface of the display 1 to the shutter array 2. PA is shutter array 2
The shutter pitch PA is the width of the light shielding portion 2A and the opening 2B. L indicates the distance from the display surface of the display 1 to the observer 4, and X indicates the amount of movement of the observer 4. When the observation is performed at the observation distance L from the display device 1, the observable viewing zone width S is expressed by the following equation.

[0030]

(Equation 4)

The shutter pitch PA is obtained by the following equation.

[0032]

(Equation 5)

The relationship between the moving distance X of the observer 4 and the moving distance x of the opening 2B of the shutter array 2 is as follows.

[0034]

(Equation 6)

Therefore, if the standard observation distance L is determined, the moving amount x ｛(l / l) of the opening 2B of the shutter array 2 is determined.
L) X｝ has a relationship proportional to the moving amount X of the observer 4.
The opening width Bt is obtained from the following equation.

[0036]

(Equation 7)

FIG. 11 is an explanatory diagram for explaining the detection of the observer 4 by the optical sensor 5. In FIG. 11, light from a light source 3 is projected to an observer 4 and reflected by the observer 4. The reflected light enters a lens (cylindrical lens) 5B and forms an image on a line sensor (CCD line sensor) 5A. Thus, the line sensor 5A outputs a detection signal for detecting the face of the observer 4.

.DELTA.L is the main plane of the lens and the display 1 (not shown).
L + ΔL indicates the distance from the observer 4 to the main lens plane. b indicates the distance from the line sensor surface to the lens main plane, X indicates the amount of movement of the observer 4, and u indicates the amount of movement of the imaging position of the line sensor 5A. Observer 4
Is proportional to the moving amount u of the imaging position of the line sensor 5A.

[0039]

(Equation 8)

The relationship between the focal length f of the lens 5B and b is expressed by the following equation. By determining f, b can be obtained.

[0041]

(Equation 9)

FIG. 12 is an explanatory diagram for explaining the relationship between the amount of movement of the image forming position of the optical sensor and the moving distance of the opening of the shutter array 2. In FIG. 12, u is a line sensor 5A.
, B is the distance from the line sensor surface to the lens main plane, L is the distance from the display surface of the display 1 to the observer 4, and ΔL is the distance from the lens main plane to the display surface of the display 1. And l is the distance from the display surface of the display 1 to the shutter array 2
, X represents the amount of movement of the observer 4, and x represents the movement distance of the opening 2B of the shutter array 2.

Therefore, if L, ΔL, l, and b are set, a similar relationship between the moving amount u of the imaging position of the line sensor 2 and the moving distance of the opening 2B of the shutter array 2 can be obtained by the following equation.

[0044]

(Equation 10)

Since the maximum value of the moving distance x of the opening 2B is the shutter pitch PA of the shutter array 2, if the maximum value of the moving amount u of the image forming position is Ds, D
The relationship between s and PA is as follows.

[0046]

[Equation 11]

If the lens position of the optical sensor 5 is set in parallel with the shutter array 2 as defined by the above equation, the opening of the shutter array 2 is detected by the detection signal of the optical sensor 5 for detecting the face of the observer 4. 2B opening position and opening width Bt
Can be controlled at high speed. FIG. 13 is a control block diagram of FIG.

In FIG. 13, a conversion circuit 6 for converting a detection signal from the optical sensor 5 into a shutter control signal includes an initialization circuit 10, a face input circuit 11, a binarization circuit 12, an aperture width correction circuit 13, Circuit 14, discrete value correction circuit 15, gain correction circuit 16, and shutter control signal generation circuit 17
It consists of. The initialization circuit 10 selects a lens focal length and initializes the position of the optical sensor. That is, the lens focal length f, ΔL, and L are set, and the distance b from the line sensor surface to the lens main plane is determined. Face input circuit 1
1 inputs the detection position of the face of the observer 4 from the optical sensor 5. The binarization circuit 12 binarizes the detection signal input to the face input circuit 11. Aperture width correction circuit (aperture width correction means) 1
3 refers to the face width / opening width conversion data file 18 and

[0049]

(Equation 12)

The input signal width is corrected in accordance with the aperture width set in step (1). The aperture width correction circuit 13 determines an arbitrary one of the detection signals for detecting the face to the observer 4, and always selects the same aperture width to display an image only to the same observer 4. The periodic circuit 14 periodically expands the corrected aperture width to the shutter length of the shutter array 2 with reference to the aperture cycle setting data file 19. The discrete value correction circuit 15 corrects the discretization error because the aperture width Bt and the pixel pitch P are discrete values. The gain correction circuit 16 performs voltage adjustment as a drive signal for the shutter array 2. The shutter control signal generation circuit 17 generates a shutter control signal for controlling the opening position and the opening width of the opening 2B of the shutter array 2 and outputs it to the shutter array 2. The synchronization between the display circuit 4 that outputs the video signal from the video creation circuit 20 to the display 1 and the shutter control signal generation circuit 17 is performed by the clock generated by the clock generation circuit 21. In addition,
This synchronization is not necessary.

FIG. 14 is a flowchart for explaining the operation of FIG. In FIG. 14, first, the lens focal length f is selected in step S1, and the optical sensor position is initialized in step S2. That is, f, L, ΔL are set,
Decide b. Next, a detection signal for detecting the face of the observer 4 is input from the optical sensor 5 in step S2. This detection signal is input as a face width signal fw indicating the face width of the observer 4 with respect to the viewing zone width S, as shown in FIG. next,
The face width signal fw input in step S4 is converted into a binary signal
To binarize. FIG. 15B shows a binarized face width signal fw.
And a pulse signal having a predetermined pulse width is obtained.

Next, in step S5, referring to the face width / opening width conversion data file 18, the face width is calculated.

[0053]

(Equation 13)

The correction is made to the opening width Bt set in the above. The corrected signal fw has the same width as shown in FIG. Next, the signal fw corrected in step S6 is periodically developed to the shutter length of the shutter array 2. FIG.
5 (d) shows a signal cycled to the shutter length (Sw) of the shutter array 2. Next, in step S7, the opening width B
The discretization error resulting from t and the pixel pitch P being a discrete value is corrected. Next, the gain is corrected in step S8 so that it can be used as a drive signal. Next, in step S9, a shutter control signal is generated and output to the shutter array 2. If the power is turned off in step S10, the process is terminated. If the power is not turned off,
Returning to step S3, the detection signal from the optical sensor 5 is input, and the process is continued.

Therefore, it is not necessary to perform image matching for controlling the shutter array 2 as in the related art, and it is possible to control the opening and closing of the shutter array 2 at high speed. As a result, an image corresponding to the observation area 8 can be projected to the observer 4 at high speed. FIG. 16 (A), (B)
Shows an area sensor according to the second embodiment of the present invention.

In FIG. 16A, an area sensor 5C is used as a light sensor as light detecting means. The area sensor 5C is generally composed of M × N pixels. That is, the area sensor 5C includes the pixel (m, n) in m rows and n columns.
The detection signal is shown, for example, in FIG. The detection signal from the area sensor 5C in FIG. 16B indicates an image of the observer 4, for example. Pixel (m, n)
Let G be the detected pixel value of G in FIG.

In order to use the detection signal of the area sensor 5C as an input signal, as shown in FIG. 18A, each pixel in the vertical direction is added and divided by the number of pixels to obtain a pixel value for M columns. Average. FIG. 18 shows the averaged signal.
It is used as an input signal as shown in FIG. In order to use the averaged signal as an input signal, the face input circuit 11 is connected to the input circuit 22 and the image memory 2 as shown in FIG.
3. It is composed of an addition circuit 24 and a division circuit 25.
The input circuit 22 inputs the detection signal of the observer 4, and the images shown in FIGS. 16B and 18A are developed on the image memory 23. The adding circuit 24 adds the pixel values in the vertical direction shown in FIG. 18A, and the dividing circuit 25 averages the pixel values for M columns by dividing the added value by the number of pixels. This averaged signal is used as an input signal.
The input signal to be used is F = (f1... Fg... Fn)
Then

[0058]

[Equation 14]

Is as follows. Note that an added value obtained by adding the pixel values in the vertical direction without averaging may be used.
As described above, the image noise can be reduced by using the added signal or the averaged signal as the input signal. FIGS. 20A and 20B are explanatory diagrams illustrating the use of an input signal by the area sensor 5C according to the third embodiment of the present invention.

In FIGS. 20A and 20B, an area sensor 5C is used as a light sensor 5 as a light detecting means, and one or more horizontal lines are selected and used as an input signal. Reference numeral 26 in FIG. 20A is a preset horizontal line, and this one line 26 is selected and used as an input signal as shown in FIG. 20B. Instead of one line 20, a plurality of lines may be selected. In order to use a selected signal as shown in FIG. 20B as an input signal, the face input circuit 11 is constituted by an input circuit 22, an image memory 23 and a selection circuit 27 as shown in FIG. The input circuit 22 shown in FIG.
(A) is input, and the input image is stored in the image memory 23.
Expanded above. The selection circuit 27 selects one horizontal line 26 from the developed image and uses it as an input signal.

FIG. 22 is an explanatory diagram for explaining control of the shutter array in the front-rear direction according to the third embodiment of the present invention. In FIG. 22, reference numerals 4a to 4c denote observers, and when the observers 4a to 4c move backward as indicated by an arrow i, control is performed so as to reduce the opening width of the opening 2B of the shutter array 2. As a result, the light of the pixels 1, 2 and 3 passes through the opening 2B of the shutter array 2 and
4c. That is, when the observation position of the observers 4a to 4c moves in the front-back direction, it can be dealt with by controlling the opening width of the opening 2B of the shutter array 2.

FIG. 23 is a diagram showing changes in the observation area when the observation distance is longer than the standard set distance. In FIG. 23, when the standard observation distance is set to 500 mm and the distance L from the display 1 to the observer 4 becomes 500 mm or more, as shown in FIG.
The opening width Bt of B becomes Bt∝1 / L. 1 is the distance between the display surface of the display 1 and the shutter array 2, which is 2 mm here.

On the other hand, if the observer 4 is a single person, the width of the face to be detected is constant. If the detection width of the face is fw, fw is proportional to the detection distance as in the following equation. fw∝1 / L Therefore, when the observer 4 moves back and forth, the opening width Bt of the opening 2B may be controlled in proportion to the face width.

FIG. 25 is a control block diagram according to a fifth embodiment of the present invention. 25, a face width measuring circuit 28 as face width measuring means is provided in FIG. Other configurations are the same as those in FIG. Face width measurement circuit 28
Comprises a timing counter to measure the face width of the observer 4. The opening width correction circuit 13 refers to the face width / opening width conversion data file 18 and determines the opening width in proportion to the measured face width.

FIG. 26 is a flow chart for explaining the operation of FIG. 26, a step S4A is additionally provided in FIG. Another step S1
4 and steps S5 to S10 are the same. Step S4
27A, as shown in FIG. 27, in the viewing zone width S, the face width fw of the observer 4 is measured from the detection signal of the optical sensor 5, and the opening width is corrected in proportion to the face width fw measured in step S5. . A value obtained by multiplying the measured face width fw by a constant is obtained with reference to the face width / opening width conversion data file 18, and this is defined as the opening width. As described above, when the observation position of the observer 4 moves in the front-back direction, the opening width of the opening 2B of the shutter array 2 may be controlled.

FIG. 28 is an overall configuration diagram showing a sixth embodiment of the present invention. In FIG. 28, when two or more images are formed by the pixels of the display device 1, stereoscopic display is possible by projecting a parallax image from each of the two images onto the half face of the observer 4. In order to detect the half face, two light sources 3A and 3B that emit light at different times from each other are arranged outside the left and right ends of the display 1. Reference numeral 29 denotes a light source control circuit for controlling lighting of the light sources 3A and 3B.
A and 3B are turned on and off at regular intervals. The optical sensor 5 detects the half face of the observer 4 by the reflected light from the observer 4 in synchronization with the blinking of the light source control circuit 29. Reference numeral 20A denotes an image creation circuit. The image creation circuit 20A creates a parallax image and sends it to the display circuit 7, and the display circuit 7 outputs the parallax image to the display 1 in synchronization with opening and closing of the shutter array 2. The conversion circuit 6 generates a shutter control signal for each half-face of the face from the optical sensor 5, controls the opening position and opening width of the shutter array 2, and sequentially projects a parallax image to the observer 4 for each pixel.

FIG. 29 is a control block diagram of FIG.
29, a left and right parallax image correspondence circuit 30 as left and right parallax image correspondence means is additionally provided in the conversion circuit 6 of FIG. The left and right parallax image corresponding circuit 30 includes two light sources 3
A, 3B, a light source position signal (blinking signal) from a light source control circuit 29 and a display position signal (a left / right parallax image corresponding to the right / left parallax image The arrangement of the openings 2B of the shutter array 2 and the arrangement of the left and right parallax images displayed on the display 1 are made to correspond to each other based on the number of the pixel that indicates which pixel is displayed).

Reference numeral 21 denotes a clock generation circuit for outputting a synchronization signal. The clock generation circuit 21 includes a light source control circuit 29,
A synchronizing signal is output to the image creation circuit 20A, the display circuit 7, and the shutter control signal generation circuit 17, respectively, to synchronize the light source blinking, image creation, image display, and shutter signal creation. The video creation circuit 20 </ b> A creates a parallax image and outputs the created parallax image to the display circuit 7. Video creation circuit 20A
Are arranged as shown in FIG. That is, the left parallax images 31A and the right parallax images 31B are alternately arranged for each horizontal pixel of the display 1.

The light source control circuit 29 includes a clock generation circuit 2
The light sources 3A and 3B are sequentially turned on and off at regular time intervals by the synchronization signal from the control unit 1. Therefore, as shown in FIG. 31, one light source 3A is turned on at regular intervals, and the other light source 3B is turned on at regular intervals following the light source 3A.
Thereafter, the optical sensor 5 detects the half face of the observer 4 by the reflected light, generates a shutter control signal, and outputs the shutter control signal.
Open and close. FIG. 31 shows the time during which the shutter control is performed by the shutter control signal, and does not show the shutter pattern. The opening / closing cycle of the shutter control signal is the same as the display timing of the display circuit 7. That is, the opening time of the shutter control signal is within the ON time of the display circuit 7.

FIG. 32 is a flow chart for explaining the operation of FIG. In FIG. 32, first, the lens focal length f is selected in step S1, and the optical sensor position is initialized in step S2. Next, in step S3, a half face is input as a detection signal of the optical sensor 5. That is,
The half face width signal fhwA, fh as shown in FIG.
Enter wB. Next, in step S5, the face half-surface width signals fhwA and fhwB are binarized, and FIG.
Pulse signals fhwA and fhwB as shown in FIG. Next, in step S5, referring to the face width / opening width conversion data file 19, the opening width is corrected as shown in FIG.

Next, in order to display a stereoscopic image in step S5A, the left and right parallax images 31A, 31 displayed on the display 1 are displayed.
The arrangement of B corresponds to the arrangement of the openings 2B of the shutter array 2. Therefore, as shown in FIG. 33D, a signal fhwAB is created by adding two signals fhwA and fhwB whose aperture widths have been corrected. Next, in step S6, FIG.
Is performed up to the shutter length Sw as shown in FIG. After that, the discrete value error is corrected, the gain is corrected, and a shutter control signal is generated. Then, the parallax images are projected to the observer 4 by sequentially displaying the left and right parallax images 31A and 31B on the display 1 for each horizontal pixel. Thus, a stereoscopic image can be displayed.

FIG. 34 is a control block diagram according to the seventh embodiment of the present invention. In the present embodiment, the center position of the face is obtained by differentiating the signal of the half face. In FIG. 34, a difference circuit 3 as difference means is different from FIG.
2. A differentiating circuit 33 as a differentiating means and a center detecting circuit 34 as a center detecting means are additionally provided. The difference circuit 32 calculates a difference between the two half face images from the face input circuit 11. The differentiating circuit 33 differentiates the signal obtained by the difference circuit 32. The center detection circuit 34 detects the center position of the face from the signal binarized by the binarization circuit 12.

FIG. 35 is a flow chart for explaining the operation of FIG. In FIG. 35, steps S3A, 3B and step S4B are added to FIG. Other steps S1 to S3, S4, S5 to S1
0 is the same as in FIG. In step S3A, a difference between the face half signals is obtained. That is, the difference between the two half face width signals fhwA and fhwB shown in FIG.
The difference signal is as shown in FIG. Next, step S
The signal differentiated in 3B is differentiated. Differentiating, FIG.
The difference signal of (b) becomes a differential signal indicated by an edge as shown in FIG. This differentiated signal is binarized by a threshold value in step S4. The binarized signal becomes one edge signal as shown in FIG. Next, step S
The center position is detected from the binarized signal in 4B, the aperture width is corrected in step S5, and a signal in which the face width is fixed as shown in FIG. 36E is obtained. As described above, the face width can be fixed by obtaining the center position of the face from the two half face width signals fhwA and fhwB.

FIG. 37 is an overall configuration diagram showing an eighth embodiment of the present invention. In FIG. 37, a pair of light sources 3C and 3D are disposed outside the left and right ends of the display 1.
One light source 3C projects light having a wavelength of λ1 to the observer 4,
The other light source 3D projects light having a wavelength of λ2 to the observer 4. As shown in FIG. 38, the optical sensor 5 as the light detecting means is constituted by a pair of CCD line sensors 5A and 5D and one cylindrical lens 5B. One CC
The D line sensor 5A is equipped with a filter that transmits light of wavelength λ1 and does not transmit light of other wavelengths, and the other CCD line sensor 5D transmits light of wavelength λ2 and filters light of other wavelengths. A filter that does not transmit light is installed. That is,
Each of the pair of CCD line sensors 5A and 5D has a filter that does not transmit light of each wavelength. A pair of CC
The D line sensors 5A and 5B respectively detect the half face of the observer 4 and output detection signals to the conversion circuit 6, respectively.

FIG. 39 is a control block diagram of FIG.
In FIG. 29, an initialization circuit 10, a face input circuit 11, a binarization circuit 12, and an aperture width correction circuit 13 are provided one by one. In FIG. 39, a pair of initialization circuits 10A and 10A are provided.
B, a pair of face input circuits 11A and 11B, a pair of binarization circuits 12A and 12B, and a pair of aperture width correction circuits 13
A and 13B are provided. Other configurations are the same as those in FIG.

One initialization circuit 10A initializes one CCD line sensor 5A and the other initialization circuit 10A.
B initializes the other CCD line sensor 5D. One face input circuit 11A is connected to one CCD line sensor 5A.
The other face input circuit 11B inputs the half face signal of the observer 4 from the other CCD line sensor 5D. One binarization circuit 12A binarizes the half-face signal from one face input circuit 11A, and the other binarization circuit 12B binarizes the half-face signal from the other face input circuit 11B. One opening width correction circuit 13A corrects the signal binarized by one binarization circuit 12A with reference to the face width / opening width conversion data file 18, and the other opening width correction circuit 13B Correcting the signal binarized by the other binarization circuit 12B with reference to the aperture width conversion data file 18. The left / right parallax image corresponding circuit 30 calculates a left / right parallax image from the opening width corrected by the one opening width correction circuit 13A and the opening width corrected by the other opening width correction circuit 13B based on the display position signal from the video creation circuit 20A. Take action.

FIG. 40 is a diagram showing operation timing.
In FIG. 40, the blinking control of the light sources 3C and 3D is not performed.
It is always on. The opening / closing cycle of the shutter array 2 is
This is the same cycle as the display timing of the display circuit 7. That is, the shutter control signal is turned on within the display ON time by the display circuit 7.

Thus, the two CCD line sensors 5
By using A and 5B, the parallax images of the left and right half faces can be simultaneously detected, and three-dimensional display can be performed. FIG.
FIG. 1 is an overall configuration diagram showing an eighth embodiment of the present invention.
In FIG. 41, reference numeral 3 denotes a light source, and the light source 3 is provided at a rear portion of the shutter array 2. A shutter scanning circuit is provided in the conversion circuit 6, and the shutter scanning circuit converts the shutter array 2 into the shutter array 2 at the frame rate of the display 1.
Is driven by the number of pixels (N) of the shutter pitch PA. That is, FIG. 42 shows an input signal by scanning at each pixel position of the shutter array. (A) is the first scan,
(B) is an i-th scan in which a face is detected, and (c) is a signal from the last scan. The reflected light of the scanning light is detected by the optical sensor 5, and as shown in (b), when the reflected light exceeds the threshold T, a shutter control signal in the reflected light is generated. That is, as shown in FIG.
.. N, N, the display circuit 7 is turned on to display an image when the shutter is opened / closed n in which reflected light is detected.

FIG. 44 is a control block diagram of FIG.
44, a shutter scanning circuit 25 as shutter scanning means and a reflected light detection circuit 26 as reflected light detecting means are provided in FIG. The shutter scanning circuit 25 drives the shutter array 2 at the number of pixels (N) times the shutter pitch PA of the frame rate of the display 1. In the first time, the shutter control signal is initialized.
The second and subsequent times are generated based on the reflected signal, and the signal is shifted for each pixel of the shutter pitch PA, and the shutter pitch PA
Is performed for the number of pixels (N) times. The reflected light detection circuit 26
The optical sensor 5 detects the reflected light of the scanning light by the scanning of the shutter array 2 by the shutter scanning circuit 25, and outputs an ON signal to turn on the display circuit 7 to the display circuit 7 when the reflected light is detected. The face width signal f
Output w.

FIG. 45 is a flow chart for explaining the generation of the shutter control signal of FIG. In FIG. 45, the drive display of the shutter array 2 is performed by the shutter display circuit 25 in step S2A. In the first time, the shutter control signal is initialized. Next, in step S3A, it is determined whether or not reflected light exceeding the threshold value T of the scanning light is detected by the optical sensor 5 based on the input of the face width signal fw in step S3. If not, the process returns to step S2A and returns to the shutter array 2
Is scanned. When the light reflected by the scanning light is detected by the optical sensor 5, an ON signal is output to the display circuit 7 and a face input signal is output to the binarization circuit 12. Subsequent steps S4 to S10 are the same as those in FIG. The shutter control signal scans the number of pixels (N) of the shutter pitch PA by shifting the position of the signal generated by the reflection signal for the second and subsequent times using the set value for the first time.

As described above, when the shutter array 2 is driven at high speed and the reflected light from the face of the observer 4 is detected, a video signal is displayed and an image is projected on a desired place where the observer 4 is located. it can. In this case, since the coordinates of the detector and the display unit match, calibration is not required.

[0082]

As described above, the lens position of the optical sensor is adjusted so that the amount of movement of the image forming position of the optical sensor as the light detecting means and the movable distance of the line shutter are defined by a predetermined formula. Since it is installed in parallel with the array, it is not necessary to match images for controlling the shutter array, etc., and it is possible to control the opening position and the opening width of the shutter array at high speed, and to respond to the observation position of the observer at high speed. The image can be projected to the observer.

Further, since any one of the detection signals for detecting the face of the observer is determined and a signal having the same width is always selected, an image can be projected only to the same observer.
Further, since an area sensor is used as an optical sensor and a part or all of the lines in the vertical direction are added to generate a detection signal, image noise can be reduced. In addition, since an area sensor is used as the optical sensor and a part of the horizontal line is selected and used as a detection signal, it is possible to adjust the height direction even when the observer sits down or observes a child. is there.

Further, since the face width of the observer is measured and the opening width is observed in proportion to the face width, the observation position can be controlled in the depth direction. Further, since a pair of light sources are arranged outside the left and right ends of the display to detect a half surface of the face and correspond to the left and right parallax images, it is possible to display a stereoscopic image. Also,
Using a pair of light sources that emit light of two different wavelengths,
Since the left and right half faces are detected using a pair of optical sensors using two different filters, stereoscopic image display is possible.

Further, when the light source is arranged at the rear portion of the shutter array, the shutter array is driven, and when light reflected from the face is detected, an image is output, so that an image can be projected at a desired place.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating the principle of the present invention.

FIG. 2 is an overall configuration diagram showing a first embodiment of the present invention.

FIG. 3 is a diagram showing an optical sensor.

FIG. 4 is an explanatory diagram of control of a projection direction.

FIG. 5 is an explanatory diagram of control of a projection direction by moving a shutter array.

FIG. 6 is a diagram showing an observation area when the observation distance is 500 mm.

FIG. 7 is an enlarged view of the display and the shutter array of FIG. 6;

FIG. 8 is a diagram showing a change in an observation area when the observation position moves sideways;

FIG. 9 is a diagram showing movement of the shutter array of FIG. 8;

FIG. 10 is a diagram illustrating a relationship between a moving distance of an observer and a moving distance of an opening of a shutter array.

FIG. 11 is a diagram showing the relationship between the amount of movement of the imaging position of the optical sensor and the amount of movement of the observer.

FIG. 12 is a diagram illustrating a relationship between a moving amount of an image forming position of an optical sensor and a moving distance of an opening.

FIG. 13 is a control block diagram of FIG. 12;

14 is a flowchart illustrating the operation of FIG.

15 is an explanatory diagram of each signal in FIG.

FIG. 16 is a diagram showing an area sensor according to a second embodiment of the present invention.

FIG. 17 is a diagram showing pixel values of an area sensor.

FIG. 18 is an explanatory diagram of image value averaging.

FIG. 19 illustrates a configuration example of a face input circuit.

FIG. 20 is an explanatory diagram of horizontal line selection according to the third embodiment of the present invention.

FIG. 21 is a diagram illustrating another configuration example of the face input circuit;

FIG. 22 is a diagram illustrating control of an observation position according to a fourth embodiment of the present invention.

FIG. 23 is a diagram showing an example in which the observation area has moved backward.

FIG. 24 is an enlarged view of the display and the shutter array of FIG. 23;

FIG. 25 is a control block diagram according to a fifth embodiment of the present invention.

FIG. 26 is a flowchart illustrating the operation of FIG. 25;

FIG. 27 is a view showing a measured face width;

FIG. 28 is an overall configuration diagram showing a sixth embodiment of the present invention.

FIG. 29 is a control block diagram of FIG. 28;

FIG. 30 is an explanatory diagram of an area of a left-right parallax image.

FIG. 31 is a diagram showing operation timings;

FIG. 32 is a flowchart for explaining the operation of FIG. 29;

FIG. 33 is an explanatory diagram of each signal in FIG. 32;

FIG. 34 is a control block diagram according to a seventh embodiment of the present invention.

FIG. 35 is a flowchart illustrating the operation of FIG. 34;

36 is an explanatory diagram of each signal in FIG. 35.

FIG. 37 is an overall configuration diagram showing an eighth embodiment of the present invention.

FIG. 38 illustrates a configuration of an optical sensor.

FIG. 39 is a control block diagram of FIG. 37;

FIG. 40 is a diagram showing operation timing.

FIG. 41 is an overall configuration diagram showing a ninth embodiment of the present invention.

FIG. 42 is an explanatory diagram of optical scanning of the optical shutter array.

FIG. 43 is a diagram showing operation timing of an optical scanning type.

FIG. 44 is a control block diagram of FIG. 41.

FIG. 45 is a flowchart for explaining the operation of FIG. 44;

FIG. 46 shows a conventional example.

FIG. 47 shows a detected image.

FIG. 48 shows a registered image.

FIG. 49 is an explanatory diagram of matching.

FIG. 50 is a flowchart for explaining the operation of the conventional example.

[Explanation of symbols]

1: Display 2: Shutter array 2A: Light shield 2B: Opening 3, 3A, 3B, 3C, 3D: Light source 4, 4a, 4b, 4c: Observer 5: Optical sensor (light detecting means) 5A, 5D: CCD line sensor (line sensor) 5B: cylindrical lens (lens) 5C: area sensor 6: conversion circuit 7: display circuit 8: observation region 9: non-observation region 10, 10A, 10B: initialization circuit 11, 11A, 11B: Face input circuit 12, 12A, 12B: binarization circuit 13, 13A, 13B: aperture width correction circuit (opening width correction means) 14: periodic circuit 15: discrete value correction circuit 16: gain correction circuit 17: shutter control signal Generation circuit 18: Face width / opening width conversion data file 18A: Face center position / opening width conversion data file 19: Opening period setting data file 20, 20A: Video creation circuit 21: Clock generation circuit 22: Input circuit 23: Image memory 24: Addition circuit 25: Division circuit 26: 1 line 27: Selection circuit 28: Face width measurement circuit (face width measurement means) 29: Light source control circuit ( Light source control means) 30: left and right parallax image correspondence circuit (left and right parallax image correspondence means) 31A: left parallax image 31B: right parallax image 32: difference circuit (difference means) 33: differentiation circuit 34: center detection circuit (center detection means) 35: shutter scanning circuit (shutter scanning means) 36: reflected light detection circuit (reflected light detecting means)

Claims (7)

[Claims] 1. A display device in which each pixel is arranged in a horizontal direction; a shutter array having an opening and a light-shielding portion capable of separating light from each pixel in an arbitrary direction; An image display device comprising: a light detection unit for detecting; and an opening position and an opening width of an opening of the shutter array controlled by a detection signal, wherein an observation distance from the observer to a display surface of the display unit is L, B is the distance from the sensor surface of the light detection means to the lens main plane, ΔL is the distance between the lens main plane and the display surface of the display, l is the distance from the display surface of the display to the shutter array, The movable distance of the shutter array is PA, and the maximum moving amount of the image forming position of the light detecting means is D.
where s is An image display device, wherein a lens position of the light detecting means is provided in parallel with the shutter array, as defined by the following. 2. An image display device according to claim 1, further comprising an aperture width correcting means for always selecting the same aperture width based on the detection signal detected by said light detecting means and correcting the aperture width. Image display device. 3. The image display device according to claim 1, wherein an area sensor composed of M × N pixels is used as said light detecting means, and a part or all of lines in the vertical direction of the area sensor are added. Is used as a detection signal for detecting the observer, or a signal obtained by selecting some horizontal lines of the area sensor is used as a detection signal for detecting the observer. An image display device characterized by the above-mentioned. 4. The image display device according to claim 1, wherein when the observation area moves in a direction far from the observation position of the observer, the face width of the observer is measured from a detection signal detected by the light detection means. An image display device, comprising: a face width measuring unit that controls the opening width in proportion to the measured face width. 5. The image display device according to claim 1, wherein a pair of light sources disposed outside both right and left ends of the display, light source control means for controlling blinking of the light sources, and a left parallax image for each pixel. And a video creating means for creating a right parallax image, and a left and right display on the display for each half face detected by the light detecting means based on a display position signal from the video creating means and a light source position signal from the light source controlling means. An image display device, comprising: a left and right parallax image correspondence unit for causing a parallax image arrangement to correspond to an arrangement of openings of the shutter array. 6. The image display device according to claim 1, wherein a pair of light sources which are arranged outside left and right ends of the display and emit light of different wavelengths are used as the light detecting means, and the one wavelength is used as the light detecting means. A pair of CCD line sensors each equipped with a filter that transmits only light of the other wavelength and does not transmit light of the other wavelength; an image creating unit that creates a left parallax image and a right parallax image for each pixel; According to the display position signal, the pair of Cs
An image display, comprising: a left-right parallax image correspondence unit that associates an arrangement of left-right parallax images displayed on the display with each half-face detected by a CD line sensor and an arrangement of openings of the shutter array. apparatus. 7. The image display device according to claim 1, wherein a light source disposed at a rear portion of said shutter array, and said shutter array is driven at a high speed to display an image when reflected light from said observer's face is detected. An image display device, comprising: reflected light detection means for outputting a signal.