JPH11134505A - Image extracting device and image display device using same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain the image extracting device which requires no special image pickup conditions and is not affected by a light emitting body, a reflecting body, etc., present in a background by performing a subtracting process between an image in the presence of lighting device lighting and an image in the absence. SOLUTION: A CCD camera 3 photographs an image in the presence of lighting 2 and an image in the absence on a time-division basis. When a disturbing light source is present in the background of an object to be measured, the image in the presence of the lighting is obtained as an image including both the object to be observed and the background image including the disturbing light source and its image signal is stored as digital data in a memory circuit 5. The lighting is off in the following exposure timing of the CCD camera 3, so an image having a background where the object to be observed is inconspicuous is obtained and stored in a memory circuit 6. The data of both the stored images are processed by the subtraction of a subtracting circuit 7 to obtain an image excluding the influence of the background. The data are stored in a memory circuit 8 and repeatedly outputted until next data are prepared.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image extracting apparatus capable of extracting only an observation target to be photographed without the influence of disturbance light or a background, and an image display apparatus using the same, particularly a stereoscopic image display apparatus. is there.

[0002]

2. Description of the Related Art When an object to be observed is imaged using a general imaging device such as a CCD camera, a background image other than the object to be imaged originally forms an image within the same image. When it is desired to remove the background and extract only the observation target, there is a method of limiting imaging conditions such as imaging using a monotonous background such as a blue back screen. However, this method can be used in a special environment such as a studio, but cannot be used in an environment where the background cannot be specified. There is also a method of extracting an observation target without depending on the background, using a method such as pattern recognition in a software manner. However, since the processing requires time, it is generally difficult to perform real-time processing. Processing equipment is required. Also, when the observation target has a complicated and non-uniform shape like a human, initial settings are often complicated, such as the need to specify the initial position and state of the observation target, and if this is not solved There are many problems that must be solved.

As a method of extracting an observation target in real time, there is a method of illuminating the observation target with sufficient illumination and using a luminance difference from a background. In a stereoscopic image display device that allows the observer to exclusively observe the first image and the second image using the substantially half-plane image of the observer, this luminance difference is used to extract the substantially half-plane image of the observer. There is a report that applies the extraction method, but this method has a problem that if there is a luminous body, reflector, etc. with the same brightness as the luminance of the observation target in the background, it is mistaken. However, in the application example of the three-dimensional image display device described above, this erroneous recognition hinders the exclusive image observation of both eyes of the observer.

[0004]

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is possible to extract only an observation target to be photographed by using a relatively small-scale configuration, excluding the influence of disturbance light and the background. It is an object of the present invention to propose a simple image extraction device and an image display device using the same.

That is, the present invention does not require special imaging conditions, can perform real-time processing, does not require complicated initial settings, and can extract an image which is not affected by a bright luminous body or reflector existing in the background. It is intended to provide a device.

Another object of the present invention is to provide an image display device which allows the observer to exclusively observe the first image and the second image without being influenced by the background state. is there.

[0007]

The problem to be solved by the present invention is achieved by the present invention described in the following (1) to (6).

(1) An image pickup device for picking up an image of an object to be observed, an illuminating device for illuminating the object to be observed, and an illuminating device that repeatedly turns on and off in synchronization with an exposure cycle of the image pickup device. A storage circuit for temporarily storing an image when the lighting device is turned on and an image when the lighting device is turned off obtained by the imaging device, and an operation for subtracting the image when the lighting device is turned on and the image when the lighting device is turned off An image extraction device comprising a circuit.

According to a preferred aspect of the present invention, it is preferable that the illumination light emitted by the illumination device specifically illuminates only the observation target and does not affect the background. In addition, the illumination light is not limited to visible light, and is not limited as long as the imaging element has sensitivity such as infrared light or ultraviolet light. However, when the observation target emits light of another wavelength by being excited by the illumination light or the like, the imaging element does not need to have sensitivity to the wavelength of the illumination light.

According to a preferred aspect of the present invention, it is preferable that the illumination light emitted by the illumination device is pulse light that is turned on for a time sufficient for exposing an image sensor of the imaging device.

According to a preferred embodiment of the present invention, the illumination may be arranged in front of, or obliquely or laterally of, the observation target.

(2) Transmission type image display means for displaying the first image and the second image, and a transmission type image display means arranged behind the image display means and comprising at least one image each. A first control image that functions as a backlight, a second control image that functions as a backlight for the second image, and a backlight output unit that outputs the image in the direction of the image display unit; A directivity that gives the first image and the second image exclusive directivity toward either the left or right eye of the observer, respectively, using the control image and the second control image. The image processing apparatus further includes an application unit, wherein the first control image and the second control image are images of the observer extracted by the image extracting device according to (1), that is, an observer image. Image display device.

According to a preferred aspect of the present invention, in the image display device of (2), the image display means can display the first image and the second image alternately in a time-division manner, The backlight output unit can display the first control image and the second control image alternately in a time-sharing manner in synchronization with the switching timing of the first image and the second image. Be composed.

According to a preferred aspect of the present invention, an image display device comprises: a set of the image display means for displaying the first image and the second image independently of each other; One set of the backlight output means for independently displaying one control image and the second control image, and the first image using the first control image and the second control image. And an independent set of directivity providing means for giving exclusive directivity toward either the left or right eye of the observer to the second image and the second image, respectively. It has an independent optical system and a synthesizing means for synthesizing the two independent optical systems.

According to a preferred aspect of the present invention, in the image display device, the backlight output means may be configured to convert the first control image and the second control image into a first polarized light and a second polarized light orthogonal to each other. Output by two polarized lights, wherein the image display means uniformly arranges a first area for displaying the first image and a second area for displaying the second image on one display surface. Wherein the first region transmits backlight light of the first polarization and substantially blocks backlight light of the second polarization, and the second region has It is configured to substantially block backlight light of the first polarization and transmit backlight light of the second polarization.

(3) Image display means for displaying the first image and the second image, and transmission or blocking of the first image, which is provided in front of the image display means and comprises at least one image each. A first control image, a transmission area selecting means for displaying a second control image for controlling the transmission or blocking of the second image, and the first control image and the second control image An image display device comprising a directivity providing means for giving exclusive directivity toward either the left or right eye of the observer to the first image and the second image, respectively. The first control image and the second control image,
An image display device characterized by being an observer image extracted by the image extraction device according to (1).

According to a preferred aspect of the present invention, in the image display device according to (3), the image display means can display the first image and the second image alternately in a time-division manner, The transmission area selecting means is configured to be able to alternately display the first control image and the second control image in a time-division manner in synchronization with a switching timing of the first image and the second image. Is done.

According to a preferred embodiment of the present invention,
The image display device according to (3), further comprising: a set of the image display means for independently displaying the first image and the second image; and the first control image and the second control image. A set of transmission area selecting means to be independently displayed, and using the first control image and the second control image, the first image and the second image, respectively, to the left of the observer or Two sets of optical systems, each comprising an independent set of or one directivity providing means for providing exclusive directivity toward one of the right eye, and the two sets of optical systems Characterized in that it has a combining means for combining

According to a preferred embodiment of the present invention,
The image display device according to (3), wherein the image display means displays the first image as first polarized light, and displays the second image as second polarized light orthogonal to the first polarized light. Wherein the transmission region selecting means transmits the first control image through the first polarized light and substantially blocks the second polarized light, and the second control image transmits the first polarized light through the first polarized image. Having a display surface which substantially blocks and transmits the second polarized light, and wherein the first control image and the second control image are uniformly arranged on one display surface; Is achieved.

According to a preferred aspect of the present invention, the image display device according to (2) or (3) creates a half-plane image of the observer from the observer image extracted by the image extraction device. It has a half-surface imaging means. It is desirable that the half-plane imaging means can further binarize the image.

The half-plane imaging means identifies a center position of two points where the outline of the observer image intersects a horizontal line as a substantially center position of the observer image, and identifies the two points and the center position. Thus, the left and right half-plane images of the observer image can be obtained from.

Further, the image display device of the present invention may have the following configuration.

(4) Transmission type image display means for displaying the first image and the second image, and at least one movable light source provided behind the image display means. A first light source functioning as a backlight for the first image, and a second light source functioning as a backlight for the second image; Having a planar light source and at least one or more movable light blocking plates, a first light source functioning as a backlight for the first image, and a second light source functioning as a backlight for the second image. Using the first light source or light-shielding plate and the second light source or light-shielding plate, the first image and the second image, respectively, to the left or right of the observer. Exclusive towards one of the eyes In an image display device provided with directivity providing means for providing directivity, the position where the first light source or the light shielding plate and the position of the second light source or the light shielding plate are extracted by the image extracting device according to (1). A stereoscopic image display device characterized by being determined by position information of the user.

According to a preferred aspect of the present invention, in the image display device of (4), the image display means can alternately display the first image and the second image in a time-division manner. The backlight output means is configured to be able to alternately light the first light source and the second light source in a time-division manner in synchronization with the switching timing of the first image and the second image. Is done.

According to a preferred embodiment of the present invention,
(4) The image display device comprises: a set of the image display means for independently displaying the first image and the second image; and the first light source and the second light source which are independent of each other. A set of the backlight output means, using the first light source and the second light source, the first image and the second image, respectively, the left or right eye of the observer Combination of two independent optical systems composed of a set of independent directivity providing means for giving exclusive directivity toward one of them, and a combination of the two independent optical systems It is characterized by having means.

According to a preferred embodiment of the present invention,
(4) In the image display device of (4), the backlight output unit outputs the first light source and the second light source in a first polarization and a second polarization orthogonal to each other, and the image display unit outputs the first light source and the second light source. Divided into a first area displaying one image and a second area displaying a second image, and the first area and the second area are uniformly arranged on one display surface Having a display surface,
The first region transmits backlight light of the first polarization and substantially blocks backlight light of the second polarization, and the second region includes backlight light of the first polarization. , And is configured to transmit backlight light of the second polarization.

Further, another image display device of the present invention can have the following configuration.

(5) Image display means for displaying the first image and the second image, and at least one movable reflector disposed in front of the image display means, First selection means for controlling transmission or blocking of the image of the
A transmission area selection means comprising a second selection means for controlling transmission or blocking of the second image, or disposed at the front of the image display means, having at least one or more movable light shielding plates, First selection means for controlling transmission or blocking of the first image, transmission area selection means comprising second selection means for controlling transmission or blocking of the second image, and the first selection means Directivity providing means for giving exclusive directivity to either the left or right eye of the observer to the first image and the second image, respectively, using the second selection means. An image display device wherein the positions of the first selecting means and the second selecting means are determined by the position information of the observer himself extracted by the image extracting apparatus according to (1). .

According to a preferred aspect of the present invention, in the image display device of (5), the image display means can alternately display the first image and the second image in a time-division manner. The transmission area selection means can control the first selection means and the second selection means alternately in a time-division manner in synchronization with the switching timing of the first image and the second image. Be composed.

According to a preferred embodiment of the present invention,
The image display device according to (5), wherein a set of the image display means for independently displaying the first image and the second image, the first selection means and the second A set of transmission area selecting means consisting of selecting means, and using the first selecting means and the second selecting means control image, the first image and the second image, respectively, to the left of the observer or Two sets of optical systems, each comprising an independent set of or one directivity providing means for providing exclusive directivity toward one of the right eye, and the two sets of optical systems Characterized in that it has a combining means for combining

According to a preferred embodiment of the present invention,
(5) The image display device according to (5), wherein the image display means displays the first image as a first polarization, and displays the second image as a second polarization orthogonal to the second polarization. One selection means transmits the first polarization and substantially blocks the second polarization, and the second selection means substantially blocks the first polarization and the second polarization. Wherein the first control image and the second control image are uniformly arranged on one display surface.

According to a preferred embodiment of the present invention,
The image display device according to (4) or (5), wherein the image extraction device has an observer center detection unit. Further, the observer center detecting means may identify center position information of two points where a contour of the face image of the observer intersects a horizontal line as a substantially center position of the observer image. desirable.

According to a preferred embodiment of the present invention,
The first image and the second image in the image display devices of (2) to (5) are stereoscopic images captured with a predetermined parallax.

According to a preferred aspect of the present invention,
The directivity imparting means in the image display device according to any one of (2) to (5) has a convex lens or a Fresnel lens.

Further, the convex lens or Fresnel lens may be one in which a plurality of lenses are arranged in an array.

Further, another image display device of the present invention may have the following configuration.

(6) In a parallax barrier type or lenticular type stereoscopic image display device, an image extracting device for obtaining a face image of the observer himself,
From the imaging device constituted by the binarizing means or the observer center detecting means, and the center position information obtained by the observer center detecting means, the observer exists at any position of the normal stereoscopic viewing area and the reverse stereoscopic viewing area. Determining means for determining whether the
Based on the determination, the image display positions for the left and right eyes are interchanged, or the positions of the barrier and the lenticular lens are changed, so that the inverted stereoscopic viewing area is changed to the normal stereoscopic viewing area, and the normal stereoscopic viewing area is substantially enlarged. It is configured as follows.

According to a preferred aspect of the present invention, the observer center detecting means converts the center position information of two points where the outline of the face image of the observer intersects a horizontal line into the observer image. Is configured so as to be identified as a substantially central position.

[0039]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image extracting device and an image display device according to a preferred embodiment to which the present invention is applied will be described.

<First Embodiment: Image Extraction Apparatus> FIG.
FIG. 2 is a block diagram of the image extraction device 1 according to the first embodiment of the present invention. FIG. 2 is an image photographed by a CCD camera when lighting is turned on, FIG. FIG. 4 is a diagram showing the video of the observation target extracted by the image extraction device. In FIG. 1, the illumination 2 is C
The turning on / off is alternately repeated in synchronization with the exposure timing of the CCD camera 3 calculated by the timing generator 4 from the synchronization signal output from the CD camera 3. Therefore, the CCD camera 3 captures the image shown in FIG. 2 illuminated by the illumination 2 and the image shown in FIG. 3 without illumination in a time-division manner. Here, when a disturbance light source such as a light or a window is present in the background of the observation object, the background image including the observation object and the disturbance light source is included in the image at the time of lighting as shown in FIG. Obtained as an image. This image signal is stored in the memory circuit 5 as digital data after predetermined processing. Since the illumination is turned off at the subsequent exposure timing of the CCD camera 3, the obtained image is an image of only the background where the object to be observed is inconspicuous as shown in FIG. It is memorized.

The data of the two images stored in the memory circuits 5 and 6 are subjected to a subtraction processing by a subtraction circuit 7 at the subsequent stage. As a result, the background image recorded with almost the same luminance distribution on both sides has a high brightness. Regardless, the image of the observation object having a large luminance difference becomes an image almost reflecting the luminance when the illumination is turned on. That is, FIG. 4 in which the influence of the background has been removed.
The image looks like The data after the subtraction is stored in the memory circuit 8 until the data for the next two frames is completed.
It is repeatedly output as an image signal.

The image extracting apparatus 1 configured as described above is
Since the configuration is simple, real-time processing is possible. Also, there is no need for special imaging conditions or complicated initial settings. In addition, since the images when the illumination is turned on and when the illumination is not turned on are photographed by one CCD camera, the displacement between the two images during the subtraction does not matter. Further, since the images are captured in a time-division manner, the background data and the observation object data are updated every two frames. For example, even when the brightness of the background changes, a new setting is performed. Observation targets can be extracted without the need.

Although the above-described subtraction process is performed after both image data are once stored in the memory, it is also possible to store only one image in the memory and use the data immediately after acquisition as it is for the other data. In addition, the illumination can be efficiently turned on by setting the period to sufficiently cover the exposure period of the CCD element. In addition, in the case where the observation target is a person, the illumination can be performed without giving the observer discomfort by using infrared light. Of course, ultraviolet light can be used depending on the observation target, and light of another wavelength emitted from the observation target excited by this may be recorded by the imaging device.

Further, although only one illumination was used,
It is also possible to photograph the state of the observation target from various angles using one or more illuminations. In addition, by using one or more illuminations having different intensities and wavelength characteristics, it is possible to detect portions of the observation object having different light intensity characteristics and wavelength characteristics, respectively. At this time, the number of time divisions of the CCD camera is set according to the number of observation directions or the number of types of illumination. Further, in the above-described example, the background image when the illumination is not lit is obtained for each frame, but may be performed for each fixed period longer than this in order to speed up the response.

<Second embodiment: three-dimensional image display device>
FIG. 5 shows the principle of an image display device capable of displaying a stereoscopic image according to the second embodiment of the present invention, and shows a horizontal plane including the position of the eyes of the observer. In FIG. 5 (a),
Observer and backlight light source (hereinafter, backlight light source)
Are in a conjugate positional relationship via the convex lens. At this time, when the point A on the backlight light source emits light, the light emitted from the point A reaches the convex lens and undergoes a lens action, so that the light enters only the right eye of the observer. That is, the light emitted from the point A acts as illumination with a large lens diameter only for the right eye of the observer. In other words, it acts as a backlight source having directivity only to the right eye. Also, as shown in FIG. 5B, even when the observer is moved back and forth from this position, an area B in the backlight plane equivalent to the point A having a conjugate relationship with the observer's right eye is emitted. Thus, a directional backlight can be similarly configured.

As described above, in the present invention, the above-described image extracting apparatus according to the first embodiment is used as a method for creating a light-emitting area in a backlight plane having a conjugate relationship with the observer's eyes. That is, the face image of the observer is photographed and extracted as an observation target, and the obtained face image is used as a figure for forming a light emitting area.

FIG. 6 is a configuration diagram of an image display device according to a second embodiment showing a practical configuration example of the above-described directional backlight. The image display device at the moment when the observer observes the right-eye observation image is shown. It shows the situation. L on the right side of the observer 100
An infrared light 101R such as an ED and an infrared light 101L having a wavelength different from that of the infrared light 101R are provided on the left side, and illuminate the right half and the left half of the face of the observer 100 as shown in the figure. As a result, the face image of the observer 100, which is brightened only on the right half surface, is photographed by the camera 102R having sensitivity to the infrared light of 101R, and the face image of the observer 100, which is brightened only on the left half surface, is sensitive to the infrared light of 101L. Camera 1 with
Shoot with 02L. When an image captured by the camera 102R is displayed on the monochrome image display device 103 after binarization,
Backlight control image 10 in which the right half of the face is a light emitting area
4 is obtained. The light from the light emitting region is added to the convex lens 10
The directivity backlight can be configured by giving directivity using the backlight 6. The directional backlight thus configured is provided near the convex lens 106 and the convex lens 106
The color parallax image for the right eye displayed on the spatial modulation element 105 such as a smaller-diameter color liquid crystal or the like functions as illumination for allowing only the right eye of the observer 100 to observe. The color parallax images for the left eye are alternately displayed on the spatial modulation element 105 in a time-division manner, and synchronized with the display, the monochrome image display device 10
3 makes the left face half surface area 107 emit light. Left half face area 1
07 may be obtained by binarizing a face image captured by the camera 102L.

The image extracting device 108 is used for extracting the face image of the observer as described above. A monochrome image display device 10 which binarizes an image captured by the camera 102 as it is
In the case where the image is projected on the screen 3, for example, a window, a room light, or the like enters behind the observer, which has an adverse effect on the areas 104 and 107 as a light emitting area, and may cause crosstalk.
At this time, if the image extraction device 108 completely turns off the light except for the area 104, the possibility of such an adverse effect can be eliminated.

According to such a configuration, since the backlight control image 104 is a photographed image of the observer himself, even when the observer moves right and left, the light emitting area also moves right and left according to the moving distance. As a result, it is possible to always maintain the optical conditions constituting the directional backlight.
Further, when the image on the monochrome image display device is turned upside down, it is possible to follow up and down movement of the observer. Furthermore, if the observation position is within the stereoscopic viewing area, a plurality of observers can simultaneously recognize the same stereoscopic image. still,
In order to establish the above-described directional backlight having observer tracking, it is necessary to adjust the size and display position of the backlight control image in advance.
Therefore, a stereoscopic viewing area in the vertical and horizontal directions determined by the size of the backlight and the distance between the backlight and the convex lens,
It is necessary to adjust the installation position of the camera, the focal length, and the like so that the observation range of the camera becomes substantially equal.

In the present embodiment, the directional backlight is alternately switched between left-eye and right-eye in a time-division manner.
In synchronization with this, the observation image is switched between the left eye and the right eye, so that the left eye of the observer can always observe the observation image for the left eye, and the right eye of the observer can always observe the observation image for the right eye. Therefore, for example, when the left-eye control image is displayed on the backlight light source, only the left-eye observation image must always be displayed on the observation image display device. The observation image display device must have a sufficient response speed.

The image display device of the present invention is not limited to the above embodiment, and various other changes can be made. For example, various displays such as a liquid crystal display, a CRT, and a plasma display can be used as long as the backlight light source can be switched in a time-division manner. Various light sources other than a display such as a solid state light emitting element can be used as a backlight light source by forming an array.

<Modification 1 of Second Embodiment> FIG. 7 shows an external view of another example of an image display device which is a modification 1 of the second embodiment of the present invention. In the present embodiment, the backlight image display devices 203R and 203L, the convex lens 205
R, 205L and two color liquid crystal panels 204R, 204L are installed, and these optical systems are arranged perpendicular to each other.
By synthesizing at 10, the parallax images for the left and right eyes can be presented independently and simultaneously to the observer. still,
Reference numerals 200R and 200L denote cameras for obtaining a parallax image, which can be replaced by an image output device such as a video tape recorder. FIG. 6 described above
In the example shown in (1), the display was performed in a time-division manner, so a display device with a fast response speed had to be used to prevent the observer from feeling flickering. A display device can be used.
In the example shown in FIG. 6, the infrared illumination is arranged on the side of the observer, but in the present embodiment shown in FIG. 7, the infrared illumination 201 is arranged so as to illuminate the observer from the front. .
This is because the illumination condition is not changed in accordance with the movement of the observation position in the front-back direction, whereby the entire face of the observer is brightly illuminated. The image of the observer thus illuminated is photographed by one CCD camera 202 having sensitivity only to the infrared wavelength of the infrared illumination 201, and the image extraction device 2
11 after processing by the monochrome CRT 203R, 2
03L is displayed as a backlight control image. Here, the infrared illumination 201 is connected to a CCD by a lighting circuit (not shown).
Lights alternately in synchronization with the exposure timing of the camera 202 /
Since the light is repeatedly turned off, the image obtained by the CCD camera 202 alternates between an image illuminated by infrared light and an image not illuminated by infrared light for each frame. The image extraction device 211 used here is the image extraction device described in the first embodiment, and can obtain an observer image that is not affected by external light from an image captured by the CCD camera 202. . The operation principle of the image extracting device 211 is the same as that of the first embodiment, and thus the description is omitted. Further, the image extracting device 211 has a binarization circuit and a half-surface image circuit, and converts the obtained front image of the observer unaffected by the external light into the left and right observer binary Process into a half-plane image and output.

The procedure for obtaining the binarized half-plane image of the observer will be described with reference to FIG. First, an observer image is binarized by an appropriate threshold to obtain an observer binarized image, and its outline is determined.
Next, for each scanning line, the time from the left edge of the screen to the right edge of the contour of the observer binarized image and the time from the right edge to the left edge of the contour,
That is, the time t1 from the horizontal synchronization signal HSYNC to the leading edge of the luminance signal and the time t2 from the leading edge to the trailing edge are obtained. The half time of t2 is calculated, and an area of t1 to t1 + t2 / 2 of each scanning line is made to emit light, so that an observer binarized right half plane image as shown in FIG. 9 is made to emit light in an area of t1 + t2 / 2 to t1 + t2. As a result, an observer binarized left half plane image as shown in FIG. 10 can be obtained.

Note that the image display device of the present invention is not limited to the above embodiment, and various other modes can be changed.

For example, as the convex lens, a Fresnel lens can be used to reduce the weight and the cost. Further, the convex lens may be composed of a plurality of lens groups in order to shorten the focal length without being affected by vignetting in the peripheral portion or to reduce the influence of aberration. In addition, the convex lens is configured by a convex lens array including a plurality of convex lens units as shown in FIGS. 11 and 12, and the focal length of each convex lens unit can be reduced to reduce the size. In that case, the display area on the backlight must be divided by the same number as the number of convex lens units, and an observer image must be displayed for each display area. It should be noted that the observer images displayed in the respective display areas should be displayed so as to have almost the same position and size as the image formed on the backlight plane by the convex lens array with the observer as the object point. In this case, the number and shape of the convex lens units are arbitrary.

Further, the above-mentioned CCD camera may be arranged on the optical axis of the above-mentioned convex lens using a half mirror or the like. It is also possible to adopt a configuration in which an observer image is formed on a diffuser installed at a position equidistant from the backlight lens with the convex lens by using a convex lens, and then the image is taken. At this time, in order to widen the depth of field of the imaging system formed by the convex lens and the diffuser, a filter that transmits visible light and blocks infrared light in a region excluding the vicinity of the optical axis, that is, a diaphragm that acts only on infrared light is used. It may be installed in the optical path. Further, the illumination light source is not limited to an infrared light source, but may be a visible light or ultraviolet light source. The infrared CCD camera may be replaced with a MOS camera or another image pickup tube. When performing predetermined image post-processing, it is possible to use microwaves or ultrasonic waves as a medium by using a system capable of obtaining those images instead of a camera.

In this embodiment, a monochrome CRT is used as a backlight source. However, instead of this, for example, a liquid crystal display, a liquid crystal projector, a plasma display, a neon tube display, a thin CRT, an array CRT, or the like may be used. It is possible. Various light sources other than a display such as a solid state light emitting element can be used as a backlight light source by forming an array.

In this embodiment, it is also possible to use a planar light source instead of a backlight light source capable of displaying an image. In this case, in order to provide observer tracking, it is necessary to mechanically control the light source position using the observer center position information obtained by the image extraction device. Alternatively, observer tracking can also be realized by controlling the installation conditions of a mirror installed between the light source and the observation image display device.

The installation position and size of the backlight light source and the observation image display device are arbitrary as long as the above-described conditions for establishing the directional backlight are satisfied. For example, in order to widen the stereoscopic viewing area, the center position of the backlight light source and the optical axis of the convex lens can be shifted, or the backlight light source can be set larger than the observation image display device.

<Modification 2 of Second Embodiment> In Modification 1 of the second embodiment, the right-eye image and the left-eye image shown on each of the two display liquid crystal panels are synthesized by a half mirror. They coexist in the same field of view. For this reason, the image display device of the first embodiment requires one half mirror, two backlight light sources, two convex lenses, and two observation image display devices.

The three-dimensional image display device according to the second modification includes:
A set of backlight control images is divided into a first polarized light and a backlight light source capable of emitting as a second polarized light orthogonal thereto, and the screen is divided into two regions for displaying a left-eye observation image and a right-eye observation image. The size of the apparatus can be reduced by using a transmissive display device in which each region is configured to transmit only the first polarized light or the second polarized light.

FIG. 13 shows the configuration of an image display device according to a second modification of the second embodiment. Also in this modification, a convex lens, a backlight light source, infrared illumination, infrared CC
Images are distributed to the left and right eyes using a directional backlight composed of a D camera and an image extraction device. The principle and settings are the same as those in the image display device of the second embodiment. Then, the description is omitted.
In addition, the description of the operation of the image extraction device that creates the backlight control image is also omitted.

The image display apparatus according to the present embodiment shown in FIG. 13 uses a flat light source using a cathode ray tube as a backlight source and a liquid crystal panel 301 from which an analyzer is removed. When the observer binarized left half-plane image as a backlight control image is displayed on the liquid crystal panel from which the analyzer has been removed in this manner, an area 302 where the observer binarized left half-plane image is displayed.
Emits the first polarized light, and similarly, the region 303 other than the observer binarized left half plane image emits the second polarized light orthogonal to the first polarized light. That is, this makes it possible to configure a backlight light source having a plurality of regions capable of outputting two orthogonally polarized lights. The polarized light that emitted the observer binarized left hemi-facial image functioned as a backlight with a large lens diameter only for the observer's left eye by the convex lens 304, and also emitted an area other than the observer binarized left hemi-facial image. The polarized light functions as a large-diameter backlight for only the right eye of the observer.

The observation image display device 305 installed near the convex lens 304 uses a liquid crystal panel on which a special polarization control film is installed instead of the polarizer and the analyzer. Are configured so that an observation image for the left eye and an observation image for the right eye can be displayed alternately every other line. For example, as shown in FIG. 14A, the observation image display device transmits only the first polarized light emitted from the above-described backlight light source and substantially blocks the second polarized light instead of the polarizer. An incident polarization control film 306 in which one polarizing plate and a second polarizing plate that transmits only the second polarized light and substantially blocks the first polarized light are alternately attached is attached. At this time, the incident polarization control film 306 is attached so that the first polarizing plate is located at the line for displaying the left-eye observation image and the second polarizing plate is located at the line for displaying the right-eye observation image of the liquid crystal panel. . Similarly, instead of the analyzer, the output polarization control film 307 in which the first polarizing plate and the second polarizing plate are alternately arranged every other line is attached, and the left-eye observation image of the liquid crystal panel is displayed. The second polarizing plate is attached on the line so that the first polarizing plate is located on the line displaying the observation image for the right eye. As a result, the first polarized light emitted from the backlight is transmitted only through the region of the incident polarization control film 306 to which the first polarizing plate is attached, and only the observation image display region for the left eye of the liquid crystal panel is transmitted. To selectively illuminate. Similarly, the second polarized light is transmitted only through the area of the incident polarization control film 306 to which the second polarizing plate is attached, and selectively illuminates only the right-eye observation image display area of the liquid crystal panel. I do. The first polarized light and the second polarized light emitted from the backlight control image have selective directivity to the left and right eyes of the observer due to the action of the convex lens. The image can be distributed to the right eye. FIG. 14B shows the state of transmission of polarized light. FIG.
(B) shows the observation image display area for the left eye and the observation image display area for the right eye, each representing only one pixel. Note that the liquid crystal panel in the present embodiment is driven in a normally white mode in which attenuation of transmitted light is small when there is no electric field.

The image display device of the present invention is not limited to the above embodiment, and various other changes can be made. For example, the observation image display device is shown in FIGS.
9 Each of the modes described in (a) may be used.
15B to FIG. 19B illustrate the state of transmission of polarized light in each mode.

In the observation image display device shown in FIG. 15, the output polarization control film is placed so that the first polarizing plate is located in the observation image display region for the left eye and the second polarizing plate is located in the observation image display region for the right eye. It differs from the case of FIG. 14 in that it is attached. With this change, the liquid crystal panel shown in FIG.
It is driven in a normally black mode in which the attenuation of transmitted light increases when there is no electric field.

The observation image display device shown in FIG. 16 differs from the device shown in FIG. 14 in that the output polarization control film is the first polarizing plate. Along with this change, the liquid crystal panel shown in FIG. 16 is driven in a normally white mode in the observation image display area for the left eye and in a normally black mode in the observation image display area for the right eye.

The observation image display device shown in FIG. 17 is different from the case of FIG. 16 in that the output polarization control film is a second polarizing plate. Along with this change, the liquid crystal panel shown in FIG. 17 is driven in a normally black mode in the observation image display area for the left eye and in a normally white mode in the observation image display area for the right eye.

The observation image display device shown in FIG. 18 has a structure in which a 90-degree retardation plate is attached on a polarizer of a liquid crystal panel driven in a normally white mode. Affixed corresponding to the right-eye observation image display position of the liquid crystal panel. Here, the 90-degree phase plate functions to rotate the phase of the transmitted light by 90 degrees from the phase of the incident light. For this reason, the first polarized light and the second polarized light that have entered the 90-degree phase difference plate are converted into the second polarized light and the first polarized light, respectively, as shown in FIG. . Since the polarizer of the liquid crystal panel is the first polarizing plate and transmits only the first polarized light, in the left-eye observation image display area to which the 90-degree retardation plate is attached, only the second polarized light is 90%. After being converted into the first polarized light in the phase difference plate, the light is transmitted through the polarizer. On the other hand, 90
In the observation image display area for the left eye to which the phase difference plate is not attached, only the first polarized light emitted from the backlight light source passes through the polarizer as it is. Due to the above effects, the first polarized light serves only as the left-eye observation image display area, and the second polarized light functions as backlight light only for the right-eye observation image display area. Exclusive distribution of both observation images to the left and right eyes becomes possible.

The observation image display device shown in FIG. 19 differs from the case of FIG. 18 in that a liquid crystal panel driven in a normally black mode is used. Since the first polarizer is used for the polarizer of the liquid crystal panel, its operation is the same as that of FIG. 18 except for the driving mode of the liquid crystal panel. For example, if the second polarizing plate is used as the polarizer of the liquid crystal panel while the first polarized light is used as the backlight for the left-eye observation image display area, the position where the 90-degree retardation plate is attached Must be a left-eye observation image display area.

In the above embodiment, a device composed of a liquid crystal panel and a special polarization control film has been used as an observation image display device. Instead, a rectangular strip-shaped first polarizing plate whose polarization axes are orthogonal to each other is used. A polarization control film obtained by alternately arranging the second polarizing plate, and a left-eye observation image at a position corresponding to the first polarizing plate, and a right-eye observation image at a position corresponding to the second polarizing plate. The photographic film obtained by pasting may be used.

The display positions of the left-eye observation image and the right-eye observation image displayed on the liquid crystal panel or the photographic film do not necessarily have to be every other line, as long as they are evenly distributed in the screen. It is possible to take various forms such as a checkered pattern. Also in that case, the first polarizing plate and the second polarizing plate constituting the polarization control film,
It must be attached so as to be located in the left-eye observation image display area and the right-eye observation image display area of the liquid crystal panel or photographic film. Further, even when a 90-degree retardation plate is used for the polarization control film, the position where the 90-degree retardation plate is attached is determined by considering the polarization axis direction of the polarizer of the liquid crystal panel in the observation image display area for the left eye or It must be set so that it is located in the observation image display area for the right eye.

In the second modification, a liquid crystal panel without an analyzer is used as a backlight light source capable of outputting two polarized lights orthogonal to each other. However, this backlight light source has the form shown in FIGS. Is also good. Since the liquid crystal panel itself is not a light emitting device, the diagrams shown in FIG. 20 to FIG.
A surface-emitting light source constituted by a metal halide lamp or the like should also be described, but is omitted from the drawing.

The backlight light source shown in FIG. 20 has the same structure and operation as the color liquid crystal shown in FIG. By adopting such a mode, the backlight light emission surface can be divided into the left-eye backlight control image display area and the right-eye backlight control image display area.
It is possible to realize a backlight light source that divides into two regions and emits first polarized light in the former region and second polarized light having a polarization axis orthogonal to the first polarized light in the latter region.

The backlight light source shown in FIG. 21 has a structure in which the input polarization control film and the output polarization control film of the color liquid crystal shown in FIG. 17 are interchanged. The operation mode setting of the liquid crystal panel is the same as that of FIG.

The backlight light source shown in FIG. 22 has a structure in which a 90-degree retardation plate is attached on a polarizer of a liquid crystal panel driven in a normally white mode.
The 0-degree retardation plate is attached corresponding to the left-eye backlight control image display position of the liquid crystal panel. The transmitted light that has passed through the liquid crystal panel uniformly becomes the second polarized light because the analyzer is the second polarizing plate. However, in the left-eye backlight control image display area to which the 90-degree retardation plate is attached, Since the phase of the second polarized light is rotated by 90 degrees, it is finally converted into the first polarized light and emitted. With the above effects, a backlight light source that emits first polarized light in the left-eye backlight control image display area and emits second polarized light in the right-eye backlight control image display area can be realized.

The backlight light sources shown in FIG. 20 to FIG. 22 use monochrome liquid crystal panels, and these are changed by changing the driving mode of the liquid crystal so that the first polarizing plate constituting the incident polarization control film can be used. It is also possible to replace the second polarizing plate. In the case where the analyzer is changed to the first polarizing plate in the backlight light source shown in FIG. 22, a 90-degree phase difference plate must be attached to correspond to the right-eye backlight control image display area. At this time, the driving mode of the liquid crystal panel is a normally white mode when the polarization axes of the polarizer and the analyzer are orthogonal to each other, and a normally black mode when the polarizer and the analyzer have the same polarization axis.

The backlight light source shown in FIG.
On the emission surface of the ED matrix light source, a polarization control film formed by alternately arranging strip-shaped first polarizers and second polarizers whose polarization axes are orthogonal to each other is attached, and the first polarizer Is attached to the left-eye backlight control image display area, and the second polarizing plate is attached to the right-eye backlight control image display area. Here, the self-luminous matrix light source to which the polarization control film is attached is not necessarily L
The light source does not need to be an ED matrix light source, and a plasma display, a neon tube display, a CRT, or the like can be used. It is also possible to use an array of light sources other than LEDs.

In the backlight light sources shown in FIGS. 20 to 23, the display positions of the left-eye backlight control image and the right-eye backlight control image displayed on the liquid crystal panel or the LED matrix light source need not always be every other line. Instead, various forms such as a vertical line or a checkered pattern can be used as long as they are evenly distributed in the screen. At that time, the first polarizing plate and the second polarizing plate constituting the polarization control film are positioned in the left-eye backlight control image display area and the right-eye backlight control image display area of the liquid crystal panel or the LED matrix light source. Must be affixed. In addition, 90
Even when a 90 ° retarder is used, the position where the 90 ° retarder is attached may be determined by taking into account the direction of the polarization axis of the polarizer of the liquid crystal panel in the left-eye backlight control image display area or the right-eye backlight control. It must be set so that it is located in the image display area.

The backlight light source shown in FIG.
It has a structure in which a left-eye LED matrix light source in which a first polarizing plate is attached to an emission surface of an ED matrix light source and a right-eye LED matrix light source in which a second polarizing plate is attached are combined by a half mirror. Here, the self-luminous matrix light source to which the polarization control film is attached is not necessarily an LED matrix light source, and a plasma display, a neon tube display, a CRT, or the like can be used. Also, an array of light sources other than LEDs,
It is also possible to use two liquid crystal displays whose analyzer consists of a first polarizer and a second polarizer. When the above-described liquid crystal display is used, it is not necessary to newly attach a first polarizing plate and a second polarizing plate to the light exit surface.

In this embodiment, instead of a backlight light source capable of displaying an image, a plane uniform light source which is divided into two regions by attaching a first polarizing plate and a second polarizing plate as shown in FIG. 25 is used. It is also possible. In this case, in order to provide observer tracking, it is necessary to mechanically control the light source position using the observer center position information obtained by the image extraction device. Alternatively, observer tracking can also be realized by controlling the installation conditions of a mirror installed between the light source and the observation image display device.

<Third embodiment: three-dimensional image display device>
The image display device of the second embodiment enables observation of a stereoscopic image by distributing the observation images for the left and right eyes exclusively to the left and right eyes of the observer using a directional backlight, respectively. With this method, stereoscopic image observation without special glasses is possible.

Referring to FIG. 26, the principle of an image display device capable of displaying a stereoscopic image according to the third embodiment will be described. In FIG. 26, the observer and the monochrome liquid crystal panel 401 as the transmitted light control device have a conjugate positional relationship via the convex lens 402. Further, a CRT 403 for displaying an observation image is provided behind the monochrome liquid crystal panel 401. Here, when the monochrome liquid crystal panel 401 does not exist, the left eye of the observer observes the observation image area (1) in the observation image displayed on the CRT as an inverted image in which the diameter of the convex lens 402 is enlarged. The right eye of the observer observes the observation image area (2) as an inverted image in which the diameter of the convex lens 402 is enlarged. However, when the monochrome liquid crystal panel 401 is disposed at the above-described position, and has a property of transmitting light in a region where the transmitted light control image for the left eye is displayed and blocking light in other regions. In, the image in the observation image area (1) reaches the left eye but cannot reach the right eye. That is, an image can be selectively observed only with the left eye. The selective image observation using only the left eye is performed by using the light ray (solid line) of the image incident on the left eye and the image incident on the right eye on the monochrome liquid crystal panel even when the position of the observer moves back and forth from the above-described set position. Ray (dashed line)
Can be maintained in a range where they do not intersect. In addition, when the observer's own image is used for setting the transmitted light control image, the transmitted light control image display position also moves along with the movement of the observation position. Image observation is maintained.

Here, when the transmitted light control image for the left eye is displayed on the monochrome liquid crystal panel 401, the observation image for the left eye is displayed in the observation image area (1) of the CRT 403, and when the transmitted light control image for the right eye is displayed, the CRT 403 is displayed. If the operation of displaying the observation image for the right eye in the observation image area (2) is alternately performed in a time-sharing manner, the observer can observe the stereoscopic image.

The face image of the observer extracted by the same image extraction device as that described in each of the above embodiments is used to create the transmitted light control image for the left eye and the transmitted light control image for the right eye.

<Modification 1 of Third Embodiment> FIG. 27 shows a stereoscopic image display apparatus of a modification 1 of the third embodiment. In the present modified example, the same optical system as that shown in FIG. 26 has two systems for the right eye and the left eye. Both optical systems are arranged perpendicular to each other, and by combining each with a half mirror 501,
The observation images for the left and right eyes can be independently and simultaneously presented to the observer. Note that the convex lens 502 is shared by both optical systems. Here, CRT5 for left eye
Since the observation image displayed on the 03L and the right-eye CRT 503R is observed as an inverted image by the observer due to the action of the convex lens 502, the observer can observe the image as an erect image by displaying the image as an inverted image in advance. . The transmitted light control images displayed on the left and right monochrome liquid crystal panels 504L and 504R are infrared illumination and infrared CC (not shown).
An observer binarized half-plane image generated by an image extraction device having a D camera is used. In order for the selective observation with one eye to have the observer followability as described above, it is necessary to adjust the size and display position of the transmitted light control image in advance, and the monochrome liquid crystal panel The camera installation position, focal length, and the like are adjusted so that the vertical and horizontal stereoscopic viewing areas determined by the size and the distance between the monochrome liquid crystal panel and the convex lens are substantially equal to the camera observation range. The description of the operation of the image extraction device that creates the transmitted light control image is the same as that of the image extraction device of the first embodiment or the image extraction device of the second embodiment and the image display device of each modified example, and therefore, will be described here. Is omitted.

<Modification 2 of Third Embodiment> The image display device of the present invention is not limited to the above embodiment, and various other modifications can be made. For example, an observation image display device that divides the screen into two regions for displaying a left-eye observation image and a left-eye observation image, and that can output each image as a first polarization and a second polarization orthogonal thereto, By using a transmitted light control device capable of displaying a transmitted light control image for the left eye that can transmit only one polarized light and a transmitted light control image for the right eye that can transmit only the second polarized light, the apparatus can be downsized. It is also possible.

FIG. 2 shows an image display device according to such an embodiment.
FIG. In FIG. 28, the observation image display device includes:
It comprises a CRT 601 capable of alternately displaying a left-eye observation image and a right-eye observation image for each scanning line, and a polarizing filter 602 attached to the surface thereof. Here, the polarizing filter 602 includes a first polarizing plate on a scanning line for displaying a left-eye observation image,
The configuration is such that the second polarizing plate is located on the scanning line for displaying the observation image for the right eye. Further, the observation image display device only needs to be able to display left and right observation images with two orthogonally polarized lights, and may use a liquid crystal display or an LED display having a configuration as shown in FIGS. The respective operations are the same as those described in the second embodiment (Modification 2), and will not be described here. Further, the transmitted light control device uses a monochrome liquid crystal panel having a configuration as shown in FIGS. Also in this regard, the respective operations are the same as those described in the second embodiment (Modification 2), and thus description thereof is omitted here.

In this embodiment, various types of liquid crystal panels are used as the transmitted light control device.
A polarizing plate having two orthogonal polarization axes as shown in FIG. 17 can also be used. In this case, in order to provide observer tracking, it is necessary to mechanically control the light source position using the observer center position information obtained by the image extraction device.

<Fourth Embodiment—3-D Image Display Device>
The image extraction device of the first embodiment or the image extraction device of the image display device of the second or third embodiment can be applied to a parallax barrier type or lenticular type stereoscopic image display device.

Normally, in a parallax barrier type or lenticular type stereoscopic image display device, as shown in FIG. 29, a normal viewing region in which stereoscopic viewing can be performed correctly and a reverse viewing region in which left and right observation images are switched alternately appear. Here, the position of the observer is detected, and when the observer enters the pseudoscopic region, the display positions of the left and right observation images are switched, or in the case of the parallax barrier method, the position of the barrier is switched, thereby causing pseudoscopic vision. The area is changed to a normal vision state, and the stereoscopic viewing area is expanded. By using the observer center position information obtained by the image extraction device to detect the observer position information,
Observer tracking can be easily added. The description of the operation of the image extracting device is the same as that of the image extracting device of the first embodiment or the image extracting device of the image display device of the second or third embodiment, and thus the description thereof is omitted here.

[0092]

According to the present invention, the above configuration does not require special imaging conditions, can be processed in real time, does not require complicated initial settings, and has a bright luminous body, reflector or scatterer in the background. An image extraction device not affected by the above can be realized.

When this image extraction device is used in an image display device for exclusively observing the first image and the second image to both eyes of an observer using a substantially half-plane image of the observer, ,
It is possible to observe the first image and the second image exclusively with both eyes of the observer easily and reliably without being affected by the background.

[Brief description of the drawings]

FIG. 1 is a block diagram of an image extraction device according to a first embodiment.

FIG. 2 is a view showing an observation image at the time of illumination used for explaining the principle of the image extraction device of the first embodiment.

FIG. 3 is a view showing an observation image at the time of non-illumination used for explaining the principle of the image extraction device of the first embodiment.

FIG. 4 is a view showing an image of an observation target extracted by the image extraction device of the first embodiment.

FIG. 5 is a diagram illustrating the principle of the image display device according to the second embodiment.

FIG. 6 is a diagram illustrating an image display device according to a second embodiment.

FIG. 7 is a diagram showing a configuration of an image display device according to a first modification of the second embodiment.

FIG. 8 is a view for explaining the principle of detecting an edge of a face image in the image extraction device of the present invention.

FIG. 9 is a diagram showing a right-eye control image obtained by the image extraction device used in the embodiment of the present invention.

FIG. 10 is a view showing a left-eye control image obtained by the image extracting apparatus used in the embodiment of the present invention.

FIG. 11 is a diagram showing a configuration of a modification of the convex lens.

FIG. 12 is a diagram showing a configuration of a modification of the convex lens.

FIG. 13 is a diagram illustrating a configuration of an image display device according to a second modification of the second embodiment.

FIG. 14 is a diagram illustrating an example of a configuration of an observation image display device used in an image display device according to Modification 2 of the second embodiment.

FIG. 15 is a diagram illustrating an example of a configuration of an observation image display device used in an image display device according to Modification 2 of the second embodiment.

FIG. 16 is a diagram illustrating an example of a configuration of an observation image display device used in an image display device according to Modification 2 of the second embodiment.

FIG. 17 is a diagram illustrating an example of a configuration of an observation image display device used in an image display device according to Modification 2 of the second embodiment.

FIG. 18 is a diagram illustrating an example of a configuration of an observation image display device used in an image display device according to Modification 2 of the second embodiment.

FIG. 19 is a diagram illustrating an example of the configuration of an observation image display device used in an image display device according to Modification 2 of the second embodiment.

FIG. 20 is a diagram illustrating an example of a configuration of a backlight light source used in an image display device according to a modification 2 of the second embodiment.

FIG. 21 is a diagram illustrating an example of a configuration of a backlight light source used in an image display device according to a modification 2 of the second embodiment.

FIG. 22 is a diagram illustrating an example of a configuration of a backlight light source used in an image display device according to a modification 2 of the second embodiment.

FIG. 23 is a diagram illustrating an example of a configuration of a backlight light source used in an image display device according to Modification 2 of the second embodiment.

FIG. 24 is a diagram illustrating an example of a configuration of a backlight light source used in an image display device according to a modification 2 of the second embodiment.

FIG. 25 is a diagram illustrating an example of a configuration of a backlight light source used in an image display device according to a second modification of the second embodiment.

FIG. 26 is a diagram illustrating a configuration of an image display device according to a third embodiment.

FIG. 27 is a diagram illustrating a configuration of an image display device according to a first modification of the third embodiment.

FIG. 28 is a diagram illustrating a configuration of an image display device according to Modification 2 of the third embodiment.

FIG. 29 is a diagram illustrating a configuration of an image display device according to a fourth embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Image extraction device 2 Illumination device 3 Imaging device 4 Timing generator 5, 6 Storage circuit 7 Operation circuit

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 13/04 G06F 15/62 380

Claims (13)

[Claims] An imaging device for imaging an observation target;
A lighting device for illuminating the observation target, which is repeatedly turned on and off, and a memory for temporarily storing an image when the lighting device is turned on and an image when the lighting device is turned off obtained by the imaging device. An image extraction device comprising: a circuit; and an arithmetic circuit for performing a subtraction process between an image when the lighting device is turned on and an image when the lighting device is turned off. 2. The image extraction device according to claim 1, wherein the illumination light emitted from the illumination device is applied only to an observation target and does not affect a background. 3. The image extraction device according to claim 1, wherein the illumination light emitted by the illumination device is pulse light that is turned on for a time sufficient to expose an image sensor of the imaging device. . 4. A transmission type image display means for displaying a first image and a second image, and a back of the first image which is provided behind the image display means and comprises at least one image each. Backlight output means for outputting a first control image functioning as a light and a second control image functioning as a backlight of the second image in the direction of the image display means; Directivity providing means for giving exclusive directivity to either the left or right eye of the observer to the first image and the second image using the image and the second control image, respectively 4. The image display device according to claim 1, wherein the first control image and the second control image are different from each other.
An image display device characterized by being an observer image extracted by the image extraction device according to (1). 5. The image display means can alternately display the first image and the second image in a time-division manner, and the backlight output means displays the first image and the second image. 5. The first control image and the second control image can be displayed alternately in a time-sharing manner in synchronization with a switching timing.
An image display device according to claim 1. 6. A set of said image display means for independently displaying said first image and said second image, and independently displaying said first control image and said second control image, respectively. A set of the backlight output means to be displayed, using the first control image and the second control image, the first image and the second image, respectively, left or right of the observer Combining two independent optical systems and two independent optical systems each comprising an independent set of directivity providing means for providing exclusive directivity toward one of the eyes 5. The image display device according to claim 4, further comprising a synthesizing unit. 7. The backlight output means outputs the first control image and the second control image by first and second polarizations orthogonal to each other, and the image display means includes The first area for displaying the first image and the second area for displaying the second image have a display surface uniformly arranged in one display surface, the first area is the first area Transmitting the backlight light of the first polarization and substantially blocking the backlight light of the second polarization, the second region substantially blocking the backlight light of the first polarization; The image display device according to claim 4, wherein the image display device is configured to transmit a backlight light of the second polarization. 8. An image display means for displaying a first image and a second image; and an image display means disposed in front of the image display means for transmitting or blocking the first image comprising at least one image. A first control image to be controlled, a transmission area selecting means for displaying a second control image for controlling transmission or blocking of the second image, and the first control image and the second control image. The image display apparatus further comprising: a directivity providing unit configured to provide the first image and the second image with exclusive directivity toward one of the left and right eyes of the observer. The one control image and the second control image, wherein:
4. An image display device, which is an observer image extracted by the image extraction device according to any one of claims 1 to 3. 9. The image display means can alternately display the first image and the second image in a time-division manner, and the transparent area selecting means can display the first image and the second image on the first image and the second image. 9. The image display device according to claim 8, wherein the first control image and the second control image can be alternately displayed in a time-sharing manner in synchronization with a switching timing. 10. A set of said image display means for independently displaying said first image and said second image, and independently displaying said first control image and said second control image, respectively. A set of transmissive region selecting means to be displayed, the first control image and the second control image using the first image and the second image to the observer's left or right eye, respectively. A two-system optical system constituted by a set of independent or one directivity-providing means for giving exclusive directivity toward one side, and a synthesizing means for synthesizing the two systems of optical systems. The image display device according to claim 8, comprising: 11. The image display means displays the first image as a first polarized light, and displays the second image as a second polarized light orthogonal to the first polarized light,
The transmission region selecting means is configured such that the first control image transmits the first polarized light and substantially blocks the second polarized light, and the second control image substantially blocks the first polarized light. The first control image and the second control image are cut off and transmit the second polarized light, and have a display surface uniformly arranged on one display surface. The image display device according to claim 8, wherein: 12. The image display device according to claim 4, further comprising a half-plane image forming means for forming a half-plane image of the observer from the observer image extracted by the image extraction device. 13. The half-plane imaging means identifies a center position of two points where a contour of the observer image intersects a horizontal line as a substantially center position of the observer image, and identifies the two points and the center position. 13. The image display device according to claim 12, wherein a left and right half-plane image of the observer image is obtained from.