JPH04145788A - Eyes matching image pickup display device - Google Patents

Abstract

PURPOSE:To improve presence by alternately switching the light transmission state and light impermeable state on a display screen. CONSTITUTION:When a Fresnel lens 5 of focal length (d) is arranged adjacent to a display screen 2, the spreading can be prevented on an observer 4 side from the screen 2 even when a video device 3 is separated from the screen 2. In short, it is because the lens 5 can bend the light incident to the video device 3, it is equal to perform image pickup from infinity by means of the video device 3. When the observer 4 is directly in front of a screen 2, the image pickup device 3 can pickup the front image of the observer 4 even when the observes the image from any position of the display surface. Thus, superior presence can be obtained.

Description

DETAILED DESCRIPTION OF THE INVENTION (Field of Industrial Application) The present invention relates to a line-of-sight image pickup and display device that provides an excellent sense of realism in image communications and the like.

(Prior Art) Image communication devices such as videophones and video conferences are equipped with an imaging display device for transmitting and receiving images in addition to a voice transmitting and receiving device. It is a communication device with an excellent sense of realism that gives a sense of realism.

Conventionally, an imaging display device for such a communication device has been used in which an imaging device such as a television camera and a display device such as a CRT display are arranged closely together.

However, images sent and received using such communication devices do not match the camera's imaging direction because the observer's line of sight faces the display surface of the display device, and as a result, the viewer's line of sight does not match the communication partner, giving an unnatural feeling. There was a drawback to giving. This means that as the display screen gets larger, the distance between the center of the display screen and the camera increases, so when performing image communication using a large screen display device, it has been difficult to align the line of sight with the other party. Met.

However, recently, an imaging display device as shown in FIG. 8 has been proposed, which allows the user to match the line of sight with the other person. This consists of a projector LA (B) for projecting and displaying an image, a display screen 2A (B), and an image pickup installed at a position facing an observer 4A (B) who holds the display screen in between and observes the image. The camera 3A (B), the drive circuit 10A (B) that alternately switches and controls the display screen 2A (B) between a light transmission state and a light non-transmission state, the image pickup device 3A (B), and the drive circuit 10A (
It is composed of a synchronization circuit 11A (B), etc., which generates a synchronization signal that serves as a reference for the operation of step B). In other words, in this imaging display device, the drive circuit 10A(B) alternately switches the display screen 2A(B) between a light transmitting state and a non-light transmitting (scattering) state, and when the display screen 2A(B) is in the light transmitting state, Observer 4A (
B) Make sure that both people's lines of sight match.

The above-mentioned imaging display device is an extremely excellent device that can, in principle, achieve line-of-sight with a communication partner on a large screen display of any size that can be projected by the projector 1A (B).

Furthermore, the above-mentioned image capturing and displaying device can be installed on a large screen with line-of-sight without reducing image brightness or resolution by treating one image capturing and displaying device as one unit and installing multiple units side by side. It has excellent characteristics that enable display.

(Problems to be Solved by the Invention) However, the configuration of the imaging display device as shown in FIG. 8 has the following problems.

Figure 9 shows the projector IA (B) and drive circuit 10 for simplicity.
FIG. 3 is a diagram illustrating an observer's line of sight area with respect to a display screen with a control device such as A (B) omitted; When the display from the projector 1 (not shown) is a large screen, when the observer 4 is looking at an image at a position 2b away from the center 2a of the display screen 2, the line of sight of the observer 4 and the observer 4 Since the angle θ formed by the line connecting the camera and the camera 3 is large, there is a problem in that the line of sight does not match.In other words, in the above imaging display device, the observer 4 may get close to the edge of the display screen 2 or In order to be able to capture an image even when pointing at the periphery of the screen 2, as shown in FIG. This is because, if the viewing angle of 4 is α, then α=2tan~”・] must be ensured.

In order to avoid such line-of-sight mismatch, it is necessary to narrow the field of view of the imager 3. To do this, the imager 3 is installed as far back as possible from the display screen 2 and images are taken using a telephoto imaging method. , etc. were necessary. However, in that case, there was a drawback that the image pickup and display device would be large and extremely deep.

Furthermore, in the above imaging display device, the wide viewing angle of the imaging device 3 causes a fatal problem when attempting to realize a large screen display by combining a plurality of the above imaging display devices.

As shown in Fig. 10 (in this figure, the projector, control device, etc. are omitted for simplicity), a composite image captured by multiple imaging devices 3 is captured by a single imaging device. This type of image is produced only when the surface indicated by the dashed line is imaged; in other locations, images taken from different angles may be stitched together (shaded area), or the image may not be captured and may not be captured. This causes a problem where the lines are cut off (hatched areas).

(Objective of the Invention) The present invention solves the above-mentioned problems, and can display a large screen image, and can display a large screen image no matter where on the display screen the viewer is looking at the screen in front of him. The object of the present invention is to provide an imaging display device that allows line of sight to match.

(Means for Solving the Problems) The present invention solves the above problems and achieves the objects as claimed in the claims (
The invention described in 1) provides a projector for projecting and displaying an image, a Fresnel lens used as an imaging lens, a display screen whose light transmitting state and light non-transmitting state are alternately controlled by electric signals, and the display screen. Using an image pickup device installed at a position facing an observer who holds the screen between the screens, the display screen is alternately switched between a light transmission state and a light non-transmission state, and when the display screen is in the light transmission state, the image pickup device It is characterized by inputting information to the .

In addition, the invention described in claim (2) provides a projector for projecting and displaying an image, a Fresnel lens used as an imaging lens, and a display whose light transmitting state and light non-transmitting state are alternately controlled by electrical signals. One unit is composed of an image capture and display device consisting of a screen and an image capture device located at a position facing an observer who holds the display screen to observe the image, and multiple units are arranged vertically or horizontally, or horizontally The display screen of each unit is arranged in both directions, and the display screen of each unit is alternately switched between a light transmission state and a light non-transmission state, and the field of view of the imaging device is set to the size of the display screen when the display screen is in the light transmission state. The projector is characterized in that input is input to the image pickup device, and the projector performs projection by setting the projected image to the size of the display screen when the display screen is in a non-light-transmitting state.

(Function) The present invention uses a Fresnel lens as an imaging lens,
This adjusts the viewing angle of the imaging device as if it were capturing an image from an infinite distance.

FIG. 1 is a diagram for explaining the basic operating principle of the invention according to claim (1) of the present invention, and the projector and control device are omitted for simplicity. As shown in the figure, by arranging the Fresnel lens 5 with a focal length of about d close to the display screen 2, the image pickup device 3 does not spread on the viewer 4 side from the display screen 2 even if it is separated from the display screen 2. You can do it like this. This is Fresnel lens 5
This is because the light incident on the image pickup device 3 is bent, and this is equivalent to the image pickup device 3 taking an image from an infinite distance. Therefore, if the observer 4 directly faces the display screen 2, the imaging device 3 will capture the front image of the observer 4 no matter where on the display screen the image is viewed, that is, the line of sight will match. .

FIG. 2 is a diagram explaining the basic operating principle of the invention according to claim (2) of the present invention, and like FIG. 1, the projector, control device, etc. are omitted for simplicity. .

As shown in the figure, a plurality of units each including the imaging display device of FIG.
The field of view is set to be the size of the display screen 2 to capture an image, and the projector of each unit is set to project its projection area to the size of the display screen 2.

As a result, the scenery on the viewer's 4 side from the display screen 2 can be captured as a continuous image without creating a patchwork of images taken from different angles or missing parts even at the joints of each unit. That will happen.

(Embodiment) FIG. 3 shows a side view of the configuration of a line-of-sight matching image pickup and display device implementing the invention according to claim (1) of the present invention, and shows a case where two sets are used facing each other. In the figure, LA and IB are image projectors, 2A and 2B are display screens, 3A and 3B are imagers, 4A and 4B are observers, 5A and 5B are Fresnel lenses, 9A and 9B are projection shutters, IOA and IOB IIA is a drive circuit that controls light transmission and non-transmission of the display screen 2.

11B is a synchronization circuit that generates a reference synchronization signal;
2A and 12B are synchronization circuits that synchronize the input operations of the imagers 3A and 3B and the light transmission operation of the display screen generated by the drive circuit, and 13A and 13B are drive circuits that control light transmission and non-transmission of the projection shutter.

The projectors IA, IB, the imagers 3A, 3B, and the projection shutters 9A, 9B are held by holding stands 20A, 20B, respectively, and are surrounded by boxes 21A, 21B.

Drive circuit 10A, IOB, synchronous circuit 11A, 12A, l
1B12B, and the imagers 3A and 3B are connected to the synchronization signal line 31
A.

31B, and drive circuits 13A, 13B, display screens 2A, 2B, and projection shutter 9A.
, 9B are connected by drive signal lines 32A and 32B, and one projector and the imager 3B, and the projector 1B and the imager 3A.
are connected by a video signal line 30, and the projector, imager, drive circuit, synchronization circuit, and delay circuit are connected to power supplies 22A and 2A, respectively.
2B with power lines 33A and 33B.

Here, the projector IA is connected to the imager 3B, and the projector IB is connected to the imager 3A, so that the display screens 2A and 2B display the other side. The projector and the imager may be connected via a telephone line.

Devices that can generate light transmission and non-transmission states include capsule-shaped liquid crystal cells in which a liquid crystal layer is sandwiched between transparent electrodes to form a cell, dispersion-type liquid crystal cells, and dynamic scattering-type liquid crystal cells. can be given.

Dynamic scattering type liquid crystal is a known material and does not require any special explanation, but capsule type liquid crystal and dispersed type liquid crystal are recently developed as display panels and glass plates with dimming functions. Capsule-type liquid crystals include Nippon Sheet Glass's "instant light control glass" and Asahi Glass's "light control glass LCW".
J, Aji no Sorui's "Dimmer Liquid Crystal Sheet Kuact" J, etc. Also, as a dispersed liquid crystal, rPNL, which Dainippon Ink Co., Ltd. announced at the Japan Display '89 International Conference, etc.
Examples include CDJs.

When the light transmission state and non-transmission state are repeated periodically, if the period is short enough not to cause flicker and the time in the non-transmission state is longer than the time in the transmission state by more than a certain value, the display screen cannot be observed. From the observer's perspective, it appears to be in a constant state of opacity.

The Fresnel lens 5 can be manufactured by carving fine annular grooves on the surface of a plastic plate. Since it is molded from plastic material, large lenses can be produced relatively easily.

Furthermore, by changing the shape of the grooves, lenses with various focal lengths can be manufactured.

Next, the synchronous circuit shown in Figure 3! IA, 1. lB, 12A.

12B, drive circuit 10A, IOB, 13A, . . . , 13B will be described with reference to FIG.

The synchronous circuit 11A (B) first receives a synchronous signal 1 with a period (TI).
is generated and sent to the drive circuit 10A(B). Next, the drive circuit 10A(B) generates a drive signal synchronized with the synchronization signal 1 to operate the display screen 2A(B).

As a result, the display screen alternates between a light transmitting state and a light non-transmitting state at a period TI.

Next, assume that the light transmission time of the display screen is T2, and its delay with respect to synchronization signal 1 is T3.

At this time, the synchronization circuit 12A (B) is T for the synchronization signal 1.
A synchronizing signal 2 with a delay of 3 and the same period <Tl is generated. This synchronization signal 2 is sent to the image pickup device 3A (B), and this image pickup device operates in synchronization with the operation of the display screen 2A (B) with a period TI, a delay T3, and an open time T2. the result,
Since the image pickup device always captures images when the display screen is in a transparent state, an image that appears as if the display screen does not exist is obtained. The opening/closing operation of this imaging device can be performed using a mechanical and an electric/electronic shutter.

Next, it is assumed that the time during which the display screen does not transmit light is T6, and its delay with respect to synchronization signal 1 is T5.

At this time, the drive circuit 13A(B) is T
A drive signal 2 with a delay of 5 and the same period <TI is generated. This drive signal 2 is sent to the projection shutter 9A (B), and the projection shutter operates in synchronization with the operation of the display screen 2A (B) with a period Tl, a delay T5, and an opening time T6. As a result, the projection shutter blocks the projection light when the display screen is transparent, so that the viewer cannot see the direct light from the projector.

However, if the projector can be installed in a position where the direct light from the projector does not enter the observer's eyes, the above-mentioned projection shutter and its drive circuit are unnecessary.

Here, a case has been described in which the synchronization circuit generates a periodic signal with a period T1, but the synchronization signal does not necessarily have to be periodic. However, if the synchronization signal is made periodic, its period T1
If it is set as one field time of the video standard or a time that is an integral multiple of one field time, there is an advantage that by using a counter circuit etc., it is possible to use video equipment that conforms to standards such as NTSC and PAL. be.

Also, the configuration and arrangement of the synchronization circuit and drive circuit are not limited to this example; in short, as long as the necessary circuits are added so that input to the image pickup device can be made when the display screen is in a light-transmitting state. good.

To explain a specific example of each part constituting the above-mentioned line-of-sight-scattered image display device, the projector IA (B) includes a liquid crystal projector (manufactured by Sharp, product name [LCD Vision XV-1]).
00ZJ), the display screen 2A (B) is an approximately 40-inch glass screen with a liquid crystal sheet sandwiched between glass (manufactured by Nippon Sheet Glass, product name "instant dimming glass"), and the Fresnel lens 5A (B) is sized is about 40 inches and focal length 4
00mm acrylic lens, imager 3A (B) is a television camera with electronic shutter (manufactured by Sony, product name [
XC-711J), synchronous circuit 11A (B), 12A (
B) is a synchronization signal generator (manufactured by Yamashita Electronics, product name rsG-
3000BJ), a pulse generator (manufactured by Huuret Paracard, product name r8112AJ) is used for the delay circuit, and a function generator (manufactured by Huuret Paracard, product name "8112AJ") is used for the drive circuits 10A (B) and 13A (B) (manufactured by Huuret Paracard, product name "8112AJ").
116A'') and an amplifier (made by NF circuit.

A line-of-sight-scatter image display device having the configuration shown in FIG. 3 was manufactured using two sets of each product (trade name: "High-speed Power Amplifier 4010").

The Fresnel lens and display screen were stacked and fixed.

The imaging and projection frequencies of the image and the switching frequency between transparent and opaque states of the display screen were set at a ratio of 60.

Regarding the drive signal for the display screen, the applied voltage is usually set to Ov to keep the display screen 2A (B) in an opaque state, and the voltage is adjusted by ±1 for a period of 1 to 5 milliseconds with a 60 ratio period.
A bipolar pulse voltage of 00 V and a frequency of 1 kHz was applied to instantaneously form a transparent state.

Next, the delay between the synchronization signal of the drive signal and the synchronization signal of the television camera was adjusted so that the electronic shutter of the television camera was opened only for the time when the display screen 2A (B) became most transparent after the pulse signal was applied. .

As a result, no matter where the other party is facing the other party's display screen and looking at the displayed image, the front image of the other party will be reflected on your own display screen, and the other party will be able to face you with their line of sight aligned. The result was an extremely natural sense of realism.

FIG. 5 shows another embodiment of the invention according to claim (1) of the present invention (here, only the main components of one of the image pickup and display devices are shown). Unlike in FIG. 3, the projector IA is arranged so that the observer 4A
The operation and effect of the device is exactly the same as in FIG. 3, except that the image is viewed reflected on the display screen 2A.

Next, embodiments of the invention according to claim (2) of the present invention will be described.

Using the line-of-sight/scatter image display device shown in FIG. 3 as a basic unit, a large line-of-sight/scatter image display device was constructed by arranging four units in total, two in each direction.

FIG. 6 is a diagram for explaining the relationship between the projection area (indicated by broken lines) and the imaging area (indicated by solid lines) with respect to the display screen 2 in each unit. The positions of the projector 1 and the image pickup device 3 are adjusted so that the projection area and the imaging area are both of the same size on the display screen surface, and if necessary, adjustments are made using a zoom lens or the like.

FIG. 7 shows a front view of the four units, and for simplicity, only the schematic arrangement of the screen 2, projector 1, and image pickup device 3 is shown in the drawing. The broken lines in the figure indicate the joints of each unit. If a support frame for the screen and Fresnel lens is provided for each unit, a non-display portion approximately twice the width of the frame will appear.

In order to avoid this, it is necessary to use one display screen and one Fresnel lens, and use a display screen and Fresnel lens with four times the area. However, the Fresnel lens does not consist of a single lens as a whole, but requires the number of lenses to be formed as many as the number of units.

Adjust the synchronization signal, drive signal 9, etc. of the four units,
The light transmission operations of the display screens of the four units and the imaging operations of the image pickup devices were made to be approximately equal. In addition, two line-of-sight-scattered image display devices consisting of the four units mentioned above are installed.
It was constructed using a combination.

(Effects of the Invention) As explained above, the invention according to claim (1) of the present invention is to rapidly switch between light transmission and non-transmission of the display screen in synchronization with the image pickup device, and to be able to move close to the display screen. Since the imaging field of view is bent using a Fresnel lens that is about the same size as the screen, it is possible to align the line of sight with the other person while displaying a large screen image, which has the advantage of providing an extremely high sense of realism. .

Furthermore, the invention according to claim (2) of the present invention provides an arbitrary system having a line-of-sight diversion function by arranging a plurality of imaging display devices whose imaging areas and projection areas are adjusted to the size of the display screen. It is possible to form a large-screen imaging display device,
Its usefulness is extremely high.

[Brief explanation of drawings]

1 and 2 are claims (1) and (2) of the present invention, respectively.
) Diagram explaining the basic operating principle of the invention described in Figure 3.
The figure is a diagram showing an example of the configuration of a line-of-sight scattering image display device implementing the invention according to claim (1) of the present invention, FIG. 4 is a diagram showing the operation timing of each part in FIG. 3, and FIG. FIG. 6 and FIG. 7 are diagrams showing an example of the construction of another embodiment different from FIG. 3, and FIGS. The figure shows an example of the configuration of a conventional line-of-sight-scattered image display device, FIG. 9 is a diagram showing the viewing area of the viewer according to FIG. 8, and FIG. FIG. 3 is a diagram illustrating a viewing area when a large screen display is realized. 1, IA, IB...projector, 2, 2A. 2B...display screen, 3.3A. 3B...imaging device, 4.4A, 4B...observer,
5.5A, 5B...Fresnel lens, 1OA. 11A. 20A. box. 9A, 9B...Projection shutter

Claims (2)

[Claims] (1) A projector that projects and displays an image, a Fresnel lens used as an imaging lens, a display screen that is alternately controlled to be in a light transmitting state and a light non-transmitting state by electric signals, and a display screen that is sandwiched between Using an image pickup device located at a position facing an observer who observes the image, the display screen is alternately switched between a light transmission state and a light non-transmission state, and input to the image pickup device is input when the display screen is in the light transmission state. What is claimed is: 1. A line-of-sight matching imaging display device. (2) A projector that projects and displays images, a Fresnel lens used as an imaging lens, a display screen that is alternately controlled to be in a light transmitting state and a light non-transmitting state by electrical signals, and a display screen that is placed between the display screens. One unit is composed of an imaging display device consisting of an image pickup device installed at a position facing an observer who observes an image, and multiple units are arranged vertically or horizontally, or in both vertical and horizontal directions, and each unit is displayed. The screen is alternately switched between a light transmitting state and a light non-transmitting state, and when the display screen is in a light transmitting state, the field of view of the image pickup device is set to the size of the display screen, and input to the image pickup device is performed, and projection is performed. What is claimed is: 1. A line-of-sight matching imaging and display device, characterized in that when the display screen is in a non-light-transmitting state, the projected image is set and projected to the size of the display screen.