KR20120096795A - Integral imaging type stereoscopic display device and method for displaying image - Google Patents

Abstract

PURPOSE: An integrated image type three-dimensional display device and a method thereof are provided to change a narrow viewing angle into a wide viewing angle by varying a lens area location of a lens array. CONSTITUTION: A pickup unit generates the total three-dimensional image of a display target object. A lens array(200) is located between a display panel(100) and a viewer. A tracking unit(300) tracks a location of a viewer. A control unit(500) controls a lens location of the lens array and an element image projected to the display panel according to a location of the viewer.

Description

Integrated Imaging Stereoscopic Display Device and Image Display Method {Integral Imaging Type Stereoscopic Display Device and Method for Displaying Image}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic display device, and more particularly, to an integrated image type stereoscopic display device capable of providing a parallax image suitable for a viewer's movement by tracking a viewer's position and capable of wide viewing angle display, and an image display method thereof.

The services to be realized for the high speed of information to be built on the high-speed information communication network today are 'seeing and listening' multi-media centering on digital terminals that process text, voice, and video at high speed from simply 'listening and talking' service like the current telephone. It is expected to develop into a media type service and ultimately become a hyper-space realistic 3D stereoscopic information communication service that transcends time and space.

In general, the three-dimensional image representing the three-dimensional image is made by the principle of stereo vision through two eyes, because the parallax of two eyes, that is, the two eyes are about 65mm apart, the left and right side due to the difference between the positions of the two eyes The eyes see slightly different images. As such, the difference in the image due to the positional difference between the two eyes is called binocular disparity. The 3D stereoscopic display device uses the binocular parallax to allow the left eye to see only the image of the left eye and the right eye to see only the right eye image.

In other words, the left and right eyes see different two-dimensional images, and when these two images are delivered to the brain through the retina, the brain accurately fuses them to reproduce the depth and reality of the original three-dimensional image. Such a capability is commonly referred to as stereography, and a device in which it is applied as a display device is called a stereoscopic display device.

However, when viewing a stereoscopic image using binocular disparity, dizziness and eye fatigue are generated due to disparity of two images and inconsistency of the focus function of the eyes. Therefore, in recent years, a lot of researches are applied to apply an integrated imaging method that can solve the problem of stereography.

The integrated imaging method was first proposed by Lippmann in 1908. The integrated image method recognizes images by integrating them into a hologram-like image, and uses a lens array composed of a plurality of single lenses without using glasses to produce a three-dimensional image having a specific depth from a two-dimensional whole element image in a constant volume. Express in That is, the viewer can feel as if he or she sees a real three-dimensional object while viewing a three-dimensional image formed in a certain volume.

Hereinafter, a general integrated image type stereoscopic display device will be described with reference to the accompanying drawings.

1A and 1B are cross-sectional views illustrating a pickup unit of a general integrated image type stereoscopic display device and a cross sectional view of a display unit of a general integrated image type stereoscopic display device, respectively. 2 is a view illustrating a viewing angle of a general integrated image type stereoscopic display device.

As shown in FIGS. 1A and 1B, a general integrated image type stereoscopic display device includes a pickup unit and a display unit. As shown in FIG. 1A, the pickup unit converts three-dimensional information of the three-dimensional object 20 into an entire element image by using the imaging device 11 such as the first lens array 10 and the camera and stores the image in the imaging device 11. . 1B, the display unit includes the display panel 42 and the second lens array 41 to show the entire element image displayed on the display panel 42 again in the form of a stereoscopic image 50.

The integrated imaging method as described above does not require glasses or other tools to watch a stereoscopic image, and does not cause eye fatigue when the viewer views the stereoscopic image and enables continuous image reproduction.

On the other hand, the integrated image type stereoscopic display device does not display on the display panel that the stereoscopic image to be reproduced is located outside the area of the single lens in order to eliminate the phenomenon of seeing several at the same time.

In detail, the integrated image type stereoscopic display device has a maximum left and right viewing angle of about 30 °, and cannot see an image at all when it is outside the viewable viewing angle (hatched display area). In addition, when the entire element image displayed on the display panel 42 is integrated through the second lens array 41 and reproduced as a stereoscopic image, as shown in FIG. 2, the viewing angle for viewing a realistic stereoscopic image is very small. In addition, there is a problem that the viewing angle becomes smaller as the viewer watches a stereoscopic image at a close range.

The general integrated image type stereoscopic display device as described above has the following problems.

Since the viewing angle is small, about 30 ° to the left and right, the viewable viewing angle range is narrow, and the image disappears completely even if the viewer moves a little. This is due to the structure of the lens array used when the element image is reproduced, the viewing angle may increase as the lens width is widened, but the disadvantage is that the depth of the stereoscopic image is reduced in inverse proportion to the increase in the viewing angle.

Therefore, simply widening the lens is not a fundamental solution.

The present invention has been made to solve the above problems to provide a parallax image in accordance with the movement of the viewer by tracking the position of the viewer, and to provide an integrated image type stereoscopic display apparatus capable of displaying a wide viewing angle and an image display method thereof There is a purpose.

An integrated image type stereoscopic display device according to the present invention for achieving the above object includes a pickup unit for generating a stereoscopic whole element image of an object to be displayed; and a display panel; and a lens located between the display panel and the viewer. An array; a tracking unit for tracking a viewer position; and a controller for adjusting an element image projected on the display panel and a lens position of the lens array according to the viewer position.

The entire element image generated by the pickup unit includes a center element image and element images of upper, lower, left, and right sides of the object.

The lens array functions as a transparent cell when voltage is off and as a lens when voltage is applied.

The lens array may include: first and second substrates facing each other; a plurality of first electrodes formed on the first substrate; a second electrode formed on the entire surface of the second substrate; and unit lens regions. A first voltage applying unit configured to apply different voltages to the first electrodes; And a liquid crystal layer between the first and second substrates.

The unit lens area is changed according to the application of a lens position control signal from the controller.

The pickup unit receives an element image control signal from the controller and controls an element image projected on the display panel.

The tracking unit may recognize the viewer's iris or the tracking unit may recognize the movement of the viewer's face.

The pickup unit includes a photographing apparatus and a lens group on a matrix positioned between the object to be displayed and the photographing apparatus.

The element images are separately generated from the photographing apparatus for each unit lens of the lens group.

In addition, an image display method of an integrated image type stereoscopic display apparatus for achieving the same purpose includes: tracking a viewer position; storing the viewer position in a control unit; and adjusting the lens array according to the viewer position. Matching; And adjusting the element image to be projected onto the display panel through the image processing unit according to the viewer position.

The controller applies the lens array element image control signal based on the viewer position and applies the element image control signal to the pickup unit.

The storing of the viewer position in the controller may further include determining a deviation from the reference viewing angle region.

The integrated image stereoscopic display device and the image display method thereof according to the present invention have the following effects.

First, the narrow viewing angle problem of the integrated imaging method may be changed to the wide viewing angle by varying the position of the lens region of the lens array.

Second, by tracking the viewer's position, an element image suitable for the viewer's position can be generated, and a realistic display image of the position can be visually recognized, thereby improving stereoscopic effect due to parallax variation. That is, it is possible to implement a motion parallax.

1A and a cross-sectional view showing a pickup step of a general integrated image type stereoscopic display device
1B is a cross-sectional view illustrating a display step of a general integrated image type stereoscopic display device.
2 is a view illustrating a viewing angle of a general integrated image type stereoscopic display device.
3A is a diagram illustrating a pickup unit of an integrated image type stereoscopic display device according to the present invention.
3B is a view illustrating a display unit of an integrated image type stereoscopic display device according to the present invention.
4 is a view illustrating an image display according to viewer movement in the integrated image type stereoscopic display device according to the present invention.
5A-5C illustrate element images of left, center, and right images of an object.
6A-6C illustrate left, center, and right images of an object
FIG. 7 is a view illustrating a viewable image of a viewer when the image panel having only the central element image is provided.
8 is a view illustrating a viewer viewable image when tracking a viewer position in an image panel having only a central element image;
FIG. 9 is a view illustrating a position at a time in the integrated image type stereoscopic display device of the present invention. FIG.
FIG. 10 is a view illustrating a time when the image is deviated from the right position to the left in the integrated image type stereoscopic display device according to the present invention. FIG.
11 is a view showing a time when the image deviates from the right position to the right in the integrated image type stereoscopic display device according to the present invention.
12 is a cross-sectional view illustrating a lens array used in an integrated image type stereoscopic display device according to the present invention.
13 is a flowchart illustrating a display method of an integrated image type stereoscopic display device according to the present invention.

Hereinafter, an integrated image display device and an image display method thereof according to the present invention will be described in detail with reference to the accompanying drawings.

3A is a diagram illustrating a pickup unit of an integrated image stereoscopic display device of the present invention, and FIG. 3B is a diagram illustrating a display unit of an integrated image stereoscopic display device of the present invention.

As shown in FIGS. 3A and 3B, the integrated image type stereoscopic display device according to the present invention includes a pickup unit for generating a stereoscopic whole element image array 150 of an object to be displayed, and a display unit 2000 for displaying an actual image. It includes.

Here, the display unit 2000 may be configured according to the display panel 100, the lens array 200 positioned between the display panel 100 and the viewer, the tracking unit 300 tracking the viewer position, and the viewer position. And a controller 500 for adjusting the element image projected on the display panel 100 and the lens position of the lens array.

The display panel 100 may include a liquid crystal display panel (LCD), an organic light emitting display panel (OLED panel), a plasma display panel (PDP), and an electroluminescence. A flat panel display panel using a field emission display panel (FED panel), an electrophoretic display panel, a quantum dot display panel, and the like.

The actual viewer may visually recognize the three-dimensional display image 400 according to the position change of the viewer by the lens array 200 and the pickup unit 150 controlled by the controller 500.

The entire element image generated by the pickup unit 1000 includes a center element image 150b and element images 150a and 150c for each of the left and right sides of the object. Although only the left and right side images 150a and 150c are illustrated in the drawing, in some cases, the top and bottom side images may also be included. However, when the viewer looks at the display panel 100 and moves to the actual position, the case where the viewer moves up and down will be exceptional. The entire element image generated by the pickup unit 1000 is the center element image 150b. Only the left and right side element images 150a and 150c may be limited.

Meanwhile, as illustrated in FIG. 3A, the pickup unit 1000 includes a photographing apparatus 340 and a lens group 330 on a matrix positioned between the object 320 to be displayed and the photographing apparatus 340. do.

All objects 320 present in the natural world have a three-dimensional effect, and the objects 320 are shown in different shapes according to the viewing position. Here, the lens group 330 is divided into units for looking at the object 320 of the lens group 330 and divided into unit lenses, and the photographing apparatus 340 has different elements according to directions for looking at the object 320 for each unit lens. Create an image.

When the pickup unit 1000 is configured as shown in FIG. 3A, it means that the object 320 is reproduced through the display unit 2000 as it is. In some cases, the pickup unit 1000 may alternatively be replaced with one image source. That is, it may be changed to a computer program or system including a stereoscopic element image array 150 of an image to be displayed on the display unit.

For example, computer program generation integrated imaging technology is a method of generating stereoscopic images by generating single element images of a 3D object using a computer algorithm and transmitting the generated single element images to a display panel.

Meanwhile, the tracking unit 300 may recognize the viewer's iris or the tracking unit may recognize the movement of the viewer's face.

The tracking unit 300 may be implemented by mounting a device capable of receiving a specific wireless signal by the viewer, and may be integrated with the display panel 100 to follow the viewer's iris movement or face movement. It may also be provided with.

4 is a view illustrating an image display according to viewer movement in the integrated image type stereoscopic display device according to the present invention.

As shown in FIG. 4, the viewer may be positioned at position 2, move to the left position 1, or move to the right position 3.

In the integrated image type stereoscopic display device according to the present invention, a shift of the unit lens area of the lens array 200 is applied even when the viewer moves by driving the tracking unit 300 and the control unit 500 according to the viewer position information. The display image 400 can be visually recognized, and the element image can be selectively displayed on the display panel 100 by switching the element images 150a, 150b, and 150c according to a specific position. The converted display images 410a, 410b, and 410c may be recognized.

In this case, the controller 500 transmits the element image control signal to the pickup unit according to the viewer position information so that the element image selected by the display panel 100 can be projected, and the lens array 200 is a lens. The position control signal is applied to match the lens position with the position at which the viewer moves.

5A to 5C illustrate element images of left, center, and right images of an object, and FIGS. 6A to 6C illustrate left, center, and right images of an object.

FIG. 5A is an element image representing a left image of an object, FIG. 5B is an element image representing a center image of an object, and FIG. 5C is an element image representing a right image of an object. Each of these element images is one of the element images generated by the pickup unit. As shown in FIG. 5B, when there are rectangular and circular objects spaced apart from each other, when viewed from the left, they overlap, and when viewed from the right, considering a kind of parallax in which the rectangular and circular objects are more spaced apart from each other. The element images are shown.

6A to 6C show an image actually viewed by a viewer when the element image of FIGS. 5A to 5C is viewed through the display panel 100 and the lens array 200, respectively. In the drawing, the left and right inverted images are shown, and the element image and the display image may be inverted from each other, and in some cases, may not be inverted, but may appear as normal images. The image conversion of the region can be adjusted by the distance between the lens array and the display panel or the distance between the pickup and the display panel.

For example, a case where the element image projected from the display panel is limited to the center image is different from that of the integrated image type stereoscopic display device of the present invention.

FIG. 7 is a diagram illustrating a viewable image of a viewer when the image panel having only the central element image is provided.

As shown in FIG. 7, only the central element image is transmitted through the display panel 60, and if the lens array 70 is also fixed, the viewable viewing angle is fixed, so that the display image is fixed only to the center image. Therefore, if the viewer is slightly out of position 2, the viewer cannot see the image.

FIG. 8 is a view illustrating a viewer viewable image when tracking a viewer position in an image panel having only a central element image.

As shown in FIG. 8, when there is only a center element image in the display panel 60, viewer position tracking is possible, and even though the lens array 75 may be repositioned, the same center image is recognized at the changed viewer position. For example, a wide viewing angle can be realized, but viewers cannot perceive the three-dimensional change of an object.

On the contrary, as shown in FIGS. 3A to 4, the integrated image type stereoscopic display device of the present invention can realize a wide viewing angle by changing content of an element image according to motion parallax so that a viewer can observe the side of an object. At the same time, the stereoscopic sense of the object can be recognized, and the realism of the stereoscopic image can be enhanced.

Hereinafter, driving of viewers by location of the integrated stereoscopic display device according to the present invention will be described.

FIG. 9 is a view showing a position of the right position in the integrated image type stereoscopic display device according to the present invention. FIG.

In the correct position, as shown in FIG. 9, the reference lens region of the display panel 100 and the lens region of the lens array 200a coincide with each other. In addition, the center element image corresponding to the correct position is transmitted from the pickup unit to the display panel 100, and the center element image is transmitted through the lens array 200a, thereby allowing the viewer to have a three-dimensional center within the normal viewable viewing angle range. The display image 410b may be visually recognized.

FIG. 10 is a diagram illustrating a case where the integrated image type stereoscopic display device of the present invention deviates from a fixed position to the left.

As shown in FIG. 10, after the tracking unit 300 detects that the viewer is shifted to the left by 'a' from the reference lens area of the display panel 100, the lens position control signal and The lens shifted by the lens array 200b 'a' is implemented in response to the element image control signal, and the element image is also selected as the element image shifted to the left, so that the viewer can recognize the image of the left image 410a. Will be.

FIG. 11 is a view showing a time when the image is deviated from the right position to the right in the integrated image type stereoscopic display device according to the present invention.

As illustrated in FIG. 11, after the tracking unit 300 detects that the viewer is shifted to the right by 'b' from the reference lens area of the display panel 100, the lens position control signal and The lens shifted by the lens array 200c 'b' is implemented by receiving the element image control signal, and the element image is also selected as the element image shifted to the left, so that the viewer can recognize the image of the left image 410c. Will be.

12 is a cross-sectional view illustrating a lens array used in an integrated image type stereoscopic display device according to the present invention.

The lens array of the present invention functions as a transparent cell when voltage is turned off and as a kind of liquid crystal field lens when voltage is applied. As shown in FIG. 12, the first and second substrates 210 and 220 facing each other and the first and second substrates face each other. A plurality of first electrodes 211a and 211b formed on a first substrate 210, a second electrode 221 formed on the front surface of the second substrate 220, and a unit lens area are formed on the first electrodes. A first voltage applying unit (not shown) for applying different voltages and a liquid crystal layer 250 between the first and second substrates are included.

9 to 11, the position of the unit lens area may be shifted according to the application of the lens position control signal from the control unit 500 of FIG. 3B. In this case, when the voltages applied by the first voltage applying unit are V1,..., Vn, the voltages are applied in accordance with the shifted unit lens regions L. FIG. That is, if the unit lens region starts at the position of the m-th electrode located at the m position, the voltage of V2, ..., Vm is applied to the adjacent first electrodes in order to apply V1 to the m-th first electrode. Is to apply. That is, in this case, there is a voltage application shift by the mth.

Here, the first electrode 211 and the second electrode 221 is made of a transparent electrode. In addition, as illustrated, the first electrode 211 may be formed in different layers through the insulating layer 212. Alternatively, the first electrode 211 may be formed together on a single layer (substrate or insulating layer). In this case, when the viewer is in the correct position, the edge of the unit lens area L may correspond to the edge E of the reference lens area of the display panel 100.

Meanwhile, the lens array described above may be implemented on a Fresnel lens in addition to the parabolic lens shown.

In addition, the integrated image type stereoscopic display device including the lens array described above may use a real mode, a virtual mode, a focused mode, or the like.

For example, a gap between the lens array 200 and the display panel 100 is formed on the liquid crystal layer 250 in the lens array 200 (the actual lens is not formed, but an optical path difference occurs due to voltage application. When the focal length of the lens is greater than the focal length of the lens), the distance between the display image 400 is positive and the display image 400 is actually formed on the front surface of the lens array 200. This is called a real mode, and the display image 400 is positioned between the lens array 200 and the viewer to view the display image 400 having a better depth.

On the contrary, when the distance between the lens array 200 and the display panel 100 is smaller than the focal length of the lens formed on the liquid crystal layer 250, the distance between the display image 400 is negative and the display image 400 is negative. It forms a virtual image on the back of the lens array 200. This is called a virtual mode, and the display image 400 is represented behind the lens array 200.

The focal length between the lens array 200 and the display panel 100 is the same as the focal length of the lens formed on the liquid crystal layer 250, which is referred to as a focused mode, which is the front and rear of the lens array 200. At the same time, the display image 400 is represented.

13 is a flowchart illustrating a display method of an integrated image type stereoscopic display device according to the present invention.

As shown in FIG. 13, the display method of the integrated image type stereoscopic display device according to the present invention is performed in the following order. The display method described below is performed in the above-described integrated image type stereoscopic display device of the present invention, and the description by the same configuration is omitted.

The viewer position is tracked by a tracking method such as eye tracking or head tracking (10S).

Subsequently, the viewer position is received and stored in the controller (11S).

It is determined whether the viewer is outside the designated viewing angle area (12S).

In this step, when out of the designated viewing angle region, the lens array is mapped according to the viewer position. At this time, the degree of deviation from the reference viewing angle region is determined, and reflected (13S) to change the voltage value applied to the first electrodes of the lens array, thereby shifting the unit lens region implemented in the lens array (14S). ).

In this case, the controller applies the lens array element image control signal based on the viewer position and applies the element image control signal to the pickup unit.

If the viewer is not out of the designated viewing angle area, the values of the control signals applied to the lens array and the pickup unit from the control unit are kept unchanged, and the viewer position is tracked again.

Subsequently, the element image to be projected onto the display panel is adjusted through the image processing unit 15S according to the viewer position.

Such a display method can change the narrow viewing angle problem limited to a level of about 30 ° of the integrated imaging method to the wide viewing angle by varying the position of the lens region of the lens array.

In addition, when the position of the lens region is changed, it is based on the tracked viewer position information, and an element image suitable for the position of the viewer can be generated to visualize a realistic display image of the corresponding position, and thus a three-dimensional effect due to a parallax change. Can improve. That is, it is possible to implement a motion parallax.

On the other hand, the present invention described above is not limited to the above-described embodiment and the accompanying drawings, it is possible that various substitutions, modifications and changes within the scope without departing from the technical spirit of the present invention. It will be apparent to those of ordinary skill in Esau.

100: display panel 150: element image array
200: lens array 300: tracking unit
400: display image 500: control unit
1000: pickup portion 2000: display portion

Claims (13)

Pick-up unit for generating a three-dimensional full element image of the object to be displayed;
Display panel;
A lens array positioned between the display panel and the viewer;
Tracking unit for tracking the viewer position; And
And a controller configured to adjust the element image projected on the display panel and the lens position of the lens array according to the viewer position. The method of claim 1,
The entire element image generated by the pickup unit includes a central element image and element images of upper, lower, left, and right sides of the object. The method of claim 1,
And the lens array functions as a transparent cell when voltage is off and as a lens when voltage is applied. The method of claim 3, wherein
The lens array
First and second substrates facing each other;
A plurality of first electrodes formed on the first substrate;
A second electrode formed on the entire surface of the second substrate;
A first voltage applying unit configured to apply different voltages to the first electrodes for each unit lens region; And
And a liquid crystal layer between the first and second substrates. The method of claim 4, wherein
And the unit lens area is changed according to the application of a lens position control signal from the controller. The method of claim 1,
And the pickup unit receives an element image control signal from the controller and controls an element image projected on the display panel. The method of claim 1,
And the tracking unit recognizes the viewer's iris. The method of claim 1,
And the tracking unit recognizes the movement of the viewer's face. The method of claim 1,
And the pickup unit comprises a photographing apparatus and a group of lenses on a matrix positioned between the object to be displayed and the photographing apparatus. The method of claim 9,
And an element image is separately generated from the photographing apparatus for each unit lens of the lens group. An image display method of an integrated image type stereoscopic display device according to any one of claims 1 to 10,
Tracking the viewer location;
Storing the viewer location in a control unit;
Mapping the lens array according to the viewer position; And
And adjusting the element image to be projected onto the display panel through image processing in the pickup unit according to the viewer's position. 12. The method of claim 11,
And the control unit applies the lens array element image control signal based on the viewer position and applies the element image control signal to the pickup unit. 12. The method of claim 11,
The storing of the viewer position in the controller, the method comprising the step of determining the deviation from the reference viewing angle region further comprising the image display method of the stereoscopic display device.

Images