KR101337790B1 - Depth-fused three dimensional display method and apparatus using multi layer - Google Patents

Abstract

The present invention relates to a three-dimensional image display method and apparatus of the DFD method, to obtain two-dimensional image information and depth information about a subject, to display a two-dimensional image using the two-dimensional image information, the displayed two-dimensional image Is selectively reflected according to the depth information, divided into a plurality of images having different depths, a plurality of display panels corresponding to each of the divided images are arranged in a line, and a time point at which each divided image is projected And the time point at which each display panel corresponding to each divided image is operated, thereby projecting each divided image onto the corresponding display panel. The 3D display device and method according to the present invention can display a high quality 3D image and can also display a 3D image in real time by increasing the processing speed of the image.

Description

Multi-Depth Fused 3D Image Display Method and Apparatus {DEPTH-FUSED THREE DIMENSIONAL DISPLAY METHOD AND APPARATUS USING MULTI LAYER}

The present invention relates to an apparatus and method for displaying a three-dimensional image, and more particularly, to an apparatus and method for displaying a stereoscopic image in a depth-fused three-dimensional (DFD) method.

With the development of display technology, various technologies for realizing three-dimensional stereoscopic images have been developed. Methods for displaying a 3D image include a stereoscopic method using binocular parallax, a holographic type, a volumetric method, and the like.

Recently, as a new display method for 3D image display, a depth-fused 3D display (DFD) method, which is a kind of volumetric type, has been studied. The DFD method displays a plurality of two-dimensional images superimposed on a plurality of screens, and displays a three-dimensional image in a depth direction by changing the luminance of each screen or changing the transmittance. The following patent documents 1-3 are mentioned as an example of the 3D display method or apparatus which used such a DFD system.

In order to implement a three-dimensional display device of the DFD method, conventionally, two displays are synthesized through a half mirror or two displays are overlapped, but recently, they are replaced by a polarization modulator and a selective polarizing film. A configuration of a 3D display device using the conventional DFD method is schematically illustrated in FIG. 1.

As shown in FIG. 1, the DFD type 3D display device includes a general camera 110 and a depth camera 120 for photographing a subject, an image projector 130 for displaying an image, a polarization modulator 140, and a plurality of selective polarizations. It consists of films 150, 151,...

The general camera 110 generates a 2D image from the subject and transmits the 2D image to the image projector 130, and the depth camera 120 generates depth information from the subject and transmits the depth information to the polarization modulator 140. The image projector 130 projects the 2D image received from the general camera 110 to the polarization modulator 140.

The polarization modulator 140 is disposed in front of the image projector 130 to receive depth information on a subject to generate a depth map, and convert the generated depth map into a polarization distribution. That is, after obtaining polarization values corresponding to one-to-one correspondence to depth information about the subject, the distributions of the polarization values are combined with the two-dimensional image projected from the image projector 130. Accordingly, the two-dimensional image combined with the polarization values according to the depth information is projected onto the plurality of polarizing films 150, 151,...

The plurality of polarizing films 150, 151,... Are arranged to have polarization axes in different directions, respectively, so that a two-dimensional image in which polarization distributions are combined is formed on a polarizing film having a depth, and displayed as a three-dimensional image. Can be.

The conventional DFD three-dimensional display device as described above has the advantage that the three-dimensional image of the image is increased as the number of the plurality of polarizing film (150, 151, ... ...), but the transmittance decreases accordingly The number of polarizing films 150, 151, ... is inevitably limited.

On the other hand, as a DFD display device having a different method from the above, there is a method in which a two-dimensional image corresponding to each depth is sequentially incident on a multilayer panel from one image projector.

In this manner, two-dimensional image information and depth information about the subject are obtained, and the two-dimensional image is converted into a plurality of basic images according to the depth information. The plurality of basic images are sequentially projected on the respective multilayer panels according to the depth information by the image projector, and the three-dimensional images are imaged on planes having different center depths through the projected basic images to display stereoscopic images.

In this case, a DLP (Digital Light Processing) type projector may be used as the image projector, and as a multilayer panel which is driven by a driving voltage to transmit or scatter light, a liquid crystal display (LCD) or a polymer liquid crystal dispersion film (PDLC) may be used. : Polymer Dispersed Liquid Crystal) can be used.

In the DFD type 3D display device as described above, before displaying the 3D image, the base image to be displayed on each display panel should be divided using a computer or the like. In other words, the image must be divided through a preprocessing process and then projected onto a DLP.

In order to generate high quality 3D images, the number of multilayer panels must be large, thereby increasing the number of the base images. This is not only an increase in processing time but also a limiting factor in the presentation time of an image. In addition, the overall driving speed is lowered, making it difficult to process a 3D image in real time.

As described above, the conventional DFD three-dimensional display device has many problems in reproducing an image showing high-quality high stereoscopic feeling.

Patent Document 1: Japanese Patent No. 3022558 Patent Document 2: Korea Patent Registration No. 10-1093929 Patent Document 3: Korea Patent Registration No. 10-0815505

The present invention is to solve the above problems, in the three-dimensional image display method and apparatus using the DFD method, it is possible to display a high-quality three-dimensional image, and to increase the processing speed of the image three-dimensional image in real time Its purpose is to be able to display.

In order to achieve the above object, the three-dimensional image display method according to the present invention, obtaining the two-dimensional image information and depth information about the subject, displaying the two-dimensional image using the two-dimensional image information, the displayed Selectively reflecting a 2D image according to the depth information, dividing the 2D image into a plurality of images having different depths, arranging a plurality of display panels corresponding to each of the divided images, and arranging the divided images Synchronizing the projected time point with the time point at which each display panel corresponding to each divided image is operated, and projecting each divided image onto the corresponding respective display panel.

In addition, in order to achieve the above object, the three-dimensional image display apparatus according to the present invention, the two-dimensional image projection unit for receiving the two-dimensional image information about the subject to project and display the two-dimensional image, the depth to the subject An image divider which receives information, selectively reflects the projected 2D image according to the depth information, and divides the projected 2D image into a plurality of images having different depths; and a plurality of images arranged in a line corresponding to each of the divided images And a multi-layer display panel unit in which each divided image is projected onto each corresponding display panel, and a time point at which each divided image is projected and each display panel corresponding to each divided image And a display panel driver for synchronizing the operation time points and driving the respective display panels.

Preferably, the image segmentation unit is a digital micro mirror device (DMD), and the plurality of display panels is a polymer liquid crystal dispersion film (PDLC).

3D image display method and apparatus according to the present invention has the following advantageous effects.

Since the DMD element is responsible for the division according to the depth of the 2D image, the 3D image display can be performed at high speed. As a result, the volume of the display panel may be increased to further improve the volume, and the 3D image may be displayed in real time.

In addition, since no additional conversion processing is required for the 2D image, the 3D image display can be performed without deteriorating the image quality of the image. That is, since the two-dimensional image is rapidly divided into images according to depth without special preprocessing, the three-dimensional image can be generated while maintaining the image quality of the two-dimensional image.

As such, by dividing the 2D image using a DMD device having a high driving speed, a high quality 3D image may be realized in real time.

Next, since the system can be configured using a commercially available general device such as a 2D image projection device, a DMD device, and a PDLC, there is an advantage in that manufacturing is easy and cost is low.

The three-dimensional display method and apparatus according to the present invention exhibiting the advantageous effects as described above may be usefully used in medical and medical devices, industrial design, communication, and computer graphics fields that require precise three-dimensional images.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram schematically showing a configuration of a conventional DFD three-dimensional image display device.
2 is a view for explaining a three-dimensional image display method of the DFD method according to an embodiment of the present invention.
3 is a view illustrating a process of projecting an image from a DMD splitter to a multi-layer display panel in a DFD type 3D image display method according to an embodiment of the present invention.
4 is a diagram schematically illustrating a configuration of a 3D image display device of a DFD method according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

2 and 3 are conceptual views illustrating a three-dimensional image display method of the DFD method according to an embodiment of the present invention.

As shown in FIG. 2, the DFD three-dimensional display method of the present invention first obtains two-dimensional image information and depth information of a subject 201 to be reproduced. Such information may be obtained by directly photographing using a camera 202 or the like, or may be synthesized by a computer.

Next, a 2D image 211 including color and brightness is generated and displayed from the 2D information by using the 2D image projection apparatus 210 or the like. The 2D image projection apparatus 210 may use a projector or the like that can project an image.

The displayed two-dimensional image is incident on an optical device such as a digital micromirror device (DMD) 220. The DMD is a device in which millions of digitally controlled micromirrors 221 are integrated, and the light incident on the DMD is controlled and reflected according to the inclination of the micromirror 221.

The 2D image incident on the DMD 220 is selectively reflected according to the depth information, and divided into a plurality of images having different depths. In this case, the selective reflection according to the depth information may be performed by controlling the micromirror 221 of the DMD 220. In general, DMD is mainly used for projecting images at high speed by using a micro mirror array as a core chip, but in the present invention, 2D image projection apparatus 210 is responsible for projecting an image, and DMD selectively selects an image. It reflects and divides.

A plurality of display panels 230 are arranged in line with each of the divided images having different depths, and the divided images are projected onto the corresponding display panels 230, respectively. In this case, a time point at which each of the divided images is reflected from the DMD 220 and a time point at which each of the display panels 230 corresponding to each of the divided images operate are synchronized with each other, so that each of the divided images is displayed. The display panel 230 sequentially displays the display panel 230 according to the depth information.

The display panel 230 may use a flat panel display device such as an LCD. In particular, since the polymer dispersed liquid crystal (PDLC) does not require a polarizing plate by the principle of using scattering and transmission of light, it is highly preferable as the display panel 230 because of its high light utilization efficiency.

In FIG. 3, the process of dividing the 2D image by the micromirrors of the DMD and reflecting them on each display panel is described in more detail.

As shown in FIG. 3, only the image having the frontmost depth information of the cylinder, which is the subject, is displayed on the display panel 231 disposed in front of the viewer, and the display panel 232 disposed in the middle of the observer. Only an image having depth information of the middle of the cylinder is displayed, and only an image having depth information of the rear of the cylinder is displayed on the rearmost display panel 233. This selective reflection is implemented by controlling the reflection direction of the micromirror as in FIG.

At this time, the control speed of the micromirror 221 and the driving speed of the display panel 230 are synchronized, and the speed is preferably within about 20 Hz, which is a limit speed for recognizing the human eye blinking. As such, by controlling the micromirrors of the DMD 220, the 2D image may be divided and reflected according to the depth.

The divided images projected onto each display panel 230 are fused by the human eye and recognized as a 3D image.

Hereinafter, an apparatus for implementing a DFD type 3D image display method according to an embodiment of the present invention will be described. 4 is a block diagram of a three-dimensional image display device of the DFD method according to an embodiment of the present invention.

As shown in FIG. 4, the DFD type 3D display device of the present invention includes a 2D image projector 310, an image divider 320, a multilayer display panel 330, and a display panel driver 340. .

The 2D image projector 310 receives 2D image information about a subject obtained from the general camera 110 and enters the image divider 320.

The image dividing unit 320 selectively reflects the 2D image received from the image projector 310 according to the depth information of the subject obtained from the depth camera 120 and projects the multi-dimensional display panel unit 330. As the image divider 320, a DMD element may be used.

That is, the image dividing unit 320 selectively reflects the input two-dimensional image according to the depth information, thereby dividing the two-dimensional image into a plurality of images having different depth information, and sequentially multi-layer display panel unit ( 330). The multilayer display panel unit 330 is formed by arranging a plurality of display panels 331, 332,..., At predetermined intervals, and the display panel preferably uses PDLC.

Each display panel 331, 332,... Of the multilayer display panel unit 330 corresponds to a divided image having different depths reflected from the image splitter 320. That is, the respective display panels correspond to the depths of the two-dimensional images so that the two-dimensional images having the same depth are displayed only on the display panels corresponding thereto. To this end, the display panel driver 340 drives the display panels in synchronization with the timing at which the images are projected onto the display panels from the image splitter 320 according to the depth information of the images. At this time, the driving speed is preferably 60 Hz or less.

If the above-described process is repeated and the divided images are sequentially projected on the panels 331, 332,... Of the multilayer display panel unit 330 according to the depth information of the 2D image, they have different depths. Images are combined on each display panel to be fused and recognized by the human eye, thereby recognizing three-dimensional images. That is, although images are sequentially formed on each display panel, since the display panels are driven at a sufficiently high speed that the human eye cannot distinguish them, the images are fused and recognized in three dimensions.

As described above, in the DFD-type three-dimensional image display method and apparatus according to the present invention, unlike the prior art, the apparatus for processing two-dimensional image information and the apparatus for processing three-dimensional depth information is separated have. That is, in the conventional DLP projector, the DMD projects an image representing color and brightness every time on the display panel according to the depth information. However, in the present invention, the color and brightness of the 2D image are directly displayed by the 2D image projector 310. In addition, the DMD element serves only as an image divider 320 for selectively reflecting and dividing an image.

As described above, the present invention does not require a preprocessing process for dividing the two-dimensional image according to the depth, and is divided in real time by the reflection of the micromirror of the DMD, thereby maintaining the image quality of the original two-dimensional image. 3D images can be displayed at high speed.

In addition, since the driving speed of the multilayer display panel can be increased, more three-dimensional images can be further increased by using more display panels, and three-dimensional video can be displayed three-dimensionally in real time.

While the present invention has been described with reference to the preferred embodiments described above and the accompanying drawings, it is to be understood that the invention may be embodied in different forms without departing from the spirit or scope of the invention. Therefore, the scope of the present invention is defined by the appended claims, and should be construed as not limited to the specific embodiments described herein.

110: normal camera 120: depth camera
130: image projector 140: polarization modulator
150, 151: polarizing film 201: subject
202: camera 210: two-dimensional image projector
211: two-dimensional image 220: DMD
221: micromirror 230: multilayer display panel
310: image projector 320: image divider
330: multilayer display panel unit 331, 332: display panel
340: display panel driver

Claims (6)

Obtaining two-dimensional image information and depth information of the subject;
Displaying a 2D image using the 2D image information;
Selectively reflecting the displayed two-dimensional image according to the depth information by using a digital micromirror device (DMD), and dividing the displayed two-dimensional image into a plurality of images having different depths; And
Arranging a plurality of display panels corresponding to each of the divided images in a row, synchronizing a view point at which each divided image is projected with a view point at which each display panel corresponding to each divided image operates, And projecting the divided image onto each corresponding display panel. delete The method of claim 1,
And a polymer liquid crystal dispersion film (PDLC) is used as the plurality of display panels. A two-dimensional image projector which receives two-dimensional image information about a subject and projects and displays a two-dimensional image;
Receiving depth information about the subject, selectively reflecting the projected two-dimensional image according to the depth information divided into a plurality of images having different depths, an image composed of a digital micromirror element (DMD) Installment;
A multilayer display panel unit including a plurality of display panels arranged in a line corresponding to each of the divided images, wherein each of the divided images is projected onto corresponding display panels;
And a display panel driver configured to synchronize the time point at which each divided image is projected with the time point at which each display panel corresponding to each divided image operates, thereby driving the respective display panels. Fusion 3D video display device. delete 5. The method of claim 4,
And wherein the plurality of display panels are polymer liquid crystal dispersion films (PDLCs).

Images