KR20200086513A - Non-eyeglass integrated image display method and system using micro mirror array - Google Patents

Abstract

The present invention relates to a non-eyeglasses integrated image display system using a micro mirror array, comprising: an integrated image pickup unit; an integrated image reproduction unit; and a micro mirror array device unit. In addition, the present invention places the micro mirror array device, which is able to optically perform PO conversion, which correctly converts a pseudoscopic image into an orthoscopic image, in the integrated image configured by a display panel and a lens array, thereby optically performing PO conversion, and reproducing a three-dimensional image with the pseudoscopic phenomenon resolved. According to the present invention, the non-eyeglasses integrated image display system comprises the integrated image pickup unit, the integrated image reproduction unit, and the micro mirror array device unit, thereby having a structure in which an image is formed symmetrically with the micro mirror array device as a reference surface. Accordingly, the present invention has remarkable effects in performing PO conversion, which changes the depth by 180 degrees, obtains an orthoscopic image, and provides a correct image.

Description

{Non-eyeglass integrated image display method and system using micro mirror array}

The present invention relates to a method and system for autostereoscopic image display using a micromirror array, and more specifically, to a depth-inverted image using a micromirror array element in a autostereoscopic image display method using a lenticular lens or a lens array. It relates to a method and system for displaying as a holographic image.

Over the past century, 3D imaging technology that records and reproduces three-dimensional (3D) information has been of great interest. Among them, integrated imaging (InIm) technology has been spotlighted as a representative next-generation technology. The concept was first proposed in 1908 by G. Lippmann. He proposed a method for acquiring and reconstructing 3D information using a spherical diopter arrangement, and his work is also known as Integral Photography (IP) [Lippmann]. Recently, instead of a spherical diopter, a lens array in which hemispherical convex lenses are arranged horizontally and vertically is utilized, and a 3D image is acquired by a two-dimensional (2D) imaging sensor (eg CMOS, CCD). It has been developed in a manner that continues to be studied.

The image thus obtained consists of an array of small images, each of which is called an elemental image (EI), and their arrangement is called an integrated image (II). Interestingly, all acquired element image images have both spatial information and angular information. That is, each pixel of the element image is multi-dimensional information gathering light intensities recorded through various incidences of light passing through the lens array. On the other hand, the recorded integrated video image is reproduced in the reverse order of shooting. By placing the lens array in front of the display device to reproduce the captured integrated image image, 3D information composed of real images and virtual images is restored. The reproduced image becomes a multi-view 3D color image with continuous viewpoints of top, bottom, left, and right.

In general, a lens pickup (or a lenticular sheet) of an image pickup unit for picking up information of a 3D image by placing a lens array (a lenticular sheet can also be used) on a 3D object in front of the camera. It is composed of a display panel attached with) and is composed of an integrated image reproducing unit for reproducing pseudoscopic 3D images and a micro-mirror array element unit for projecting the correct orthoscopic 3D images into space through a depth inversion function for the pseudoscopic 3D images. .

Particularly, in the interactive 3D display system of Patent No. 10-1238824 registered as a prior art, an aperture through which light emitted from a display panel is transmitted and a barrier that blocks the light are repeatedly arranged. The formed parallax barrier panel is disposed in front of the display panel, and the three-dimensional image synthesized through the opening is observed separately, so that an autostereoscopic 3D image display device is provided. The display panel size, resolution, unit pixel width (p), electrode width (M) between each unit pixel and the distance between the parallax barrier panel and the display panel from the autostereoscopic 3D image display device (d) ), display information for the opening width (A) and the width (B) of the barrier, a predetermined total number of viewpoints, the number of point light sources per unit pixel, the observation distance (V) between the parallax barrier panel and the observation surface, and The entire viewing area where light from a point light source of a small area forming a unit pixel of a display passes through an opening by receiving viewpoint information on a distance (BD) between centers of view of each viewpoint image formed on the observation surface. A control device that calculates the width (Intensity distribution) to obtain visual field distribution data within a horizontal observation range on a predetermined observation surface; And a beam that receives the viewing area distribution data obtained from the control device and outputs an image of the optimal viewing area, which is the size of the amount of light for each view point in the horizontal direction of the display panel, to the bottom surface on the viewing space so that the viewer can visually know. It is described as an interactive three-dimensional display system that includes a project device.

As another conventional technique, a three-dimensional display system for displaying an optimal viewing area to an observer of Patent Registration No. 10-1288120 includes: an autostereoscopic 3D image display device in which a parallax barrier including an opening is disposed in front of a display panel; A camera for acquiring background image information on an actual observation area including at least one observer located in front of the 3D image display device; A 3D image acquisition unit that receives the background image information obtained from the camera and acquires a 3D image and location information data about an observer's position using stereo matching; And an extended total viewing width at which light originating from each light source of the autostereoscopic 3D image display device arrives at each point in an observation area extending in the x-direction of the horizontal axis and the z-direction of the vertical axis based on the observation plane. intensity distribution) to obtain visual field distribution data within the horizontal and vertical observation ranges on the observation surface, and the size of the light quantity for each view point in the horizontal and vertical direction of the display panel using the visual field distribution data. Obtain an optimal viewing area image consisting of, and synthesize the observer's 3D image and location information data obtained from the 3D image acquisition unit on the optimal viewing area image to display it on the display panel so that the viewer can visually know It is described as a three-dimensional display system including a control device.

On the other hand, there is a fatal problem with the integrated image technology. In a general integrated image reproduction method, when an integrated image of an object is displayed in space, an observer's observation of the object's integrated image appears in the opposite perspective to that of the observer directly observing the object, that is, a distant object. Pseudoscopic phenomena occur when this object is visible or objects nearby are visible.

This is a phenomenon that occurs because the acquisition and reproduction of images are made in opposite directions, as shown in FIG. 1, when objects acquired by the camera are reproduced, they are also reproduced in the vicinity of the display device as well, and consequently looking at them The observer observes the back side rotated 180 degrees of the acquired image.

Therefore, a phenomenon in which the perspective of the reproduced image is shown in reverse is generated. As a method to solve the problem, pseudoscopic-to-orthoscopic conversion (PO conversion) is often proposed.

In order to solve these problems, research and development have been continuously conducted in various places to date, but there are still many improvements [AIRR, SPOC, Okano’s method, etc. ].

Therefore, the present invention has been devised to solve the above problems, and the present invention is composed of an integrated image pickup unit, an integrated image playback unit, and a micromirror array element, so that the image is symmetrically based on the micromirror array element as a reference plane. It is intended to provide an autostereoscopic integrated image display system and method using a micro-mirror array that provides a correct image because a PO conversion function that changes the depth by 180 degrees by having an imaged structure is performed and an orthoscopic image is obtained.

The present invention relates to a glasses-free integrated image display system using a micro-mirror array, and is characterized by comprising an integrated image pickup unit, an integrated image playback unit, and a micro-mirror array element unit.

In addition, the present invention is performed by optical converion by arranging a micro-mirror array element capable of optically performing a PO conversion that correctly converts a pseudoscopic image into an orthoscopic image in an integrated image configuration consisting of a display panel and a lens array, Characterized by a method for displaying a glasses-free integrated image using a micro-mirror array, characterized by reproducing a 3D image in which pseudoscopic phenomenon is solved.

Therefore, the present invention is composed of an integrated image pickup unit, an integrated image playback unit, and a micromirror array element unit, and has a structure in which an image is symmetrically formed using the micromirror array element as a reference plane to change the depth by 180 degrees. Since this is performed and an orthoscopic image is obtained, there is a remarkable effect of providing a correct image.

Figure 1. Structure of integrated video technology (pickup and playback unit)
Figure 2. Overall system structure
Figure 3. Structure of the direct video pickup unit
Figure 4. Structure of the direct video playback unit
Fig. 5. Structure and imaging principle of the micro-mirror array element
Figure 6. Structure of the entire display system
7. Experimental structure of 3D image acquisition of integrated image pickup for demonstration
Fig. 8. Pseudoscopic 3D image displayed in the integrated image playback unit
Fig. 9 Display of orthoscopic 3D images reproduced in a micromirror array

The present invention relates to a glasses-free integrated video display system using a micro-mirror array,

It is characterized by being composed of an integrated image pickup unit, an integrated image playback unit, and a micromirror array element unit.

In addition, the image pickup unit is to place a lens array or a lenticular sheet on a 3D object in front of the camera to pick up information on a 3D image, and the integrated image playback unit performs lens array or lenticular on the element image picked up by the image pickup unit. It consists of a display panel with a sheet attached to it and reproduces a pseudoscopic 3D image, and the micro-mirror array element unit is characterized by projecting a correct orthoscopic 3D image into space through a depth inversion function for the pseudoscopic 3D image.

In addition, the present invention is performed by optical converion by arranging a micro-mirror array element capable of optically performing a PO conversion that correctly converts a pseudoscopic image into an orthoscopic image in an integrated image configuration consisting of a display panel and a lens array, Characterized by a method for displaying a glasses-free integrated image using a micro-mirror array, characterized by reproducing a 3D image in which pseudoscopic phenomenon is solved.

The present invention will be described in detail with reference to the accompanying drawings. Fig. 1. Configuration diagram of integrated video technology (pickup and playback section),

Fig. 2. Overall system structure diagram, Fig. 3. Structure of the direct image pickup section, Fig. 4. Structure diagram of the direct image playback section, Fig. 5. Structure and imaging principle of the micro-mirror array element section, Fig. 6. Structure of the entire display system Figure 7, Figure 3 3D image acquisition experiment structure diagram of the integrated image pickup for the demonstration,

Figure 8. Pseudoscopic 3D image display diagram reproduced in the integrated image playback unit,

9 is a view showing an orthoscopic 3D image reproduced in a micromirror array.

The configuration of the present invention is composed of an integrated image pickup unit, an integrated image playback unit, and a micromirror array element unit as shown in FIG. 2.

If you explain the integrated video pickup,

For image pickup using the integrated image technology, it is configured as shown in FIG. 2. In FIG. 3, a lens array is placed in front of a 3D object to be picked up, and the image is acquired after focusing the camera on the lens array with a 2D camera. The photographed image is an elemental image, and is obtained by inverting it up, down, left, and right due to the characteristics of the concave lens.

If you explain the integrated video playback unit,

In order to convert the element image recorded above into a spatial 3D image, an optical display device having a specific structure is required. As shown in FIG. 4, the element image recorded above is displayed on the display panel and a lens array is disposed. At this time, the distance between the lens array and the panel is equal to the focal length of the basic lens of the lens array. Then, a sufficiently wide depth region 3D image can be obtained. On the other hand, when the obtained element image is used as it is without applying PO conversion, there is a problem in that the pseudoscopic phenomenon described above occurs and an image in which depth is reversed is reproduced.

When explaining the micro-mirror array element,

In the present invention, a micro-mirror array element capable of optically performing PO conversion for correctly converting a pseudoscopic image into an orthoscopic image is used. The structure of the micro-mirror array element has a structure as shown in FIG. 5.

To explain the PO conversion by the micro-mirror array element, consider two point light sources P1 and P2 as shown in FIG. 5. P1 and P2 are located at different distances from the micromirror array element. First, the light sources starting from the point light source P1 are imaged to the position of P1' with the help of vertical mirrors included in the micro-mirror array element. And the light source P2 is imaged to the position of P2' through the micro-mirror array element. As described above, it can be seen that the micro mirror array element has a structure in which an image is formed symmetrically as a reference plane. Therefore, the PO conversion function of changing the depth by 180 degrees is performed through this principle.

Basic optical experiments were performed to show the usefulness of the 3D integrated image display method proposed in the present invention. The structure diagram of the integrated video display system including the PO conversion shown in FIG. 5 is shown in FIG. 6 below. In a traditional integrated imaging method consisting of a display panel and a lens array, the PO mirror is arranged at an angle of 45 degrees with the help of a micro-mirror array, and PO converion is performed optically, and as a result, a pseudoscopic phenomenon is solved.

The system as shown in FIG. 6 was constructed to perform the experiment of restoring the obtained integrated image image into a 3D image.

First, a 3D image was picked up. The 3D image was composed of a ring image and an icon image, and the icon image was placed in front of the ring image.

The element image obtained in FIG. 7 was displayed in the system of FIG. 6. In this case, it can be seen that, in the case of the image reproduced by the integrated image reproducing unit, a pseudoscopic image is generated through the left and right images as shown in FIG. 8. Since pseudoscopic images are not correct images, if the observer moves to the left, the difference between the two images should increase but decrease.

On the contrary, it can be seen that the image passing through the micro-mirror array as shown in FIG. 9 operates in contrast to the image in FIG. 8. That is, an orthoscopic image is obtained. Therefore, it can be seen that the method of the present invention provides a correct image.

Therefore, the present invention is composed of an integrated image pickup unit, an integrated image playback unit, and a micromirror array element unit, and has a structure in which an image is symmetrically formed using the micromirror array element as a reference plane to change the depth by 180 degrees. Since this is performed and an orthoscopic image is obtained, there is a remarkable effect of providing a correct image.

Claims (3)

Glasses-free integrated video display system using a micro-mirror array, characterized in that it consists of an integrated image pickup unit, an integrated image playback unit, a micro-mirror array element unit The method of claim 1, wherein the image pickup unit picks up information of a 3D image by placing a lens array or a lenticular sheet in front of the camera for a 3D object,
The integrated image reproducing unit is composed of a display panel with a lens array or a lenticular sheet attached to the element image picked up from the image pickup unit and reproduces pseudoscopic 3D images,
The micro-mirror array element unit is a glasses-free integrated image display system using a micro-mirror array characterized in that the correct orthoscopic 3D image is projected to the space through a depth inversion function for the pseudoscopic 3D image. The PO converion is performed optically and the pseudoscopic phenomenon is performed by arranging a micro-mirror array element that can optically perform the PO conversion that correctly converts the pseudoscopic image into an orthoscopic image in an integrated image configuration consisting of a display panel and a lens array. Glasses-free integrated image display method using a micro-mirror array characterized by reproducing a resolved 3D image

Images