WO2016175378A1

WO2016175378A1 - Table-top three-dimensional display system, and method therefor

Info

Publication number: WO2016175378A1
Application number: PCT/KR2015/006529
Authority: WO
Inventors: 김승철; 홍석표; 김은수; 신동학
Original assignee: 광운대학교 산학협력단
Priority date: 2015-04-28
Filing date: 2015-06-26
Publication date: 2016-11-03
Also published as: KR20160128483A; KR101691292B1

Abstract

In order to implement a table-top three-dimensional (3D) display, an image standing upright on a table-top form display is represented by using a sub-viewing zone (SVZ) to be restored through an element lens other than a corresponding element lens. Therefore, the present invention has remarkable effects of: enabling the covering of both eyes since the present invention has a table-top form such that both eyes are on the same axis; enabling the image quality of a restored image to become better by using an integrated image display technique using an array lens and by using a high degree visual field to configure the table-top 3D display, but the visual field becomes narrower as the degree of a VZ becomes higher; and ensuring a visual field by attaching a linear prism on a lens array as a method for adjusting an optical path.

Description

Table Top 3D Display System and Its Method

The present invention relates to a table top three-dimensional display system and a method thereof, and more particularly, to implement a table top three-dimensional display, a sub-viewing zone (SVZ) restored through other element lenses than the corresponding element lenses. The present invention relates to a table top three-dimensional display system and a method for representing an image standing upright on a table-top display.

In general, the lens array is a direct view type that can output an image only to the front part. In general, when the integrated image display is used as a direct view type, the SVZ field of view is not wide enough to cover both eyes.

According to the three-dimensional image display device of Patent Publication No. 10-2014-0025784 as a prior art, the display panel for displaying a 2D image in the 2D mode, and a multi-view image in the 3D mode; A 3D filter passing light generated from the display panel in the 2D mode and partially passing light generated from the display panel in the 3D mode; A user input unit configured to receive a number of viewers and a viewer location from the user in the 3D mode; A view signal generation unit generating a number signal of a viewer according to the number of viewers input from the user input unit and a position signal of a viewer according to a position of the viewer; A multi-view image converter for outputting image data input in the 2D mode and converting the resolution of the image data into multi-view image data according to the number signal of the viewer in the 3D mode; And a 3D filter driver for supplying a driving voltage for controlling the 3D filter according to the number of viewers and the position signal of the viewer in the 3D mode.

According to another conventional technology, the display device of Korean Patent Publication No. 10-1019244 and its angle adjusting method include: a plurality of sensors for sensing a direction and a height of a display user; And a plurality of angle adjusters configured to adjust angles of the display according to a result detected by the plurality of sensors, wherein the angle adjusters are positioned in a vertical direction between each corner of the display and a back of a tabletop display, and the vertical It is described as a table top display device which is formed in a columnar shape whose height is changed in a direction.

However, such conventional systems can only view 3D images on one side of the display, and users in different locations at the same time cannot see them, and even after solving the above, they do not match both the field of view and the order, or the field of view is not correct. Otherwise, there is a problem in that the image quality of the reconstructed image is degraded by lowering the order.

Therefore, the present invention has a table-top shape, and since both eyes are on the same axis, there is no problem in covering both eyes, using an integrated image display technology using an array lens, and using a high order to construct a table top three-dimensional display. By using the field of view, the higher the order of the VZ, the narrower the field of view and the image quality of the reconstructed image is reduced, and the table top 3 that secures the field of view by attaching linear prism on the lens array as a way to adjust the optical path. It is an object of the present invention to provide a dimensional display system and a method thereof.

The present invention relates to a table top three-dimensional display system and a method thereof, in order to implement a table top three-dimensional display, using a sub-viewing zone (SVZ) restored through other element lenses than the corresponding element lens Table- It is characterized by representing the image standing upright on the top-shaped display.

The present invention is a table-top type, both eyes are on the same axis to cover both eyes, using an integrated image display technology using an array lens, using a high-order field of view to construct a table top three-dimensional display Thus, the higher the order of the VZ, the narrower the viewing area, the better the image quality of the restored image, and the remarkable effect of securing the viewing area by attaching a linear prism on the lens array as a method of adjusting the optical path.

1 is an overall block diagram of a table top three dimensional display system and method thereof of the present invention.

2 is a graph of a ray trace diagram of a table top three dimensional display of the present invention table top three dimensional display system and method thereof.

3 is a graph of a method of correcting an integrated image for a position according to an arbitrary depth of the present invention table top three dimensional display system and method thereof.

4 is a view of a table top three dimensional display system and a table top three dimensional display system of the method;

5 is a graph of the viewing angle according to the f number of the element lens of the table top three-dimensional display system and method thereof;

6 is a view of a table top three dimensional display system and a system using linear prism of the method;

7 is a schematic diagram for coordinate transformation of a photographed image of a table top three-dimensional display system and method thereof;

In addition, a method of expressing an image standing upright on the table-top display includes an elemental image plane positioned below and an elementary image displayed thereon, and a lens array positioned above the lens to correspond to the lens. An image acquisition step of acquiring brightness and depth information of an oblique projection view image through an array; A correction step of correcting depth information through axis transformation for the obtained table top three-dimensional display of the oblique projection view image; An element image generation step of generating an element image using brightness information and the corrected depth information; Table-top display step; characterized in that it comprises a.

In addition, the correction step is to display through the three-dimensional information, in order to obtain an image of the side portion, the camera is inclined so that the pickup optical axis is inclined, but the display is placed directly below and has a display optical axis perpendicular to it. The difference (θpd) between the optical axis is generated in the display and it is necessary to correct the difference, the difference between the optical axis is determined according to the order of SVZ, and the brightness and depth information obtained by placing the object on the reference plane and the reference plane, Since the depth image is inclined to the optical axis, some parts of the image are bright and others are dark. Therefore, when the element image is created and reconstructed using this information, a depth difference is generated depending on the position of the reference plane. Characterized by becoming visible.

In addition, the upright image may be represented by a difference in the amount of movement of the reconstructed image according to the order of the sub-viewing zone.

The method may further include a method of correcting an upright image and adjusting a viewing angle by installing a linear prism on the lens array.

In addition, by installing a sub-viewing zone (SVZ) that is restored through other element lenses other than the corresponding element lens to represent the image standing upright on the table-top display, the elemental image plane The element image is displayed at a position corresponding to the lens array, and the lens array is positioned at the top to acquire and display an image through the lens array, and the n th lens is positioned with respect to the point M (ym, zm) located at the depth (mg). The restoring may be performed by restoring the element lens {(n-1) -th} adjacent to the original element lens n-th.

In addition, when the point M located at the distance of mg is picked up by the nth element lens and restored through the element lens separated by l, the restored point moves by (m + 1) lP, and the table-top display is therefrom. Forming a viewing area from the system to the side is characterized in that the image can be observed from the side.

In addition, by installing a linear prism on the lens array, it is possible to correct the upright image and adjust the viewing angle.

The present invention will be described in detail with reference to the accompanying drawings.

1 is an overall block diagram of a table top three dimensional display system and method thereof of the present invention, FIG. 2 is a graph of a ray trace diagram of a table top three dimensional display system of the present invention table top three dimensional display system and method thereof, and FIG. A graph of a method for correcting an integrated image with respect to a position according to an arbitrary depth of the table top three dimensional display system and the method, FIG. 4 is a view of the table top three dimensional display system and the table top three dimensional display system of the method, 5 is a graph of the viewing angle according to the f number of the element lens of the tabletop three-dimensional display system and method, FIG. 6 is a viewing area of the tabletop three-dimensional display system and the system using the linear prism of the method, FIG. It is a schematic diagram for coordinate transformation of a picked-up image of a three-dimensional display system and its method.

Referring to the present invention specifically, it can be seen that the present invention is divided into four parts, as shown in FIG. First, acquire brightness and depth information of Oblique projection view image for table top 3D display; second, correct depth information through axis transformation for proposed table top 3D display; and third, brightness information And element image generation using corrected depth information, and finally table top 3D display.

As shown in FIG. 2, an element image is displayed on an elemental image plane, and an image is acquired and displayed through a lens array corresponding thereto.

In the case of a general direct view 3D display, an image is viewed at the position of Viewer 1 of FIG. 2. However, in the case of tabletop 3D display, the image is viewed from the position of Viewer 2, not of Viewer 1. However, in the case of a general integrated image-based 3D display, due to the narrow viewing angle, the viewer cannot see a proper image at the position of Viewer 2.

In addition, in order to express an image such as an arrow connecting three points A'M'B 'standing perpendicular to the display in the viewer in the viewer as shown in FIG. 2, information of an arrow connecting A'M'B' must be obtained. In integrated imaging technology, images cannot be obtained because three points are located on the same optical axis. Therefore, in order to solve this problem, the table-top is changed by using the sub-viewing zone (SVZ), which is restored through other element lenses, instead of the main viewing zone (MVZ), which is transformed through the corresponding element lens. We propose a new display system that can represent an image standing upright on a display.

In addition, as shown in FIG. 3, when a point M (ym, zm) located at an arbitrary depth mg is picked up through the nth lens through the integrated imaging technique, the pickup is performed at the yen position. When the picked-up image is restored through the original n-th lens, the picked-up image is restored to its original position M (ym, zm). However, if this is restored to the element lens ((n-1) -th, (n-2) -th) adjacent to the original element lens (n-th), respectively, as follows.

When picking up through the nth element lens with respect to the point M, the position yen in the element image can be expressed as Equations (1) and (2).

(One)

(2)

And, if the yen point of the element image is restored through the adjacent n-1 th element lens, it can be expressed as equations (3) and (4).

(3)

(4)

Therefore, it can be expressed as follows from Formula (2) and (4).

(5)

That is, when the point M located at a distance of mg is restored through an adjacent element lens, the restored point is shifted by (m + 1) P. When this is generalized and restored through the (n−l) th element lens, it can be expressed as Equation (6).

(6)

That is, if the point M located at a distance of mg is picked up by the nth element lens and then restored through the element lens that is separated by l, the restored point moves by ( m +1) lP . It can be seen that an image can be observed from the side by forming a viewing area from the side in the display system of the type.

Therefore, if the point A and the point B of FIG. 2 are restored through adjacent element lenses, the point A located at a distance of 3g moves by 4P and the point B located at a distance of 9g moves by 10P. That is, the more away from the lens array, the more it moves when restored through the adjacent element lens. Therefore, if the appropriate points A and B are selected, the restored points A 'and B' can stand perpendicular to the table top three-dimensional display, thereby enabling table top three-dimensional display.

As shown in FIG. 4, the viewing area of a table top three dimensional display system is shown. You can see that there are many different views. Firstly, the MVZ located in the center of the display shows the following viewing angles.

(7)

MVZ occupies the widest area and is mainly used in general direct view. However, table top three-dimensional displays cannot use MVZ, but SVZ. It can be seen from FIG. 4 that 1stSVZ and 2ndSVZ restored through adjacent element lenses have the following viewing angles.

(8)

(9)

As shown in FIG. 5, the smaller the f number, the wider the viewing area is. However, SVZ can be seen to be relatively small compared to MVZ. For example, when the element number of f number 1 is used, MVZ, 1 ^st SVZ, 2 ^nd SVZ, and 3 ^rd SVZ have 53.130, 29.745, 11.889, and 5.856 degrees, respectively. It is expected that 1 ^st SVZ or 2 ^nd SVZ can be used as a table top three-dimensional display. However, it is not easy to make a lens with a small f number.

In general, when using an integrated video display as a direct view, the SVZ field of view is not wide enough to cover both eyes and thus cannot be used. However, when used as a table-top, both eyes are on the same axis, so there is no problem in covering both eyes.

Therefore, in order to compose a table top three-dimensional display using an integrated image display technology using a general lens array, it is possible to use a high-order field of view. However, in FIGS. 5 and 8, and 9, the viewing area becomes narrower as the SVZ degree is higher.

In one embodiment, a lens of f number 5 was used, and in this case, MVZ, 1 ^st SVZ, 2 ^nd SVZ, and 3 ^rd SVZ had 11.421, 10.989, 9.866, and 8.427 degrees, respectively. However, even in the case of 3 ^rd SVZ, the viewing area is not suitable for applying the table top from 63.435 to 55.008 degrees, so higher order VZ should be used. However, the higher the order of the VZ, the narrower the viewing area and the lower the quality of the restored image.

Therefore, in order to construct the table-top, a method of adjusting the optical path should be applied. A linear prism was attached to the lens array to secure a viewing area.

6 shows the field of view of the proposed system using linear prism. In the method of this system, the optical path is controlled by using very dense linear prism. According to the prism formula, the angle of refraction in the linear prism can be expressed as Equation (10).

10

Here n0 and np represent the refractive index in air and the refractive index of a prism, respectively, and (alpha) shows the angle of a prism. Thus, the adjusted optical paths may be represented by θ's11 = θs11 + θP and θ's12 = θs12 + θP, respectively. Therefore, the visual field is maintained at θ s1 and the overall angle is moved outward. Therefore, it can be seen that by adopting the linear prism to the table top three-dimensional display, it is possible to create a field of view suitable for the table top three-dimensional display.

Table-top three-dimensional display system must be able to show the image of the side, unlike the direct view 3D display.

Therefore, it is necessary to be able to acquire an image of the side part and display it.

FIG. 7A illustrates a geometry for acquiring and displaying three-dimensional information with respect to an arbitrary object, and the pickup optical axis is inclined because the camera is inclined to acquire an image of the side part. However, the display is placed directly underneath and has a display optical axis perpendicular to the display, and a difference (θpd) between the pickup and the display is generated, and a work of correcting it is necessary. The difference between the optical axes is determined according to the order of SVZ used in the display system.

7 (b) and 7 (c) of FIG. 7 show brightness and depth information obtained by placing a box on a reference plane and a reference plane. If you look at the double depth image, you can see that the lower part of the image is bright and the upper part is dark because the reference plane is inclined with the optical axis. When the element image is created and reconstructed using the above information, the depth difference according to the position of the reference plane occurs. The reconstructed image will appear tilted. 7 (d) is obtained by subtracting the depth information of 7 (b) from the brightness image of 7 (c) and the depth information of 7 (c), and compensating the reference depth with respect to the reference plane. The values for the red line are shown in the black and red lines of the graph of 7 (e), respectively. As mentioned above, the black and red lines are inclined with different depth information along the y axis.

In particular, it can be seen that the same slope for Plane A and Plane B of 7 (a) has a certain slope for Plane C. The green line of FIG. 7 (e) is information on the red line of 7 (d). As a result, it can be seen that the depth information of Plane A is 0 and the depth information of Plane B has a constant value 96. However, the information of Plane C can be seen to have a specific slope, and when using the above to create and restore the element image is restored to the same shape as seen in the MVZ, and when seen through the SVZ Figure 2 and equation ( As shown in 6), it moves horizontally according to the depth information. In other words, if the depth information is large, it moves a lot, and if it is small, it moves little. Especially, when the SVZ of the high order is high, the horizontal movement amount is high, and when the depth information is low, the horizontal movement amount is small. However, as mentioned above, high-order SVZ cannot be used due to problems such as deterioration of image quality depending on the characteristics of the display system, and according to the characteristics of the display system, the appropriate SVZ is selected and the information restored through the SVZ is restored. If you look at it, it will be restored like the blue line in 8 (e).

In the proposed method, as mentioned above, linear prism is additionally used to secure the viewing area, and the horizontal shift of the reconstructed image is additionally corrected, and the amount of correction depends on the amount of depth information as in the case of SVZ. Therefore, if the appropriate linear prism is selected, the box shape is restored as shown in the light blue line of FIG. 8 (e). More specifically, the depth information of Plane A is 0, the depth information of Plane B is a constant value 96, and Plane C. You can see that the original box shape is restored by restoring at the same y position perpendicular to PLANE A.

The table top three-dimensional display system mentioned so far can only view three-dimensional images on one side of the display. But for a true tabletop three-dimensional display, you need to adjust the light path to see three-dimensional images in all directions.

As a method of adjusting the optical path, a variable linear prism that can change the angle and direction of the prism can be used or the linear prism can be rotated. At this time, according to the direction of the change or rotation, according to the direction of the prism to obtain the image corresponding to the direction to create and display the element image. The direction of the prism can be synchronized with the displayed image to change time-sequentially, or the human eye can be traced to express the direction and image accordingly.

Therefore, the present invention is a table-top form, both eyes are on the same axis to cover both eyes, using an integrated image display technology using an array lens, and high-order field of view to compose a table top three-dimensional display In this case, the higher the order of the VZ, the narrower the viewing area, the better the image quality of the restored image, and the remarkable effect of securing the viewing area by attaching a linear prism on the lens array as a method of adjusting the optical path.

Claims

In order to realize a table top three-dimensional display, an image standing upright on a table-top display is represented by using a sub-viewing zone (SVZ) that is restored through an element lens other than the element lens. Table Top 3D Display Method
The method of claim 1, wherein an element image is displayed with an elemental image plane below and an element image is displayed on the table-top display. An image acquisition step of obtaining position and brightness information of an oblique projection view image through the lens array; A correction step of correcting depth information through axis transformation for the obtained table top three-dimensional display of the oblique projection view image; An element image generation step of generating an element image using brightness information and the corrected depth information; Table-top display method comprising the; tabletop three-dimensional display method comprising a
According to claim 2, wherein the correction step is to display through the three-dimensional information, in order to obtain the image of the side portion is inclined the pickup optical axis because the camera is positioned inclined, but the display is placed directly below the vertical display optical axis Since the difference between the optical axis of the pickup and the display (θpd) is generated and the correction is necessary, the difference between the optical axis is determined according to the order of SVZ, the brightness and depth information obtained by placing the object on the reference plane and the reference plane However, since the depth image is inclined with the optical axis, the depth image is partly bright and the other part is dark. Therefore, when the element image is created and restored using this information, the depth difference is generated according to the position of the reference plane. Table top three-dimensional, characterized in that the image is shown tilted Display Method
The table top three-dimensional display method according to claim 1, wherein the upright image can be expressed by a difference in the amount of movement of the reconstructed image according to the order of the sub-viewing zone.
The table top three-dimensional display method of claim 2, further comprising a method of correcting an upright image and adjusting a viewing angle by installing a linear prism on the lens array.
A sub-viewing zone (SVZ) that is restored through an element lens other than the corresponding element lens is installed to represent the image standing upright on the table-top display. The elemental image plane is located at the bottom. The element image is displayed, and a lens array is positioned correspondingly to obtain an image through the lens array, and the image is reconstructed through the nth lens with respect to the point M (ym, zm) located at a depth (mg). However, the table top three-dimensional display system, characterized in that to restore the element lens {(n-1) -th} adjacent to the original element lens (n-th)
The method of claim 6, wherein when the point M located at the distance of mg is picked up by the nth element lens and restored through the element lens separated by l, the restored point moves by (m + 1) lP and therefrom Table-. Table-top three-dimensional display system, characterized in that the image can be observed from the side by forming a viewing area to the side in the top-type display system
7. The tabletop three-dimensional display system according to claim 6, wherein a linear prism is installed on the lens array to correct an upright image and adjust a viewing angle.