KR20150039463A - A 3 dimension display device and 3 dimension image processing method - Google Patents

Abstract

The present invention relates to a 3-dimensional display device, comprising: an image input unit for receiving a 3-dimensional image; a perspective calculation unit for calculating a 3-dimensional perspective standard of a depth, based on at least one of screen curvature information of a display device and location information of a viewer; a rendering unit for compensating the depth of the received 3-dimensional image, according to the calculated perspective standard of the depth; and a display unit for displaying the compensated 3-dimensional image. According to the present invention, the 3-dimensional image can be displayed optimally, depending on a location of a user, or a screen curvature.

Description

[0001] The present invention relates to a 3D display device and a 3D image processing method,

The present invention relates to a 3D display device and a 3D image processing method, and more particularly, to a 3D display device and a 3D image processing method capable of displaying 3D images optimal for viewers by correcting 3D image information based on a user's position or screen curvature .

The display device can display a two dimensional (3D) image and a three dimensional (3D) image according to its characteristics. The user has different viewing angles by both eyes, and thereby can recognize a three-dimensional solid object. Using the above principle, three-dimensional images are divided into two different viewpoints, that is, a left-eye image and a right-eye image. Each of the viewpoints is horizontally separated, but a person perceives the two viewpoints as one by the binocular parallax, and recognizes the three-dimensional objects of the object.

When the left eye image and the right eye image having the two different viewpoints are overlapped, a positional difference occurs on a horizontal plane between the left eye image and the right eye image as objects closer to each other are viewed. The difference causes a person to feel the perspective (depth sense or depth) have.

Depth and perspective of a 3D image can be divided into three dimensions. The perspective refers to the 3D view when the depth is 0, and the depth means a sense of depth from 0 Depth based on the perspective. That is, the perspective corresponds to the setting criterion of the depth.

In the conventional 3D image, the setting criterion of the depth is applied to the entire screen as a constant value as shown in FIG.

2. Description of the Related Art Display devices such as televisions are becoming larger in size, and it is common that a large number of viewers watch at the same time from different angles. In this case, since the setting criterion of the depth in the conventional 3D image is adjusted to the viewer at the center, the 3D image can be distorted to the viewer at the outer periphery.

Recently, flexible displays have been developed and it is common that they always have a variable curvature during use. When such a flexible display is used to represent a 3D image, a distorted 3D image can be displayed to a viewer by applying a setting criterion of depth in a conventional 3D image.

An object of the present invention is to solve the above-mentioned conventional problems, and it is an object of the present invention to provide a 3D display device and a 3D image processing method which provide a setting criterion of a depth in a 3D image centering on a detected viewer position and / .

It is another object of the present invention to provide a multi-view 3D display device and a 3D image processing method capable of viewing a 3D image optimally generated for each of a plurality of viewers.

According to another aspect of the present invention, there is provided a 3D display apparatus including a video input unit for receiving a 3D image, a 3D depth unit based on at least one of screen curvature information of a display apparatus and position information of a viewer, A rendering unit for correcting the depth of the received 3D image according to the calculated depth setting reference, and a display unit for displaying the corrected 3D image And a display unit for displaying the image.

The location information of the viewer may be obtained by at least one of a position sensing sensor and a camera.

The 3D display apparatus may further include a curvature measuring unit for measuring screen curvature information of the display device.

Preferably, the curvature measuring unit includes a plurality of load cells, and is disposed on a rear surface of the display unit.

The display unit may include a flexible display unit.

The 3D depth setting perspective can be calculated for each of a plurality of viewers.

The display unit may include an autostereoscopic display unit.

The 3D depth setting perspective is preferably calculated based on the viewer's face.

According to another aspect of the present invention, there is provided a 3D image processing method including receiving a 3D image, measuring at least one of screen curvature information of a display device and position information of a viewer, Calculating a 3D depth setting perspective based on at least one of the screen curvature information and the viewer's location information; Correcting the depth of the 3D image, and displaying the corrected 3D image on the display unit.

According to the present invention, the 3D image is corrected according to the viewing position of the viewer and the screen curvature of the display device, and provided to the viewer, so that the viewer can always view the optimal 3D image.

1 is a block diagram of a 3D display device according to the present invention;
FIG. 2 is a diagram illustrating correction of a 3D image according to the depth setting reference change of the present invention,
3 is a diagram illustrating a depth setting reference change according to a viewer position based on the present invention.
4 and 5 are diagrams illustrating a depth setting reference change according to a screen curvature based on the present invention,
6 is a flowchart illustrating a 3D image processing method according to the present invention.
7 is a diagram showing a configuration of a curvature measuring unit,
8 is a diagram illustrating a depth setting reference change for a plurality of viewers in a multi-view 3D display apparatus according to the present invention, and Fig.
FIG. 9 is a view showing a depth setting standard of a conventional 3D image.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In the following embodiments, only configurations directly related to the concept of the present invention will be described, and description of other configurations will be omitted. However, it is to be understood that, in the implementation of the apparatus or system to which the spirit of the present invention is applied, it is not meant that the configuration omitted from the description is unnecessary. Like reference numerals in the drawings denote like elements.

1 is a block diagram of a 3D display device 100 according to an embodiment of the present invention.

The 3D display device 100 of the present invention may include an electronic device capable of receiving and processing video signals from an external video source, not shown. And a display device for displaying an image corresponding to the processed video signal on the display unit 30. [

The 3D display device 100 includes a computer body (not shown) capable of generating an image signal having a CPU (not shown) and a graphic card (not shown) and providing the image signal locally, A video signal can be supplied from a variety of video sources such as a server (not shown) capable of transmitting a broadcast signal, a broadcasting apparatus (not shown) capable of transmitting a broadcast signal using a public wave or a cable.

When the 3D display device 100 receives a two-dimensional image signal or a three-dimensional image signal from the outside, the 3D display device 100 processes the two-dimensional image signal or the three-dimensional image. Here, unlike a two-dimensional image, a three-dimensional image is divided into a left eye image corresponding to a user's left eye and a right eye image corresponding to a user's right eye. Accordingly, when the 3D display device 100 receives the three-dimensional image signal, the left-eye image and the right-eye image are alternately displayed on a frame-by-frame basis. At this time, the 3D display device 100 may further include shutter glasses (not shown) for alternately opening and closing the left shutter unit and the right shutter unit corresponding to the alternately displayed left and right eye image frames . When a 3D image is displayed on the 3D display device 100, the shutter glasses (not shown) selectively display a view of the left or right eye of the user corresponding to whether the current left eye image or the right eye image is displayed Open or block.

Also, the 3D display device 100 can display an autostereoscopic image without using the shutter glasses. The autostereoscopic display method is a parallax barrier method and a lenticular lens method. In the parallax barrier method, the left eye image and the right eye image can be separately displayed by placing a film at the front of the screen. In the lenticular lens system, a convex lenticular lens may be disposed in front of the screen to separate the left eye image and the right eye image.

The 3D display device 100 of the present invention may also include a set-top box. Accordingly, a video signal supplied from an external video source (not shown) can be processed in the set-top box and the processed video signal can be transmitted to the display unit. At this time, the display unit may be composed of a TV or a monitor.

1, a 3D display device 100 according to the present invention includes an image input unit 110, a viewer position sensing unit 120, a curvature measuring unit 130, a perspective calculating unit 140, A display unit 150, and a display unit 160. [0027]

 The image input unit 110 may receive the image signal from the outside and transmit the image signal to the perspective calculating unit 140. The image input unit 110 may be implemented in various ways corresponding to the standard of the received image signal and the implementation form of the display device 100. The image signal may include a two-dimensional image signal or a three-dimensional image signal, and may further include a voice signal and a data signal.

When the image signal is a three-dimensional image signal, the data signal may include stereoscopic information on the three-dimensional image signal.

The stereoscopic information may include information on a horizontal positional difference between a left eye image and a right eye image of a predetermined region of an image corresponding to the three-dimensional image signal.

For example, when the 3D display device 100 is implemented as a TV, the image input unit 110 may wirelessly receive a radio frequency (RF) signal transmitted from a broadcasting station, or may transmit a composite video, , Super video, SCART, and HDMI (high definition multimedia inferface) standards. In this case, the image input unit 110 may further include a tuner (not shown) for tuning an antenna (not shown) and / or a broadcast channel.

For example, when the 3D display device 100 is implemented as a PC monitor, the image input unit 110 may include a D-SUB capable of delivering RGB signals according to the VGA scheme, a DVI-A (digital video interactive analog (DVI-I), DVI-D (digital), or HDMI standards. Alternatively, the receiving unit 10 may be implemented as a display port (DisplayPort), a unified display interface (UDI), or a wireless HD.

The viewer position sensing unit 120 may sense the viewing position of the viewer and may transmit the sensing result to the per-spectral unit calculating unit 140. [ The viewer position sensing unit 120 may include a human body sensor and a camera. The viewer position sensing unit 120 can be disposed at the upper or lower center of the chassis that constitutes the appearance of the display device.

The human body detection sensor may include a motion detection sensor, a position sensor, a heat sensing sensor, and the like.

The camera recognizes not only the position of the viewer but also the face of the viewer to identify the user. The 3D image suitable for the identified user can be displayed on the display unit 160. The camera may include a webcam, a pan tilt camera, a digital camera, an analog camera, a camcorder, and the like.

The curvature measuring unit 130 may measure the curvature of the screen and may transmit the measurement result to the per-spectral unit calculating unit 140. Fig. 7 shows an example of measuring the curvature of the screen.

In FIG. 7, a plurality of sensors 132 may be arranged on the back surface of the flexible display unit 160. The sensor 132 is preferably arranged at regular intervals in the horizontal and vertical directions of the flexible display unit 160 in order to accurately extract the curved shape of the flexible display unit 160. The sensors 132 may be disposed on the back surface of the flexible display unit 160 while being attached to the sensor supporting unit 134. The sensor 132 may be a load cell, which converts a physical force into an electrical signal, or a bend sensor, which has a characteristic that a resistance value increases according to a bending angle.

The display unit 160 may be designed to have a predetermined curvature. In this case, predetermined curvature data may be used at the time of designing.

The per-spectral part calculation unit 140 may receive the 3D image received by the image input unit 110. [ In addition, the per-spectral part calculator 140 may receive the location of the viewer and / or the viewer identification result sensed by the viewer position sensing unit 120. The per-spectral part calculator 140 may receive the measured screen curvature from the curvature measuring unit 130. The per-spectral part calculator 140 may calculate a criterion (hereinafter referred to as 3D perspective) for setting the depth of the received 3D image based on the received viewer position and / or the screen curvature. The per-spectral part calculator 140 may calculate a 3D perspective for a plurality of identified viewers and output the 3D perspective to the rendering unit 150.

8 is a diagram schematically illustrating a method of calculating a 3D perspective for a plurality of viewers. In FIG. 8, the viewer B is located at the center, and can calculate the 3D perspective B of the same curvature centered on the viewer B. When the viewer A is located on the left side, the 3D perspective A having the same curvature can be calculated around the viewer on the left side. When the viewer C is located on the right side, the 3D perspective C having the same curvature can be calculated centering on the viewer on the right side. Of course, the equation for calculating the 3D perspective can be set according to a predetermined rule instead of being limited to a certain curvature

The 3D perspective corresponds to a reference (plane) for setting the depth of a stereoscopic (3D) image, that is, a reference having a depth of zero. As shown in FIG. 2, when the 3D perspective is changed, the depth of the 3D image should be corrected based on the changed 3D perspective when the depth is set.

The per-spectral part calculator 140 may be implemented by hardware or software. The hardware may comprise a control module such as a CPU, MPU, or the like. The software can be implemented as a program that can calculate the perspective installed in the operating system.

The 3D perspective calculation of the per-spectral part calculator 140 may be calculated based on at least one of a viewer's viewing position and a screen curvature.

Figure 3 schematically illustrates changing the 3D perspective according to the viewer's location. That is, when the viewer is located on the right side of the screen and views the display device 100, the 3D perspective can be changed around the viewer on the right side.

Fig. 4 schematically illustrates changing the 3D perspective when the screen is flat; the 3D perspective can be changed to a concave surface with respect to the viewer.

Fig. 5 schematically illustrates changing the 3D perspective when the screen is curved. The 3D perspective can be changed not only to the viewer but also to the surface that changes according to the curvature of the screen.

The per-spectral part calculation unit 140 may calculate the 3D perspective by individually applying the viewing position information or the screen curvature of the viewer, or may calculate the 3D perspective by reflecting all of them.

The rendering unit 150 may apply the 3D information included in the received 3D image, for example, the depth based on the 3D perspective calculated by the per-spectral unit calculation unit 140 and correct the 3D information. The rendering unit 150 may generate a corrected 3D image by correcting the 3D image for each of a plurality of viewers. Thus, by correcting the 3D image by correcting for each of a plurality of viewers, it is possible to display an optimal 3D image for each viewer.

The 3D image obtained by calculating and correcting the 3D perspective for a plurality of viewers can be applied to a multi view display device in which a plurality of users can view different contents on one screen.

The 3D display device 100 according to the present invention may include a video signal processing unit (not shown). The image processing unit may further perform various image processing processes predetermined for the image signal. The type of the processor is not limited. For example, a scale for enlarging or reducing a screen to a given resolution, decoding and encoding corresponding to various image formats, de-interlacing, A frame refresh rate conversion, a noise reduction for improving image quality, detail enhancement, line scanning, and the like. The processor may be performed individually or in combination.

Of course, the rendering unit 150 may be included in the image signal processing unit, but is separately displayed for the sake of convenience.

The display unit 160 may display the 3D image corrected by the rendering unit 150 so that the 3D image can be viewed by the viewer. The display unit 160 may display one image frame by vertically arranging a plurality of scanned horizontal scanning lines. The display panel 160 includes a display panel (not shown) for displaying the image, and the display panel (not shown) includes a liquid crystal panel including a liquid crystal layer or an organic luminescent panel including a light- A display panel, and the like. The display unit 160 may include a flexible panel.

Hereinafter, a 3D image processing method according to the present invention will be described in detail with reference to FIG.

First, in step S110, a 3D image including a video source or a stored left eye image, right eye image, and 3D information is received. At this time, the received 3D image includes 3D information calculated on the basis of the 3D perspective of the plane collectively regardless of the viewer's viewing position or the screen curvature.

In step S120, the location information of the viewer and the viewer identification information are acquired through the position sensing unit 120 of the viewer.

Simultaneously or selectively with step S120, the screen curvature of the display device is measured.

In step S140, the 3D perspective is calculated based on at least one of the screen curvature information and the viewer position information.

In step S150, the calculated 3D perspective is received and reflected on the received 3D image, and the 3D information included in the received 3D image is corrected.

In step S160, the 3D perspective corrected 3D image is displayed on the display unit 160. [

As described above, it is possible to identify the viewer by detecting the viewing position of the user, and to correct the received 3D image with an optimal 3D image according to the viewer's position and display it. Further, when a 3D image is displayed on a curved TV or a flexible display, the received 3D image may be corrected and displayed according to the changed curvature of the screen.

The above-described embodiments are merely illustrative, and various modifications and equivalents may be made by those skilled in the art. Accordingly, the true scope of protection of the present invention should be determined by the technical idea of the invention described in the following claims.

100: 3D display device
110:
120: viewer position detection unit
130: screen curvature measuring unit
132: load cell
134: load cell support
140: 3D perspective calculation unit
150:
160:
430:

Claims (15)

In a 3D display device,
A video input unit for receiving a 3D image;
A perspective calculation unit for calculating a 3D depth setting reference (3D perspective) based on at least one of the screen curvature information of the display device and the viewer's position information;
A rendering unit for correcting the depth of the received 3D image according to the calculated depth setting standard (3D perspective); And
And a display unit for displaying the corrected 3D image.
The method according to claim 1,
Wherein the position information of the viewer is obtained by at least one of a position sensor and a camera.
The method according to claim 1,
Further comprising a curvature measuring unit for measuring curvature information of the display device.
The method of claim 3,
Wherein the curvature measuring unit includes a plurality of load cells and is disposed on a back surface of the display unit.
5. The method of claim 4,
Wherein the display unit includes a flexible display unit.
The method according to claim 1,
Wherein the 3D depth setting reference (3D perspective) is calculated for each of a plurality of viewers.
The method according to claim 6,
Wherein the display unit includes an autostereoscopic display unit.
The method according to claim 1,
Wherein the 3D depth setting reference (3D perspective) is calculated based on the face of the viewer.
In the 3D image processing method,
Receiving a 3D image;
Measuring at least one of screen curvature information of a display device and position information of a viewer;
Calculating a 3D depth setting reference based on at least one of the measured screen curvature information and the viewer's location information;
Correcting the depth of the received 3D image according to the calculated depth perspective (3D perspective); And
And displaying the corrected 3D image on a display unit.
10. The method of claim 9,
Wherein the position information of the viewer is obtained by at least one of a position sensor and a camera.
10. The method of claim 9,
Wherein the screen curvature information of the display device is obtained by measuring a warp of the flexible display portion.
12. The method of claim 11,
Wherein the flexion measurement of the flexible display unit includes a plurality of load cells and is performed by a curvature measuring unit disposed on a rear surface of the display unit.
10. The method of claim 9,
Wherein the 3D depth setting reference (3D perspective) is calculated for each of a plurality of viewers.
14. The method of claim 13,
Wherein the 3D depth setting reference (3D perspective) is applied to an autostereoscopic display unit.
10. The method of claim 9,
Wherein the 3D depth setting reference (3D perspective) is calculated based on a viewer's face.

Images