KR100586029B1 - Apparatus and Method for Display of Stereo-Scopic Video - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a stereoscopic image display apparatus and a method thereof.

2. The technical problem to be solved by the invention

According to the present invention, after receiving a 3D image of various formats such as a field-by-field format, a top-down format, a side-by-side format, and the like, the format of the received 3D image is determined using edge information. The present invention provides a stereoscopic image display apparatus and a method for normally outputting 3D images of various formats by performing interpolation for a corresponding format.

3. Summary of Solution to Invention

According to an aspect of the present invention, there is provided a stereoscopic image display apparatus comprising: image input means for receiving a 3D image in various formats; After calculating edge information from the 3D image input through the image input means, the 3D image is determined to be in a side-by-side format as the calculated edge information appears strongly in the vertical direction from the center. The three-dimensional image is determined in a top-down format as the calculated edge information appears strongly in the horizontal direction from the center, and the calculated edge information appears strongly in the horizontal direction and uniformly distributed in the vertical direction. Image distribution means for determining the three-dimensional image in a field-by-field format and distributing it to the interpolation means; A plurality of interpolation means for interpolating each of the 3D video signals distributed by the image distribution means according to a corresponding format; Image output means for transferring the left / right image of the original resolution interpolated by the interpolation means to a display driving means; Display driving means for driving the display means to independently display the left and right video signals received from the video output means; And said display means for independently displaying left / right image signals of original resolution from said display driving means.

4. Important uses of the invention

The present invention is used in image processing systems and the like.

3D image, various formats, interpolation, 3D image signal processing, original resolution, HMD (Head Mounted Display)

Description

Apparatus and Method for Display of Stereo-Scopic Video}             

1A to 1C are exemplary diagrams illustrating an image format of a general 3D image.

2 is a block diagram of an embodiment of a stereoscopic image display device according to the present invention;

3 is a detailed configuration diagram of an embodiment of a 3D image signal processor of a 3D image display apparatus according to the present invention;

4A to 4C are diagrams illustrating an embodiment of interpolation of a 3D image signal processing unit according to the present invention;

5 is a flowchart illustrating a method of displaying a stereoscopic image according to the present invention.

* Explanation of symbols for the main parts of the drawings

210: image signal input unit 220: 3D image signal processing unit

230: liquid crystal display (LCD) drive unit 240: liquid crystal display (LCD)

The present invention relates to a stereoscopic image display device and a method thereof, and more particularly, to an edge according to input of a 3D image in various formats such as a field-by-field format, a top-down format, a side-by-side format, and the like. The present invention relates to a 3D image display apparatus and a method for normally outputting 3D images of various formats by determining a format of an input 3D image using information and performing interpolation according to a corresponding format.

Unlike 2D plane information, a 3D stereoscopic image is a more realistic image that simultaneously provides depth and spatial shape information. That is, the 3D stereoscopic image is an image of a spatial recognition concept that is synthesized in a process in which the human eyes (that is, the left and right eyes) recognize the environment having a volume that has already been learned and organize in the brain. In other words, it provides a sense of presence, realism and virtual reality as if it were seen in the field.

The three-dimensional display is a three-dimensional display technology that can express a three-dimensional feeling such as viewing the real by displaying a three-dimensional stereoscopic image with a sense of depth that was impossible in the conventional two-dimensional flat panel display.

The three-dimensional image display method includes a three-dimensional image having information before and after (ie, depth) of the object and a three-dimensional image having side information of the object.

First, stereoscopic image display is a technique based on the principle of binocular disparity effect, and depends on the technique of how to properly present and fuse each two-dimensional image corresponding to both eyes independently to the left and right eyes.

There are two types of presenting techniques: the use of special glasses and the use of highly directional display surfaces.

The three-dimensional image display technology includes a multi-lens system using a special lens plate, a depth sampling method that is a variable focus mirror method, and a holographic method that records and reproduces the amplitude and phase of light.

1A to 1C are exemplary diagrams illustrating an image format of a general 3D image.

As shown in FIGS. 1A to 1C, a 3D image is configured in various image formats.

First, the field-by-field format of FIG. 1A shows left and right images divided into an odd field and an even field, and the top down of FIG. 1b. ) Shows left and right images up and down. In addition, the side-by-side of FIG. 1C shows left and right images on both sides.

The conventional three-dimensional image format as described above is composed of about half the resolution of the original image. That is, the images of the various image formats as above only have information about 50% of the left and right images.

For example, when displaying a three-dimensional image composed of a field-by-field through a head mounted display (HMD), the odd field and the even field are left. When displayed on a liquid crystal display (LCD) device, an observer cannot observe a normal original image.

delete

That is, the conventional 3D image display apparatus has a problem that it is unable to process 3D images of various formats.

The present invention has been proposed in order to solve the above problems, and the edge information according to the input of the three-dimensional image of various formats such as field-by-field format, top-down format, side-by-side format, etc. It is an object of the present invention to provide a stereoscopic image display apparatus and a method for normally outputting a 3D image of various formats by determining a format of an input 3D image and then performing interpolation according to a corresponding format.
Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided a stereoscopic image display apparatus comprising: image input means for receiving a 3D image of various formats; After calculating edge information from the 3D image input through the image input means, the 3D image is determined to be in a side-by-side format as the calculated edge information appears strongly in the vertical direction from the center. The three-dimensional image is determined in a top-down format as the calculated edge information appears strongly in the horizontal direction from the center, and the calculated edge information appears strongly in the horizontal direction and uniformly distributed in the vertical direction. Image distribution means for determining the three-dimensional image in a field-by-field format and distributing it to the interpolation means; A plurality of interpolation means for interpolating each of the 3D video signals distributed by the image distribution means according to a corresponding format; Image output means for transferring the left / right image of the original resolution interpolated by the interpolation means to a display driving means; Display driving means for driving the display means to independently display the left and right video signals received from the video output means; And the display means for independently displaying the left / right image signals of the original resolution from the display driving means.

On the other hand, the method of the present invention, in the three-dimensional image display method, receiving a three-dimensional image of various formats; After calculating edge information from the received 3D image, the 3D image is determined as a side-by-side format as the calculated edge information is strongly displayed in the vertical direction at the center, and the calculated The 3D image is determined in the top-down format as edge information is strongly displayed in the horizontal direction from the center, and the 3D image is determined as the calculated edge information is strongly displayed in the horizontal direction and uniformly distributed in the vertical direction. Determining a field-by-field format and distributing it to corresponding interpolation means; An interpolation step of interpolating the distributed 3D video signal according to a corresponding format; And independently displaying the left and right images having the original resolution interpolated.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram of an embodiment of a stereoscopic image display device according to the present invention.

As shown in FIG. 2, the stereoscopic image display apparatus according to the present invention includes a video signal input unit 210 and a digital image output from the video signal input unit 210 for receiving various video signals and converting them into digital video signals. 3D image signal processor 220 and 3D image signal processor 220 for obtaining high resolution left and right image signals through image signal processing such as interpolation, etc. Display the liquid crystal display (LCD) driver 230 for displaying the image signal on the liquid crystal display (LCD) 240, and the left and right image signal output from the liquid crystal display (LCD) driver 230 It includes a liquid crystal display (LCD) unit 240 for.

As described above, the stereoscopic image display apparatus according to the present invention will be described in more detail as follows.

First, the video signal input unit 210 includes various video signals, that is, video signals output from a computer (for example, VGA, XGA, etc.) and all standard signals of video (for example, NTSC, PAL, SECAM, S-VHS). Etc.) to receive all video signals. The various three-dimensional or two-dimensional image signals input by the image signal input unit 210 are converted into digital image signals and output.

In addition, the digital 3D image signals of various image formats output from the image signal input unit 210 are input to the 3D image signal processor 220. Then, the 3D image signal processor 220 performs 3D image signal processing such as interpolation on the input 3D image signal to obtain a normal left and right image having the original resolution.

The high resolution 3D left and right image signals obtained by the 3D image signal processing unit 220 are input corresponding to left and right independent LCD display devices and displayed on the left and right LCD displays, respectively. Will be.

As such, by converting a three-dimensional image composed of half the resolution of the original resolution having various formats into a left / right independent image of the original resolution and displaying the image on a left / right liquid crystal display (LCD), the observer Observe dimensional images.

On the other hand, when the input image is two-dimensional, it is possible to display the two-dimensional image independently of the left / right image by making the two-dimensional image the same image left / right.

3 is a detailed block diagram of an example of a 3D image signal processor of a 3D image display apparatus according to the present invention.

As shown in FIG. 3, the 3D image signal processor 220 according to the present invention distributes an input image according to the 3D image format in the image distribution module 310 and the image distribution module 310. An interpolation module 320 for interpolating the video signals according to the respective video formats, and the left / right video signals of the original resolution interpolated by the interpolation module 320. And an image output module 330 for outputting.

The 3D image signal processor 220 performs a function of generating a left / right image having a raw resolution from various 3D image formats having about half the resolution of the original image.

At this time, the input 3D image format is composed of various formats such as field-by-field, top-down, and side-by-side. It is.

In addition, the conventional 3D image format is composed of half the resolution of the original image, the existing 3D image display device is composed of several formats that are not unified.

The video signals of the various three-dimensional image formats as described above have only information on 50% of the left and right images. Therefore, in order to provide an image, such as an original image, to each liquid crystal display (LCD), the original image is reconstructed by using interpolation for each image format.

That is, the image signal input from the external input terminal is separated by the image format by the image distribution module 310 and then restored as the original image by the interpolation module 320 using interpolation for each characteristic. . The high resolution normal left and right image signals are sent to each of the left and right liquid crystal display (LCD) drivers so that they can be displayed on each of the left and right liquid crystal displays (LCD).

By the above method, the user can view the 3D image in various formats.

4A to 4C are diagrams illustrating an embodiment of interpolation of the 3D image signal processor according to the present invention.
First, each interpolation according to the following three-dimensional image format is a well-known technique that is generally well-known, and a detailed description thereof will not be provided. In general, however, in the case of a 3D image in a field-by-field format, the left and right images are output by interpolating the left and right images input in units of fields in the vertical direction, respectively, and in the case of a 3D image in a top-down format, Since the left and right images exist in up and down within one frame, the left and right images are separated up and down, and the left and right images are output by double-interpolating each of them in the vertical direction. Since the image exists in the left and right format, it is divided into left and right and interpolated twice in the horizontal direction to output the left and right images.

Interpolation of the 3D image signal processing unit restores a normal original image by using interpolation suitable for a 3D image format.

That is, an edge is calculated from the input 3D image, the image format is recognized according to the calculated information, and interpolation is performed according to the image format.

Here, when edge information calculated from the input 3D image appears strongly in the vertical direction from the center, the input 3D image is recognized as a side-by-side image format, and the center is recognized. In the case of strong display in the horizontal direction, the input 3D image is recognized as a top-down image format. When the edge information appearing strongly in the horizontal direction and the edge information in the horizontal direction are uniformly distributed in the vertical direction, the input 3D image is recognized as a field-by-field image format. do. However, if it is not distributed in any single direction, the input image is recognized in two dimensions.

FIG. 4A illustrates a case where the 3D image format is a field-by-field, and generates an odd field by interpolating an even field. By generating an Even Field by interpolating an Odd Field, left and right images having an original resolution are obtained. That is, since the original image of the 3D image of the field-by-field format is the left image of the even line and the right image of the odd line, the top-down format is separated from each of the even image and the odd image. Is the same as the three-dimensional image of.

FIG. 4B illustrates a case in which the 3D image format is top-down, interpolating an image of an upper region to obtain an image having a double resolution of twice the resolution, and interpolating an image of a lower region. By interpolating to obtain the original resolution image having twice the resolution, the left / right image of the original resolution is obtained. That is, since the original image of the 3D image of the top-down format is vertically double-sampled, the image is vertically up-sampled, ie, vertical interpolation, to display the 3D image of the original resolution. .

FIG. 4C illustrates a case in which the 3D image format is side-by-side. Interpolation of an image of the left region may be performed to obtain an original resolution image having twice the resolution, and a right region. By interpolating the image of the image to obtain the original resolution image of twice the resolution, the left / right image of the original resolution is obtained. That is, since the original image of the 3D image in the side-by-side format is twice down-sampled horizontally, up-sampling in the horizontal direction to display the 3D image of the original resolution, that is, horizontal interpolation (Horizontal Interpolation) )do.

5 is a flowchart illustrating a method of displaying a stereoscopic image according to the present invention.

As shown in FIG. 5, the stereoscopic image display method according to the present invention first receives a low resolution image signal expressed in various formats (501), and interpolates the received image according to the image format. The left / right image having the original resolution is obtained (502). The obtained left and right images are displayed on the left and right liquid crystal display (LCD) by the left and right liquid crystal display (LCD) driving unit (503).

That is, the stereoscopic image display method according to the present invention may display more various three-dimensional stereoscopic image contents than conventional display methods.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

As described above, according to the present invention, when a 3D image of various formats such as a field-by-field format, a top-down format, a side-by-side format, and the like are received, By determining the format and performing interpolation for the format, the 3D image of various formats can be output normally.

Claims (10)

delete delete delete In the stereoscopic image display device, Image input means for receiving a three-dimensional image of various formats; After calculating edge information from the 3D image input through the image input means, the 3D image is determined to be in a side-by-side format as the calculated edge information appears strongly in the vertical direction from the center. The three-dimensional image is determined in a top-down format as the calculated edge information appears strongly in the horizontal direction from the center, and the calculated edge information appears strongly in the horizontal direction and uniformly distributed in the vertical direction. Image distribution means for determining the three-dimensional image in a field-by-field format and distributing it to the interpolation means; A plurality of interpolation means for interpolating each of the 3D video signals distributed by the image distribution means according to a corresponding format; Image output means for transferring the left / right image of the original resolution interpolated by the interpolation means to a display driving means; Display driving means for driving the display means to independently display the left and right video signals received from the video output means; And The display means for independently displaying the left / right image signals of the original resolution from the display driving means; Stereoscopic image display device comprising a. The method of claim 4, wherein The interpolation means, In the case of a 3D image in a field-by-field format, the left and right images having the original resolution are output by interpolating the left and right images input in the unit of a field twice in the vertical direction, respectively. In the case of the 3D image of the Top-Down format, the left and right images are located up and down within one frame, and the left and right images are separated by up and down, and the left and right images are interpolated twice in the vertical direction. In the case of 3D image of side-by-side format, the left and right images exist in one frame from side to side, and the left and right images are separated by left and right, and the left and right images are interpolated twice in the horizontal direction. Stereoscopic display device characterized in that. delete delete delete In the stereoscopic image display method, Receiving a 3D image in various formats; After calculating edge information from the received 3D image, the 3D image is determined as a side-by-side format as the calculated edge information is strongly displayed in the vertical direction at the center, and the calculated The 3D image is determined in the top-down format as edge information is strongly displayed in the horizontal direction from the center, and the 3D image is determined as the calculated edge information is strongly displayed in the horizontal direction and uniformly distributed in the vertical direction. Determining a field-by-field format and distributing it to corresponding interpolation means; An interpolation step of interpolating the distributed 3D video signal according to a corresponding format; And Independently displaying the interpolated original resolutions of the left and right images Stereoscopic image display method comprising a. The method of claim 9, The interpolation step, In the case of a 3D image in a field-by-field format, the left and right images having the original resolution are output by interpolating the left and right images input in the unit of a field twice in the vertical direction, respectively. In the case of the 3D image of the Top-Down format, the left and right images are located up and down within one frame, and the left and right images are separated by up and down, and the left and right images are interpolated twice in the vertical direction. In the case of 3D image of side-by-side format, the left and right images exist in one frame from side to side, and the left and right images are separated by left and right, and the left and right images are interpolated twice in the horizontal direction. Stereoscopic image display method characterized in that.

Images