KR20120015666A - A method for displaying a stereoscopic image and stereoscopic image playing device - Google Patents

Abstract

PURPOSE: A stereoscopic image reproducing device and a method thereof are provided to enable a user to watch an excellent stereoscopic image by changing an image depth according to a genre. CONSTITUTION: A 3D format generating unit(130) generates a second stereoscopic image by adjusting the depth of a first stereoscopic image based on stereoscopic image depth information corresponding to pre-stored genre information. A user input unit(155) receives an image reproduction request signal. The user input unit transmits a corresponding signal to a decoder unit and the 3D format generating unit. A memory unit(150) stores the stereoscopic image depth information corresponding to the genre information. A controller(135) outputs the second stereoscopic image.

Description

A method for displaying a stereoscopic image and stereoscopic image playing device}

The present invention relates to an apparatus and method for reproducing stereoscopic images.

Conventional two-dimensional (2D) displays have been common, but in recent years, interest in three-dimensional (3D) or three-dimensional image display is increasing. Such a three-dimensional display already existed, but the three-dimensional content itself was insufficient in quantity and the marketability was low due to the lack of display technology for quality three-dimensional content.

However, in recent years, as the production of three-dimensional content, which is advantageous for delivering realism and three-dimensional feelings, has been activated in the cultural domain and the like, the interest and technology for the three-dimensional display for viewing him are increasing. The increase in interest and technology for 3D content and display foretells the arrival of an era in which 3D images can be easily and comfortably enjoyed at home in the future.

Meanwhile, the 3D stereoscopic image is generated by synthesizing each of the 2D images according to a plurality of views of the subject by a specific rule. When the synthesized three-dimensional stereoscopic image is displayed on the stereoscopic apparatus, the stereoscopic image of a single view or a multiview can be viewed. Here, a method of making a stereoscopic image includes a method of photographing with a stereoscopic camera and a method of using a 3D modeling program.

An image depth (depth imange or disparity) exists between two-dimensional images of each viewpoint constituting the three-dimensional stereoscopic image. The image depth refers to the angle between the viewpoints of looking at the subject.

In general, since the image depth of the stereoscopic image display is already determined, the image depth angle is set according to the determined image depth. However, the visual depth can be different for each person, and depending on the nature and genre of the displayed image, a different three-dimensional feeling may be felt even for the same image depth.

Specifically, since the depth of the image is artificially created to express the stereoscopic feeling of the 3D stereoscopic image, even if the same image depth is felt comfortably depending on the user, the phenomenon of feeling dizzy and eye fatigue varies depending on the observer. Will appear.

Therefore, when the user observes the 3D image, if the image depth does not match the user, the user may feel dizzy or tired of the eyes.

It is an object of the present invention to provide a stereoscopic image reproducing apparatus and a stereoscopic image reproducing method which can adjust the stereoscopic sense automatically or by a user's operation by changing the image depth according to the genre so that a comfortable and excellent stereoscopic image can be viewed. .

In accordance with an embodiment of the present invention, a stereoscopic image reproducing apparatus includes: a decoder unit for decoding input image information, a first stereoscopic image by combining the left eye image and the right eye image which are matched in time, and receiving the 3D format generation unit for generating a second stereoscopic image by adjusting the depth of the generated first stereoscopic image based on the stereoscopic depth information corresponding to the prestored genre information when the genre information exists in the image information. A user input processor for receiving a reproduction request signal and transmitting a corresponding signal to the decoder and the 3D format generator, a memory unit for storing stereoscopic image depth information corresponding to the genre information, and a 3D format generator; It includes a control unit for controlling to output a two-dimensional image.

The stereoscopic image reproducing method may further include receiving image information including a left eye image and a right eye image for generating a stereoscopic image, and generating a stereoscopic image generated by combining the left eye image and the right eye image. And when genre information exists in the received image information, adjusting and displaying the generated stereoscopic image depth based on stereoscopic image depth information corresponding to the prestored genre information.

On the other hand, the reproduction method may be implemented as a computer-readable recording medium recording a program for execution in a computer.

According to an embodiment of the present invention, the depth of the stereoscopic image is automatically or adjusted by the user's operation according to the genre of the input image information, thereby not only diminishing dizziness and eye fatigue caused by the stereoscopic image observation, but also You can feel a more realistic three-dimensional feeling.

1 is a block diagram of a three-dimensional image display device according to an embodiment of the present invention.
2 is an exemplary view showing an example of a transmission format of a stereoscopic image according to an embodiment of the present invention.
3 is a flowchart illustrating a stereoscopic image reproduction method according to an embodiment of the present invention.
4 and 5 illustrate a user interface according to an embodiment of the present invention.
6 is a diagram illustrating stereoscopic image depth information according to a genre in a stereoscopic image reproducing method according to an exemplary embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described in detail with respect to the present invention. Like numbers refer to like elements throughout.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise. In addition, the terms "... unit", "... group", "module", etc. described in the specification mean a unit for processing at least one function or operation, which is hardware or software or a combination of hardware and software. It can be implemented as.

The term 3-D or 3D is used to describe a visual representation or display technique that attempts to play a three-dimensional video with an optical illusion of depth. For the image of the left eye and the image of the right eye, the observer's visual cortex interprets the two images into one three-dimensional image.

The three-dimensional (3D) display technology employs the technology of 3D image processing and representation for a device capable of 3D image display. Optionally, a device capable of displaying 3D images may require the use of a special viewing device to effectively provide the viewer with three-dimensional images.

Examples of 3D image processing and representation include stereoscopic image / video capture, multi-view image / video capture using multiple cameras, and processing of two-dimensional image and depth information. Examples of display devices capable of displaying 3D images include liquid crystal displays (LCDs), digital TV screens, and computer monitors having appropriate hardware and / or software supporting 3D display technology. Examples of special observation devices include specialized glasses, goggles, headgear, eyewear, and the like.

Specifically, 3D image display technology includes anaglyph stereoscopic images (commonly used with passive red blue glasses), polarized stereoscopic images (usually used with passive polarized glasses), and alternating-frame sequencing. (Usually used with active shutter eyeglasses / headgear), autostereoscopic displays with lenticular or barrier screens, and the like. Various ideas and features described below are applicable to such stereoscopic image display technology.

Some 3D image display technologies may use rotating or alternating optical devices, for example segmented polarizers attached to a color filter wheel, which requires synchronization with each other. Another 3D image display technology is a digital light processor based on a Digital Micromirror Device (DMD) using a rotatable Microscopic Mirror, arranged in a rectangular array corresponding to the pixels of the image to be displayed. Digital Light Processor (DLP) can be used.

On the other hand, new types of standards related to the rendering and display technology of stereoscopic images (particularly 3D TVs) are currently being developed by various companies, consortiums and organizations, such as The Society Of Motion Picture And Television Engineers (CEA), Consumer Electronics Association (CEA), 3d @ Home Consortium, and International Telecommunication Union (ITU). In addition, other standardization groups such as DVB, BDA, ARIB, ATSC, DVD Forum, IEC, etc. are participating. Moving Picture Experts Group (MPEG) is involved in 3D video coding of multidimensional video, stereoscopic video, and two-dimensional video with depth information, and is now multiview video coding for MPEG-4 Advanced Video Coding (AVC). The Multiview Video Coding Extension is being standardized. Stereoscopic image coding and stereoscopic distribution formatting include color shifting, pixel sub-sampling (side-by-side, checkerboard, and quincunx). , And Advanced Video Coding (2D + Delta, 2D + Metadata, 2D with Depth Information). The spirit and features described herein are applicable to this standard.

In addition, at least some of the spirit and features of the invention described herein relate to 3D image display technology described in terms of a video reproduction display environment for digital images or 3D TVs. However, such details are not intended to limit the various features described herein and are applicable to other types of display technologies and devices. For example, 3D TV technology can be applied to Blu-ray ^TM , console games, cable and IPTV transmissions, mobile phone content delivery, as well as TV broadcasts, where other types of TVs, Must be compatible with set-top boxes, Blu-ray devices (eg, Blu-Ray Disk players), DVD players, and TV content distributors.

Meanwhile, a conventional 2D display generates only one image. On the other hand, in the 3D image display device, one 3D image is generated from the left image and the right image.

The stereoscopic image display alternately outputs a left image and a right image to create a three-dimensional space. The left image and the right image should be delivered to the left eye and the right eye, respectively. More than 60 frames per second are sent to the device alternately, so that both images can be combined and displayed on the screen at a frequency of 120 Hz to produce a three-dimensional image without flickering.

Hereinafter, a stereoscopic image reproducing apparatus and a reproducing method according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

A configuration of a stereoscopic image reproducing apparatus to which an embodiment of the present invention is applied will be described with reference to FIG. 1. 1 is a block diagram of a three-dimensional image display device according to an embodiment of the present invention.

The data receiver 105 generates a transport stream (TS) or a packetized stream by loading image data from a storage medium such as airwaves or a disk. In general, image data transmitted by air or disk is formatted in a transport stream format of a moving picture expert group (MPEG) system.

In particular, MPEG-2 is a processing method for compressing high-definition video. It is widely used in various fields such as storage media such as DVD (Digital Verstiale Disk), digital TV broadcasting such as satellite cable, terrestrial wave, storage device, and video transmission over network. It is used.

The generated transport stream is delivered to the TS / PS analyzer 110. The TS / PS analyzer 110 generates an elementary stream including both image information and audio information by performing filtering and parsing to filter packets to be reproduced in the transport stream.

The elementary stream output from the TS / PS analyzer 110 is decoded by a decoder 115 suitable for the corresponding codec and outputs an image frame. The decoder 115 also decodes the audio information.

On the other hand, in a stereoscopic image reproducing apparatus using a multiview video codec (MVC), a demultiplexer function is added to an output portion of the decoder 115 so that the image data transmitted in a single stream is left. It is divided into / right image is transmitted to the image enhancement unit 120. At this time, the left image and the right image are synchronized using time stamp information.

Thereafter, the image frame is subjected to de-interlacing or image reinforcement processing in the image reinforcement unit 120. In the 2D image reproducing apparatus, the image frames output from the image reinforcement unit 120 are transmitted to the transmission data generation unit ( 140, and if necessary, it is overformatted to be overlaid with other video or transmitted to a device such as a TV.

Thereafter, the transmission unit 145 such as a high definition multimedia interface (HDMI) transmits the image data to a device for displaying an image such as a TV. In this case, when the reproducing apparatus is integrated with the TV, the reproducing apparatus may be directly transmitted to the display unit without passing through the transmission unit 145.

On the other hand, in the stereoscopic image reproducing apparatus, after the image reinforcement unit 120 is pulled down (pull-down processing 125), it is transferred to the 3D format generation unit 130 to generate a 3D image format. 3, the 3D format image data is processed in a form that can be transmitted to a device for displaying an image such as a TV and then transmitted through the transmission unit 145.

In particular, in the embodiment of the present invention, the memory unit 150 of the stereoscopic image reproducing apparatus stores the received image information and information on various broadcast programs, and stores the stereoscopic image depth information corresponding to the genre information of the input image information. Can be. In addition, the 3D format generation unit 130 may adjust the depth of the stereoscopic image generated according to the presence or absence of genre information on the input image information to generate and output a new stereoscopic image.

 The user input processing unit 155 controls the device according to a user input input through an input button, a remote controller, a network, or the like. In addition, when the display unit is a touch screen, the user input processing unit 155 may be performed by touching the display unit. More specifically, the user input processing unit 155 may perform various control operations including control of playback, stop and double speed operations for the decoder unit 15, transmission data resolution and interface mode control for the transmission data generator 140, and the like. To perform.

The user input processor 155 according to an embodiment of the present invention performs a function of receiving a depth adjustment request signal for adjusting the depth of the output stereoscopic image.

Hereinafter, the thumbnail display operation according to an embodiment of the present invention in the above-described stereoscopic image reproducing apparatus will be described in detail.

2 is an exemplary view showing an example of a transmission format of a stereoscopic image according to an embodiment of the present invention. Looking at the three-dimensional image to explain the present invention, as follows.

Stereoscopic images include stereo (or stereoscopic) images considering two viewpoints and multi-view images considering three or more viewpoints.

The stereo image refers to a pair of left and right images obtained by photographing the same subject with a left camera and a right camera spaced apart by a certain distance. The multi-view image refers to three or more images obtained by photographing the same subject with three or more cameras having a constant distance or angle.

There are two formats of a stereo video transmission format: a single video stream format and a multi video stream format. In the embodiment of the present invention, a single video stream format will be described.

The single video stream format includes side by side of FIG. 2 (a). Top / down of FIG. 2 (b), interlaced of FIG. 2 (c), frame sequential of FIG. 2 (d), checker board of FIG. 2 (e) board).

In the side-by-side format of FIG. 2A, the left image L and the right image R are each half subsampled in the horizontal direction, and the sampled left image L and the right image ( This is the case where one stereo image is created by placing R) on the left and right sides respectively.

In the top / down format of FIG. 2 (b), the left image L and the right image R are each sub-sampled 1/2 in the vertical direction, and the sampled left image L and the right image R are respectively. This is the case where one stereo image is created by placing them at the top and bottom.

In the interlaced format of FIG. 2C, the left image L and the right image R are each half subsampled in the vertical direction, and the pixels and the right image R of the sampled left image L are respectively sub-sampled. The pixels are positioned alternately in each line to make a stereo image, or the left image L and the right image R are each half subsampled in the horizontal direction, and the pixels and the right image of the sampled left image L are This is a case where the (R) pixels are alternately positioned one by one to create a stereo image.

The frame sequential format of FIG. 2 (d) does not subsample the left image (L) and the right image (R), but instead creates a stereo image by sequentially placing each image as one frame. to be.

In the checker board format of FIG. 2E, the left image L and the right image R are 1/2 subsampled in the vertical and horizontal directions, respectively, and the pixels and the right image R of the sampled left image L are sampled. ) Is a case where stereo pixels are created by alternately positioning pixels one by one.

A method of reproducing a stereoscopic image according to an exemplary embodiment of the present invention will be described with reference to FIGS. 3 to 5. 3 is a flowchart illustrating a stereoscopic image reproduction method according to an embodiment of the present invention. 4 and 5 illustrate a user interface according to an embodiment of the present invention.

Referring to FIG. 3, the controller 135 receives image information including a left eye image and a right eye image for generating a stereoscopic image through the data receiving unit 105 (S210). The image information may include genre information about the image information, in addition to the left eye image and the right eye image, which coincide in time.

The controller 135 generates a stereoscopic image by combining a left eye image and a right eye image through the 3D format generator 130 (S220).

On the other hand, the controller 135 determines whether there is genre information for the image information in the received image information (S230), and if there is genre information for the image information, the control unit 135 is the genre In response to the information, the stereoscopic depth information corresponding to the genre information stored in the memory unit 150 is transmitted to the 3D format generation unit 130.

The 3D format generation unit 130 adjusts the depth of the stereoscopic image generated in step S220 based on the stereoscopic image depth information corresponding to the genre information stored in the memory unit 150 (S240). The stereoscopic image whose depth value is adjusted based on the stereoscopic image depth information corresponding to the genre information is displayed through a display unit (not shown) (S250). Here, the 3D image depth information refers to a depth value according to genre information about the received image information. That is, since the stereoscopic image may be displayed differently according to the genre of the received image information, when generating and displaying the stereoscopic image, the information for displaying the optimized stereoscopic image is displayed by considering the genre of the received image information. to be.

In addition, the three-dimensional image depth information is artificial to express the three-dimensional feeling of the three-dimensional image, and may be set differently according to the genre of the received image information to a value that is comfortable enough to feel the three-dimensional feeling according to the user.

Here, the steps S230 to S240 may be performed by setting a default value in the 3D image reproducing apparatus. As shown in FIG. 4, the user automatically adjusts the depth adjustment 310 in the menu through the user interface. This may be performed when the mode 320 is selected. Therefore, when the manual adjustment mode 320 is selected for the depth adjustment 310, the performance of steps S230 to S240 may be omitted.

Meanwhile, when the depth control request signal for adjusting the depth of the stereoscopic image displayed in step S250 is input through the user input processor 155, the controller 135 corresponds to the depth adjustment request signal. The depth of the image is readjusted and displayed on the display unit (S232). Here, the depth adjustment request signal may be input when the user selects the manual adjustment mode 320 for the depth adjustment 310 in the menu through the user interface, as shown in FIG. 5A. When the user selects the manual adjustment mode 320 in FIG. 5 (a), as shown in FIG. 5 (b), the user may select the stereoscopic depth information according to the genre more conveniently. Accordingly, various stereoscopic depth information 340 is displayed, and the user may input the depth adjustment request signal by selecting any one of the stereoscopic image depth information 340 displayed in this way.

In this case, the depth control request signal may not be a stereoscopic image in which an optimal stereoscopic feeling may be felt by the user even if the depth adjustment request signal is displayed by adjusting the depth of the stereoscopic image according to the genre information on the received image information. Accordingly, the user may additionally adjust the depth of the stereoscopic image with respect to the stereoscopic image automatically adjusted in depth, thereby generating and displaying a stereoscopic image that can feel an optimal stereoscopic sense suitable for the user's eyes.

In operation S230, when genre information about the image information does not exist, the controller 135 determines whether a depth control request signal is input through the user input processor 155 (S231). . As a result of the determination, when the depth adjustment request signal is not received, the stereoscopic image generated in step S220 is displayed on the display unit (not shown) (S250). On the other hand, when the depth adjustment request signal is received as a result of the determination, the 3D format generation unit 130 transmits the depth information corresponding to the genre information according to the depth control request signal.

The 3D format generation unit 130 is generated in step S220 based on the stereoscopic image depth information 340 selected from the stereoscopic image depth information 340 according to the genre on the user interface illustrated in FIG. 5B. The depth of the stereoscopic image is adjusted (S233). The stereoscopic image whose depth value is adjusted based on the stereoscopic image depth information corresponding to the genre information is displayed through a display unit (not shown) (S250).

6 is a diagram illustrating stereoscopic image depth information according to a genre in a stereoscopic image reproducing method according to an exemplary embodiment of the present invention. As shown in FIG. 6, various stereoscopic depth information according to each genre such as drama or movie may be stored in advance. The stereoscopic depth information may be information according to a change in the depth value according to the stereoscopic image playback time.

The stereoscopic image depth information for each genre may be used to adjust the depth of the stereoscopic image when genre information is included in the received image information, as in step S240, and the depth adjustment as in step S231 or S232. When the request signal is input, it may be used to adjust the depth of the stereoscopic image.

In this way, the user directly selects the depth information of the stereoscopic image according to the genre provided through the genre information included in the received image information or through the user interface to determine the depth of the stereoscopic image that can feel the optimal stereoscopic feeling for the user's eyes. I can regulate it.

The above-described stereoscopic image reproducing method according to the present invention may be stored in a computer-readable recording medium that is produced as a program for execution on a computer, and examples of the computer-readable recording medium include ROM, RAM, CD-ROM. Magnetic tapes, floppy disks, optical data storage devices, and the like, and also include those implemented in the form of carrier waves (eg, transmission over the Internet).

The computer readable recording medium can be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. In addition, functional programs, codes, and code segments for implementing the control method can be easily inferred by programmers in the art to which the present invention belongs.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims (8)

In the stereoscopic image reproducing apparatus for receiving a left eye image and a right eye image to form a stereoscopic image,
A decoder for decoding the input image information;
A first stereoscopic image is generated by combining the left eye image and the right eye image, which are matched in time, and when genre information exists in the received image information, based on stereoscopic image depth information corresponding to prestored genre information. A 3D format generating unit generating a second stereoscopic image by adjusting a depth of the generated first stereoscopic image;
A user input processor configured to receive an image playback request signal and transmit a corresponding signal to the decoder and the 3D format generator;
A memory unit for storing stereoscopic image depth information corresponding to the genre information;
And a controller for controlling to output the second stereoscopic image generated by the 3D format generator. The method of claim 1,
And the control unit controls to output the first stereoscopic image when genre information does not exist in the received image information. The method of claim 2,
When the user input processor receives a depth adjustment request signal for adjusting the depth of the output stereoscopic image,
The 3D format generation unit generates a third stereoscopic image by adjusting the depth of the first stereoscopic image based on stereoscopic depth information corresponding to preset genre information corresponding to the depth control request signal, and the controller generates the third stereoscopic image. A stereoscopic image reproducing apparatus for controlling to output a third stereoscopic image. The method of claim 1,
When the user input processor receives a depth adjustment request signal for adjusting the depth of the output stereoscopic image,
The 3D format generator generates a fourth stereoscopic image by adjusting the depth of the second stereoscopic image based on stereoscopic image depth information corresponding to preset genre information corresponding to the depth control request signal, and the controller generates the fourth stereoscopic image. A stereoscopic image reproducing apparatus for controlling to output a fourth stereoscopic image. The method of claim 1,
And stereoscopic image depth information corresponding to the genre information previously stored in the memory unit is information according to a change in depth value over time. In the stereoscopic image reproduction method of receiving a left eye image and a right eye image to form a stereoscopic image,
Receiving image information including a left eye image and a right eye image for generating a stereoscopic image;
Generating a stereoscopic image generated by combining the left eye image and the right eye image;
And when the genre information exists in the received image information, adjusting and displaying a depth of the generated stereoscopic image based on stereoscopic image depth information corresponding to the prestored genre information. The method of claim 6,
When the depth adjustment request signal for adjusting the depth of the displayed stereoscopic image is input, the depth of the displayed stereoscopic image is adjusted based on the stereoscopic image depth information corresponding to the genre information preset according to the depth adjustment request signal. The stereoscopic image reproduction method further comprising the step of displaying. The method of claim 6,
And stereoscopic image depth information corresponding to the genre information is information according to a change in depth value over time.

Images