KR20120056647A - Method and apparatus for transmitting 3-dimensional caption, method and apparatus for displaying 3-dimensional caption - Google Patents

Abstract

PURPOSE: A 3D caption transmitting method and a device thereof, and a 3D caption display method and a device thereof are provided to reset a 3D caption and enable a user to watch 3D images with a proper 3D caption. CONSTITUTION: A receiving device receives image information and caption information(S610). The receiving device receives caption control information(S620). The receiving device resets the caption information by the caption control information according to a taste of a user(S630). The receiving device generates a 3D image using the reset caption information and the image information(S640).

Description

METHOD AND APPARATUS FOR TRANSMITTING 3-DIMENSIONAL CAPTION, METHOD AND APPARATUS FOR DISPLAYING 3-DIMENSIONAL CAPTION}

The present invention relates to 3D video broadcasting, and more particularly, to a 3D subtitle transmission method and apparatus, and a 3D subtitle display method and apparatus.

Recently, three-dimensional (3D) video broadcasting has been in the spotlight. Currently, 3D video broadcasting transmits two images, each viewed by the left and right eyes of a person, and by viewing polarized glasses or time-division, each eye sees a different image. Create

For example, 3D video broadcasting may need to transmit subtitles along with video, such as foreign language movie broadcasting. In this case, the subtitles should be transmitted so that they can be seen in three dimensions. Subtitles are generally produced separately from the 3D video, then added to the 3D video and then transmitted. Such separately produced subtitles are often inconsistent with 3D video, and as a result, viewers have a disadvantage in that eye fatigue increases.

In 3D video broadcasting, there is a need for a subtitle transmission method that can increase viewer visibility and reduce eye fatigue.

The present invention provides a method and apparatus for transmitting captions and a method and apparatus for displaying captions that can improve viewer visibility and reduce eye fatigue in 3D stereoscopic image broadcasting.

According to an aspect of the present invention, there is provided a method of transmitting a 3D subtitle to generate depth information of the first image and depth information of the second image with respect to a first image and a second image of a 3D image. step; Generating a 3D subtitle based on depth information of the first image and depth information of the second image; And transmitting subtitle information about the 3D subtitle, wherein the 3D subtitle is a subtitle synchronized with the 3D image, and the subtitle information is depth information about the first image and depth information about the second image. Characterized in that it comprises a.

The first image and the second image may be images captured by different viewpoints of the same object.

The 3D subtitle transmission method may further include transmitting image information of a 3D image, wherein the image information includes image information of the first image and image information of the second image. The image information may further include depth information of the first image and depth information of the second image.

According to another aspect of the present invention, a three-dimensional (3D) subtitle display method comprising the steps of: receiving subtitle information; Receiving subtitle control information; Changing the caption information according to the caption control information; And displaying 3D captions according to the changed caption information, wherein the caption information includes depth information of the first image and depth information of the first image with respect to the first and second images constituting the 3D image. And depth information, wherein the caption control information is information for changing at least one of depth information of the first image and depth information of the second image.

The first image and the second image may be images captured by different viewpoints of the same object.

The caption control information may be information for increasing or decreasing depth information for the first image and depth information for the second image at the same ratio.

The 3D caption display method may further include receiving image information of the 3D image, wherein the image information may include image information of the first image and image information of the second image. The image information may further include depth information of the first image and depth information of the second image.

According to another aspect of the present invention, a three-dimensional (3D) subtitle transmission apparatus generates depth information on the first image and depth information on the second image with respect to the first and second images constituting the 3D image. A 3D image generating unit; A caption generating unit generating caption information including depth information of the first image and depth information of the second image; And a final image generator for transmitting the caption information together with the image information of the 3D image.

The first image and the second image may be images captured by different viewpoints of the same object.

According to still another aspect of the present invention, there is provided a three-dimensional (3D) subtitle display apparatus comprising: a receiver configured to receive image information and subtitle information; A 3D subtitle setting unit configured to receive subtitle control information and reset the subtitle information; An image processor configured to construct an image including a subtitle based on the 3D subtitle configured according to the reset subtitle information and the image information; And a display displaying an image including the caption, wherein the caption information includes depth information of the first image and depth information of the second image with respect to the first and second images constituting a 3D image. And the caption control information is information for changing at least one of depth information of the first image and depth information of the second image.

According to the present invention, a viewer can watch a stereoscopic image including 3D subtitles suitable for him. That is, when the 3D subtitles provided by the program provider in a uniform manner decrease visibility or increase eye fatigue, the 3D subtitles may be reconstructed to watch a stereoscopic image including 3D subtitles suitable for them.

1 illustrates an example of an image in which a 3D image and a 3D subtitle are displayed together.
2 illustrates an example of a broadcast process of a conventional 3D image and an image including 3D subtitles.
3 illustrates an example of a 3D image transmission apparatus including viewer-tailored 3D subtitles according to an embodiment of the present invention.
4 illustrates an example of a structure of data transmitted by the transmission apparatus described with reference to FIG. 3.
5 shows a structure of a receiving device according to an embodiment of the present invention.
6 illustrates a method of generating a 3D image including 3D subtitles according to an embodiment of the present invention.
7 is an example illustrating a process of transmitting a 3D image and displaying a 3D image including 3D subtitles according to the present invention.

1 illustrates an example of an image in which a 3D image and a 3D subtitle are displayed together.

Referring to FIG. 1, an image displayed on the display device may include a 3D image 101 and a 3D subtitle 102. In the 3D video broadcasting that transmits the video, the audio signal is naturally included and transmitted. However, since the visual elements displayed on the display device are the 3D video 101 and the 3D caption 102, the 3D video 101 and the 3D caption 102 are described below. ) Only. Examples of display devices may vary from televisions, personal digital assistance (PDA), mobile phones, monitors of computers, and the like. Hereinafter, a television is illustrated as a display device, but this is not a limitation.

2 illustrates an example of a broadcast process of a conventional 3D image and an image including 3D subtitles.

Referring to FIG. 2, a 3D image is acquired through a plurality of cameras, for example, two cameras (201). The two cameras respectively photograph images corresponding to the left and right eyes of a person, and the images photographed by each camera are time-synchronized and synthesized into one image to form a 3D image.

3D subtitles are produced separately from the 3D video (202). The separately produced 3D subtitle is included in the 3D image to generate an image including the 3D subtitle (S203). An image including 3D subtitles is transmitted through a wired or wireless channel and is viewed by a viewer through a display device such as a television (204).

3D subtitles are difficult to be produced by program providers or system operators in consideration of the characteristics of individual viewers, and the contents are produced in a uniform manner. Even if the user of the display device, that is, the viewer, has a problem such as poor visibility of 3D subtitles or increased eye fatigue, it is difficult to adjust it on the viewer side.

3 illustrates an example of a 3D image transmission apparatus including 3D subtitles according to an embodiment of the present invention.

Referring to FIG. 3, the 3D image generator 301 acquires a first image and a second image from a camera. Here, the first image and the second image may be images captured by different viewpoints of the same object. For example, the first image may be a left image constituting the 3D image, that is, an image corresponding to the left eye of the person, and the second image may correspond to a right image constituting the 3D image, ie, the right eye of the person. It may be an image. The 3D image generator 301 acquires a left image and a right image from each camera to generate a 3D image. The 3D image generator 301 transmits depth information on the left image and the right image to the subtitle generator 302. Here, the depth information is information representing a distance between the target object in the left image and the right image. The depth information is used to generate a 3D image by synthesizing the left image or the right image. The depth information may be generated from a camera that captures a left image and a right image, or may be generated from the 3D image generator 301.

The subtitle generator 302 adaptively generates 3D subtitles using depth information. That is, since the caption generator 302 generates 3D captions for the 3D image using depth information of the left image and the right image, 3D captions having different depth information may be generated for each 3D image. That is, in the related art, 3D subtitles are inconsistent with each other by generating 3D subtitles in a uniform manner without generating 3D subtitles using such depth information. This problem can be mitigated because it is generated using depth information. The subtitle generator 302 transmits the generated 3D subtitle to the final image generator 303.

The final image generator 303 receives a 3D image from the 3D image generator 301, receives a 3D subtitle from the subtitle generator 302, and generates a final image, that is, a 3D image including the 3D subtitle. The final image may be broadcast or unicast (or multicast) through a transmitter (not shown). The final image may be transmitted through image information of the 3D image and subtitle information of the 3D subtitle.

4 illustrates an example of a structure of data transmitted by the transmission apparatus described with reference to FIG. 3.

Referring to FIG. 4A, a data (image information) structure for a 3D image may include an image header 401, left image information 402, and right image information 403. The image header 401 includes depth information of the left image and depth information of the right image.

Referring to FIG. 4B, a data (subtitle information) structure for 3D subtitles may include a subtitle header 404 and subtitle information 405. The caption header 404 includes depth information on the left image and depth information on the right image. In this case, the depth information included in the caption header 404 may be the same as the depth information included in the image header 401, but may be set differently in some cases. In addition, the depth information used for some images and the captions may be set differently according to the characteristics of the content.

Data (image information) for the 3D image and data (subtitle information) for the 3D subtitle may be transmitted through separate data structures as shown in FIGS. 4 (a) and 4 (b) described above. May be transmitted via a combined data structure.

Referring to FIG. 4 (c), the data structures for the 3D video and the 3D subtitle include the video subtitle multiplexing header 410, the video header 411, the subtitle header 414, the left video information 412, and the right video information. 413 and subtitle information 415. The video subtitle remultiplexing header 410 includes information on resynchronization with an existing video and subtitles when the subtitle setting of the display device to be described later is changed.

5 shows a structure of a receiving device according to an embodiment of the present invention.

Referring to FIG. 5, the receiving apparatus includes a receiving unit 501, an image processing unit 502, a 3D subtitle setting unit 503, a display 504, and a DB unit 505.

The receiver 501 receives image information and subtitle information from the transmission device. The receiver 501 transmits the image information to the image processor 502 and the caption information to the 3D caption setting unit 503. The image information and the subtitle information may have a data structure as shown in FIG. 4 described above.

The image processor 502 receives the image information from the receiver 501, receives the reset subtitle information from the 3D subtitle setting unit 503, and generates a 3D image including the 3D subtitles. The generated 3D image is transferred to the display 504.

The 3D caption setting unit 503 receives the caption control information and generates reset caption information. The caption control information may include, for example, control information on the caption display, such as depth information on the caption, a displayed color, and the like. For example, the caption control information may be information for changing at least one of the depth information of the first image and the depth information of the second image. The caption control information can be controlled and input by the user according to their preferences. For example, the user may reset the caption information by increasing or decreasing the depth information of the first image and the depth information of the second image by the same ratio through the caption control information.

The 3D caption setting unit 503 changes or resets the caption information received through the receiver 501 using the caption control information to generate reset caption information and transmits the caption information to the image processor 502. The 3D subtitle setting unit 503 may be implemented as a software program in actual implementation.

The display 504 is a device for displaying an image and may be, for example, a device such as an LCD or a PDP of a television.

The DB unit 505 is a part for storing subtitle control information. The user can recycle the caption control information previously set in the DB unit 505, or by specifying and storing the caption control information pattern in advance, the user can conveniently input the caption control information by selecting a specific pattern according to the image. have.

6 illustrates a method of generating a 3D image including 3D subtitles according to an embodiment of the present invention. This method may be implemented in the receiving apparatus of FIG. 5 described above.

Referring to FIG. 6, the receiving device receives image information and caption information (S610). As described above, the caption information may include a caption header 404 and caption information 405, and the caption header 404 includes depth information on the left image and depth information on the right image.

The receiving device receives subtitle control information (S620). As described above, the caption control information may include control information on the caption display, such as depth information on the caption, a displayed color, and the like. The receiving device resets the caption information based on the caption control information according to the viewer's preferences (S630). The receiving device generates a 3D image using the reset caption information and the image information (S640).

7 is an example illustrating a process of transmitting a 3D image and displaying a 3D image including 3D subtitles according to the present invention.

Referring to FIG. 7, the transmission apparatus acquires a 3D image (S701) and adaptively generates 3D subtitles using depth information of the left image and the right image (S702). The transmission device transmits a 3D image including a 3D subtitle in consideration of depth information (S703).

A display device, for example, a smart television receives a 3D image including such 3D subtitles. The user of the display apparatus, that is, the viewer, may input the caption control information using the caption setting program (S704). The display apparatus may reset the displayed captions using the caption control information (S705) and then display a 3D image including the reset captions.

Conventional 3D subtitles are provided by a program provider in a uniform manner, and there is no way to control only 3D subtitles in particular, even when such 3D subtitles are less visible or increase eye fatigue. However, according to the present invention, by resetting the 3D subtitles there is an advantage that you can watch a stereoscopic image including the 3D subtitles that are suitable for them.

The above-described embodiments include examples of various aspects. While it is not possible to describe every possible combination for expressing various aspects, one of ordinary skill in the art will recognize that other combinations are possible. Accordingly, it is intended that the invention include all alternatives, modifications and variations that fall within the scope of the following claims.

Claims (12)

In the three-dimensional (3D) subtitle transmission method,
Generating depth information of the first image and depth information of the second image with respect to a first image and a second image constituting a 3D image;
Generating a 3D subtitle based on depth information of the first image and depth information of the second image; And
Including subtitle information for the 3D subtitle,
The 3D caption is a caption synchronized with the 3D image, wherein the caption information includes depth information about the first image and depth information about the second image. The method of claim 1, wherein the first image and the second image are images captured by different viewpoints of the same object. The method of claim 1, further comprising transmitting image information of the 3D image, wherein the image information includes image information of the first image and image information of the second image. Way. The method of claim 3, wherein the image information further comprises depth information about the first image and depth information about the second image. In the three-dimensional (3D) subtitle display method,
Receiving caption information;
Receiving subtitle control information;
Changing the caption information according to the caption control information; And
Displaying 3D subtitles according to the changed subtitle information;
The caption information includes depth information of the first image and depth information of the second image with respect to the first and second images constituting the 3D image, and the caption control information is associated with the first image. And at least one of depth information and depth information of the second image. The method of claim 5, wherein the first image and the second image are images captured by different viewpoints of the same object. The method of claim 5, wherein the caption control information increases or decreases depth information of the first image and depth information of the second image at the same ratio. 6. The method of claim 5, further comprising receiving image information about the 3D image, wherein the image information includes image information about the first image and image information about the second image. 7. Way. The method of claim 5, wherein the image information further comprises depth information of the first image and depth information of the second image. In the three-dimensional (3D) subtitle transmission device,
A 3D image generating unit generating depth information of the first image and depth information of the second image with respect to a first image and a second image constituting a 3D image;
A caption generating unit generating caption information including depth information of the first image and depth information of the second image; And
And a final image generator for transmitting the caption information together with the image information of the 3D image. The apparatus of claim 10, wherein the first image and the second image are images photographed by different viewpoints of the same object. In a three-dimensional (3D) subtitle display device,
A receiver for receiving image information and subtitle information;
A 3D subtitle setting unit configured to receive subtitle control information and reset the subtitle information;
An image processor configured to construct an image including a subtitle based on the 3D subtitle configured according to the reset subtitle information and the image information; And
Including a display for displaying an image containing the subtitle,
The caption information includes depth information of the first image and depth information of the second image with respect to the first and second images constituting the 3D image, and the caption control information is associated with the first image. And at least one of depth information and depth information of the second image.

Images