KR20090080498A - Method and apparatus for transmitting and receiving of video, and transport stream structure thereof - Google Patents

Abstract

An image transmission and reception method and apparatus, and a transport stream structure thereof are provided to display a 2D(Two Dimensional) image and a 3D(Three Dimensional) image in various fields in which the importance of more advanced image information is required. A decoding unit(510) receives an image signal and recovers the image signal. The video signal comprises image data and image property parameters. The image property parameters indicate information about whether image data is a 2D image or a 3D image. An image property parameter detector(520) receives the recovered image signal and detects the image property parameters. The video property parameters comprise information about the display format of the 3D image.

Description

Method and apparatus for transmitting and receiving video, and transport stream structure thereof

The present invention relates to a method and apparatus for transmitting and receiving an image, and a structure of a transport stream thereof. More particularly, the present invention relates to a transport stream structure including a video characteristic parameter representing a characteristic of a 2D / 3D image at a predetermined position and a header. An image transmitting apparatus and method for transmitting a stream, and an image receiving apparatus and method for receiving and displaying a transport stream transmitted from the image transmitting apparatus.

Recently, researches are being conducted to broadcast 3D stereoscopic images through digital television (DTV). Digital broadcasting is a broadcast that converts analog signals such as video, audio, and other data into digital signals, compresses them, transmits them, receives them, converts them into original video, audio, and other data signals, and plays them. In contrast, it provides high quality services.

In addition, research on receiving and displaying three-dimensional images using the digital broadcasting technology as described above is also in progress. A general method of implementing a 3D image is to use binocular disparity of a viewer. Three-dimensional image implementation using binocular parallax includes a method of wearing glasses for displaying a three-dimensional image, such as polarized glasses, LC shutter glasses, etc., and a device equipped with a lenticular lens, barallax barrier, barallax illumination, etc. There is a method of observing with the naked eye using. The former is called a stereoscopy method and the latter is called an autostereoscopy method.

The stereoscopy method is applied to a place where many people, such as a theater, mainly use a polarization projector. The autostereoscopy method is applied to a game display, a home TV, an exhibition display, or the like used by individuals or a small number of people.

The current research is mostly focused on realizing three-dimensional images using autostereoscopy, and various related products are sold. Most of the 3D (3D) image display device that is currently being introduced is capable of realizing only 3D (3D) image, the price is more expensive than the 2D display device.

However, since content for 3D video is not actively supplied, an expensive 3D video display device cannot satisfy a consumer's desire to purchase.

Accordingly, a lot of researches have been made on a method of manufacturing a 2D / 3D display device capable of selectively implementing 2D and 3D images, and various products have been introduced.

In order to broadcast a three-dimensional stereoscopic image similar to an actual image viewed by the human eye, a multi-view three-dimensional image must be made, transmitted, and received and reproduced by a three-dimensional display apparatus. However, the multi-view 3D stereoscopic image has a large amount of data, so it is difficult to accommodate the bandwidth of a channel used in the current digital broadcasting system. Therefore, studies on the transmission and reception of stereo images are being conducted first.

Moving on to moving picture expert groups (MPEG), the moving picture expert group (MPEG), the ongoing development of MPEG-2 multi-view profile was established in 1996. The standard for compression is in its final stages. Accordingly, related organizations studying stereoscopic images are actively researching transmission and reception of 3D stereoscopic images through digital television broadcasting, and currently aim to transmit and receive HD (High Definition) stereo images. I am doing it.

Meanwhile, in most fields, such as digital broadcasting systems, simulations, or medical analysis systems, two-dimensional images need to be selectively implemented along with three-dimensional images. However, a transport stream structure for selectively implementing two-dimensional and three-dimensional images, a transmission device and method for transmitting the transport stream, and a reception device and method for receiving and displaying the transport stream are not currently defined in the standard. Research will have to go on.

Accordingly, an aspect of the present invention is to provide a transport stream structure including a video characteristic parameter of a 2D / 3D video at a predetermined position in a digital broadcasting system, an image transmitter and method for transmitting the transport stream, and the transmission. The present invention provides an image receiving apparatus and method for receiving and displaying the transport stream.

The transport stream structure of the present invention for solving the above technical problem is, in the transport stream structure in a digital broadcasting system, an image representing information on whether the image data in the digital broadcasting system is a two-dimensional image or a three-dimensional image A header containing characteristic parameters; And a payload including the image data.

An image transmitting apparatus of the present invention for solving the above technical problem, the storage unit for storing the image data; An image characteristic parameter generator for generating an image characteristic parameter representing information on whether the stored image data is a 2D image or a 3D image; And an encoder that receives the stored image data and the generated image characteristic parameter and encodes the included image data and included in the transport stream.

In order to solve the above technical problem, an image receiving apparatus of the present invention includes a decoder for receiving and decoding image data and an image signal including an image characteristic parameter indicating information on whether the image data is a 2D image or a 3D image. part; An image characteristic parameter detector configured to receive the decoded image signal and detect the image characteristic parameter; And a display unit which displays the image data input from the decoder unit according to the image characteristic parameter inputted from the image characteristic parameter detector.

In addition, the image transmission method of the present invention for solving the above technical problem, (a) receiving the image data; (b) receiving an image characteristic parameter indicating information on whether the image data is a 2D image or a 3D image; And (c) encoding the video data and the video characteristic parameter to be included in the transport stream.

In addition, the image receiving method of the present invention for solving the above technical problem, (a) a video signal including an image characteristic parameter indicating information on whether the image data and the image data is a two-dimensional image or a three-dimensional image; Receiving and decoding the input; (b) receiving the decoded video signal and detecting the video characteristic parameter; (c) receiving an image characteristic parameter detected in step (b); And (d) displaying the image data decoded in the step (a) according to the image characteristic parameter received in the step (c).

And a computer readable recording medium having recorded thereon a program for executing the invention described in the video transmission method according to the invention on a computer.

A computer-readable recording medium having recorded thereon a program for executing the invention described in the video receiving method according to the present invention is also characterized by including a computer-readable recording medium.

According to the present invention, many fields that require the importance of more advanced image information, such as medical, engineering, and simulation, are used, and stereoscopic image (three-dimensional image) broadcasting which will emerge using DTV standard system in the future. There is an effect of providing a method and apparatus for transmitting and receiving an image capable of displaying two-dimensional images and three-dimensional images, and a transport stream structure thereof.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a transport stream structure according to an embodiment of the present invention. Referring to FIG. 1, the transport stream includes a header 100 and a payload 120.

The header 100 of the transport stream includes various control information for displaying an image included in the payload 120. The predetermined position of the transport stream header 100 includes an image characteristic parameter 102 representing a characteristic of the image data included in the payload 120.

The image characteristic parameter 102 determines whether the image data stored in the payload 120 is a 2-dimensional (2D) image (for example, a general TV signal or a VCR signal). ) 2D / 3D classification information 102a on whether or not the image is included.

In addition, when the image stored in the payload 120 is a 3D image, the image characteristic parameter may further include image capturing view number information 102b of the 3D image. Here, the number of imaging viewpoints of the three-dimensional image is information related to how many different angles are picked up in the process of imaging one object with a camera. The imaging viewpoint number of the 3D image will be described in more detail with reference to FIG. 2.

In addition, when the image stored in the payload 120 is a 3D image, the image characteristic parameter may further include display format information 102c of the 3D image. Here, the display format is information about how the format is performed for one scene in the process of synthesizing the 3D image. More specifically, display formats of three-dimensional images include line-by-line format, pixel-by-picel format, top-down format, and the like. Side-by-side format. Such display format information of the 3D image will be described in more detail with reference to FIG. 3.

2A and 2B are diagrams illustrating an example of the number of viewpoints of imaging of a 3D image in FIG. 1.

Referring to FIG. 2A, one object 200 is photographed with two cameras 221 and 222 positioned at different positions. That is, the number of viewpoints of imaging of the 3D image is two views. Here, the object may be a stationary object or may be a moving object. The two cameras 221 and 222 separately capture the left eye image and the right eye image, respectively, of one object object 200.

Referring to FIG. 2B, one object 200 is photographed with four cameras 221, 222, 223, and 224 located at different positions. That is, the number of viewpoints of imaging of the three-dimensional image is four.

2A and 2B, the object may be a stationary object or may be a moving object.

In FIG. 2A and FIG. 2B, the viewpoints of 2 and 4 have been described with respect to the number of viewpoints of imaging of the 3D image, but one object 200 may be imaged to have more various imaging viewpoints.

3A to 3D are diagrams illustrating an example of a display format method of a 3D image in FIG. 1. 3A to 3D, FIG. 3A shows an image for the line-by-line format, FIG. 3B shows an image for the pixel-by-pixel format, FIG. 3C shows a top-down format image, and FIG. 3d represents the image for the side-by-side format.

More specifically, the display format method for the stereo image (left eye image, right eye image) will be described below. The left eye image and the right eye image are each (N × M) in size.

In the line-by-line format of FIG. 3A, the left eye image and the right eye image are each half subsampled in the vertical direction, so that the pixels of the left eye image and the pixels of the right eye image are alternately line by line. Create a 3D image by positioning it as. In the pixel-by-pixel format of FIG. 3B, the left eye image and the right eye image are each half subsampled in the horizontal direction, so that the pixels of the left eye image and the pixels of the right eye image are one pixel. Create three-dimensional images by placing them alternately. In the top-down format image of FIG. 3C, the left eye image and the right eye image are each half subsampled in the vertical direction, and the sampled left eye image is positioned at the top and the sampled right eye image is positioned at the bottom. Create one 3D image. That is, by sub-sampling the (N x M) sized left and right eye images to the (N x M / 2) size, respectively, and placing them above and below, a three-dimensional (N x M) sized 3D image is created. FIG. 3D is a side-by-side format image, in which the left eye image and the right eye image are each half subsampled in the horizontal direction, and the sampled left eye image is sampled on the left side. It is located on the right side to make one 3D image. That is, a three-dimensional image of one (N x M) size is generated by subsampling the (N x M) sized left and right eyes images to each (N / 2 x M) size and placing them on the left and right sides.

As described above, there are a variety of three-dimensional image synthesis formats. Among them, the top-down format as shown in FIG. 3C and the side-by-side format as shown in FIG. 3D are compressed by MPEG or the like. It can be used a lot because it is efficient.

4 is a block diagram of an image transmitting apparatus according to an exemplary embodiment of the present invention. Referring to FIG. 4, the image transmitting apparatus includes a storage 400, an image characteristic parameter generator 410, a user interface 420, an encoder 430, and a transmitter 440.

The storage unit 400 stores image data obtained by capturing an object. The image data stored in the storage unit 400 may be an image obtained by photographing one object with one camera or may be images obtained by photographing one object with a plurality of cameras.

That is, the image data stored in the storage unit 400 may be a 2D image, and the left eye image and the right eye image taken by the plurality of cameras are subsampled and synthesized to display as described above with reference to FIGS. 3A to 3D. It may be a three-dimensional image of any one of the formats.

The image characteristic parameter generator 410 generates an image characteristic parameter representing a characteristic of the image data stored in the storage 400. Here, the image characteristic parameter includes whether it is a 2D image or a 3D image. Furthermore, in the case of a three-dimensional image, it may include information on the number of image capsing points or display format information.

The user interface unit 420 receives an instruction for controlling the image characteristic parameter generator 410 from the user and provides an input / output interface for receiving the image characteristic parameter. The user may generate an image characteristic parameter representing the characteristic of the image data stored in the storage unit 400 by setting it through the user interface unit 420.

In an embodiment of the present invention, the user interface unit 420 is configured to generate an image characteristic parameter. However, in this regard, various embodiments, such as a method for generating an image characteristic parameter in the process of capturing an image, are possible.

The encoder 430 receives the image data obtained by capturing the object from the storage 400 and the image characteristic parameter generated from the image characteristic parameter generator 410. The encoder 430 encodes the image data input from the storage 400 and the image characteristic parameter received from the image characteristic parameter generator 410 to convert the image data into a transport stream. Herein, the encoder 430 allows the images input from the storage 400 to be included in the payload of the transport stream, and the image characteristic parameter is included in the header predetermined position of the transport stream. In addition, the encoder 430 performs encoding by MPEG or various other methods.

The transmitter 440 transmits the encoded transport stream according to a digital broadcast standard or other various transport standards.

5 is a block diagram of an image receiving apparatus according to an exemplary embodiment of the present invention. Referring to FIG. 5, the image receiving apparatus includes a receiver 500, a decoder 510, an image characteristic parameter detector 520, and a display 530.

The receiver 500 receives an image signal transmitted from an image transmitter. Here, the video signal received through the receiver 500 is a video signal in the form of a transport stream.

The decoder 510 performs decoding corresponding to the standard encoded by the video transmitting apparatus. For example, if encoded according to the MPEG-2 standard, decoding is performed accordingly. More specifically, the decoder 510 may decode the encoded video signal by using a decoding scheme such as variable length decoding, inverse DCT, inverse quantization, and motion compensation in consideration of the spatial and spatial correlation of the video signal. And image characteristic parameters.

The image characteristic parameter detector 520 detects an image characteristic parameter from information included in a header predetermined position of the decoded transport stream. Here, the image characteristic parameter includes whether the image included in the payload is a 2D image or a 3D image. Furthermore, in the case of a 3D image, the apparatus may further include image capturing view number information or display format information.

The display unit 530 receives the image characteristic parameter transmitted from the image characteristic parameter detector 520 and the decoded image data from the decoder 510. The display unit 530 displays the decoded image data on the screen according to the image characteristic parameter.

More specifically, when the image characteristic parameter is represented as a two-dimensional image, the display unit 530 displays decoded image data input from the decoder unit 510 on the screen in two dimensions. When the image characteristic parameter is represented as a 3D image, the display unit 530 displays the decoded image data input from the decoder unit 510 on the screen in 3D. In addition, the display unit 530 may decode the decoded image data so that the image characteristic parameter corresponds to the imaging viewpoint number information or the display format information when it is shown that the image characteristic parameter is a 3D image and further includes imaging viewpoint number information or display format information. Converted and displayed in a predetermined manner.

Here, the display unit 530 is composed of a 2D / 3D combined display device. The method of implementing the 2D / 3D combined display device may vary. More specifically, the display unit 530 of the present invention is an image forming panel display, a lens unit and the above described as described in the Republic of Korea Patent Publication No. 10-0440956 (name of the invention: 2D / 3D combined display) It may be implemented to include a power supply for selectively supplying power to the lens unit. In addition, there is a 2D / 3D combined display device having a liquid crystal shutter behind the TFT-LCD and selectively displaying two-dimensional and three-dimensional images using the liquid crystal shutter. However, the above examples are just one example, and the display unit 530 of the present invention is not limited thereto and may be implemented in various ways.

6 is a flowchart illustrating a video transmission method according to an exemplary embodiment of the present invention. Referring to FIG. 6, first, image data obtained by capturing an object is received (S600). Here, the image data may be image data obtained by imaging one object with one camera or image data obtained by imaging one object with a plurality of cameras.

Next, an image characteristic parameter generated to represent the characteristic of the image data is received (S610). Here, the image characteristic parameter includes information on whether the image data input in step S600 is a 2D image or a 3D image. Furthermore, in the case of a 3D image, the apparatus may further include image capturing view number information or display format information.

Next, the image data input in step S600 and the image characteristic parameter received in step S610 are encoded and converted into a transport stream form (S620). Here, the video data is included in the payload of the transport stream, and the video characteristic parameter is included in the header predetermined position of the transport stream. The encoding in step S620 is performed by MPEG or various other methods.

Next, the transport stream encoded in step S620 is transmitted according to a digital broadcast standard or other various transport standards (S630).

Parts not described in FIG. 6 will be referred to FIG. 4.

7 is a flowchart illustrating an image receiving method according to an exemplary embodiment of the present invention. Referring to FIG. 7, first, an image signal including an image data and an image characteristic parameter for the image data is received through an antenna (S700). Here, the received video signal is a video signal in the form of a transport stream.

Next, the image signal received in step S700 is decoded (S710).

Next, the image signal decoded in step S710 is input to detect an image characteristic parameter for the image data (S720). Here, the image characteristic parameter includes whether the image data in the payload is a 2D image or a 3D image. Furthermore, in the case of a 3D image, the apparatus may further include image capturing view number information or display format information.

Next, the image characteristic parameter detected in step S720 is output to the display apparatus (S730).

Next, the image data decoded in step S710 is displayed on the screen according to the image characteristic parameter transmitted in step S730 (S750).

Parts not described in FIG. 7 will be referred to FIG. 5.

The invention can also be embodied as computer readable code on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD_ROM, magnetic tape, floppy disks, and optical data storage, and may also include those implemented in the form of carrier waves (e.g., transmission over the Internet). . The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

As described above, optimal embodiments have been disclosed in the drawings and the specification. Although specific terms have been used herein, they are used only for the purpose of describing the present invention and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

1 is a transport stream structure according to an embodiment of the present invention.

2A and 2B are diagrams illustrating an example of an image capturing view number of a 3D image in FIG. 1.

3A to 3D are diagrams illustrating an example of a display format method of a 3D image in FIG. 1.

4 is a block diagram of an image transmitting apparatus according to an exemplary embodiment of the present invention.

5 is a block diagram of an image receiving apparatus according to an exemplary embodiment of the present invention.

6 is a flowchart illustrating a video transmission method according to an exemplary embodiment of the present invention.

7 is a flowchart illustrating an image receiving method according to an exemplary embodiment of the present invention.

Claims (19)

Receiving and restoring an image signal including image data and an image characteristic parameter representing information on whether the image data is a 2D image or a 3D image; And Receiving the reconstructed video signal and detecting the video characteristic parameter; And the image characteristic parameter includes information on a display format of the 3D image. The method of claim 1, The display format of the 3D image is a line-by-line format, The line-by-line format generates the 3D image by sub-sampling the left eye image and the right eye image in the vertical direction, respectively, so that pixels of the left eye image and pixels of the right eye image are alternately positioned for each line. Restoration method characterized in that the format. The method of claim 1, The display format of the 3D image is a pixel-by-pixel format, In the pixel-by-pixel format, the left-eye image and the right-eye image are each half subsampled in the horizontal direction, so that the pixels of the left-eye image and the pixels of the right-eye image are alternately positioned by one pixel. Restoration method characterized in that the format to create. The method of claim 1, The display format of the 3D image is a top-down format, In the top-down format, the left-eye image and the right-eye image are each half subsampled in the vertical direction, and the three-dimensional image is generated by placing the sub-sampled left eye image on the top and the sub-sampled right eye image on the bottom. Restoration method characterized in that the format. The method of claim 1, The display format of the 3D image is a side-by-side format. In the side-by-side format, the left-eye image and the right-eye image are each half subsampled in a horizontal direction, and the sub-sampled left eye image is positioned on the left side and the sub-sampled right eye image is positioned on the right side. Restore method characterized in that the format for generating. The method of claim 1, And displaying the reconstructed image data according to the detected image characteristic parameter. The method of claim 1, The image characteristic parameter may further include information about the number of viewpoints of the imaging of the 3D image. The method of claim 1, And the video signal is a transport stream including the video characteristic parameter in a header and the video data in a payload. The method of claim 1, And the image data is data applied to a digital broadcasting system. A decoder unit for receiving and restoring an image signal including image data and an image characteristic parameter representing information on whether the image data is a 2D image or a 3D image; And An image characteristic parameter detector configured to receive the restored image signal and detect the image characteristic parameter; And the image characteristic parameter includes information on a display format of a 3D image. The method of claim 10, The display format of the 3D image is a line-by-line format, The line-by-line format generates the 3D image by sub-sampling the left eye image and the right eye image in the vertical direction, respectively, so that pixels of the left eye image and pixels of the right eye image are alternately positioned for each line. Restoration apparatus characterized in that the format. The method of claim 10, The display format of the 3D image is a pixel-by-pixel format, In the pixel-by-pixel format, the left-eye image and the right-eye image are each half subsampled in the horizontal direction, so that the pixels of the left-eye image and the pixels of the right-eye image are alternately positioned by one pixel. Restoration apparatus, characterized in that the format to create. The method of claim 10, The display format of the 3D image is a top-down format, In the top-down format, the left-eye image and the right-eye image are each half subsampled in the vertical direction, and the three-dimensional image is generated by placing the sub-sampled left eye image on the top and the sub-sampled right eye image on the bottom. Restoration apparatus characterized in that the format. The method of claim 10, The display format of the 3D image is a side-by-side format. In the side-by-side format, the left-eye image and the right-eye image are each half subsampled in a horizontal direction, and the sub-sampled left eye image is positioned on the left side and the sub-sampled right eye image is positioned on the right side. Restoration apparatus characterized in that the format for generating a. The method of claim 10, And a display unit for displaying the restored image data according to the detected image characteristic parameter. The method of claim 10, And the image characteristic parameter further includes information on the number of image capturing viewpoints of the 3D image. The method of claim 10, And the video signal is a transport stream including the video characteristic parameter in a header and the video data in a payload. The method of claim 10, And the image data is data applied to a digital broadcasting system. Receiving and restoring an image signal including image data and an image characteristic parameter representing information on whether the image data is a 2D image or a 3D image; And Receiving the reconstructed video signal and detecting the video characteristic parameter; And the image characteristic parameter is a computer readable recording medium having recorded thereon a program for executing a restoration method including information on a display format of the 3D image.

Images