KR101390810B1 - Method and apparatus for receiving image data stream comprising parameters for displaying local three dimensional image, and method and apparatus for generating image data stream comprising parameters for displaying local three dimensional image - Google Patents

Abstract

A method of receiving an image data stream including local 3D image parameters according to the present invention includes receiving an image data stream including a two-dimensional image data section and a three-dimensional image data section, A local 3D image parameter, which is a parameter for an image of a data section, is extracted, and the local 3D image parameters include image arrangement order information indicating the order in which the reference view image and the additional view image are arranged in the three- Dimensional image, and restoring at least one of a two-dimensional image and a three-dimensional image of the image data section using the extracted local three-dimensional image parameters, thereby reproducing a three-dimensional image only at a moment when viewing of the three- .

Stereo image, binocular image, three-dimensional image, local three-dimensional image

Description

Field of the Invention [0001] The present invention relates to a method and apparatus for receiving an image data stream including parameters for reproducing a local three-dimensional image, and a method and apparatus for generating an image data stream including parameters for reproducing a local three- image data stream, and image data stream comprising three dimensional image,

The present invention relates to a method and apparatus for receiving an image data stream including a three-dimensional image, and a method and apparatus for generating a three-dimensional image data stream. More particularly, the present invention relates to a method and apparatus for receiving an image data stream including a three- And more particularly, to a method and apparatus for extracting detailed parameters for a three-dimensional data interval or recording parameters for a three-dimensional data interval in an image data stream.

There is a growing interest in 3-D images, but there are still many limitations in producing the entire 3-D image contents. Fatigue that may occur when viewing three-dimensional images, difficulty in acquiring three-dimensional images, and problems in transmission of three-dimensional images.

In order to overcome such a problem, a local three-dimensional image in which some three-dimensional image data are combined with two-dimensional image data has been proposed. Two-dimensional image data for displaying the image content in two dimensions is provided in the entire playback period of the image content, and three-dimensional image data for displaying the image content in three dimensions in one or more sections of the image content data is provided .

The currently proposed stereo image storage format uses one or two elementary streams. FIG. 1A shows an example of an implementation method of a local three-dimensional image based on a two-dimensional image. The local three-dimensional image data is expressed using the elementary stream 120 on which the two-dimensional image data is recorded and the elementary stream 110 on which some three-dimensional image data 112 and 114 are recorded, that is, two elementary streams. FIG. 1B shows another example of an implementation of a local three-dimensional image based on a two-dimensional image. In this case, two-dimensional image data is recorded in one elementary stream 130 and three-dimensional image data is recorded in some sections 132 and 134 to be reproduced as a three-dimensional image.

1A and 1B, only the position information of the image data section for expressing local three-dimensional image data is transmitted, and detailed information for reproducing the three-dimensional image is not transmitted.

SUMMARY OF THE INVENTION The object of the present invention is to extract various information related to a 3D image combined with a reference viewpoint image and a viewpoint viewpoint image, as well as position information of a video data section, And effectively reproduce the local three-dimensional image from the data stream.

In addition, not only the position information of the image data section, but also various information related to the three-dimensional image in which the reference view image and the additional view image are combined is recorded as a parameter in the image data stream so that local three- To generate a video data stream.

According to an aspect of the present invention, there is provided a method of receiving a video data stream, the method including receiving a video data stream including a video data section of a two-dimensional video data section and a three- ; Extracting a local 3D image parameter that is a parameter for an image of each image data section from the image data stream, and the local 3D image parameter extracts a reference view image and a viewpoint image from the 3D image of each image data section Comprising: video sequence order information indicating an ordered sequence; And reconstructing at least one of a two-dimensional image and a three-dimensional image of the image data section using the extracted parameters.

In one embodiment, the method further comprises extracting, from the image data stream, image data section number information indicating the number of image data sections, wherein the local three-dimensional image parameter extraction step comprises: The identification information of the elementary stream in which the current image data section is recorded and the image data section position information in which the current image data section is recorded in the image data stream when the elementary streams are plural.

In one embodiment, the local 3D image parameter extraction step includes, if the current image data section is a 3D image data section, the local 3D image parameter includes the image layout order information.

The video data section position information of the embodiment includes the start position information of the video data section and the end position information of the video data section.

The local 3D image parameter extracting step of the embodiment may further include extracting elementary stream start position information indicating a start position of each elementary stream, wherein the image data section position information includes a start position of the elementary stream And video data section length information indicating the length of each video data section as a reference.

The local 3D image parameter extraction step of the embodiment further includes image configuration type information indicating a method of configuring the local view 3D image and the viewpoint view image as a 3D image, The format information may be a side by side format, a top and bottom format, a vertical line interleaved format, a horizonal line interleaved format ), A frame sequential format, a field sequential format, a single reference view image format, and a single additional view image format.

In one embodiment, the local 3D image parameter extraction step may include a step of, when the image configuration format information is a side-by-side format or a top-and-bottom format, And width width information of the additional viewpoint image.

The local 3D image parameter of the embodiment further includes the width width information of the reference view image and the addition view image in the image configuration format.

In one embodiment, the local 3D image parameter information includes extracting from the ISO-based media file format if the 3D image data stream is an ISO-based media file format.

In one embodiment, the ISO-based media file format includes a moov box, an mdat box, and a meta box, and the local three-dimensional image parameter information includes a lower level box of the meta box, a lower level box of the moov box, A lower level box of a trak box, a lower level box of the trak box, and a lower level box of a meta box which is a lower level of the trak box, which are lower levels of the moov box.

According to an aspect of the present invention, there is provided a method of generating a video data stream including a media data area divided into a plurality of video data sections, Dimensional image data or three-dimensional image data in an image data section of the image data; And recording the local 3D image parameters including the image arrangement order information indicating the order in which the reference view image and the additional viewpoint image are arranged in the image configuration format of each image data section in the image data stream.

The local three-dimensional image parameter of the embodiment may include: image data section number information indicating the number of the image data sections; Identification information of a base stream in which a current video data section is recorded when a plurality of base streams recorded with the video data section are recorded; And at least one of video data section location information in which the current video data section is recorded in the video data stream.

The local 3D image parameter of the embodiment may include image configuration type information indicating a method of constructing the reference view image and the addition view image in a 3D image format; And a width width information of the reference view image and the additional viewpoint image in the image configuration format, wherein the image configuration format information includes at least one of a side-by-side format, a top-bottom format, a vertical line interleaved format , Horizonal line interleaved format, frame sequential format, field sequential format, single reference view video format, and single add-on video format.

The video data section position information may be position information represented using start position information of the video data section and end position information of the video data section. And position information expressed using video data section length information indicating a length of each video data section based on elementary stream start position information and a starting position of the elementary stream.

In one embodiment, the local 3D image parameter recording step records the local 3D image parameter in the ISO-based media file format if the 3D image data stream is an ISO-based media file format.

In one embodiment, the local 3D image parameter recording step comprises: when the ISO-based media file format includes a moov box, an mdat box, and a meta box, the lower three-dimensional image parameter recording step includes: Dimensional image parameter information to at least one of a lower level box of a trak box, a lower level box of the trak box, and a lower level box of a meta box, which is a lower level of the trak box, Record.

According to an aspect of the present invention, there is provided a video data stream receiving apparatus including: a receiver for receiving a video data stream including a video data section of a two-dimensional video data section and a three-dimensional video data section; Extracting a local 3D image parameter that is a parameter for an image of each image data section from the image data stream, and the local 3D image parameter extracts a reference view image and a viewpoint image from the 3D image of each image data section A local three-dimensional image parameter extracting unit including image arrangement order information indicating an arranged order; And an image restoration unit for restoring at least one of a two-dimensional image and a three-dimensional image of the image data section using the extracted parameters.

In one embodiment, the image data section number information indicating the number of image data sections is further extracted from the image data stream, and the local three-dimensional image parameter extracting section extracts the local three- The identification information of the elementary stream in which the current image data section is recorded, and the image data section position information in which the current image data section of the image data stream is recorded.

The local 3D image parameter extracting unit of the embodiment may include: image configuration type information indicating a method of configuring the local 3D image parameters as the 3D view image and the reference view image and the addition view image; And a width width information of the reference view image and the additional viewpoint image in the image configuration format, wherein the image configuration format information includes at least one of a side by side format, a top and bottom format, a vertical line interleaved format, A frame sequential format, a field sequential format, a single reference view video format, and a single additional viewpoint video format.

According to an aspect of the present invention, there is provided an apparatus for generating a video data stream including a media data area divided into a plurality of video data sections, An image data recording unit for recording two-dimensional image data or three-dimensional image data in an image data interval of the image data; And a local three-dimensional image parameter recording unit for recording, in the image data stream, local three-dimensional image parameters including image arrangement order information indicating the order in which the reference view image and the additional viewpoint image are arranged in each image data format, .

The local three-dimensional image parameter of the embodiment may include: image data section number information indicating the number of the image data sections; Identification information of a base stream in which a current video data section is recorded when a plurality of base streams recorded with the video data section are recorded; And at least one of video data section location information in which the current video data section is recorded in the video data stream.

The local 3D image parameters of the embodiment include image configuration type information indicating a method of constructing the reference view image and the addition view image in a 3D image format; And a width width information of the reference view image and the additional viewpoint image in the image configuration format, wherein the image configuration format information includes at least one of a side-by-side format, a top-bottom format, a vertical line interleaved format , Horizonal line interleaved format, frame sequential format, field sequential format, single reference view video format, and single add-on video format.

The present invention includes a computer-readable recording medium containing a program for implementing a method of receiving a video data stream according to an embodiment of the present invention.

In addition, the present invention includes a computer-readable recording medium containing a program for implementing a method of generating a video data stream according to an embodiment of the present invention

A method and apparatus for extracting a video data stream according to the present invention is a method and apparatus for extracting a video data stream from a viewpoint image and a viewpoint image, The reference viewpoint image, and the additional viewpoint image, and reproduces the local 3D image accurately and effectively from the image data stream of the received two-dimensional image and the 3D image.

In addition, the method and apparatus for generating a video data stream of the present invention can be applied to not only the position information of a video data section, but also a video composition method of a three-dimensional video in which a reference view video and a viewpoint video are combined, Dimensional image data is combined with the three-dimensional image data in the two-dimensional image data by writing various information on the width, the information about the width, the reference viewpoint image, have.

The present invention provides order information in which a reference viewpoint image and a viewpoint viewpoint image are arranged in a three-dimensional image format, thereby preventing a disturbing feeling that may occur to a viewer by changing the arrangement order of the reference viewpoint image and the additional viewpoint image .

In addition, parameters such as video data section position information, video configuration format information, width width information, and video arrangement order information can be individually defined for each data section, so that the video can be represented accurately in accordance with the characteristics of each data section Or restored.

By combining some three-dimensional image data on the entire two-dimensional image data, the image content is reproduced in three dimensions only in a certain section to be emphasized and the viewer is strongly perceived in the three-dimensional image reproduction section.

When the 3D stereo image is watched for a long time, the viewer increases the fatigue. Therefore, it is possible to increase the immersion degree of the viewer by watching the contents with the local 3D image only at the important moments. Also, It is possible to overcome difficulties in acquiring a three-dimensional image. Accordingly, the present invention is expected to contribute to the activation of three-dimensional images, and the present invention can be used in a variety of multimedia devices such as a digital TV, a PC monitor, and a camcorder.

Hereinafter, a method and apparatus for receiving an image data stream including local 3D image parameters according to an embodiment of the present invention, a method for generating an image data stream including local 3D image parameters, The device is described in detail.

Figure 2 shows a block diagram of an image data stream receiving apparatus that includes local three-dimensional image parameters, in accordance with an embodiment of the present invention.

The image data stream receiving apparatus 200 including the local three-dimensional image parameters includes a receiving unit 210, a local three-dimensional image parameter extracting unit 220, and an image restoring unit 230.

The receiving unit 210 receives the image data stream including the image data section of the two-dimensional image data section and the three-dimensional image data section, and outputs the received image data stream to the local three-dimensional image parameter extracting section 220. In one embodiment, the three-dimensional image is formed by combining images of two viewpoints, that is, a reference viewpoint image and a supplementary viewpoint image.

A two-dimensional image is a viewpoint image obtained by one camera, whereas a three-dimensional image is composed of two or more viewpoint images obtained by two or more cameras. For example, there may be a left view image obtained from the left camera and a right view image obtained from the right camera. One embodiment of the present invention deals with a three-dimensional image composed of one reference viewpoint image and additional viewpoint images at different viewpoints.

The local three-dimensional image parameter extracting unit 220 receives the image data stream from the receiving unit 210, extracts a local three-dimensional image parameter, which is a parameter for an image of each image data interval, from the image data stream, (230). The local 3D image parameters of the present invention include image arrangement order information indicating the order in which the reference view image and the additional viewpoint image are arranged in the three-dimensional image of each image data section.

In addition, the local three-dimensional image parameter of the present invention further includes at least one of image data section location information, image configuration format information, and width width information.

In one embodiment of the video data stream receiving unit 200, video data section number information indicating the number of video data sections is extracted from the video data stream. The local three-dimensional image parameter of the embodiment of the local three-dimensional image parameter extracting unit 220 includes identification information of an elementary stream in which a current image data section is recorded when a plurality of elementary streams are recorded, And the position information of the video data section.

In another embodiment of the local three-dimensional image parameter extracting unit 220, if the current image data section is a three-dimensional image data section, the local three-dimensional image parameter includes image arrangement order information.

In one embodiment of the local three-dimensional image parameter extraction unit 220, the image data section position information includes the start position information of the image data section and the end position information of the image data section.

In another embodiment of the local three-dimensional image parameter extracting unit 220, elementary stream start position information indicating the start position of each elementary stream is extracted, and the image data section position information is extracted based on the start position of the elementary stream And a video data section length information indicating the length of the video data section of the video data.

In one embodiment of the local three-dimensional image parameter extraction unit 220, the local three-dimensional image parameter further includes image configuration type information indicating a method of constructing the reference view image and the addition view image into a three-dimensional image.

One embodiment of the image configuration format information may be a side-by-side format, a top-bottom format, a vertical line interleaved format, a horizonal line interleaved format, a frame sequential format, a field sequential format, And a view image format.

In one embodiment of the local three-dimensional image parameter extraction unit 220, the local three-dimensional image parameter includes width-width information which is width-width information of the reference view image and the addition-view image in the image configuration format. In another embodiment, the local three-dimensional image parameter may be set such that the local three-dimensional image parameter is the width of the reference view image and the viewpoint image in the image composition format only when the image composition format information is in the side- Information.

ISO (International Standardization Organization) based media file format This data stream includes moov boxes, mdat boxes and meta boxes. When the image data stream of the present invention is an ISO-based media file format, one embodiment of the local three-dimensional image parameter extracting unit 220 extracts a local three-dimensional image parameter box from a local three- Extract the parameters.

Another embodiment of the local three-dimensional image parameter extracting unit 220 extracts the identification information of the elementary stream and the image data section position information from the iloc box at the lower level of the meta box, Parameters excluding the identification information of the elementary stream and the video data section position information are extracted from the video information box.

The image restoring unit 230 receives local three-dimensional image parameters from the local three-dimensional image parameter extracting unit 220 and restores at least one of a two-dimensional image and a three-dimensional image of the image data interval using the extracted parameters do.

3 illustrates a block diagram of an apparatus for generating image data streams that includes local three-dimensional image parameters, in accordance with an embodiment of the present invention.

One embodiment of the image data stream generating apparatus 300 including the local three-dimensional image parameters includes an image data recording unit 310 and a local three-dimensional image parameter recording unit 320. In the video data stream generating apparatus 300 of the present invention, the video data stream includes a media data area divided into a plurality of video data sections.

The image data recording unit 310 records two-dimensional image data or three-dimensional image data in each image data interval and outputs the two-dimensional image data or three-dimensional image data.

The local three-dimensional image parameter recording unit 320 records the local three-dimensional image parameters including the image arrangement order information indicating the order in which the reference view image and the additional view image are arranged in the image configuration format of each image data section, And outputs it.

The local three-dimensional image parameter of the image data stream generating apparatus 300 is the same as the local three-dimensional image parameter in the image data stream extracting apparatus 200 described above. Details of the local three-dimensional image parameters will be described below with reference to FIGS. 4 to 12.

Figure 4 illustrates a method for implementing a local three-dimensional image in accordance with an embodiment of the present invention.

The video data stream handled by the video data stream extracting apparatus 200 and the video data stream generating apparatus 300 is divided into a plurality of data sections and one or more partial data Dimensional data sections 420, 430, and 440 in which three-dimensional data is recorded in a period.

The local 3D image parameters of the present invention provide detailed information on each of the three-dimensional data sections 420, 430, and 440, and include the image data section position information, image configuration type information, width width information, At least one of them.

The video data section location information indicates the location where each video data section is recorded in the current video data stream.

The image configuration type information indicates a method of constructing a reference view image and a viewpoint view image in a three-dimensional image format for a three-dimensional image of each image data section.

The width width information indicates the width information and the width information of the reference view image and the additional viewpoint image, respectively, in the three-dimensional image format of the image composition method for the three-dimensional image of each image data section.

The image arrangement order information indicates the order in which the reference view image and the additional view image are arranged in the three-dimensional image format of each image data section.

Since the local three-dimensional image parameters according to the embodiment of the present invention are defined for each data section, the local three-dimensional image parameters, which are included in the local three-dimensional image parameters, include image data section position information, image configuration type information, Can be defined separately for each data section. In addition, the video configuration type information, the width width information, and the video arrangement order information may be set uniformly for every video data section.

Figure 5 illustrates a local three-dimensional image parameter in accordance with an embodiment of the present invention.

Local3D 500 represents a local three-dimensional image parameter. The local three-dimensional image parameter 500 includes the number-of-image section number information (number_of_interval) 510, and the image data section number information 510 represents the number of image data sections included in the current image data stream.

a parameter including information that varies for each image data section is defined through a for statement 520. [ In the embodiment of FIG. 5, the video data section location information is expressed using the start_position 530 of the current video data section and the end_position 540 of the current video data section.

The composition_width field 560 represents the width of the width width information, and the composition_height field 570 represents the width of the width width information. The LR_First 580 indicates video layout order information.

One embodiment of the local three-dimensional image parameter 500 of FIG. 5 includes the image data section number information, the image data section location information 530 and 540, the image configuration type information 550, the width width information 560 and 570, And image layout order information 580. [

6A shows a type of image configuration format information according to an embodiment of the present invention.

If the StereoScopic Composition Type value of the current video data section is 0, the video data of the corresponding video data section is in a side-by-side format. In the side by side format, for example, a reference view image and a viewpoint image are arranged side by side in a horizontal direction to form a single three-dimensional image.

If the StereoScopic Composition Type value of the current video data section is 1, the video data of the corresponding video data section is a 3D video format of the top and bottom format. In the top and bottom format, for example, the reference view image and the additional view image are arranged side by side in the vertical direction to form a single three-dimensional image.

If the StereoScopic Composition Type value of the current image data section is 2, the image data of the corresponding image data section is a 3-dimensional image format of a vertical line interleaved format. The vertical line interleaved format constitutes a three-dimensional image by alternately arranging lines in the vertical direction of the reference view image and the addition view image, for example.

If the StereoScopic Composition Type value of the current image data section is 3, the image data of the corresponding image data section is a 3-dimensional image format of horizonal line interleaved format. Horizontal line interleaved formats constitute a three-dimensional image by alternately arranging horizontally oriented lines of a reference viewpoint image and a supplementary viewpoint image, for example.

If the StereoScopic Composition Type value of the current video data section is 4, it indicates a frame sequential format. The frame sequential format forms a three-dimensional image, for example, by alternately displaying a reference view image frame and a viewpoint image frame.

If the StereoScopic Composition Type value of the current video data section is 5, it indicates a field sequential format. The field sequential format forms a three-dimensional image, for example, by alternately displaying a reference view image field and a viewpoint image field. The frame sequential format and the field sequential format are applied when there are two or more elementary streams.

If the StereoScopic Composition Type value of the current video data section is 6, it indicates a monoscopic left image. The monoscopic left image forms an image using only the left view image, for example.

If the StereoScopic Composition Type value of the current video data section is 7, it indicates a monoscopic right image. A single monoscopic right image forms an image using only the right view image, for example.

If the StereoScopic Composition Type value of the current video data section is one of 8 to 255, it indicates that it is an arbitrary image configuration format.

FIG. 6B shows an example of video arrangement order information according to an embodiment of the present invention.

LR_first is a parameter for the arrangement order information of the reference view image and the addition view image constituting the three-dimensional image according to the embodiment of the present invention. In one embodiment of the present invention, LR_first is represented by one bit (u (1)).

If LR_first is 0, the left view is the reference view image, the image data of the left image is the odd line (Odd line) in the vertical line interleaved format (Parallax barrier format) An odd-numbered line in a horizontal line interleaved format, an upper line in a top-down format, a left-side line in a side-by-side format, An odd field in a field sequential format, an odd frame in a frame sequential format, and a block-interleaved format in a field sequential format. (Odd number of MB) in the format (for example, format), and two media (Two ES) in the main media. Likewise, the right view becomes the additional viewpoint image, and is arranged in the opposite area of the area where the left image is arranged in each of the image configuration format information described above.

If LR_first is 1, the right view is the reference view image, and the arrangement order of the right view and the left view is opposite to the case where LR_first is 0 as described above.

One embodiment of the present invention can have individual three-dimensional image configuration format information for each data section on one data stream. The local three-dimensional parameter of the present embodiment includes respective three-dimensional image configuration type information for each data section. In addition, one embodiment of the local three-dimensional parameter includes image arrangement order information of the three-dimensional image configuration format information. In addition, the local three-dimensional parameter may include the width (width size) information and the width (height size) information of the basic viewpoint image, the width (width size) information and the width (height size) information of the additional viewpoint image.

7 shows a basic structure of an ISO-based media file format.

ISO file box 700 includes moov box 710 and mdat box 720.

The moov box 710 contains basic header information for video trak or audio trak information and the mdat box 720 contains substantial video data or voice data. One embodiment of the mdat box 720 includes interleaved time-ordered video or voice frames.

Figure 8 shows a box list of an ISO-based media file format.

The ftyp box 810 represents the file type and compatibility and contains information about the major type (major_brand) of the file. An embodiment of the present invention sets the file to "ssav " to indicate that the file is a 3D stereo image. Where ssav stands for stereoscopic audio-video (AV).

The moov box 820 is a space for all metadata of timed resources. As described above with reference to FIG. 7, the moov box 820 includes header information or metadata for real media data included in the mdat box 830.

The mdat box 830 is a space for media data, as described above with reference to Fig.

The meta box 840 is also a space for metadata other than the moov box 820. One embodiment of the present invention includes a sinf (stereoscopic information) box 850 as a space for a local three-dimensional image parameter at a lower level of the meta box 840.

Trak box 860, which is a lower level of moov box 820, is a space for each independent track or stream for main AV data or auxiliary data. Another embodiment of the present invention includes a sinf box 850 as a space for a local three-dimensional image parameter in a lower level 870 of another meta box below the trak box.

Accordingly, one embodiment of the local three-dimensional image parameter extraction unit 220 of the image data stream receiving unit 200 extracts the local three-dimensional image parameters from the sinf box of the ISO-based media file format described above. In addition, one embodiment of the local three-dimensional image parameter register 320 of the image data stream generator 300 records the local three-dimensional image parameters in the sinf box of the ISO-based media file format.

9 illustrates the syntax of a local three-dimensional image parameter, in accordance with an embodiment of the present invention.

The Syntax for representing the low fatigue parameter shown in Fig. 9 is such that, in one embodiment described above with reference to Fig. 8, the snif box 850 for the local three-dimensional image parameter is the lower level of the meta box 840 (Box type: 'snmi' / Container: Meta box ('meta')). In the ISO-based media file format, it is not mandatory to have a local 3D image parameter (Mandatory: No) and the amount of the parameter is 0 or 1 (Quantity: Zero or one). The definitions of the respective variables are the same as those described above in Fig.

For each video data section 910, identification information ES_ID 920, video data position information 930, and video configuration type information of the base stream in which the current video data section is recorded are defined. 9, since the image configuration format information of the current image data section is a three-dimensional image format only when the image configuration format information is a value smaller than 6 (940), the local three-dimensional image parameters are stored in the image arrangement order information 950 ). Also, if the image configuration format information is less than 2 (960) and the side-by-side format or the top-and-bottom format, then the local three-dimensional image parameter includes width width information 970.

 Figure 10 shows the syntax of a local three-dimensional image parameter, according to another embodiment of the present invention.

In the embodiment shown in FIG. 10, the local 3D image parameter value has start position information 1010 of the elementary stream. Since the start position of the elementary stream may be different for each elementary stream, there are two pieces of start position information (base_offsetES1 and base_offsetES2) when there are two elementary streams.

In the present embodiment, the video data section position information is expressed using the length of the video data section based on the start position information of the elementary stream. Therefore, the local 3D image parameter has identification information ES_ID and video data section length information (interval_length) 1030 for each video data section 1020.

9, the start position information and the end position information of the video data section are required for each video data section as the video data section position information. However, in the embodiment of FIG. 10, since the start position information of the elementary stream is used, the video data section position information for each video data section can be represented only by the video data section length information, thereby reducing the amount of information.

In the embodiment of FIG. 10, similarly to the embodiment of FIG. 9, only the case of the three-dimensional image 1040 (1040) exists, and the image arrangement order information 1050 exists in the side-by-side format or the three- Only width 1060 width width information 1070 is used as the local three-dimensional image parameter.

Figure 11 shows the syntax of a local three-dimensional image parameter, according to another embodiment of the present invention.

At the lower level of the meta box 840 of the ISO-based media file format, an iloc box for managing the metadata file is located. In the item_ID of the iloc box 1110, the identification information ES_ID of the elementary stream is recorded. The start point of the video data section is expressed using base_offset and extent_offset, and the length of the video data section is expressed using extent_length. Accordingly, a method of representing the video data position information described above using the start position of the elementary stream of the iloc box and the video data section length information 1110 is implemented.

Since the image data position information is recorded in the iloc box 1110, the image format type information, the image arrangement order information, and the width width information may be recorded in the sinf box 1120 in the same manner as in the above embodiments.

Figure 12 a illustrates a method for differently representing the syntax of a local 3D video parameters according to one embodiment of the present invention.

In the embodiments described above, the presence or absence of the image layout order information (LR_first) or the width width information (composition_width, composition_height) is variable according to the image configuration format. In the embodiment of FIG. 12, Assuming that order information and width width information are needed, all information is represented by parameter values without conditional statement (1210).

The syntax of the local three-dimensional image parameter shown in FIG. 12A includes the image configuration type information (stereo_file_format), the image layout order information (LR_first), and the width width information (composition_width, composition_height) .

12B illustrates another method of representing the syntax of a local three-dimensional image parameter, in accordance with an embodiment of the present invention.

The syntax of the local three-dimensional image parameter shown in FIG. 12B is that the image structure type information (stereo_file_format), the image layout order information (LR_first), and the width width information (composition_width, composition_height) And a case where the video data section is set uniformly is expressed.

The method in which the video configuration type information, the video arrangement order information, and the width width information of the present invention are set according to the video data section is set only when all three pieces of information are individually set (FIG. 12A) But is not limited thereto.

For example, the video configuration format information is set uniformly for all video data sections, but the video arrangement order information and width width information may be set separately for each video data section. In addition, while the video configuration type information and the video layout order information are individually set for each video data section, the width width information may be set uniformly for all video data sections.

13 shows a flow diagram of a method for receiving a video data stream including local three-dimensional image parameters, in accordance with an embodiment of the present invention.

In step 1310, a video data stream including a video data section of the two-dimensional video data section and the three-dimensional video data section is received.

In step 1320, a local 3D image parameter, which is a parameter for an image of each image data section, is extracted from the received image data stream. The local 3D image parameters are extracted from the 3D image of each image data section, And image arrangement order information indicating the order in which the additional viewpoint images are arranged.

In one embodiment of the present invention, the local three-dimensional image parameter includes at least one of image data section position information, image configuration format information, width width information, and image layout order information.

In one embodiment of the present invention, the local 3D image parameter information is extracted from an ISO-based media file format if the 3D image data stream is an ISO-based media file format.

In another embodiment of the present invention, the ISO-based media file format includes a moov box, an mdat box and a meta box, and the local three-dimensional image parameter information includes a lower level box of a meta box, a lower level box of a moov box, A lower level box of a trak box, a lower level box of a trak box, and a lower level box of a meta box which is a lower level of a trak box.

At step 1330, at least one of the two-dimensional image and the three-dimensional image of the image data section is reconstructed using the extracted local three-dimensional image parameters.

14 shows a flow diagram of a method of generating a video data stream including local three-dimensional image parameters, in accordance with an embodiment of the present invention.

In step 1410, in the video data stream including the media data area divided into the plurality of video data sections, two-dimensional video data or three-dimensional video data is recorded in each video data section.

In step 1420, a local three-dimensional image parameter including the image arrangement order information indicating the order in which the reference view image and the additional view image are arranged in the image configuration format of each image data section is recorded in the image data stream.

In one embodiment of the present invention, the local three-dimensional image parameter includes at least one of image data section position information, image configuration format information, width width information, and image layout order information.

In an embodiment of the present invention, when the 3D image data stream is an ISO-based media file format, the local 3D image parameter is recorded in an ISO-based media file format.

In another embodiment of the present invention, the ISO-based media file format includes a moov box, an mdat box, and a meta box, and includes a lower level box of a meta box, a lower level box of a moov box, Local three-dimensional image parameter information is recorded in at least one of a lower level box, a lower level box of a trak box, and a lower level box of a meta box which is a lower level of a trak box.

The above-described embodiments of the present invention can be embodied in a general-purpose digital computer that can be embodied as a program that can be executed by a computer and operates the program using a computer-readable recording medium. The computer readable recording medium may be a magnetic storage medium such as a ROM, a floppy disk, a hard disk, etc., an optical reading medium such as a CD-ROM or a DVD and a carrier wave such as the Internet Lt; / RTI > transmission).

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

FIG. 1A shows an example of an implementation method of a local three-dimensional image based on a two-dimensional image.

FIG. 1B shows another example of an implementation of a local three-dimensional image based on a two-dimensional image.

Figure 2 shows a block diagram of an image data stream receiving apparatus that includes local three-dimensional image parameters, in accordance with an embodiment of the present invention.

3 illustrates a block diagram of an apparatus for generating image data streams that includes local three-dimensional image parameters, in accordance with an embodiment of the present invention.

Figure 4 illustrates a method for implementing a local three-dimensional image in accordance with an embodiment of the present invention.

Figure 5 illustrates a local three-dimensional image parameter in accordance with an embodiment of the present invention.

6A shows a type of image configuration format information according to an embodiment of the present invention.

FIG. 6B shows an example of video arrangement order information according to an embodiment of the present invention.

7 shows a basic structure of a media file format based on the International Standardization Organization (ISO).

Figure 8 shows a box list of an ISO-based media file format.

9 illustrates the syntax of a local three-dimensional image parameter, in accordance with an embodiment of the present invention.

Figure 10 shows the syntax of a local three-dimensional image parameter, according to another embodiment of the present invention.

Figure 11 shows the syntax of a local three-dimensional image parameter, according to another embodiment of the present invention.

Figure 12A illustrates a method for differently representing the syntax of a local three-dimensional image parameter, in accordance with an embodiment of the present invention.

12B illustrates another method of representing the syntax of a local three-dimensional image parameter, in accordance with an embodiment of the present invention.

13 shows a flow diagram of a method for receiving a video data stream including local three-dimensional image parameters, in accordance with an embodiment of the present invention.

14 shows a flow diagram of a method of generating a video data stream including local three-dimensional image parameters, in accordance with an embodiment of the present invention.

Claims (32)

A plurality of image data segments including a three-dimensional image data section for a partial section of the three-dimensional image data and a two-dimensional image data section for a partial section of the two-dimensional image data, Receiving a video data stream; Wherein the local three-dimensional image parameter extracts a local three-dimensional image parameter from the three-dimensional image data section, Including image arrangement order information indicating an order in which viewpoint images are arranged; And And restoring at least one of a two-dimensional image and a three-dimensional image of the image data section using the extracted local three-dimensional image parameter, Wherein the reference view image and the additional viewpoint image separated from the three-dimensional image are determined as a left view image or a right view image based on the image arrangement order information. The method according to claim 1, Further comprising extracting, from the video data stream, video data section number information indicating the number of video data sections, Wherein the local 3D image parameter extraction step comprises a step of extracting identification information of an elementary stream in which the current 3D image parameter is recorded when the local 3D image parameter includes a plurality of elementary streams, Wherein the video data stream position information further includes position information of a video data section indicating a position of the video data stream. 2. The method according to claim 1, Wherein the local 3D image parameter includes the image arrangement order information if the current image data interval is a 3D image data interval. 3. The method of claim 2, Wherein the video data section position information includes start position information of the video data section and end position information of the video data section. 3. The method of claim 2, wherein the local three- Further comprising extracting elementary stream start position information indicating a start position of each elementary stream, Wherein the video data section position information includes video data section length information indicating a length of each video data section based on a start position of the elementary stream. 2. The method according to claim 1, The local 3D image parameter further includes image configuration type information indicating a method of configuring the reference view image and the addition view image as a 3D image, The image configuration format information may include at least one of a side by side format, a top and bottom format, a vertical line interleaved format, a horizonal line interleaved format, line interleaved format, a frame sequential format, a field sequential format, a single reference view video format, and a single additional view-point video format. Stream receiving method. 7. The method of claim 6, wherein the local three- If the image configuration type information is a side-by-side format or a top-and-bottom format, Wherein the local 3D image parameter further includes width width information of each of the reference view image and the addition view image in the image configuration format. 2. The method of claim 1, wherein the local three- Further comprising the step of storing width width information of each of the reference viewpoint image and the additional viewpoint image in the image configuration format. The method according to claim 1, Wherein the local 3D image parameter information is extracted from the ISO-based media file format if the 3D image data stream is an ISO-based media file format. 10. The method of claim 9, The ISO-based media file format includes a moov box, an mdat box, and a meta box, Wherein the local 3D image parameter information includes at least one of a lower level box of the meta box, a lower level box of the moov box, a lower level box of a trak box that is a lower level of the moov box, a lower level box of the trak box, Level box of a meta box which is a lower level of the meta box. A method for generating a video data stream including a media data area divided into a plurality of video data sections, Recording a partial section of the three-dimensional image data or a partial section of the two-dimensional image data composed of at least one of the reference view image and the additional view image in each of the image data sections; The image layout order information indicating the order in which the reference view image and the additional viewpoint image are arranged in the 3D image data recorded in the 3D image data section in which a part of the 3D image data is recorded, Determining; Setting a local three-dimensional image parameter including the image arrangement order information for each image data section and recording the image in the image data stream; And And outputting the image data stream including one of the two-dimensional image data and the three-dimensional image data for each of the image data sections, Wherein the reference view image and the additional viewpoint image separated from the three-dimensional image are determined as a left view image or a right view image based on the image arrangement order information. 12. The method of claim 11, wherein the local three- A video data section number information indicating the number of video data sections; Identification information of a base stream in which a current video data section is recorded when a plurality of base streams recorded with the video data section are recorded; Further comprising at least one of video data section location information indicating a location where the current video data section is recorded in the video data stream. 12. The method of claim 11, wherein the local three- Image configuration type information indicating a method of configuring the reference viewpoint image and the additional viewpoint image in a three-dimensional image format; And Width width information of the reference view image and the additional viewpoint image in the image configuration format information; And at least one of < RTI ID = 0.0 > The image configuration format information may include at least one of a side by side format, a top and bottom format, a vertical line interleaved format, a horizonal line interleaved format, a frame sequential format, a field sequential format, Wherein the at least one video configuration format comprises at least one of a video configuration format. 13. The method of claim 12, Position information expressed using start position information of the video data section and end position information of the video data section; And And position information represented by using video data section length information indicating a length of each video data section based on elementary stream start position information and a starting position of the elementary stream. Way. 12. The method of claim 11, Wherein the local 3D image parameter recording step records the local 3D image parameter in the ISO based media file format if the 3D image data stream is an ISO based media file format. Generation method. 16. The method of claim 15, Wherein the ISO-based media file format includes a moov box, an mdat box, and a meta box, the low-level box of the meta box, the low-level box of the moov box, Dimensional image parameter information to at least one of a lower level box of a trak box, a lower level box of the trak box, and a lower level box of a meta box which is a lower level of the trak box, / RTI > A plurality of image data segments including a three-dimensional image data section for a partial section of the three-dimensional image data and a two-dimensional image data section for a partial section of the two-dimensional image data, A receiving unit for receiving a video data stream; Wherein the local three-dimensional image parameter extracts a local three-dimensional image parameter from the three-dimensional image data section, A local three-dimensional image parameter extraction unit including image arrangement order information indicating an order in which viewpoint images are arranged; And And an image restoring unit for restoring at least one of a two-dimensional image and a three-dimensional image of the image data section using the extracted local three-dimensional image parameter, Wherein the reference view image and the additional viewpoint image separated from the three-dimensional image are determined as the left view image or the right view image based on the image arrangement order information. 18. The method of claim 17, Further extracting, from the video data stream, video data section number information indicating the number of video data sections, Wherein the local three-dimensional image parameter extracting unit extracts the local three-dimensional image parameter from the identification information of the elementary stream in which the current image data section is recorded when the local three-dimensional image parameter is a plurality of elementary streams, And the video data stream position information indicating the video data stream position information. 19. The method of claim 18, Position information expressed using start position information of the video data section and end position information of the video data section; And And position information represented by using length information of each video data section based on each elementary stream start position information and a start position of the elementary stream. 18. The image processing apparatus according to claim 17, wherein the local three- Image configuration type information indicating a method of configuring the local view image and the viewpoint view image as three-dimensional images; And Further comprising width width information of the reference viewpoint image and the additional viewpoint image in the image configuration format, The image configuration format information may include at least one of a side by side format, a top and bottom format, a vertical line interleaved format, a horizonal line interleaved format, a frame sequential format, a field sequential format, Wherein the video data stream includes at least one video configuration format. 18. The method of claim 17, Wherein the local 3D image parameter information is extracted from the ISO-based media file format if the 3D image data stream is an ISO-based media file format. 22. The method of claim 21, The ISO-based media file format includes a moov box, an mdat box, and a meta box, Wherein the local 3D image parameter information includes at least one of a lower level box of the meta box, a lower level box of the moov box, a lower level box of a trak box that is a lower level of the moov box, a lower level box of the trak box, And a lower level box of a meta box which is a lower level of the meta box. An apparatus for generating a video data stream including a media data area divided into a plurality of video data sections, A video data recording unit for recording a partial section of the three-dimensional video data or a partial section of the two-dimensional video data composed of at least one of the reference viewpoint image and the additional viewpoint image in each video data section; The image layout order information indicating the order in which the reference view image and the additional viewpoint image are arranged in the 3D image data recorded in the 3D image data section in which a part of the 3D image data is recorded, A local three-dimensional image parameter recording unit for setting the image arrangement order by setting a local three-dimensional image parameter for each image data section and recording the local three-dimensional image parameter in the image data stream; And And an output unit for outputting the image data stream including one of the two-dimensional image data and the three-dimensional image data for each of the image data periods, Wherein the reference view image and the additional viewpoint image separated from the three-dimensional image are determined as a left view image or a right view image based on the image arrangement order information. 24. The method of claim 23, wherein the local three- A video data section number information indicating the number of video data sections; Identification information of a base stream in which a current video data section is recorded when a plurality of base streams recorded with the video data section are recorded; Further comprising at least one of video data section location information indicating a location where the current video data section is recorded in the video data stream. 24. The method of claim 23, wherein the local three- Image configuration type information indicating a method of configuring the reference viewpoint image and the additional viewpoint image in a three-dimensional image format; And And a width width information of the reference view image and the additional viewpoint image in the image configuration format, The image configuration format information may include at least one of a side by side format, a top and bottom format, a vertical line interleaved format, a horizonal line interleaved format, a frame sequential format, a field sequential format, Wherein the video data stream comprises at least one of a video configuration format. The method of claim 24, wherein the video data section location information comprises: Position information expressed using start position information of the video data section and end position information of the video data section; And And position information represented by using video data section length information indicating a length of each video data section based on elementary stream start position information and a starting position of the elementary stream. Device. 24. The method of claim 23, Wherein the local 3D image parameter recording unit records the local 3D image parameter in the ISO-based media file format when the 3D image data stream is an ISO-based media file format. Device. 28. The method of claim 27, Wherein the local 3D image parameter recording unit records the local 3D image parameter of the moov box, the moov box, the mdat box, and the meta box when the ISO based media file format includes a moov box, an mdat box, The local three-dimensional image parameter information is recorded in at least one of a lower level box of a lower level trak box, a lower level box of the trak box, and a lower level box of a meta box which is a lower level of the trak box A video data stream generation apparatus. A computer-readable recording medium containing a program for implementing the method of receiving the image data stream of any one of claims 1 to 10. A computer-readable recording medium embodying a program for implementing the method of generating a video data stream according to any one of claims 11 to 16. A method of restoring a stereoscopic image from an image bitstream including stereoscopic image data, Reading a data interval parameter for an image data interval including at least one frame of the image bitstream from the image bitstream through parsing of the image bitstream; Extracting, from the data interval parameters, video data section number information indicating the number of video data intervals; Extracting video data section length information on the length of each video data section from the data section parameters; Extracting stereo / mono information indicating whether one of the stereoscopic image data and the monoscopic image data is inserted in each of the image data sections from the data interval parameter; And And restoring an output image using the stereoscopic image data or the monoscopic image data extracted from the image bit stream, Wherein the data interval parameter is used to reproduce the reconstructed output image in a two-dimensional or three-dimensional reproduction mode. A method for generating a stereoscopic image bitstream, Inserting a data interval parameter for a video data interval including at least one frame out of the video bitstream into the video bitstream for a video data interval including at least one frame of a stereoscopic video; Inserting the video data section number information indicating the number of video data sections including at least one frame of the video bit stream into the data section parameter; Inserting video data section length information on the length of each video data section into the data section parameter; Inserting stereo / mono information indicating whether one of the stereoscopic image data and the monoscopic image data is inserted into each of the image data sections, in the data interval parameter; And And inserting image data including the image data intervals into the image bitstream, Wherein the data interval parameter is used for reproducing the image data.

Images