KR101396337B1 - Method and apparatus for generating header information of stereoscopic image data - Google Patents

Abstract

A method of generating a stereoscopic image bitstream according to the present invention is a method for generating stereoscopic image data that is three-dimensionally reproduced from image data recorded in a payload area of an image bitstream, Records the camera information of the camera which has acquired the stereoscopic image in the header area, records parallax information between the reference view image and the addition view image of the stereoscopic image in the header area, The stereoscopic image transmitted and received by recording in the payload area is accurately restored and reproduced, and the restored image is easily used in the post-processing process.

Stereoscopic image format, Stereoscopic image transmission, Stereoscopic image format, Stereoscopic image transmission,

Description

[0001] The present invention relates to a method and apparatus for generating a stereoscopic image bitstream,

The present invention relates to a method and an apparatus for generating header information of stereoscopic image data. More particularly, the present invention relates to a method of generating header information in which information necessary for restoring and reproducing an original image is decoded by decoding a coded transmitted stereoscopic image And apparatus.

Currently, many methods for transmitting stereoscopic images have been proposed. For example, in order to efficiently transmit a stereoscopic image, a depth map transmission method using an MPEG-4 Multi-view Video Profile (MVP), an MPEG-4 MAC (Multiple Auxiliary Component) And AVC / H.264 MVC (Multi-view Video Coding). At present, standardization of data about stereoscopic image in MAF (Multimedia Application Format) is under way.

FIG. 1 shows a stereoscopic image format on a pixel basis for transmission of a stereoscopic image.

Pixels of the left viewpoint image and the right viewpoint image are sampled in a lattice unit and the right image is shifted by one pixel so as to prevent the left and right images from overlapping to form a single image format for the stereoscopic image. A stereoscopic image transmission / reception method uses a conventional two-dimensional encoder and a decoder. Lost pixels occur because two left and right images are composed of a single stereoscopic image format of the same resolution.

Fig. 2 shows a lost pixel restoration apparatus in a pixel-by-pixel stereoscopic image format.

In order for the display device to reproduce the original resolution image, the lost pixels must be reconstructed in the stereoscopic image format generation step of FIG. Therefore, the image sampled in units of pixels is extracted for each direction, and each directional pixel value is multiplied by a predetermined weight and added together to restore the original left and right images.

FIG. 3 illustrates a reference structure of an ISO-based media file format.

In the conventional ISO-based media file format, actual media data is stored in the media data area, and information on the characteristics of the media data is stored in the movie data area.

The transmission image format of FIG. 1 uses the fact that there are many pieces of information overlapping the left image and the right image for transmission efficiency. That is, by combining a left image and a right image on a pixel basis to generate a single mixed image, the transmission efficiency is improved by reducing the amount of transmitted data.

However, in the conventional stereoscopic image format, the scale function used in the process of composing the mixed image for transmission by combining the left side image and the right side image in the movie data area moov, the camera function obtained by obtaining the left side image and the right side image Whether the header information is transmitted or not.

If an arbitrary method of composing a stereoscopic image into a mixed image is defined and transmitted according to the image format of FIG. 1 and transmitted, there is no information about the mixed image configuration method at the transmitting end in the encoding end of the receiving end. The inverse transformation of the mixed image for obtaining the image can not be accurately performed. Therefore, even if lossless transmission is performed according to the existing stereoscopic image format, there is no information such as mixed image configuration method and scaling information at the receiving end, so that the correct stereoscopic image can not be restored.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a method and apparatus for generating header information of stereoscopic image data including information essential for reconstructing a stereoscopic image composed of mixed images during a transmission process.

Also, the present invention proposes a method and apparatus for generating stereoscopic image data in which a stereoscopic image is efficiently recorded and transmitted through essential header information of various stereoscopic images, and the original image is restored and reproduced at a receiving end.

According to an aspect of the present invention, there is provided a method of generating a stereoscopic image bitstream according to a preferred embodiment of the present invention, including the steps of generating stereoscopic image data reproduced in three dimensions among image data recorded in a payload area of an image bitstream, Recording the 3D information on the header region of the image bitstream, recording the camera information on the camera that has acquired the stereoscopic image in the header region, Recording parallax information in a header area and recording video data in a payload area of a bit stream.

One embodiment of the present invention includes a method of recording scaling method information to be used when a mixed image including a reference view image and a viewpoint addition image is formed in a header area.

One embodiment of the present invention includes recording information on a method of constructing a mixed image having information of a reference view image and a viewpoint addition image in a header area.

The 3D playback section information of one embodiment includes the number information of the 3D playback section.

The 3D playback section information of the preferred embodiment includes start index information indicating the index of the start frame of the 3D playback section recorded in the payload area and end index information indicating the index of the last frame of the 3D playback section recorded in the payload area .

When the 3D playback section of the preferred embodiment is composed of one data stream, the start index information and the end index information represent an index for one data stream. If the 3D playback section is composed of a plurality of data streams, And the end index information indicate an index for the main data stream among the plurality of data streams.

The camera information of one embodiment includes recording the camera parameter information on the camera in the header area according to the type of the camera and whether the stereoscopic image data transmits camera parameters.

The camera parameter information of an embodiment includes information on the number of camera parameter coefficients and information on the rotation, translation, image center, focal length, and aspect ratio of each of the reference point camera and the viewpoint camera.

The parallax information of the preferred embodiment includes parallax information of one global disparity vector for the whole of the stereoscopic image and parallax information of the representative disparity vector for a predetermined object of the stereoscopic image.

The parallax information of the global disparity vector of the preferred embodiment includes the number information of the area having the global disparity value of the frames recorded in the payload area, the global disparity start index information indicating the index of the frame having the global disparity value change, And vector value information of the variation.

The representative variation vector of the preferred embodiment includes a variation vector having a vector value of the minimum value among the variation vectors and a variation vector having a vector value of the maximum value, a variation vector of the background and the foreground, mutation vectors of the respective objects, / RTI > maximum value / minimum values of < / RTI >

The parallax information of the representative mutation vector of the preferred embodiment includes the number information of the representative mutation vector and the vector value information of the representative mutation vector.

The scaling method information in one embodiment is information about using at least one of the sampling method, the linear method, the cubic convolution method and the variable scaling function method as the scaling method.

The variable scaling function of one embodiment is determined by the number of horizontal direction coefficients, the number of horizontal direction coefficients, and the number of vertical direction coefficients that can be set by an external request.

The mixed image configuration information of another embodiment includes information on the width and height ratio of the reference viewpoint image and the additional viewpoint image, the arrangement order information of the reference viewpoint image, and the additional viewpoint image.

According to an aspect of the present invention, there is provided an apparatus for generating a stereoscopic image bitstream according to an exemplary embodiment of the present invention. The apparatus includes a decoder for decoding stereoscopic image data Dimensional reproduction section information recording section for recording the three-dimensional reproduction section information on the stereoscopic image in the header area of the image bit stream, a camera information recording section for recording the camera information on the camera obtained the stereoscopic image in the header area, A parallax information recording unit for recording parallax information between the reference view image and the addition view image in a header area, and an image recording unit for recording the image data in the payload area of the bit stream.

One embodiment of the present invention includes a scaling information recording unit for recording scaling method information used in a mixed image including a reference view image and a viewpoint addition image in a header area.

One embodiment of the present invention includes a mixed image configuration information recording unit that records information on a method of configuring a mixed image having information of a reference view image and a viewpoint addition image in a header area.

According to an aspect of the present invention, there is provided a stereoscopic image bitstream structure including a payload area in which image data is recorded and a stereoscopic image reproduced in three dimensions, And a header area including parallax information between the reference view image and the addition view image of the stereoscopic image, the 3D information of the 3D playback section, the camera information of the camera that acquires the stereoscopic image, and the stereoscopic image.

One embodiment of the present invention records the header information including the scaling method information used when a mixed image including the reference view image and the addition view image information is composed in the header area.

One embodiment of the present invention records header information including information on how to construct a mixed image having information of a reference view image and a viewpoint addition image in a header area.

In addition, the present invention includes a computer-readable recording medium on which a program for implementing a stereoscopic image bitstream generation method according to an embodiment is recorded.

The method and apparatus for generating stereoscopic image data according to the present invention can effectively transmit and store stereoscopic images through header information essential for various stereoscopic image formats and reproduce them in a general manner.

That is, since the parallax information of the stereoscopic image, the camera information, the composition information of the mixed image, the reproduction section information of the three-dimensional image and the scaling information are recorded in the header area of the stereoscopic image data of the present invention, There is an effect that the data needed when converting a stereoscopic image into a stereoscopic image is specified in detail.

In addition, camera parameters and partial parallax information are inserted into the header information of the stereoscopic image data, so that camera parameters and parallax information can be easily used in a post-processing process that may exist after the decoding end.

Hereinafter, a method and apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention will be described in detail with reference to FIGS. 4A to 12B.

4A and 4B, an apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention will be described.

4A is a block diagram of an apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention.

The stereoscopic image bitstream generating apparatus 400 includes a 3D playback section information recording section 410, a camera information recording section 430, a parallax information recording section 450 and an image recording section 470.

The three-dimensional reproduction section information recording section 410 records the three-dimensional reproduction section information on the stereoscopic image data reproduced in three dimensions among the image data recorded in the payload area of the stereoscopic image bit stream in the header area of the image bit stream And outputs it to the image recording unit 470.

The camera information recording unit 430 records the camera information for the camera that has acquired the stereoscopic image in a header area and outputs the camera information to the image recording unit 470.

The parallax information recording unit 450 records parallax information between the reference view image and the addition view image of the stereoscopic image in a header area and outputs the parallax information to the image recording unit 470.

The header information is all stored in the header area of the stereoscopic image bit stream in the 3D playback section information recording section 410, the camera information recording section 430 and the time difference information recording section 450 and then outputted to the image recording section 470.

The image recording unit 470 records the image data in the payload area of the image bit stream to output a stereoscopic image bit stream.

Therefore, the stereoscopic image bitstream generated by the apparatus for generating stereoscopic image bitstream 400 according to an embodiment of the present invention stores image data in the payload area, and in the header area, , And header information of the time difference information.

FIG. 4B shows a block diagram of an apparatus for generating a stereoscopic image bitstream according to another embodiment of the present invention.

The stereoscopic image bitstream generation apparatus 405 of the present embodiment includes a three-dimensional reproduction section information recording section 410, a camera information recording section 430, a parallax information recording section 450, A recording unit 470, and a mixed image configuration information recording unit 420 and a scaling information recording unit 440.

The mixed image configuration information recording unit 420 records the method information constituting the mixed image including the reference view image and the addition view image information in the header area and outputs the method information to the image recording unit 470.

The scaling information recording unit 440 records scaling method information, which is used when a mixed image including the reference view image and the addition view image information is formed, in a header area, and outputs the scaling method information to the image recording unit 470.

Therefore, the bit stream generated by the apparatus for generating stereoscopic image bitstream 405 according to another embodiment of the present invention includes 3D playback interval information, image configuration information, camera information, scaling Information and time difference information as header information in the header area.

5 to 9B, the header information of the stereoscopic image bit stream generated by the apparatus for generating a stereoscopic image bit stream according to the present invention will be described in detail.

FIG. 5 illustrates an embodiment of the syntax of the 3D reconstruction interval information for the apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention.

3D_Period represents the 3D playback section information. In an embodiment of the present invention, the 3-D playback section information is represented by 32 bits (u (32)). The 3D playback section information 3D_Period includes the number information (number_of_3D_period), the start index information (start_position), and the end index information (end_position) of the 3D playback section.

The number_of_3D_period represents the number information of the three-dimensional reproduction section, that is, the number of image data sections that the user can view in three dimensions.

start_position is the start index information, which indicates the position index in the payload area of the video bit stream where the start frame of the 3D playback section in the payload area of the video bit stream is located. In an embodiment of the present invention, the 3-D playback section information is represented by 32 bits (u (32)).

end_position is the ending index information and indicates the position index in the payload area of the video bitstream where the last frame of the 3D playback section is located. In an embodiment of the present invention, the 3-D playback section information is represented by 32 bits (u (32)).

Since start index information (start_position) and end index information (end_position) are required for each three-dimensional reproduction section, when i is an integer, start index information (start_position [i]) and end index information ]) Shall be determined.

In one embodiment, when the 3D playback section is composed of one elementary stream (ES), start index information (start_position) and end index information (end_position) indicate indexes for one data stream.

In another embodiment, the start index information (start_position) and the end index information (end_position) may be used for a plurality of data streams (ES) of a plurality of data streams, Indicates an index.

6A shows an embodiment of syntax of mixed image configuration information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention. One embodiment of the present invention selects a base view image and an additional image as a left viewpoint and a right viewpoint among a plurality of viewpoint images.

The mixed image configuration information (stereoFormat_params) includes a mixed image format type (Stereo_format_type) of the stereoscopic image, a placement order (LR_first), a width ratio LR_width_ratio, a height ratio LR_height_ratio, a scaling_method ) And a scaling function (scaling_func).

Stereo_format_type is a mixed image format type of a stereoscopic image, and indicates a format type according to a method of composing a mixed image using a two-dimensional image of a plurality of viewpoints. The mixed image format of the stereoscopic image will be described in detail with reference to FIG. 6B. In one embodiment, the mixed image format type (Stereo_format_type) is represented by 8 bits (u (8)).

6B illustrates an embodiment of a mixed image configuration format used for mixed image configuration information for a stereoscopic image bitstream generation apparatus according to an exemplary embodiment of the present invention.

When Stereo_format_type is 0, it indicates a vertical line interleaved format. One embodiment of the vertical line interleaved format forms a mixed image by arranging the vertical direction lines of the reference view image and the addition view image alternately on the lines of the mixed image.

When Stereo_format_type is 1, it indicates a horizontal line interleaved format. One embodiment of the horizontal line interleaved format forms a mixed image by arranging horizontal lines of the reference view image and the addition view image alternately on the lines of the mixed image.

If Stereo_format_type is 2, it indicates top-down format. In the top-down format, for example, a reference view image and a viewpoint view image in which the resolution is reduced by half in the vertical direction are arranged at the upper and lower ends of the mixed image, respectively, to form a single mixed image.

If Stereo_format_type is 3, it indicates Side by side format. In the side by side format, for example, a reference view image and a viewpoint view image in which the resolution is reduced in half in the horizontal direction and the additional viewpoint image are arranged in the left region and the right region of the mixed image, respectively, .

When Stereo_format_type is 4, it indicates a field sequential format. The field sequential format is, for example, an image format according to a scheme of composing a mixed image by alternately displaying the reference view image field and the additional viewpoint image field on the playback unit.

If Stereo_format_type is 5, it indicates Frame sequential format. The frame sequential format is, for example, an image format according to a scheme of composing a mixed image by alternately displaying the reference view image frame and the additional view image frame on the playback unit.

When Stereo_format_type is 6, it indicates a block interleaved format. In the block interleaved format, for example, a reference viewpoint image and a viewpoint viewpoint image are alternately arranged on a block basis to form a mixed image.

A Stereo_format_type of 7 indicates a Disparity map. According to this format, an image format according to a scheme of composing a mixed image using a reference view image and a displacement map (Disparity map).

If Stereo_format_type is 8, it indicates depth map. According to this format, a mixed image is generated using a reference view image and a depth map.

If Stereo_format_type is 9, it indicates displacement and motion map (Disparity + Motion map). According to this format, a mixed image is generated using a reference view image and a displacement map and a motion map (Disparity + Motion map).

If Stereo_format_type is 10, it indicates monoscopic image format. According to this format, a single view image of one of the reference viewpoint image or the additional viewpoint image is used.

When the Stereo_format_type is 11 to 255, it indicates a User private format. Therefore, an image format designated by the user is used to construct a mixed image.

LR_first is a parameter for the arrangement order information of the reference view image and the additional viewpoint image, for example, information on the arrangement method of the left and right images. The arrangement method information of the left and right images will be described in detail with reference to FIG. One embodiment of the present invention shows LR_first as one bit (u (1)).

6C illustrates an embodiment of a method of arranging a reference view image and a supplementary view image used for mixed image configuration information for a stereoscopic image bit stream generating apparatus according to an embodiment of the present invention.

When LR_first is 0, the left image is the reference view image, the image data of the left image is the odd-numbered line in the vertical-line interleaved format, the odd-numbered line in the horizontal-line interleaved format, The odd numbered field in the field sequential format, the odd numbered frame in the frame sequential format, and the odd numbered block in the block interleaved format. Likewise, the right image becomes a supplemental viewpoint image and is arranged in the opposite region of the arrangement region of the left image in each of the above-described mixed image formats.

When LR_first is 1, the right image is the reference view image, and the arrangement of the right image and the left image is opposite to the case where LR_first is 0 as described above.

LR_width_ratio is a parameter for a width ratio of the reference viewpoint image and the addition viewpoint image, and is a parameter for controlling the ratio of the width of the reference viewpoint and the viewpoint image when the mixed image format is a side-by-side format or a top-down format. One embodiment of the present invention shows LR_width_rate as 32 bits (u (32)). LR_width_ratio is calculated as shown in Equation (1).

LR_width_ratio = width _base / width _additional

LR_height_ratio is a parameter for the height ratio of the reference viewpoint image and the addition viewpoint image, and is a parameter for adjusting the ratio of the height of the reference viewpoint and the height of the additional viewpoint image when the mixed image format is a side-by-side format or a top-down format. One embodiment of the present invention shows LR_height_ratio as 32 bits (u (32)). LR_height_ratio is calculated as shown in Equation (2).

LR_height_ratio = height _base / height _additional

scaling_method is a scaling method parameter indicating a scaling method in a scaling process that occurs when a right and left image is combined when there is one data stream. The scaling method must be transmitted so that the left and right images can be accurately reconstructed from the decoding end. The scaling method defined by this parameter will be described with reference to FIG. 7A. The scaling method parameter (scaling_method) of one embodiment is represented by 8 bits (u (8)).

FIG. 7A illustrates an embodiment of a scaling function used for scaling method information (scaling_method) for a device for generating a stereoscopic image bitstream according to an embodiment of the present invention.

If the scaling method parameter value (scaling_method) is 0, the stereoscopic image is scaled by the sampling method. The sampling method is a method in which pixels of a predetermined period are extracted and scaled in a single view image.

If the scaling method parameter value (scaling_method) is 1, the stereoscopic image indicates that it is scaled by the linear method. The linear method constitutes a pixel of a mixed image with pixel values calculated through a line form using at least one or more pixel values in a single view image.

When the scaling method parameter value (scaling_method) is 2, the stereoscopic image is scaled by cubic convolution. The Cubic convolution constructs the pixels of the mixed image using the average value calculated considering the distances to the sixteen surrounding pixels surrounding the current pixel.

If the scaling method parameter value (scaling_method) is from 3 to 255, the stereoscopic image indicates that it has been scaled by a user-specific scaling function.

FIG. 7B shows an embodiment of the syntax of the scaling method information (scaling_method) for the apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention.

scaling_func is a scaling function set by the user when the scaling method parameter (scaling_method) is 3 or more. One embodiment of the present invention requires two-dimensional scaling function coefficients in the horizontal and vertical directions to set the scaling function.

number_of_hor_coeff represents the number of horizontal direction coefficients of the scaling function set by the user. In one embodiment, number_of_hor_coeff is represented by 8 bits.

hor_scaling_coeff indicates the horizontal direction coefficient value of the scaling function set by the user. Since the coefficient value is required for the number of number_of_hor_coeff, hor_scaling_coeff [i] should be set in the range 0 ≤ i <number_of_hor_coeff when i is an integer. In one embodiment, hor_scaling_coeff [i] is represented by 32 bits.

y _hor [i] is the horizontal direction pixel value of the scaled image, x _hor [i] is the horizontal direction pixel value of the original image, and h _hor [i] _{The relations of hor} [i], x _hor [i] and h _hor [i] are as follows.

y _hor [i] = x _hor [i] * h _hor [i]

Here, * denotes a convolution operation symbol.

number_of_ver_coeff represents the number of vertical direction coefficients of the scaling function set by the user. In one embodiment, number_of_ver_coeff is represented by 8 bits.

ver_scaling_coeff indicates the vertical direction coefficient value of the scaling function set by the user. Since the coefficient value is required by number_of_ver_coeff, when i is an integer, ver_scaling_coeff [i] should be set in the range of 0 ≤ i <number_of_ver_coeff. In one embodiment, ver_scaling_coeff [i] is represented by 32 bits.

when y _ver [i] represents the vertical direction pixel value of the scaled image, x _ver [i] represents the vertical direction pixel value of the original image, and h _ver [i] represents the vertical direction coefficient value of the scaling function set by the user, y _{The relations of ver} [i], x _ver [i] and h _ver [i] are as follows.

y _ver [i] = x _ver [i] * h _ver [i]

Similarly, * denotes a convolution operation symbol.

8A shows an embodiment of syntax of camera information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

camera_distance represents the distance between the stereoscopic cameras. The camera_distance in one embodiment is represented by 32 bits.

The view_type indicates a type of viewpoint such as a crossed-eye view or a parallel-eye viewpoint of the stereoscopic image. The view_type of one embodiment is represented by 8 bits.

View_distance_vs_depth represents the ratio of viewing distance to use / validity depth. In one embodiment, View_distance_vs_depth is represented by 32 bits.

camera_type indicates the camera type used when acquiring the stereoscopic image. The camera_type in one embodiment is represented by 8 bits.

is_camera_params is a parameter related to camera parameter transmission information, and when not 0, transmits the reference time point and the parameter (Camera_params) of the additional point-of-view camera. Is_camera_params in one embodiment is represented by 1 bit.

is_parallel_info indicates whether to transmit parallax information (Parallax_info). If it is not 0, the parallax information is transmitted. Is_parallax_info in one embodiment is represented by 1 bit.

8B shows an embodiment of syntax of camera parameter information used for camera information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention. In the present embodiment, the left view and the right view are used as an example of the reference view and the additional view.

The camera parameter information (Camera_params) includes the number of camera parameter coefficients (number_of_camera_params), and the parameters of the left and right cameras (Left_camera_params, Right_camera_params).

number_of_camera_params is the number of camera parameter coefficients, and number_of_camera_params in one embodiment is represented by 8 bits.

Left_camera_params indicates the parameters of the left camera. Left_camera_params includes rotation information of the left view camera, translation information, and parameters related to the intrinsic properties such as image center, focal length, and aspect ratio. Left_camera_params in one embodiment is represented by 32 bits.

Right_camera_params represents the parameter of the right-view camera. Right_camera_params includes parameters related to the intrinsic properties of the right view camera rotation information, parallel movement information, and image center, focal length, and aspect ratio. Right_camera_params in one embodiment is represented by 32 bits.

FIG. 9 shows an embodiment of syntax of parallax information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

Parallax information includes parallax information indicating a variation occurring for the entire stereoscopic image and parallax information for a representative variation vector generated for a predetermined object of the stereoscopic image. The vector to be the subject of the representative variation vector is a variation vector having a vector value of a minimum value among a plurality of variation vectors and a variation vector having a vector value of a maximum value. In addition, the predetermined object to be subjected to representative variation includes a background, a foreground, and respective individual objects.

The parallax information Parallex_info includes information on the number of the global disparity vectors num_of_global_disparity, the global disparity start index information global_disparity_index, the global disparity vector value global_disparity, the representative disparity vector number num_of_representative_disparity, and the global disparity vector value representative_disparity ).

num_of_global_disparity indicates the number of times the global disparity information among the frames recorded in the payload area has changed. Num_of_global_disparity in one embodiment is represented by 32 bits.

global_disparity_index indicates the index of the frame in which the global variation starts to occur in the frame in which the global vector is generated. The global_disparity_index in one embodiment is represented by 32 bits.

global_disparity represents the vector value of the global variation. The global_disparity of one embodiment is represented by 16 bits.

i is an integer, and the global variation between the global_disparity_index [i] and the global_disparity_index [i + 1] th frames has a value of global_disparity [i] when 0? i <num_of_global_disparity.

num_of_representative_disparity indicates the number information of the representative variation. Num_of_representative_disparity in one embodiment is expressed by 8 bits.

representative_disparity represents the vector value of the representative variation. The representative_disparity of one embodiment is represented by 16 bits.

i is an integer, and representative_disparity [i] has representative variation when 0 ≤ i <num_of_representative_disparity. The corresponding information represents the minimum and maximum values of the disparity vector, the disparity vector information of the representative object, and the maximum and minimum values that the disparity / depth vector map can represent.

FIG. 10 shows an embodiment of a header area of a stereoscopic image bitstream according to a preferred embodiment of the present invention.

A 3D reconstruction information area 1010, a mixed image configuration information area 1030, and a 3D reconstruction information area 1030 are formed in a header area of a stereoscopic image bitstream generated by the stereoscopic image bitstream generating apparatuses 400 and 405 according to an embodiment of the present invention. And a camera information area 1050.

The 3D playback information area (3D period) 1010 includes the number information (number_of_3D_period, 1011), the start_position 1012, and the end_position 1013 of the 3D playback section.

The mixed image configuration information area 1030 includes a format type (Stereo_format_type, 1031) of the stereoscopic image, arrangement order information (LR_first, 1032) of the reference view image and the addition view image, the width of the reference view image, (LR_width_ratio, 1033), a parameter LR_height_ratio 1034, a scaling_method 1035, and a number of horizontal direction coefficients of a scaling function (number_of_hor_coeff, 1036) , The horizontal direction coefficient value (hor_scaling_coeff [i], 1037) of the scaling function, the number of vertical direction coefficients of the scaling function (number_of_ver_coeff [i], 1038), and the vertical direction coefficient value (ver_scaling_coeff [i] .

The camera information area (Stereoscopic camera) 1050 includes an interval (camera_distance) 1051 between the stereoscopic cameras, a view type (view_type) 1052 of the stereoscopic image, a view_distance_vs_depth (1053) (Camera_type) 1054, camera parameter transmission information (is_camera_params) 1055, number of camera parameter coefficients (number_of_camera_params) 1056, left camera parameters Left_camera_params 1057 and right camera parameters Right_camera_params 1058, .

In addition, the camera information area 1050 includes parallax information transmission information (is_parallel_info) 1059, number of global disparity vector information num_of_global_disparity 1060, global disparity start index information global_disparity_index [i] 1061, (Num_of_representative_disparity) 1063 and a representative variation vector value (representative_disparity [i], 1064). The vector value (global_disparity [i], 1062)

11A shows a flowchart of a method of generating a stereoscopic image bitstream according to a preferred embodiment of the present invention.

In step 1110, three-dimensional reproduction section information on stereoscopic image data reproduced in three dimensions among the image data to be recorded in the payload area of the image bit stream is recorded in the header area of the image bit stream.

In step 1130, camera information for the camera that has acquired the stereoscopic image is recorded in the header area.

In step 1150, parallax information between the reference view image and the addition view image of the stereoscopic image is recorded in the header area.

In step 1170, the video data is recorded in the payload area of the video bitstream.

11B shows a flowchart of a method of generating a stereoscopic image bitstream according to an embodiment of the present invention.

In step 1110, three-dimensional reproduction section information on stereoscopic image data reproduced in three dimensions among the image data to be recorded in the payload area of the image bit stream is recorded in the header area of the image bit stream.

In step 1120, the scaling method information used when composing a mixed image including information of the reference view image and the addition view image is recorded in the header area.

In step 1130, camera information for the camera that has acquired the stereoscopic image is recorded in the header area.

In step 1140, the mixed image configuration information for the method of constructing the mixed image using the reference view image and the addition view image is recorded in the header area.

In step 1150, parallax information between the reference view image and the addition view image of the stereoscopic image is recorded in the header area.

In step 1170, the video data is recorded in the payload area of the video bitstream.

The above-described embodiments of the present invention can be embodied in a general-purpose digital computer that can be embodied as a program that can be executed by a computer and operates the program using a computer-readable recording medium. The computer readable recording medium may be a magnetic storage medium such as a ROM, a floppy disk, a hard disk, etc., an optical reading medium such as a CD-ROM or a DVD and a carrier wave such as the Internet Lt; / RTI &gt; transmission).

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Fig. 1 shows a conventional method of constructing a stereoscopic image on a pixel-by-pixel basis.

Fig. 2 shows a block diagram of a system for recovering lost pixels of a conventional pixel-by-pixel scaleless cicopric image.

FIG. 3 illustrates a reference structure of an ISO-based media file format.

4A is a block diagram of an apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention.

FIG. 4B shows a block diagram of an apparatus for generating a stereoscopic image bitstream according to another embodiment of the present invention.

FIG. 5 shows an embodiment of the syntax of the 3D reconstruction interval information for the apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention.

6A shows an embodiment of syntax of mixed image configuration information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

6B illustrates an embodiment of a stereo image configuration format used for mixed image configuration information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

6C illustrates an embodiment of a method of arranging a reference view image and a supplementary view image used in mixed image configuration information for a stereoscopic image bitstream generating apparatus according to an embodiment of the present invention.

7A illustrates an example of a scaling function used for scaling method information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

FIG. 7B shows an embodiment of the syntax of the scaling method information for the apparatus for generating a stereoscopic image bitstream according to an embodiment of the present invention.

8A shows an embodiment of syntax of camera information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

8B shows an embodiment of syntax of camera parameter information used for camera information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

9 illustrates an embodiment of syntax of parallax information for a stereoscopic image bitstream generation apparatus according to an embodiment of the present invention.

FIG. 10 shows an embodiment of a header area of a stereoscopic image bitstream according to a preferred embodiment of the present invention.

11A shows a flowchart of a method of generating a stereoscopic image bitstream according to a preferred embodiment of the present invention.

11B shows a flowchart of a method of generating a stereoscopic image bitstream according to an embodiment of the present invention.

Claims (7)

A method for generating a stereoscopic image bitstream, Inserting camera parameter insertion information into the image bitstream indicating whether or not a camera parameter indicating information on a camera that has acquired the stereoscopic image is inserted; Inserting, into the image bitstream, reproduction interval information indicating a video data interval in which the reproduction scheme is distinguished from the stereoscopic image data; And And inserting the image data into the image bitstream, Wherein the camera parameter insertion information and the playback section information are used for restoring the stereoscopic image to be reproduced in a two-dimensional or three-dimensional playback mode, Wherein the reproduction section information indicates a number of reproduction mode conversion times information indicating the number of sections in which the reproduction method is converted into a two-dimensional or three-dimensional stereoscopic image and a number of sections in which the stereoscopic image is reproduced in two- or three- And a number of playback interval information. The stereoscopic image bitstream generation method according to claim 1, And inserting the camera arrangement information into the image bitstream as camera parameters inserted in the image bitstream based on the camera parameter insertion information, the camera arrangement information indicating whether the arrangement scheme of the camera is an intersection equation or not. / RTI &gt; to generate a stereoscopic image bitstream. The stereoscopic image bitstream generation method according to claim 2, Further comprising the step of inserting the rotation angle information of the camera into the image bit stream with the camera parameter inserted into the image bit stream based on the camera parameter insertion information and the camera arrangement information. A method for generating a bitstream. The stereoscopic image bitstream generation method according to claim 1, Wherein the camera parameters inserted in the image bitstream based on the camera parameter insertion information include at least one of center-of-view information of each of the reference-point camera and the additional-point camera, at least one of the parallel movement information, the focal length information, And inserting one of the plurality of bitstreams into the image bitstream. The stereoscopic image bitstream generation method according to claim 1, Further comprising inserting the mixed image configuration information for the method of constructing the mixed image including the reference view image data of the stereoscopic image and the addition view image data into the image bit stream. How to create a stream. 6. The method of claim 5, The mixed image configuration information may include at least one of a vertical line interleaved format, a side-by-side format, a frame sequential format, and independent single view images Wherein the at least one frame comprises at least one of a monoscopic image format and a stereoscopic image format. The stereoscopic image bitstream generation method according to claim 1, Inserting attribute information about the stereoscopic image into at least one box in the image bitstream when the image bitstream is a media file format based on an ISO (International Standardization Organization) And the stereoscopic image data is inserted into the stereoscopic image bitstream.

Images