KR20090036080A - Method of constructing maf file format and apparatus of decoding for video signal using thereof method - Google Patents

Abstract

A method of constructing an MAF(Multimedia Application Format) file format and an apparatus of decoding a video signal by using the same are provided to perform a smaller number of modification steps to reproduce a video signal by using a hidden scaling mode, a horizontal scaling mode and a vertical scaling mode. A video signal receiver receives a video signal having an MAF file format structure. The MAF file format structure includes the first and second information. A video signal decoding unit(420) decodes a file having the MAF file format structure. The video signal decoding unit decodes and extracts a corresponding signal by using the first information. An output screen generation unit(430) generates an output screen by scaling the video signal by using the second information to output the video signal by a 2 dimensional image.

Description

Method of configuring MAF file format and decoding device for video signal using same TECHNICAL TECHNICAL FIELD OF METHOD OF CONSTRUCTING MAF FILE FORMAT AND APPARATUS OF DECODING FOR VIDEO SIGNAL USING THEREOF METHOD

The present invention relates to a method for configuring a MAF file format and a decoding apparatus for a video signal using the same, comprising a first information indicating a file type and a second information indicating a file scaling method. It is about.

In order to accommodate the rapidly changing market demands, MPEG has established independent international standards that can be expanded into a single profile concept by combining different existing standards to meet the purpose of a specific application service. This standard is called MPEG-A (MPEG-Applications) multimedia application standard.

The MPEG-A standard defines a new multimedia application format (MAF) aimed at developing multimedia applications and services. The characteristic of MPEG MAF international standard is that it is aimed at rapid progress and specific application service in order to respond quickly to the demands of industry, and it integrates and expands the standards of various fields into one new format.

In addition, MPEG MAF continues to discuss international standards for stereoscopic imaging. The stereoscopic method, which is a method of providing 3D image information, is a method of delivering stereoscopic information using binocular disparity, which is one of physiological depth recognition elements.

Accordingly, a technical problem to be achieved by the present invention is a structure of a MAF file format in which a stereoscopic image generated for use in a 3D image reproducing apparatus has backward compactibility in a 2D image reproducing apparatus. To provide.

In addition, another technical problem to be achieved by the present invention is a MAF file format structure for reproducing a stereoscopic image as a two-dimensional image by performing fewer modification steps by using a hidden scaling mode, a horizontal scaling mode, and a vertical scaling mode. It is to provide an apparatus for decoding a used video signal.

The method for constructing a MAF file format of the present invention for achieving the above technical problem includes first information indicating a file type and second information indicating a file scaling method.

In the method of configuring the MAF file format of the present invention for achieving the above another technical problem, whether the first information is a resolution reduction of the left image and the right image constituting the stereoscopic image and the arrangement method of the left image and the right image Contains a brand identifier determined according to.

The brand identifier is a first brand identifier indicating that the left and right images are arranged left and right without resolution reduction, a second brand identifier indicating that the left and right images are arranged up and down without decreasing resolution, and the left and right images And a third brand identifier indicating that the resolution of the left and right images are reduced, and a fourth brand identifier indicating that the resolutions of the left and right images are reduced and arranged up and down.

The second information includes the scaling of the stored stereoscopic image according to the brand identifier.

The second information may include a width and a height of the current view of the stereoscopic image, a scaling method of the stereoscopic image, a start point and an end point of the scaling, and the start point and the end point of the scaling are considered in a direction factor. And the scaling method includes a hidden scaling mode, a horizontal scaling mode, and a vertical scaling mode.

According to another aspect of the present invention, there is provided a decoding apparatus for a video signal, the video signal receiving a video signal configured in a MAF file format including first information indicating a file type and second information indicating a file scaling method. Receiving unit; A video signal decoding unit which decodes the video signal using the first information; An output screen generation unit for generating an output screen by scaling the video signal to the size of the current screen by using the second information; And a display unit for displaying the output screen, wherein the video signal includes a left image and a right image as a stereoscopic image.

According to the method of constructing the MAF file format structure of the present invention, a stereoscopic image generated for use in a 3D image reproducing apparatus can be reproduced backwardly so that the 2D image reproducing apparatus can be reproduced. It can have

In addition, the method for constructing the MAF file format structure of the present invention, and an apparatus for decoding a video signal using the same, perform fewer modification steps by using a hidden scaling mode, a horizontal scaling mode, and a vertical scaling mode to perform a video signal, for example, For example, there is an advantage that the stereoscopic video can be reproduced as a two-dimensional video.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The embodiments of the present invention are provided to more fully explain the present invention to those skilled in the art, and the following examples can be modified in various other forms, and the scope of the present invention is It is not limited to an Example. Like numbers refer to like elements in the figures.

Stereoscopic (stereoscopic) images are synthesized into a single three-dimensional image by muxing two images taken from the left and right sensors of a binocular stereoscopic camera. Such stereoscopic image synthesis includes a side by side method, a vertical line interleaved type, and a frame sequential type. The side by side method creates an odd vertical line of the left image and an even vertical line of the right image of the stereo image as one image, and the vertical insertion method is a stereoscopic method in a polarization LCD equipped with a barrier panel. Configure to display video. In addition, the frame arrangement method displays a stereoscopic image effect by alternately displaying a left image and a right image.

Although the stereoscopic MAF international standard stipulates a file format using the above three methods, the decoding apparatus for reproducing two-dimensional video is still widely used, so the backward compatibility from the stereoscopic MAF international standard to two-dimensional video can be defined. There is a need.

In the present invention, a method of configuring a file format for effectively reproducing a stereoscopic video stored in a side by side method as a 2D video and a 3D video and a decoding apparatus of a video signal using the same will be described.

1 and 2 illustrate a MAF file type according to an embodiment of the present invention, FIG. 1 illustrates a 1/1 side by side method, and FIG. 2 illustrates a 1/2 side by side method.

The 1/1 side-by-side method arranges the left and right images of the stereoscopic images side by side in one frame of the image. Can be divided into As shown in FIG. 1, when the width of the display is called w and the height is h, one frame of an image stored in a 1/1 side by side left and right arrangement has a width of 2w and a height of h. . In addition, one frame of an image stored in a 1/1 side by side vertical arrangement has a width of w and a height of 2h. This 1/1 side by side method may double the total capacity, but may not reduce the resolution.

1/2 side-by-side is a method of arranging the left and right images of a stereoscopic image in half and arranging them side by side in one frame of the image. The vertical resolution can be divided into two types of vertical arrangement in which the vertical resolution is reduced in half and arranged vertically. As shown in FIG. 2, one frame of an image stored in a 1/2 side by side left and right arrangement and a half side by side up and down arrangement has both a width of w and a height of h. This half-side by side method has the advantage that the resolution is reduced, but the overall capacity is not increased.

The MAF file format according to an embodiment of the present invention may include first information indicating a file type. The first information is for notifying that a stereoscopic image is stored in a side-by-side manner to a device for reproducing a 3D image, and whether the resolution of the left and right images constituting the stereoscopic image is reduced, and the left and right images It may include a brand identifier determined according to the arrangement method of the image.

The brand identifier is a first brand identifier indicating that the left image and the right image are arranged left and right without decreasing resolution (1/1 side by side left and right arrangement method), wherein the left and right images are arranged up and down without decreasing the resolution. A second brand identifier indicating (1/1 side by side vertical placement), a third brand identifier indicating that the resolution of the left and right images is reduced and left and right (1/2 side by side left and right arrangement) And a fourth brand identifier indicating that the resolution of the left image and the right image is reduced and disposed up and down (1/2 side by side up and down arrangement).

system Placement direction Brand identifier Identification code 1/1 side by side Right and left First brand identifier ss1l 1/1 side by side Up and down 2nd brand identifier ss1u 1/2 side by side Right and left Third brand identifier ss2l 1/2 side by side Up and down 4th brand identifier ss2u

3 illustrates an example of a MAF file format structure constructed according to the present invention.

The MAF file format according to the present invention may include various boxes. In this case, the boxes may be based on an international organization for standardization (ISO) base media file format.

Basically, a box can be divided into a container box and a general box, and a container box can include other boxes inside for grouping purposes, but only the total size of the grouped box Keeping only the and names, the generic box can actually contain data for that purpose.

Hereinafter, the main boxes of the MAF file format structure constructed according to the present invention will be described. In this case, for convenience of explanation, the English name of each box is used as it is, but is indicated in bold, and the English name of each field constituting the syntax for the box is used as it is but is indicated using double quotation marks.

Referring to FIG. 3, the MAF file format structure constructed according to the present invention may mainly include a ftyp box, a moov box, and an mdat box.

The ftyp box may designate a file type such as a digital multimedia broadcasting file structure. The moov box may describe the presentation of a scene including one trak box. In this case, the trak box may include a description for one media. In addition, the media in the trak box includes information on an audio-only broadcast, information on a transport stream in which audio and video are not separated, and information on data broadcast content. The trak box may support time information for synchronizing with other media, but the data regarding the transport stream of the media may already include timing information and thus do not include a box for separate timing. The mdat box includes a trak box capable of importing content by URL without deposing of the actual content described in the trak box or the content in the mdat box.

In addition, the moov box is a movie box is a container box that can contain all the metadata boxes associated with the actual movie. Therefore, the moov box does not have its own information and serves to group each box in the corresponding moov box.

As described above, the moov box may include a trak box and an mdia box as a container box. The trak box is as described above, and the mdia box is a media box, which is a container box containing information about media. The mdia container box includes a stbl box, which is a sample table box containing all the time and reference information about the media in the track, using the information in the stbl box to sample at an appropriate time. You can set the timing by sending. The stbl box includes a stsd box, and the stsd box includes the first information indicating how the stereoscopic image is stored and the width and height of the stereoscopic image do not match the width and height of the display. It may include information about the scaling method applied. Information about a scaling method included in the stsd box is referred to as second information.

The MAF file format according to an embodiment of the present invention further includes not only the first information but also second information regarding scaling of a stereoscopic image. The second information includes the width (tkhd.width) of the current view of the stereoscopic image and the height (tkhd.height) of the presenting screen, the scaling method of the stereoscopic image (stbl.stsd.codingname.stsl.scale_method), and the scaling of It includes a start point (stbl.stsd.codingname.stsl.display_center_x) and an end point (stbl.stsd.codingname.stsl.display_center_y). The scaling method may include a hidden scaling mode, a horizontal scaling mode, and a vertical scaling mode, wherein the hidden scaling mode comprises a left image or a stereoscopic image of a file having the first brand identifier or the second brand identifier. A method of reproducing only a right image, and the horizontal scaling mode and the vertical scaling mode will be described with reference to Table 3 below.

Table 2 below is a table showing second information when the first information is a first brand identifier and a second brand identifier.

Kinds ss1l ss1u tkhd.width stbl.stsd.codingname.width / 2 stbl.stsd.codingname.width tkhd.height stbl.stsd.codingname.height stbl.stsd.codingname.height / 2 stbl.stsd.codingname.stsl.scale_method 2 ('hidden' mode) 2 stbl.stsd.codingname.stsl.display_center_x stbl.stsd.codingname.width / 4 * direction_factor stbl.stsd.codingname.width stbl.stsd.codingname.stsl.display_center_y stbl.stsd.codingname.height stbl.stsd.codingname.height / 4 * direction_factor

Here, 'codingname' indicates a coding method of the stereoscopic image, and 'direction_factor' may be 1 when the upper image is used in the left image or the 'ss1u' method in the 'ss1l' method to reproduce the 2D image. Otherwise it may be three.

When the stereoscopic image including the second information of Table 2 in the file format is reproduced in the two-dimensional playback device, the left or right image of the stereoscopic image using the hidden scaling method ('hidden' method) 2 is used. Only a file can be reproduced, and when reproduced in a 3D reproducing apparatus, the file type of the stored stereoscopic image can be determined using a brand identifier, separated into a left image and a right image, and then reproduced as a 3D image. The method of reproducing the 3D image may adopt a conventional stereoscopic MAF standard technology.

Table 3 below is a table showing second information when the first information is a third brand identifier and a fourth brand identifier.

The method for configuring the MAF file format of the present invention proposes a new scaling method for reproducing a 2D image. Horizontal scaling mode (Horizontal-span mode) is a method of playing the stereoscopic image of the file having the third brand identifier only the left image or right image scaled in the horizontal direction by using the start and end of the scaling. In the vertical scaling mode, the stereoscopic image of the file having the fourth brand identifier is reproduced using only the left image or the right image scaled in the vertical direction by using the start point and the end point of the scaling. Hereinafter, a scaling method using the horizontal scaling mode is referred to as m, and a scaling method using the vertical scaling mode is referred to as n.

Kinds ss2l ss2u tkhd.width stbl.stsd.codingname.width stbl.stsd.codingname.width tkhd.height stbl.stsd.codingname.height stbl.stsd.codingname.height stbl.stsd.codingname.s tsl.scale_method m (user-defined'horizontal-span'mode) n (user-defined 'vertical-span' mode) stbl.stsd.codingname.s tsl.display_center_x direction_factor direction_factor stbl.stsd.codingname.s tsl.display_center_y stbl.stsd.codingname.width / 2 + direction_factor stbl.stsd.codingname.height / 2 + direction_factor

Here, 'codingname' represents a coding method of the stereoscopic image, and 'direction_factor' may be 0 when the upper image is used in the left image or the 'ss2u' method in the 'ss2l' method to reproduce the 2D image. 'stbl.stsd.codingname.width / 2' can be used when the right image is used in the 'ss2l' method. have.

The stereoscopic video including the second information of Table 3 in the file format is a start point of scaling (stbl.stsd.codingname.stsl.display_center_x) determined by using a direction factor when the 2D playback device is played back. By performing the horizontal scaling mode or the vertical scaling mode based on the end point (stbl.stsd.codingname.stsl.display_center_y), only the left or right image of the stereoscopic image can be reproduced. On the other hand, when played back in the 3D playback apparatus, the file type of the stored stereoscopic image may be determined using the brand identifier, and separated into a left image and a right image, and then reproduced as a 3D image. The method of reproducing the 3D image may adopt a conventional stereoscopic MAF standard technology. In addition, the stereoscopic video of the present invention may be received through a broadcast signal, it may be received through a digital medium.

Hereinafter, an apparatus for decoding a video signal that receives and processes a video signal including the MAF file format structure configured as described above according to the present invention will be described.

4 illustrates an example of an apparatus for receiving and processing a video signal including a MAF file format structure constructed according to the present invention.

The apparatus 400 for decoding a video signal of FIG. 4 may include a video signal receiver 410, a video signal decoder 420, an output screen generator 430, and a display 440.

The video signal receiver 410 receives a video signal having a MAF file format structure configured as shown in FIG. 3, and the MAF file format structure includes the first information and the second information. The video signal may be a stereoscopic video signal having backward compactness in a 2D image reproducing apparatus. In addition, the video signal receiving unit 410 may output metadata information including the first information and the second information and corresponding media data information.

The video signal decoding unit 420 is a decoder for decoding a file having the MAF file format structure. The video signal decoding unit 420 decodes and extracts a corresponding video signal using the first information. The first information includes a brand identifier determined according to whether the resolution of the left image and the right image constituting the video signal is reduced, and a placement method of the left image and the right image, and more specifically, the brand identifier is the left image. A first brand identifier indicating that the image and the right image are arranged left and right without decreasing resolution, and that the left and right images are arranged up and down without decreasing the resolution of the second brand identifier and the resolution of the left and right images is reduced The third brand identifier may include a fourth brand identifier, and the fourth and second brand identifiers may be disposed in a vertical direction by reducing the resolution of the left and right images.

The video signal decoding unit 420 may include a 1/1 side by side left and right arrangement, a 1/1 side by side up and down arrangement, and a 1/2 side by side left and right arrangement according to the first brand identifier to the fourth brand identifier. And decode the stored video signal in a 1/2 side by side up and down arrangement.

The output screen generating unit 430 generates the output screen by scaling the video signal using the second information in order to output the video signal as the 2D image in the apparatus for reproducing the 2D image. The second information includes a width and a height of the current screen of the stereoscopic image, a scaling method of the stereoscopic image, a start point and an end point of the scaling. When the first information is the first brand identifier or the second brand identifier, and the scaling method is a hidden scaling mode ('hidden' mode), a left image or a right image of the video signal is generated as an output screen. do. On the other hand, when the first information is the third brand identifier or the fourth brand identifier, and the scaling method is the horizontal scaling mode (m) or the vertical scaling mode (n), the start point of the scaling and the video signal and After scaling in the horizontal or vertical direction by using the end point, the scaled screen is generated as an output screen.

The display unit 440 displays the output screen.

FIG. 5 is an example of a flowchart shown to explain the process of FIG. 4.

According to the present invention, a video signal having a MAF file format structure configured as shown in FIG. 3 is received (step S510). The video signal includes first information indicating a file type and second information indicating a file scaling method.

The video signal is decoded according to a stored method using the first information (step S520), and when using a device for reproducing a 2D image, scaling the video signal using the first information and the second information. After the output screen is generated (step S530), the output screen is displayed (step S540).

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions and changes can be made without departing from the technical spirit of the present invention. It will be apparent to those who have

1 illustrates a 1/1 side by side method of a MAF file type according to an embodiment of the present invention.

2 illustrates a 1/2 side by side method of a MAF file type according to an embodiment of the present invention.

3 illustrates an example of a MAF file format structure constructed according to the present invention.

4 is a schematic diagram illustrating an apparatus for decoding a video signal according to an embodiment of the present invention.

FIG. 5 is a flowchart illustrating a procedure for describing the processing of FIG. 4.

Claims (15)

In the method of configuring a multimedia application format (MAF) file format, And the MAF file format includes first information indicating a file type and second information indicating a file scaling method. The method of claim 1, The first information comprises a MAF file format, characterized in that the resolution of the left image and the right image constituting the stereoscopic image and a brand identifier determined according to the arrangement method of the left image and the right image. Way. The method of claim 2, The brand identifier is a first brand identifier indicating that the left image and the right image are arranged left and right without decreasing resolution, and the left and right images are arranged up and down without decreasing the resolution of the second brand identifier, the left image and the right image And a fourth brand identifier having a reduced resolution and a third brand identifier arranged left and right and a fourth brand identifier having a reduced resolution of the left and right images. The method of claim 3, wherein And wherein the second information relates to scaling of a stored stereoscopic image according to the brand identifier. The method of claim 4, wherein And wherein the second information includes a width and a height of the current view of the stereoscopic image, a scaling method of the stereoscopic image, a starting point and an ending point of the scaling. The method of claim 5, wherein The start point and the end point of the scaling are determined in consideration of a direction factor. The method of claim 5, wherein Wherein said scaling method comprises a hidden scaling mode, a horizontal scaling mode, and a vertical scaling mode. The method of claim 7, wherein The hidden scaling mode is a method of configuring a MAF file format, characterized in that for playing the stereoscopic video of the file having the first brand identifier or the second brand identifier only a left image or a right image. The method of claim 7, wherein In the horizontal scaling mode, the stereoscopic video of the file having the third brand identifier plays a left image or a right video scaled horizontally using the start point and the end point of the scaling. How to configure the format. The method of claim 7, wherein In the vertical scaling mode, the stereoscopic image of the file having the fourth brand identifier plays a left image or a right image scaled vertically using the start point and the end point of the scaling. How to configure the format. The method of claim 2, And wherein the stereoscopic video is received via a broadcast signal. The method of claim 2, And wherein the stereoscopic image is received through a digital medium. A video signal receiver configured to receive a video signal configured in a MAF file format including first information indicating a file type and second information indicating a file scaling method; A video signal decoding unit which decodes the video signal using the first information; An output screen generation unit for generating an output screen by scaling the video signal to a size of a display screen using the first information and the second information; And It includes a display unit for displaying the output screen, The video signal is a stereoscopic video decoding apparatus of a video signal comprising a left image and a right image. The method of claim 13, The first information is a first brand identifier indicating that the left and right images are arranged left and right without decreasing resolution, or the second brand identifier indicating that the left and right images are arranged up and down without decreasing resolution, and the second information. Is a hidden scaling mode for reproducing only the left image or the right image. The method of claim 13, The first information is a third brand identifier indicating that the left image and the right image have been reduced in left and right directions, or a fourth brand identifier indicating that the resolution of the left image and the right image has been reduced and arranged up and down. 2 is a horizontal scaling mode or a vertical scaling mode.

Images