EP1961238A1 - Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service - Google Patents
Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image serviceInfo
- Publication number
- EP1961238A1 EP1961238A1 EP06769273A EP06769273A EP1961238A1 EP 1961238 A1 EP1961238 A1 EP 1961238A1 EP 06769273 A EP06769273 A EP 06769273A EP 06769273 A EP06769273 A EP 06769273A EP 1961238 A1 EP1961238 A1 EP 1961238A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- service
- dmb
- additional
- reference image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
Definitions
- DMB Digital Media Broadcasting
- a method for providing a DMB-based 3D stereoscopic image service including the steps of: a)defining, through a data service component type, that a broadcast service is a DMB service, and defining the dimension of the DMB service through a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image as different independent streams using different object descriptors.
- method for providing a DMB-based 3D stereoscopic image service including the steps of: a) defining, through a data service component type, that a broadcast service is a DMB service, and defining the dimension of the DMB service through a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image respectively as an independent stream and a dependent stream for the reference image using one object descriptor.
- the method including the steps of: a) separately recognizing and decoding a reference image stream and a 3D additional information stream using two different object de- scriptors; b) receiving a play mode from a user; c) when the received play mode is a 2D play mode, deactivating a node corresponding to 3D additional information in a scene descriptor such that only the reference image decoded in the step a) is outputted; and d) when the received play mode is a 3D play mode, converting one of the r eference image and the 3D additional image decoded in the step a) into an image having only odd-numbered line data and converting the other into an image having only even-numbered line data.
- the present invention provides users with a realistic 3D image service while
- the present invention provides a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure that can provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system.
- Fig. 1 is a table with additional data service component types to provide a DMB service based on a DAB;
- FIG. 2 is a table illustrating a method of discriminating between a 2D DMB service and a 3D DMB service based on a user application type defined in a DAB in accordance with an embodiment of the present invention
- Fig. 3 is a table illustrating the structure of an MPEG-4 object descriptor used to describe audio/video signals in a conventional DMB service;
- Fig. 4 is a table illustrating the structure of an object descriptor for providing a
- the DMB is based on the European digital audio broadcast standards, which
- the DMB is one of mobile multimedia broadcasts with an excellent reception capability.
- Fig. 2 is a table illustrating a method of discriminating between a 2D DMB service and a 3D DMB service based on a user application type defined in a DAB in accordance with an embodiment of the present invention.
- 3D moving pictures are coded independently on the basis of the respective viewpoints, thereby outputting viewpoint- based coded streams.
- 3D moving pictures are coded on the basis of the correlation between the respective viewpoints with reference to an image at a specific time, thereby outputting viewpoint-based coded streams.
- the present invention assigns a reference image and 3D
- 3D additional information used for a digital broadcast based 3D service includes disparity data (Disparity), disparity and residual data (Disparity + Residual Data), depth information (Depth), depth and residual data (Depth + Residual Data), a full right image (Right Image (full)), a right image of half of horizontal (Right Image (Half of Horizontal)), a left image of half of vertical (Left Image (Half of Vertical)), a horizontal/vertical half image (Right Image (Quarter)).
- the residual data includes residual texture data.
- the 3D additional information includes "Left image (full)”, “Left image (half of horizontal)”, “Left image (half of vertical)”, “left image (half of vertical)”, and "Left image (quarter)”.
- the 3D format converter 62 fills even-numbered line data with garbage data and maintains only odd- numbered line data while maintaining the size of an image.
- the 3D format converter 62 fills odd- numbered line data with garbage data and maintains only even-numbered line data while maintaining the size of an image to be equal to the size of the reference image through an image expansion filtering process using actual data contained therein.
- the reference image 621 may be converted into the even-numbered data, while the 3D additional image may be converted into the odd-numbered data.
- the 2D image 610 may be created using only the decoded reference image.
- the user may adjust a stereoscopic feeling through the horizontal shift, i.e., disparity adjustment of a 3D motion image or an object in an image according to a stereoscopic feeling adjustment mode.
- the user can enjoy a stereoscopic image by adjusting the disparity of a 3D motion image according to the stereoscopic feeling adjustment mode, which is possible by horizontally shifting left and right images. Also, when the image disparity can be optionally adjusted for each object in an image, the user can enjoy an image by adjusting the image disparity on the basis of a desired object.
- Fig. 7 illustrates the structure of an object descriptor for representing a bit stream outputted from a codec using one object descriptor when 3D moving pictures are coded independently based on the viewpoints or coded based on the correlation between the respective viewpoints with reference to an image at a specific time.
- FIG. 4 illustrates the method of assigning a reference image
- FIG. 7 illustrates a method of assign a reference image and 3D additional information as an independent stream and a dependent stream by using one object descriptor.
- an elementary stream (ES) descriptor for a reference image and an elementary stream descriptor for 3D additional information are brought forth in a subordinate relationship under one object descriptor.
- the subordinate relationship can be expressed using "StreamDependanceFlag” and "dependsOn_ES_ID” of an MPEG-4 ES descriptor.
- FIG. 8 is a block diagram illustrating a decoding apparatus 80 and method for
- the decoder 81 recognizes and decodes a reference image stream and a 3D additional image stream using one object descriptor.
- the decoder 81 combines a decoded reference image and a decoded 3D additional image to generate one 3D image.
- the user can enjoy an image by adjusting the image disparity based on a desired object.
- the present invention can be similarly applied to a 3D audio service as well as a 3D stereoscopic image service.
- the methods in accordance with the embodiments of the present invention can be realized as programs and stored in a computer-readable recording medium that can execute the programs.
- Examples of the computer-readable recording medium include CD-ROM, RAM, ROM, floppy disks, hard disks, magneto-optical disks and the like.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Provided is a method for providing a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure to provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system, and a decoding apparatus and method for the DMB-based 3D stereoscopic image service. The method includes the steps of: a) defining in a data service component type that a broadcast service is a DMB service, and defining a dimension of the DMB service in a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image as different streams which are independent from each other by using different object descriptors.
Description
Description
METHOD FOR PROVIDING DMB-BASED 3D IMAGE
SERVICE, AND DECODING APPARATUS AND METHOD FOR
DMB-BASED 3D IMAGE SERVICE
Technical Field
[1] The present invention relates to a method for providing a DMB-based three- dimensional (3D) stereoscopic image service and a decoding apparatus and method for the DMB-based 3D stereoscopic image service; and more particularly, to a method for providing a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure to provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system, and a decoding apparatus and method for the DMB-based 3D stereoscopic image service.
Background Art
[2] In a Digital Media Broadcasting (DMB) system, a Moving Picture Experts Group
(MPEG)-4 initial object descriptor (IOD), a binary format for scene (BIFS), an object descriptor (OD), and media data are used to describe objects and scenes. The initial object descriptor is information that should be first transmitted in order to configure an MPEG-4 scene. The initial object descriptor is used to describe the profile and level of respective media. The object descriptor is a set of elementary stream descriptors for describing information about respective media data configuring a scene. The object descriptor is used to connect a scene description with an elementary stream (ES) of each of media data. A scene descriptor stream is used to represent the spatial/temporal position and action of a video or audio object constituting a scene.
[3] However, since a conventional DMB service is defined with a focus on a 2D
moving picture process, it has a limitation in providing users with a realistic, stereoscopic 3D service.
[4] This calls for the development of a new MPEG-4 object descriptor and a method for providing a 3D video/audio service using the new MPEG-4 object descriptor that can provide users with a realistic 3D service while maintaining compatibility to a conventional DMB system.
[5] However, an MPEG-4 object descriptor for providing a DMB-based 3D service and a method for discriminating whether service contents are 2D contents or 3D contents are not disclosed in the prior art documents.
Disclosure of Invention
Technical Problem
[6] It is, therefore, an object of the present invention to provide a method for providing a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure to provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system, and a decoding apparatus and method for the DMB-based 3D stereoscopic image service.
Technical Solution
[7] In accordance with one aspect of the present invention, there is provided a method for providing a DMB-based 3D stereoscopic image service, the method including the steps of: a)defining, through a data service component type, that a broadcast service is a DMB service, and defining the dimension of the DMB service through a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image as different independent streams using different object descriptors.
[8] In accordance with another aspect of the present invention, there is provided a
method for providing a DMB-based 3D stereoscopic image service, the method including the steps of: a) defining, through a data service component type, that a broadcast service is a DMB service, and defining the dimension of the DMB service through a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image respectively as an independent stream and a dependent stream for the reference image using one object descriptor.
[9] In accordance with another aspect of the present invention, there is provided a
decoding apparatus for a DMB-based 3D stereoscopic image service, the decoding apparatus including: a decoder for separately recognizing and decoding a reference image stream and a 3D additional information stream using two different object descriptors; and a 3D format converter for converting one of the decoded reference image and the decoded 3D additional image from the decoder into an image having only odd- numbered line data and converting the other into an image having only even-numbered line data.
[10] In accordance with another aspect of the present invention, there is provided a
decoding apparatus for a DMB-based 3D stereoscopic image service, the decoding apparatus including: a decoder for recognizing and decoding a reference image stream and a 3D additional information stream using one object descriptor; and a 3D format converter for combining the decoded reference image and the decoded 3D additional image from the decoder to generate one 3D image.
[11] In accordance with another aspect of the present invention, there is provided a
method for providing a 3D stereoscopic image service in a DMB receiving terminal, the method including the steps of: a) separately recognizing and decoding a reference image stream and a 3D additional information stream using two different object de-
scriptors; b) receiving a play mode from a user; c) when the received play mode is a 2D play mode, deactivating a node corresponding to 3D additional information in a scene descriptor such that only the reference image decoded in the step a) is outputted; and d) when the received play mode is a 3D play mode, converting one of the r eference image and the 3D additional image decoded in the step a) into an image having only odd-numbered line data and converting the other into an image having only even-numbered line data.
[12] In accordance with another aspect of the present invention, there is provided a
method for providing a 3D stereoscopic image service in a DMB receiving terminal, the method including the steps of: a) recognizing and decoding a reference image stream and a 3D additional information stream using one object descriptor; b) receiving a play mode from a user; c) when the received play mode is a 2D play mode, outputting only the reference image decoded in the step a) is outputted without a change thereof; and d) when the received play mode is a 3D play mode, combining the decoded reference image and the 3D additional image from the step a) to generate one 3D image.
Advantageous Effects
[13] The present invention provides users with a realistic 3D image service while
maintaining compatibility to a conventional DMB system.
[14] That is, the present invention provides a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure that can provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system.
Brief Description of the Drawings
[15] The above and other objects and features of the present invention will become apparent from the following description of the preferred embodiments given in conjunction with the accompanying drawings, in which:
[16] Fig. 1 is a table with additional data service component types to provide a DMB service based on a DAB;
[17] Fig. 2 is a table illustrating a method of discriminating between a 2D DMB service and a 3D DMB service based on a user application type defined in a DAB in accordance with an embodiment of the present invention;
[18] Fig. 3 is a table illustrating the structure of an MPEG-4 object descriptor used to describe audio/video signals in a conventional DMB service;
[19] Fig. 4 is a table illustrating the structure of an object descriptor for providing a
DMB-based 3D moving picture service using two object descriptors in accordance with an embodiment of the present invention;
[20] Fig. 5 is a table illustrating 3D additional information types in accordance with an embodiment of the present invention;
[21] Fig. 6 is a block diagram illustrating a decoding apparatus and method for providing a DMB-based 3D stereoscopic image service using the object descriptor structure of Fig. 4 in accordance with an embodiment of the present invention;
[22] Fig. 7 is a table illustrating the structure of an object descriptor for providing a
DMB-based 3D moving picture service using one object descriptor in accordance with an embodiment of the present invention; and
[23] Fig. 8 is a schematic block diagram illustrating a decoding apparatus and method for providing a DMB-based 3D stereoscopic image service using the object descriptor of Fig. 7 in accordance with an embodiment of the present invention.
Mode for the Invention
[24] Other objects and aspects of the invention will become apparent from the following description of the embodiments with reference to the accompanying drawings, which is set forth hereinafter. Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Detailed descriptions about well-known functions or structures will be omitted if they are deemed to obscure the subject matter of the present invention.
[25] The DMB is based on the European digital audio broadcast standards, which
provides a video service in a stream mode among data service modes of EUREKA- 147. The DMB is one of mobile multimedia broadcasts with an excellent reception capability.
[26] The EUREKA- 147 provides a stream-mode or packet-mode data service as well as a data service associated with an audio.
[27] Several compressed audio streams and several types of data are channel-coded and multiplexed into one bit stream, together with system control data. The multiplexed stream is called an ensemble stream. The ensemble stream goes through OFDM modulation and high-power amplification prior to transmission. At this point, multiplex configuration information (MCI) includes service lists available within the ensemble and it provides type information about service components in a data service component type (DSCTy).
[28] Hereinafter, the structure of an MPEG-4 object descriptor for a 3D image service in
DMB and a method for discriminating whether service contents are 2D contents or 3D contents, in accordance with the preferred embodiments of the present invention, will now be described in detail with reference to the accompanying drawings.
[29] Fig. 1 is a table with additional data service component types to provide a DMB
service based on a DAB.
[30] Referring to Fig. 1, a broadcast transmitting side defines in a data service
component type (DSCTy) that a service intended to be provided is a DMB service.
[31] Accordingly, a DMB receiving terminal recognizes from the data service
component type that a received service is a DMB service.
[32] A 2D DMB service is currently taken into consideration. However, what is required for a 3D DMB service is a method for discriminating between 2D contents and 3D contents in a DMB service.
[33] Fig. 2 is a table illustrating a method of discriminating between a 2D DMB service and a 3D DMB service based on a user application type defined in a DAB in accordance with an embodiment of the present invention.
[34] Referring to Fig. 2, the presenting invention provides a method for discriminating between 2D contents and 3D contents in a DMB service based on the user application type defined in the DAB.
[35] That is, 2D DMB and 3D DMB are discriminatively defined in the user application type defined in the DAB (201, 202) to provide a 3D DMB service differently from the conventional DMB service.
[36] Accordingly, a receiving terminal recognizes a DMB service from the data service component type defined in Fig. 1 (101), and discriminates whether DMB service contents are 2D contents or 3D contents based on the user application type (201, 202).
[37] A 2D DMB 201 represents a conventional DMB service, while a 3D DMB 202 represents a DMB service that can provide users with a 3D service while maintaining compatibility to a conventional DMB receiving terminal. At this point, bit fields of 2D and 3D DMB contents defined in the present invention may vary.
[38] Fig. 3 is a table illustrating the structure of an MPEG-4 object descriptor used to describe audio/video signals in a conventional DMB service.
[39] As illustrated in Fig. 3, a video stream is set to "ObjectTypeIndication=0x21
(AVC), StreamType=0x04 (visual stream)" and an audio stream is set to "Object-
Typelndication=0x40 (BSAC), StreamType=0x05 (audio stream)" by using object descriptors and elementary stream (ES) descriptors.
[40] At this point, each of object descriptor IDs has a unique value, which is assigned identically to an URL in a scene descriptor. That is, in order to represent audio/video streams, the scene descriptor includes two nodes, which are associated with the assigned object descriptors.
[41] However, since the above object descriptor structure is focused on 2D contents, it has a limitation in describing a 3D moving picture with two or more viewpoints which are obtained from a camera.
[42] Accordingly, the present invention proposes the structure of an MPEG-4 object
descriptor for providing a 3D stereoscopic broadcast while maintaining compatibility to the conventional DMB system according to the type of a codec. In this specification, the present invention will be described with its focus on a video, which can also be applied to an audio.
[43] Two types of codec schemes are taken into consideration with respect to an
obtained 3D moving picture. In a first codec scheme, 3D moving pictures are coded independently on the basis of the respective viewpoints, thereby outputting viewpoint- based coded streams. In a second codec scheme, 3D moving pictures are coded on the basis of the correlation between the respective viewpoints with reference to an image at a specific time, thereby outputting viewpoint-based coded streams.
[44] Fig. 4 is a table illustrating the structure of an object descriptor for providing a
DMB-based 3D moving picture service using two object descriptors in accordance with an embodiment of the present invention. In detail, Fig. 4 illustrates the structure of an object descriptor for representing a bit stream outputted from a codec using two object descriptors when 3D moving pictures are coded independently on the basis of viewpoints. 3D additional information considered at this point will be described later with reference to Fig. 5.
[45] As illustrated in Fig. 4, the present invention assigns a reference image and 3D
additional information to independent streams using two object descriptors.
[46] That is, the reference image is coded using an AVC (advanced video coding) codec for DMB and is set to "ObjectTypeIndication=0x21 (AVC), StreamType=0x04 (visual stream)", while the 3D additional information is coded using the AVC codec or other codecs and is set to "ObjectTypeIndication=0xC0 (user private), StreamType=0x04 (visual stream)".
[47] Also, the type of 3D additional information is defined in a 3D additional descriptor in a corresponding object descriptor.
[48] Accordingly, a conventional DMB receiving terminal cannot recognize Object-
Typelndication information about 3D additional information and thus cannot receive a right image stream. That is, the conventional DMB receiving terminal recognizes only a general reference image stream and thus may recognize a 3D moving picture as a 2D moving picture, which makes it impossible to maintain compatibility to a conventional DMB service.
[49] In addition, a DMB receiving terminal capable of providing a 3D moving picture service recognizes two object descriptors and independently receives and decodes a reference image and a 3D additional information stream. At this point, for display of a 3D moving picture, the decoded reference image and 3D additional image are respectively converted into images with only odd (or even)-numbered line data and even (or odd)-numbered line data, and a left field image and a 3D additional field image are
simultaneously displayed at the same position in a scene.
[50] Fig. 5 is a table illustrating a 3D additional information type in accordance with an embodiment of the present invention.
[51] When a reference image is a left image, 3D additional information used for a digital broadcast based 3D service includes disparity data (Disparity), disparity and residual data (Disparity + Residual Data), depth information (Depth), depth and residual data (Depth + Residual Data), a full right image (Right Image (full)), a right image of half of horizontal (Right Image (Half of Horizontal)), a left image of half of vertical (Left Image (Half of Vertical)), a horizontal/vertical half image (Right Image (Quarter)). The residual data includes residual texture data.
[52] On the other hand, when the reference image is a right image, the 3D additional information includes "Left image (full)", "Left image (half of horizontal)", "Left image (half of vertical)", "left image (half of vertical)", and "Left image (quarter)".
[53] Fig. 6 is a schematic block diagram illustrating a decoding apparatus and method for providing a DMB -based 3D stereoscopic image service using the object descriptor structure of Fig. 4 in accordance with an embodiment of the present invention. That is, Fig. 6 illustrates a method by which the DMB-based 3D stereoscopic image service is displayed to a user through the object describer of Fig. 4.
[54] As illustrated in Fig. 6, when the 3D additional information (See Fig. 5) is a right image (half of vertical), the right image is equal in size to the reference image but an actual data is a right image (half of vertical).
[55] Referring to Fig. 6, a decoding apparatus 60 includes a decoder 61 and a 3D format converter 62.
[56] The decoder 61 separately recognizes a reference image stream and a 3D additional information stream using two different object descriptors and performs independent decoding operations thereon.
[57] With respect to a reference image 621 decoded by the decoder 61, the 3D format converter 62 fills even-numbered line data with garbage data and maintains only odd- numbered line data while maintaining the size of an image. With respect to a 3D additional image 622 decoded by the decoder 61, the 3D format converter 62 fills odd- numbered line data with garbage data and maintains only even-numbered line data while maintaining the size of an image to be equal to the size of the reference image through an image expansion filtering process using actual data contained therein. Alternatively, the reference image 621 may be converted into the even-numbered data, while the 3D additional image may be converted into the odd-numbered data.
[58] This method satisfies the conventional DMB standard that only one video object is simultaneously displayed in one scene even when two object descriptor IDs are contained in a scene descriptor for display of a 3D stereoscopic moving picture 620.
[59] On the other hand, when a user wants 2D display with respect to a 3D moving picture (610), the 3D format converter 62 deactivates a node corresponding to 3D additional information in the scene descriptor such that only a decoded reference image is outputted and displayed without being change.
[60] A user interaction method for 3D contents will now be described in detail.
[61] A user may optionally adjust 3D contents to be 2D contents or 3D contents
depending on play modes.
[62] When the user sets a 3D play mode by a play mode input interface, the 3D image
620 may be created according to the characteristics of a 3D monitor using the decoded reference image and the decoded 3D additional image. On the other hand, when the user sets a 2D play mode by the play mode input interface, the 2D image 610 may be created using only the decoded reference image.
[63] Meanwhile, the user may adjust a stereoscopic feeling through the horizontal shift, i.e., disparity adjustment of a 3D motion image or an object in an image according to a stereoscopic feeling adjustment mode.
[64] That is, the user can enjoy a stereoscopic image by adjusting the disparity of a 3D motion image according to the stereoscopic feeling adjustment mode, which is possible by horizontally shifting left and right images. Also, when the image disparity can be optionally adjusted for each object in an image, the user can enjoy an image by adjusting the image disparity on the basis of a desired object.
[65] Fig. 7 is a table illustrating the structure of an object descriptor for providing a
DMB-based 3D moving picture service using one object descriptor in accordance with an embodiment of the present invention. In detail, Fig. 7 illustrates the structure of an object descriptor for representing a bit stream outputted from a codec using one object descriptor when 3D moving pictures are coded independently based on the viewpoints or coded based on the correlation between the respective viewpoints with reference to an image at a specific time.
[66] While Fig. 4 illustrates the method of assigning a reference image and 3D
additional information as independent streams using by using two object descriptors, Fig. 7 illustrates a method of assign a reference image and 3D additional information as an independent stream and a dependent stream by using one object descriptor.
[67] As illustrated in Fig. 7, an elementary stream (ES) descriptor for a reference image and an elementary stream descriptor for 3D additional information are brought forth in a subordinate relationship under one object descriptor. The subordinate relationship can be expressed using "StreamDependanceFlag" and "dependsOn_ES_ID" of an MPEG-4 ES descriptor.
[68] The reference image, which is an independent stream, is coded and set to "Object-
Typelndication=0x21 (AVC), StreamType=0x04 (visual stream)" using an AVC codec
for DMB, while the 3D additional information, which is a dependent stream, is coded and set to "ObjectTypeIndication=0xC0 (user private), StreamType=0x04 (visual stream), StreamDependanceFlag=l, dependsOn_ES_ID=101 (reference image ES_ID)" using the AVC codec or other codecs.
[69] Also, the type of 3D additional information is defined in a 3D additional descriptor of an elementary stream descriptor (ES_Descriptor) or a 3D additional descriptor of an object descriptor (OD). Accordingly, a conventional DMB receiving terminal cannot recognize ObjectTypelndication information about 3D additional information and thus cannot receive a 3D additional information stream. That is, the conventional DMB receiving terminal recognizes only a general reference image stream and thus may recognize a 3D moving picture as a 2D moving picture, which makes it possible to maintain compatibility to a conventional DMB service.
[70] In the above method, the 3D moving pictureis recognized as one object and one object descriptor ID is contained in a scene descriptor, which is identical to the structure of a scene descriptor for representing a video in the conventional DMB.
[71] Fig. 8 is a block diagram illustrating a decoding apparatus 80 and method for
providing a DMB-based stereoscopic 3D image service using the object descriptor structure of Fig. 7 in accordance with an embodiment of the present invention.
[72] Referring to Fig. 8, a decoding apparatus 80 includes a decoder 81 and a 3D format converter 82.
[73] The decoding apparatus 80 of a DMB receiving terminal capable of providing a 3D moving picture service recognizes one object descriptor and receives and decodes an independent reference image and a dependent 3D additional information stream contained therein. Since a scene descriptor includes one object descriptor for displaying a 3D moving picture, the decoding apparatus 80 combines the decoded reference image with the decoded 3D additional image to generate and display one 3D image 820.
[74] That is, the decoder 81 recognizes and decodes a reference image stream and a 3D additional image stream using one object descriptor. When the3D format converter 82 receives a request for 3D display from a user, the decoder 81 combines a decoded reference image and a decoded 3D additional image to generate one 3D image.
[75] On the other hand, when a user wants 2D display with respect to a 3D moving picture 810, the 3D format converter 82 does not change a scene descriptor such that only a reference image is outputted and displayed without a change in format.
[76] A user interaction method for 3D contents will now be described in detail.
[77] A user can enjoy a stereoscopic image by optionally adjusting 3D contents to be 2D contents or 3D contents depending on play modes or by optionally adjusting the disparity of a 3D moving picture according to a stereoscopic feeling adjustment mode,
which is possible by horizontally shifting left and right images.
[78] When the image disparity can be optionally adjusted for each object in an image, the user can enjoy an image by adjusting the image disparity based on a desired object.
[79] The format of the 3D moving picture generated at the 3D format converter 82 varies according to the characteristics of a 3D monitor.
[80] The present invention can be applied to all systems for a 3D service as well as a system for a DMB-based 3D stereoscopic service.
[81] In addition, the present invention can be similarly applied to a 3D audio service as well as a 3D stereoscopic image service.
[82] The methods in accordance with the embodiments of the present invention can be realized as programs and stored in a computer-readable recording medium that can execute the programs. Examples of the computer-readable recording medium include CD-ROM, RAM, ROM, floppy disks, hard disks, magneto-optical disks and the like.
[83] The present application contains subject matter related to Korean patent application
No. 2005-121112 and 2006-001987, filed with the Korean Intellectual Property Office on December 9, 2005, and January 6, 2006, the entire contents of which is incorporated herein by reference.
[84] While the present invention has been described with respect to certain preferred embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the following claims.
Claims
[1] A method for providing a Digital Multimedia Broadcasting (DMB)-based 3D stereoscopic image service, the method comprising the steps of:
a) defining in a data service component type that a broadcast service is a DMB service, and defining a dimension of the DMB service in a user application type; and
b) assigning a reference image and 3D additional information for a serviced 3D image as different streams which are independent from each other by using different object descriptors.
[2] The method as recited in claim 1, wherein the reference image is set to be "Ob- jectTypeIndication=0x21 (AVC) StreamType=0x04 (visual stream)", while the 3D additional information is set to be "ObjectTypeIndication=0xC0 (user private), StreamType=0x04 (visual stream)" in the step b).
[3] The method as recited in claim 2, wherein the type of the 3D additional information is defined in a 3D additional descriptor of a corresponding object descriptor (OD).
[4] The method as recited in claim 1, wherein the 3D additional information includes disparity data (Disparity), disparity and residual data (Disparity + Residual Data), depth information (Depth), depth and residual data (Depth + Residual Data), an additional image of a full image, a vertical half additional image, a horizontal half additional image, and a quarter image.
[5] The method as recited in claim 4, wherein the additional images are right/left images when the reference image is a left/right image.
[6] A method for providing a DMB-based 3D stereoscopic image service, the
method comprising the steps of:
a) defining in a data service component type that a broadcast service is a DMB service, and defining the dimension of the DMB service in a user application type; and
b) assigning a reference image and 3D additional information for a serviced 3D image as an independent stream and a dependent stream on the reference image, respectively, by using one object descriptor.
[7] The method as recited in claim 6, wherein the reference image is set to be "Ob- jectTypeIndication=0x21 (AVC), StreamType=0x04 (visual stream)" while the 3D additional information is set to be "ObjectTypeIndication=0xC0 (user private), StreamType=0x04 (visual stream), StreamDependanceFlag=l, dependsOn_ES_ID=101 (reference image ESJD)" in the step b).
[8] The method as recited in claim 7, wherein the desired type of 3D additional in-
formation is defined in a 3D additional descriptor of the object descriptor.
[9] The method as recited in claim 7, wherein the desired type of 3D additional information is defined in a 3D additional descriptor of an elementary descriptor (ES_Descriptor).
[10] The method as recited in claim 6, wherein the 3D additional information includes disparity data (Disparity), disparity and residual data (Disparity + Residual Data), depth information (Depth), depth and residual data (Depth + Residual Data), an additional image of a full image, a vertical half additional image, a horizontal half additional image, and a quarter image.
[11] The method as recited in claim 10, wherein the additional images are right/left images when the reference image is a left/right image.
[12] A decoding apparatus for a DMB-based 3D stereoscopic image service, the
decoding apparatus comprising:
a decoder for separately recognizing and decoding a reference image stream and a 3D additional information stream by using two different object descriptors; and a 3D format converter for converting one of the decoded reference image and the decoded 3D additional image from the decoder into an image having only odd- numbered line data and converting the other into an image having only even- numbered line data.
[13] The decoding apparatus as recited in claim 12, wherein when the decoded
reference image and the decoded 3D additional image are converted into images having only odd-numbered or even-numbered line data, the 3D format converter fills the corresponding rest lines with garbage data.
[14] The decoding apparatus as recited in claim 13, wherein the 3D format converter further performs a function of deactivating a node corresponding to 3D additional information in a scene descriptor to output only the decoded reference image, upon receipt of a request for 2D display from a user.
[15] The decoding apparatus as recited in claim 12, wherein the 3D format converter adjusts the disparity of a 3D image for adjustment of the stereoscopic feeling of an image according to a user's demand.
[16] A decoding apparatus for a DMB-based 3D stereoscopic image service, the
decoding apparatus comprising:
a decoder for recognizing and decoding a reference image stream and a 3D additional information stream by using one object descriptor; and a 3D format converter for combining the decoded reference image and the decoded 3D additional image from the decoder to generate one 3D image.
[17] The decoding apparatus as recited in claim 16, wherein the 3D format converter further performs a function of outputting only the decoded reference image
without a change thereof, upon receipt of a request for 2D display from a user.
[18] The decoding apparatus as recited in claim 16, wherein the 3D format converter adjusts the disparity of a 3D image for adjustment of the stereoscopic feeling of an image according to a user's request.
[19] A method for providing a 3D stereoscopic image service in a DMB receiving terminal, the method comprising the steps of:
a) separately recognizing and decoding a reference image stream and a 3D additional information stream by using two different object descriptors;
b) receiving a play mode from a user;
c) when the received play mode is a 2D play mode, deactivating a node corresponding to 3D additional information in a scene descriptor such that only the reference image decoded in the step a) is outputted; and
d) when the received play mode is a 3D play mode, converting one of the reference image and the 3D additional image decoded in the step a) into an image having only odd-numbered line data and converting the other into an image having only even-numbered line data.
[20] The method as recited in claim 19, further comprising the step of adjusting the disparity of a 3D image for adjustment of a stereoscopic feeling of an image according to a user's demand.
[21] A method for providing a 3D stereoscopic image service in a DMB receiving terminal, the method comprising the steps of:
a) recognizing and decoding a reference image stream and a 3D additional information stream using one object descriptor;
b) receiving a play mode from a user;
c) when the received play mode is a 2D play mode, outputting only the reference image decoded in the step a) is outputted without a change thereof; and d) when the received play mode is a 3D play mode, combining the decoded reference image and the 3D additional image from the step a) to generate one 3D image.
[22] The method as recited in claim 21, further comprising the step of adjusting the disparity of a 3D image for adjustment of a stereoscopic feeling of an image according to a user's demand.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20050121112 | 2005-12-09 | ||
| KR1020060001987A KR100747550B1 (en) | 2005-12-09 | 2006-01-06 | Method for providing three dimensional image service based on DMB, Apparatus and Method of Decoding for three dimensional image service based on DMB |
| PCT/KR2006/002756 WO2007066868A1 (en) | 2005-12-09 | 2006-07-13 | Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1961238A1 true EP1961238A1 (en) | 2008-08-27 |
| EP1961238A4 EP1961238A4 (en) | 2014-04-30 |
Family
ID=38356896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP06769273.1A Withdrawn EP1961238A4 (en) | 2005-12-09 | 2006-07-13 | Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP1961238A4 (en) |
| KR (1) | KR100747550B1 (en) |
| CN (1) | CN101366290A (en) |
| WO (1) | WO2007066868A1 (en) |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100913397B1 (en) | 2006-12-04 | 2009-08-21 | 한국전자통신연구원 | Method of object description for three dimensional image service based on dmb, and method for receiving three dimensional image service and converting image format |
| KR100910996B1 (en) * | 2006-12-08 | 2009-08-05 | 한국전자통신연구원 | Method of Providing Three-Dimensional Video Service in Digital Multimedia Broadcasting System |
| KR100938283B1 (en) * | 2007-12-18 | 2010-01-22 | 한국전자통신연구원 | Apparatus and method for transmitting/receiving three dimensional broadcasting service using separate transmission of image information |
| KR100955578B1 (en) * | 2007-12-18 | 2010-04-30 | 한국전자통신연구원 | System and Method for stereoscopic contents display |
| BRPI0822032A2 (en) * | 2007-12-20 | 2015-07-21 | Koninkl Philips Electronics Nv | Image encoding method that enables stereoscopic rendering, data bearer, image encoder, image decoder, and computer program product |
| KR100921686B1 (en) * | 2008-02-18 | 2009-10-15 | 전자부품연구원 | Stereoscopic video file format and computer readable recording medium for recording a stereoscopic video file therefore |
| US20110044664A1 (en) * | 2008-06-18 | 2011-02-24 | Maki Yukawa | Three-dimensional video conversion recording device, three-dimensional video conversion recording method, recording medium, three-dimensional video conversion device, and three-dimensional video transmission device |
| KR100963005B1 (en) | 2008-07-09 | 2010-06-10 | 한국전자통신연구원 | Method for file formation according to freeview av service |
| KR20100040640A (en) * | 2008-10-10 | 2010-04-20 | 엘지전자 주식회사 | Receiving system and method of processing data |
| EP2319247A4 (en) * | 2008-10-27 | 2012-05-09 | Samsung Electronics Co Ltd | Methods and apparatuses for processing and displaying image |
| US8520057B2 (en) | 2008-11-04 | 2013-08-27 | Electronics And Telecommunications Research Institute | Method and system for transmitting/receiving 3-dimensional broadcasting service |
| KR100972792B1 (en) | 2008-11-04 | 2010-07-29 | 한국전자통신연구원 | Synchronizer and synchronizing method for stereoscopic image, apparatus and method for providing stereoscopic image |
| KR101279120B1 (en) * | 2009-05-15 | 2013-06-26 | 엘지디스플레이 주식회사 | Image display device |
| WO2010151555A1 (en) | 2009-06-24 | 2010-12-29 | Dolby Laboratories Licensing Corporation | Method for embedding subtitles and/or graphic overlays in a 3d or multi-view video data |
| TW201119353A (en) | 2009-06-24 | 2011-06-01 | Dolby Lab Licensing Corp | Perceptual depth placement for 3D objects |
| KR101781872B1 (en) | 2009-10-13 | 2017-09-26 | 엘지전자 주식회사 | Broadcast receiver and 3d video data processing method thereof |
| EP2489196A4 (en) * | 2009-10-13 | 2014-03-05 | Lg Electronics Inc | Broadcast receiver and 3d video data processing method thereof |
| US8988495B2 (en) | 2009-11-03 | 2015-03-24 | Lg Eletronics Inc. | Image display apparatus, method for controlling the image display apparatus, and image display system |
| EP2334088A1 (en) * | 2009-12-14 | 2011-06-15 | Koninklijke Philips Electronics N.V. | Generating a 3D video signal |
| US8325757B2 (en) * | 2009-12-17 | 2012-12-04 | Silicon Image, Inc. | De-encapsulation of data streams into multiple links |
| US9426441B2 (en) | 2010-03-08 | 2016-08-23 | Dolby Laboratories Licensing Corporation | Methods for carrying and transmitting 3D z-norm attributes in digital TV closed captioning |
| US9172991B2 (en) * | 2010-04-30 | 2015-10-27 | Lg Electronics Inc. | Apparatus of processing an image and a method of processing thereof |
| KR101883018B1 (en) * | 2010-07-21 | 2018-07-27 | 톰슨 라이센싱 | Method and device for providing supplementary content in 3d communication system |
| KR101910192B1 (en) * | 2010-11-12 | 2018-10-22 | 한국전자통신연구원 | Method and apparatus determining image compression format of the 3dtv |
| KR101763941B1 (en) * | 2010-12-20 | 2017-08-01 | 엘지디스플레이 주식회사 | Stereoscpic image display device |
| EP2697975A1 (en) | 2011-04-15 | 2014-02-19 | Dolby Laboratories Licensing Corporation | Systems and methods for rendering 3d images independent of display size and viewing distance |
| EP2753084A4 (en) | 2011-08-31 | 2014-12-31 | Lg Electronics Inc | Digital broadcast signal processing method and device |
| JP6192902B2 (en) * | 2011-11-11 | 2017-09-06 | サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ | Image data transmitting apparatus, image data transmitting method, image data receiving apparatus, and image data receiving method |
| KR102009049B1 (en) | 2011-11-11 | 2019-08-08 | 소니 주식회사 | Transmitting apparatus, transmitting method, receiving apparatus and receiving method |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100523052B1 (en) * | 2002-08-30 | 2005-10-24 | 한국전자통신연구원 | Object base transmission-receive system and method, and object-based multiview video encoding apparatus and method for supporting the multi-display mode |
| KR100751422B1 (en) * | 2002-12-27 | 2007-08-23 | 한국전자통신연구원 | A Method of Coding and Decoding Stereoscopic Video and A Apparatus for Coding and Decoding the Same |
| KR100491523B1 (en) * | 2003-02-19 | 2005-05-30 | (주)파버나인 | Apparatus for displaying stereoscopic image |
| KR20040104777A (en) * | 2003-06-04 | 2004-12-13 | 주식회사 팬택앤큐리텔 | Handset having dual camera |
| KR100585933B1 (en) * | 2003-08-20 | 2006-06-01 | 한국전자통신연구원 | System ? Method for Digital Multimedia Broadcasting |
| KR100999768B1 (en) * | 2003-09-17 | 2010-12-08 | 엘지전자 주식회사 | Method for managing additional information in digital mutimedia broadcasting receiver |
| KR100576544B1 (en) * | 2003-12-09 | 2006-05-03 | 한국전자통신연구원 | Apparatus and Method for Processing of 3D Video using MPEG-4 Object Descriptor Information |
-
2006
- 2006-01-06 KR KR1020060001987A patent/KR100747550B1/en active IP Right Grant
- 2006-07-13 EP EP06769273.1A patent/EP1961238A4/en not_active Withdrawn
- 2006-07-13 WO PCT/KR2006/002756 patent/WO2007066868A1/en active Application Filing
- 2006-07-13 CN CNA2006800525376A patent/CN101366290A/en active Pending
Non-Patent Citations (7)
| Title |
|---|
| "Description of Exploration Experiments in 3D AV", 61. MPEG MEETING;22-07-2002 - 26-07-2002; KLAGENFURT; (MOTION PICTUREEXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. N4929, 29 July 2002 (2002-07-29), XP030012352, ISSN: 0000-0363 * |
| BAUER S ET AL: "THE MPEG-4 MULTIMEDIA CODING STANDARD: ALGORITHMS, ARCHITECTURES AND APPLICATIONS", JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL, IMAGE, AND VIDEO TECHNOLOGY, SPRINGER, NEW YORK, NY, US, vol. 23, no. 1, 1 October 1999 (1999-10-01), pages 7-26, XP000862769, ISSN: 0922-5773, DOI: 10.1023/A:1008136602091 * |
| FAZEL K ET AL: "MOBILE MULTIMEDIA SERVICES VIA DAB: DMB", IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE. PHOENIX, ARIZONA, NOV. 3 - 8, 1997; [GLOBAL TELECOMMUNICATIONS CONFERENCE (GLOBECOM)], NEW YORK, IEEE, US, 3 November 1997 (1997-11-03), pages 1312-1317, XP000737741, ISBN: 978-0-7803-4199-9 * |
| GRUBE M ET AL: "Applications of MPEG-4: Digital Multimedia Broadcasting", IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 47, no. 3, 19 June 2001 (2001-06-19), pages 474-484, XP002389300, ISSN: 0098-3063, DOI: 10.1109/30.964136 * |
| KUGJIN YUN ET AL: "Experimental Evaluation of MAC for stereoscopic video coding", 62. MPEG MEETING; 21-10-2002 - 25-10-2002; SHANGHAI; (MOTION PICTUREEXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, no. M8911, 16 October 2002 (2002-10-16), XP030037847, ISSN: 0000-0271 * |
| See also references of WO2007066868A1 * |
| SEYOON JEONG ET AL: "MPEG-4 extension for augmented stereoscopic video", DIGITAL AND COMPUTATIONAL VIDEO, 2002. DCV 2002. PROCEEDINGS - THIRD I NTERNATIONAL WORKSHOP ON NOV. 14-15, 2002, PISCATAWAY, NJ, USA,IEEE, 14 November 2002 (2002-11-14), pages 176-183, XP010649294, ISBN: 978-0-7803-7984-8 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1961238A4 (en) | 2014-04-30 |
| WO2007066868A1 (en) | 2007-06-14 |
| CN101366290A (en) | 2009-02-11 |
| KR20070060951A (en) | 2007-06-13 |
| KR100747550B1 (en) | 2007-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP1961238A1 (en) | Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service | |
| EP2369836B1 (en) | Object-based 3-dimensional audio service system using preset audio scenes | |
| US8705747B2 (en) | Object-based 3-dimensional audio service system using preset audio scenes | |
| KR100658222B1 (en) | 3 Dimension Digital Multimedia Broadcasting System | |
| US9380288B2 (en) | System and method for transmitting/receiving three dimensional video based on digital broadcasting | |
| JP4362105B2 (en) | Apparatus and method for adaptive conversion of 2D and 3D stereoscopic video signals | |
| KR100905723B1 (en) | System and Method for Digital Real Sense Transmitting/Receiving based on Non-Realtime | |
| JP2010505327A (en) | 3D still image service method and apparatus based on digital broadcasting | |
| KR101490005B1 (en) | Method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content | |
| KR100703715B1 (en) | Multiview 3D video transmission/receiving system | |
| KR100874226B1 (en) | Multi-view Image and 3D Audio Transceiver and Transmit and Receive Method Using the Same | |
| KR20160098974A (en) | Apparatus and method for transmitting and receiving 3dtv broadcasting | |
| KR20170130883A (en) | Method and apparatus for virtual reality broadcasting service based on hybrid network | |
| KR100826519B1 (en) | Method for descripting objects and multiplexing for 3d visual image service based on dmb, apparatus and method for decoding according it | |
| KR100913397B1 (en) | Method of object description for three dimensional image service based on dmb, and method for receiving three dimensional image service and converting image format | |
| KR20170093637A (en) | Method for buffering media transport stream in heterogeneous networks environment and image receiving apparatus using the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20080624 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| DAX | Request for extension of the european patent (deleted) | ||
| A4 | Supplementary search report drawn up and despatched |
Effective date: 20140327 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 13/00 20060101ALI20140321BHEP Ipc: H04N 13/02 20060101AFI20140321BHEP Ipc: H04N 13/04 20060101ALI20140321BHEP |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
| 18W | Application withdrawn |
Effective date: 20140514 |