CN101366290A - Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service - Google Patents
Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service Download PDFInfo
- Publication number
- CN101366290A CN101366290A CNA2006800525376A CN200680052537A CN101366290A CN 101366290 A CN101366290 A CN 101366290A CN A2006800525376 A CNA2006800525376 A CN A2006800525376A CN 200680052537 A CN200680052537 A CN 200680052537A CN 101366290 A CN101366290 A CN 101366290A
- Authority
- CN
- China
- Prior art keywords
- image
- dmb
- service
- stream
- additional information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/356—Image reproducers having separate monoscopic and stereoscopic modes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Provided is a method for providing a DMB-based 3D stereoscopic image service using an MPEG-4 object descriptor of a new structure to provide users with a realistic 3D image service while maintaining compatibility to a conventional DMB system, and a decoding apparatus and method for the DMB-based 3D stereoscopic image service. The method includes the steps of: a) defining in a data service component type that a broadcast service is a DMB service, and defining a dimension of the DMB service in a user application type; and b) assigning a reference image and 3D additional information for a serviced 3D image as different streams which are independent from each other by using different object descriptors.
Description
Technical field
The present invention relates to a kind of method and a kind of decoding device and method that is used for based on the 3D stereoscopic image service of DMB that is used to provide three-dimensional (3D) stereoscopic image service based on DMB; And more specifically, relate to a kind of MPEG-4 Object Descriptor that is used to use new construction method based on the 3D stereoscopic image service of DMB is provided, in the compatibility that keeps with traditional DMB system, providing 3D rendering service true to nature to the user, and a kind of decoding device and method that is used for based on the 3D stereoscopic image service of DMB.
Background technology
In digital media broadcast (DMB) system, the binary format (BIFS) of Motion Picture Experts Group (MPEG)-4 initial object descriptor (IOD), scene, Object Descriptor (OD) and media data are used to description object and scene.Described initial object descriptor is the information that at first transmit with configuration MPEG-4 scene.The initial object descriptor is used to describe the profile (profile) and the level (level) of each medium.Object Descriptor is one group of basic flow descriptors, is used to describe the information about each media data of configuration scene.Described Object Descriptor is used to connect the basic stream (ES) of scene description and each media data.Scene descriptor stream is used to represent constitute the space/time location and the action of the video or the audio object of scene.
Yet, handle because the focus of the traditional DMB of definition service is the 2D motion picture, so it is providing restricted aspect true to nature, the third dimension 3D service to the user.
This requires the new MPEG-4 Object Descriptor of exploitation, and uses this new MPEG-4 Object Descriptor that the method for 3D video is provided, and it can provide 3D service true to nature to the user in the compatibility that keeps with traditional DMB system.
Yet, in the prior art document, openly be not used to provide based on the MPEG-4 Object Descriptor of the 3D service of DMB and be used to distinguish that service content is the method for 2D content or 3D content.
Summary of the invention
Technical problem
Therefore, the purpose of this invention is to provide a kind of MPEG-4 Object Descriptor that uses new construction method based on the 3D stereoscopic image service of DMB is provided, in the compatibility that keeps with traditional DMB system, providing 3D rendering service true to nature to the user, and a kind of decoding device and method that is used for based on the 3D stereoscopic image service of DMB.
Technical solution
According to an aspect of the present invention, a kind of method that is used to provide based on the 3D stereoscopic image service of DMB is provided, described method comprises the steps: that a) defining broadcast service by the data, services component type is the DMB service, and defines the dimension of this DMB service by user's application type; And b) reference picture that uses different Object Descriptors to divide to be used in the 3D rendering of being served and 3D additional information are as different independent stream.
According to another aspect of the invention, a kind of method that is used to provide based on the 3D stereoscopic image service of DMB is provided, it is the DMB service by data, services component type definition broadcast service that described method comprises the steps: a), and defines the dimension of this DMB service by user's application type; And b) Object Descriptor of use divides the reference picture and the 3D additional information that are used in the 3D rendering of being served to flow as the subordinate of independent stream and this reference picture respectively.
According to another aspect of the invention, a kind of decoding device that is used for based on the 3D stereoscopic image service of DMB is provided, described decoding device comprises: decoder is used to use two different Object Descriptors discern respectively and decode reference image stream and 3D additional information stream; And 3D format converter, be used for to be converted to the image of the line data that only have odd-numbered from one of the decoded reference picture of described decoder and decoded 3D appended drawings picture, and another is converted to the image of the line data that only have even-numbered.
According to another aspect of the invention, provide a kind of decoding device that is used for based on the 3D stereoscopic image service of DMB, described decoding device comprises: decoder is used to use an Object Descriptor discern and decode reference image stream and 3D additional information stream; And the 3D format converter, be used to make up from the decoded reference picture of described decoder and the 3D appended drawings picture of decoding, to generate a 3D rendering.
According to another aspect of the invention, a kind of method that is used for providing at the DMB receiving terminal 3D stereoscopic image service is provided, and described method comprises the steps: a) to use two kinds of different Object Descriptors discern respectively and decode reference image stream and 3D additional information stream; B) receive play mode from the user; C) when the play mode that is received is the 2D play mode, the node corresponding with the 3D additional information in the scene descriptor is invalid, thereby only exports decoded reference picture in described step a); And d) when the play mode that is received is the 3D play mode, will be in step a) one of decoded reference picture and 3D appended drawings picture be converted to the image of the line data that only have odd-numbered, and another is converted to the image of the line data that only have even-numbered.
According to another aspect of the invention, provide a kind of method that is used for providing at the DMB receiving terminal 3D stereoscopic image service, described method comprises the steps: a) to use an Object Descriptor discern and decode reference image stream and 3D additional information stream; B) receive play mode from the user; C) when the play mode that is received is the 2D play mode, only exports decoded reference picture in described step a) and do not carry out its change; And d) when the play mode that is received is the 3D play mode, combination is from the decoded reference picture and the 3D appended drawings picture of described step a), to generate a 3D rendering.
Technique effect
The present invention provides 3D rendering service true to nature to the user in the compatibility that keeps with traditional DMB system.
That is to say that the present invention uses the MPEG-4 Object Descriptor of new construction that 3D stereoscopic image service based on DMB is provided, it can provide 3D rendering service true to nature to the user in the compatibility that keeps with traditional DMB system.
Description of drawings
According to next to the description of the preferred embodiment that provides in conjunction with the accompanying drawings, of the present invention above and other purpose and feature with apparition, wherein:
Fig. 1 is in order to the form based on additional data service component (component) type of the DMB of DAB service to be provided;
Fig. 2 illustrates according to the form embodiment of the invention, distinguish 2D DMB service and 3D DMB service method based on the user's application type that defines in DAB;
Fig. 3 is the form that illustrates the structure of the MPEG-4 Object Descriptor that is used for description audio/vision signal in traditional DMB service;
Fig. 4 be illustrate according to the embodiment of the invention, be used to use two Object Descriptors that form based on the structure of the 3D motion picture service object descriptor of DMB is provided;
Fig. 5 is the form that illustrates according to the 3D additional information type of the embodiment of the invention;
Fig. 6 illustrates according to the object descriptor structure embodiment of the invention, that be used to use Fig. 4 to provide based on the decoding device of the 3D stereoscopic image service of DMB and the block diagram of method;
Fig. 7 be illustrate according to the embodiment of the invention, be used to use an Object Descriptor that form based on the structure of the 3D motion picture service object descriptor of DMB is provided; And
Fig. 8 illustrates according to the Object Descriptor embodiment of the invention, that be used to use Fig. 7 to provide based on the decoding device of the 3D stereoscopic image service of DMB and the schematic block diagram of method.
Embodiment
Describe according to reference to the accompanying drawings embodiment next, other purpose of the present invention and aspect are with apparition, and this states hereinafter.Now, detailed reference is illustrated in the accompanying drawings the preferred embodiments of the present invention of its example.If the detailed description about known function and structure is considered to make theme of the present invention fuzzy, then will omit these detailed descriptions.
DMB is based on European digital audio broadcast standards, and it provides Video service with the stream mode among the data, services pattern of EUREKA-147.This DMB is one of Mobile Multimedia Broadcasting that has outstanding receiving ability.
EUREKA-147 provides the data, services of stream mode or group mode and the data, services that is associated with audio frequency.
The audio stream after several compressions and the data of several types by chnnel coding, and are multiplexed as a bit stream together with system's control data.Stream after multiplexed is called as an ensemble stream (ensemble stream).This ensemble stream is experience OFDM modulation and high power amplification before transmitting.In this, multiplexed configuration information (MCI) be included in this overall in available service list, and it provides the type information about the service component in the data, services component type (DSCTy).
Hereinafter, describe in detail according to the preferred embodiment of the invention, be used in the structure of the MPEG-4 Object Descriptor of the 3D rendering service of DMB referring now to accompanying drawing and be used to distinguish that service content is the method for 2D content or 3D content.
Fig. 1 is in order to the form based on the additional data service component type of the DMB of DAB service to be provided.
With reference to figure 1, the service that is intended to provide has been provided in data, services component type (DSCTy) the broadcasting sender is the DMB service.
Therefore, to discern the service that is received from the data, services component type be DMB service to the DMB receiving terminal.
Current consideration 2D DMB service.Yet what service needed at 3D DMB is to be used for distinguishing the 2D content of DMB service and the method for 3D content.
Fig. 2 illustrates according to the form embodiment of the invention, distinguish 2D DMB service and 3D DMB service method based on the user's application type that defines in DAB.
With reference to figure 2, the invention provides a kind of being used for to distinguish the 2D content in the DMB service and the method for 3D content based on the user's application type that defines at DAB.
That is to say that 2D DMB and 3D DMB can be defined in user's application type of definition in DAB (201,202) with distinguishing, so that the 3D DMB that is different from traditional DMB service to be provided service.
Therefore, receiving terminal is discerned the DMB service according to the data, services component type of definition in Fig. 1 (101), and distinguishes that based on user's application type (201,202) the DMB service content is 2D content or 3D content.
The DMB service that 2D DMB 201 representatives are traditional, and 3D DMB 202 representatives can provide the DMB service of 3D service to the user in the compatibility of maintenance and traditional DMB receiving terminal.In this, the 2D of definition and the bit field of 3D DMB content can change in the present invention.
Fig. 3 is the form that illustrates the structure of the MPEG-4 Object Descriptor that is used for description audio/vision signal in traditional DMB service.
Illustrated in Fig. 3, use Object Descriptor and basic stream (ES) descriptor, video flowing is set to " object type indication (ObjectTypeIndication)=0x21 (AVC); stream type (StreamType)=0x04 (visual stream) ", and audio stream is set to " object type indication=0x40 (BSAC), stream type=0x05 (audio stream) ".
In this, each Object Descriptor ID has unique value, and this value is assigned to the URL in the scene descriptor equally.That is to say that in order to represent audio, scene descriptor comprises two nodes that are associated with institute object for allocation descriptor.
Yet because top object descriptor structure is at the 2D content, it has restriction at the 3D motion picture that description has two or more viewpoints (viewpoint) that obtain from camera.
Therefore, the present invention proposes structure, be used in the compatibility that keeps with traditional DMB system, providing the broadcasting of 3D third dimension according to the MPEG-4 Object Descriptor of the type of codec (codec).In this specification, the present invention will be described at video, and the present invention also may be used on audio frequency.
Codec scheme for two types of the 3D motion picture considerations that is obtained.In first codec scheme, independently the 3D motion picture is encoded based on each viewpoint, thereby output is based on the stream of having encoded of viewpoint.In second codec scheme, come the 3D motion picture is encoded based on the correlation of each viewpoint with reference to the image of special time, thereby output is based on the stream of having encoded of viewpoint.
Fig. 4 be illustrate according to the embodiment of the invention, be used to use two Object Descriptors that form based on the structure of the 3D motion picture service object descriptor of DMB is provided.At length, Fig. 4 illustrates when independently the 3D motion picture being encoded based on viewpoint, is used to use two Object Descriptors to represent from the structure of the Object Descriptor of the bit stream of codec output.The 3D additional information of considering in this will be described with reference to figure 5 in the back.
Illustrated as Fig. 4, the present invention uses two Object Descriptors to independent flow distribution reference picture and 3D additional information.
That is to say, reference picture uses AVC (advanced video coding) codec of DMB to encode, and be set to " object type indication=0x21 (AVC); stream type=0x04 (visual stream) ", and the 3D additional information is used AVC codec or other codec to encode and is set to " object type indication=0xC0 (user's special use), stream type=0x04 (visual stream) ".
In addition, the type of definition 3D additional information in the additional descriptor of the 3D in the Object Descriptor of correspondence.
Therefore, traditional DMB receiving terminal can not be discerned object type indication (ObjectTypeIndication) information about the 3D additional information, and therefore can not receive correct image stream.That is to say that traditional DMB receiving terminal is only discerned general reference image stream, and therefore the 3D motion picture may be identified as the 2D motion picture, the compatibility that this makes impossible maintenance and traditional DMB service.
In addition, can provide two Object Descriptors of DMB receiving terminal identification of 3D motion picture service also to receive the decode reference picture and 3D additional information stream independently.In this, in order to show the 3D motion picture, decoded reference picture and 3D appended drawings picture are converted to the image of the line data of the line data that only have odd number (or even number) numbering and even number (or odd number) numbering respectively, and left side field picture (left field image) and 3D complementary field image are simultaneously displayed on the same position in the scene.
Fig. 5 is the form that illustrates according to the 3D additional information type of the embodiment of the invention.
When reference picture is left image, is used for 3D additional information based on the 3D of digital broadcasting service and comprises parallax (disparity) data (parallax), parallax and residual data (parallax+residual data), depth information (degree of depth), the degree of depth and residual data (degree of depth+residual data), right image (right image (fully)), the horizontal right image (right image (laterally half) of half fully), the vertical left image (left image (vertically half) of half), horizontal/vertical half image (right image (1/4th)).Residual data comprises remaining data texturing.
On the other hand, when reference picture was right image, the 3D additional information comprised left image (fully), left image (laterally half), left image (vertically half) and left image (1/4th).
Fig. 6 illustrates according to the object descriptor structure embodiment of the invention, that be used to use Fig. 4 to provide based on the decoding device of the 3D stereoscopic image service of DMB and the schematic block diagram of method.That is to say that the Object Descriptor that Fig. 6 illustrates by Fig. 4 shows method based on the 3D stereoscopic image service of DMB to the user.
Illustrated as Fig. 6, when 3D additional information (see figure 5) was right image (vertically half), though the size of this right image equals reference picture, real data was right image (vertically half).
With reference to figure 6, decoding device 60 comprises decoder 61 and 3D format converter 62.
Decoder 61 uses two different Object Descriptors to discern reference image stream and 3D additional information stream respectively, and carries out independently decode operation thereon.
About the reference picture 621 by decoder 61 decodings, 3D format converter 62 is in the size that keeps image, and the line data of utilizing useless (garbage) data to fill even-numbered also only keep the line data of odd-numbered.About by the 3D appended drawings of decoder 61 decoding as 622,3D format converter 62 utilizes hash to fill the line data of odd-numbered and only keeps the line data of even-numbered when use is included in wherein real data and keeps the size of image to equal the size of reference picture by the image spreading filtration treatment.Replacedly, reference picture 621 can be converted into the data of even-numbered, and 3D appended drawings picture can be converted into the data of odd-numbered.
Even when comprising two Object Descriptor ID with demonstration 3D third dimension motion picture 620 in scene descriptor, this method also satisfies the traditional DMB standard that only shows an object video in a scene simultaneously.
On the other hand, when the user wishes to carry out 2D when showing (610) at the 3D motion picture, 3D format converter 62 makes that the nodes corresponding with the 3D additional information in the scene descriptor are invalid, thereby only decoded reference picture is output and shows and be not changed.
Now, the user interaction approach of 3D content will be described in detail.
The user can rely on play mode and randomly the 3D content is adjusted in the 2D perhaps 3D content.
When the user is provided with the 3D play mode by the play mode inputting interface, can be according to the additional creation of image 3D rendering 620 of characteristic, the decoded reference picture of use and decoded 3D of 3D monitor.On the other hand, when the user is provided with the 2D play mode by the play mode input interface, can only use decoded reference picture to create 2D image 610.
Simultaneously, the user can adjust the third dimension sensation by laterally moving (that is, according to 3D moving image third dimension sensation adjustment modes, in the image or the parallax adjustment of object),
That is to say that the user can feel that adjustment modes appreciates stereoscopic model by the parallax of adjusting the 3D moving image according to third dimension, this may be undertaken by the horizontal mobile left side and right image.In addition, in the time can randomly adjusting image parallactic at each object in the image, the user can appreciate image by adjusting image parallactic based on desired object.
Fig. 7 be illustrate according to the embodiment of the invention, be used to use an Object Descriptor that form based on the structure of the 3D motion picture service object descriptor of DMB is provided.At length, Fig. 7 illustrates when encoding the 3D motion picture based on viewpoint coding 3D motion picture or with reference to the image of special time based on the correlation between each viewpoint independently, uses an Object Descriptor to represent the structure of the Object Descriptor of the bit stream exported from codec.
Fig. 4 illustrates by the method for using two Object Descriptor assigned references images and 3D additional information to use as independent stream, and Fig. 7 illustrates by using an Object Descriptor assigned references image and the 3D additional information method as independent stream and subordinate stream.
Illustrated as Fig. 7, show basic stream (ES) descriptor of reference picture and the basic flow descriptors of 3D additional information with the membership under the Object Descriptor.This membership can be used MPEG-4ES descriptor " stream dependency marking (StreamDependanceFlag) " and " dependsOn_ES_ID " expression.
The AVC codec that uses DMB is to encoding as the reference picture of independent stream and it is set to " object type indication=0x21 (AVC), stream type=0x04 (visual stream) ", and uses AVC codec or other codec that the 3D appended drawings as subordinate stream is looked like to encode and it is set to " object type indication=0xC0 (user's special use), stream type=0x04 (visual stream), flow dependency marking=1, dependsOn_ES_ID=101 (reference picture ES_ID) ".
In addition, the type of 3D additional information is defined within the additional descriptor of 3D of the additional descriptor of 3D of basic flow descriptors (ES_Descriptor) or Object Descriptor (OD).Therefore, traditional DMB receiving terminal can not be discerned the object type indication information about the 3D additional information, and therefore can not receive the 3D additional information stream.Therefore that is to say that traditional DMB receiving terminal is only discerned general reference image stream, and the 3D motion picture may be identified as the 2D motion picture, this makes and may keep compatibility with traditional DMB service.
In the above methods, the 3D motion picture is identified as an object, and an Object Descriptor ID is included in the scene descriptor, this equates the structure of the scene descriptor of the video that is used for representing traditional DMB.
Fig. 8 illustrates according to the object descriptor structure embodiment of the invention, that be used to use Fig. 7 to provide based on the decoding device 80 of the third dimension 3D rendering service of DMB and the block diagram of method.
With reference to figure 8, decoding device 80 comprises decoder 81 and 3D format converter 82.
Object Descriptor of decoding device 80 identifications of the DMB receiving terminal of 3D motion picture service can be provided, receive the independent reference picture and the subordinate 3D additional information stream that are included in wherein, and it is decoded.Because scene descriptor comprises an Object Descriptor that is used to show the 3D motion picture, thus reference picture that decoding device 80 combinations are decoded and the 3D appended drawings picture of being decoded, to generate and to show a 3D rendering 820.
That is to say that decoder 81 uses an Object Descriptor to discern reference image stream and 3D additional image stream, and they are decoded.When 3D format converter 82 when the user receives the request that 3D shows, reference picture that decoder 81 combinations are decoded and the 3D appended drawings picture of being decoded are to generate a 3D rendering.
On the other hand, when the user wanted to carry out 2D about 3D motion picture 810 and shows, 3D format converter 82 did not change scene descriptor, only made reference picture be output and showed and do not carry out change of format.
To describe the user interaction approach of 3D content now in detail.
The user can come randomly the 3D content to be adjusted in the 2D perhaps the 3D content or by randomly adjust the parallax of 3D motion picture according to third dimension sensation adjustment modes by relying on play mode, and the appreciation stereoscopic model, this may be undertaken by horizontal mobile left image and right image.
In the time can randomly adjusting image parallactic at each object in the image, the user can appreciate image by adjusting image parallactic based on the expectation object.
The form of the 3D motion picture that generates at 3D format converter 82 places changes according to the characteristic of 3D monitor.
The present invention may be used on being used for all systems of 3D service and based on the system of the 3D stereoscopic service of DMB.
In addition, the present invention can be applied to 3D audio service and 3D stereoscopic image service similarly.
But can be embodied as program and be stored in the computer readable recording medium storing program for performing of working procedure according to the method for the embodiment of the invention.The example of computer readable recording medium storing program for performing comprises CD-ROM, RAM, ROM, floppy disk, hard disk, magneto optical disk etc.
The present invention comprises about korean patent application No.2005-121112 that submits in Korea S Department of Intellectual Property on December 9th, 2005 and on January 6th, 2006 and the theme of 2006-001987, and its full content is by with reference to being herein incorporated.
Although described the present invention, it will be apparent to those skilled in the art that and to carry out various changes and modification, and do not break away from the scope of the present invention that in ensuing claim, limits with reference to specific preferred embodiment.
Claims (22)
1. one kind is used to provide the method based on the 3D stereoscopic image service of DMB (DMB), and described method comprises the steps:
A) the definition broadcast service is the DMB service in the data, services component type, and the dimension of this DMB service of definition in user's application type; And
B) reference picture by using different Object Descriptors to divide to be used in the 3D rendering of being served and 3D additional information are as various flows independent of each other.
2. according to the method for claim 1, wherein in described step b), with this reference image setting " object type indication=0x21 (AVC), stream type=0x04 (visual stream) ", and this 3D additional information is set to " object type indication=0xC0 (user's special use), stream type=0x04 (visual stream) ".
3. according to the method for claim 2, the type of this 3D additional information of definition in the additional descriptor of 3D of the Object Descriptor (OD) of correspondence wherein.
4. according to the process of claim 1 wherein that this 3D additional information comprises the appended drawings picture of parallax data (parallax), parallax and residual data (parallax+residual data), depth information (degree of depth), the degree of depth and residual data (degree of depth+residual data), full images, vertically half appended drawings picture, laterally half appended drawings picture and 1/4th images.
5. according to the method for claim 4, wherein when this reference picture was the left/right image, this appended drawings similarly was a right/left image.
6. one kind is used to provide the method based on the 3D stereoscopic image service of DMB, and described method comprises the steps:
A) the definition broadcast service is the DMB service in the data, services component type, and the dimension of this DMB service of definition in user's application type; And
B) flow as the subordinate on independent stream and this reference picture respectively by reference picture and the 3D additional information of using an Object Descriptor to come branch to be used in the 3D rendering of being served.
7. according to the method for claim 6, wherein in described step b), with this reference image setting " object type indication=0x21 (AVC), stream type=0x04 (visual stream) ", and this 3D additional information is set to " object type indication=0xC0 (user's special use), stream type=0x04 (visual stream), stream dependency marking=1, dependsOn_ES_ID=101 (reference picture ES_ID) ".
8. according to the method for claim 7, wherein in the additional descriptor of the 3D of this Object Descriptor, define the desired type of 3D additional information.
9. according to the method for claim 7, wherein in the additional descriptor of the 3D of basic descriptor (ES_Descriptor), define the desired type of 3D additional information.
10. according to the method for claim 6, wherein this 3D additional information comprises the appended drawings picture of parallax data (parallax), parallax and residual data (parallax+residual data), depth information (degree of depth), the degree of depth and residual data (degree of depth+residual data), full images, vertically half appended drawings picture, laterally half appended drawings picture and 1/4th images.
11. according to the method for claim 10, wherein when this reference picture was the left/right image, this appended drawings similarly was a right/left image.
12. a decoding device that is used for based on the 3D stereoscopic image service of DMB, described decoding device comprises:
Decoder is used for by using two different Object Descriptors discern respectively and decode reference image stream and 3D additional information stream; And
The 3D format converter is used for and will be converted to the image of the line data that only have odd-numbered from one of the decoded reference picture of described decoder and decoded 3D appended drawings picture, and another is converted to the image of the line data that only have even-numbered.
13. decoding device according to claim 12, wherein when this decoded reference picture and this decoded 3D appended drawings looked like to be converted into the image of the line data that only have odd-numbered or even-numbered, the 3D format converter was filled corresponding residue line with useless data.
14. decoding device according to claim 13, wherein when receiving the request of 2D demonstration from the user, this 3D format converter is also carried out the feasible node invalid function corresponding with the 3D additional information in the scene descriptor, only to export this decoded reference picture.
15. according to the decoding device of claim 12, wherein this 3D format converter is adjusted the parallax of 3D rendering according to user's demand, to adjust the third dimension sensation of image.
16. a decoding device that is used for based on the 3D stereoscopic image service of DMB, described decoding device comprises:
Decoder is used for by using an Object Descriptor discern and decode reference image stream and 3D additional information stream; And
The 3D format converter is used to make up decoded reference picture and decoded 3D appended drawings picture from described decoder, to generate a 3D rendering.
17. according to the decoding device of claim 16, wherein when receiving the request that 2D shows from the user, this 3D format converter is also carried out the reference picture behind the output decoder only and the function of not carrying out its change.
18. according to the decoding device of claim 16, wherein this 3D format converter is adjusted the parallax of 3D rendering according to user's demand, to adjust the third dimension sensation of image.
19. a method that is used for providing at the DMB receiving terminal 3D stereoscopic image service, described method comprises the steps:
A) by using two different Object Descriptors discern respectively and decode reference image stream and 3D additional information stream;
B) receive play mode from the user;
C) when the play mode that is received is the 2D play mode, makes that the node corresponding with the 3D additional information in the scene descriptor is invalid, thereby only export decoded reference picture in described step a); And
D) when the play mode that is received is the 3D play mode, will be in described step a) one of decoded reference picture and 3D appended drawings picture be converted to the image of the line data that only have odd-numbered, and another is converted to the image of the line data that only have even-numbered.
20. according to the method for claim 19, also comprise according to user's demand adjust the parallax of 3D rendering, with the step of the third dimension sensation of adjusting image.
21. a method that is used for providing at the DMB receiving terminal 3D stereoscopic image service, described method comprises the steps:
A) use an Object Descriptor discern and decode reference image stream and 3D additional information stream;
B) receive play mode from the user;
C) when the play mode that is received is the 2D play mode, only exports decoded reference picture in described step a) and do not carry out its change; And
D) when the play mode that is received is the 3D play mode, combination is from the decoded reference picture and the 3D appended drawings picture of described step a), to generate a 3D rendering.
22. according to the method for claim 21, also comprise according to user's demand adjust the parallax of 3D rendering, with the step of the third dimension sensation of adjusting image.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20050121112 | 2005-12-09 | ||
| KR1020050121112 | 2005-12-09 | ||
| KR1020060001987 | 2006-01-06 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101366290A true CN101366290A (en) | 2009-02-11 |
Family
ID=38356896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006800525376A Pending CN101366290A (en) | 2005-12-09 | 2006-07-13 | Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP1961238A4 (en) |
| KR (1) | KR100747550B1 (en) |
| CN (1) | CN101366290A (en) |
| WO (1) | WO2007066868A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012010101A1 (en) * | 2010-07-21 | 2012-01-26 | Technicolor (China) Technology Co., Ltd. | Method and device for providing supplementary content in 3d communication system |
| CN102547345A (en) * | 2010-12-20 | 2012-07-04 | 乐金显示有限公司 | Stereoscopic image display |
| CN102577403A (en) * | 2009-10-13 | 2012-07-11 | Lg电子株式会社 | Broadcast receiver and 3D video data processing method thereof |
| CN102640506A (en) * | 2009-12-14 | 2012-08-15 | 皇家飞利浦电子股份有限公司 | Generating a 3D video signal |
| CN102656851A (en) * | 2009-12-17 | 2012-09-05 | 晶像股份有限公司 | De-encapsulation of data streams into multiple links |
| CN101888564B (en) * | 2009-05-15 | 2012-10-10 | 乐金显示有限公司 | Image display device |
| CN103339933A (en) * | 2010-11-12 | 2013-10-02 | 韩国电子通信研究院 | Method and apparatus for determining a video compression standard in a 3 DTV service |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100913397B1 (en) | 2006-12-04 | 2009-08-21 | 한국전자통신연구원 | Method of object description for three dimensional image service based on dmb, and method for receiving three dimensional image service and converting image format |
| KR100910996B1 (en) * | 2006-12-08 | 2009-08-05 | 한국전자통신연구원 | Method of Providing Three-Dimensional Video Service in Digital Multimedia Broadcasting System |
| KR100938283B1 (en) * | 2007-12-18 | 2010-01-22 | 한국전자통신연구원 | Apparatus and method for transmitting/receiving three dimensional broadcasting service using separate transmission of image information |
| KR100955578B1 (en) | 2007-12-18 | 2010-04-30 | 한국전자통신연구원 | System and Method for stereoscopic contents display |
| EP3007440A1 (en) * | 2007-12-20 | 2016-04-13 | Koninklijke Philips N.V. | Image encoding method for stereoscopic rendering |
| KR100921686B1 (en) * | 2008-02-18 | 2009-10-15 | 전자부품연구원 | Stereoscopic video file format and computer readable recording medium for recording a stereoscopic video file therefore |
| EP2288148A4 (en) * | 2008-06-18 | 2012-04-04 | Mitsubishi Electric Corp | Three-dimensional video conversion recording device, three-dimensional video conversion recording method, recording medium, three-dimensional video conversion device, and three-dimensional video transmission device |
| KR100963005B1 (en) | 2008-07-09 | 2010-06-10 | 한국전자통신연구원 | Method for file formation according to freeview av service |
| KR20100040640A (en) | 2008-10-10 | 2010-04-20 | 엘지전자 주식회사 | Receiving system and method of processing data |
| EP2319247A4 (en) * | 2008-10-27 | 2012-05-09 | Samsung Electronics Co Ltd | Methods and apparatuses for processing and displaying image |
| KR20100050426A (en) | 2008-11-04 | 2010-05-13 | 한국전자통신연구원 | Method and system for transmitting/receiving 3-dimensional broadcasting service |
| KR100972792B1 (en) | 2008-11-04 | 2010-07-29 | 한국전자통신연구원 | Synchronizer and synchronizing method for stereoscopic image, apparatus and method for providing stereoscopic image |
| TW201119353A (en) | 2009-06-24 | 2011-06-01 | Dolby Lab Licensing Corp | Perceptual depth placement for 3D objects |
| WO2010151555A1 (en) | 2009-06-24 | 2010-12-29 | Dolby Laboratories Licensing Corporation | Method for embedding subtitles and/or graphic overlays in a 3d or multi-view video data |
| CA2777016C (en) * | 2009-10-13 | 2015-10-20 | Lg Electronics Inc. | Broadcast receiver and 3d video data processing method thereof |
| US8988495B2 (en) * | 2009-11-03 | 2015-03-24 | Lg Eletronics Inc. | Image display apparatus, method for controlling the image display apparatus, and image display system |
| US9426441B2 (en) | 2010-03-08 | 2016-08-23 | Dolby Laboratories Licensing Corporation | Methods for carrying and transmitting 3D z-norm attributes in digital TV closed captioning |
| CA2797619C (en) | 2010-04-30 | 2015-11-24 | Lg Electronics Inc. | An apparatus of processing an image and a method of processing thereof |
| US9519994B2 (en) | 2011-04-15 | 2016-12-13 | Dolby Laboratories Licensing Corporation | Systems and methods for rendering 3D image independent of display size and viewing distance |
| CA2845780C (en) | 2011-08-31 | 2017-04-18 | Lg Electronics Inc. | Digital broadcast signal processing method and device |
| JP6192902B2 (en) * | 2011-11-11 | 2017-09-06 | サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ | Image data transmitting apparatus, image data transmitting method, image data receiving apparatus, and image data receiving method |
| WO2013069608A1 (en) | 2011-11-11 | 2013-05-16 | ソニー株式会社 | Transmitting apparatus, transmitting method, receiving apparatus and receiving method |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100523052B1 (en) * | 2002-08-30 | 2005-10-24 | 한국전자통신연구원 | Object base transmission-receive system and method, and object-based multiview video encoding apparatus and method for supporting the multi-display mode |
| KR100751422B1 (en) * | 2002-12-27 | 2007-08-23 | 한국전자통신연구원 | A Method of Coding and Decoding Stereoscopic Video and A Apparatus for Coding and Decoding the Same |
| KR100491523B1 (en) * | 2003-02-19 | 2005-05-30 | (주)파버나인 | Apparatus for displaying stereoscopic image |
| KR20040104777A (en) * | 2003-06-04 | 2004-12-13 | 주식회사 팬택앤큐리텔 | Handset having dual camera |
| KR100585933B1 (en) * | 2003-08-20 | 2006-06-01 | 한국전자통신연구원 | System ? Method for Digital Multimedia Broadcasting |
| KR100999768B1 (en) * | 2003-09-17 | 2010-12-08 | 엘지전자 주식회사 | Method for managing additional information in digital mutimedia broadcasting receiver |
| KR100576544B1 (en) * | 2003-12-09 | 2006-05-03 | 한국전자통신연구원 | Apparatus and Method for Processing of 3D Video using MPEG-4 Object Descriptor Information |
-
2006
- 2006-01-06 KR KR1020060001987A patent/KR100747550B1/en active IP Right Grant
- 2006-07-13 CN CNA2006800525376A patent/CN101366290A/en active Pending
- 2006-07-13 WO PCT/KR2006/002756 patent/WO2007066868A1/en active Application Filing
- 2006-07-13 EP EP06769273.1A patent/EP1961238A4/en not_active Withdrawn
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101888564B (en) * | 2009-05-15 | 2012-10-10 | 乐金显示有限公司 | Image display device |
| US9756380B2 (en) | 2009-10-13 | 2017-09-05 | Lg Electronics Inc. | Broadcast receiver and 3D video data processing method thereof |
| CN102577403A (en) * | 2009-10-13 | 2012-07-11 | Lg电子株式会社 | Broadcast receiver and 3D video data processing method thereof |
| US9392252B2 (en) | 2009-10-13 | 2016-07-12 | Lg Electronics Inc. | Broadcast receiver and 3D video data processing method thereof |
| CN104717479A (en) * | 2009-10-13 | 2015-06-17 | Lg电子株式会社 | Broadcast receiver and 3D video data processing method thereof |
| CN102640506A (en) * | 2009-12-14 | 2012-08-15 | 皇家飞利浦电子股份有限公司 | Generating a 3D video signal |
| CN102656851B (en) * | 2009-12-17 | 2016-05-11 | 美国莱迪思半导体公司 | Data diffluence encapsulation is entered to method, the Apparatus and system in multiple links |
| CN102656851A (en) * | 2009-12-17 | 2012-09-05 | 晶像股份有限公司 | De-encapsulation of data streams into multiple links |
| WO2012010101A1 (en) * | 2010-07-21 | 2012-01-26 | Technicolor (China) Technology Co., Ltd. | Method and device for providing supplementary content in 3d communication system |
| CN103339933A (en) * | 2010-11-12 | 2013-10-02 | 韩国电子通信研究院 | Method and apparatus for determining a video compression standard in a 3 DTV service |
| CN103339933B (en) * | 2010-11-12 | 2016-04-27 | 韩国电子通信研究院 | Image compression specification defining method in 3DTV service and device |
| CN102547345B (en) * | 2010-12-20 | 2014-07-23 | 乐金显示有限公司 | Stereoscopic image display |
| CN102547345A (en) * | 2010-12-20 | 2012-07-04 | 乐金显示有限公司 | Stereoscopic image display |
Also Published As
| Publication number | Publication date |
|---|---|
| EP1961238A4 (en) | 2014-04-30 |
| KR100747550B1 (en) | 2007-08-08 |
| WO2007066868A1 (en) | 2007-06-14 |
| KR20070060951A (en) | 2007-06-13 |
| EP1961238A1 (en) | 2008-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101366290A (en) | Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service | |
| CN101982979B (en) | Apparatus and method for adapting 2d and 3d stereoscopic video signal | |
| US9380288B2 (en) | System and method for transmitting/receiving three dimensional video based on digital broadcasting | |
| JP5543504B2 (en) | 3D still image service method and apparatus based on digital broadcasting | |
| JP4897024B2 (en) | Multi-view video transmission / reception apparatus and method | |
| KR100556826B1 (en) | System and Method of Internet Broadcasting for MPEG4 based Stereoscopic Video | |
| CN1998233B (en) | 3-dimensional digital multimedia broadcasting system | |
| CN102158733B (en) | Method for loading auxiliary video supplementary information, processing method, equipment and system | |
| KR100703715B1 (en) | Multiview 3D video transmission/receiving system | |
| JP2010512096A (en) | Non-real-time digital actual broadcasting transmission / reception system and method | |
| CN102292997A (en) | Broadcast receiver and video data processing method thereof | |
| CN103650515A (en) | Wireless 3D streaming server | |
| Lim et al. | A multiview sequence CODEC with view scalability | |
| Puri et al. | Stereoscopic video compression using temporal scalability | |
| KR100576544B1 (en) | Apparatus and Method for Processing of 3D Video using MPEG-4 Object Descriptor Information | |
| WO2007067020A1 (en) | System and method for transmitting/receiving three dimensional video based on digital broadcasting | |
| KR100874226B1 (en) | Multi-view Image and 3D Audio Transceiver and Transmit and Receive Method Using the Same | |
| KR20160098974A (en) | Apparatus and method for transmitting and receiving 3dtv broadcasting | |
| KR100540172B1 (en) | System And Method For Serving Multi-visual Point Video Based On The Object | |
| KR100913397B1 (en) | Method of object description for three dimensional image service based on dmb, and method for receiving three dimensional image service and converting image format | |
| KR100979445B1 (en) | Method for providing three dimensional data service based on dmb and method for receiving it | |
| KR101382618B1 (en) | Method for making a contents information and apparatus for managing contens using the contents information | |
| Fautier | Next-generation video compression techniques | |
| EP2158767A1 (en) | Method for describing and multiplexing objects for 3d still image service based on dmb, and apparatus and decoding apparatus and method thereof | |
| Lucas et al. | Multiview Video Coding (MVC) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090211 |