KR101305789B1 - Method for processing non-real time stereoscopic services in terrestrial digital multimedia broadcasting and apparatus for receiving terrestrial digital multimedia broadcasting - Google Patents

Abstract

A method of performing a non-real time stereoscopic service in terrestrial digital multimedia broadcasting and a terrestrial digital multimedia broadcasting receiving apparatus are disclosed. The terrestrial digital multimedia broadcasting receiving apparatus can perform a stereoscopic service by storing additional data in a non-volatile storage device in advance in the terrestrial DMB service and synchronizing and processing the reference data transmitted in real time. According to the present invention, the stereoscopic service can be performed without requiring an additional data rate.

Description

Method of performing non-real time stereoscopic service in terrestrial digital multimedia broadcasting and receiving device for terrestrial digital multimedia broadcasting

The present invention relates to a terrestrial digital multimedia broadcasting service, and more particularly, to a method and apparatus for performing a stereoscopic service using reference data and additional data transmitted in non-real time.

The present invention is derived from the research conducted as part of the IT source technology development project of the Korea Communications Commission [Task Management No .: 2008-F-011-01, Project Name: Next-Generation DTV Core Technology Development (Standardization)-Glasses-free Development of personal 3D broadcasting technology (continued)].

A stereoscopic video service using video data of left and right binocular views may provide a three-dimensional image to increase viewers' sense of reality. Currently, stereoscopic video services are attempting to be applied to terrestrial DMB. In this case, since the stereoscopic video service must provide both the left eye image and the right eye image to the viewer, it is necessary to transmit data up to twice as much as the monoscopic service. For this reason, since data rate is limited, it is difficult to provide a stereoscopic video service for terrestrial DMB. A service for multiplexing and transmitting additional data and reference data together for a stereoscopic service is defined as a " real time " stereoscopic service.

However, since the transmission of the additional data and the reference data together is limited by the data rate, a method for overcoming this limitation and performing a stereoscopic service in a terrestrial DMB receiving apparatus is required.

The present invention provides an apparatus and method for terrestrial digital multimedia broadcasting non-real time stereoscopic service.

The present invention provides an apparatus and method for overcoming the limitation of data rate by first downloading and storing additional data for a stereoscopic service and processing the reference data transmitted in real time together with the additional data.

The present invention provides an apparatus and method capable of preventing image quality deterioration of stereoscopic data by performing synchronization between reference data and additional data transmitted in non real time.

In accordance with an embodiment of the present invention, a method for performing a stereoscopic service performed by a broadcast receiving apparatus extracts a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in an MPEG-2 TS. Analyzing information defined in a stereoscopic service descriptor (SS_descriptor) among descriptors corresponding to a program selected by the user in the program map table, based on a descriptor corresponding to a program selected by the user in the program map table; Extracting the reference video included in the MPEG-2 TS, extracting additional video stored in advance in the broadcast receiving apparatus using the analyzed information, and starting time of the stereoscopic video using the analyzed information. From the extracted reference video and the additional video It may comprise the display screen.

Analyzing the information defined in the stereoscopic service descriptor according to an embodiment of the present invention, analyzing a service type defining a type of a stereoscopic service, the file name from which to extract the additional video The method may include analyzing a defined content name and analyzing a marker NRT_marker indicating a start position for synchronization between the base video and the additional video.

In accordance with another aspect of the present invention, a method for performing a stereoscopic service performed by a broadcast receiving device extracts a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in an MPEG-2 TS. Analyzing information defined in a stereoscopic service descriptor (SS_descriptor) among descriptors corresponding to the program selected by the user in the program map table, based on the descriptor corresponding to the program selected by the user in the program map table. Extracting a reference image included in the MPEG-2 TS, extracting an additional image previously stored in the broadcast receiving apparatus using the analyzed information, and synchronizing and displaying the extracted reference image and the additional image It may include a step.

The analyzing of the information defined in the stereoscopic service descriptor according to another embodiment of the present invention may include: analyzing a service type defining a type of stereoscopic service, and extracting a file name from which the additional image is to be extracted. The method may include analyzing a defined image name ImageName and analyzing a stereoscopic service image identifier SS_image_PID for defining the image name as a file name from which the additional image is to be extracted.

According to another embodiment of the present invention, a method for performing a stereoscopic service performed by a broadcast receiving device includes a program map table corresponding to a program selected by a user from a program association table (PAT) included in an MPEG-2 TS for transmitting content; Extracting PMT), wherein the contents are repeatedly transmitted for a predetermined period of time by alternately replacing a left image and a right image as reference videos through the MPEG-2 TS; and corresponding to a program selected by the user in the program map table. Analyzing information defined in a stereoscopic service descriptor (SS_descriptor) among the descriptors; extracting a reference video included in the MPEG-2 TS based on a descriptor corresponding to a program selected by the user from the program map table; And the additional video corresponding to the reference video is stored in the broadcast receiving device. Determining whether a video is stored in the broadcast receiving apparatus; if the additional video is included in the broadcast receiving apparatus; displaying the reference video and the additional video stereoscopically; and if the additional video is not stored in the broadcast receiving apparatus. And displaying the reference image in a monoscopic manner and storing the reference image in the broadcast receiving device.

The analyzing of the information defined in the stereoscopic service descriptor according to another embodiment of the present invention may include analyzing a service type defining a type of stereoscopic service, a file name to read the additional video, and Analyzing a ContentName defining a file name to store a reference video, analyzing a marker (NRT_marker) indicating a starting position for synchronization between the reference video and the additional video, and a file size for a file to store the reference video. (file size) and expiration date may be analyzed.

A broadcast receiving apparatus for processing a stereoscopic service according to an embodiment of the present invention extracts a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in an MPEG-2 TS. Analyzing information defined in a stereoscopic service descriptor (SS_descriptor) among descriptors corresponding to a program selected by the user in the program map table, based on a descriptor corresponding to a program selected by the user in the program map table; Extracting the reference video included in the MPEG-2 TS, extracting additional video stored in advance in the broadcast receiving apparatus using the analyzed information, and starting time of the stereoscopic video using the analyzed information. From the extracted reference video and the additional video You may perform the step of granulation to display.

A broadcast receiving apparatus for processing a stereoscopic service according to another embodiment of the present invention extracts a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in an MPEG-2 TS. Analyzing information defined in a stereoscopic service descriptor (SS_descriptor) among descriptors corresponding to a program selected by the user in the program map table, based on a descriptor corresponding to a program selected by the user in the program map table; Extracting a reference image included in the MPEG-2 TS, extracting an additional image previously stored in the broadcast receiving apparatus using the analyzed information, and synchronizing and displaying the extracted reference image and the additional image Can be performed.

According to another exemplary embodiment of the present invention, a broadcast receiving apparatus for processing a stereoscopic service may include a program map table corresponding to a program selected by a user from a program association table (PAT) included in an MPEG-2 TS for transmitting content. Extracting PMT), wherein the contents are repeatedly transmitted for a predetermined period of time by alternately changing left and right images as reference videos through the MPEG-2 TS; and corresponding to a program selected by the user in the program map table. Analyzing information defined in a stereoscopic service descriptor (SS_descriptor) among the descriptors; extracting a reference video included in the MPEG-2 TS based on a descriptor corresponding to a program selected by the user from the program map table; And the additional video corresponding to the reference video is stored in the broadcast receiving device. Determining whether a video is stored in the broadcast receiving apparatus; if the additional video is included in the broadcast receiving apparatus; displaying the reference video and the additional video stereoscopically; and if the additional video is not stored in the broadcast receiving apparatus. And displaying the reference image in a monoscopic manner and storing the reference image in the broadcast receiving device.

According to an embodiment of the present invention, terrestrial digital multimedia broadcasting may perform a non-real time stereoscopic service.

According to an embodiment of the present invention, the additional data for the stereoscopic service is first downloaded and stored, and the reference data transmitted in real time together with the additional data may overcome the limitation of the data rate.

According to an embodiment of the present invention, deterioration of image quality of stereoscopic data may be prevented by performing synchronization between additional data transmitted in non real time and reference data.

1 is a diagram illustrating a process of performing a non-real time terrestrial DMB stereoscopic service according to an embodiment of the present invention.
2 is a diagram illustrating a content access process for a non-real-time MOT / stream mode stereoscopic video service according to an embodiment of the present invention.
3 is a diagram illustrating a content access process for a non-real-time MOT / stream mode video linked stereoscopic data service according to an embodiment of the present invention.
4 is a diagram illustrating a content access process for a non-real time repetitive content stereoscopic video service according to an embodiment of the present invention.
5 is a diagram illustrating a basic format and an optional format of a stereoscopic video according to an embodiment of the present invention.
6 is a diagram illustrating a process of playing a stereoscopic video according to an embodiment of the present invention.
7 is a diagram illustrating an example of performing a terrestrial DMB non-real-time repeating content stereoscopic video service according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Terms referred to in the present invention are defined as follows.

(1) Stereoscopic

It is a characteristic that a user feels a three-dimensional feeling by using data of human left and right binocular views, and has the same meaning as 3D.

(2) Monoscopic

It is a characteristic that a user does not feel three-dimensionality by using data of a single view of a human, and has the same meaning as 2D.

(3) Terrestrial Digital Mulitmedia Broadcasting (DMB) non-real time stereoscopic service

 It provides a stereoscopic video or video-linked data service compatible with the monoscopic service of the conventional terrestrial DMB, but transmits additional data necessary for stereoscopic expression in a non-real time manner.

(4) Terrestrial DMB non-real-time stereoscopic video service

It is a service that provides stereoscopic video by transmitting video in real time from terrestrial DMB service.

(5) Terrestrial DMB non real-time video linked data service

It is a service that provides a stereoscopic image by linking with a monoscopic video by transmitting a still image (image) in real time from a terrestrial DMB service.

(6) Terrestrial DMB non-real-time repeating content stereoscopic video service

In terrestrial DMB service, it is a service that provides stereoscopic video by repeatedly transmitting in real time for a predetermined period like advertisement contents.

(7) Terrestrial DMB non-real-time MOT / stream mode stereoscopic (video, data) services

 Additional data for displaying stereoscopic video or data is transmitted in advance to the terrestrial DMB receiving device through the MOT protocol and stored in a nonvolatile storage device, and then the monoscopic video or monoscopic data, which is reference data corresponding to the additional data, is stored in real time. When received, a service that displays stereoscopic video or data by processing the additional data stored in the nonvolatile storage device and the reference data together.

(8) Terrestrial DMB non-real-time MOT / stream mode video-linked stereoscopic data service

It is a service that provides stereoscopic data service in conjunction with monoscopic video service in terrestrial DMB service.

(9) Terrestrial DMB Stereoscopic Service Receiver

Receives terrestrial DMB signals and provides stereoscopic services to users.

(10) lenticular lens system

This is a display method that sends different images to both human eyes by refracting the left and right images through a lenticular screen in which the lenticular lenses are vertically arranged so as to provide a 180 degree viewing angle around the screen. .

(11) reference video

A stereoscopic video refers to an image that is conventionally recognized and reproduced by a conventional terrestrial DMB receiving apparatus or an image that is reproduced when a viewing mode is switched from a stereoscopic mode to a monoscopic mode. At this time, in the case of a video, it may be referred to as a "reference video" or "reference video", in the case of a still image "reference still image" or "reference image".

12 additional videos

In the stereoscopic image, it means an image of a viewpoint different from the reference image. The additional video is used for stereoscopic reproduction with the reference video in the terrestrial DMB receiving apparatus, and may not be recognized and ignored in the conventional terrestrial DMB receiving apparatus. In this case, the moving picture may be referred to as "additional video" or "additional video", and in the case of a still image, "additional still image" or "additional image".

In addition, the abbreviations of terms used in one embodiment of the present invention are shown in Table 1 below.

1 is a diagram illustrating a process of performing a non-real time terrestrial DMB stereoscopic service according to an embodiment of the present invention.

The terrestrial DMB transmitting apparatus 100 of FIG. 1 may transmit data to the terrestrial DMB receiving apparatus 101 in real time for terrestrial DMB service. At this time, according to an embodiment of the present invention, the terrestrial DMB receiving apparatus 101 may provide a stereoscopic service to a user. Stereoscopic services using left and right images can provide a three-dimensional image, thereby improving the user's feeling. Since the stereoscopic service must transmit both the left eye image and the right eye image, it is necessary to transmit a maximum amount of information up to twice as much as the monoscopic service.

Accordingly, the terrestrial DMB receiving apparatus 100 according to an embodiment of the present invention does not multiplex and transmit an additional video for a stereoscopic service together with the reference image, but transmits the terrestrial DMB receiving apparatus 101 in advance by using another method. Store in non-volatile storage such as memory. Then, the terrestrial DMB receiving apparatus 101 may provide a stereoscopic service to the user by processing the reference video transmitted in real time from the terrestrial DMB transmitting apparatus 101 and the additional video stored in advance.

According to an embodiment of the present invention, there are various methods for the terrestrial DMB receiving apparatus 101 to obtain additional video from the terrestrial DMB transmitting apparatus 100 in real time as follows.

(Iii) a method of downloading an additional image in the form of a file to the terrestrial DMB receiving apparatus 101 using a multimedia object transfer (MOT) protocol;

(Ii) a method of downloading an additional image in a file form through a high-speed wired Internet and transferring the additional image to a terrestrial DMB receiving apparatus 101 in a portable storage device;

(Iii) When the terrestrial DMB receiving apparatus 101 supports the portable Internet, a method of downloading an additional video in the form of a file through the portable internet in advance.

(Iii) In the case of content that is repeatedly transmitted for a predetermined period of time, such as an advertisement, the terrestrial DMB transmitting apparatus 100 transmits a reference image alternately between a left image and a right image, and the terrestrial DMB receiving apparatus 101 transmits alternately. And storing the left image and the right image in a nonvolatile storage device, and then processing the stored images together and displaying them stereoscopically the next time the same content is broadcast. That is, when the left image is transmitted in real time as a reference image, the right image stored in advance in the terrestrial DMB receiving apparatus 101 is used as an additional image, and when the right image is transmitted in real time as the reference image, the terrestrial DMB receiving apparatus 101 is used. How to use as an additional video stored in advance. According to the method (i), when the left image or the right image is not stored in the terrestrial DMB receiving apparatus 101 in advance, the left image or the right image first transmitted from the terrestrial DMB transmitting apparatus 100 is displayed in a monoscopic manner. . In the case of the (iii) method, an additional data rate for transmitting additional video is not required, but may be applied only to repetitive content.

According to an embodiment of the present invention, a non-real time stereoscopic service using a method of downloading an additional video to the terrestrial DMB receiving apparatus 101 in advance using a MOT protocol for a stereoscopic video service may be provided. Hereinafter, such a service will be referred to as a "terrestrial DMB non-real-time MOT / stream mode stereoscopic video service".

According to another embodiment of the present invention, a non-real time stereoscopic service using a method of downloading an additional image to the terrestrial DMB receiving apparatus 101 in advance using a MOT protocol for a stereoscopic BIFS data service may be provided. Hereinafter, such a service will be referred to as a "terrestrial DMB non-real-time MOT / stream mode video linked stereoscopic data service".

In addition, according to another embodiment of the present invention, in the case of repetitive content, a non-real time stereoscopic video service capable of providing a stereoscopic video service without transmitting additional video may be provided. Hereinafter, such a service will be referred to as a "terrestrial DMB non-real-time repeating content stereoscopic video service".

The terrestrial DMB non-real time stereoscopic service according to an embodiment of the present invention may be spatially or temporally mixed with a conventional monoscopic service. In more detail, in the stereoscopic video service, "temporal mixing" means that the monoscopic video service section is followed by the stereoscopic video service section, and then the monoscopic video service section is provided.

In the stereoscopic BIFS data service, 'spatial mixing' means displaying only some images of text, graphics, and images overlaid using BIFS on a stereoscopic video as a stereoscopic still image. 'Is a section in which only monoscopic BIFS data is served for each broadcast time, followed by a section in which stereoscopic BIFS data is served, and then back to a section in which only monoscopic BIFS data is served. Means that.

In the case of non-real time stereoscopic video services, frame level synchronization between the reference video and the additional video is required. In the case of a non-real time stereoscopic video service according to an embodiment of the present invention, the length of the duration of the stereoscopic video depends on the characteristics of the additional video file stored in the nonvolatile storage device. That is, if the number of frames of the additional video is smaller than the number of frames of the reference video, only the last frame of the additional video is displayed stereoscopically. If the additional video is stored in a compressed form and the first frame is not an Instantaneous Decoding Refresh (IDR) picture, the first frame of the additional video is displayed stereoscopically from the first IDR frame of the additional video if it cannot be decoded.

Requirements of the terrestrial DMB non-real-time stereoscopic service according to an embodiment of the present invention are as follows.

Terrestrial DMB Non-Real Time Stereoscopic Service Requirements

1. General Requirements

Terrestrial DMB non-real-time stereoscopic services are based on the terrestrial digital multimedia broadcasting (DMB) transmission and reception matching standard.

In the terrestrial DMB non-real time stereoscopic service, the additional video is multiplexed with the reference video so that the additional video is not transmitted / received in real time to the terrestrial DMB receiving device 101 in the same subchannel, and the additional video is a nonvolatile device mounted in the terrestrial DMB receiving device 101. Obtained from storage.

In addition, the terrestrial DMB non-real time stereoscopic service according to an embodiment of the present invention is guaranteed to be compatible with a conventional terrestrial DMB receiving apparatus. In this case, the conventional terrestrial DMB receiving apparatus may additionally support a terrestrial DMB receiving apparatus providing a monoscopic service or a real-time stereoscopic data service based on the "Digital Multimedia Broadcasting (DMB) Video Linked Stereoscopic Data Service" standard. Terrestrial DMB receiver.

2. Service Requirements

(1) Reception performance

The terrestrial DMB receiving apparatus 101 complies with the reception performance requirements defined in the "terrestrial digital multimedia broadcasting (DMB) video transmission and reception matching" standard.

(2) service

In the case of a stereoscopic video service, the terrestrial DMB receiving apparatus 101 provides video in a stereoscopic manner. And, in the case of a stereoscopic video linked data service, the terrestrial DMB receiving apparatus 101 provides some or all of the images, graphics, or images provided through the BIFS data service in a stereoscopic manner.

(3) type

The terrestrial DMB receiving apparatus 101 supports a video format and ancillary data format defined in the “terrestrial digital multimedia broadcasting (DMB) video transmission / reception matching” standard. The terrestrial DMB receiving apparatus 101 has a parallax barrier method or a lenticular lens method. Likewise, the optimized format for the display method using only data corresponding to 1/2 of the horizontal resolution of the image can be additionally supported.

(4) compatibility

When the stereoscopic service is provided, the conventional monoscopic terrestrial DMB receiving apparatus can reproduce monoscopically without deterioration of image quality. The terrestrial DMB receiving apparatus 101 may receive and reproduce a conventional monoscopic service. In addition, the terrestrial DMB non-real time stereoscopic service according to an embodiment of the present invention should ensure maximum interoperability with a conventional terrestrial DMB receiving apparatus.

3. Transmission, Multiplexing and Signaling of Stereoscopic Video

The terrestrial DMB receiving apparatus 101 follows the transmission mechanism and service transmission and multiplexing methods defined in the "terrestrial digital multimedia broadcasting (DMB) video transmission and reception matching" standard and the "digital multimedia broadcasting (DMB) video linked stereoscopic data service". The following additional provisions apply:

(1) stereoscopic object type

The object type (ObjectTypeIndication) of the stereoscopic video follows the video type and auxiliary data type defined in the "terrestrial digital multimedia broadcasting (DMB) video transmission and reception matching" standard and "digital multimedia broadcasting (DMB) video linked stereoscopic data service". . In one example, the ObjectTypeIndication of the reference video and the supplementary video is Visual ISO / IEC 14496-10 (0x21) defined in the "terrestrial digital multimedia broadcasting (DMB) video transmission and reception matching" standard. In addition, ObjectTypeIndication of the reference image and the additional image conforms to the digital multimedia broadcasting (DMB) video linked stereoscopic data service "standard.

The compression encoding scheme for the additional image is the same as the compression encoding scheme for the reference image, and the ObjectTypeIndication of the additional image is also the same as the ObjectTypeIndication of the reference image. However, in the digital multimedia broadcasting (DMB) video linked stereoscopic data service "standard, the ObjectTypeIndication of the additional image may be different from the ObjectTypeIndication of the reference image.

(2) stereoscopic service signaling

According to an embodiment of the present invention, in order to maximize interoperability with a conventional terrestrial DMB receiving apparatus, signaling for a non-real-time stereoscopic service is put into a PMT which is one of program specific information (PSI) of the MPEG-2 TS layer. May be limited.

The stereoscopic service may be provided in a stereoscopic-only or temporal mixed form with a conventional monoscopic service. To this end, according to an embodiment of the present invention, a stereoscopic service descriptor (StereoscopicService_descriptor: SS_descriptor) may be further defined in the PMT to signal a non-real time stereoscopic service.

SS_descriptor is included in the descriptor loop immediately following program_info_length in PMT and can provide the following information. SS_descriptor is a compatible extension of SDS_descriptor defined in the "Digital Multimedia Broadcasting (DMB) Video Linked Stereoscopic Data Service" standard, and uses the same descriptor_tag.

(Iii) Classification of monoscopic service section and stereoscopic service section

(Ii) Types of Stereoscopic Services

(Iii) Configuration format of stereoscopic data

(Iii) Information on whether the reference image is the left image or the right image

(Iii) In case of non-real-time MOT / stream mode stereoscopic video service or non-real-time repeating content stereoscopic video service, left and right video synchronization start position information

(Iii) Additional video file name for non real-time MOT / stream mode stereoscopic video service

(Iii) In the case of non-real time repeating content stereoscopic video service, information for forming an additional video file name. This information may also be information for constructing a file name to store the reference video as an additional video to be used when the content is repeated next time.

(V) the time limit for storing files to be stored in flash memory

(Iii) recommended values for the minimum amount of flash memory space required to store files in flash memory.

(Iii) File name of additional image files in case of non real-time MOT / stream mode video linked stereoscopic data service

According to an embodiment of the present invention, the syntax of SS_descriptor is shown in Table 2 below.

StereoMono_serviceFlag: Use '1' for stereoscopic service and '0' for conventional monoscopic terrestrial DMB service. The terrestrial DMB receiving apparatus 101 for stereoscopic service may automatically turn on / off the stereoscopic display according to the value of StereoMono_serviceFlag.

ServiceType: A type of stereoscopic service as shown in Table 3 below. However, 'ServiceType = 111' is a value for future syntax expansion.

CompositionType: Represents a composition type of stereoscopic data received as shown in Table 4 below. However, when ServiceType is 010, it may be set to 'CompositionType = 001'.

LR_first: Use '1' if the reference image is the left image and '0' if the reference image is the right image. At this time, the reference video is video data transmitted in real time in the multiplexed stream for the terrestrial DMB service.

NRT_marker: Indicate the starting position for synchronization of left and right images as shown in Table 5 below.

ContetNameLength: Represents the length of ContentName in bytes.

ContetName: Represents information for forming a video file name according to the following rules.

In the case of terrestrial DMB non-real-time MOT / stream mode stereoscopic service, ContetName is designated as a file name including an additional video ES stored in the flash memory of the terrestrial DMB receiving apparatus 101.

In the case of terrestrial DMB non-real-time repeating content stereoscopic video service, ContetName may be used to designate a file including an additional video ES stored in the flash memory of the terrestrial DMB receiving apparatus 101. In addition, the reference video ES may be utilized when storing the reference video ES as a file in a flash memory of the terrestrial DMB receiving apparatus 101. When reading the additional video ES from the flash memory of the terrestrial DMB receiving apparatus 101, the result obtained by combining the ContentNameString with the prefix "L_" if the additional video is a left image and "R_" if it is a right image is a file name to be read. Even when the reference video ES is stored in the flash memory of the terrestrial DMB receiving apparatus 101, the result obtained by combining the URL with the prefix “L_” if the reference video is a left image and “R_” if it is a right image is a file name to be stored.

In order to uniquely distinguish files stored in the same flash memory space, ContentNameString may be set to a unique name such as CRID.

ExpireDate: For terrestrial DMB non-real-time repeating content stereoscopic video service, the terrestrial DMB transmitter 100 recommends a preservation period for the ES to be stored as a file in flash memory. The actual value represents the last day of the retention period. For example, the unit is 2 days, and may be displayed as a cumulative number of days from January 1. If it is less than today's cumulative date, ExpireDate is the cumulative number of days since January 1st of next year. And, if the value of ExpireDate is "0", it means that the deadline is unknown.

FileSize: In the case of terrestrial DMB non-real time repeating content stereoscopic video service, it is a required minimum memory capacity recommended by the terrestrial DMB transmitting apparatus 100 for an ES to be stored as a file in the flash memory of the terrestrial DMB receiving apparatus 101. For example, the unit may be 1 Mbyte and may be changed according to the characteristics of the device. If the value of FileSize is '0', it means that there is no information on the required capacity. Up to 255 MBytes can be specified.

SS_image_count: In the case of terrestrial DMB non-real-time MOT / stream mode video-linked stereoscopic data service, this indicates the number of reference images.

SS_image_PID: In the case of terrestrial DMB non-real-time MOT / stream mode video-linked stereoscopic data service, this indicates a PID of a TS packet carrying a reference image.

ImageNameLength: Represents the length of the ImageName in bytes.

ImageName: Terrestrial DMB Non-real-time MOT / Stream Mode For video-linked stereoscopic data service, specifies the name of an additional image file stored in flash memory.

(3) MPEG-4 OD structure for non-real time stereoscopic service

The MPEG-4 OD structure for the non-real time stereoscopic service defined in the present invention may be the same as that of the conventional 2D video and / or 2D BIFS service. That is, the MPEG-4 OD structure may be set as if serving only conventional 2D video and / or 2D BIFS using only reference video and / or reference image.

(4) File name for additional video

The terrestrial DMB receiving apparatus 101 may determine a name of a file required for a non-real time stereoscopic service through the following procedure.

(Iii) Terrestrial DMB For non-real-time MOT / stream mode stereoscopic services, the ContentName in SS_descriptor is the file name containing the additional video ES to be read from flash memory.

(Ii) In the case of terrestrial DMB non-real-time MOT / stream mode video-linked stereoscopic data service, a PID of a TS packet carrying each reference image to be used for 3D BIFS service and an additional image file name corresponding to the PID are paired in SS_descriptor. By displaying, the additional image file name to be read from the flash memory of the terrestrial DMB receiving apparatus 101 is informed.

(Iii) Terrestrial DMB Non-Real-Time Repetitive Content For stereoscopic video services, the ContentName in SS_descriptor forms part of the required file name.

(5) File format for additional video

The file format of the additional video may be ISO / IEC 23000-9 DMB Application Format (DMB-AF), and the file format of the additional image may be JPEG, PNG, or MNG, which is the same format as the reference image.

The DMB-AF may directly include the MPEG-2 TS or store the ES for each media as a separate stream. The DMB-AF file used in the present invention does not include any media ES other than the supplementary video ES (ie, audio ES or other video ES).

(6) Delivery of storage period and size information of additional video file

It is necessary for the terrestrial DMB receiving apparatus 100 to inform the terrestrial DMB receiving apparatus 101 of information about a file storage period and a file size of the additional video. The file storage period of the additional image means a period during which the terrestrial DMB receiving apparatus 101 should store the corresponding file in the flash memory, and the file size is downloaded by the terrestrial DMB receiving apparatus 101 from the terrestrial DMB transmitting apparatus 100. The amount of flash memory to be secured when storing the data. The file storage period and size of the additional video may be helpful when the terrestrial DMB receiving apparatus 101 manages the flash memory.

For example, in the case of the terrestrial DMB non-real-time MOT / stream mode stereoscopic service, the file storage period and the file size of the additional video may be designated by Expiration among the BodySize and MOT header extension parameters of the MOT header core, respectively.

In the case of the terrestrial DMB non-real-time repeating content stereoscopic video service, the file storage period and the file size of the additional video are transmitted by ExpireDate and FileSize in the SS_descriptor, respectively. ExpireDate and FileSize in the SS_descriptor are actually used when storing the reference video ES delivered in real time in the flash memory of the terrestrial DMB receiving apparatus 101. However, ExpireDate and FileSize in SS_descriptor are not used when reading the additional video ES of the terrestrial DMB receiving apparatus 101 from the flash memory.

(7) Synchronization of left and right images in non-real time stereoscopic video service

In the stereoscopic service, left and right image synchronization means inputting a left image and a right image corresponding thereto simultaneously to a stereoscopic display. In the non-real time stereoscopic video service, the reference video is transmitted in real time, but since the additional video must be read from the flash memory of the terrestrial DMB receiving apparatus 101, a synchronization mechanism of left and right images is required.

A. First frame position signaling of stereoscopic video

The first frame position of the stereoscopic video may be signaled by the NRT_Marker value in the SS_descriptor. The NRT_Marker is reference information necessary for forming the first frame of the left and right images in pairs. Accordingly, the terrestrial DMB receiving apparatus 101 that is powered on or switched channel after the transmission location of the signaling information is stored in the flash memory even if the terrestrial DMB receiving apparatus 101 is receiving a stream corresponding to the reference video of the stereoscopic content. Since it is impossible to know which part of the video file to read and match the left and right image pairs, the stereoscopic content is inevitably displayed. Therefore, the left and right images must be synchronized from the first frame.

N. Synchronization of left and right images instead of the first frame of stereoscopic video

The terrestrial DMB receiving apparatus 101 may store a composition time stamp (CTS) of the first access unit (AU) of the reference video as an offset value for the CTS value of the additional video. The terrestrial DMB receiving apparatus 101 may read the CTS value together when reading the AU (or PU) of the additional video. In the case of the first AU, since the CTS of the additional video is set to 0, it may be set to the CTS of the additional video AU by adding the stored offset value. Since the AU of the reference video and the AU of the additional video are data to be displayed at the same time, the pair of left and right images can be found using the two CTS values. Ideally, two CTS values of a pair of left and right images should be identical, but may be slightly different for some reason. Accordingly, the terrestrial DMB receiving apparatus 101 according to an embodiment of the present invention determines a pair of left and right images when a difference between two CTS values is less than or equal to a predetermined threshold.

4. MOT Carousel for MOT / Stream Mode Non-Real-Time Stereoscopic Services

(1) Overview

The additional video files for the non-real time stereoscopic service are repeatedly transmitted through the packet mode subchannel as the MOT carousel by the MOT directory mode before the reference video is broadcast in real time. The subchannel through which additional video files are transmitted is called a "additional video file channel".

The packet mode service that is responsible for transmitting the additional video file may be designated as a secondary service component for the terrestrial DMB video service to which the reference video is transmitted in real time within the same ensemble through which the reference video is transmitted.

An application for transmitting the additional video file may be signaled by FIG 0/13. The User Application Type for the additional video file transfer application is defined in ETSI TS 101 756. The additional video files are transmitted as MOT objects respectively in the additional video file channel, and the MOT directory object carries a list of MOT objects. MOT parameters to be applied to MOT objects individually are transmitted in MOT header information, which is a separate item in the MOT directory. The MOT header information consists of a MOT header core and a MOT header extension.

(2) MOT header core

The MOT header core for individual objects used in the present invention is defined in ETSI EN 301 234, and the following restrictions may apply.

ContentType-If the additional video file is a video, the content type of the additional video file is set to video (000100) as described in ETSI TS 101 756. If the additional video file is an image, the content type of the additional video file is image (000010). Is set.

ContentSubType-The terrestrial DMB receiving apparatus 101 ignores this value.

(3) MOT header extension parameters

The MOT header extension parameters used in one embodiment of the present invention are shown in Table 6 below.

CAReplacementObject 0x24 MOT No No Once

Expiration-The deadline for preserving files in the flash memory of the terrestrial DMB receiving apparatus 101. When not provided by the terrestrial DMB transmitting apparatus 101, the terrestrial DMB receiving apparatus 101 may determine a retention period according to its own flash memory management policy.

ContentName-Additional video file name. When the terrestrial DMB receiving apparatus 101 forms a pair of left and right images, this file name is used.

(4) MOT directory extension parameter

According to one embodiment of the present invention, MOT parameters for the entire carousel are shown in Table 7 below. In other words, only DefaultExpiration is used.

Hereinafter, a process in which the terrestrial DMB receiving apparatus 101 performs a non-real-time MOT / stream mode stereoscopic video service, a non-real-time MOT / stream mode video linked stereoscopic data service, and a non-real-time repeating content stereoscopic video service Let's explain.

2 is a diagram illustrating a content access process for a non-real-time MOT / stream mode stereoscopic video service according to an embodiment of the present invention.

At this time, the reference video is transmitted in real time to the terrestrial DMB receiving apparatus 101 in the stream mode through the MPEG-2 TS, and the additional video is a MOT carousel (MoT) according to the motion object transfer (MOT) protocol before transmission of the reference video. The carousel may be repeatedly transmitted to the terrestrial DMB receiving apparatus 101 for a predetermined time and stored in a nonvolatile memory.

In step ①, the terrestrial DMB receiving apparatus 101 may analyze a program association table (PAT) having a PID of 0x0000 in the MPEG-2 TS.

In step ②, the terrestrial DMB receiving apparatus 101 extracts the PMT corresponding to the program selected by the user from the PAT contents, and then reads the PID of the PMT.

In step (3), the terrestrial DMB receiving apparatus 101 reads descriptors corresponding to a program selected by the user among the contents of the PMT. If there is a stereoscopic service descriptor SS_descriptor among the descriptors, the terrestrial DMB receiving apparatus 101 analyzes the information defined in SS_descriptor. At this time, the terrestrial DMB receiving apparatus 101 confirms that the ServiceType of SS_descriptor is a non real-time MOT / stream mode stereoscopic video service. The terrestrial DMB receiving apparatus 101 designates the ContentName of the SS_descriptor as a file name to read the additional video ES. The terrestrial DMB receiving apparatus 101 also reads the NRT_marker in the SS_descriptor and synchronizes the first frame of the left and right images. In this case, NRT_marker means a marker indicating a start position for synchronization between the reference video and the additional video. The left and right images mean a reference video and an additional video.

In step ④, the terrestrial DMB receiving apparatus 101 analyzes an initial object descriptor (IOD_descriptor) among descriptors corresponding to a program selected by a user among PMT contents, and then a scene descriptor stream (BIFS stream) and an object descriptor stream (OD stream). Parse each element stream descriptor (ESD) associated with. In addition, the terrestrial DMB receiving apparatus 101 identifies the ES_ID from the analyzed ESD information, and then finds a sink layer descriptor SL_descriptor having the same ES_ID value in the Descriptor Loop.

In step ⑤, the terrestrial DMB receiving apparatus 101 analyzes the PID and the StreamType immediately above the SL_descriptor identified in step ④, and then finds TS packets including the BIFS stream and the OD stream, respectively, from the TS.

In step ⑥, the terrestrial DMB receiving apparatus 101 reads the audio OD and the video OD from the OD stream using the OD_IDs of the audio object and the video object included in the BIFS stream.

In step ⑦, the terrestrial DMB receiving apparatus 101 analyzes the ESD corresponding to each media (audio or video) stream in the OD. That is, the terrestrial DMB receiving apparatus 101 identifies the audio ES_ID and the video ES_ID. At this time, the video ES_ID is the reference video ES_ID.

In step ⑧, the terrestrial DMB receiving apparatus 101 identifies the PID corresponding to the ES_ID identified in step ⑦, and then finds TS packets including audio and video streams from the TS, respectively.

In step ⑨, the terrestrial DMB receiving apparatus 101 may extract the audio ES and the reference video ES from the TS packet through the TS packet parser, the PES packet parser, and the SL packet parser, and transmit the extracted audio ES and the reference video ES to the audio decoder and the video decoder, respectively.

In step ,, the terrestrial DMB receiving apparatus 101 reads a file containing the additional video ES from the flash memory of the terrestrial DMB receiving apparatus 101 using ContentName, which is a file name for reading the additional video ES designated in step ③.

In step ,, the terrestrial DMB receiving apparatus 101 extracts the additional video ES from the file read in step 하여 and delivers it to the video decoder. The terrestrial DMB receiving apparatus 101 may display the stereoscopic video by synchronizing the left and right images from the time when the stereoscopic video starts, as designated by NRT_marker in step ③.

3 is a diagram illustrating a content access procedure for a non-real-time MOT / stream mode video linked stereoscopic data service according to an embodiment of the present invention.

At this time, the reference image is transmitted in real time to the terrestrial DMB receiving apparatus 101 in the stream mode through the MPEG-2 TS, and the additional image is transmitted by the MOT carousel according to the Motion Object Transfer (MOT) protocol before the transmission of the reference image. It is repeatedly transmitted to the terrestrial DMB receiving apparatus 101 for a predetermined time and stored in the nonvolatile memory.

In step ①, the terrestrial DMB receiving apparatus 101 analyzes a PAT having a PID of 0x0000 in the MPEG-2 TS.

In step ②, the terrestrial DMB receiving apparatus 101 may read the PID of the PMT corresponding to the program selected by the user among the contents of the PAT.

In step (3), the terrestrial DMB receiving apparatus 101 reads descriptors corresponding to a program selected by the user among the contents of the PMT. If SS_descriptor exists among them, the terrestrial DMB receiving apparatus 101 analyzes the information defined in SS_descriptor. At this time, the terrestrial DMB receiving apparatus 101 confirms that the ServiceType of the SS_descriptor is a non real-time MOT / stream mode video linked stereoscopic data service.

In step ④, the terrestrial DMB receiving apparatus 101 analyzes an initial object descriptor (IOD_descriptor) among descriptors corresponding to a program selected by a user among PMT contents, and then a scene descriptor stream (BIFS stream) and an object descriptor stream (OD stream). Analyze each ESD associated with At this time, since the video-linked data service exists, the terrestrial DMB receiving apparatus 101 analyzes ESDs corresponding to four streams, such as a basic BIFS stream, a basic OD stream, an additional BIFS stream, and an additional OD stream. Also, the terrestrial DMB receiving apparatus 101 identifies an ES_ID from each ESD information and then finds an SL_descriptor having the same ES_ID value in the Descriptor Loop.

In step ⑤, the terrestrial DMB receiving apparatus 101 analyzes the PID and StreamType immediately above the SL_descriptor identified in step ④, and then TS packets including the basic / additional BIFS streams and the basic / additional OD streams from the TS, respectively. Find them.

In step ⑥, the terrestrial DMB receiving apparatus 101 reads the audio OD and the video OD from the basic OD stream using the OD_IDs of the audio object and the video object included in the basic BIFS stream. In addition, the terrestrial DMB receiving apparatus 101 reads the JPEG OD from the additional OD stream using the OD_ID of the JPEG image object included in the additional BIFS stream.

In step ⑦, the terrestrial DMB receiving apparatus 101 analyzes the ESD corresponding to each media (audio or video) stream in the OD. At this time, the terrestrial DMB receiving apparatus 101 identifies the audio ES_ID, the video ES_ID, and the JPEG image ES_ID. At this time, the JPEG image is a reference image.

In step ⑧, the terrestrial DMB receiving apparatus 101 identifies the PID corresponding to the ES_ID identified in step ⑦, and then finds TS packets including the audio stream, the video stream, and the JPEG image from the TS. If the found PID is the same value as one of the SS_image_PIDs in the SS_descriptor, the terrestrial DMB receiving apparatus 101 stores the following ImageName as a file name to read the additional image.

In step ⑨, the terrestrial DMB receiving apparatus 101 extracts an audio ES, a video ES, and a JPEG file from a TS packet through a TS packet parser, a PES packet parser, and an SL packet parser, respectively, to an audio decoder, a video decoder, and a JPEG decoder. To pass.

In step ,, the terrestrial DMB receiving apparatus 101 performs the following simultaneously with the process of step ⑨. In detail, the terrestrial DMB receiving apparatus 101 reads an additional image JPEG file from the flash memory using the file name stored in step ⑦ and delivers it to the JPEG decoder.

4 is a diagram illustrating a content access process for a non-real time repetitive content stereoscopic video service according to an embodiment of the present invention.

At this time, the reference video is content repeatedly transmitted for a preset period, and the additional video is content in which the reference video is stored in the terrestrial DMB receiving apparatus 101.

In step ①, the terrestrial DMB receiving apparatus 101 analyzes a PAT having a PID of 0x0000 in the MPEG-2 TS.

In step ②, the terrestrial DMB receiving apparatus 101 reads the PID of the PMT corresponding to the program selected by the user among the contents of the PAT.

In step ③, the terrestrial DMB receiving apparatus 101 reads descriptors corresponding to a program selected by the user from the contents of the PMT. If there is SS_descriptor, the terrestrial DMB receiving apparatus 101 analyzes the information defined in SS_descriptor. At this time, the terrestrial DMB receiving apparatus 101 confirms that the ServiceType of SS_descriptor is a non-real time repeating content stereoscopic video service. The terrestrial DMB receiving apparatus 101 configures a "file name to read an additional video" and a "file name to store a reference video" from ContentName in the SS_descriptor and stores them for later use. In addition, the terrestrial DMB receiving apparatus 101 reads and stores ExpireDate and FileSize in the SS_descriptor. The terrestrial DMB receiving apparatus 101 reads the NRT_marker in the SS_descriptor and synchronizes the first frame of the left and right images corresponding to the reference video and the additional video.

In step ④, the terrestrial DMB receiving apparatus 101 analyzes an initial object descriptor (IOD_descriptor) among descriptors corresponding to a program selected by a user among PMT contents, and then a scene descriptor stream (BIFS stream) and an object descriptor stream (OD stream). Analyze each ESD associated with Also, the terrestrial DMB receiving apparatus 101 identifies an ES_ID from each ESD information and then finds an SL_descriptor having the same ES_ID value in the Descriptor Loop.

In step ⑤, the terrestrial DMB receiving apparatus 101 analyzes the PID and the StreamType immediately above the SL_descriptor identified in step ④, and then finds TS packets including the BIFS stream and the OD stream, respectively, from the TS.

In step ⑥, the terrestrial DMB receiving apparatus 101 reads the audio OD and the video OD from the OD stream using the OD_IDs of the audio object and the video object included in the BIFS stream.

In step ⑦, the terrestrial DMB receiving apparatus 101 analyzes the ESD corresponding to each media (audio or video) stream in the OD. In addition, the terrestrial DMB receiving apparatus 101 identifies the audio ES_ID and the video ES_ID. At this time, the video ES_ID is the reference video ES_ID.

In step (8), the terrestrial DMB receiving apparatus 101 identifies the PID corresponding to the ES_ID identified in step ⑦ and finds TS packets including audio and video streams from the TS, respectively.

In step 9, the terrestrial DMB receiving apparatus 101 sequentially passes the TS packet parser, the PES packet parser, and the SL packet parser, extracts the audio ES and the reference video ES from the TS packet, and delivers them to the audio decoder and the video decoder, respectively.

In step ⑩, the terrestrial DMB receiving apparatus 101 reads the file containing the additional video ES from the flash memory if the file having the “file name to read the additional video” stored in step ③ is in the flash memory. If the file having the "file name to read the additional video" does not exist in the flash memory, the terrestrial DMB receiving apparatus 101 displays the reference video monoscopically.

In step ,, the terrestrial DMB receiving apparatus 101 extracts the additional video ES from the file read in step 하여 and delivers it to the video decoder. In step ③, the NRT_marker specifies that the left and right images are synchronized and displayed stereoscopically from the time when the stereoscopic video starts.

In step ,, at the same time as step 과정, At this time, the terrestrial DMB receiving apparatus 101 can check the resources necessary for storing in advance by using the FIleSize stored in step ③, and can manage the retention period of the file after saving the file using ExpireDate. If a file of that name already exists in the flash memory, the file storage process is skipped.

In step ,, the terrestrial DMB receiving apparatus 101 checks whether the file having the “file name to store the reference video” stored in step ③ exists in the flash memory. The video ES obtained in the step is stored in the flash memory as a file of "file name to store the reference video".

5 is a diagram illustrating a basic format and an optional format of a stereoscopic video according to an embodiment of the present invention.

Stereoscopic video consists of one of two formats: This format is used as an input video format of the encoder of the terrestrial DMB transmitting apparatus 100 and at the same time as an output video format of the decoder of the terrestrial DMB receiving apparatus 101.

The following basic formats and optional formats are compatible with conventional terrestrial DMB monoscopic video services and video-linked monoscopic data services. That is, the conventional terrestrial DMB receiving apparatus receives and reproduces only reference image data necessary for monoscopic expression in real time among data available in such a format. In the basic format and the optional format, the reference video may be provided in the same form, but the additional video may be configured in another form and provided to the terrestrial DMB receiving apparatus 101. In other words, in the optional format, the horizontal resolution of the additional video is 1/2 of the reference video.

The terrestrial DMB receiving apparatus 101 according to an embodiment of the present invention is a device for providing a stereoscopic service of terrestrial DMB and may support both a basic format and an optional format of stereoscopic video. According to the basic format, the stereoscopic image includes a left image 501 and a right image 502 of the same size corresponding to left and right binocular views. One of the left image 501 and the right image 502 is a reference image, and the other means an additional image. In addition, according to the optional format, the stereoscopic image may include a left image 503 and a right image 504 representing half resolution by subsampling the left image 503 on the horizontal axis. In this case, the shape of the left image 503 and the right image 504 may be changed.

6 is a diagram illustrating a process of playing a stereoscopic video according to an embodiment of the present invention.

The terrestrial DMB receiving apparatus 101 according to an embodiment of the present invention may support an autostereoscopic 3D display method. In this case, the autostereoscopic 3D display method may include a parallax barrier method or a lenticular lens method.

Referring to FIG. 6, the case where the resolution of the stereoscopic display of the terrestrial DMB receiving apparatus 101 is QVGA (320x260) and VGA (660x480) is illustrated. In FIG. 6, the left image 601 and the right image 602 are basic formats, and the right image 603 represents an optional format.

As shown in FIG. 4, in the case of QVGA (320x260), the left image 604 and the right image 605 are displayed after being converted into a stereoscopic image of a vertical line interlace method. In this case, the reference image is the left image 604. The same applies to VGA (640x480).

In detail, in the QVGA-class stereoscopic image reproduction, when the format of the reference image 601 is a basic format, the reference image 601 is a reference image 604 whose horizontal resolution is reduced to 1/2 through 1/2 subsampling. ) Into the wildly scanned format 606. In addition, when the format of the additional image 602 is a basic format (320x240 pixels in this example), the additional image 602 is an additional image 604 whose horizontal resolution is reduced to 1/2 through 1/2 subsampling. It is transformed into a wildly scanned format 606. If the format of the additional image 603 is an optional format (160 x 240 pixels in this example), the additional image 603 is converted to the wildly scanned format 606 without reducing the horizontal resolution.

In addition, in QVGA-class stereoscopic video reproduction, when the reference video 607 and the additional video 608 are the basic formats, both the reference video 607 and the additional video 608 are upsampled twice in the vertical direction, and then vigorously. Converted to scan format 609. In this case, when the format of the additional video 603 is an optional format, the additional video 603 is upsampled twice in the horizontal and vertical directions and then converted into the wildly scanned format 609.

7 is a diagram illustrating an example of performing a terrestrial DMB non-real-time repeating content stereoscopic video service according to an embodiment of the present invention.

FIG. 7 illustrates a service for content that is repeatedly transmitted for a certain period of time such as 1 month, 3 months, and 6 months as an advertisement. The terrestrial DMB transmitting apparatus 100 alternately transmits the left image 702 and the right image 703 as a reference video through a specific frame 701. For example, as shown in FIG. 7, when the advertisement is first broadcast, the left image 702 is transmitted as the reference video, and when the same advertisement is broadcast the second time, the right image 704 is transmitted as the reference video. Thirdly, the left image 702 is transmitted as a reference video.

When the terrestrial DMB receiving apparatus 101 receives the reference video, it is checked whether the additional video corresponding to the reference video exists in the flash memory 704. If there is an additional video corresponding to the reference video, the terrestrial DMB receiving apparatus 101 may configure a left and right image pair through the reference video and the additional video, and then display the stereoscopic video. If there is no additional video corresponding to the reference video, the terrestrial DMB receiving apparatus 101 may display only the reference video monoscopically. As a result, the terrestrial DMB receiving apparatus 101 checks whether the reference video is stored in the flash memory along with this process, and if there is no reference video, the terrestrial DMB receiving apparatus 101 may use the same to repeat the next time content.

The methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

100: terrestrial DMB receiving apparatus 101: terrestrial DMB receiving apparatus

Claims (16)

The method for performing stereoscopic service performed by the broadcast reception device may include:
Extracting a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in a transport stream (TS);
Analyzing descriptor information included in the program map table;
Extracting, from the program map table, reference video included in the transport stream based on a descriptor corresponding to the program selected by the user;
Extracting additional video stored in the broadcast receiving apparatus by using the analyzed descriptor information; And
Synchronizing and displaying the extracted reference video and additional video using the analyzed descriptor information
Lt; / RTI >
The reference video is transmitted in real time to the broadcasting device through a stream mode,
The additional video is transmitted to the broadcast receiving apparatus for a predetermined time by a MOT carousel according to a motion object transfer (MOT) protocol before transmission of the reference video and stored in a memory. The method of claim 1,
Analyzing the descriptor information,
Analyzing a service type defining a type of stereoscopic service;
Analyzing a ContentName defining a file name from which the additional video is to be extracted; And
Analyzing a marker NRT_marker indicating a start position for synchronization between the reference video and the additional video;
Stereoscopic service performing method comprising a. The method of claim 1,
Extracting the reference video,
Analyzing an initial object descriptor (IOD) among descriptors corresponding to the program selected by the user in the program map table;
Analyzing an elementary stream descriptor (ESD) associated with a scene descriptor stream (BIFS stream) and an object descriptor stream (OD stream);
Extracting a base identifier from the analyzed elementary stream descriptor and searching for a sink layer descriptor (SL_descriptor) having the same value as the extracted base identifier;
Retrieving a transport stream (TS) packet including a scene descriptor stream and an object descriptor stream from the transport stream using a packet ID and a stream type located directly above the sink layer descriptor;
Retrieving an elementary stream identifier (ES_ID) of a reference video by using an object identifier of a video object included in the scene descriptor stream; And
Extracting a transport stream packet containing the reference video from the transport stream using the elementary stream identifier of the reference video
Stereoscopic service performing method comprising a. delete The method of claim 1,
Synchronizing and displaying the extracted reference video and the additional video,
Stereoscopic service characterized by signaling the first frame position of the stereoscopic video using a marker (NRT_marker) indicating the start position for synchronization between the reference video and the additional video of the information defined in the stereoscopic service descriptor (SS_descriptor) How to do it. The method of claim 5,
Synchronizing and displaying the extracted reference video and the additional video,
And synchronizing using a time stamp of an access unit (AU) of the reference video, a time stamp of an access unit of the additional video, and a program clock reference (PCR) value. The method for performing a stereoscopic service performed by a broadcast receiving device is
Extracting a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in a transport stream (TS);
Analyzing descriptor information included in the program map table;
Extracting a reference image included in the transport stream based on a descriptor corresponding to the program selected by the user from the program map table;
Extracting an additional image stored in the broadcast receiving apparatus in advance by using the analyzed descriptor information; And
Synchronizing and displaying the extracted reference image and the additional image
Lt; / RTI >
The reference image is transmitted in real time to the broadcasting device through a stream mode,
The additional image is transmitted to the broadcast receiving device for a predetermined time by a MOT carousel according to a motion object transfer (MOT) protocol before the reference image is transmitted and stored in a memory. The method of claim 7, wherein
Analyzing the descriptor information,
Analyzing a service type defining a type of stereoscopic service;
Analyzing an image name that defines a file name from which the additional image is to be extracted; And
Analyzing a stereoscopic service image identifier (SS_image_PID) for defining the image name as a file name from which the additional image is to be extracted;
Stereoscopic service performing method comprising a. The method of claim 7, wherein
Extracting the reference image,
Analyzing an initial object descriptor (IOD) among descriptors corresponding to the program selected by the user in the program map table;
Parsing an elementary stream descriptor (ESD) associated with a scene descriptor stream (BIFS stream) and an object descriptor stream (OD stream), wherein the scene descriptor stream includes a base BIFS stream and an additional BIFS stream, the object descriptor stream OD stream and additional OD stream;
Extracting a base identifier from the analyzed elementary stream descriptor and searching for a sink layer descriptor (SL_descriptor) having the same value as the extracted base identifier;
Retrieving a transport stream (TS) packet including a scene descriptor stream and an object descriptor stream from the transport stream using a packet ID and a stream type located directly above the sink layer descriptor;
Retrieving an elementary stream identifier (ES_ID) of a reference image from the additional OD stream by using an object identifier of an image object included in the additional BIFS stream; And
Extracting a transport stream packet including the reference image from the transport stream using the elementary stream identifier of the reference image
Stereoscopic service performing method comprising a. delete The method for performing stereoscopic service performed by the broadcast reception device may include:
Extracting a program map table (PMT) corresponding to a program selected by a user from a program association table (PAT) included in a transport stream (TS); Includes content to be transmitted and received;
Analyzing descriptor information included in the program map table;
Extracting, from the program map table, reference video included in the transport stream based on a descriptor corresponding to the program selected by the user;
Determining whether an additional video corresponding to the reference video is stored in the broadcast receiving device;
If the additional video is stored in the broadcast receiving device, displaying stereoscopic video using the reference video and the additional video; and
If the additional video is not stored in the broadcast receiving device, displaying the reference video;
Stereoscopic service performing method comprising a. 12. The method of claim 11,
Analyzing the descriptor information,
Analyzing a service type defining a type of stereoscopic service;
Analyzing a content name defining a file name for reading the additional video and a file name for storing the reference video;
Analyzing a marker (NRT_marker) indicating a start position for synchronization between the reference video and the additional video; And
Analyzing a file size and an expiration date for a file to store the reference video
Stereoscopic service performing method comprising a. 12. The method of claim 11,
The displaying of the stereoscopic video may include:
If the reference video is a left image, extracting an additional video that is a right image from the broadcast receiving device and displaying a stereoscopic video using the left image and the right image; And
If the reference video is a right image, extracting an additional video that is a left image from the broadcast receiving device, and displaying a stereoscopic video using the right image and the left image
Stereoscopic service performing method comprising a. The method of claim 13,
The displaying of the reference video may include:
If the reference video is a left image and an additional video of a right image corresponding to the reference video is not stored in the broadcast receiving apparatus, storing the reference video as a left image in the broadcast receiving apparatus; And
Storing the reference video as the right image in the broadcast receiving apparatus when the reference video is the right image and the additional video of the left image corresponding to the reference video is not stored in the broadcast receiving apparatus.
Stereoscopic service performing method comprising a. 12. The method of claim 11,
The displaying of the stereoscopic video may include:
Stereoscopic service characterized by signaling the first frame position of the stereoscopic video using a marker (NRT_marker) indicating the start position for synchronization between the reference video and the additional video of the information defined in the stereoscopic service descriptor (SS_descriptor) How to do it. 16. The method of claim 15,
The displaying of the stereoscopic video may include:
And synchronizing the stereoscopic video by using a time stamp of an access unit (AU) of the reference video and a time stamp and PCR value of an access unit of the additional video.

Images