KR20120104498A - Method of providing 3d service linking contents transported at different time in a broadcasting system based on mpeg-2 ts - Google Patents

Abstract

PURPOSE: A three dimensional service providing method is provided to enable users to effectively access multimedia which the users are immersed by extracting the connected media of files stored using a non-real time stream. CONSTITUTION: A terminal extracts additional image signaling information and an additional image from a received non-real time stream(S110). The terminal extracts a reference image signaling information and a reference image from a received real-time stream(S120). The terminal creates stereoscopic content including the reference image and the additional image based on the relationship information(S130). The terminal reproduces the stereoscopic content by synchronizing the images based on time information included in synchronization information. [Reference numerals] (AA) Start; (BB) End; (S110) Additional images and additional image signaling information are extracted by receiving a non-real time stream; (S120) Standard images and standard signaling information are extracted by receiving a real time stream; (S130) Additional image signaling information and the creation of stereoscopic content based on the additional image signaling information

Description

METHOD OF PROVIDING 3D SERVICE LINKING CONTENTS TRANSPORTED AT DIFFERENT TIME IN A BROADCASTING SYSTEM BASED ON MPEG-2 TS}

The present invention relates to a method for providing a 3D service in an MPEG-2 TS based broadcast service environment, and more particularly, to a signaling and synchronization method for interworking a service having a different delivery time.

With the recent development of digital technology, convergence of broadcasting and telecommunications has become active, and the spread of communication convergence media such as IPTV, connected TV, and smart TV has allowed consumers to consume video, music and other entertainment contents. . This is because access to entertainment and information using consumer media has become easy, and consumption of stored content through personal media players has become popular.

ATSC NRT (Advanced Television Systems Committee Non Real Time) is a service that transmits multimedia contents on a non-real time basis through the existing DTV broadcasting channel, and accepts user's requirements rather than a mechanism of unilateral delivery by a conventional content provider. A new form of storage mechanism. NRT uses the characteristics of the existing broadcasting network, which is easily accessible, so that the video can be easily and efficiently delivered.

Currently, NRT service is a technology that accepts the requirement of storing content upon user's request. However, the stored non-real-time content and the existing real-time broadcasting content are distinguished and provide only respective services. When the service is divided into broadcast contents, the relationship between the two contents cannot be known, and synchronization cannot be consumed at the same time.

In order to overcome the above limitations, ATSC is in the process of adding items related to 3D content transmission in which two images are interlocked and scanned in the NRT standard, but the interworking technology of the two technologies has not been specifically presented.

In order to provide a 3D broadcasting service on a non-real time basis, there has been a conventional method of transmitting a base view video in real time and additional video before a broadcast time in non real time, but the conventional technology does not use an IP-based ATSC NRT mechanism. It also does not include a method for signaling a non-real time based 3D broadcast service.

In addition, as another conventional technology, a method for synchronizing stored content with a real-time image through a stereoscopic service descriptor (SS_descriptor) for a non real-time stereoscopic service has been proposed. However, the above scheme is a method of providing a service by transmitting both the base view video and the additional view video in real time, and does not include a service in which the base view video is delivered in real time and the supplementary video is delivered in non-real time.

Korean Patent Publication No. 10-2010-0086440 ("Method for performing non-real-time stereoscopic service and terrestrial digital multimedia broadcasting receiver in terrestrial digital multimedia broadcasting", Korea Electronics and Telecommunications Research Institute, published on July 30, 2010)

The present invention is to solve the above problems, when the user wants to receive the 3D service through the terminal, by interlocking the 2D video received as a real-time broadcast stream and the auxiliary video received and stored as a non-real-time broadcast stream, 3D A broadcast service can be provided. There is a need for association information between a broadcast stream and a stored file, and synchronization information is required for reproduction in synchronization.

Accordingly, the present invention can add association information between the base view video and the additional view video to an existing standard, and a signaling method for constructing a 3D picture and a method for adding time information for synchronizing the two pictures are required.

That is, an object of the present invention for solving the above problems is to provide a stereoscopic broadcast service based on a base view video delivered in real time and 3D additional video delivered in real time through the ATSC NRT technology, the reference video and The present invention provides a signaling method for composing 3D content by combining additional video and a method of providing time information for synchronizing the reference video with the additional video.

According to an embodiment of the present invention, a method for providing a 3D service by interworking contents having different delivery times may include additional video and additional video signaling information, wherein the additional video signaling information includes association information and Extracting the additional video and the additional video signaling information by receiving a non-real-time stream comprising synchronization information; Extracting the reference video and the reference video signaling information by receiving a real time stream including reference video and reference video signaling information, wherein the reference video signaling information includes association information and synchronization information; And generating stereoscopic content including the additional view video and the reference video based on the association information, and synchronizing the additional view video and the reference video of the stereoscopic content based on time information included in the synchronization information. Playing the scoping content.

The method of providing a 3D service by interworking contents having different delivery times according to an embodiment of the present invention is immersed by deriving a linked media of a file stored through a non-real-time stream and a broadcast through an existing real-time stream. Type multimedia can be easily accessed, and can be used as a base technology for services utilizing various storage media.

In addition, a method for providing 3D service by interworking NRT storage content and real-time broadcasting may suggest a direction of developing a linked service technology using various storage media.

1 is a flowchart illustrating a 3D service providing method according to an embodiment of the present invention.
FIG. 2 illustrates that information about a reference image and information about an auxiliary image that can be linked to the reference image are described in delivering a reference image of 3D content to a real-time broadcasting service.
3 illustrates a descriptor representing information for performing synchronization according to an embodiment of the present invention.
4 illustrates a process of performing a linked stereoscopic service in a terminal according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail.

It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

In the following description of the embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present disclosure rather unclear.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

In addition, the components shown in the embodiments of the present invention are shown independently to represent different characteristic functions, which does not mean that each component is composed of separate hardware or software constituent units. That is, each constituent unit is included in each constituent unit for convenience of explanation, and at least two constituent units of the constituent units may be combined to form one constituent unit, or one constituent unit may be divided into a plurality of constituent units to perform a function. The integrated embodiments and separate embodiments of the components are also included within the scope of the present invention, unless they depart from the essence of the present invention.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the relevant art and are to be interpreted in an ideal or overly formal sense unless explicitly defined in the present application Do not.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In order to facilitate the understanding of the present invention, the same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

As described above, the present invention relates to a signaling method and a synchronization method for providing a 3D service in an MPEG-2 TS-based broadcast service environment for interworking with different contents. More specifically, the present invention divides the 3D content into a reference video (main video) and an additional video (auxiliary video), the reference video delivered to the real-time broadcast stream and the additional video stored in the terminal in advance through the non-real-time broadcast stream It relates to a method for providing a 3D service by interworking.

Accordingly, in order to provide a 3D service according to the above-described method, it is necessary to add information about a signaling method and a synchronization method for interlocking and scanning the reference video and the additional video to a stream that delivers a real-time video.

The terminal described in the present invention means a terminal capable of receiving and consuming broadcast content composed of the MPEG-2 TS standard, and means a terminal capable of receiving and storing broadcast content based on the ATSC NRT standard. In addition, the terminal described in the present invention means a terminal capable of playing 3D content.

The reference video (main video) of the 3D content described in the present invention may be configured and transmitted based on the MPEG-2 TS standard, and may further include correlation information and synchronization information with the additional video. The correlation information and synchronization information may be analyzed.

The additional video (secondary video) of the 3D content described in the present invention may be configured and transmitted based on the ATSC NRT standard, and may be stored in the terminal including correlation information and synchronization information with the reference video. The terminal may analyze the stored association information and the synchronization information.

1 is a flowchart illustrating a 3D service providing method according to an embodiment of the present invention.

As shown in FIG. 1, the 3D service providing method according to an embodiment of the present invention first receives the non-real time stream including the additional video and the additional video signaling information to extract the additional video and the additional video signaling information ( S110). Here, the non-real time stream may be configured based on the ATSC NRT (Non Real Time) standard. The additional picture signaling information may include association information indicating a relationship with a reference picture and synchronization information for synchronizing with the reference picture. The correlation information may be used to generate stereoscopic content including a base view video and an additional view video. The extracted additional view video and additional view video signaling information may be stored in the 3D service providing apparatus.

Thereafter, a real time stream including a reference video and signaling information of the reference video is received to extract the reference video and the reference video signaling information (S120). Here, the real time stream may be configured based on the MPEG-2 TS standard. In addition, the reference video signaling information may include association information indicating a relationship with the additional view video and synchronization information for synchronizing with the additional view video.

When the additional image and the reference image are extracted, the stereoscopic content including the additional image and the reference image is generated based on the correlation information, and the additional image of the stereoscopic content is based on the time information included in the synchronization information. And playing the stereoscopic content by synchronizing a reference image (S130) to provide a 3D service to a viewer.

Hereinafter, in constructing a TS stream in order to deliver the 3D content reference video to the terminal, the broadcaster includes the association information and synchronization information with the additional video, and stores the added information based on the transmitted association information. A method of reproducing a 3D screen with reference to an image and synchronizing with an additional image based on the transmitted synchronization information will be described in more detail.

Hereinafter, an embodiment of the present invention will be described based on a broadcast service using MPEG-2 TS and ATSC NRT technology, but a technical field is not necessarily limited to the broadcast service, and a transmission time point of an image constituting 3D content is provided. This is different and can be applied to all fields where association information and synchronization information between images are required.

FIG. 2 is a diagram illustrating a structured stereoscopic service descriptor added to a program map table (PMT).

As described above, the base view video signaling information and the additional view video signaling information may include association information indicating a relationship between the base view video and the additional view video. The configuration diagram of FIG. 2 may include information about a reference image and association information about an auxiliary image that may be linked with the reference image in delivering a reference image of 3D content to a real-time broadcasting service. The information about the reference image may add a descriptor in a program map table (PMT) to transmit the linked image service identification and related information.

Referring to FIG. 2, the PMT according to an embodiment of the present invention may further include a linked stereoscopic service descriptor (Linkage_Stereoscopic_Service_Descriptor) 100 as association information between the base view video and the additional view video. The linked stereoscopic service descriptor 100 may distinguish left and right images of the linked stereoscopic service, may include URL information of a file to be linked, and may include information for configuring a 3D video service. .

The descriptor tag (Descriptor_tag) 101 of FIG. 2 may indicate that the descriptor is a linked stereoscopic service descriptor. The descriptor length (Descriptor_length, 102) may indicate the length of the descriptor.

In addition, the view position index (View_position_index) 103 may indicate whether the video stream including the descriptor is a left image or a right image. There are a plurality of methods for composing a 3D image, such as a service compatibility method and a frame compatibility method. However, in the case of the interlocked service, since the left and right images are separated from each other like the frame compatibility method, only the left and right images can be expressed in the form of flag values. However, in consideration of compatibility with the existing 3D composition method and future expandability, it can be allocated as a spare size.

For example, when the value of the view position index (View_position_index, 103) is '001', this may indicate that the video stream including the corresponding descriptor is the left image, and the video stream included in the linked file may be the right image. . Conversely, when the value of the view position index (View_position_index, 103) is '010', the video stream including the descriptor may be a right image, and the video stream included in the linked file may be a left image.

As described above, when the 3D configuration method of the linked service uses only a form in which the left video and the right video are separated, the linked video becomes the right video when the corresponding stream is the left video. It can be included only in the real-time stream that delivers the video, and other additional videos can be provided without the 3D configuration information.

The dependency flag Dependency_flag 104 of FIG. 2 is a flag for referring to a file to be linked. Since the file to be linked is previously stored in the terminal through the NRT technology, the URL information in which the file is stored is necessary. Since the URL information has a variable length, it indicates the length of the URL name for the file to be linked through the link file length (linkage_file_length, 105), and indicates the length of the file to be linked with the stream through the link file name (linkage_file_name, 106). It can represent a name.

The linkage file type (linkage_file_type) 107 of FIG. 2 means a type of file to be linked with the corresponding stream. There is a stereoscopic video application format (SVAF) as a storage format for providing a stereoscopic service, and the additional video to be used for the 3D service may be configured as an mp4 file type in the SVAF format. In consideration of the variety of file format types for storing additional video in the future, a field capable of classifying a file may be configured.

In the case of the SVAF, video, audio, metadata, and the like are distinguished in units of tracks in the form of an ISO Base media file format. When the format of the stored file format is SVAF, a track ID (track_id) 108 may be used to identify a track including an auxiliary picture.

3 illustrates a descriptor representing information for performing synchronization according to an embodiment of the present invention. As described above, the base view video signaling information and the additional view video signaling information may include synchronization information between the base view video and the additional view video.

Unlike files stored for synchronization of linked services, existing streams do not contain information that can be used to track the progress of a program. Therefore, the decoding time and composition time of the file format can be added to the real-time transport stream for synchronization.

The linkage time descriptor linkage_time_descriptor 200 of FIG. 3 is synchronization information for performing synchronization, and represents the same time information as the stored file. The linkage time descriptor (linkage_time_descriptor) 200 may be added to the PES private data (PES_Private_data, 201) part of the packetized elementary stream (PES) corresponding to the header information of the individual stream in the real-time transport stream.

The CT_DT_flag 202 of FIG. 3 may indicate whether the corresponding stream has only the composition time (Composition_time) 203 information or the decoding time (Decoding_time, 204). For example, when the value of the CT_DT_flag is 1, the corresponding stream may include composition time (203) information. When the value of the CT_DT_flag is 2, the composition time (Composition_time, 203) and decoding time are included. (Decoding_time, 204) information may be included.

The composition time (Composition_time, 203) and the decoding time (Decoding_time, 204) of FIG. 3 are time information showing the corresponding stream on the screen and time information to perform decoding, respectively, and indicate how long the corresponding stream has passed since the start of the program. Can be.

4 illustrates a process of performing a linked stereoscopic service in a terminal according to an embodiment of the present invention.

Depacketization 310 of the current broadcast stream may analyze a program map table (PMT). The linked service starts with the analysis of the linkage stereoscopic service descriptor added to the PMT, and finds a file to be linked among the stored files using the analyzed file name information s301. If there is a file to be linked in the storage space 330, the file may be decoded 340 to prepare for playback. In addition, the analyzed screen configuration information s303 may be transmitted to the renderer 450 to prepare a stereoscopic screen.

The real time broadcast stream including the reference video may be played according to an existing broadcast standard, and additionally, the CT (Composition time) and DT (Decoding time) information (s302) included in the PES may be analyzed for synchronization with the additional video. have. The current playback time can be searched by comparing the analyzed time information with time information of a stored file including an additional image. The stored file may also use an existing file reproducing method, and may play from a time point corresponding to the current real time broadcast stream without playing from the first screen.

The embodiments of the present invention disclosed in the specification and the drawings are provided with specific examples to easily explain the technical contents of the present invention and to help the understanding of the present invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be implemented in addition to the disclosed embodiments.

Claims (1)

Extracting the additional video and the additional video signaling information by receiving a non-real time stream including the additional video and the additional video signaling information, wherein the additional video signaling information includes association information and synchronization information;
Extracting the reference video and the reference video signaling information by receiving a real time stream including reference video and reference video signaling information, wherein the reference video signaling information includes association information and synchronization information; And
Generate stereoscopic content including the additional view video and the reference video based on the correlation information, and synchronize the additional view video and the reference video of the stereoscopic content based on the time information included in the synchronization information. 3D service providing method comprising the step of playing the content.

Images