JP2008500790A - Apparatus and method for transmitting / receiving 3D stereoscopic digital broadcast using 3D stereoscopic video additional data - Google Patents

Abstract

  The present invention provides a transmission / reception apparatus and method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data. The present invention is different from the conventional method of supporting only the 3D stereoscopic digital broadcasting system using the video of another viewpoint, and adding the 3D stereoscopic video such as video of another viewpoint, disparity information, and depth information. By defining and processing data as an additional stream synchronized with the two-dimensional video stream, it is possible to have compatibility with the two-dimensional digital broadcasting system. The present invention relates to a transmission device for 3D stereoscopic digital broadcast using 3D stereoscopic video additional data, a video acquisition means, an audio data acquisition means, an encoding means, a program specification information (PSI) generation means, a packetization Means, transport stream (TS) generation means, multiplexing means, and modulation means.

Description

  The present invention relates to a transmission / reception apparatus and method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, and more specifically, supports only a 3D stereoscopic digital broadcasting system using video from another viewpoint. Unlike conventional methods, 3D stereoscopic video additional data such as video from another viewpoint, disparity information (Disparity Information), and depth information (Depth Information) are synchronized with the 2D video stream (Transport Stream). 3D stereoscopic digital broadcast transmission / reception device using 3D stereoscopic video additional data, which can be compatible with a 2D digital broadcasting system by defining and processing as an additional stream, and the same Regarding the method.

  Digital broadcasts using MPEG (Motion Picture Experts Group) (hereinafter referred to as “MPEG”) technology can transmit high-quality programs over the same bandwidth as conventional analog broadcasts. It can also be transmitted on one channel. In addition, digital broadcasting can provide various application services such as data broadcasting and interactive broadcasting. As described above, in order to provide a plurality of programs and various application services on one transmission channel, the MPEG-2 transport stream (TS: Transport Stream) generated from each service provider is multiplexed on one channel. Must be able to

  In conventional analog broadcasting, when transmitting and receiving stereoscopic video, there is no problem because the order of transmitting videos takes an alternating and orderly form, but in digital broadcasting, video information in the transport format (Transport Format), Additional information for audio information, program guide, and the like is multiplexed in a complicated manner, and videos are arranged in a disorderly manner, so there is a problem in re-separating and outputting them.

  In order to solve such a problem, a packet identifier (PID: Packet Identifier) that can identify each packet of a video signal, an audio signal, and additional information, and a packet that distinguishes left and right video information for stereoscopic video A method of providing an identifier (PID) has been proposed.

  However, the technique proposed for servicing such conventional 3D stereoscopic video content is such that two video streams exist by defining packet identifier (PID) values for left and right video respectively. Therefore, in the conventional two-dimensional system, since this cannot be classified, a problem of lack of compatibility occurs.

  On the other hand, information that can generate a three-dimensional stereoscopic video includes two-viewpoint video, one-viewpoint video and disparity information, or one-viewpoint video and depth information. It refers only to perspective videos.

  The present invention has been made to solve the above-described problem, and its purpose is different from a conventional method that supports only a three-dimensional stereoscopic digital broadcasting system using a video of another viewpoint, and has a different viewpoint. 2D digital broadcasting by defining and processing 3D stereoscopic video additional data such as video, disparity information, and / or depth information as an additional stream synchronized with a 2D video transport stream (TS) An object of the present invention is to provide a transmission / reception apparatus and method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, which can be compatible with a system.

  In order to achieve the above object, a transmission apparatus of the present invention is a video acquisition means for acquiring original video and 3D stereoscopic video additional data in a 3D stereoscopic digital broadcast transmission apparatus using 3D stereoscopic video additional data. Audio data acquisition means for acquiring audio data, encoding means for encoding the original video and 3D stereoscopic video additional data transmitted from the video acquisition means, and audio data transmitted from the audio data acquisition means , Program specification information generating means for generating program specification information (PSI: Program Specific Information) for classifying each information, and each elementary stream (ES: Elementary) encoded by the encoding means. A packetizing means for generating an elementary stream packet (PES: Packetizer Elementary Stream) and receiving each elementary stream packet (PES) from the packetizing means; Transport stream generating means for receiving program specification information (PSI) from the information generating means and generating each transport stream (TS), and each transport stream (TS) transmitted from the transport stream generating means And a modulation means for modulating the multiplexed transport stream (TS).

  Further, the receiving device of the present invention is a receiving device for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, a demodulating means for receiving a modulated transport stream (TS) and demodulating a modulated signal; The transport stream demodulated by the demodulation means is received, the program specification information (PSI) is received from the program specification information analysis means, and the transport stream (TS) is demultiplexed to generate each transport stream (TS). Demultiplexing means, a transport stream (TS_PSI) for program specification information from the demultiplexing means, and analyzing the program specification information (PSI), and analyzing the analyzed program specification information (PSI) The program specification information analyzing means for transmitting to the demultiplexing means, and the demultiplexing Means for receiving each transport stream demultiplexed by the means, analyzing each transport stream and generating elementary stream packets (PES), and each element from the transport stream analyzing means. Depacketizing means for receiving and streaming elementary stream packets (PES) and generating respective elementary streams (ES); and decoding means for receiving and decoding each elementary stream (ES) from the depacketizing means A video synthesizing unit that synthesizes the original video decoded by the decoding unit and the 3D stereoscopic video additional data to generate a 3D stereoscopic video, and a 2D video or a 3D stereoscopic video received from the video synthesizing unit, The above And an outputting means for outputting the audio data received from the code means.

  On the other hand, the transmission method of the present invention is a transmission method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, in which a) an acquisition step of acquiring original video, 3D stereoscopic video additional data, and audio data; b) an encoding step of encoding each of the original video, the 3D stereoscopic video additional data, and the audio data in a form suitable for digital transmission to generate each elementary stream (ES); c) each of the elementary streams A step of packetizing (ES) to generate an elementary stream packet (PES); and d) program specification information (PSI) for segmenting each information such as original video, 3D stereoscopic video additional data, audio data, etc. ) Program specifications that generate An information generation step; e) a step of generating a transport stream using the program specification information (PSI) and the generated elementary stream packets (PES) as respective transport streams (TS); A transport step (TS) that is multiplexed into one transport stream (TS), and g) a modulation step that modulates and transmits the transport stream (TS). .

  The receiving method of the present invention is a receiving method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data. A) Demodulating step of receiving a modulated transport stream (TS) and demodulating a modulated signal And b) a demultiplexing step for demultiplexing the transport stream (TS_PSI) for the program specification information (PSI) according to the packet identifier, and c) a program using the transport stream (TS_PSI) for the program specification information A program specification information analyzing step for analyzing the specification information; and d) a demultiplexing step for dividing the transport stream (TS) using the analyzed program specification information and demultiplexing the transport stream (TS). And e) each of the demultiplexed transpo An elementary stream packet generation step for analyzing the stream and generating an elementary stream packet (PES); and f) de-packetizing each of the generated elementary stream packets (PES) to generate each elementary stream (ES). An elementary stream generating step to be generated; g) a decoding step for decoding each of the depacketized elementary streams (ES); and h) combining the decoded original video with the 3D stereoscopic video additional data to generate 3 A 3D stereoscopic video generating step for generating a 3D stereoscopic video; and i) an output step for outputting 2D video or 3D stereoscopic video and audio data according to a user's selection.

  The above objects, features and advantages will become more apparent through the following detailed description in conjunction with the accompanying drawings. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing an embodiment of a transmission device for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

  As shown in the figure, a transmission apparatus for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention includes a video acquisition unit 110, an audio acquisition unit 120, an encoding unit 130, and a program specification information generation unit 140. , A packetization unit 150, a transport stream (TS) generation unit 160, a multiplexing unit 170, and a modulation unit 180.

  The video acquisition unit 110 acquires an original video and 3D stereoscopic video additional data. The audio acquisition unit 120 acquires audio data. The encoding unit 130 receives the original video and the 3D stereoscopic video additional data acquired by the video acquisition unit 110, receives the audio data acquired by the audio acquisition unit 120, and encodes it in a form suitable for digital transmission. To do.

  The program specification information generation unit 140 generates program specification information (PSI) that classifies each piece of information. The packetizing unit 150 receives each elementary stream (ES) encoded by the encoding unit 130 and packetizes it to generate each elementary stream packet (PES). The transport stream (TS) generation unit 160 receives each elementary stream packet (PES) from the packetization unit 150, receives program specification information (PSI) from the program specification information generation unit 140, and The transport stream (TS) is generated. The multiplexing unit 170 receives each transport stream (TS) from the transport stream generation unit 160 and multiplexes it into one transport stream (TS). The modulation unit 180 modulates the transport stream (TS) multiplexed by the multiplexing unit 170.

  The video acquisition unit 110 acquires one or more of one viewpoint video for generating an original video and another viewpoint video for generating 3D stereoscopic video additional data, disparity information, and depth information.

  Here, the video of one viewpoint that generates the original video acquired through the video acquisition unit 110 is a reference video that can be compared with the video of another viewpoint, and the video through the video acquisition unit 110. The video of another viewpoint that generates the 3D stereoscopic video additional data acquired in this way is a video of one different viewpoint having a different viewpoint from the original video, or a multi-view video having a plurality of different viewpoints.

  The disparity information for generating the three-dimensional stereoscopic video additional data is obtained from different viewpoints when two videos obtained from different viewpoints from a multi-view video or a one-view video are projected into one, It is distance information between two points representing the same position, and depth information is perspective information that can be acquired and grasped from a video of a different viewpoint for the same object at a predetermined distance from a video of one viewpoint.

  The encoding unit 130 includes a first MPEG-2 encoder 131, an arbitrary encoder 132, and a second MPEG-2 encoder 133. The first MPEG-2 encoder 131 receives the original video of the reference viewpoint from the video acquisition unit 110 and encodes it into MPEG-2, which is the current broadcast standard. The arbitrary encoder 132 receives the 3D stereoscopic video additional data from the video acquisition unit 110 and encodes it efficiently. The second MPEG-2 encoder 133 receives audio data from the audio acquisition unit 120 and encodes it into MPEG-2, which is the current broadcast standard.

  The program specification information generation unit 140 generates program specification information (PSI) that separates each piece of information, such as original video, 3D stereoscopic video additional data, and audio data. At this time, the program specification information generation unit 140 is a program map table (PMT) packet that is divided into respective transport streams (TS) for compatibility with the two-dimensional digital broadcasting system and the three-dimensional stereoscopic digital broadcasting system. In the identifier (PID) information, the stream type (stream_type) defined for conventional digital broadcast video and audio is used as it is, and the stream type (stream_type) for the 3D stereoscopic video additional data is set to “reserved” or “ A function that is newly defined as a value defined in “user individual” is performed.

  The packetizing unit 150 includes a first packetizer 151, a second packetizer 152, and a third packetizer 153. The first packetizer 151 receives an elementary stream (ES_Ori) for the original video from the encoding unit 130 and packetizes it, and generates an elementary stream packet (PES_Ori) for the original video. The second packetizer 152 receives and packetizes the elementary stream (ES_3D) for the 3D stereoscopic video additional data from the encoding unit 130 and generates an elementary stream packet (PES_3D) for the 3D stereoscopic video additional data. The third packetizer 153 receives the elementary stream for the audio data from the encoding unit 130 and packetizes it, and generates an elementary stream packet (PES_Au) for the audio data.

  At this time, when there is an input field newly input in association with the 3D stereoscopic video additional data, the packetizing unit 150 includes the header portion of the elementary stream packet (PES_3D) for the 3D stereoscopic video additional data. In order to discriminate videos of different viewpoints, disparity information, depth information, and the like, a function of further defining an input field for the 3D stereoscopic video additional data type is performed.

  The transport stream generator 160 includes a first transport stream generator 161, a second transport stream generator 162, a third transport stream generator 163, and a fourth transport stream generator 164. The first transport stream generator 161 receives an elementary stream packet (PES_Ori) for the original video from the packetizer 150 and generates a transport stream (TS_Ori) for the original video.

  The second transport stream generator 162 receives an elementary stream packet (PES_3D) for 3D stereoscopic video additional data from the packetizer 150 and generates a TS packet (TS_3D) for 3D stereoscopic video additional data. . The third transport stream generator 163 receives an elementary stream packet (PES_Au) for audio data from the packetizing unit 150 and generates a TS packet (TS_Au) for audio data. The fourth transport stream generator 164 receives the program specification information (PSI) from the program specification information generation unit 140 and generates a TS packet (TS_PSI) for the program specification information.

  The multiplexing unit 170 performs a function of inserting a program clock reference (PCR) into the transport stream (TS_Ori) for the original video in order to detect the system time in the final process of multiplexing.

  FIG. 2 is a structural diagram illustrating an embodiment relating to a configuration diagram of elementary stream packets (PES).

  As shown in the figure, the elementary stream packet (PES) generated by the packetization unit 150 of FIG. 1 is a three-dimensional stereoscopic video according to the configuration of the MPEG-2 system standard (ISO / IEC 13818-1). When there is a newly input field related to the additional data, the definition is made in the header part of the elementary stream packet (PES).

  For example, an input field for a 3D stereoscopic video additional data type (3D_Video_Type) may be further defined in order to segment 3D stereoscopic video additional data such as video of different viewpoints, disparity information, and depth information.

  FIG. 3 is a structural diagram showing an embodiment in which a configuration for dividing information of 3D stereoscopic video is added to the header portion of an elementary stream packet (PES) according to the present invention.

  In the figure, when each elementary stream packet (PES) is generated by the packetization unit 150 of FIG. 1, the elementary stream packet (PES) in the conventional elementary stream packet (PES) header shown in FIG. An embodiment in which an information type capable of classifying the type of 3D stereoscopic video additional data by using the space of the extended field data is added is shown. As shown in FIG. 3, a 2-bit 3D stereoscopic video additional data type (3D_Video_type) can be further defined using elementary stream packet (PES) extension field data.

[Table 1] below shows the types of 3D stereoscopic video additional data.

  When the 3D stereoscopic video additional data type (3D_Video_type) in FIG. 3 is further defined, the 3D stereoscopic video additional data type (3D_Video_type) is added to the elementary stream packet (PES) extension field data as shown in [Table 1]. The value to represent must be predefined. A value of “00” means disparity information, a value of “01” means depth information, a value of “10” means a video of another viewpoint, and a value of “11” means “reserved”.

  On the other hand, the program specification information generation unit 140 is composed of four tables: a program association table (PAT), a program map table (PMT), a network information table (NIT: Network Information Table), and a limited access table (CAT: Conditional Access Table). Generate program specification information (PSI). Here, the program specification information (PSI) is inserted into the payload portion of the TS packet, but is repeatedly transmitted at regular time intervals for initialization in the receiver. The tables are divided by different packet identifier (PID) values, and only one type of table is transmitted in one TS packet.

[Table 2] below shows the definition for the packet identifier (PID) value of the program specification information (PSI).

  In order to identify the transport stream (TS) including program specification information (PSI), as defined in [Table 2] above, the packet identifier (PID) value in the section “0x00010 to 0x1FFE” is arbitrarily set and utilized. The set packet identifier (PID) value and meaning must be predefined in the program map table (PMT). Therefore, not only the setting and description of the packet identifier (PID) of the transport stream TS used in the conventional digital broadcasting in the program map table (PMT) but also the transport stream (TS) for the 3D stereoscopic video additional data. It further defines the setting and description of the packet identifier (PID).

  Here, “0x0000” of the packet identifier PID is a program association table (PAT), “0x0001” is a limited access table (CAT), “0x0002” is a transport stream description table, and “0x0003 to 0x000F” sections are “reserved”. , “0x00010-0x1FFE” section is an arbitrary packet identifier (PID) that can be arbitrarily set, and “0x1FFF” means a null packet.

  FIG. 4 is a structural diagram showing an embodiment relating to a configuration diagram of a transport stream (TS) having program association table (PAT) information according to the present invention.

  As shown in the figure, a transport stream (TS) having program association table (PAT) information is stored in the program association table (PAT) according to the configuration of the MPEG-2 system standard (ISO / IEC 13818-1). Information relating to a program such as a program number and a packet identifier (PID) indicating what program the transport stream (TS) is configured is defined. That is, it includes a network identifier (network_PID) for each program number (Program_number0, 1, 2,..., I), a packet identifier (program_map_PID) for the program map table, and the like.

  For example, the 3D stereoscopic video additional data has one program number and always has a packet identifier (program_map_PID) for one program map table.

  FIG. 5 is a structural diagram showing an embodiment relating to a configuration diagram of a transport stream (TS) having program map table (PMT) information according to the present invention.

  As shown in the figure, a transport stream (TS) having program map table (PMT) information follows the configuration of the MPEG-2 system standard (ISO / IEC 13818-1), and the program structure table (PMT) It includes the contents for the elementary stream (ES) included in one program and the packet identifier (PID). That is, it includes information such as the stream type (stream_type) of each information for the program, the packet identifier (elementary_PID) of the transport stream for the component, the elementary stream information length (ES_info_length), and the descriptor (discriptor).

  For example, when three-dimensional content exists, original video, three-dimensional stereoscopic video additional data, and audio data are required. Therefore, in order to distinguish each information, a packet identifier (elementary_PID) for each component and a stream for each information Information such as type (stream_type) is included.

  The packet identifier (elementary_PID) for the component represents the packet identifier (PID) value of the TS packet including the program component, and the stream type (stream_type) represents the packet identifier (PID) value of the packet identifier (elementary_PID) for the component. Represents the type of program component contained in the packet it has.

[Table 3] below is an allocation table for the currently standardized stream type (stream_type).

  In order to distinguish the stream type (stream_type), as defined in [Table 3] above, MPEG-2 video is defined as “0x02” and MPEG-2 audio is defined as “0x04”. However, since the stream type (stream_type) for the 3D stereoscopic video additional data is not defined, when the 3D stereoscopic video additional data is defined as “0x02” like the 2D video, two video streams are included in one program. As a result, an error occurs in the conventional two-dimensional digital receiver.

  Therefore, a 3D stereoscopic video additional data stream is newly defined as one of the values reserved in the current standard or defined for individual users.

  FIG. 6 is a structural diagram showing an embodiment relating to the structure of a TS packet according to the present invention.

  As shown in the figure, each elementary stream packet (PES) is generated as a TS packet having a fixed length of 188 bytes according to the configuration of the MPEG-2 system standard (ISO / IEC 13818-1). It is divided into two parts, a TS packet header and a TS packet payload. The TS packet header includes a synchronization byte and a packet identifier (PID) of the TS packet that enables the TS packet to be distinguished, and the TS packet payload includes elementary stream packets (PES_Ori, PES_3D) for each video, It includes data such as elementary stream packets (PES_Au) for audio data and program specification information (PSI).

  Each elementary stream packet (PES_Ori, PES_3D, PES_Au) is generated as a TS packet according to the structure of the transport stream (TS) of the MPEG-2 system standard (ISO / IEC 13818-1) shown in FIG. . Accordingly, the transport stream generation unit 160 of FIG. 1 adds the elementary stream packet (PES_Ori) and the 3D stereoscopic video to the original video with reference to the packet identifier (PID) value defined in the program map table (PMT). An elementary stream packet (PES_3D) for data and an elementary stream packet (PES_Au) for audio data are received, and respective TS packets are generated.

  Each TS packet is multiplexed into one transport stream (TS) by the multiplexing unit 170 of FIG. 1 and modulated by the modulation unit 180 so as to be transmitted.

  At this time, in the last process of the multiplexing unit 170, a program clock reference (PCR) is inserted into the transport stream (TS_Ori) of the original digital video and used for synchronization. The program clock reference (PCR) insertion period follows the MPEG-2 system standard.

  FIG. 7 is a block diagram showing an embodiment of a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data according to the present invention.

  As shown in the figure, a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data according to the present invention includes a demodulator 710, a demultiplexer 720, a program specification information analyzer 730, a transport stream. An analysis unit 740, a depacketization unit 750, a decoding unit 760, a video synthesis unit 770, and an output unit 780 are provided.

  The demodulator 710 receives the modulated transport stream (TS) and demodulates the modulated signal. The demultiplexer 720 receives the demodulated transport stream from the demodulator 710, receives program specification information (PSI) from the program specification information analyzer 730, and receives one multiplexed transport stream TS. Are demultiplexed and divided into respective transport streams (TS). The program specification information analysis unit 730 receives a transport stream (TS_PSI) corresponding to the program specification information from the demultiplexing unit 720, analyzes the program specification information, and transmits it to the demultiplexing unit 720.

  The transport stream analysis unit 740 receives each transport stream demultiplexed by the demultiplexing unit 720, analyzes each transport stream, and generates an elementary stream packet (PES). The depacketization unit 750 receives each elementary stream packet (PES) from the transport stream analysis unit 740 and depackets it to generate each elementary stream (ES). The decoding unit 760 receives and decodes each elementary stream (ES) from the depacketization unit 750. The video synthesis unit 770 receives and synthesizes the original video decoded by the decoding unit 760 and the 3D stereoscopic video additional data, and generates a 3D stereoscopic video. The output unit 780 receives the 2D video or the 3D stereoscopic video from the video synthesis unit 770, outputs the video according to the display type selected by the user, and receives and outputs the audio data from the decoding unit 760.

  The demultiplexer 720 receives the demodulated transport stream from the demodulator 710, first separates the transport stream (TS_PSI) corresponding to the program specification information, and transmits it to the program specification information analyzer 730. The program specification information (packet identifier information) that can classify each information is received from the specification information analysis unit 730, and the transport stream (TS_Ori) for the original video and the transport stream (TS_3D) for the 3D stereoscopic video additional data The audio data is demultiplexed into a transport stream (TS_Au).

  That is, the demultiplexing unit 720 receives the multiplexed transport stream (TS), and the program association table (PAT) having a packet identifier (PID) value “0x0000” in the transport stream (TS) header. The TS packet having information is searched for and transmitted to the program specification information (PSI) analysis unit 730. Thereafter, the program specification information analysis unit 730 receives the program number and the packet specification (Program_map_PID) for the program map table from the program specification information analysis unit 730, and receives the program map table (PMT) information from the transport stream (TS). The TS packet that is included is searched and transmitted to the program specification information analysis unit 730. Thereafter, each elementary stream type (stream_type) and an elementary packet identifier (elementary_PID) from the program specification information analysis unit 730 are received from the program specification information analysis unit 730, and transport streams (TS_Ori, TS_3D, TS_Au) is demultiplexed.

  At this time, since the stream type (stream_type) for the 3D stereoscopic video additional data is newly defined as a value defined as “reserved” or “personal user”, the receiving apparatus is a 2D digital broadcasting system. 3D stereoscopic video additional data is recognized as “reserved” or “user personal”, and only the stream for video and audio is processed. Therefore, compatibility with the conventional two-dimensional digital broadcasting system is ensured, and in the case of the three-dimensional stereoscopic digital broadcasting system, the newly defined stream type (stream_type) is recognized, and video, audio, and three-dimensional stereoscopic video are recognized. Process additional data.

  In addition, the demultiplexing unit 720 is configured to generate a system clock based on a program clock reference (PCR) of a transport stream (TS_Ori) for the original video in order to synchronize the clocks of the transmission apparatus of FIG. 1 and the reception apparatus of FIG. To restore.

  The program specification information analysis unit 730 receives a transport stream (TS_PSI) corresponding to the program specification information from the demultiplexing unit 730 and receives information on the program association table (PAT) and a packet identifier (PID) of the program map table (PMT). ) Analyzing the information, and outputting the program specification information (PSI) that can distinguish each transport stream (TS) from the demultiplexer 720 to the demultiplexer 720.

  That is, the program specification information analysis unit (PSI) receives a TS packet having program association table (PAT) information from the demultiplexing unit 720, analyzes the payload information of the TS packet, and sends it to the demultiplexing unit 720. The TS packet having the program map table (PMT) information is received again from the demultiplexing unit 720, and the payload information of the TS packet is analyzed and transmitted to the demultiplexing unit 720.

  The transport stream analyzer 740 includes a first transport stream analyzer 741, a second transport stream analyzer 742, and a third transport stream analyzer 743. The first transport stream analyzer 741 receives and analyzes the transport stream (TS_Ori) for the original video from the demultiplexing unit 720 and generates an elementary stream packet (PES_Ori) for the original video. The second transport stream analyzer 742 receives and analyzes the transport stream (TS_3D) for the 3D stereoscopic video additional data from the demultiplexer 720, analyzes the transport stream (TS_3D) for the 3D stereoscopic video additional data ( PES_3D) is generated. The third transport stream analyzer 743 receives and analyzes the transport stream (TS_Au) for the audio data from the demultiplexing unit 720, and generates an elementary stream packet (PES_Au) for the audio data.

  The depacketizer 750 includes a first depacketizer 751, a second depacketizer 752, and a third depacketizer 753. The first depacketizer 751 receives the elementary stream packet (PES_Ori) for the original video from the transport stream analysis unit 740 and depackets it to generate an elementary stream (ES_Ori) for the original video. The second depacketizer 752 receives the elementary stream packet (PES_3D) for the 3D stereoscopic video additional data from the transport stream analysis unit 740, depackets it, and converts the elementary stream (ES_Ori) for the 3D stereoscopic video additional data. Generate. The third depacketizer 753 receives an elementary stream packet (PES_Au) for audio data from the transport stream analysis unit 740 and depackets it to generate an elementary stream (ES_Au) for audio data.

  At this time, as shown in [Table 1] above, when there is a newly input field related to the 3D stereoscopic video additional data, the second depacketizer 752 of the depacketizer 750 uses the 3D stereoscopic video additional data. In the header part of the elementary stream packet (PES_3D), a function of analyzing information on a 3D stereoscopic video additional data type such as a video of another viewpoint, disparity information, and depth information and classifying each information is further performed.

  The decoding unit 760 includes a first MPEG-2 decoder 761, an arbitrary decoder 762, and a second MPEG-2 decoder 763. The first MPEG-2 decoder 761 receives an elementary stream (ES_Ori) for the original video from the depacketizer 750 and decodes it to MPEG-2, which is the current broadcast standard. The arbitrary decoder 762 receives the elementary stream (ES_3D) for the 3D stereoscopic video additional data from the depacketizer 750 and efficiently decodes it. The second MPEG-2 decoder 763 receives an elementary stream (ES_Au) for audio data from the depacketizer 750 and decodes it to MPEG-2, which is the current broadcast standard.

  At this time, the decoding unit 760 includes an elementary stream (ES_Ori) for the original video input from the depacketization unit 750, an elementary stream (ES_3D) for 3D stereoscopic video additional data, and an elementary stream for audio data (ES_3D). ES_Au) is synchronized using a program clock reference (PCR).

  The video synthesis unit 770 receives and synchronizes the original video decoded by the decoding unit 760 and the 3D stereoscopic video additional data, generates a 3D stereoscopic video, and then generates 2D of the original video for 2D display. The three-dimensional video (2D) and the three-dimensional stereoscopic video (3D) for three-dimensional display are output to the video display unit 781.

  At this time, the original video for generating the 3D stereoscopic video and the 3D stereoscopic video additional data are the playback time information (PTS: Presentation Time) present in the system clock program clock reference (PCR) and the elementary stream packet (PES). (Stamp) to synchronize.

  Here, the original video of the 2D video is a reference video of 1 viewpoint that can be compared with a video of another viewpoint, and the 3D stereoscopic video additional data of the 3D stereoscopic video is different from the viewpoint of the original video. One different viewpoint video and / or multi-view video having different viewpoints, disparity information, or depth information.

  In addition, the video synthesis unit 770 applies an appropriate 3D stereoscopic video generation algorithm according to the type of 3D stereoscopic video additional data such as video of different viewpoints, disparity information, and / or depth information. Generate a 3D stereoscopic video.

  The output unit 780 includes a video display unit 781 that displays 2D video or 3D stereoscopic video input from the video synthesis unit 770, and an audio data output unit 782 that outputs audio data input from the decoding unit 760. Is provided.

  At this time, the output unit 780 has different output information according to the display type selected by the user. When the user selects the 2D display type, 2D video is output via the video display unit 781. When the user selects the 3D display type, 3D stereoscopic video is output via the video display unit 781.

  FIG. 8 is a flowchart illustrating an embodiment of a transmission method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

  First, in step S810, the video acquisition unit 110 acquires the original video and the 3D stereoscopic video additional data, and in step S820, the audio acquisition unit 120 acquires the audio data.

  Thereafter, in step S840, the encoding unit 130 encodes the original video and the 3D stereoscopic video additional data acquired by the video acquisition unit 110 and the audio data acquired by the audio acquisition unit 120 into a form suitable for digital transmission. Then, each elementary stream ES is generated.

  In step S830, the acquired original video and 3D stereoscopic video additional data are classified. In step S841, the original video is encoded into an MPEG-2 encoder which is the current broadcasting standard, and in step S842, the 3D stereoscopic video additional data is encoded into an arbitrary encoder in order to efficiently encode the respective elementary data. A stream (TS) is generated. In step S843, the audio data acquired by the audio acquisition unit 120 is encoded into an MPEG-2 encoder which is the current broadcast standard, and an elementary stream for the audio data is generated.

  Thereafter, in step S850, the program specification information generation unit 140 generates program specification information (PSI) that divides each piece of information, such as original video, 3D stereoscopic video additional data, and audio data.

  In step S860, the packetizing unit 150 packetizes each elementary stream (ES) generated by encoding and generates an elementary stream packet (PES).

  Thereafter, in step S870, the transport stream generation unit 160 generates the generated program specification information (PSI) and the generated elementary stream packets (PES) as the transport streams (TS).

  Thereafter, in step S880, the multiplexing unit 170 multiplexes each of the generated transport streams (TS) into one transport stream.

  Thereafter, the modulation unit 180 modulates and transmits the multiplexed transport stream (TS).

  FIG. 9 is a flowchart showing an embodiment of a receiving method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

  First, in step S910, the demodulator 710 receives the modulated transport stream (TS) and demodulates the modulated signal.

  Thereafter, in step S920, the demultiplexer 720 first separates the transport stream (TS_PSI) for the program specification information (PSI) according to the packet identifier.

  In step S930, the program specification information analysis unit 730 analyzes the program specification information using the transport stream (TS_PSI) for the program specification information.

  Thereafter, in step S940, the demultiplexing unit 720 classifies the transport stream (TS) using the analyzed program specification information and demultiplexes the transport stream (TS) into each transport stream (TS).

  Thereafter, in step S950, the transport stream analyzing unit 740 analyzes each demultiplexed transport stream to generate an elementary stream packet (PES).

  Thereafter, in step S960, the depacketization unit 750 depackets each generated elementary stream packet (PES) to generate each elementary stream (ES).

  After that, in step S970, the decoding unit 760 decodes each of the depacketized elementary streams (ES).

  In step S971, the first MPEG-2 decoder 761 decodes the elementary stream (ES_Ori) for the original video into MPEG-2, which is the current broadcast standard, and in step S972, an arbitrary decoder 762 performs the process for the 3D stereoscopic video additional data. The elementary stream (ES_3D) is efficiently decoded. In step S973, the second MPEG-2 decoder 763 decodes the elementary stream (ES_Au) for the audio data into MPEG-2, which is the current broadcast standard.

  Thereafter, in step S980, when the video display mode is input from the user and 3D is selected, the video combining unit 770 combines the decoded original video and the 3D stereoscopic video additional data to generate the 3D stereoscopic video. Is generated. Conversely, when 2D is selected, the original video is passed.

  Thereafter, in step S990, the output unit 780 outputs both the two-dimensional video or the three-dimensional stereoscopic video and audio data according to the user's selection.

  Since the detailed operation process of the present invention is the same as the description in FIG. 1 and FIG. 7, the detailed description is omitted here.

  The method of the present invention described above is realized by a program, and can be stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a form that can be read by a computer. Such a process can be easily carried out by a person having ordinary knowledge in the technical field to which the present invention belongs, and thus detailed description thereof is omitted.

  The present invention described above is not limited by the above-described embodiments and the accompanying drawings, and various replacements, modifications, and changes can be made without departing from the technical idea of the present invention. It is obvious to those having ordinary knowledge in the technical field to which the present invention belongs.

  The present invention differs from a conventional method that supports only a 3D digital broadcasting system using a video of another viewpoint, and 2D of additional 3D stereoscopic video additional data such as video of another viewpoint, disparity information, or depth information. By defining and processing as an additional stream synchronized with a three-dimensional video stream (Transport Stream), there is an effect that complete compatibility with a two-dimensional digital broadcasting system can be ensured.

  Therefore, the present invention enables a user having a conventional digital broadcast receiving apparatus to enjoy a 2D video broadcast even when receiving a 3D stereoscopic video-based broadcast content, and receiving a 3D stereoscopic digital broadcast. There is an effect that a user having a device can enjoy broadcasting of a two-dimensional video or a three-dimensional stereoscopic video.

  Furthermore, the present invention has an effect that a three-dimensional stereoscopic video broadcasting apparatus can be easily realized.

It is a block diagram which shows one Embodiment of the transmission apparatus of the three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data based on this invention. It is a structural diagram which shows one Embodiment regarding the block diagram of an elementary stream packet (PES). It is a figure for demonstrating the three-dimensional stereoscopic video type (3D_Video_type) added in order to classify the three-dimensional stereoscopic video additional data based on this invention. It is a structural diagram which shows one Embodiment regarding the block diagram of the transport stream (TS) which has the program association table (PAT: Program Association Table) information which concerns on this invention. It is a structural diagram which shows one Embodiment regarding the block diagram of the transport stream (TS) which has the program map table (PMT: Program Map Table) information which concerns on this invention. It is a block diagram which shows one Embodiment regarding the block diagram of TS packet (Transport Stream Packet) which concerns on this invention. It is a block diagram which shows one Embodiment of the receiver of the three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data based on this invention. 3 is a flowchart illustrating an embodiment of a transmission method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention. 3 is a flowchart illustrating an embodiment of a receiving method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

Claims (23)

In a transmission device for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data,
Video acquisition means for acquiring original video and 3D stereoscopic video additional data;
Audio data acquisition means for acquiring audio data;
Encoding means for encoding the original video and the 3D stereoscopic video additional data transmitted from the video acquisition means, and the audio data transmitted from the audio data acquisition means;
Program specification information generating means for generating program specification information (PSI) for classifying each information;
Packetizing means for receiving and packetizing each elementary stream (ES) encoded by the encoding means, and generating each elementary stream packet (PES);
Transport stream generation that receives each elementary stream packet (PES) from the packetization means, receives program specification information (PSI) from the program specification information generation means, and generates each transport stream (TS) Means,
Multiplexing means for multiplexing each transport stream (TS) transmitted from the transport stream generating means into one transport stream (TS);
A transmission device for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, comprising: modulation means for modulating the multiplexed transport stream (TS). The three-dimensional stereoscopic video additional data is
The three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data according to claim 1, comprising at least one of a group consisting of a three-dimensional video of another viewpoint, parallax information, and depth information. Transmitter. The program specification information generating means is
The 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data according to claim 1, wherein program specification information (PSI) for dividing the original video, the 3D stereoscopic video additional data, and the audio data from each other is generated. Transmitter. The program specification information generating means is
For compatibility between the two-dimensional digital broadcasting system and the three-dimensional stereoscopic digital broadcasting system, the packet identifier (PID) information of the program map table (PMT) divided into the respective transport streams (TS) is used for the conventional digital broadcasting. Stream type (stream_type) defined for video and audio is used, and stream type (stream_type) for 3D stereoscopic video additional data is newly defined as a value defined as "Reserved" or "User personal" The transmission apparatus for 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data according to claim 3. The packetizing means comprises:
When there is an input field newly input in relation to the 3D stereoscopic video additional data, an elementary stream packet (for 3D stereoscopic video additional data ( The 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to claim 1, further comprising a function of additionally defining an input field for the 3D stereoscopic video additional data type in a header portion of PES_3D). Transmitter. In a 3D stereoscopic digital broadcast receiver using 3D stereoscopic video additional data,
Demodulation means for receiving the modulated transport stream (TS) and demodulating the modulated signal;
The transport stream demodulated by the demodulation means is received, the program specification information (PSI) is received from the program specification information analysis means, and the transport stream (TS) is demultiplexed to generate each transport stream (TS). Demultiplexing means,
The program for receiving a transport stream (TS_PSI) for program specification information from the demultiplexing means, analyzing the program specification information (PSI), and transmitting the analyzed program specification information (PSI) to the demultiplexing means Specification information analysis means,
Transport stream analyzing means for receiving each transport stream demultiplexed by the demultiplexing means and analyzing each transport stream to generate elementary stream packets (PES);
Depacketizing means for receiving and depacketizing each elementary stream packet (PES) transmitted from the transport stream analyzing means, and generating each elementary stream (ES);
Decoding means for decoding each elementary stream (ES) transmitted from the depacketizing means;
Video synthesizing means for synthesizing the original video decoded by the decoding means and the 3D stereoscopic video additional data to generate a 3D stereoscopic video;
3D using 3D stereoscopic video additional data, comprising: 2D video or 3D stereoscopic video received from the video synthesizing means; and output means for outputting audio data received from the decoding means. Stereo digital broadcast receiver. The three-dimensional stereoscopic video additional data is
The three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data according to claim 6, comprising any one or more of a group consisting of a three-dimensional video of another viewpoint, parallax information, and depth information. Receiver. The demultiplexing means comprises:
The transport stream (TS_PSI) corresponding to the program specification information is separated from the demodulated transport stream (TS) transmitted from the demodulating means, TS_PSI is transmitted to the program specification information analyzing means, and the program specification information analyzing means respectively Program specification information such as a packet identifier (PID) that can be used to classify information of a video stream, a transport stream (TS_Ori) for original video, a transport stream (TS_3D) for 3D stereoscopic video additional data, and audio data The receiving apparatus for 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data according to claim 6, wherein the receiver stream is demultiplexed into a transport stream (TS_Au). The demultiplexing means comprises:
The program association table (PAT) information is found by checking the packet identifier (PID) value in the header of the demodulated transport stream (TS) transmitted from the demodulating unit to find the TS packet having the program association table (PAT) information. Is transmitted to the program specification information analysis means, receives a program number and a packet identifier (Program_map_PID) for the program map table from the program specification information analysis means, and receives a program map table (PMT) from the transport stream (TS). ) Find out TS packet having information and transmit it to the program specification information analysis means, and each elementary stream type (stream_type) from the program specification information analysis means. And the packet identifier (elementary_PID) is received and demultiplexed into a transport stream (TS_Ori, TS_3D, TS_Au) for each piece of information. A receiver for 3D digital broadcasting. The demultiplexing means comprises:
The three-dimensional system according to claim 8, wherein the system clock is restored based on a program clock reference (PCR) of a transport stream (TS_Ori) for the original video in order to synchronize the clock between the transmission / reception devices. A receiving device for three-dimensional stereoscopic digital broadcasting using stereoscopic video additional data. The program specification information analyzing means is
Receiving a transport stream (TS_PSI) for program specification information from the demultiplexing means, analyzing information of a program association table (PAT) and / or packet identifier (PID) information of a program map table (PMT), and 9. The 3D stereoscopic video addition according to claim 8, wherein program specification information (PSI) capable of distinguishing each transport stream (TS) is transmitted from the demultiplexing means to the demultiplexing means. A receiver for 3D stereoscopic digital broadcasting using data. The program specification information analyzing means is
A TS packet having program association table (PAT) information is received from the demultiplexing means, payload information of the TS packet having program association table (PAT) information is analyzed and transmitted to the demultiplexing means, and the inverse A TS packet having program map table (PMT) information is received from the multiplexing means, and payload information of the TS packet having program map table (PMT) information is analyzed and transmitted to the demultiplexing means. Item 13. A three-dimensional stereoscopic digital broadcast receiver using the three-dimensional stereoscopic video additional data according to Item 9. The depacketizing means comprises:
When there is an input field newly input in relation to the 3D stereoscopic video additional data, the video of another viewpoint, disparity information, depth in the header part of the elementary stream packet (PES_3D) for the 3D stereoscopic video additional data The three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data according to claim 6, further comprising a function of analyzing information for a three-dimensional stereoscopic video additional data type such as information and classifying each information. Receiver. The decoding means comprises:
An elementary stream (ES_Ori) for original video input from the depacketization means, an elementary stream (ES_3D) for 3D stereoscopic video additional data, and an elementary stream (ES_AU) for audio data are program clock reference (PCR). 7. The apparatus for receiving 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data according to claim 6, wherein synchronization is performed using The video synthesizing means is
A 3D stereoscopic video is generated by applying each 3D stereoscopic video generation algorithm according to the type of 3D stereoscopic video additional data such as video of different viewpoints, disparity information, or depth information. A receiving device for three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data according to claim 6. The video synthesizing means is
The original video and the 3D stereoscopic video additional data are synchronized by using a system clock program clock reference (PCR) and playback time information (PTS) in an elementary stream packet (PES). A receiving device for three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data according to claim 6. The output means is
When the display type of the user selection signal is 2D, 2D video is output via the video display unit, and when the display type of the user selection signal is 3D, the 3D stereoscopic video is output to the video display unit. 7. The apparatus for receiving 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data according to claim 6, wherein the 3D stereoscopic video additional data is output. In a transmission method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data,
a) an acquisition step of acquiring original video, 3D stereoscopic video additional data, and audio data;
b) an encoding step of encoding the original video, the 3D stereoscopic video additional data, and the audio data into a form suitable for digital transmission to generate an elementary stream (ES);
c) packetizing each elementary stream (ES) to generate an elementary stream packet (PES);
d) a program specification information generating step for generating program specification information (PSI) for classifying each information such as original video, 3D stereoscopic video additional data, audio data, and the like;
e) generating a transport stream using the program specification information (PSI) and each of the generated elementary stream packets (PES) as a transport stream (TS);
f) a multiplexing step of multiplexing the transport stream (TS) into one transport stream (TS);
g) a modulation step of modulating and transmitting the transport stream (TS); and a transmission method of 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data. The three-dimensional stereoscopic video additional data is
The three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data according to claim 18, comprising at least one of a group consisting of a three-dimensional video of another viewpoint, parallax information, and depth information. How to send In step d)
For compatibility between the two-dimensional digital broadcasting system and the three-dimensional stereoscopic digital broadcasting system, the packet identifier (PID) information of the program map table (PMT) divided into the respective transport streams (TS) is used for the conventional digital broadcasting. The stream type (stream_type) defined for video and audio is used as it is, and the stream type (stream_type) for 3D stereoscopic video additional data is newly set as a value defined for “reserved” or “user individual”. The transmission method of 3D stereoscopic digital broadcasting using the 3D stereoscopic video additional data according to claim 18, wherein the transmission method is defined. In the receiving method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data,
a) a demodulation step of receiving a modulated transport stream (TS) and demodulating the modulated signal;
b) a demultiplexing step of demultiplexing the transport stream (TS_PSI) for the program specification information (PSI) according to the packet identifier;
c) a program specification information analyzing step of analyzing the program specification information using a transport stream (TS_PSI) for the program specification information;
d) a demultiplexing step of dividing the transport stream (TS) using the analyzed program specification information and demultiplexing the transport stream (TS) into each transport stream (TS);
e) an elementary stream packet generating step of analyzing each demultiplexed transport stream to generate an elementary stream packet (PES);
f) Elementary stream generation step of depacketizing each generated elementary stream packet (PES) to generate each elementary stream (ES);
g) a decoding step of decoding each of the depacketized elementary streams (ES);
h) a 3D stereoscopic video generation step of generating a 3D stereoscopic video by combining the decoded original video and the 3D stereoscopic video additional data;
i) reception of 3D stereoscopic digital broadcast using 3D stereoscopic video additional data, comprising: an output step of outputting 2D video or 3D stereoscopic video and audio data according to a user's selection Method. The three-dimensional stereoscopic video additional data is
The reception of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to claim 21, comprising any one or more of a group consisting of video of different viewpoints, disparity information, and depth information. Method. In step c)
The transport stream (TS_PSI) corresponding to the program specification information is received, the information of the program association table (PAT) and / or the packet identifier (PID) information of the program map table (PMT) is analyzed, and each transport stream (TS 23. The method of receiving 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to claim 21, wherein the program specification information (PSI) is generated.

Images