JP2013026644A - Receiving device, receiving method, and transmitting/receiving method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable the user to view 3D content suitably.SOLUTION: A transmitting device transmits 3D video content containing video data and caption data and depth display position information or parallax information with regard to the caption data, and a receiving device receives the 3D video content, in which the receiving device performs video processing in order to display the received video data and caption data in 3D or 2D mode, and the video processing includes a first video processing which displays the received video data of the 3D video content in 3D mode and displays the received caption data in 3D mode by using the depth display position information or the parallax information. And, if an input signal for switching display modes from 3D to 2D is input from an operation input unit of the receiving device, a second video processing is available for displaying the video data of the received 3D video content in 2D mode and for displaying the received caption data in 2D mode without relying on the depth display position information or the parallax information.

Description

  The technical field relates to a three-dimensional (three-dimensional) video broadcast receiving apparatus, receiving method, and transmitting / receiving method.

  Patent Document 1 has a problem of “providing a digital broadcast receiver capable of actively notifying that a program requested by a user starts on a certain channel” (see Patent Document 1 [0005]). As a means for solving the problem, “a means for extracting program information included in a digital broadcast wave and selecting a notification target program using selection information registered by the user; And a means for interrupting and displaying the screen being displayed "(see Patent Document 1 [0006]).

  Further, Patent Document 2 has an object of “allowing subtitles to be displayed at appropriate positions” (see Patent Document 2 [0011]). D is generated, and at what distance the subtitle based on the subtitle data D is displayed on the decoding side stereoscopic display device from the user, that is, how far the subtitle is from the display screen of the stereoscopic display device Is generated and supplied to the multiplexing unit, and the multiplexing unit adds the caption data D supplied from the caption generation unit and the distance parameter to the encoded image data C supplied from the stereo encoding unit. E is multiplexed based on a predetermined format, and the multiplexed data stream F is transmitted to a decoding system via a predetermined transmission path or medium. In the stereoscopic display device, the subtitles can be displayed at a predetermined distance from the user.The present invention can be applied to a stereo video camera ”(see Patent Document 2 [0027]) and the like. Have been described.

JP2003-9033 JP 2004-274125 A

  However, Patent Document 1 does not disclose the viewing of 3D content. For this reason, there is a problem that the receiver cannot recognize that the program currently received or received in the future is a 3D program.

  Patent Document 2 only discloses simple operations of transmission and reception of “encoded image data C”, “caption data D”, and “distance parameter E”, and other various operations in actual broadcasting and communication. There is a problem that it is insufficient to realize transmission processing and reception processing corresponding to various information and situations.

  In order to solve the above-described problem, according to an embodiment of the present invention, for example, a transmission device transmits 3D video content including video data and depth display position information or parallax information about the caption data and the caption data. A receiving device receives the 3D video content, and the receiving device performs video processing for 3D display or 2D display of the received video data and the caption data. From the first video processing for displaying the video data of the 3D video content in 3D, and displaying the received caption data in 3D using the depth display position information or the parallax information, and the operation input unit of the receiving device, Switching the 3D display to the 2D display When the operation input signal is input, the received video data of the 3D video content is displayed in 2D and received. May be configured such that there is a second video processing for 2D display of the caption data without based on the depth display position information and the disparity information.

  According to the present invention, it is possible for a user to more appropriately view 3D content.

An example of a block diagram showing a system configuration example An example of a block diagram showing a configuration example of the transmission apparatus 1 Example of stream format type assignment Example component descriptor structure Example of component contents and component types that are components of a component descriptor Example of component contents and component types that are components of a component descriptor Example of component contents and component types that are components of a component descriptor Example of component contents and component types that are components of a component descriptor Example of component contents and component types that are components of a component descriptor An example of the structure of a component group descriptor Example of component group type Component group identification example Billing unit identification example Example of 3D program details descriptor structure The figure which shows the example of 3D / 2D classification The figure which shows the example of the system classification of 3D Example service descriptor structure Examples of service type types Example service list descriptor structure An example of a sending operation rule in the component descriptor sending apparatus 1 It is an example of the transmission operation rule in the transmission apparatus 1 of a component group descriptor. An example of a transmission operation rule in the transmission device 1 for a 3D program detail descriptor An example of a transmission operation rule in the service descriptor transmission apparatus 1 An example of a transmission operation rule in the transmission device 1 of the service list descriptor Example of processing for each field of component descriptor in receiving apparatus 4 An example of processing for each field of the component group descriptor in the receiving device 4 Example of processing for each field of 3D program detail descriptor in receiving apparatus 4 Example of processing for each field of service descriptor in receiving apparatus 4 Example of processing for each field of service list descriptor in receiving apparatus 4 Example of configuration diagram of receiving apparatus of the present invention An example of a schematic diagram of an internal functional block diagram of a CPU in the receiving apparatus of the present invention An example of a flowchart of 2D / 3D video display processing based on whether or not the next program is 3D content Example of message display Example of message display Example of message display Example of message display An example of the flowchart of the system controller at the start of the next program Example of message display Example of message display An example of a block diagram showing a system configuration example An example of a block diagram showing a system configuration example Explanatory drawing of an example of 3D playback / output / display processing of 3D content Explanatory drawing of an example of 2D playback / output / display processing of 3D content Explanatory drawing of an example of 3D playback / output / display processing of 3D content Explanatory drawing of an example of 2D playback / output / display processing of 3D content An example of a flowchart of 2D / 3D video display processing based on whether or not the current program is 3D content Example of message display Example of display processing flowchart after user selection Example of message display An example of a flowchart of 2D / 3D video display processing based on whether or not the current program is 3D content Example of message display Example of stream combination during 3D video transmission Example content descriptor structure Example code table for program genre Example code table for program characteristics Example code table for program characteristics An example of transmission data configuration in the subtitle / character super data transmission apparatus 1 An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter Example of subtitle data code An example of subtitle data expansion method Example of code and control for subtitle data Example of code and control for subtitle data Example of code for subtitle data Example of code and control for subtitle data Example of code for subtitle data Example of code for subtitle data Example of code for subtitle data Example of code and control for subtitle data Example of code and control for subtitle data Example of code and control for subtitle data An example of a processing flowchart when displaying caption data according to an embodiment of the present invention Example of 3D display processing of 3D content according to an embodiment of the present invention Example of 3D display processing of 3D content according to an embodiment of the present invention An example of a processing flowchart when displaying caption data according to an embodiment of the present invention An example of a processing flowchart when displaying caption data according to an embodiment of the present invention An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter An example of data transmitted from the transmitter Example of 3D display processing of 3D content according to an embodiment of the present invention Example of 3D display processing of 3D content according to an embodiment of the present invention Example of apparatus configuration according to one embodiment of the present invention Example of 3D display processing of 3D content according to an embodiment of the present invention Example of 3D display processing of 3D content according to an embodiment of the present invention

  Hereinafter, examples (examples) of the preferred embodiments of the present invention will be described. However, the present invention is not limited to this embodiment. The present embodiment mainly describes the receiving apparatus and is suitable for implementation in the receiving apparatus, but does not hinder application to other than the receiving apparatus. Moreover, it is not necessary to employ all the configurations of the embodiment, and can be selected.

<System>
FIG. 1 is a block diagram illustrating a configuration example of a system according to the present embodiment. The case where information is transmitted / received by broadcast and recorded / reproduced is illustrated. However, it is not limited to broadcasting but may be VOD by communication, and is also collectively referred to as distribution.

  1 is a transmission device installed in an information providing station such as a broadcasting station, 2 is a relay device installed in a relay station or a broadcasting satellite, 3 is a public line network connecting a general household and the broadcasting station such as the Internet, and the user's home 4 is a receiving device, and 10 is a reception recording / reproducing unit built in the receiving device 4. The reception recording / reproducing unit 10 can record and reproduce the broadcast information, or reproduce the content from a removable external medium.

  The transmission device 1 transmits the modulated signal radio wave via the relay device 2. As shown in the figure, in addition to transmission by satellite, for example, transmission by cable, transmission by telephone line, transmission by terrestrial broadcasting, transmission via a network such as the Internet via the public network 3, etc. can also be used. As will be described later, the signal radio wave received by the receiving device 4 is demodulated into an information signal and then recorded on a recording medium as necessary. Alternatively, when the data is transmitted via the public line network 3, the data is converted into a format such as a data format (IP packet) conforming to a protocol suitable for the public line network 3 (for example, TCP / IP), and the received data is received. The device 4 decodes the information signal and records it on a recording medium as a signal suitable for recording if necessary. In addition, the user can watch the video and audio indicated by the information signal by connecting the receiving device 4 and a display (not shown) when the receiving device 4 has a built-in display, and connecting the receiving device 4 to a display (not shown). Can do.

<Transmitter>
FIG. 2 is a block diagram illustrating a configuration example of the transmission device 1 in the system of FIG.

  11 is a source generation unit, 12 is an encoding unit that compresses MPEG2 or H.264 and adds program information, 13 is a scramble unit, 14 is a modulation unit, 15 is a transmission antenna, and 16 is management information. Part. Information such as video and audio generated by the source generation unit 11 including a camera and a recording / playback device is compressed by the encoding unit 12 so that it can be transmitted in a smaller occupied band. If necessary, the scrambler 13 performs transmission encryption so that a specific viewer can view. The signal is modulated as a signal suitable for transmission, such as OFDM, TC8PSK, QPSK, and multilevel QAM, by the modulation unit 14, and then transmitted as a radio wave from the transmission antenna 15 toward the relay device 2. At this time, the management information adding unit 16 sets program identification information such as content attributes created by the source generation unit 11 (for example, video and audio encoding information, audio encoding information, program configuration, 3D video In addition, program arrangement information created by the broadcasting station (for example, the configuration of the current program and the next program, the format of the service, the configuration information of the program for one week, etc.) is also added. The program specifying information and the program arrangement information are collectively referred to as program information below.

  In many cases, a plurality of pieces of information are multiplexed in one radio wave by a method such as time division or spread spectrum. Although not shown in FIG. 2 for simplicity, in this case, there are a plurality of systems of the source generation unit 11 and the encoding unit 12, and a multiplex for multiplexing a plurality of pieces of information between the encoding unit 12 and the scramble unit 13. Part (multiplexing part) is placed.

  Similarly, a signal transmitted via the public network 3 is encrypted so that a signal generated by the encoding unit 12 can be viewed by a specific viewer by an encryption unit 17 as necessary. It becomes. After being encoded by the communication path encoding unit 18 so as to be a signal suitable for transmission through the public line network 3, the signal is transmitted from the network I / F (Interface) unit 19 toward the public line network 3.

<3D transmission system>
There are roughly two types of transmission methods for 3D programs transmitted from the transmission apparatus 1. One method is a method in which video for the left eye and right eye is stored in one image by utilizing an existing 2D program broadcasting method. This method is an MPEG2 (Moving Picture Experts Group 2) or H.264 standard as a video compression method. H.264 AVC is used, and its features are compatible with existing broadcasts, can use existing relay infrastructure, and can be received by existing receivers (STB, etc.). Half (vertical or horizontal) 3D video transmission. For example, as shown in FIG. 39A, one image is divided into right and left, and the horizontal width of each of the left-eye video (L) and the right-eye video (R) is about half that of a 2D program, The horizontal width of each of the left-eye video (L) and right-eye video (R) by dividing the top and bottom of the “Side-by-Side” method, which is the same screen size as a 2D program, Is equivalent to 2D programs, the vertical direction is about half the screen size of 2D programs, the “Top-and-Bottom” method, other “Field alternative” methods that use interlace, and each scanning line There are a “Line alternative” method in which left-eye and right-eye images are alternately stored, and a “Left + Depth” method in which two-dimensional (one side) images and depth (distance to the subject) information for each pixel of the images are stored. Since these methods divide one image into a plurality of images and store a plurality of viewpoint images, the encoding method itself is MPEG2 or H.264 which is not originally a multi-view video encoding method. The H.264 AVC (excluding MVC) encoding method can be used as it is, and there is an advantage that 3D program broadcasting can be performed by utilizing the existing 2D program broadcasting method. In addition, for example, when a 2D program can be transmitted with a screen size of 1920 dots in the maximum horizontal direction and 1080 lines in the vertical direction, one piece is required when 3D program broadcasting is performed in the “Side-by-Side” format. The left-eye video (L) and the right-eye video (R) are each stored in a screen size of 960 dots in the horizontal direction and 1080 lines in the vertical direction and transmitted. Similarly, in this case, when a 3D program broadcast is performed by the “Top-and-Bottom” method, one image is divided into upper and lower parts, and the left-eye video (L) and the right-eye video (R) are respectively horizontal. May be transmitted with a screen size of 1920 dots and a vertical size of 540 lines.

As another method, there is a method of transmitting the left-eye video and the right-eye video in separate streams (ES). In this embodiment, this method is hereinafter referred to as “3D2 viewpoint-specific ES transmission”.
As an example of this method, for example, H., which is a multi-view video encoding method. There is a transmission system based on H.264 MVC. The feature is that high-resolution 3D video can be transmitted. When this method is used, there is an effect that high-resolution 3D video can be transmitted. Note that the multi-view video encoding method is a standardized encoding method for encoding multi-view video, and multi-view video can be encoded without dividing one image for each viewpoint. A separate image is encoded for each viewpoint.

  When transmitting 3D video in this manner, for example, the encoded image for the left-eye viewpoint may be used as the main viewpoint image, and the encoded image for the right eye may be transmitted as another viewpoint image. In this way, the main viewpoint image can be compatible with the existing 2D program broadcasting system. For example, H.264 is used as a multi-view video encoding method. When H.264 MVC is used, H.264 is used. For the base substream of H.264 MVC, the main viewpoint image is H.264. H.264 AVC 2D images can be kept compatible, and the main viewpoint image can be displayed as a 2D image.

  Furthermore, in the embodiment of the present invention, the following scheme is also included as another example of the “3D2 viewpoint-specific ES transmission scheme”.

  As another example of the “3D2 viewpoint-specific ES transmission method”, the encoded image for the left eye is encoded as the main viewpoint image in MPEG2, and the encoded image for the right eye is set as another viewpoint image. H.264 AVC is encoded and included in a separate stream. According to this method, since the main viewpoint image becomes MPEG2 compatible and can be displayed as a 2D image, it is possible to maintain compatibility with an existing 2D program broadcasting method in which MPEG2 encoded images are widely used. is there.

  Another example of the “3D2 viewpoint-specific ES transmission method” is that the encoded image for the left eye is encoded with MPEG2 as the main viewpoint image, the encoded image for the right eye is encoded with MPEG2 as the other viewpoint image, and each stream is separate. Include the method. In this method, since the main viewpoint image is compatible with MPEG2 and can be displayed as a 2D image, it is possible to maintain compatibility with an existing 2D program broadcasting method in which encoded images based on MPEG2 are widely used.

  As another example of the “3D2 viewpoint-specific ES transmission method”, an encoded image for the left eye is used as a main viewpoint image, and H.264 AVC or H.264. It is possible to encode with H.264 MVC and encode with MPEG2 the encoded image for the right eye as another viewpoint image.

  Apart from the “3D2 viewpoint-specific ES transmission scheme”, MPEG2 and H.264 which are not originally defined as multi-view video encoding schemes. Even with an encoding method such as H.264 AVC (excluding MVC), 3D transmission is also possible by generating a stream in which left-eye video and right-eye frames are alternately stored.

<Program information>
Program identification information and program arrangement information are referred to as program information.
The program specific information is also called PSI (Program Specific Information), and is information necessary for selecting a required program, and specifies a packet identifier of a TS packet that transmits a PMT (Program Map Table) related to the broadcast program. (Program Association Table), a packet identifier of a TS packet that transmits each encoded signal constituting a broadcast program, and a PMT that specifies a packet identifier of a TS packet that transmits common information among related information of pay broadcasting, a modulation frequency, etc. From four tables, NIT (Network Information Table) for transmitting information relating road information and broadcast programs, and CAT (Conditional Access Table) for specifying packet identifiers of TS packets for transmitting individual information among related information of pay broadcasting. Therefore, it is defined in the MPEG2 system standard. For example, it includes video encoding information, audio encoding information, and program configuration. In the present invention, information indicating whether or not the video is a 3D video is newly included. The PSI is added by the management information adding unit 16.

  Program sequence information, also called SI (Service Information), is a variety of information defined for the convenience of program selection, including MPEG-2 system standard PSI information, program name, broadcast date, program content, etc. There are an EIT (Event Information Table) in which information related to a program is described, an SDT (Service Description Table) in which information related to an organized channel (service) is described, such as an organized channel name and a broadcaster name.

  For example, the management information adding unit 16 includes information indicating the configuration of the currently broadcast program, the program to be broadcast next, the format of the service, and the program configuration information for one week. The program information includes a component descriptor, a component group descriptor, a 3D program detail descriptor, a service descriptor, a service list descriptor, and the like, which are constituent elements of the program information. These descriptors are described in tables such as PMT, EIT [schedule basic / schedule extended / present / following], NIT, and SDT.

  As the usage of the PMT and EIT tables, for example, since only information on programs currently broadcast is described for PMT, information on programs broadcast in the future cannot be confirmed. However, since the transmission cycle from the transmission side is short, the time until the reception is completed is short, and the reliability is high in the sense that the information is not changed because it is information on the currently broadcast program. On the other hand, for EIT [schedule basic / schedule extended], information up to 7 days ahead can be acquired in addition to the currently broadcasted program, but the time until the reception is completed because the transmission cycle from the transmission side is longer than the PMT. There is a demerit such as low reliability in the sense that it requires a long storage area and may be changed due to a future event. As for EIT [following], information on the program of the next broadcast time can be acquired.

  The program specific information PMT uses a table structure defined by ISO / IEC13818-1, and stream_type (stream format type) which is 8-bit information described in the 2nd loop (loop for each ES (Elementary Stream)). Thus, the ES format of the broadcast program can be indicated. In the embodiment of the present invention, the ES format is increased as compared with the prior art. For example, as shown in FIG.

  First, the base-view sub-bitstream (main viewpoint) of a multi-view video encoding (eg H.264 / MVC) stream is defined by the existing ITU-T recommendation H.264 | ISO / IEC 14496-10 video The same 0x1B as the AVC video stream is allocated. Next, a sub-bit stream (other viewpoint) of a multi-view video encoded stream (for example, H.264 MVC) that can be used for a 3D video program is assigned to 0x20.

  Also, the existing ITU-T recommendation for the H.262 (MPEG2) system base-view bitstream (main viewpoint) when using the "3D2 viewpoint-specific ES transmission system" that transmits multiple viewpoints of 3D video in separate streams. H.262 | ISO / IEC 13818-2 Assign 0x02 which is the same as video. Here, the H.262 (MPEG2) base-view bitstream (main viewpoint) when transmitting multiple viewpoints of 3D video in separate streams is only the video of the main viewpoint among the multiple viewpoint videos of 3D video. Is a stream encoded by the H.262 (MPEG2) system.

  Furthermore, a bit stream of another viewpoint of the H.262 (MPEG2) scheme when transmitting a plurality of viewpoints of 3D video in different streams is assigned to 0x21.

  In addition, a bit stream of another viewpoint bit stream of the AVC stream method specified by ITU-T recommendation H.264 | ISO / IEC 14496-10 video when multiple viewpoints of 3D video are transmitted in different streams is assigned to 0x22. .

  In this description, H.262 (MPEG2) in the case of assigning a sub-bit stream of a multi-view video encoded stream that can be used for a 3D video program to 0x20 and transmitting multiple viewpoints of 3D video in separate streams. The bit stream of the other viewpoint of the system is assigned to 0x21, and the AVC stream specified by the ITU-T recommendation H.264 | ISO / IEC 14496-10 video when transmitting the multiple viewpoints of 3D video as separate streams is set to 0x22 Although assigned, it may be assigned to any of 0x23 to 0x7E. Further, the MVC video stream is merely an example, and a video stream other than H.264 / MVC may be used as long as it represents a multi-view video encoded stream that can be used for a 3D video program.

  As described above, when the broadcaster on the transmission apparatus 1 side transmits (broadcasts) the 3D program by allocating the stream_type (stream format type) bit, in the embodiment of the present invention, for example, as shown in FIG. It is possible to transmit in such a stream combination.

  In combination example 1, a base-view sub-bit stream (main viewpoint) (stream format type 0x1B) of a multi-view video encoding (eg, H.264 / MVC) stream is transmitted as a main viewpoint (left-eye) video stream, Sub-viewpoint (for right eye) Another viewpoint sub-bit stream (stream format type 0x20) is transmitted as a multi-view video encoding (eg, H.264 / MVC) stream as a video stream.

  In this case, both the main-viewpoint (left-eye) video stream and the sub-viewpoint (right-eye) video stream use multi-viewpoint video encoding (eg, H.264 / MVC) format streams. The multi-view video encoding (eg, H.264 / MVC) method is a method for transmitting multi-view video in the first place, and can transmit a 3D program most efficiently among the combination examples in FIG. .

  Further, when 3D display (output) of a 3D program, the receiving apparatus processes both the main viewpoint (for left eye) video stream and the sub-viewpoint (for right eye) video stream to reproduce the 3D program. Is possible.

  When the receiving apparatus displays (outputs) a 3D program in 2D, it can display (output) as a 2D program by processing only the main-viewpoint (left-eye) video stream.

  Since the multi-view video encoding method H.264 / MVC base-view sub-bit stream and the existing H.264 / AVC (excluding MVC) video stream are compatible, both are as shown in FIG. By assigning the same stream format type to 0x1B, the following effects are obtained. That is, even if a receiving device that does not have the function of 3D display (output) of a 3D program receives the 3D program of Combination Example 1, the video stream of the existing H.264 / AVC (excluding MVC) is received by the receiving device. As long as it has a function to display (output) (AVC video stream defined by ITU-T recommendation H.264 | ISO / IEC 14496-10 video), the main viewpoint of the program (for the left eye) based on the stream format type This is an effect that the video stream can be recognized as a stream similar to the existing H.264 / AVC (excluding MVC) video stream and displayed (output) as a normal 2D program.

  In addition, since the sub-viewpoint (for the right eye) video stream is assigned a stream format type that has not been used in the past, it is ignored by existing receivers. As a result, it is possible to prevent the substation (for the right eye) video stream from being unintentionally displayed (output) by the broadcasting station in the existing receiving apparatus.

  Therefore, even if the 3D program broadcast of Combination Example 1 is newly started, it is displayed (output) by an existing receiving device having a function of displaying (outputting) an existing H.264 / AVC (excluding MVC) video stream. ) You can avoid the situation that you can not. As a result, it is possible to view even a receiving device that does not support the 3D display (output) function, since the 3D program broadcast was newly started by broadcasting operated by advertising revenue such as CM (commercial message). By limiting the function of the device, it is possible to avoid a decrease in the audience rating, and there is a merit on the broadcasting station side.

  In combination example 2, an H.262 (MPEG2) base-view bit stream (main viewpoint) (stream format type 0x02) when transmitting multiple viewpoints of 3D video as separate streams as the main viewpoint (left-eye) video stream AVC stream (stream format specified by ITU-T recommendation H.264 | ISO / IEC 14496-10 video when transmitting multiple viewpoints of 3D video as separate video streams as sub-viewpoint (right-eye) video streams Type 0x22) is transmitted.

  As in the combination example 1, when 3D display (output) of a 3D program is performed, the receiving apparatus processes both the main viewpoint (left-eye) video stream and the sub-viewpoint (right-eye) video stream to perform 3D When a receiver can display (output) a 3D program in 2D, it can display (output) it as a 2D program by processing only the main-viewpoint (left-eye) video stream. It becomes.

  In addition, the H.262 (MPEG2) base-view bitstream (main viewpoint) when multiple viewpoints of 3D video are transmitted as separate streams is converted into the existing ITU-T recommendation H.262 | ISO / IEC 13818-2 video. The stream is compatible with the stream, and the stream format type of both is assigned to the same 0x1B as shown in Fig. 3 to display (output) the existing ITU-T recommendation H.262 | ISO / IEC 13818-2 video stream If the receiving device has a function to do this, even a receiving device that does not have a 3D display (output) function can display (output) it as a 2D program.

  Further, as in the combination example 1, the sub-viewpoint (for the right eye) video stream is assigned a stream format type that has not been conventionally used, and thus is ignored by existing receiving apparatuses. As a result, it is possible to prevent the substation (for the right eye) video stream from being unintentionally displayed (output) by the broadcasting station in the existing receiving apparatus.

  Receiving devices with a display (output) function for existing ITU-T Recommendation H.262 | ISO / IEC 13818-2 video streams are widely used. Therefore, it is possible to realize the most preferable broadcasting for the broadcasting station.

  Furthermore, the sub-viewpoint (for the right eye) is changed to the AVC stream (stream format type 0x22) defined by the ITU-T recommendation H.264 | ISO / IEC 14496-10 video as the sub-viewpoint (for the right eye). A video stream can be transmitted at a high compression rate.

  That is, according to the combination example 2, it is possible to achieve both the commercial merit of the broadcasting station and the technical merit of high-efficiency transmission.

  In combination example 3, an H.262 (MPEG2) base-view bit stream (main viewpoint) (stream format type 0x02) in the case of transmitting multiple viewpoints of 3D video as separate streams as the main viewpoint (left-eye) video stream And a bit stream (stream format type 0x21) of another viewpoint of the H.262 (MPEG2) system when transmitting a plurality of viewpoints of 3D video as separate streams as a sub-viewpoint (right eye) video stream.

  Also in this case, as in the combination example 2, if the receiving apparatus has a function of displaying (outputting) an existing ITU-T recommendation H.262 | ISO / IEC 13818-2 video stream, a 3D display (output) function It is possible to display (output) as a 2D program even in a receiving apparatus that does not have the.

  In addition to the commercial merits of the broadcast station, which further prevents a decrease in audience rating due to restrictions on the functions of the receiving device, the encoding method of the main viewpoint (left eye) video stream and the sub viewpoint (right eye) video stream is H. By unifying the 262 (MPEG2) system, the hardware configuration of the video decoding function in the receiving apparatus can be simplified.

  Note that, as in combination example 4, as the main viewpoint (left-eye) video stream, a multi-view video encoding (eg, H.264 / MVC) stream base-view sub-bit stream (main viewpoint) (stream format type 0x1B) And a bit stream (stream format type 0x21) of another viewpoint of the H.262 (MPEG2) system when transmitting multiple viewpoints of 3D video as separate streams as a sub-viewpoint (for the right eye) video stream Is also possible.

  47, instead of the base-view sub-bitstream (main viewpoint) (stream format type 0x1B) of the multi-view video coding (eg, H.264 / MVC) stream, the ITU-T recommendation H.264 | Similar effects can also be obtained as an AVC video stream (stream format type 0x1B) defined by ISO / IEC 14496-10 video.

  47, instead of the base view bit stream (main viewpoint) of the H.262 (MPEG2) method when transmitting multiple viewpoints of 3D video in separate streams, the ITU-T recommendation H.262 | ISO The same effect can be obtained with / IEC 13818-2 video stream (stream format type 0x02).

  FIG. 4 shows an example of the structure of a component descriptor (Component Descriptor) which is one piece of program information. The component descriptor indicates the type of a component (element constituting a program. For example, video, audio, character, various data, etc.), and is also used for expressing an elementary stream in a character format. This descriptor is placed in the PMT and / or EIT.

  The meaning of the component descriptor is as follows. In other words, descriptor_tag is an 8-bit field and describes a value that can identify this descriptor as a component descriptor. descriptor_length is an 8-bit field and describes the size of this descriptor. The stream_content (component content) is a 4-bit field and represents a stream type (video, audio, data), and is encoded according to FIG. The component_type (component type) defines the type of component such as an 8-bit field, video, audio, and data, and is encoded according to FIG. component_tag (component tag) is an 8-bit field. The component stream of the service can refer to the description content (FIG. 5) indicated by the component descriptor by this 8-bit field.

  In the program map section, the component tag value given to each stream should be different. The component tag is a label for identifying the component stream, and has the same value as the component tag in the stream identification descriptor (provided that the stream identification descriptor exists in the PMT). The 24-bit field of ISO_639_language_code (language code) identifies the language of the component (speech or data) and the language of the character description contained in this descriptor.

  The language code is represented by a three-letter code defined in ISO 639-2 (22). Each character is encoded in 8 bits according to ISO8859-1 (24) and inserted in the 24-bit field in that order. For example, Japanese is “jpn”, which is a three-letter code of the alphabet, and is encoded as follows. “0110 1010 0111 0000 0110 1110”. text_char (component description) is an 8-bit field. A series of component description fields define the character description of the component stream.

  FIGS. 5A to 5E show examples of stream_content (component content) and component_type (component type) that are components of the component descriptor. The component content 0x01 shown in FIG. 5A represents various video formats of a video stream compressed in the MPEG2 format.

  Component content 0x05 shown in FIG. 5B represents various video formats of a video stream compressed in the H.264 AVC format. Component content 0x06 shown in FIG. 5C represents various video formats of a 3D video stream compressed by multi-view video coding (for example, H.264 MVC format).

  The component content 0x07 shown in FIG. 5D represents various video formats of a side-by-side stream of 3D video compressed in MPEG2 or H.264 AVC format. In this example, the same component content value is used in MPEG2 and H.264 AVC format, but different values may be set in MPEG2 and H.264 AVC.

  The component content 0x08 shown in FIG. 5 (e) represents various video formats of a Top-and-Bottom stream of 3D video compressed in MPEG2 or H.264 AVC format. In this example, the same component content value is used in MPEG2 and H.264 AVC format, but different values may be set in MPEG2 and H.264 AVC.

  As shown in FIG. 5 (d) and FIG. 5 (e), whether or not it is 3D video depending on the combination of stream_content (component content) and component_type (component type) that are components of the component descriptor. By adopting a configuration that shows a combination of resolution and aspect ratio, it is possible to transmit various types of video system information including 2D program / 3D program identification with a small transmission amount even in mixed 3D and 2D broadcasting. .

  In particular, using a coding method such as MPEG2 or H.264 AVC (excluding MVC) that is not originally defined as a multi-view video coding method, Side-by-Side format or Top-and-Bottom When transmitting a 3D video program including a plurality of viewpoint images in one image such as a format, only the above-described stream_type (stream format type) allows multiple viewpoint images to be included in one image for a 3D video program. It is difficult to identify whether the image is included and transmitted or a normal image from one viewpoint. Therefore, in this case, identification of various video systems including 2D program / 3D program identification for the program may be performed by a combination of stream_content (component content) and component_type (component type). Also, by receiving component descriptors related to programs that are currently being broadcast or will be broadcast in the future by EIT, the receiver 4 creates an EPG (program guide) by acquiring the EIT, and as EPG information. It can be created whether it is 3D video, whether it is 3D video system, resolution, aspect ratio, 3D video. The receiving apparatus has an advantage that such information can be displayed (output) on the EPG.

  As described above, the receiver 4 monitors stream_content and component_type, so that it is possible to recognize that the currently received program or a future received program is a 3D program.

  FIG. 6 shows an example of the structure of a component group descriptor (Component Group Descriptor), which is one piece of program information. The component group descriptor defines and identifies the combination of components in the event. That is, grouping information of a plurality of components is described. This descriptor is placed in the EIT.

The meaning of the component group descriptor is as follows. In other words, descriptor_tag is an 8-bit field, and a value that can identify this descriptor as a component group descriptor is described. descriptor_length is an 8-bit field and describes the size of this descriptor. component_group_type (component group type) is a 3-bit field and represents the group type of the component in accordance with FIG.
Here, 001 represents a 3DTV service and is distinguished from 000 multi-view TV services. Here, the multi-view TV service is a TV service capable of switching and displaying a 2D video of a plurality of viewpoints for each viewpoint. For example, in a multi-view video encoded video stream or a stream of an encoding method that is not originally an encoding method defined as a multi-view video encoding method, a stream in which images of a plurality of viewpoints are transmitted in one screen May be used not only for 3D video programs but also for multi-view TV programs. In this case, even if a multi-view video is included in the stream, it may be impossible to identify whether the stream is a 3D video program or a multi-view TV program only by the above-described stream_type (stream format type). In such a case, identification by component_group_type (component group type) is effective. total_bit_rate_flag (total bit rate flag) is a 1-bit flag and indicates the description state of the total bit rate in the component group in the event. When this bit is “0”, it indicates that the total bit rate field in the component group does not exist in the descriptor. When this bit is “1”, it indicates that the total bit rate field in the component group exists in the descriptor. num_of_group (number of groups) is a 4-bit field and indicates the number of component groups in the event.

  component_group_id (component group identification) is a 4-bit field and describes the component group identification according to FIG. num_of_CA_unit (billing unit number) is a 4-bit field and indicates the number of billing / non-billing units in the component group. CA_unit_id (charging unit identification) is a 4-bit field and describes the charging unit identification to which the component belongs according to FIG.

  num_of_component (number of components) is a 4-bit field and indicates the number of components belonging to the component group and belonging to the billing / non-billing unit indicated by the immediately preceding CA_unit_id. component_tag (component tag) is an 8-bit field indicating the value of the component tag belonging to the component group.

  total_bit_rate (total bit rate) is an 8-bit field, and describes the total bit rate of the components in the component group by rounding up the transport stream packet transmission rate every 1/4 Mbps. text_length (component group description length) is an 8-bit field and represents the byte length of the subsequent component group description. text_char (component group description) is an 8-bit field. A series of character information fields describes a description about the component group.

  As described above, the monitoring of the component_group_type by the receiving device 4 has an effect of recognizing that a program that is currently received or that will be received in the future is a 3D program.

  Next, an example in which a new descriptor indicating information related to a 3D program is used will be described. FIG. 10A shows an example of the structure of a 3D program detail descriptor, which is one piece of program information. The 3D program detailed descriptor indicates detailed information when the program is a 3D program, and is used for determining a 3D program in the receiver. This descriptor is placed in the PMT and / or EIT. The 3D program detail descriptor may coexist with stream_content (component content and component_type (component type) for the 3D video program shown in FIGS. 5 (c) to 5 (e) already described. By transmitting the child, the stream_content (component content or component_type (component type)) for the 3D video program may not be transmitted. The meaning of the 3D program detail descriptor is as follows. In this field, a value (for example, 0xE1) that can distinguish this descriptor from the 3D program detail descriptor is described, and descriptor_length is an 8-bit field that describes the size of this descriptor.

3d_2d_type (3D / 2D type) is an 8-bit field and represents the type of 3D video / 2D video in the 3D program according to FIG. 10B. This field is information for identifying whether a 3D video or a 2D video in a 3D program in which the main part of the program is a 3D video and a commercial inserted in the middle of the program is composed of 2D video, for example. Yes, it is arranged for the purpose of preventing malfunction in the receiving apparatus (display (output) problem that occurs because the broadcast program is 2D video even though the receiving apparatus performs 3D processing). 0x01 represents 3D video, and 0x02 represents 2D video.
3d_method_type (3D method type) is an 8-bit field and represents a 3D method type according to FIG. 0x01 represents the “3D2 viewpoint-specific ES transmission scheme”, 0x02 represents the Side-by-Side scheme, and 0x03 represents the Top-and-Bottom scheme. The stream_type (stream format type) is an 8-bit field and indicates the ES format of the program according to FIG. 3 described above. The 3D program detail descriptor may be transmitted in the case of a 3D video program and not transmitted in a 2D video program. It is possible to identify whether the program is a 2D video program or a 3D video program only by transmitting or not transmitting the 3D program detail descriptor for the received program.

  The component_tag (component tag) is an 8-bit field. The component stream of the service can refer to the description content (FIG. 5) indicated by the component descriptor by this 8-bit field. In the program map section, the component tag value given to each stream should be different. The component tag is a label for identifying the component stream, and has the same value as the component tag in the stream identification descriptor (provided that the stream identification descriptor exists in the PMT).

  As described above, the receiving device 4 monitors the 3D program detail descriptor, and if this descriptor exists, there is an effect that it is possible to recognize that the program currently received or received in the future is a 3D program. In addition, when the program is a 3D program, the type of the 3D transmission method can be identified, and when 3D video and 2D video are mixed, the identification can be performed.

  Next, an example in which 3D video or 2D video is identified on a service (organization channel) basis will be described. FIG. 12 shows an example of the structure of a service descriptor (Service Descriptor) which is one piece of program information. The service descriptor represents the organization channel name and the business operator name together with the service format type by a character code. This descriptor is placed in the SDT.

The meaning of the service descriptor is as follows. That is, service_type (service format type) is an 8-bit field and represents the type of service according to FIG. 0x01 represents a 3D video service. The 8-bit field of service_provider_name_length (operator name length) represents the byte length of the subsequent operator name. char (character code) is an 8-bit field. A series of character information fields represents a business name or a service name. The 8-bit field of service_name_length (service name length) represents the byte length of the subsequent service name.

  As described above, there is an effect that the reception device 4 can recognize that the service (organization channel) is a 3D program channel by monitoring service_type. In this way, if it is possible to identify whether a service (organization channel) is a 3D video service or a 2D video service, it is possible to display, for example, that the service is a 3D video program broadcast service by EPG display or the like. . However, even a service that broadcasts mainly 3D video programs may need to broadcast 2D video, such as when the source of advertisement video is only 2D video. Therefore, the identification of the 3D video service based on the service_type (service type type) of the service descriptor is the same as the identification of the 3D video program based on the combination of the stream_content (component content) and the component_type (component type) as described above. 3D video program identification by 3) or 3D video program identification by 3D program detail descriptor is desirable. When a plurality of pieces of information are combined and identified, it is a 3D video broadcasting service, but it is also possible to identify that only some programs are 2D video. If such identification can be made, the receiving device, for example, EPG can clearly indicate that the service is a “3D video broadcasting service”, and the service includes a mixture of 2D video programs in addition to 3D video programs. Even when the program is received, the display control or the like can be switched as necessary between the 3D video program and the 2D video program.

  FIG. 14 shows an example of the structure of a service list descriptor (Service List Descriptor) which is one piece of program information. The service list descriptor provides a list of services according to service identification and service type. That is, a list of organization channels and their types is described. This descriptor is placed in the NIT.

  The meaning of the service list descriptor is as follows. That is, service_id (service identification) is a 16-bit field, and uniquely identifies the information service in the transport stream. The service identification is equal to the broadcast program number identification (program_number) in the corresponding program map section. The service_type (service type type) is an 8-bit field and represents the type of service according to FIG. 12 described above.

  Since it is possible to identify whether or not it is “3D video broadcasting service” by these service_type (service type type), for example, by using the list of organized channels and their types indicated in the service list descriptor, EPG In the display, it is possible to perform a display in which only “3D video broadcasting service” is grouped.

  As described above, there is an effect that the receiving device 4 can recognize that the organization channel is a channel of a 3D program by monitoring service_type.

  The examples of descriptors described above describe only representative members. Having other members, combining multiple members into one, and converting one member into multiple members with detailed information. Dividing is also conceivable.

<Examples of program information transmission operation rules>
The component descriptor, component group descriptor, 3D program detail descriptor, service descriptor, and service list descriptor of the program information described above are generated and added by the management information adding unit 16, for example, and the MPEG-TS PSI ( This is information that is stored in SI (eg, EIT, SDT, or NIT) and transmitted from the transmission apparatus 1 as an example.

An example of program information transmission operation rules in the transmission apparatus 1 will be described below.
FIG. 15 shows an example of a transmission process in the component descriptor transmission apparatus 1. In “descriptor_tag”, “0x50” indicating a component descriptor is described. In “descriptor_length”, the descriptor length of the component descriptor is described. The maximum descriptor length is not specified. In “stream_content”, “0x01” (video) is described.

  In “component_type”, the video component type of the component is described. The component type is set from FIG. “Component_tag” describes a component tag value that is unique within the program. “ISO_639_language_code” describes “jpn (“ 0x6A706E ”)”.

  “Text_char” is described with a video type name of 16 bytes (8 full-width characters) or less when there are multiple video components. Do not use a line feed code. This field can be omitted if the component description is the default string. The default character string is “video”.

  It should be noted that at least one video component having a component_tag value of 0x00 to 0x0F included in the event (program) is always transmitted.

  As described above, when the transmission apparatus 1 performs the transmission operation, the reception apparatus 4 monitors the stream_content and the component_type, so that it is possible to recognize that the program currently received or received in the future is a 3D program.

  FIG. 16 shows an example of a transmission process in the component group descriptor transmission apparatus 1.

In “descriptor_tag”, “0xD9” indicating a component group descriptor is described. In “descriptor_length”, the descriptor length of the component group descriptor is described.
The maximum descriptor length is not specified. “Component_group_type” indicates the type of component group. “000” indicates a multi-view TV, and “001” indicates a 3D TV.

  In “total_bit_rate_flag”, if all the total bit rates in the group in the event are at the specified default value, set to “0”, and one of the total bit rates in the group in the event exceeds the specified default value. If it is present, it indicates '1'.

  “Num_of_group” describes the number of component groups in the event. The maximum is 3 for multi-view television (MVTV) and 2 for 3D television (3DTV).

  “Component_group_id” describes component group identification. In the case of the main group, “0x0” is assigned, and in the case of each subgroup, the broadcaster assigns it uniquely within the event.

  “Num_of_CA_unit” describes the number of charge / non-charge units in the component group. The maximum value is 2. Set to "0x1" if no component to be charged is included in the component group.

  “CA_unit_id” describes the charging unit identification. The broadcaster assigns it uniquely within the event. “Num_of_component” describes the number of components belonging to the component group and belonging to the billing / non-billing unit indicated by the immediately preceding “CA_unit_id”. The maximum value is 15.

  “Component_tag” describes a component tag value belonging to the component group. “Total_bit_rate” describes the total bit rate in the component group. However, “0x00” is described for the default value.

  “Text_length” describes the byte length of the subsequent component group description. The maximum value is 16 (8 full-width characters). “Text_char” always describes the description about the component group. No default string is specified. Also, no line feed code is used.

  When performing multi-view TV service, “component_group_type” is always transmitted as “000”. When performing 3D television service, “component_group_type” is always transmitted as “001”.

  By performing transmission operation in the transmission apparatus 1 in this way, there is an effect that the reception apparatus 4 can recognize that the program currently received or received in the future is a 3D program by monitoring component_group_type.

  FIG. 17 shows an example of a transmission process in the 3D program detail descriptor transmission apparatus 1. In “descriptor_tag”, “0xE1” indicating a 3D program detail descriptor is described. In “descriptor_length”, the descriptor length of the 3D program detail descriptor is described. “3d_2d_type” describes 3D / 2D identification. It sets from FIG.10 (b). “3d_method_type” describes 3D method identification. The setting is made from FIG. “Stream_type” describes the ES format of the program. The setting is made from FIG. “Component_tag” describes a component tag value that is unique within the program.

  By performing transmission operation in the transmission apparatus 1 in this way, the reception apparatus 4 monitors the 3D program detail descriptor, and if this descriptor exists, a program that is currently received or will be received in the future is a 3D program. There is an effect that can be recognized.

  FIG. 18 shows an example of transmission processing in the service descriptor transmission apparatus 1. In “descriptor_tag”, “0x48” indicating a service descriptor is described. In “descriptor_length”, the descriptor length of the service descriptor is described. “Service_type” describes the service type.

  The service format type is set from FIG. “Service_provider_name_length” describes the name of the operator in BS / CS digital television broadcasting. The maximum value is 20. Since service_provider_name is not used in terrestrial digital television broadcasting, describe “0x00”.

  “Char” describes an operator name in BS / CS digital television broadcasting. Maximum 10 characters. Nothing is described for digital terrestrial television broadcasting. “Service_name_length” describes the organization channel name length. The maximum value is 20. “Char” describes the organization channel name. It is within 20 bytes and within 10 full-width characters. Note that only one is always arranged for the target knitting channel.

  By performing transmission operation in the transmission apparatus 1 in this manner, there is an effect that the reception apparatus 4 can recognize that the organization channel is a 3D program channel by monitoring service_type.

  FIG. 19 shows an example of a transmission process of the service list descriptor in the transmission apparatus 1. In “descriptor_tag”, “0x41” indicating a service list descriptor is described. In “descriptor_length”, the descriptor length of the service list descriptor is described. “Loop” describes a loop of the number of services included in the target transport stream.

  “Service_id” describes service_id included in the transport stream. “Service_type” describes the service type of the target service. The setting is made from FIG. Note that this is always arranged for the TS loop in the NIT.

  By performing transmission operation in the transmission apparatus 1 in this manner, there is an effect that the reception apparatus 4 can recognize that the organization channel is a 3D program channel by monitoring service_type.

  As described above, the transmission example of the program information in the transmission apparatus 1 has been described. When the program is switched from the 2D program to the 3D program, on the first screen where the 3D program starts, for example, using a telop, the “3D program is started. “When viewing with 3D display, wearing 3D viewing glasses”, “Recommending viewing with 2D display when eyes are tired or unwell”, “3D program length For a user who views a 3D program on the receiving device 4 by inserting and sending it to the video of the 3D program created by the transmitting device 1 such as “viewing time may cause eyestrain or poor physical condition”. There is a merit that warning / warning for 3D program viewing can be performed.

<Hardware configuration of receiving device>
FIG. 25 is a hardware configuration diagram illustrating a configuration example of the receiving device 4 in the system of FIG. 21 is a CPU (Central Processing Unit) that controls the entire receiver, 22 is a general-purpose bus for transmitting control and information between the CPU 21 and each part in the receiver, 23 is a radio (satellite, ground), broadcast transmission such as a cable A broadcast signal transmitted from the transmission apparatus 1 is received via the network, a specific frequency is selected, demodulation, error correction processing, and the like are performed, and an MPEG2-Transport Stream (hereinafter also referred to as “TS”) or the like. A tuner that outputs multiplexed packets, 24 is a descrambler that decodes scrambled data by the scrambler 13, and 25 is a network I / F that transmits / receives information to / from the network and transmits / receives various information and MPEG2-TS between the Internet and the receiving device. Interface) 26 is, for example, an HDD (Hard Disk Drive), a flash memory, or a removable device built in the receiving device 4. A recording medium 27 such as a DD, a disk-type recording medium, a flash memory, etc. 27 controls a recording medium 26, and a recording / reproducing unit 29 controls the recording of signals on the recording medium 26 and the reproduction of signals from the recording medium 26. It is a demultiplexing unit that demultiplexes signals multiplexed in a format such as MPEG2-TS into signals such as video ES (Elementary Stream), audio ES, and program information. An ES is each of compressed and encoded image / sound data. 30 is a video decoding unit that decodes the video ES into a video signal, 31 is an audio decoding unit that decodes the audio ES into an audio signal and outputs it to the speaker 48 or output from the audio output 42, and 32 is the video decoding unit 30. The decoded video signal is superposed on the video signal by processing to convert the 3D or 2D video signal into a predetermined format by a conversion process to be described later according to the instruction of the CPU, and the display such as OSD (On Screen Display) created by the CPU 21. The processed video signal is output to the display 47 or the video signal output unit 41, and the synchronization signal and control signal (used for device control) corresponding to the processed video signal format are output to the video signal output unit. 41 and a video conversion processing unit 33 output from the control signal output unit 43, 33 is an operation input from the user operation input unit 45 (for example, IR (Infrared Radiation) Control signal transmission / reception for receiving a device control signal (for example, IR) to the external device generated by the CPU 21 or the video conversion processing unit 32 from the device control signal transmission unit 44. , 34 has a counter inside and a timer for holding the current time, 46 performs necessary processing such as encryption on the TS reconfigured by the demultiplexing unit, and outputs the TS to the outside, or A high-speed digital I / F such as a serial interface or an IP interface that decodes TS received from the outside and inputs it to the demultiplexing unit 29, 47 is decoded by the video decoding unit 30, and video is converted by the video conversion processing unit 32 Display for displaying 3D video and 2D video, 48 is a speaker for outputting sound based on the audio signal decoded by the audio decoding unit The receiving device 4 is mainly composed of these devices. In the case of 3D display on the display, if necessary, the synchronization signal and the control signal are output from the control signal output unit 43 and the device control signal transmission terminal 44.

  Examples of the system configuration including the receiving device, the viewing device, and the 3D viewing assistance device (for example, 3D glasses) are shown in FIG. 35 and FIG. FIG. 35 shows a system configuration in which the receiving device and the viewing device are integrated, and FIG. 36 shows an example in which the receiving device and the viewing device are configured separately.

  In FIG. 35, 3501 is a display device including the configuration of the receiving device 4 and capable of 3D video display and audio output, 3503 is a 3D viewing assist device control signal (for example, IR signal) output from the display device 3501, and 3502 is 3D shows a 3D viewing assistance device. In the example of FIG. 35, the video signal is displayed from a video display included in the display device 3501, and the audio signal is output from a speaker included in the display device 3501. Similarly, the display device 3501 includes an output terminal that outputs a 3D viewing assist device control signal output from the device control signal 44 or the output portion of the control signal 43.

  The above description has been made on the assumption that the display device 3501 and the 3D viewing assistance device 3502 shown in FIG. 35 perform display by an active shutter method to be described later, but the display device 3501 and the 3D viewing assistance device shown in FIG. In the case of a method of performing a 3D video display device by polarization separation, which will be described later, the 3D viewing assistance device 3502 only needs to perform polarization separation so that different images are incident on the left eye and the right eye, and the display device 3501. Therefore, the 3D viewing assist device control signal 3503 that is output to the 3D viewing assist device 3502 from the output unit of the device control signal 44 or the control signal 43 may not be output.

  In FIG. 36, 3601 is a video / audio output device including the configuration of the receiving device 4, 3602 is a transmission path (for example, HDMI cable) for transmitting video / audio / control signals, and 3603 is a video signal or audio input from the outside. Represents a display that displays and outputs signals.

  In this case, the video signal output from the video output 41 of the video / audio output device 3601 (reception device 4), the audio signal output from the audio output 42, and the control signal output from the control signal output unit 43 are transmitted through the transmission path 3602. Is converted into a transmission signal in a format suitable for the format specified in (for example, a format specified by the HDMI standard), and input to the display 3603 via the transmission path 3602. The display 3603 receives the transmission signal, decodes it to the original video signal, audio signal, and control signal, outputs video and audio, and outputs a 3D viewing assist device control signal 3503 to the 3D viewing assist device 3502. To do.

  The above description has been made on the assumption that the display device 3603 and the 3D viewing assistance device 3502 shown in FIG. 36 display by an active shutter method described later, but the display device 3603 and the 3D viewing assistance device shown in FIG. In the case of a method of performing a 3D video display device by polarization separation, which will be described later, the 3D viewing assistance device 3502 only needs to perform polarization separation so that different images are incident on the left eye and the right eye, and the display device 3603. 3D viewing assist device control signal 3603 does not have to be output from 3D to 3D viewing assist device 3502.

  A part of each of the constituent elements 21 to 46 shown in FIG. 25 may be composed of one or a plurality of LSIs. Moreover, it is good also as a structure which implement | achieves a part of function of each structural requirement of 21-46 shown in FIG. 25 with software.

<Functional block diagram of receiver>
FIG. 26 is an example of a functional block configuration of processing inside the CPU 21. Here, each functional block exists, for example, as a software module executed by the CPU 21, and some means (for example, message passing, function call, event transmission) is performed between each module to exchange and control information and data. Give instructions.

  Each module also transmits / receives information to / from hardware in the receiving device 4 via the general-purpose bus 22. Moreover, although the relationship line (arrow) described in the figure mainly describes the part related to this explanation, there is a communication means and a process that requires communication between other modules. For example, the channel selection control unit 59 appropriately acquires program information necessary for channel selection from the program information analysis unit 54.

  Next, the function of each functional block will be described. The system control unit 51 manages the state of each module, the user instruction state, and the like, and issues a control instruction to each module. The user instruction receiving unit 52 receives and interprets a user operation input signal received by the control signal transmitting / receiving unit 33 and transmits the user instruction to the system control unit 51. The device control signal transmission unit 53 instructs the control signal transmission / reception unit 33 to transmit a device control signal in accordance with instructions from the system control unit 51 and other modules.

  The program information analysis unit 54 acquires program information from the demultiplexing unit 29, analyzes the contents, and provides necessary information to each module. The time management unit 55 acquires time correction information (TOT: Time offset table) included in the TS from the program information analysis unit 54 and manages the current time, and uses the counter of the timer 34 to An alarm (notification of the arrival of a specified time) and a one-shot timer (notification of the elapse of a certain time) are performed as requested.

  The network control unit 56 controls the network I / F 25 and acquires various information and TS from a specific URL (Unique Resource Locater) or a specific IP (Internet Protocol) address. The decoding control unit 57 controls the video decoding unit 30 and the audio decoding unit 31 to start and stop decoding and acquire information included in the stream.

  The recording / playback control unit 58 controls the recording / playback unit 27 to read a signal from the recording medium 26 from a specific position of a specific content and in any reading format (normal playback, fast forward, rewind, pause). . Further, control is performed to record the signal input to the recording / reproducing unit 27 on the recording medium 26.

  The channel selection control unit 59 controls the tuner 23, the descrambler 24, the demultiplexing unit 29, and the decoding control unit 57 to receive broadcasts and record broadcast signals. Alternatively, control is performed until reproduction from the recording medium and output of the video signal and the audio signal. Detailed broadcast reception operation, broadcast signal recording operation, and reproduction operation from the recording medium will be described later.

  The OSD creation unit 60 creates OSD data including a specific message, and instructs the video conversion control unit 61 to superimpose the created OSD data on the video signal and output it. Here, the OSD creation unit 60 creates parallax OSD data for left eye and right eye, and requests the video conversion control unit 61 to perform 3D display based on the left-eye and right-eye OSD data. As a result, message display in 3D is performed.

  The video conversion control unit 61 controls the video conversion processing unit 32 to convert the video signal input from the video decoding unit 30 to the video conversion processing unit 32 into 3D or 2D video according to an instruction from the system control unit 51. The converted video and the OSD input from the OSD creation unit 60 are superimposed, and the video is further processed as necessary (scaling, PinP, 3D display, etc.) and displayed on the display 47 or output to the outside. Details of a method for converting 3D video and 2D video into a predetermined format in the video conversion processing unit 32 will be described later. Each functional block provides these functions.

<Broadcast reception>
Here, a control procedure and a signal flow when performing broadcast reception will be described. First, the system control unit 51 that has received a user instruction (for example, pressing the CH button on the remote controller) indicating broadcast reception of a specific channel (CH) from the user instruction receiving unit 52 uses the CH (hereinafter designated CH) designated by the user. The channel selection control unit 59 is instructed to select a channel.

  Upon receiving the instruction, the channel selection control unit 59 instructs the tuner 23 to perform reception control of the designated CH (tuning to the designated frequency band, broadcast signal demodulation processing, error correction processing), and sends the TS to the descrambler 24. Output.

  Next, the channel selection control unit 59 instructs the descrambler 24 to descramble the TS and output it to the demultiplexing unit 29. The demultiplexing unit 29 receives the demultiplexing of the input TS, In addition, an instruction to output the demultiplexed video ES to the video decoding unit 30 and to output the audio ES to the audio decoding unit 31 is given.

  Further, the channel selection control unit 59 instructs the decoding control unit 57 to decode the video ES and the audio ES input to the video decoding unit 30 and the audio decoding unit 31. Upon receiving the decoding instruction, the decoding control unit 31 controls the video decoding unit 30 to output the decoded video signal to the video conversion processing unit 32, and the audio decoding unit 31 receives the decoded audio signal from the speaker. 48 or the audio output 42 is controlled. In this way, control is performed to output the video and audio of the CH designated by the user.

  Further, in order to display a CH banner (OSD for displaying a CH number, program name, program information, etc.) at the time of channel selection, the system control unit 51 instructs the OSD creation unit 60 to create and output a CH banner. . The OSD creation unit 60 that has received the instruction transmits the created CH banner data to the video conversion control unit 61, and the video conversion control unit 61 that has received the data outputs the CH banner superimposed on the video signal. To control. In this way, a message is displayed at the time of channel selection.

<Recording of broadcast signal>
Next, broadcast signal recording control and signal flow will be described. When recording a specific CH, the system control unit 51 instructs the channel selection control unit 59 to select a specific CH and output a signal to the recording / reproducing unit 27.

  The channel selection control unit 59 that has received the instruction instructs the tuner 23 to receive the designated channel as in the broadcast reception process, and the MPEG2-TS received from the tuner 23 to the descrambler 24. The descrambling / demultiplexing unit 29 is controlled to output the input from the descrambler 24 to the recording / reproducing unit 27.

  In addition, the system control unit 51 instructs the recording / playback control unit 58 to record the input TS to the recording / playback unit 27. Receiving the instruction, the recording / playback control unit 58 performs necessary processing such as encryption on the signal (TS) input to the recording / playback unit 27, and also adds additional information (recording CH of the recording CH) required for recording / playback. Program information, bit rate and other content information), and management data (recorded content ID, recording position on recording medium 26, recording format, encrypted information, etc.), and then the MPEG2-TS In addition, a process of writing additional information and management data to the recording medium 26 is performed. In this way, the broadcast signal is recorded.

<Reproduction from recording media>
Next, playback processing from a recording medium will be described. When reproducing a specific program, the system control unit 51 instructs the recording / reproduction control unit 58 to reproduce the specific program. As an instruction at this time, the content ID and the reproduction start position (for example, the beginning of the program, the position of 10 minutes from the beginning, the continuation of the previous time, the position of 100 Mbyte from the beginning, etc.) are instructed. The recording / playback control unit 58 that has received the instruction controls the recording / playback unit 27 to read out a signal (TS) from the recording medium 26 using additional information and management data, and perform necessary processing such as decryption of encryption. After that, processing is performed to output TS to the demultiplexing unit 29.

  In addition, the system control unit 51 instructs the channel selection control unit 59 to output the video and audio of the reproduction signal. The channel selection control unit 59 that has received the instruction performs control so that the input from the recording / reproducing unit 27 is output to the demultiplexing unit 29, and the demultiplexing unit 29 performs demultiplexing and demultiplexing of the input TS. The output of the separated video ES to the video decoding unit 30 and the output of the demultiplexed audio ES to the audio decoding unit 31 are instructed.

  Further, the channel selection control unit 59 instructs the decoding control unit 57 to decode the video ES and the audio ES input to the video decoding unit 30 and the audio decoding unit 31. Upon receiving the decoding instruction, the decoding control unit 31 controls the video decoding unit 30 to output the decoded video signal to the video conversion processing unit 32, and the audio decoding unit 31 receives the decoded audio signal from the speaker. 48 or the audio output 42 is controlled. In this way, signal reproduction processing from the recording medium is performed.

<3D video display method>
As a 3D video display method that can be used in the present invention, left and right eye images that make the left and right eyes feel parallax are created, and a human being recognizes that a three-dimensional object exists. There is a method.

  As one method, the glasses worn by the user are shielded from light by the left and right glasses alternately using a liquid crystal shutter, etc., and the left and right eye images are displayed in synchronization with the glasses. There is an active shutter system that generates parallax in an image displayed on the screen.

  In this case, the receiving device 4 outputs a synchronization signal and a control signal from the control signal output unit 43 and the device control signal transmission terminal 44 to the active shutter glasses worn by the user. Further, the video signal is output from the video signal output unit 41 to an external 3D video display device, and the left-eye video and the right-eye video are alternately displayed. Alternatively, the same 3D display is performed on the display 47 of the receiving device 4. In this way, a user wearing active shutter glasses can view 3D video on the display 47 of the 3D video display device or the receiving device 4.

  As another method, for the glasses worn by the user, a film orthogonal to the linearly polarized light is applied to the left and right glasses, or a linearly polarized coating is applied, or a circularly polarized film with the rotation direction of the polarization axis reversed. Or apply a circularly polarized coat, and simultaneously output the image for the left eye and the image for the right eye with different polarizations corresponding to the polarization of the glasses for the left eye and the right eye respectively. There is a polarization method that generates parallax between the left eye and the right eye by separating them according to the polarization state.

  In this case, the receiving device 4 outputs the video signal from the video signal output unit 41 to an external 3D video display device, and the 3D video display device converts the left-eye video and the right-eye video in different polarization states. Display. Alternatively, the same display is performed on the display 47 of the receiving device 4. In this way, a user wearing polarized glasses can view 3D video on the display 47 of the 3D video display device or the receiving device 4. In the polarization method, since the 3D video can be viewed without transmitting a synchronization signal or a control signal from the receiving device 4 to the polarization method glasses, it is synchronized from the control signal output unit 43 or the device control signal transmission terminal 44. There is no need to output signals or control signals.

  In addition, a color separation method that separates the left and right eye images by color may be used. Alternatively, a parallax barrier method that creates a 3D image using a parallax barrier that can be viewed with the naked eye may be used.

  The 3D display method according to the present invention is not limited to a specific method.

<Example of specific determination method of 3D program using program information>
As an example of a 3D program determination method, information for determining whether or not a 3D program is newly included is obtained from various tables and descriptors included in the program information of the broadcast signal and the reproduction signal described above. It is possible to determine whether or not.

  Check the information to determine whether the 3D program is newly included in the component descriptor or component group descriptor described in the table such as PMT and EIT [schedule basic / schedule extended / present / following]. Or 3D program details descriptor, which is a new descriptor for 3D program determination, is newly included in the service descriptor, service list descriptor, etc. described in tables such as NIT and SDT It is determined whether or not it is a 3D program by checking information for determining whether or not it is a 3D program. These pieces of information are added to the broadcast signal in the transmission device described above and transmitted. In the transmission device, for example, the management information adding unit 16 adds these pieces of information to the broadcast signal.

  The use of each table is characterized in that, for example, only information on the current program is described for PMT, so information on future programs cannot be confirmed, but the reliability is high. On the other hand, for EIT [schedule basic / schedule extended], information on future programs as well as current programs can be acquired, but it takes a long time to complete reception, requires a large storage area, and is a future event. There are disadvantages such as low reliability. As for EIT [following], it is possible to obtain information on a program at the next broadcast time, and therefore it is suitable for application to the present embodiment. Further, EIT [present] can be used to obtain current program information, and information different from PMT can be obtained.

  Next, a detailed example of processing of the receiving device 4 related to the program information described in FIGS. 4, 6, 10, 12, and 14 sent from the transmitting device 1 will be described.

  FIG. 20 shows an example of processing for each field of the component descriptor in the receiving device 4.

  If “descriptor_tag” is “0x50”, it is determined that the descriptor is a component descriptor. Based on “descriptor_length”, it is determined to be the descriptor length of the component descriptor. If “stream_content” is “0x01”, “0x05”, “0x06”, “0x07”, it is determined that the descriptor is valid (video). In cases other than “0x01”, “0x05”, “0x06”, and “0x07”, it is determined that the descriptor is invalid. When “stream_content” is “0x01”, “0x05”, “0x06”, “0x07”, the following processing is performed.

  “Component_type” is determined as the video component type of the component. For this component type, one of the values in FIG. 5 is designated. From this content, it can be determined whether or not the component is a component for a 3D video program.

  “Component_tag” is a component tag value that is unique within the program, and can be used in association with the component tag value of the PMT stream identifier.

  “ISO_639_language_code” treats a character code arranged later as “jpn”, except for “jpn (“ 0x6A706E ”)”.

  “Text_char” is determined to be a component description within 16 bytes (8 full-width characters). If this field is omitted, it is determined as the default component description. The default character string is “video”.

  As described above, the component descriptor can determine the type of video component constituting the event (program), and the component description can be used when selecting the video component in the receiver.

  Note that only video components whose component_tag value is set to a value between 0x00 and 0x0F are to be selected independently. A video component set with a component_tag value other than the above is not a single selection target, and a target for a component selection function or the like.

In addition, the component description may not match the actual component due to a mode change during an event (program). (The component_type of the component descriptor describes the representative component type of the component, and this value is not changed in real time in response to a mode change during the program.)
The component_type described by the component descriptor is the default when the digital copy control descriptor, which is a description of the information for controlling the copy generation in the digital recording device and the maximum transmission rate, is omitted for the event (program). It is referred to when determining the maximum_bit_rate.

  In this way, by performing processing for each field of this descriptor in the receiving device 4, the receiving device 4 monitors the stream_content and component_type, so that the program currently received or received in the future is a 3D program. There is an effect that can be recognized.

  FIG. 21 shows an example of processing for each field of the component group descriptor in the receiving device 4.

  If “descriptor_tag” is “0xD9”, it is determined that the descriptor is a component group descriptor. Based on “descriptor_length”, it is determined to be the descriptor length of the component group descriptor.

  When “component_group_type” is “000”, it is determined as a multi-view TV service, and when it is “001”, it is determined as a 3D TV service.

  When “total_bit_rate_flag” is “0”, it is determined that the total bit rate in the group in the event (program) is not described in the descriptor. If “1”, it is determined that the total bit rate in the group in the event (program) is described in the descriptor.

  “Num_of_group” is determined as the number of component groups in the event (program). If the maximum value exists and exceeds this value, it may be processed as the maximum value. If “component_group_id” is “0x0”, it is determined as the main group. If it is not “0x0”, it is determined as a subgroup.

  “Num_of_CA_unit” is determined as the number of billing / non-billing units in the component group. If the maximum value is exceeded, it may be processed as 2.

  If “CA_unit_id” is “0x0”, it is determined as a non-billing unit group. If it is “0x1”, it is determined as a charging unit including the default ES group. If it is other than “0x0” and “0x1”, it is determined that the charging unit is not identified above.

  “Num_of_component” is determined to be the number of components belonging to the component group and belonging to the billing / non-billing unit indicated by the immediately preceding CA_unit_id. If it exceeds the maximum value, it may be processed as 15.

  “Component_tag” is determined to be a component tag value belonging to the component group, and can be used in correspondence with the component tag value of the PMT stream identifier. “Total_bit_rate” is determined as the total bit rate in the component group. However, when it is “0x00”, it is determined as the default.

  If “text_length” is 16 (8 full-width characters) or less, it is determined as the component group description length. If it is greater than 16 (8 full-width characters), the description for the component group description length exceeding 16 (8 full-width characters) is You can ignore it.

  “Text_char” indicates an explanatory text related to the component group. Note that the arrangement of the component group descriptor of component_group_type = '000' determines that the multi-view TV service is to be performed in the event (program), and can be used for processing for each component group.

  Further, the arrangement of the component group descriptor of component_group_type = '001' makes it possible to determine that a 3D television service is to be performed in the event (program) and use it for processing for each component group.

  Furthermore, the default ES group of each group is always described in the component loop arranged at the head of the CA_unit loop.

In the main group (component_group_id = 0x0)
・ If the group's default ES group is non-chargeable, set free_CA_mode = 0 and do not set a component loop with CA_unit_id = 0x1.
-If the default ES group of the group is the object of billing, set free_CA_mode = 1 and be sure to set and describe the component loop with CA_unit_id = "0x1".
In the subgroup (component_group_id> 0x0)
-Only the same billing unit as the main group or a non-billing unit can be set for the sub group.
-If the default ES group of the group is a non-billing target, set and describe a component loop with CA_unit_id = 0x0.
・ If the group's default ES group is a chargeable target, set and describe a component loop with CA_unit_id = 0x1.

  In this way, by performing processing for each field of this descriptor in the receiving device 4, the receiving device 4 monitors the component_group_type, so that a program that is currently received or that will be received in the future is a 3D program. There is a recognizable effect.

  FIG. 22 shows an example of processing for each field of the 3D program detail descriptor in the receiving device 4.

  If “descriptor_tag” is “0xE1”, it is determined that the descriptor is a 3D program detail descriptor. Based on “descriptor_length”, the descriptor length of the 3D program detail descriptor is determined. “3d_2d_type” is determined to be 3D / 2D identification in the 3D program. It is specified from FIG. “3d_method_type” is determined to be 3D method identification in the 3D program. It is specified from FIG.

  “Stream_type” is determined to be the ES format of the 3D program. It is specified from FIG. “Component_tag” is determined to be a component tag value that is unique within the 3D program. It can be used in correspondence with the component tag value of the PMT stream identifier.

  Note that it may be configured to determine whether or not the program is a 3D video program based on the presence or absence of the 3D program detail descriptor itself. That is, in this case, if there is no 3D program detailed descriptor, it is determined as a 2D video program, and if there is a 3D program detailed descriptor, it is determined as a 3D video program.

  In this way, by performing processing for each field of this descriptor in the receiving device 4, the receiving device 4 monitors the 3D program detail descriptor, and if this descriptor exists, it is currently received. Alternatively, it is possible to recognize that a program to be received in the future is a 3D program.

  FIG. 23 shows an example of processing for each field of the service descriptor in the receiving device 4. If “descriptor_tag” is “0x48”, it is determined that the descriptor is a service descriptor. Based on “descriptor_length”, it is determined to be the descriptor length of the service descriptor. If “service_type” is other than the service_type shown in FIG. 13, the descriptor is determined to be invalid.

  When “service_provider_name_length” is 20 or less in the case of reception of BS / CS digital television broadcasts, it is determined that the name of the operator is greater than 20, and if it is greater than 20, the operator name is determined to be invalid. On the other hand, in the case of reception of digital terrestrial television broadcasting, it is determined that anything other than “0x00” is invalid.

  In the case of receiving BS / CS digital television broadcasting, “char” is determined to be a business name. On the other hand, in the case of receiving terrestrial digital television broadcasting, the description is ignored. If “service_name_length” is 20 or less, it is determined as the composition channel name length, and if it is greater than 20, the composition channel name is determined to be invalid.

  “Char” is determined as the organization channel name. If the SDT in which the descriptor is arranged cannot be received according to the example of the transmission process described with reference to FIG. 18, it is determined that the basic information of the target service is invalid.

  Thus, by performing processing for each field of this descriptor in the receiving device 4, there is an effect that the receiving device 4 can recognize that the organization channel is a 3D program channel by monitoring service_type.

  FIG. 24 shows an example of processing for each field of the service list descriptor in the receiving device 4. If “descriptor_tag” is “0x41”, it is determined that the descriptor is a service list descriptor. Based on “descriptor_length”, it is determined that it is the descriptor length of the service list descriptor.

  “Loop” describes a loop of the number of services included in the target transport stream. “Service_id” is determined to be service_id for the transport stream. “Service_type” indicates the service type of the target service. It is determined that the service types other than those specified in FIG. 13 are invalid.

  As described above, the service list descriptor can be determined as information on the transport stream included in the target network.

  Thus, by performing processing for each field of this descriptor in the receiving device 4, there is an effect that the receiving device 4 can recognize that the organization channel is a 3D program channel by monitoring service_type.

  Next, specific descriptors in each table will be described. First, the ES format can be determined as described with reference to FIG. 3 according to the data type in the stream_type described in the 2nd loop of PMT (loop for each ES). If there is a description indicating that the stream is 3D video, the program is determined to be a 3D program (for example, multi-view video encoding (eg, H.264 / MVC) stream sub-type in stream_type) If there is 0x1F indicating a stream (other viewpoint), the program is determined to be a 3D program.

  In addition to stream_type, it is also possible to newly assign a 3D program or a 2D / 3D identification bit for identifying a 2D program to an area that is currently reserved in the PMT, and make a determination based on the area.

  Similarly, EIT can be determined by newly assigning a 2D / 3D identification bit to the reserved area.

When a 3D program is determined by a component descriptor arranged in the PMT and / or EIT, a type indicating 3D video is assigned to component_type of the component descriptor as described in FIGS. 4 and 5 (for example, FIG. 5). (C) to (e)) If there is a component_type representing 3D, it is possible to determine that the program is a 3D program. (For example, assign FIGS. 5C to 5E and confirm that the value exists in the program information of the target program.)
As described above with reference to FIGS. 6 and 7, as a determination method using the component group descriptor arranged in the EIT, a description representing 3D service is assigned to the value of component_group_type, and the value of component_group_type represents 3D service. 3D program can be discriminated (for example, 001 in the bit field assigns a 3D TV service or the like, and confirms that the value exists in the program information of the target program).
As a determination method using the 3D program detail descriptor arranged in the PMT and / or EIT, as described in FIGS. 10 and 11, when determining whether the target program is a 3D program, the 3D program detail descriptor It can be determined by the content of 3d_2d_type (3D / 2D type). If no 3D program detail descriptor is transmitted for the received program, it is determined to be a 2D program. In addition, if the receiving apparatus is compatible with the 3D method type (3d_method_type) included in the descriptor, a method of determining the next program as a 3D program is also conceivable. In this case, although the descriptor analysis process is complicated, it is possible to stop the operation for performing the message display process and the recording process for the 3D program that cannot be handled by the receiving apparatus.

  As described with reference to FIGS. 12, 13, and 14, a 3D video service is assigned to 0x01 in the service_type information included in the service descriptor arranged in the SDT and the service list descriptor arranged in the NIT. When certain program information is acquired, it can be determined as a 3D program. In this case, the determination is not made in units of programs, but in units of services (CHs, organization channels), and 3D program determination of the next program in the same organization channel cannot be made, but information acquisition is not in units of programs. There is also an advantage such as easy.

  There is also a method of acquiring program information through a dedicated communication channel (broadcast signal or the Internet). Even in this case, if there is a program start time, CH (broadcast organization channel, URL or IP address), and an identifier indicating whether the program is a 3D program, the 3D program determination is possible.

  In the above description, various information (information included in tables and descriptors) for determining whether or not a 3D video is a service (CH) or a program unit has been described. There is no need. What is necessary is just to transmit required information according to a broadcast form. Of these pieces of information, each piece of information may be checked to determine whether it is a 3D video for each service (CH) or program, or a combination of multiple pieces of information for 3D for each service (CH) or program. You may determine whether it is an image | video. When determining by combining a plurality of pieces of information, it is a 3D video broadcasting service, but it is also possible to determine that only some programs are 2D video. If such a determination can be made, the receiving device, for example, EPG can clearly indicate that the service is a “3D video broadcasting service”, and the service includes a mixture of 2D video programs in addition to 3D video programs. Even when the program is received, the display control or the like can be switched between the 3D video program and the 2D video program.

  When the 3D program is determined to be a 3D program by the above-described 3D program determination method, for example, the 3D component specified in FIGS. 5C to 5E is appropriately processed (displayed and output) by the receiving device 4. If it can be processed in 3D (playback, display, output), and cannot be properly processed (playback, display, output) in the receiving device 4 (for example, it corresponds to the specified 3D transmission method) For example, when there is no 3D video playback function to be performed), processing (playback, display, output) may be performed in 2D. At this time, along with the display and output of the 2D video, it may be displayed that the 3D video program cannot be appropriately 3D displayed or 3D output by the receiving apparatus. In this way, the user needs to know whether the program is broadcast as a 2D video program or is a program broadcast as a 3D video program, but the 2D video is displayed because it cannot be properly processed by the receiving device. Can do.

<3D playback / output / display processing of 3D content by 3D2 viewpoint-based ES transmission method>
Next, processing during playback of 3D content (digital content including 3D video) will be described. Here, first, description will be made regarding the playback processing in the case of the 3D2 viewpoint-specific ES transmission method in which the main viewpoint video ES and the sub-viewpoint video ES exist in one TS as shown in FIG. First, when the user gives an instruction to switch to 3D output / display (for example, pressing the “3D” key on the remote controller), the user instruction receiving unit 52 that has received the key code converts the 3D video to the system control unit 51. (Note that the following processing is similar even when switching to 3D output / display for 3D2 viewpoint-specific ES transmission type content under conditions other than the user switching instruction to 3D display / output of 3D content. I do). Next, the system control unit 51 determines whether or not the current program is a 3D program by the above method.

  If the current program is a 3D program, the system control unit 51 first instructs the channel selection control unit 59 to output 3D video. Upon receiving the instruction, the channel selection control unit 59 first receives a PID (packet ID) and an encoding method (for example, H.264 / MVC, MPEG2) from the program information analysis unit 54 for each of the main viewpoint video ES and the sub-viewpoint video ES. , H.264 / AVC, etc.), and then the demultiplexing unit 29 is controlled to demultiplex and demultiplex the main viewpoint video ES and sub-viewpoint video ES and output them to the video decoding unit 30.

  Here, for example, the demultiplexing unit 29 is controlled so that the main viewpoint video ES is input to the first input of the video decoding unit and the sub-viewpoint video ES is input to the second input of the video decoding unit. Thereafter, the channel selection control unit 59 transmits to the decoding control unit 57 the information that the first input of the video decoding unit 30 is the main viewpoint video ES and the second input is the sub-view video ES and the respective encoding methods. And instruct to decrypt these ESs.

  In order to decode 3D programs having different encoding methods between the main-view video ES and the sub-view video ES, as in combination example 2 and combination example 4 of the 3D2 viewpoint-specific ES transmission method shown in FIG. 47, the video decoding unit 30 It is sufficient to configure so as to have a plurality of types of decoding functions corresponding to the respective encoding methods.

  In order to decode a 3D program having the same encoding method between the main viewpoint video ES and the sub-view video ES as in combination example 1 and combination example 3 of the 3D2 viewpoint-specific ES transmission method shown in FIG. 47, the video decoding unit 30 A configuration having only a decoding function corresponding to a single encoding method may be used. In this case, the video decoding unit 30 can be configured at low cost.

  Upon receiving the instruction, the decoding control unit 57 performs decoding corresponding to the encoding methods of the main viewpoint video ES and the sub viewpoint video ES, and outputs the left-eye and right-eye video signals to the video conversion processing unit 32. Here, the system control unit 51 instructs the video conversion control unit 61 to perform 3D output processing. The video conversion control unit 61 that has received the instruction from the system control unit 51 controls the video conversion processing unit 32 to output from the video output 41 or display a 3D video on the display 47 provided in the receiving device 4.

  The 3D playback / output / display method will be described with reference to FIG.

  FIG. 37 (a) is an explanatory diagram of a frame sequential method output for alternately displaying and outputting videos of the left and right viewpoints of 3D content in the 3D2 viewpoint-specific ES transmission method, and a playback / output / display method corresponding to the display. . The upper left frame sequence (M1, M2, M3,...) Is a plurality of frames included in the main viewpoint (left eye) video ES of the content in the 3D2 viewpoint-specific ES transmission method, and the lower left frame in the figure. The columns (S1, S2, S3,...) Represent a plurality of frames included in the sub-viewpoint (for the right eye) video ES of the content in the 3D2 viewpoint-specific ES transmission method. In the video conversion processing unit 32, each frame of the input main viewpoint (for left eye) / sub-viewpoint (for right eye) video signal is converted into a right frame sequence (M1, S1, M2, S2, M3, S3). As indicated by..., Frames are alternately output / displayed as video signals. According to such an output / display method, the maximum resolution that can be displayed on the display for each viewpoint can be used, and high-resolution 3D display is possible.

  In the system configuration of FIG. 36, when the method of FIG. 37 (a) is used, the video signals are output and synchronized so that each video signal can be discriminated for the main viewpoint (left eye) and for the sub viewpoint (right eye). A signal is output from the control signal 43. The external video output device that has received the video signal and the synchronization signal outputs the video of the main viewpoint (for the left eye) and the sub-viewpoint (for the right eye) according to the synchronization signal, and supports 3D viewing. By sending a synchronization signal to the device, 3D display can be performed. Note that the synchronization signal output from the external video output device may be generated by the external video output device.

  In the system configuration of FIG. 35, when the video signal is displayed on the display 47 included in the receiving device 4 using the method of FIG. 37A, the synchronization signal is transmitted to the device control signal transmission unit 53 and the control signal. 3D display is performed by outputting from the device control signal transmission terminal 44 via the transmission / reception unit 33 and controlling the external 3D viewing assistance device (for example, shading switching of the active shutter).

  FIG. 37 (b) is an explanatory diagram of the output / reproduction / display method corresponding to the output and display of the method of displaying the video of the left and right viewpoints of 3D content in the 3D2 viewpoint-specific ES transmission method in different areas of the display. In this process, the 3D2 viewpoint-specific ES transmission system stream is decoded by the video decoding unit 30 and the video conversion processing unit 32 performs the video conversion process. Here, to display in different areas includes, for example, a method of displaying odd lines and even lines of the display as display areas for the main viewpoint (left eye) and the sub viewpoint (right eye), respectively. Alternatively, the display area does not have to be in line units, and in the case of a display having different pixels for each viewpoint, a combination of a plurality of pixels for the main viewpoint (left eye) and a plurality of pixels for the sub viewpoint (right eye) Each display area of the combination may be used. For example, in the above-described polarization type display device, for example, images of different polarization states corresponding to the respective polarization states of the left eye and right eye of the 3D viewing assistance device may be output from the different regions. According to such an output / display method, the resolution that can be displayed on the display for each viewpoint is smaller than that in the method of FIG. 37 (a), but the video for the main viewpoint (left eye) and the sub viewpoint (right eye). Video can be output / displayed simultaneously, and there is no need to display them alternately. Thereby, 3D display with less flicker than the method of FIG.

  In any of the system configurations shown in FIGS. 35 and 36, when the method shown in FIG. 37 (b) is used, the 3D viewing assistance device may be polarization-separated glasses and does not need to perform electronic control. . In this case, the 3D viewing assistance device can be provided at a lower cost.

<3D2 2D output / display processing of 3D content by viewpoint-based ES transmission method>
The operation in the case of performing 2D output / display of 3D content in the 3D2 viewpoint-specific ES transmission method will be described below. When the user gives an instruction to switch to 2D video (for example, pressing the “2D” key on the remote control), the user instruction receiving unit 52 that has received the key code instructs the system control unit 51 to switch the signal to 2D video. (The following processing is performed even when switching to 2D output / display under conditions other than the user switching instruction to 2D output / display of 3D content in the 3D2 viewpoint-specific ES transmission method). Next, the system control unit 51 first instructs the channel selection control unit 59 to output 2D video.

  The channel selection control unit 59 that has received the instruction first acquires the PID of the ES for 2D video (the main viewpoint ES or the ES having the default tag) from the program information analysis unit 54, and sends it to the demultiplexing unit 29. Control is performed to output the ES to the video decoding unit 30. Thereafter, the channel selection control unit 59 instructs the decoding control unit 57 to decode the ES. That is, in the 3D2 viewpoint-specific ES transmission method, since the substream or ES is different between the main viewpoint and the subview, it is only necessary to decode the substream or ES of the main viewpoint.

  Upon receiving the instruction, the decoding control unit 57 controls the video decoding unit 30 to decode the ES and outputs a video signal to the video conversion processing unit 32. Here, the system control unit 51 controls the video conversion control unit 61 to perform 2D video output. The video conversion control unit 61 that has received the instruction from the system control unit 51 performs control to output a 2D video signal from the video output terminal 41 to the video conversion processing unit 32 or display a 2D video on the display 47.

  The 2D output / display method will be described with reference to FIG. Although the configuration of the encoded video is the same as that of FIG. 37, as described above, since the second ES (sub-viewpoint video ES) is not decoded by the video decoding unit 30, one ES to be decoded by the video conversion processing unit 32 The video signal on the side is converted into a 2D video signal as represented by the right frame sequence (M1, M2, M3,...) And output. In this way, 2D output / display is performed.

  Here, the method of not decoding the right-eye ES as a 2D output / display method has been described, but both the left-eye ES and the right-eye ES are decoded and the video conversion processing unit 32 performs the same as in 3D display. You may perform 2D display by implementing the process which thins out the video signal for right eyes. In that case, the switching process between the decoding process and the demultiplexing process is eliminated, and effects such as a reduction in switching time and simplification of software processing can be expected.

<3D output / display processing of 3D content in Side-by-Side format / Top-and-Bottom format>
Next, when there is a left-eye video and a right-eye video in one video ES (for example, a left-eye video and a right-eye video in one 2D screen as in the Side-by-Side method and the Top-and-Bottom method) 3D content playback processing will be described. When the user instructs to switch to 3D video in the same manner as described above, the user instruction receiving unit 52 that has received the key code instructs the system control unit 51 to switch to 3D video (note that The same processing is performed even when switching to 2D output / display under conditions other than the user switching instruction to 2D output / display of 3D content of the Side-by-Side system or Top-and-Bottom system). Next, the system control unit 51 similarly determines whether or not the current program is a 3D program by the above method.

  If the current program is a 3D program, the system control unit 51 first instructs the channel selection control unit 59 to output 3D video. Upon receiving the instruction, the channel selection control unit 59 first obtains the PID (packet ID) of 3D video ES including 3D video and the encoding method (for example, MPEG2, H.264 / AVC, etc.) from the program information analysis unit 54. Then, the demultiplexing unit 29 is controlled to demultiplex and output the 3D video ES to the video decoding unit 30, and the video decoding unit 30 is subjected to a decoding process according to the encoding method to perform decoding. Control is performed so that the processed video signal is output to the video conversion processing unit 32.

  Here, the system control unit 51 instructs the video conversion control unit 61 to perform 3D output processing. Upon receiving the instruction from the system control unit 51, the video conversion control unit 61 converts the input video signal into a left-eye video and a right-eye video and performs processing such as scaling (details will be described later). An instruction is given to the processing unit 32. The video conversion processing unit 32 outputs the converted video signal from the video output 41 or displays the video on the display 47 provided in the receiving device 4.

  The 3D video playback / output / display method will be described with reference to FIG.

  FIG. 39 (a) shows a frame sequential output that alternately displays and outputs video from the left and right viewpoints of 3D content in the Side-by-Side format or the Top-and-Bottom format, and the playback / output / It is explanatory drawing of a display method. The descriptions of Side-by-Side and Top-and-Bottom are shown together as encoded video, but the only difference between the two is the difference in the arrangement of the left-eye video and the right-eye video in the video. Therefore, in the following description, description will be made using the Side-by-Side method, and description of the Top-and-Bottom method will be omitted. The left-side frame sequence (L1 / R1, L2 / R2, L3 / R3...) Is a side-by-side video signal in which left-eye and right-eye images are arranged on the left / right side of one frame. Represents. The video decoding unit 30 decodes the side-by-side video signal arranged on the left / right side of the left-eye and right-eye video frames, and the video conversion processing unit 32 decodes the decoded Side- Each frame of the by-Side video signal is separated into left and right images so that it becomes a left-eye image and a right-eye image, and is further scaled (expanded / interpolated or compressed / decimated to match the horizontal size of the output image) )do. Further, as represented by the right frame sequence (L1, R1, L2, R2, L3, R3,...), Frames are alternately output as video signals.

  In FIG. 39 (a), the processing after the conversion to the output / display video for alternately outputting / displaying the frame, the output of the synchronization signal and the control signal to the 3D viewing assistance device, etc. have already been described. Since this is the same as the 3D playback / output / display processing of 3D content in the 3D2 viewpoint-specific ES transmission method described in (a), description thereof is omitted.

  FIG. 39 (b) shows the output of the method of displaying the left and right viewpoint video of the 3D content of the Side-by-Side method or Top-and-Bottom method in different areas of the display, and playback / output / display corresponding to the display. It is explanatory drawing of a method. As in FIG. 39 (a), descriptions of side-by-side and top-and-bottom methods are shown together as encoded video, but the difference between the two is that the video for the left eye and the video for the right eye In the following description, description will be made using the Side-by-Side method, and description of the Top-and-Bottom method will be omitted. The left-side frame sequence (L1 / R1, L2 / R2, L3 / R3...) Is a side-by-side video signal in which left-eye and right-eye images are arranged on the left / right side of one frame. Represents. The video decoding unit 30 decodes the side-by-side video signal arranged on the left / right side of the left-eye and right-eye video frames, and the video conversion processing unit 32 decodes the decoded Side- Each frame of the by-Side video signal is separated into left and right images so that it becomes a left-eye image and a right-eye image, and is further scaled (expanded / interpolated or compressed / decimated to match the horizontal size of the output image) )do. Further, the scaled left-eye video and right-eye video are output and displayed in different areas. Similar to the description in FIG. 37 (b), displaying in different areas means, for example, that the odd lines and even lines of the display are used as the display areas for the main viewpoint (left eye) and the sub viewpoint (right eye), respectively. There are methods such as displaying. In addition, the display processing in different areas, the display method in the polarization type display device, and the like are the same as the 3D playback / output / display processing of 3D content of the 3D2 viewpoint-specific ES transmission method described in FIG. Therefore, the description is omitted.

  In the method of FIG. 39 (b), when the vertical resolution of the display and the vertical resolution of the input video are the same, the left-eye video and the right-eye video are output and displayed on the odd-numbered line and the even-numbered line of the display, respectively. In some cases, it is necessary to reduce the vertical resolution of each, but in such a case as well, thinning corresponding to the resolution of the display area of the left-eye video and the right-eye video may be performed in the scaling process.

<2D output / display processing of 3D content in Side-by-Side format / Top-and-Bottom format>
The operation of each unit when performing 2D display of 3D content in Side-by-Side format or Top-and-Bottom format will be described below. When the user gives an instruction to switch to 2D video (for example, pressing the “2D” key on the remote control), the user instruction receiving unit 52 that has received the key code instructs the system control unit 51 to switch the signal to 2D video. (Note that the following processing is the same even when switching to 2D output / display under conditions other than the user switching instruction to 2D output / display of 3D content in the Side-by-Side format or Top-and-Bottom format) Process). The system control unit 51 that has received the instruction instructs the video conversion control unit 61 to output 2D video. The video conversion control unit 61 that has received the instruction from the system control unit 51 performs control so that 2D video output is performed on the video signal input to the video conversion processing unit 32.

  A video 2D output / display method will be described with reference to FIG. FIG. 40 (a) illustrates the Side-by-Side method, and FIG. 40 (b) illustrates the Top-and-Bottom method. Both differ only in the arrangement of the left-eye video and the right-eye video. Therefore, the description will be made using the Side-by-Side method of FIG. The left-side frame sequence (L1 / R1, L2 / R2, L3 / R3...) Is a side-by-side system in which video signals for left eye and right eye are arranged on the left / right side of one frame. Represents a video signal. The video conversion processing unit 32 separates each frame of the input side-by-side video signal into left and right left-eye video and right-eye video frames, and then only the main viewpoint video (left-eye video) portion. Is scaled, and only the main viewpoint video (left-eye video) is output as a video signal as represented by the right frame sequence (L1, L2, L3,...).

  The video conversion processing unit 32 outputs the processed video signal as a 2D video from the video output 41 and outputs a control signal from the control signal 43. In this way, 2D output / display is performed.

  FIGS. 40C and 40D also show an example of performing 2D output / display of 3D content of the Side-by-Side system or Top-and-Bottom system as it is, with 2 viewpoints stored in one image. For example, as shown in FIG. 36, when the receiving device and the viewing device have different configurations, the receiving device stores the decoded side-by-side or top-and-bottom video in two viewpoints in one image. The video may be output as it is, and the viewing device may perform conversion for 3D display.

<Example of 2D / 3D video display processing flow based on whether or not the current program is 3D content>
Next, content output / display processing when the current program is 3D content or when the current program becomes 3D content will be described. When viewing the 3D content when the current program is a 3D content program or when it becomes a 3D content program, if the display of the 3D content is unconditionally started, the user cannot view the content. There is a possibility that the convenience of the user is impaired. On the other hand, user convenience can be improved by performing the following processing.

  FIG. 41 is an example of a processing flow of the system control unit 51 that is executed when the current program or program information is changed at the time of program switching. In the example of FIG. 41, the flow is for performing 2D display of video from one viewpoint (for example, the main viewpoint) for both 2D programs and 3D programs.

  The system control unit 51 acquires the program information of the current program from the program information analysis unit 54, determines whether or not the current program is a 3D program by the above 3D program determination method, and further determines the 3D system type of the current program (For example, determination based on the 3D system type described in the 3D program detail descriptor, such as 2-view ES transmission system / Side-by-Side system) is obtained from the program information analysis unit 54 in the same manner (S401). The acquisition of the program information of the current program is not limited to when the program is switched, and may be acquired periodically.

  As a result of the determination, if the current program is not a 3D program (No in S402), control is performed so that 2D video is displayed in 2D (S403).

  When the current program is a 3D program (Yes in S402), the system control unit 51 uses the method described in FIGS. 38 and 40 (a) and 40 (b) to generate a 3D video signal in a format corresponding to each 3D system type. Control is performed so that one of the viewpoints (for example, the main viewpoint) is displayed in 2D (S404). At this time, a display indicating that the program is a 3D program may be displayed superimposed on the 2D display video of the program. In this way, when the current program is a 3D program, the video from one viewpoint (for example, the main viewpoint) is displayed in 2D.

  Even when the channel selection operation is performed and the current program is changed, the above-described flow is performed in the system control unit 51.

  As described above, when the current program is a 3D program, the video of one viewpoint (for example, the main viewpoint) is displayed in 2D for the time being. As a result, even if the user is not ready for 3D viewing, such as when the user is not wearing a 3D viewing assistance device, the user can view almost the same as the 2D program for the time being. In particular, in the case of 3D content in the Side-by-Side format or Top-and-Bottom format, as shown in FIGS. As shown in FIGS. 40 (a) and 40 (b), an instruction for 2D display of one viewpoint from a video stored in two viewpoints in one image by using 2D output / display of one viewpoint, a remote control or the like Even if the user does not perform it manually, it is possible for the user to view the program in the same way as a normal 2D program.

  Next, FIG. 42 shows an example of a message that is displayed in 2D in step S404 and the system control unit 51 displays on the OSD creation unit 60, for example. A message notifying the user that the 3D program has started is displayed, and an object (hereinafter referred to as a user response receiving object: for example, a button on the OSD) 1602 to which the user responds is displayed, and the subsequent operation is selected.

  When the message 1601 is displayed, for example, when the user presses the “OK” button on the remote controller, the user instruction receiving unit 52 notifies the system control unit 51 that “OK” has been pressed.

  As an example of a user selection determination method in the screen display of FIG. 42, when the user operates the remote control and presses the <3D> button on the remote control, or moves the cursor to “OK / 3D” on the screen and <OK> on the remote control When the button is pressed, the user selection is determined as “3D switching”.

  Or, when the user presses the <Cancel> button or <Return> button on the remote control, or when the cursor is placed on "Cancel" on the screen and <OK> is pressed on the remote control, the user selection is determined to be "other than 3D switching" To do. In addition to this, for example, when an operation is performed in which the state of whether or not the user is ready for 3D viewing (3D viewing preparation state) is OK (for example, wearing 3D glasses), the user selection is “3D switching”. "

  FIG. 43 shows a processing flow of the system control unit 51 executed after the user makes a selection. The system control unit 51 acquires the user selection result from the user instruction receiving unit 52 (S501). If the user selection is not “3D switching” (No in S502), the video ends in 2D display, and no processing is performed.

  When the user's selection is “3D switching” (yes in S502), the video is displayed in 3D by the above 3D display method (S504).

  With the above flow, when the 3D program starts, the video of one viewpoint is output / displayed in 2D, and the user wants to perform 3D viewing, such as after the user prepares for operation or 3D viewing, etc. Can be output / displayed to view the video in 3D, and a viewing method suited to the convenience of the user can be provided.

  In the display example of FIG. 42, the object for the user to respond to is displayed. However, a character that simply indicates that the program is a program corresponding to “3D viewing”, such as “3D program”, or It is also possible to display only a logo, a mark or the like. In this case, the user who has recognized that the program is compatible with “3D viewing” depresses the “3D” key of the remote controller and receives the signal from the remote controller from the user instruction receiver 52 to the system controller 51. Switching from 2D display to 3D display is triggered by the notification.

  Furthermore, as another example of the message display displayed in step S404, a method of clearly indicating whether the program display method is 2D video or 3D video as well as simply OK as shown in FIG. . FIG. 44 shows an example of the message and the user response reception object in that case.

  This makes it easier for the user to determine the operation after the button is pressed as compared to the “OK” display as shown in FIG. 42, and allows the user to explicitly indicate a 2D display (see “2D described in 1202”). When “view with” is pressed, the user 3D viewing preparation state is determined to be NG), and convenience is improved.

  Next, an example in which specific video / audio is output or video / audio is muted (black screen display / display stop, audio output is stopped) when 3D program viewing is started will be described. This is when the user starts viewing a 3D program. If the display of the 3D content is started unconditionally, the user cannot view the content, and there is a possibility that the convenience of the user is impaired. On the other hand, user convenience can be improved by performing the following processing. FIG. 45 shows a processing flow executed by the system control unit 51 at the start of the 3D program in this case. A difference from the processing flow of FIG. 41 is that a step (S405) of outputting specific video and audio is added instead of the processing of S404.

  The specific video / audio here includes, for example, a 3D preparation message, a black screen, a still image of a program, etc. for video, and the audio includes silence or fixed pattern music (environmental music), etc. Is mentioned.

  For display of fixed pattern video (message, environment video, 3D video, etc.), data is read from the video decoding unit 30 or from a ROM or recording medium 26 not shown in the figure, and the video decoding unit 30 decodes and outputs the data. This can be achieved. The output of the black screen can be realized, for example, by the video decoding unit 30 outputting only the video signal indicating black, or the video conversion processing unit 32 muting the output signal or outputting the black video.

  Similarly, in the case of fixed pattern sound (silence, environmental music), it can be realized by reading out data from the inside of the sound decoding unit 31 or from the ROM or the recording medium 26, decoding output, muting output signals, and the like.

  The output of the still image of the program video can be realized by instructing the recording / playback control unit 58 from the system control unit 51 to play back the program and pause the video. The processing of the system control unit 51 after the user selection is executed as shown in FIG.

  This makes it possible to prevent the program video and audio from being output until the user completes preparation for 3D viewing.

  Similar to the above example, the message display displayed in step S405 is as shown in FIG. The difference from FIG. 42 is that only the displayed video and audio are different, and the displayed message, the configuration of the user response receiving object, and the operation of the user response receiving object are the same.

  As for the message display, not only simply OK as shown in FIG. 46, but also a method of clearly specifying whether the display method of the program is 2D video or 3D video. In this case, the message and an example of the user response receiving object can be displayed in the same manner as in FIG. 44. In this way, the user can judge the operation after pressing the button more than the display of “OK” as described above. In addition to facilitating the convenience, it is possible to explicitly instruct display in 2D, and the convenience is improved as in the above example.

<Example of 2D / 3D video display processing flow based on whether the next program is 3D content>
Next, content output / display processing when the next program is 3D content will be described. Regarding the viewing of the 3D content program that is the next program when the next program is 3D content, if the user is not in a state of viewing the 3D content and the display of the 3D content starts, the user is best. In such a state, the content cannot be viewed, which may impair user convenience. On the other hand, user convenience can be improved by performing the following processing.

  In FIG. 27, when the time until the start of the next program changes due to channel selection processing or the like, or by the start time of the next program or the end time information of the current program included in the EIT of the program information transmitted from the broadcast station, It is an example of the flow performed by the system control unit 51 when it is determined that the start time of the next program has changed. First, the system control unit 51 acquires program information of the next program from the program information analysis unit 54 (S101), and determines whether or not the next program is a 3D program by the 3D program determination method.

  If the next program is not a 3D program (No in S102), the process ends without performing any particular process. When the next program is a 3D program (yes in S102), the time until the start of the next program is calculated. Specifically, the start time of the next program or the end time of the current program is acquired from the EIT of the acquired program information, the current time is acquired from the time management unit 55, and the difference is calculated.

  If it is not less than X minutes until the next program start (No in S103), the process waits until X minutes before the next program start without any particular processing. When it is X minutes or less until the next program start (yes in S103), a message is displayed to the user that the 3D program will start soon (S104).

  FIG. 28 shows an example of message display at that time. Reference numeral 701 denotes an entire screen displayed by the apparatus, and reference numeral 702 denotes a message displayed by the apparatus. In this way, it is possible to alert the user to prepare the 3D viewing assistance device before the 3D program is started.

  As for the determination time X before the start of the program, if X is reduced, the user may not be ready for 3D viewing before the start of the program. Further, if X is increased, there is a demerit that message display is hindered for a long period of time, and there is a gap after preparation is completed, so it is necessary to adjust to an appropriate time.

  Further, when displaying a message to the user, the start time of the next program may be specifically displayed. FIG. 29 shows a screen display example in that case. A message 802 displays the time until the start of the 3D program. Here, description is made in units of minutes, but description may be made in units of seconds. In that case, the user can know the start time of the next program in more detail, but there is a demerit that the processing load increases.

In addition, although the example which displays the time until a 3D program is started was shown in FIG. 29, you may make it display the time when a 3D program starts. When the 3D program starts at 9:00 pm, for example, a message “3D program starts from 9:00 pm. Please wear 3D glasses” may be displayed.
By displaying such a message, the user can know the specific start time of the next program and prepare for 3D viewing at an appropriate pace.

  In addition, as shown in FIG. 30, it is also conceivable to add a mark (3D check mark) that looks stereoscopic when using the 3D viewing assistance device. 902 is a message for notifying the start of a 3D program, and 903 is a mark that looks three-dimensional when the 3D viewing assistance device is used. Thereby, the user can confirm the normal operation of the 3D viewing assistance device before the start of the 3D program. For example, when a malfunction (for example, battery exhaustion or failure) occurs in the 3D viewing assistance device, it is possible to take measures such as repair or replacement before the program starts.

  Next, after notifying the user that the next program is 3D, it is determined whether or not the user is ready for 3D viewing (3D viewing preparation state), and the video of the 3D program is displayed in 2D or 3D. A method of switching to will be described.

  The method for notifying the user that the next program is 3D is as described above. However, the message displayed to the user in step S104 is different in that an object to which the user responds (hereinafter, a user response receiving object: for example, a button on the OSD) is displayed. An example of this message is shown in FIG.

  Reference numeral 1001 denotes an entire message, and reference numeral 1002 denotes a button for a user to respond. When the message 1001 in FIG. 31 is displayed, for example, when the user presses the “OK” button on the remote controller, the user instruction receiving unit 52 notifies the system control unit 51 that “OK” has been pressed.

  The system control unit 51 that has received the notification stores the state that the user's 3D viewing preparation state is OK as a state. Next, a processing flow of the system control unit 51 when time has elapsed and the current program becomes a 3D program will be described with reference to FIG.

  The system control unit 51 acquires program information of the current program from the program information analysis unit 54 (S201), and determines whether or not the current program is a 3D program by the above-described 3D program determination method. When the current program is not a 3D program (No in S202), control is performed so that the video is displayed in 2D by the above method (S203).

  If the current program is a 3D program (yes in S202), then the user's 3D viewing preparation status is confirmed (S204). If the 3D viewing preparation state stored by the system control unit 51 is not OK (No in S205), the control is similarly performed so that the video is displayed in 2D (S203).

  When the 3D viewing preparation state is OK (Yes in S205), control is performed so that the video is displayed in 3D by the above method (S206). In this way, when it is confirmed that the current program is a 3D program and the user's 3D viewing preparation is completed, the video is displayed in 3D.

  As the message display displayed in step S104, not only simply OK as shown in FIG. 31, but also a method of clearly indicating whether the display method of the next program is 2D video or 3D video is conceivable. Examples of the message and the user response reception object in that case are shown in FIGS.

  In this way, compared to the “OK” display as described above, the user can more easily determine the operation after the button is pressed, and the user can explicitly instruct the display in 2D (see “2D in 1202”). When “view” is pressed, the user 3D viewing preparation state is determined to be NG, and convenience is enhanced.

  The determination of the 3D viewing preparation state of the user is performed by operating the user menu on the remote controller here, but the 3D viewing preparation state is also determined by, for example, a user wearing completion signal transmitted by the 3D viewing assistance device, for example. A method or an imaging device may be used to photograph a user's viewing state, and image recognition or user's face recognition may be performed based on the photographing result to determine that a 3D viewing assistance device is worn.

  By making such a determination, it is possible to save the user from having to perform any operation on the receiving device, and to avoid erroneously setting 2D video viewing and 3D video viewing due to an erroneous operation. Is possible.

  As another method, when the user presses the <3D> button on the remote control, the 3D viewing preparation state is determined to be OK, and the user presses the <2D> button, the <Return> button, or the <Cancel> button on the remote control. There is also a method of determining that the 3D viewing preparation state is NG when pressed. In this case, the user can clearly and easily notify the device of his / her state, but there are also disadvantages such as erroneous operation and state transmission due to misunderstanding.

  In the above example, it is also conceivable to perform processing by determining only the program information of the next program acquired in advance without acquiring information of the current program. In this case, a method of using program information acquired in advance (for example, step S101 in FIG. 27) without determining whether the current program is a 3D program in step S201 in FIG. 32 is also conceivable. In this case, there is a merit that the processing structure becomes simple. However, there is a possibility that the 3D video switching process may be executed even when the program configuration is suddenly changed and the next program is not a 3D program. There are disadvantages.

  The message display for each user described in this embodiment is preferably deleted after a user operation. In this case, there is an advantage that the video can be easily viewed after the user performs the operation. Similarly, after a certain period of time has elapsed, it is assumed that the user has already recognized the message information, and deleting the message to make it easy to view the video improves the user's convenience.

  According to the embodiment described above, the user can complete 3D viewing preparation in advance for the start portion of the 3D program, or the user can use the recording / playback function to start the 3D program when the 3D program is not ready for the start. The user can view the 3D program in a better state, such as displaying video again after preparation for viewing is completed. In addition, it is possible to improve user convenience, such as automatically switching the video display to a display method that is desirable for the user (3D video display when viewing 3D video, or vice versa). The same effect can be expected when switching to a 3D program by channel selection or when starting playback of a recorded 3D program.

  In the above description, an example has been described in which the 3D program detail descriptor described in FIG. 10A is arranged and transmitted in a table such as a PMT (Program Map Table) or an EIT (Event Information Table). Instead of this, or in addition to this, information included in the 3D program detail descriptor may be stored and transmitted in a user data area or an additional information area that is encoded together with the video during video encoding. In this case, these pieces of information are included in the program video ES.

  Examples of information to be stored include the 3d_2d_type (3D / 2D type) information described in FIG. 10B and the 3d_method_type (3D method type) information described in FIG. When storing, the 3d_2d_type (3D / 2D type) information and the 3d_method_type (3D system type) information may be different information. It is good also as information which identifies together with identification of whether it is.

  Specifically, when the video encoding method is the MPEG2 method, encoding is performed by including the 3D / 2D type information and the 3D method type information in the user data area following the Picture header and Picture Coding Extension. Good.

  In addition, when the video encoding method is the H.264 / AVC method, the additional information (supplemental enhancement information) region included in the access unit is encoded including the 3D / 2D type information and the 3D method type information. Can be done.

  As described above, by transmitting the information indicating the type of 3D video / 2D video or the information indicating the type of 3D system in the video encoding layer in the ES, it is possible to identify the video in units of frames (pictures). There is an effect of becoming.

  In this case, since the identification can be performed in a shorter unit than when stored in a PMT (Program Map Table), the response speed of the receiver with respect to switching of 3D video / 2D video in the transmitted video can be improved. This makes it possible to further suppress noise and the like that may occur when switching between 3D video / 2D video.

  In addition, when the above information is stored in a video coding layer that is encoded together with a video at the time of video coding without placing the 3D program detail descriptor in a PMT (Program Map Table), a conventional 2D broadcast broadcast When a 2D / 3D mixed broadcast is newly started at a station, for example, the broadcast station only needs to configure only the encoding unit 12 in the transmission device 1 of FIG. 2 to newly support the 2D / 3D mixed broadcast. It is not necessary to change the configuration of the PMT (Program Map Table) added by the management information adding unit 16, and 2D / 3D mixed broadcasting can be started at a lower cost.

  It should be noted that 3D related information (particularly 3D) such as 3d_2d_type (3D / 2D type) information and 3d_method_type (3D method type) information is added to predetermined areas such as a user data area and additional information area that are encoded together with video during video encoding. / 2D identification information) is not stored, the receiver may be configured to determine that the video is a 2D video. In this case, for the 2D video, the broadcasting station can omit storing these pieces of information during the encoding process, and the processing man-hours in broadcasting can be reduced.

  In the above description, as an example of arranging identification information for identifying 3D video in units of programs (events) and services, it is included in program information such as a component descriptor, a component group descriptor, a service descriptor, and a service list descriptor. The example which provided the 3D program detailed descriptor newly and the example was demonstrated. In addition, these descriptors are transmitted by being included in tables such as PMT, EIT [schedule basic / schedule extended / present / following], NIT, and SDT.

  Here, as yet another example, an example will be described in which identification information of a 3D program (event) is arranged in a content descriptor shown in FIG.

  FIG. 48 shows an example of the structure of a content descriptor that is one piece of program information. The content descriptor describes information on the genre of the event (program). This descriptor is placed in the EIT. In the content descriptor, in addition to event (program) genre information, information indicating program characteristics can be described.

The structure of the content descriptor is as follows. The descriptor_tag is an 8-bit field for identifying the descriptor itself, and a value “0x54” that can identify this descriptor as a content descriptor is described. descriptor_length is an 8-bit field and describes the size of this descriptor.
content_nibble_level_1 (genre 1) is a 4-bit field and represents the first stage classification of content identification. Specifically, the major classification of the program genre is described. Specify "0xE" to indicate program characteristics.
content_nibble_level_2 (genre 2) is a 4-bit field and represents the second stage classification of content identification in more detail than content_nibble_level_1 (genre 1). Specifically, the middle classification of the program genre is described. When content_nibble_level1 = “0xE”, the type of program characteristic code table is described.
user_nibble (user genre) is a 4-bit field and describes the program characteristics only when content_nibble_level1 = “0xE”. In other cases, it is set to “0xFF” (undefined). As shown in FIG. 48, two 4-bit fields of user_nibble can be arranged, and the combination of the values of the two user_nibble (hereinafter, the first arranged bit is “first user_nibble bit” and arranged later) Bits are referred to as “second user_nibble bits”) to define program characteristics.

  If the descriptor_tag is “0x54”, the receiver that has received the content descriptor determines that the descriptor is a content descriptor. Further, the end of data described by this descriptor can be determined by descriptor_length. Further, it is determined that the description of the portion equal to or shorter than the length indicated by descriptor_length is valid, and the processing of the portion exceeding the length is ignored.

  Further, the receiver determines whether or not the value of content_nibble_level_1 is “0xE”. If the value is not “0xE”, the receiver determines that the program category is a major category. When it is not “0xE”, it is not determined as a genre, and it is determined that some program characteristic is specified by the subsequent user_nibble.

  If the value of the content_nibble_level_1 is not “0xE”, the receiver determines that the content_nibble_level_2 is a medium category of the program genre, and uses it for searching, displaying, etc. together with the large category of the program genre. If the value of the content_nibble_level_1 is “0xE”, it is determined that it indicates the type of program characteristic code table defined by the combination of the first user_nibble bit and the second user_nibble bit.

  When the value of the content_nibble_level_1 is “0xE”, the receiver determines that the first user_nibble bit and the second user_nibble bit are bits indicating program characteristics by combining them. When the value of the content_nibble_level_1 is not “0xE”, any value in the first user_nibble bit and the second user_nibble bit is ignored.

  Therefore, if the content_nibble_level_1 value of the content descriptor is not “0xE”, the broadcasting station can transmit the genre information of the target event (program) to the receiver by a combination of the content_nibble_level_1 value and the content_nibble_level_2 value. .

  Here, for example, as shown in FIG. 49, when the value of content_nibble_level_1 is “0x0”, the major category of the program genre is defined as “news / report”, the value of content_nibble_level_1 is “0x0”, and the value of content_nibble_level_2 Is defined as "weather" when the value is "0x1", the value of content_nibble_level_1 is "0x0" and the value of content_nibble_level_2 is "0x2" is defined as "special feature / document", and the value of content_nibble_level_1 is "0x1" In this case, the major category of the program genre is defined as “sports”, and the content_nibble_level_1 value is “0x1” and the content_nibble_level_2 value is “0x1” is defined as “baseball”, and the content_nibble_level_1 value is “0x1” The case where the value of content_nibble_level_2 is “0x2” is defined as “soccer”.

  In this case, the receiver can determine whether the major category of the program genre is “news / report” or “sports” based on the value of content_nibble_level_1. The combination of the value of content_nibble_level_1 and content_nibble_level_2 It is possible to determine up to the middle category of the program genre, which is a lower program genre than the major category of the program genre such as “/ report” and “sports”.

  In order to realize the determination process, genre code table information indicating the correspondence between the combination of the value of content_nibble_level_1 and the value of content_nibble_level_2 and the definition of the program genre may be stored in advance in the storage unit of the receiver. .

  Here, a case will be described in which the 3D program-related program characteristic information of the target event (program) is transmitted using the content descriptor. Hereinafter, a case will be described in which identification information of a 3D program is transmitted as a program characteristic instead of a program genre.

  First, when transmitting 3D program-related program characteristic information using a content descriptor, the broadcast station transmits the content descriptor's content_nibble_level_1 value as “0xE”. Thereby, the receiver can determine that the information transmitted by the content descriptor is not the genre information of the target event (program) but the program characteristic information of the target event (program). Further, it can be determined that the first user_nibble bit and the second user_nibble bit described in the content descriptor indicate the program characteristic information by the combination thereof.

  Here, for example, as shown in FIG. 50, when the value of the first user_nibble bit is “0x3”, the program characteristic information of the target event (program) transmitted by the content descriptor is “3D program related program characteristics”. Information ”, the program characteristics when the value of the first user_nibble bit is“ 0x3 ”and the value of the second user_nibble bit is“ 0x0 ”,“ 3D video is included in the target event (program) ” And the program characteristics when the value of the first user_nibble bit is “0x3” and the value of the second user_nibble bit is “0x1” are “the target event (program) video is 3D video” If the value of the first user_nibble bit is “0x3” and the value of the second user_nibble bit is “0x2”, the program characteristics are defined as “3D video and 2D video during the target event (program)”. Will be described.

  In this case, the receiver can determine the 3D program-related program characteristics of the target event (program) by the combination of the value of the first user_nibble bit and the value of the second user_nibble bit, and the content descriptor is included. In the electronic program guide (EPG) display, the receiver that has received the EIT indicates that “a 3D video is not included” for a program that is received in the future or that is currently received, and that it is a “3D video program” for the program. With respect to the program, it is possible to display an explanation to the effect that “3D video and 2D video are included” and to display a graphic indicating the fact.

  In addition, the receiver that has received the EIT including the content descriptor can search for a program that does not include 3D video, a program that includes 3D video, a program that includes 3D video and 2D video, and the like. It is possible to display a list of programs.

  In order to realize the determination process, a program characteristic code table indicating a correspondence relationship between the combination of the value of the first user_nibble bit and the value of the second user_nibble bit and the definition of the program characteristic is stored in the storage unit of the receiver. Information may be stored in advance.

  As another definition example of the program characteristic information related to the 3D program, for example, as shown in FIG. 51, when the value of the first user_nibble bit is “0x3”, the target event (program to be transmitted by the content descriptor) ) Is defined as “program characteristic information related to 3D program”, the value of the first user_nibble bit is “0x3”, and the value of the second user_nibble bit is “0x0” The characteristic is defined as “the target event (program) does not include 3D video”, and the value of the first user_nibble bit is “0x3” and the value of the second user_nibble bit is “0x1” Is defined as “the target event (program) includes 3D video and the 3D video transmission method is the Side-by-Side method”, and the value of the first user_nibble bit is “0x3” and the second When the user_nibble bit value is “0x2”, the program characteristics are set to “Target event (program 3D video is included, and the 3D video transmission method is a top-and-bottom method ”, the value of the first user_nibble bit is“ 0x3 ”and the value of the second user_nibble bit is“ 0x3 ” The case where “3D video is included in the target event (program) and the 3D video transmission method is the 3D2 viewpoint-specific ES transmission method” will be described.

  In this case, the receiver can determine the 3D program-related program characteristics of the target event (program) based on the combination of the value of the first user_nibble bit and the value of the second user_nibble bit. It is possible to determine the 3D transmission method when not only the video is included but also the 3D video is included. If information on a 3D transmission method that can be supported by the receiver (3D playback is possible) is stored in advance in a storage unit included in the receiver, the receiver can perform the corresponding (reproduceable) 3D transmission stored in the storage unit in advance. By comparing the system information with the 3D transmission system information of the target event (program) determined by the content descriptor included in the EIT, in the electronic program guide (EPG) display, it is received in the future or currently received “3D video is not included” for the program, “3D video is included and 3D playback is possible with this receiver” for the program, and “3D video is included with the receiver,” It is possible to display an explanation to the effect that “3D playback is not possible” and to display a graphic indicating that effect.

  Further, in the above example, the program characteristic when the value of the first user_nibble bit is “0x3” and the value of the second user_nibble bit is “0x3” is “the target event (program) includes 3D video. The 3D video transmission method is a 3D2 viewpoint-specific ES transmission method ”, but a second user_nibble bit value is prepared for each detailed stream combination of the“ 3D2 viewpoint-specific ES transmission method ”shown in FIG. May be. In this way, further detailed identification is possible at the receiver.

  Moreover, you may display the information of the 3D transmission system of an object event (program).

  A receiver that receives an EIT including the content descriptor includes a program that does not include 3D video, a program that includes 3D video, and a 3D video that can be played back by the receiver. It is possible to search for programs that cannot be played back in 3D, and to display a list of the corresponding programs.

  In addition, programs that include 3D video can be searched for each 3D transmission system, and a list of programs can be displayed for each 3D transmission system. Searching for programs that include 3D video but cannot be played back in 3D with this receiver, or search for programs for each 3D transmission method, for example, playback of other 3D video programs that the user has even if 3D playback is not possible with this receiver. This is effective when playback is possible on the device. Even if a program includes 3D video that cannot be played back in 3D by this receiver, the program is output from the video output unit of this receiver to another 3D video program playback device in the form of a transport stream. It is also possible to 3D play the received transport stream program on the playback device, and if the receiver has a recording unit for recording content on the removable medium, the program is recorded on the removable medium. This is because the above-mentioned program recorded on the removable medium can be played back in 3D by the other 3D video program playback device.

  In order to realize the determination process, a program characteristic code indicating the correspondence between the combination of the value of the first user_nibble bit and the value of the second user_nibble bit and the definition of the program characteristic is stored in the storage unit of the receiver. The table information and the information of the 3D transmission method that the receiver can support (3D playback is possible) may be stored in advance.

<Regulation and operation of subtitle data transmission>
When subtitle data is superimposed on a 3D video program transmitted from the transmission device, 3D display can be supported by adding depth information to the subtitle data.

  For example, the following subtitle / superimpose service is provided for the transmitted data. That is, the subtitle service is a subtitle service synchronized with the main video / audio / data (eg, translated subtitles), and the superimpose service is a subtitle service asynchronous with the main video / audio / data. (Eg, breaking news, organization change, hourly report, earthquake early warning, etc.).

  As restrictions on organization and transmission at the time of stream creation on the transmission device side, subtitles and character supers are transmitted by the independent PES transmission method (0x06) in the allocation of stream format types shown in FIG. 3, for example. Subtitles and superimpose are transmitted by separate ESs. Also, it is transmitted at the same time with the same PMT as the main video data etc., and subtitle data is not pre-distributed within the same program or before the start of the program. 1 ES each, and 2 ES in total, and at the same time the same layer (with the hierarchy, it is possible to use different modulation schemes in one transmission, and the frequency band transmitted in each modulation scheme. The number of ESs of subtitles / superimposes that can be transmitted to a superimposed data group is 2 ES, one ES each. In addition, for each temporary organization channel, the maximum number of subtitle ES and the maximum number of character super ES is 1, and the maximum number of languages that can be transmitted at the same time is 2 languages per ES. The number used to identify the language) is determined by subtitle management data (described later) in the ES. Bitmap data can be used for superimposing characters. Only “Recording / reproduction selection display” and “Reception selection / recording / reproduction selection display” (each display method will be described later) can be used. In superimpose, “Automatic display during reception / automatic display during recording / playback”, “Automatic display during reception / selection display during recording / playback”, “Selection display during reception / selection display during recording / playback” (each display method will be described later) ) Can only be operated. When transmitting a plurality of languages, the display modes (described later) of these languages are the same. Contrary to this, the receiver operation depends on the receiver implementation, but automatic display is given priority, and the warning sound in subtitles / superimposed characters is the receiver built-in sound (common to multiple scenes). The audio data to be used can be operated only if it is stored in the memory in the receiving device 4 in advance. The additional sound (sound effect sound transmitted from the transmission apparatus 1 each time) is controlled by the target region descriptor of the PMT when neither the caption nor the character superimposing is operated, and the target region is designated. However, for subtitles, the operation to specify the target area of the subtitles alone is not performed. In the character supermarket, it is possible to perform an operation of designating a target area of the character supermarket alone. In this case, character supermarkets with different target areas are transmitted at different times, and the data superscript is not described because the character supermarket is not related to the event (the program concerned). In the case of subtitles, one descriptor per ES is described. However, if the parameters do not match the settings of the PMT data encoding descriptor and subtitle management data, each parameter such as the display mode, the number of languages, and the language code in the receiver operation is the PMT data encoding descriptor. And subtitle management data settings are given priority, and subtitle management data includes necessary information for displaying subtitles / superimposed characters, so subtitle text is displayed until subtitle management data is received. I can't. Therefore, in consideration of channel selection, etc., when sending normal subtitles / superimposed characters, predetermined intervals (for example, maximum transmission frequency: once / 0.3 seconds, minimum transmission frequency: once / 5.0 seconds, but CM (commercial) The subtitle management data may be interrupted by a message).

  As a PES transmission method used for subtitles, a synchronous PES transmission method is applied, and timing synchronization is achieved by PTS. As the PES transmission method used in the character superposition, an asynchronous PES transmission method is applied.

  An example of the subtitle PES data format transmitted from the transmission apparatus 1 to the reception apparatus 4 is shown in FIG. 52, and the parameters set in the subtitle PES packet are shown in FIG. 53 (a). The PES data format is the same for the character super, and the parameters set in the character super PES packet are shown in FIG. 52 corresponds to PES_data_private_data_byte from Stream_id in FIG. 53, and Syncronized_PES_data_byte corresponds to the data group portion. For Stream_id, data_identifier, and private_stream_id, the receiver can recognize subtitle data and character super data by using the prescribed values described in the figure. The data group includes a data group header and data group data, and parameters thereof are shown in FIG. The data group header in FIG. 52 corresponds to the data_group_size field from data_group_id in FIG. 54, includes information indicating the type and size of caption data, and the data group data corresponds to data_group_data_byte.

  25 receives the PES data in the data format shown above, the demultiplexer 29 classifies the data by looking at the values of Stream_id and data_identifier, and stores the data on a memory not shown in the figure. Expand by type.

  The data group data is transmitted by subtitle management data and subtitle sentence data of 0 or a maximum of eight languages. FIG. 55 shows possible values and meanings of the data group ID included in the data group header. By referring to this number, it is possible to determine whether the data group data is caption management data or caption text data, and it is possible to determine the language type (Japanese, English,...) Of caption text data. The data_group_id is to be transmitted by switching the data group from the set A to the set B and from the set B to the set A in accordance with the update of the caption management data. However, when subtitle management data is not transmitted for more than 3 minutes, either group A or group B may be transmitted regardless of the previous group. data_group_version is not used. When subtitle management data is set A, the receiver processes only subtitle text (text, bitmap data, DRCS) only for set A, and when subtitle management data is set B, the receiver only processes subtitle text for set B. Process. When subtitle management data of the same set as the currently received subtitle management data is received, it is processed as retransmitted subtitle management data, and the initialization operation by the subtitle management data is not performed. When a subtitle sentence of the same set as the currently received subtitle management data is received a plurality of times, each subtitle sentence is processed as a new subtitle sentence.

  The subtitle management data includes information shown in FIG. 56, and is used to transmit setting information and the like. FIG. 56A shows the parameters of caption management data in captions.

  TMD means a time control mode, and the time control mode at the time of reception and reproduction is indicated by a 2-bit field. When the 2-bit value is “00”, it indicates that the mode is “free” and there is no restriction to synchronize the playback time with the clock. In the case of “01”, the mode “real time” is indicated, and the reproduction time follows the time of the clock calibrated by the clock calibration of the clock signal (TDT). Or it means that the playback time is based on PTS. In the case of “10”, the mode indicates “offset time”, which means that the reproduction time is set to a new reproduction time that is obtained by adding the offset time to the reproduction time, and reproduction is performed according to a clock calibrated by clock calibration of the clock signal. '11' is a reserved value and is not used.

  num_languages (number of languages) means the number of languages included in ES of this caption / superimpose. The language_tag (language identification) is a number for identifying a language, and means 0: first language,... 7: eighth language.

  DMF means display mode, and the display mode of caption text is indicated by a 4-bit field. In the display mode, the presentation operation during reception and recording / reproduction is represented by 2 bits each, and the upper 2 bits indicate the presentation operation during reception. In the case of “00”, automatic display at the time of reception is shown. In the case of “01”, automatic non-display at the time of reception is shown. In the case of “10”, a selection display at the time of reception is shown. In the case of “11”, automatic display / non-display of the specific condition at the time of reception is shown. The lower 2 bits indicate a presentation operation during recording / reproduction. When “00”, automatic display during recording / reproduction is indicated. In the case of “01”, automatic non-display during recording / reproduction is shown. In the case of “10”, a recording / reproduction selection display is shown. The case of “11” is undefined. The designation of the display or non-display condition when the display mode is “specific condition automatic display / non-display” specifies, for example, the display of a rejection message at the time of rain attenuation. An example of the operation at the start and end of display in each display mode is shown in FIG.

  ISO_639_language_code (language code) represents a language code corresponding to the language identified by language_tag as a three-letter code defined in ISO639-2.

  format (display format) indicates the initial state of the display format of the caption display screen. For example, designation is made such that horizontal writing is performed in a display area of horizontal 1920 pixels and vertical 1080 pixels, and vertical writing is performed in a display area of horizontal 960 pixels and vertical 540 pixels.

  TCS (character encoding scheme) indicates the type of character encoding scheme. For example, encoding with 8 unit codes is designated.

  data_unit_loop_length (data unit loop length) defines the total byte length of the subsequent data unit. If no data unit is arranged, the value is 0.

  In data_unit () (data unit), a data unit that is valid for the entire caption program transmitted in the same ES is arranged.

  Regarding the operation of caption management data, a plurality of data units having the same or different data unit parameters can be arranged in the same caption management data. When there are a plurality of data units in the same caption management data, they are processed in the order of appearance of the data units. However, the data that can be described in the text is only SWF, SDF, SDP, SSM, SHS, SVS, and SDD control codes (described later), and character code sets that accompany screen display cannot be described.

  Subtitle management data used for subtitles must be sent at least once every three minutes. When caption management data has not been received for 3 minutes or more, the receiver performs an initialization operation at the time of channel selection.

  For subtitle management data used in character superimposition, TMD can be set not only for free but also in real time to perform time synchronization by STM (presentation start time that can be specified by time control data TIME) in consideration of time signal super. And When caption management data has not been received for 3 minutes or more, the receiver performs an initialization operation at the time of channel selection. FIG. 56B shows parameters that can be specified for the caption management data used in the character superimposition. The definition of the parameters used in FIG. 56B is the same as that in FIG.

  A plurality of data units having the same or different data unit parameters can be arranged in the same caption text data. When there are a plurality of data units in the same caption text data, they are processed in the order of appearance of the data units. The parameters that can be set in the caption text data are shown in FIG. STM (presentation start time) indicates the presentation start time of the subsequent caption text. The presentation start time is encoded in the order of hour, minute, second, and millisecond using nine 4-bit binary coded decimal numbers (BCD). The end of presentation depends on the code of the character code part.

  Further, FIG. 58 shows parameters that can be set in the data unit.

  unit_separator (data unit separation code) is 0x1F (fixed value).

  data_unit_parameter (data unit parameter) identifies the type of data unit. For example, by specifying the data unit as the main text, the function can transmit the text data that composes the caption text, the transmission of setting data such as the display area in the caption management, or the geometric graphic data transmission function that can be specified as geometric Represents.

  data_unit_size (data unit size) indicates the number of bytes of the subsequent data unit data.

  Data unit data to be transmitted is stored in data_unit_data_byte (data unit data). DRCS refers to graphic data that is handled as a kind of external character.

  In the receiving device 4 of FIG. 25, the system control unit 51 reads the caption data (data group header and data group data) developed by the demultiplexing unit 29. When it is detected from the value of the data group ID included in the data group header that the information of the data unit data is caption management data, processing is performed according to the value of each parameter of the caption management data shown in FIG. I do. For example, the subtitle data transfer timing from the system control unit 51 to the video conversion control unit 61 is set by the values of TMD and DMF. If the TMD is “free” and automatically displayed upon reception, the system control unit 51 thereafter transfers the subtitle data to the video conversion control unit 61 immediately after receiving the subtitle data until these data are updated. May be. Further, for example, from the values of num_languages and ISO_639_language_code, the OSD creation unit 60 may be instructed to display the number of caption data and the identified language name on the display 47 in order to notify the user of caption information. Further, for example, the rendering position of the subtitle character string (including characters and graphic data) in the subtitle display plane is designated in the video conversion control unit 61 by Format.

  Further, the system control unit 51 reads the subtitle data, and from the value of the data group ID included in the data group header, if the information of the data unit data is subtitle sentence data, the system control unit 51 corresponds to the parameter value shown in FIG. Process. For example, the caption data included in the subsequent data unit is transferred to the video conversion control unit 61 in accordance with the time indicated in the STM. When the data unit is analyzed and unit_separator is detected, the data type of the subsequent data unit data is determined based on the value of data_unit_parameter immediately after. When control data to be described later is detected in the data unit data, the video conversion control unit 61 is controlled to instruct the display position and decoration method of the caption data. A caption sentence is created from the data unit data (details will be described later), and a caption sentence to be displayed on the display 47 is notified to the video conversion control unit 61 at a predetermined timing. In the video conversion processing unit 32, the video conversion control unit 61 superimposes a character string on the display position determined based on the display control on the display video data output from the video decoding unit 30, and the OSD creation unit 60. A video to be displayed on the display 47 is created by synthesizing with the OSD data created in the above.

  Next, the operation of PSI / SI related to caption / text superimposition will be described.

  The component tag value of the caption ES is set to a value in the range of 0x30 to 0x37, and the component tag value of the character super ES is set to a value in the range of 0x38 to 0x3F. However, the component tag value of the default ES for subtitles is set to 0x30, and the component tag value of the default ES for character superimposing is set to 0x38.

  In principle, the update of the PMT is performed by adding / deleting ES information at the start / end of subtitles and superimposing characters. However, it is also possible to always record ES information.

  The stream identification descriptor (stream_type) of the caption / character super ES is 0x06 (independent PES_packet). FIG. 59 (a) shows PMT and EIT descriptor operations for subtitles / superimpose. In caption transmission, one EIT data content descriptor is described per ES. However, in an application that is not scheduled in advance, such as a bulletin supermarket, an operation that does not insert a data content descriptor into the EIT is allowed. The data_component_id of the data encoding scheme descriptor shown in FIG. 59A is 0x0008 for both the caption and the character superimposition. The parameters set for additional information identification are shown in FIG. For subtitles, the value indicates program synchronization. For character super, it is a value indicating asynchronous or time synchronous.

  The operation of the target area descriptor shown in FIG. 59 (a) describes the information of the target area of the entire service.

  Parameters that can be set in the data content descriptor shown in FIG. 59A are shown in FIGS. 59C and 59D. However, if these setting parameter values are inconsistent with the PMT data encoding descriptor and caption management data during the same event, the setting values of the data encoding descriptor and caption management data have priority. . The value of data_component_id is 0x0008. The entry_component value is the component_tag value of the caption ES. 0 is specified for the value of num_of_component_ref. The component_ref value is not necessary because num_of_component_ref = 0. The value of ISO_639_language_code is fixed to jpn (Japanese). The upper limit of the text_length value is 16 (bytes). The value of text_char describes the content of the caption displayed on the EPG. The value of Num_languages is the same value as caption management data. The value of DMF is the same value as the data encoding scheme descriptor. ISO_639_language_code is the same value as caption management data.

  The receiver 4 analyzes the contents of the PMT, which is one of the PSI information, by the program information analysis unit 54. For example, if the value of the stream identification descriptor is “0x06”, the TS packet having the corresponding PID is subtitled / superimposed. It can be determined that the data is data, and thereafter, a filter setting for separating a packet indicating the PID is set in the demultiplexer 29. As a result, the demultiplexing unit 29 can extract the PES data of caption / character super data. Also, the subtitle display timing of the system control unit 31 and / or the video conversion processing unit 61 is set according to a value indicated by Timing which is a setting parameter included in the data encoding descriptor. If the value of the target area descriptor of the character superimpose does not match the reception area information set by the user using an appropriate method in advance, do not perform a series of processing for subtitle display. good. When data is detected from text_char included in the data content descriptor, the system control unit 51 may use it as data at the time of EPG display. Since the same value is used in the caption management data for each setting parameter in the selector area of the data content descriptor, it is not necessary to perform control, but the system control unit 51 may perform the control as described above.

<Display area>
When the data transmitted from the transmission device 1 in the above format is received and displayed by the reception device 4, for example, the following display format is used. For example, as the display format, 960 × 540 and 720 × 480, horizontal writing and vertical writing, respectively, can be used. Also, the resolution of the video plane (the memory area for storing the display image data after being decoded by the video decoding unit 30) and the display format of the caption / superimpose are determined according to the resolution of the video plane. In the case of 1080, the subtitle / character super display format is 960 × 540, and in the case of the video plane is 720 × 480, the subtitle / superimpose display format is 720 × 480, which is horizontal writing and vertical writing, respectively. The display at 720x480 has the same display format regardless of the aspect ratio of the video. When displaying in consideration of the aspect ratio, correction is made on the transmission side.

  For each subtitle and superimpose, one display area can be set simultaneously. The display area is also effective for bitmap data. The priority of the display area is (1) the value specified by SDF and SDP in the text of caption text data, (2) the value specified by SDF and SDP in the text of updated caption management data, (3) An initial value based on the display format specified in the updated caption management data header. It is assumed that an 8-unit code is used as a character encoding method used in caption / superimpose. In addition, it is desirable that the character font used in the subtitle / superimpose is round gothic. In addition, the character size that can be displayed in the caption / superimpose is 5 sizes of 16 dots, 20 dots, 24 dots, 30 dots, and 36 dots. The character size at the time of sending designates the size. For each size, standard, medium, and small sizes can be used. For example, the standard, medium, and small definitions are, for example, standard characters with the size specified by the control code SSM, medium sizes are half the size of the character direction, and small sizes are the character direction from the standard. The characters in the line direction are half the size.

<About control codes>
The encoding system of the caption data is based on an 8-unit code, and the encoding system is shown in FIG. 60 (a), and the expansion method is shown in FIG. 60 (b). Fig. 61 (a) shows the control contents of code call (calling code sets G0, G1, G2, and G3 to the 8-unit code table) in code extension. FIG. 61 (b) shows the contents of the control of (indicating one code set as G0, G1, G2, or G3 set), and FIG. 61 (c) shows the code set classification and terminal code. The coded representation of each call control and instruction control is represented by “column number / row number” in the coding system shown in FIG. 60A. For example, if the actual data is 0x11, the upper 4 bits are the column number and the lower 4 bits are Indicates the line number and is expressed as 01/1. ESC is 01/11 shown in the code system of caption data in FIG. F is one of the terminal codes shown in FIG. 61 (c), which means that the type of code set to be called is determined by this value, and means that it is the terminal of one instruction content.

The code structures of the Kanji set, alphanumeric set, hiragana set, katakana set, and mosaic set are such that arbitrary characters are assigned to 2-byte or 1-byte data strings. One set of JIS compatible Kanji characters is set to the first Kanji character set shown in JIS X0213: 2004, and two sets of JIS compatible Kanji characters are set to the second set of Kanji characters shown in JIS X0213: 2004. The additional symbol set consists of additional symbols and additional kanji. A non-spacing character and a non-spacing mosaic are specified by, for example, a subsequent code, and are displayed by being combined with a character, a mosaic, a space, or the like.
The code used for the external character code is a 1-byte code or a 2-byte code. The 1-byte gaiji code consists of 15 sets from DRCS-1 to DRCS-15, and each set consists of 94 characters (2/1 to 7/14 are used. In the column number / line number notation method, If the number is written in one digit, the column number shall be indicated by a binary value of 3 bits from b7 to b5).

  The 2-byte external character code set is the DRCS-0 set. DRCS-0 is a code table consisting of 2 bytes.

  In the receiving device 4, code sets used as subtitle sentences (refer to all the codes displayed as subtitles such as the above-described kanji set, alphanumeric set, hiragana set, katakana set, etc., and additional symbol sets and external characters). It is developed in advance on a memory not shown in the figure, and a memory area conforming to the coding system shown in FIG. 60 (a) and memory areas corresponding to G0 to G3 shown in FIG. 60 (b) are secured. Keep it. The system control unit 51 reads the character string from the top in the order in which the subtitle sentence data is received, and when the data string corresponding to the coded representation of the instruction control shown in FIG. The character code set shown in FIG. If a data string corresponding to the coded representation of the call control shown in FIG. 61A is detected in the caption text data, the corresponding code set (any of G0 to G3) is selected as the call destination (GL code shown in FIG. 60 (a)). In the memory area of the area or the GR code area). When the calling form shown in FIG. 61A is a locking shift, once a call is made, it is effective until another code set is called next time. Single shift is a calling method in which only one character immediately following is called and the previous state is restored after the call. Data other than the control command of caption text data (02/1 to 07/14, 10/1 to 15/14) is the column number / row number of the code set read in the GL code area or GR code area at that time This means that the characters corresponding to are used as subtitle sentences. The video conversion control unit 61 secures a memory area for displaying a character string (caption display plane), and numbers from 02/1 to 07/14 and from 10/1 to 15/14 according to the number sequence of caption text data. When a column is detected, the character data mapped to the GL and GR code areas is set as display character string data through the above instruction and call control. The system control unit 51 transmits the caption text data to the video conversion control unit 61, and the video conversion control unit 61 renders display character string data as, for example, bitmap data on the caption display plane. When the system control unit 51 detects the control code (and its parameters), the control code (and its parameters) is transmitted to the video conversion control unit 61, and the video conversion control unit 61 executes processing corresponding thereto. Details of how to use the control code will be described later. Note that it is not always necessary to transmit subtitle text data for each character. For example, a method of storing data for a predetermined time and transmitting the data collectively may be used, or a method of storing data for a predetermined size and transmitting the data collectively. good.

  With this code system and operation, it is possible to specify a control instruction and a character to be displayed, which will be described later, with the same caption text data, and by calling a code set frequently used from G0 to G3 in advance, a huge number of characters It is a mechanism that can specify the characters to be used efficiently from the data. Note that code sets set in the GL code area, the GR code area, and the code areas G0 to G3 at the time of system initialization are defined in advance.

  The macro code set is a function (hereinafter referred to as “macro definition”) representatively used by a series of code strings (hereinafter referred to as “macro sentence”) consisting of character codes (including mosaic graphics and DRCS graphic display graphics) and control codes. ) Code set. Macro definition is performed by macro designation in FIG. The macro code is a 1-byte code and consists of 94 types (2/1 to 7/14 are used). When the macro code is specified, the code string of the macro sentence is decoded. When the macro definition is not performed, the default macro sentence shown in FIG.

  The receiving device 4 reads and understands the subtitle text data and detects the MACRO (09/5), and performs the macro processing immediately after that. Macro codes are allocated so that the frequently used calls and instruction controls shown in the default macro sentence can be expressed easily. When the macro code is detected by the system control unit 51, it is indicated in the default macro sentence. Execute control. As a result, the caption text data can be reduced by expressing the complicated caption processing in a shortened manner.

  As a method for dynamically controlling the display method and display format of caption text data, it is possible to insert a control code into the caption text data. An example of the configuration of the C0 and C1 control codes is shown in FIG. Each control code assigns 00/0 to 01/15 to the C0 control code and 08/0 to 09/15 to the C1 control code in the column number / row number notation method. The types of control codes used in each control code set are shown in FIG. In the present embodiment, a control code indicating the subtitle depth display position is newly included in the extended control code. Character types SDD, SDD2, SDD3, and SDD4 are used as types of control codes to be newly used. A method for specifying the depth display position will be described later.

  An example of the function of the C0 control code is shown below.

  NUL is a “blank” control function, and is a control code that can be added or deleted without affecting the information content. APB is a control function of “retraction of the operation position”, and the operation position is retracted along the operation direction by the length of the display section in the operation direction. When the reference point of the display section exceeds the end of the display area by this movement, the operation position is moved to the opposite end of the display area along the operation direction, and the operation line is moved backward. The APF is a control function of “movement position advance”, and advances the movement position along the movement direction by the length of the display section in the movement direction. When the reference point of the display section exceeds the end of the display area by this movement, the operation position is moved to the opposite end of the display area along the operation direction, and the operation line is advanced. The APD is a control function of “movement line advance”, and moves the operation position to the next line along the line direction by the length of the display section in the line direction. When the reference point of the display section exceeds the edge of the display area by this movement, the operation position is moved to the first line of the display area along the line direction. APU is a control function of “moving operation line backward”, and moves the operation position to the previous line along the line direction by the length of the display section in the line direction. When the reference point of the display section exceeds the end of the display area by this movement, the operation position is moved to the last line of the display area along the line direction. APR is a control function of “operation position line feed”, and moves the operation position to the first position on the same line to advance the operation line. PAPF is a “designated operation position advance” control function, and advances the operation position by the number of times specified by parameter P1 (1 byte). APS is a “motion position designation” control function, and moves the motion position by the number of times specified by the first parameter from the first position of the first line of the display area in the row direction of the display area. The operation position is advanced by the number of times specified by the second parameter by the length in the operation direction of the display section. CS is a control function of “screen erasure”, and puts the display area of the display screen in the erased state. ESC is a control function for “escape” and is a code for extending the code system. LS1 is a control function of “locking shift 1”, and is a code for calling a character code set. LS0 is a control function of “locking shift 0”, and is a code for calling a character code set. SS2 is a control function of “single shift 2”, and is a code for calling a character code set. SS3 is a control function of “single shift 3”, and is a code for calling a character code set.

  An example of the function of the C1 control code is shown below.

  BKF is a control function of “foreground color black and color map lower address designation”, and designates the foreground color as black and the color map lower address (CMLA) that defines the coloring value of the drawing plane as 0. RDF is a control function of “Foreground color red and color map lower address designation”, and designates the foreground color as red and the color map lower address (CMLA) that defines the coloring value of the corresponding drawing plane as 0. GRF is a control function of “specify foreground green and color map lower address”, and specifies the foreground color as green and the color map lower address (CMLA) that defines the coloring value of the corresponding drawing plane as 0. YLF is a control function of “Foreground color yellow and color map lower address designation”. The foreground color is designated as yellow, and the color map lower address (CMLA) that defines the coloring value of the corresponding drawing plane is designated as 0. BLF is a control function of “foreground color blue and color map lower address designation”. The foreground color is designated as blue, and the color map lower address (CMLA) that defines the coloring value of the drawing plane is designated as 0. The MGF is a control function of “foreground color magenta and color map lower address designation”, and designates the foreground color as magenta and the color map lower address (CMLA) that defines the coloring value of the drawing plane as 0. CNF is a control function of “foreground color cyan and color map lower address designation”, and designates the foreground color to cyan and the color map lower address (CMLA) that defines the coloring value of the drawing plane concerned to 0. WHF is a control function of “Foreground color white and color map lower address designation”, and designates the foreground color as white and the color map lower address (CMLA) that defines the coloring value of the drawing plane as 0. COL is a control function of “color designation”, and designates the foreground color, background color, front intermediate color, back intermediate color, and color map lower address (CMLA) by parameters. The color between the foreground color and the background color in the gradation font is defined as a color near the foreground color as a front intermediate color and a color close to the background color as a back intermediate color. POL is a control function of “pattern polarity”. The polarity of characters, mosaics, and other patterns represented by the codes after this control code (for normal polarity, the foreground color and background color remain unchanged, and for the reverse polarity, the foreground color and Specify the background color to be inverted). When non-spacing characters are included, the pattern polarity after synthesis is specified. For the intermediate color in the gradation font, the front intermediate color is converted into the back intermediate color, and the back intermediate color is converted into the front intermediate color. SSZ is a “small size” control function, and the character size is small. MSZ is a “medium size” control function, and the character size is medium. NSZ is a control function of “standard size”, and character size is standard. SZX is a “designated size” control function, and designates the size of a character by a parameter. FLC is a control function of “flushing control”, and specifies the start and end of flushing and the distinction between normal phase and reverse phase by parameters. Normal-phase flushing refers to flushing that starts first on the screen, and reverse-phase flushing refers to flushing in which the phases of light and darkness are reversed from those of normal-phase flushing. WMM is a control function of “write mode change”, and designates a change of the write mode to the display memory by a parameter. The writing mode includes a mode for writing a part designated as a foreground color and a background color, a mode for writing only a part designated as a foreground color, and a mode for writing only a part designated as a background color. For the intermediate color in the gradation font, both the front intermediate color designation part and the back intermediate color designation part are handled as the foreground color. TIME is a control function of “time control” and designates time control by a parameter. The specified time unit shall be 0.1 seconds. The presentation start time (STM), time control mode (TMD), playback time (DTM), offset time (OTM), and performance time (PTM) are not used. Use the display end time (ETM). MACRO is a “macro designation” control function, and designates macro definition start, macro definition mode, and macro definition end by parameter P1 (1 byte). The RPC is a “character repeat” control function, and repeatedly displays one character or mosaic on the display following this code as many times as specified by a parameter. STL is a control function of “underline start and mosaic separation start”. In the display after this code, in the case of mosaic A and B, synthesis is not performed, and when mosaic is included during synthesis by non-spacing and synthesis control After the composition, separation processing (processing to divide the mosaic segment into small segments having a size of 1/2 in the horizontal direction and 1/3 in the vertical direction, and providing a space in each peripheral portion) is performed. In other cases, an underline is added. SPL is a control function of “underline end and mosaic separation end”, and this code ends the underline addition and mosaic separation processing. HLC is a control function of “enclosure control”, and the start and end of enclosure are specified by parameters. CSI is a control function of the “control sequence introducer” and is a code for extending the code system.

  An example of the function of the extended control code (CSI) code is shown below.

  SWF is a control code for “format setting”, selects initialization by a parameter, and performs an initialization operation. As the initial value, format specification such as horizontal writing with standard density or vertical writing with high density, character size, number of characters per line, number of lines are specified. RCS is a control code of “raster color control”, and sets a raster color by a parameter. ACPS is a control code of “motion position coordinate designation”, and designates the motion position reference point of the character display section as a coordinate from the upper left corner of the logical plane by a parameter. SDF is a control code of “display configuration dot designation”, and designates the number of display dots by a parameter. SDP is a “display position designation” control code, and designates the display position of the character screen by the position coordinates of the upper left corner by a parameter. SSM is a control code of “character composition dot designation”, and designates a character dot by a parameter. SHS is a control code of “character spacing designation”, and designates the length in the operation direction of the display section by a parameter. As a result, the movement position moves in units of the length of the design frame plus character spacing. SVS is a control code of “line spacing designation”, and designates the length of the display section in the row direction by a parameter. As a result, the movement line movement is based on a length obtained by adding a line interval to the design frame. GSM is a control code for “character transformation”, and designates character transformation by a parameter. GAA is a control code of “colored section”, and designates a colored section of a character by a parameter. TCC is a control code of “switch control”, and specifies a subtitle switching mode, a subtitle switching direction, and a subtitle switching time by parameters. CFS is a control code of “character font setting”, and designates a character font by a parameter. ORN is a control code for “character decoration designation”, and designates character decoration (bordering, shadowing, hollowing, etc.) and character decoration color from parameters. MDF is a control code for “designation of font”, and designates a font (bold, italic, bold italic, etc.) by a parameter. XCS is a control code of “External character substitution code”, and defines a code string to be replaced and displayed when DRCS or third and fourth level characters cannot be displayed. PRA is a control code for “built-in sound reproduction”, and reproduces a built-in sound designated by a parameter. SRC is a control code of “raster designation”, and designates super display and raster color by parameters. CCC is a control code for “compositing control”, and instructs synthesis control of characters and mosaic patterns by parameters. SCR is a control code for “scroll designation”, and designates a subtitle scroll mode (designation of character direction / line direction and designation of presence / absence of rollout) and scroll speed by parameters. UED is a control code of “invisible data embedding control”, and for the purpose of adding semantic content to a subtitle character string, an invisible data code sequence that is not displayed in a normal subtitle presentation system is embedded. In this control code, the invisible data code string is designated, and the caption display character string to which the invisible data is linked is designated. SDD, SDD2, SDD3, and SDD4 will be described later.

  In the code sequence of the C0 and C1 control codes, parameters are arranged immediately after the control code. The code sequence of the extended control code is arranged in the order of control code (09/11 = CSI), parameter, intermediate character, and termination character. If there are multiple parameters, repeat the parameters and intermediate characters.

  The receiving apparatus 4 analyzes the caption text data in the order of input, and when a data string indicating the C0 and C1 control codes is detected, processing of control contents corresponding to each control code shown in FIG. 64 is performed. For example, when 01/6 is detected in the caption text data, this means PAPF (designated operation position advance), and when the immediately following numerical value is 04/1, for example, the parameter value indicates 1, that is, video conversion control. The unit 61 advances the drawing position on the caption display plane by one character in the horizontal direction. When the extended control code (CSI) is detected, the data is processed as a set until the termination character is detected in the subsequent data, the control function is determined by the termination character, and the control content is determined based on each parameter value therebetween Execute.

  The content once specified by the extended control is continuously reflected in the display content until a different value is specified again by the same type of extended control or the initialization operation of the caption display is performed. For example, when character composition dot designation is performed, after 09/11 (CSI) is detected, 05/7 (F (terminating character)) is read thereafter, and for example between 09/11 and 03/11 (I1 ( The interval between the intermediate characters))) is the parameter P1. For example, if it is 03/5, 03/0, the designation of the number of dots in the horizontal direction is “50”. Similarly, the parameter P2 is from 03/11 to 02/0 (I2 (intermediate character)). For example, in the case of 03/4, 03/0, the designation of the number of dots in the vertical direction is “40”. The display character string data is converted into a size of 50 dots wide and 40 dots high in the code string of the caption text data after that and rendered on the caption display plane. Thereafter, the character configuration dot designation is performed again or initialization is performed. Until this time, the number of dots is used. Other control functions are processed in the same manner to perform arbitrary control.

  The C0 control code mainly controls the operation position and calls the character code set (character codes are grouped as a divided set. In order to display characters in subtitles, it is necessary to specify a set that includes the characters once. For example, when a device is instructed to call a set, such control is performed such that the character data of the set is expanded on a predetermined memory so that the memory area can be used effectively. A sign for). The C1 control code mainly includes control such as designation of character color and character size, flushing, and surrounding control. The extended control code includes detailed control not included in the C0 and C1 control codes. This extended control code includes a depth display position designation control code for 3D display of subtitles.

  An example of a control code for performing 3D display of caption data is shown in FIG.

  A character “SDD” having a control function of “depth display position designation” is newly set. For example, following the value of CSI (Control Sequence Introducer), the control content specifies the depth display position by disparity information of subtitle data of two viewpoints for 3D display. That is, it specifies the difference in the horizontal display position between the caption data displayed on the right-eye image of the two-viewpoint video and the caption data displayed on the left-eye image. Following the CSI information in the control content, a value for specifying the difference between the horizontal display positions in the left and right directions by the number of dots is set in P11... P1i, and then 02/0 (intermediate character I1) and 06/13 ( Continuing with the end character F) constitutes the data. The designated value of the terminal character F may be any value as long as it does not match other control codes, and is not limited to this example.

  In the receiving device 4, when subtitles are superimposed on a 3D program, the subtitle display plane is for the right eye display area plane and the left eye display area in the same manner as two display images are prepared: a right eye display area and a left eye display area. Two planes are prepared, and the same display character string data is drawn so that parallax occurs in each plane. At this time, the depth information of the caption display plane may be a value based on the depth setting of the display video. That is, the state in which the right-eye data and the left-eye data are displayed at the same place on the display 47 in FIG. 69A (also expressed as the position of parallax 0 and the designated position during 2D display) is used as a reference. When the depth display position setting value of the caption data is designated, the image conversion control unit 61 causes the caption data to pop out for the character string data to be superimposed on both the right-eye image and the left-eye image by the number of dots that is ½ of the setting value. Adjust the subtitle display position in the direction. For example, when the set value is an odd value, the value after the decimal point is rounded down. As a specific method for expressing the depth, the right-eye display character string data may be adjusted to be shifted to the left in the horizontal direction, and the left-eye display character string data may be adjusted to be shifted to the right in the horizontal direction. As a result, as shown in FIG. 69 (a), it is possible to obtain a sensation of the image jumping out of the screen when the line of sight intersects. For example, when the depth display position setting value is 03/4, 03/0, indicating 40, the display character string data to be superimposed on the right-eye video is the reference display position of the right-eye caption display plane (the display position for 2D display) And may be specified by the extended control code SDP), and is drawn 20 dots to the left, and is drawn 20 dots to the right of the reference display position of the caption display plane for the left eye. The character string displayed by the above method appears to jump out to the front, and the user can view subtitles in accordance with the 3D video display.

  Further, as another example of the designation by the parameter P1 in the control content, it may be designated to display at the reference position with a predetermined positive value. For example, the case where P1 is 30 may be displayed on the reference plane (display position in the case of 2D display). Specifically, when a value less than 30 is specified, the right-eye display character string data is horizontal right and the left-eye display character string data is horizontal according to the difference between the specified value and a predetermined integer value of 30. Adjust to the left of the direction. When a value larger than 30 is set, the right-eye display character string data is adjusted to the left in the horizontal direction and the left-eye display character string data is adjusted to the right in the horizontal direction according to the difference between the specified value and a predetermined integer value of 30. I do. In this way, not only an expression that jumps out from the reference plane but also an expression that retracts to the back from the reference plane becomes possible.

  In order to further enhance the sense of reality, character composition dot designation may be performed in accordance with the depth display position setting. That is, when subtitle data is displayed in front of the reference, it may be displayed in a size larger than the normal display size by designating character dots. As a result, the user can get a sense of presence when displaying the caption data. Further, when displaying after the reference, it may be displayed in a size smaller than the normal display size by designating character dots.

  Note that when the receiving device 4 has a function of adjusting the amount of parallax of 3D video, the display position for both video display and subtitle display is set in units of dots in the horizontal direction in accordance with an adjustment signal input by a user operation. You may adjust it. Next, another method for specifying a depth display position different from the above-described character “SDD” will be described. For example, a character “SDD2” having a control function of “designation of depth display position” is newly set. In the control by “SDD2”, for example, coordinate designation in the depth direction is performed with reference to the forefront of the depth that can be executed on the display. Following the CSI information in the control content, a value specifying the front-most reference depth display position is set in P11... P1i, and then the intermediate character I1 and the terminal character F are followed to form data. For example, when the setting value can be set to a maximum of 100, if an arbitrary value from 0 to 100 is set in P11... P1i, the depth designation position that can be set by the video conversion processing unit 32 in the receiving device 4 is set as the depth display position. The ratio is calculated by the value specified by the specified value / the maximum value (100) that can be set, and the display position of the right-eye and left-eye display character string data is adjusted in accordance with the ratio to display the caption. . From the user, that is, when the set value is 0, it appears to pop out to the foremost on the display 47, and by specifying 100, it appears to be retracted to the back. On the contrary, the same implementation method and effect can be obtained even if the specification standard is set to 0 at the back.

  Further, another method for specifying the depth display position will be described. A character “SDD3” having a control function of “depth display position designation” is newly set. In the control by “SDD3”, designation is performed using a setting value that is designated relative to the depth display position (depth of the reference plane) as a reference of the caption display plane. Following the CSI information in the control content, a value specifying the relative depth display position from the reference plane is set by P11... P1i, and then the intermediate character I1 and the terminal character F are followed to constitute data. For example, the setting value is specified in the same manner as in the case where the forefront of the depth is used as a reference. The display device 4 performs subtitle display by adjusting the horizontal display position of each display character string data for right eye and left eye according to the specified ratio. For example, when the set value is 0, the right-eye data and the left-eye data are displayed at the same place on the display 47 in FIG. 69A (also expressed as a parallax 0 position and a designated position at 2D display). ). When the set value is 100, the maximum parallax that can be set by the video conversion processing unit 32 is provided to display in the foreground, and in the case of an intermediate numerical value, the position of parallax 0 and the position of the maximum parallax are divided into 100. It shows that the amount of parallax according to the ratio is provided.

  Further, another method for specifying the depth display position will be described. A character “SDD4” having a control function of “depth display position designation” is newly set. In the control by “SDD4”, the designation is performed by the parallax information for the two-viewpoint caption data. That is, for each of the caption data displayed in the right-eye image and the caption data displayed in the left-eye image of the 2-viewpoint video, how many pixels are further shifted in the horizontal direction from the display position specified by the SDP to display the caption data. Is specified. Following the CSI information in the control content, set a value that specifies the amount of movement in the horizontal direction from the display position specified in SDP for the caption data to be displayed on the right-eye video with P11. After that, the intermediate character I1 is continued. Further, P21... P2j set values for specifying the amount of movement in the horizontal direction from the display position specified by the SDP of the caption data to be placed on the left-eye video in P21,... To configure the data. In the display device 4, the display character string data for the right eye is adjusted to the left in the horizontal direction and the display character string data for the left eye is adjusted to the right in the horizontal direction according to the specified value. For example, when the parallax setting value of the display data for the right eye is 03/2, 03/0, indicating 20 and the parallax setting value of the display data for the left eye is 03/2, 03/0, indicating 20, the video for the right eye is displayed. The display character string data to be superimposed is displayed 20 dots to the left of the reference display position of the right-eye caption display plane (the display position for 2D display and may be specified by the extended control code SDP). Displayed 20 dots to the right of the reference display position on the display plane. Depth can be added to the character string to be displayed also by the method described above, and the user can view subtitles in accordance with the 3D video display.

  Note that the control contents at this time may be specified by the parameters P1 and P2 as absolute position designations based on position coordinates, for example, the respective display positions not depending on the SDP. By doing so, the receiving device 4 can also express from the position of parallax 0 to the back. In that case, the use of the control code may not be performed together with the SDP. Further, the control content may be set to display at the position of parallax 0 with a predetermined positive value in the designation by the parameters P1 and P2. For example, when a predetermined integer value is 30 and P1 and P2 are 30, the display on the reference plane (display position in the case of 2D display) may be designated. In this case, when a value less than 30 which is a predetermined integer value is designated, the right-eye display character string data is adjusted to the right in the horizontal direction and the left-eye display character string data is adjusted to the left in the horizontal direction according to the designated value. . When a value larger than 30 which is a predetermined integer value is set, the display character string data for the right eye is adjusted to the left in the horizontal direction and the display character string data for the left eye is adjusted to the right in the horizontal direction according to the specified value. This also allows expression from the reference plane to the back.

  Further, the control content at this time may be the reverse of the designation order of the two viewpoints by the parameters P1 and P2 (designation for the subtitle data for the left eye with the parameter P1, and designation for the subtitle data for the right eye with the parameter P2).

By selecting any one of the plurality of control codes for specifying the depth display position and outputting the selected control code, the 3D display of subtitles can be realized by the compatible receiving device 4. Moreover, you may output from the transmitter 1 using the control code of several depth display position designation | designated. When a plurality of depth display position designation control codes are used at a time, for example, the display position of the caption may be determined by the depth display position designation control code received last by the receiving device 4. Alternatively, among the plurality of depth display position designation control codes transmitted from the transmission apparatus 1, a control code corresponding to a depth display position designation method that can be handled by the reception apparatus 4 is detected to determine a caption display position. Also good.
As described above, the control codes used in the caption are as described with reference to FIGS. 64 and 65. FIG. 66 shows an example of the restriction of the extended control codes in the transmission apparatus 1. Restrictions on the extended control code SDD for designating the depth display position are as follows. Whether or not it can be used can be used, and as other restrictions, after the initialization operation of the display screen described later, it is possible to designate only before the appearance of characters and control codes with bitmap display and display operations. By providing such a restriction, the receiving apparatus 4 can construct a control sequence similar to display position designation other than depth display position designation, display configuration dot designation, and the like. For example, the restrictions on SDD2, SDD3, and SDD4 may be provided similarly.

  By using the control codes of the present embodiment described above, the position of the depth display position / parallax information can be specified for each initialization operation of the display screen, and therefore can be changed for each arbitrary number of characters. For example, the subtitle data to be displayed can be specified for each line, and of course, the initialization operation can be incorporated even in the middle of the line, so that the position can be specified for each character of the subtitle data to be displayed. The receiving device 4 reads the control codes described above, calculates the display positions of the right-eye and left-eye videos for realizing the specified depth for the caption data in the range where the control content of the control code is valid, and caption data Is superimposed on the video data.

  Further, as the control content to be transmitted by the control code for designating the depth display position, depth information indicating the foremost display position of the depth that can be set in the program may be transmitted. For example, if it is known that the left and right parallax amounts are shifted up to 20 pixels at the time of video production, the transmission apparatus 1 always sets the setting value of the left and right parallax of the SDD to 20 at the time of transmission. By doing so, it is possible for the receiving device 4 to always display subtitles on the foreground of the displayed video by using the set value 20 during 3D display and display a video with no sense of incongruity. For example, when the receiving device 4 includes a function for adjusting the strength of the 3D display effect, a default value of 20 is used as the parallax default value, and when the strength is specified by the user, the parallax of the video data Just change the amount.

  Further, based on the above configuration, for example, in the case of a receiving device that does not support 3D program display, it is possible to display subtitle data on the 2D screen by ignoring this extended control information. The data structure does not cause malfunction.

  When the depth display position is not specified in the caption text data in the 3D program, the receiving device 4 displays the caption data in a state without parallax or expresses it in the foreground that can be set by the video conversion processing unit 32 It is possible to implement such a method.

  In this embodiment, the control code for performing 3D display is described as a part of the extended control code. However, the control code may be realized by being included in another control code (C0, C1 control code). Other expressions may be used. When the control code for designating the depth display position is applied to the C0 control code or the C1 control code, the range of the control code shown in FIG. 64 and the description location of the depth position designation information in the operation restriction shown in FIG. Is done.

<Other transmission restrictions>
Regarding the transmission operation of subtitle data in the transmission device 1, for example, the depth display position designation information is effective control only when the target program includes 3D video. Therefore, the depth display position designation is a content description as a limitation of the transmission operation. There is a restriction that transmission is possible only when the program characteristics indicated by the child are “the video of the target event (program) is a 3D video” or “the target event (program) includes 3D video and 2D video”. May be.

  For subtitle data in broadcasting, for example, a variety of expression methods such as flashing (blinking), underline, scrolling, etc. can be set. In the 3D display of caption data, in consideration of the fatigue and burden of viewing the 3D program by the user, a limitation may be placed on the combination of these character decoration methods and display using depth. For example, as a restriction of flushing when performing 3D display of subtitle data, the number of flushing colors is different from that for non-flushing characters and 128 common fixed colors for bitmap data. It is assumed that a total of 24 colors (including intermediate colors of 4 gradation fonts) can be designated. Assume that a total of 16 colors can be specified simultaneously for flushing bitmap data. In subtitles, a total of 24 colors (24 colors for text) can be arbitrarily specified from 128 common fixed colors. In the character superimposition, it is assumed that a total of 40 colors (24 colors for characters + 16 colors for bitmap data) can be arbitrarily specified from 128 common fixed colors. In addition, flushing is only positive phase. Also, mixing with the border specification is prohibited. Mixing with scroll specification is prohibited. The number of flushing colors can be specified up to a total of 24 colors (including intermediate colors of 4 gradation fonts) for flushing of 8-unit code character strings, apart from 128 common fixed colors of characters and bitmap data that are not flushed. And Assume that a total of 16 colors can be specified simultaneously for flushing bitmap data. In the subtitles, it is assumed that a total of 24 colors (24 colors for characters) can be arbitrarily specified from 128 common fixed colors. In the character superimposition, it is assumed that a total of 40 colors (24 colors for characters + 16 colors for bitmap data) can be arbitrarily specified from 128 common fixed colors. In addition, flushing is only positive phase. Also, mixing with the border specification is prohibited. Mixing with scroll specification is prohibited. Mixing with the depth display position designation is prohibited.

  Or the example of the restriction | limiting matter in operation | use of the scroll designation | designated (SCR) at the time of performing 3D display of subtitle data is shown below.

  It is prohibited to specify SCR more than once in the same text. When scrolling, the data is transmitted as a different data unit (text) specifying the display area for one line by SDF. As a receiver operation when scrolling is specified, scrolling is performed within the rectangular area specified by SDF and SDP, and drawing outside the rectangular area is not performed. It is assumed that a virtual area of one character (specified size) exists on the right side of the first line of the display area, and when the scroll specification (SCR) is specified, the operation position is restored to the virtual writing area. Set. Characters written in the display area before the scroll designation are deleted after the scroll designation. The first character is displayed from the right edge of the display area. The scrolling starts when characters are written in the virtual writing area. If there is no rollout, scrolling is stopped after the last character is displayed. If there is a rollout, scrolling continues until there are no more characters on the screen. If the next data to be displayed is received during scrolling, the process waits until the scrolling is completed. In addition, when the character spacing value and line spacing value specified from the start of scrolling instruction to the end of scrolling exceed the maximum value of the display section, the scroll display depends on the receiver implementation. Mixing with the depth display position designation is prohibited.

  Similarly, restrictions such as prohibition of character display methods (polarity inversion, raster color control, box, underline, border, shadow, bold, italic, etc.) should not be mixed with depth display position specification. It may be provided.

<Operation example of receiving device>
Hereinafter, an operation example when the reception device 4 receives the content including the caption data transmitted from the transmission device 1 will be described.

<Subtitle initialization operation>
Regarding the initialization operation, the receiving device 4 performs the initialization operation for the caption management at the time of update when the data group of the received caption management data is switched from the set A to the set B, or from the set B to the set A. Do. At this time, the display area and the display position are set to predetermined initial values, and the depth display position may be canceled from the designated value that has been designated by the control code. With respect to the initial value of the depth display position designation of the caption data, for example, the state in which the right-eye data and the left-eye data are displayed at the same place on the display 47 in FIG. It is also expressed as a designated position.

  The timing for executing initialization is, for example, as shown below.

  As initialization by subtitle text, the receiving device 4 performs an initialization operation when receiving subtitle text data identical to the data group set and language being presented. That is, the ID value included in the data group header of the caption PES data is detected and the initialization operation is executed.

  Further, as initialization by the text data unit, the receiving device 4 receives the text data unit included in the caption text data when the caption text data that is the same as the data group set and language being presented is received. The initialization operation is performed immediately before the receiver presentation process. That is, the initialization operation is executed in units of data.

  In addition, as initialization by the character control code, the reception device 4 performs the initialization operation immediately before the receiver execution processing of screen erasure (CS) and format selection (SWF). Since this control code can be inserted at an arbitrary position, the initialization operation can be executed in an arbitrary character unit.

  That is, the depth display position of subtitle data can be changed at an arbitrary timing by designating the depth display position each time initialization is performed.

<Example of subtitle data reception control of receiver>
For example, the number of subtitles / superimpose characters that can be displayed simultaneously as the operation of the receiving device 4 may be one subtitle and one superimpose character. The receiving device 4 is configured to control the presentation control of the caption and the character supervision independently. In principle, the receiving device 4 controls the caption and the superimpose so that the display areas do not overlap. However, if the display must be overlapped, the character superimposition is given priority and displayed before the subtitle. In addition, in each subtitle and character superimposition, if the bitmap data and the body text or the bitmap data overlap each other, the postscript priority is given. Also, the display size and position of the caption / superimpose in the data broadcasting program are displayed with reference to the entire screen area. The receiving device 4 determines whether or not caption data is transmitted based on whether or not caption management data is received. The display of a mark notifying the viewer of the reception of subtitles, and the display and deletion of subtitles are mainly performed based on the subtitle management data. In consideration of suspension of transmission of the caption management data between CMs, timeout processing may be performed when no caption management data is received for 3 minutes or longer. Note that display control may be performed in conjunction with other data such as EIT data for caption management data.

  FIG. 67 shows the operation of the receiving device 4 at the start and end of subtitle / superimpose display. However, “start” means “start of subtitle display specified by subtitle text” and “end” means “deletion of subtitle text”. As shown in FIG. 67, the receiving device 4 starts the subtitle display specified by the subtitle text and deletes the subtitle text in accordance with the DMF in the subtitle management data described with reference to FIG. 56 (a). Even when a 3D program to which caption data is added is received and video and caption data are displayed in 3D, the receiving device 4 follows the DMF. For example, in the case of automatic display at the time of reception, the system control unit 51 displays subtitle data based on the above-described depth display position designation. If it is automatically hidden during reception, caption data is not displayed at the start. If it is a selection display at the time of reception, it is displayed / erased by the user's selection.

  Next, as the operation related to the setting of the caption / superimpose in the receiving device 4, the following operation may be performed. For example, the receiving device 4 displays the subtitle and the character super of the language selected immediately before through the user operation input. For example, when a subtitle in the second language is selected through user operation input while viewing a program, the second language is displayed when another program with subtitles is started. In the initial setting at the time of shipment of the receiver, the first language is displayed. A receiver capable of setting a language code such as Japanese or English displays a caption / superimpose of the set language code. When the subtitle / character super of the language or language code set in the receiver is not transmitted, the receiver displays the subtitle / superimpose of the first language.

  A control procedure when the receiving device 4 receives the above-described stream including the caption data and the 3D display video and superimposes the stream on the video data displayed in 3D will be described with reference to FIG. If a broadcast wave is received, the subtitle data is separated by the demultiplexer 29 via the tuner 23 and descrambler 24 in S6801, stored in a volatile memory not shown in FIG. 25, and the process proceeds to S6802. In S6802, the subtitle sentence data stored in the memory is read by the system control unit 51 of the CPU 21, the subtitle sentence data is analyzed by the video conversion control unit 61 of the CPU 21, the control code is determined, and the process proceeds to S6803. Regarding the processing of the caption data at this time, the above-described operation for the caption data may be performed. In S6803, the presence / absence of depth display position designation information in the 3D video content is determined. If the depth display position designation information is present, the process proceeds to S6804, and if not, the process proceeds to S6805. In step S6804, the right-eye display character string data and the left-eye display character string data are drawn on each caption display plane. At this time, the drawing positions of the right-eye display character string data and the left-eye display character string data are determined according to the analysis result of the depth display position designation information by the video conversion control unit 61 of the CPU 21. After drawing, the process advances to step S6806. Since there is no designation of the depth display position in S6805, the video conversion control unit 61 uses the drawing position obtained from standard depth (parallax) information stored in advance in a memory (not shown) to use the right-eye character string data. And the left-eye display character string data are drawn on each subtitle display plane. As the standard depth (parallax) information, predetermined information may be determined in advance and stored in a memory (not shown). At this time, as an example of the depth display position indicated by the standard depth information, for example, a display position displayed on the forefront that can be displayed by the video conversion processing unit 32 may be used. In this case, since the subtitle display is always fused to the front position with respect to the 3D video, the subtitle can be displayed without a sense of incongruity. After drawing, the process advances to step S6806. In S6806, the system control unit 51 and the video conversion control unit 61 of the CPU 21 superimpose the display area planes created in S6805 and the video display planes, and the OSD data created by the OSD creation unit as necessary. The video conversion processing unit 32 is controlled so as to be superimposed. The superimposed video data is displayed on the display 47 or output from the video output 41, and the process is terminated. By repeating the above series of processes for each received subtitle data, suitable subtitles can be displayed in 3D. For example, the receiving device 4 may repeat the above process continuously while receiving a broadcast signal.

  Note that the depth display position indicated by the standard depth information shown in S6805 may be a different position. For example, the position of parallax 0 (the state where there is no parallax between the right-eye display character string and the left-eye display character string) is defined as the standard depth display position. Further, for example, a new parameter of standard parallax information indicating the reference parallax of the display data for the right eye and the display data for the left eye may be set, and the parameter may be stored in a new descriptor. Parameters may be stored. It is also possible to synthesize these parameters with program information such as PMT, transmit it from the transmission apparatus 1, receive it by the reception apparatus 4, and determine the reception apparatus 4 using the received parameters.

  Instead of the processing from S6805, when the subtitle data does not include the control code for designating the depth display position, the subtitle may be controlled not to be displayed. For example, in step S6805, the video conversion control unit 61 renders the video data on the video display plane, but does not draw the display character string data on the subtitle display plane. In this case, it is possible to avoid display in a state where the depth display position with the video data is inconsistent. When the control data for specifying the depth display position is not included in the caption data, the display data may be drawn and displayed on the caption display plane at a position without parallax. In this case, although there is a possibility that there is a mismatch in the depth display position with the video data, it is possible to avoid at least not displaying the subtitles.

  In the above control example, the example in which caption data and video data are synthesized by the video conversion control unit 61 and the video conversion processing unit 32 of the CPU 21 is shown. There may be provided different processing blocks, a control unit, etc. (not shown) to perform these processes.

  Even when content is input to the receiving device 4 via the network 3, the stream data including the caption data is received via the network I / F 25, and the caption data is received by the demultiplexing unit 29 in the same manner as when the broadcast is received. It is possible to view the caption corresponding to 3D display by the same control as the control example at the time of receiving the broadcast.

  An example of the display of the caption information performed by the control described above is shown in FIGS. 69 (a) and 69 (b). The method of generating parallax by shifting the display positions of the right-eye video and the left-eye video is as described above. Here, FIG. 69A is an explanatory diagram of a simple model showing the display positions of the display data for the right eye and the display data for the left eye and the depth of the fusion position to be displayed by the user's brain. When certain first display target data is displayed at the right-eye display position 1 on the right-eye display area and at the left-eye display position 1 on the left-eye display area, it is fused at the fusion position 1 in the user's brain. As a result, the display target data is perceived as being at a position behind the display surface of the display 47. On the other hand, when certain second display target data is displayed at the right-eye display position 2 on the right-eye display area and at the left-eye display position 2 on the left-eye display area, at the fusion position 2 in the user's brain. As a result, the data to be displayed is perceived as popping out from the display surface of the display 47. In other words, for the display of subtitle data, moving the display character string data for the right eye to the left in the horizontal direction and moving the display character string data for the left eye to the right in the horizontal direction brings the fusion position closer to the user, and the user's brain Then, the caption data appears to jump out of the screen. Note that the amount of movement in the left-right direction is not necessarily the same. Therefore, by setting the display position so that the parallax of the caption data is in front of the video data, it is possible to display a video with no sense of incompatibility during display. That is, for the subtitle data to be displayed together with the stereoscopic video data including the left-eye video and the right-eye video, a parallax in the horizontal direction is provided so as to be displayed on the entire surface of the video data. The left-eye video and the right-eye video generated in FIG. 69 (b) are alternately displayed as shown in FIGS. 37 (a) and 39 (a), so that the display 47 shows how the display video looks. A video is displayed as in the example, and the user can view it as a stereoscopic video with superimposed subtitles by using an auxiliary device such as glasses equipped with an active shutter filter, for example.

  In addition, the operation of the receiving device 4 when the caption data including the depth display position designation information shown in the present embodiment is included and transmitted in content not including 3D video will be described.

  For example, in the receiving device 4, the program information analysis unit 54 detects the value of the program characteristic indicated by the content descriptor shown in FIG. 50, and the system control unit 51 determines that the target event (program) does not include 3D video. In this case, even if the depth display position designation information included in the caption data is detected, processing is performed so that 3D display of the caption data is not performed. Thereby, it is possible to superimpose 3D caption data on the 2D video, and to avoid displaying a video that is difficult for the user to view.

<When displaying 3D video in 2D>
When 3D content of 3D2 viewpoint-based ES transmission method is received and the user gives a switching instruction to display 2D video (for example, pressing the “2D” key on the remote control) during or before viewing, the switching instruction information is received. The user instruction reception unit 52 instructs the system control unit 51 to switch the signal to 2D video. At this time, even if the received content includes depth display position designation information, caption display is performed in 2D format.

  FIG. 70 shows an example of a processing sequence for setting the depth position of a caption when the receiving device receives video transmitted in 3D video and views it in 2D (for example, the case shown in FIG. 40A). After receiving the stream including the caption data, after analyzing the caption data by the same processing as S6801 and S6802, in S7001, when the video conversion control unit 61 of the CPU 21 detects the depth display position designation information, Based on this, the right-eye display character string is drawn on the right-eye display area plane, the left-eye display character string is drawn on the left-eye display area plane, and the process advances to step S7002. In S7002, the system control unit 51 and the video conversion control unit 61 of the CPU 21 generate display data in which, for example, the left-eye display video data, the left-eye caption display plane, and the OSD display plane are superimposed as in S404. Here, in display, 2D display is realized by displaying only one of the generated display data for two viewpoints. As the data displayed at this time, for example, left-eye video and left-eye video subtitle data may be used. After the above display process, the process ends. By repeating the above processing every time the caption data is received, the caption can be suitably displayed in 2D. Further, since switching of 3D / 2D display can be realized by switching only the display processing of S7002 as the final processing, switching can be executed at high speed.

  In addition to this example, only one display subtitle plane is generated without using the depth display position designation information detected by the video conversion control unit 61 in S7001, and the right-eye display video or the left-eye display video is generated. It may be realized by a method of superimposing on one of the display images.

  According to this embodiment, at the time of 2D output / display of 3D content, 2D display is also performed on the caption data, so that the user can view the program without feeling uncomfortable.

  Further, the processing shown in this sequence is performed in S404 of FIG. 41 or is performed simultaneously. The system control unit 51 performs the above-described control in synchronization with the process of displaying the video in 2D, so that the timing of the 3D / 2D display of the video and the 3D / 2D display of the caption data can be synchronized, and the program can be viewed without a sense of incongruity. To do.

  FIG. 71 shows an example of a subtitle display process switching sequence when switching of 3D / 2D display of 3D content is instructed by the user. When a 3D / 2D display switching instruction is given from the user when receiving 3D content, the process starts. In S7101, if the switching instruction is a switching instruction from 2D video display to 3D video display, the process proceeds to S7102, and if the switching instruction is a switching instruction from 3D video display to 2D video display, the process proceeds to S7103. In step S7102, the system control unit 51 switches the subtitle data display method to 3D display along with the process of switching the video signal display method to 3D display, and ends the processing. In this case, 3D display of caption data is realized by the processing sequence shown in FIG. In step S7103, the system control unit 51 switches the subtitle data display method to 2D display along with the process of switching the video signal display method to 3D display, and ends the processing. In this case, 2D display of caption data is realized by the processing sequence shown in FIG.

  According to this embodiment, when 3D content video is 3D output / displayed, caption data is also 3D output / displayed, and when 3D content video is 2D output / displayed, caption data is also 2D output. / Will be displayed. As a result, 3D / 2D display of caption data according to the output / display of 3D content is realized, and the user can view the program without a sense of incongruity.

<Subtitle display when 2D video can be 3D converted by the receiver 4>
A case will be described in which a broadcast signal including subtitle data and 2D video data is transmitted from the transmission device 1 and converted into 3D video for display in the reception device after reception by the reception device 4. Conversion of 2D video data into 3D is performed by including a conversion circuit in the video conversion processing unit 32 or by software processing by the CPU 21. At this time, depth display position designation information is not added to the received caption data. Therefore, similar to the processing performed in S6805 shown in FIG. 68, the parallax information may be set so that the caption information is displayed on the forefront in the depth direction. With this configuration, it is possible to prevent inconsistency in the depth display position between the video data and the caption data in the 3D display after conversion.

  At this time, since the transmission apparatus 1 is premised on 2D display, a control code that is not suitable for combined use with 3D display may be applied to subtitle control information. Therefore, in the receiving device 4, when subtitle data is displayed by performing 3D conversion of 2D video, if the subtitle is used when displaying the subtitle in 3D, it is possible to perform 3D display such as control that may cause fatigue when viewing the user. Display without executing the instruction of the control code that is not suitable. For example, the scroll process with the control code for scroll designation is not performed, or the flushing operation with the control code for flushing control is not performed. Thereby, it is possible to more suitably realize 3D viewing of video and subtitles.

  On the other hand, in consideration of the case where 2D video is displayed in 3D, when the transmission device 1 transmits the subtitle data accompanying the 2D video data including the depth display position designation information, the reception device 4 shows, for example, FIG. As in S401 and S402, it is determined whether or not the program is a 3D program. When the 2D program is displayed in 2D, 2D video is displayed in 2D without referring to the depth display position designation information. Do. When the program is a 2D program and is converted to 3D and displayed, caption display is performed in 3D with reference to the depth display position designation information.

<Another example of subtitle data transmission operation>
Another example of the method for inserting the parallax data into the content of the parallax control data in the case where 3D video is transmitted from the transmission apparatus 1 by the two-viewpoint identical ES transmission method will be described below.

  FIG. 72A shows an example of the format of PES data including caption data according to the present embodiment. data_identifier is an identification number of caption PES data uniquely determined. For example, a fixed value such as 0x20 is set. subtitle_stream_id is an identification number for uniquely specifying that the PES packet is caption data. Following this, segment data is inserted. For example, a fixed value such as 0x00 is used. subtitle_stream_id is an identification number for uniquely specifying the caption data from the PMT of the program. Following this, segment data is inserted. end_of_PES_data_field_marker is a fixed value indicating the end of caption PES data. For example, it is an information string such as '111 111' with 8-bit information.

  FIG. 72 (b) shows the structure of the segment data specified in FIG. 72 (a). sync_byte is a uniquely determined value for identifying the segment data at the receiver. Definition values that can be specified by segment_type will be described later. In page_id, the page number for selecting the display position of the caption data is designated. segment_length indicates the data length that follows. segment_data_field is specific data contained in each segment, and defines what information is included.

  FIG. 72C illustrates the definition of segment_type, which is the type of segment related to captions. For example, an object data segment including subtitle character string information, a page or region for displaying subtitles, segment data related to color management, and the like are defined. In this example, segment_type for setting the parallax of caption data is newly defined as 0x15 (Disparity_signaling_segment).

  FIG. 72 (d) shows an example of the data structure of the left / right disparity information segment disparity_signaling_segment. sync_byte is a uniquely determined value for identifying a segment. For example, 8-bit information may be set to a value “0000 1111”. For segment_type, the value of 0x15 defined in FIG. 72 (c) is designated, and the segment type is determined to be disparity_signaling_segment. page_id defines the page number to which the information of this segment is applied. segment_length indicates the information length of the immediately following segment. page_disparity_address specifies the disparity information of the corresponding page. For example, the parallax information represents the parallax of the left and right screens in units of subpixels. dss_version_number indicates the version of this disparity_signaling_segment. The receiving apparatus can determine the subsequent data format based on this version. The region_id specifies the identification number of the corresponding region in order to define the parallax for each region that is a unit of display position finer than the page. For region_disparity_address, for example, the parallax on the left and right screens is expressed and specified in units of subpixels. Thereby, even when there are a plurality of subtitle data, different depth (parallax) information can be given to each of them and the images can be displayed at different depths.

  Based on the above data structure, for example, in the case of a receiving apparatus that does not support 3D program display, information having this segment_type is ignored, and normal subtitle data can be displayed on the 2D screen. Become. Thereby, FIG. 72 (d) has an advantage that the old model does not malfunction even when content including subtitle data using the left-right parallax information segment is transmitted.

  The operation of the reception apparatus with respect to the control data having the data configuration using the left and right parallax information segments described above is changed from “depth display position designation information” to “left and right parallax information segments” in the operation examples illustrated in FIGS. It has been changed. In S6805 of FIG. 68, when the received 3D video content does not include the left-right disparity information segment, predetermined left-right disparity information segment information is stored in the memory, and this is converted into the standard left-right disparity information. A subtitle display character string may be displayed as segment information. Other operations are the same as those in FIGS. 68, 70, and 71, and thus the description thereof is omitted.

  72 (a), 72 (b), 72 (c), and 72 (d) are not necessarily limited to the data arrangement, name, and data size / type shown in each figure. There is no need to include similar information.

  If the right parallax information segment described above is used, it is possible to suitably realize the depth setting for the caption data for 3D display.

<Another example of subtitle data transmission operation>
Another example of a method for inserting caption data and its parallax control data into content in the case of transmitting 3D video from the transmission apparatus 1 using the two-viewpoint identical ES transmission method is shown below.

  First, caption data may be inserted into a user data area included in a sequence header of video data, for example. FIG. 73A shows a configuration example of user data included as extension data in the sequence header. user_data_start_code is a fixed value that can uniquely identify that the subsequent data is user data, and is “0x000001B2”, for example. user_data_type_code is a uniquely identifiable fixed value indicating that caption data and the like are included in the subsequent data, and is “0x03”, for example. vbi_data_flag indicates whether subtitle data or the like is included. If it is 1, the subsequent caption data is analyzed, and if it is 0, analysis is unnecessary. cc_count indicates the data amount of subsequent caption data. cc_priority indicates the priority at the time of image creation in the form of 0 (highest priority) to 3 (lowest priority), for example. For field_number, a field for displaying a caption is selected by, for example, Odd / Even. cc_data_1 and cc_data_2 include a character string to be displayed and a control command. Control commands specify text color and background color, or roll-up (subtitle service that additionally displays subtitle data sent as page data in units of lines in a preset area of about 3 lines. Sometimes rolls up in the row direction.) Include things that specify movement, such as blinking, and parallax information. An example of the control command is shown in FIG. The reason why a plurality of channels are indicated as channel 1 and channel 2 is to enable display of a plurality of caption data at a time. Assign a different value control command to each channel, which means equivalent control. In order not to confuse the character string with the control command, for example, the character string may use a value after 0x20, and the control command may start with a value from 0x10 to 0x1F.

  At this time, the disparity information indicating the disparity of the caption data may be specified by arranging the disparity control command data in FIG. 73 (c) immediately after the Text Restart command, for example. The parallax amount may be arranged immediately after the control command, and may be specified in a range of values from 0x20 to 0x7E (32 to 126 in decimal number), for example. The meaning of the designated value expresses the parallax by the amount of increase / decrease (-47 to +47) from 0x4F (79 in decimal) which is the center. As a result, a total of 94 pixels of parallax can be generated. For example, the positive direction is defined as right and the negative direction is defined as left (or vice versa, of course).

  By determining the value specified by the transmission device in this way, it is possible to uniquely interpret the depth information by an arbitrary reception device.

  For example, when channel 1 is used to provide 10-pixel positive parallax for video data for the right eye, the data sequence “0x14, 0x2A, 0x23, 0x59” is transmitted from the transmission side and interpreted on the receiver side. It becomes possible to respond. It can be seen that the caption information of channel 1 is initialized by 0x14 and 0x2A, and then the disparity information of the caption data for the right-eye image is transmitted by 0x23. The next 0x59 is the actual disparity information, and 10 which is the difference from 0x4F is the disparity information. Subsequently, the parallax information for the left-eye image is transmitted and received in the same manner, and the subtitle data main body is transmitted and received, so that the caption data can be displayed with left and right parallax.

  The user data in FIG. 73 (a) may include data other than the caption data after the caption data described above. Next start_code () is a fixed value such as “0x000001”, and can be interpreted as the end of user data.

  The control method when the reception device receives the above-described parallax control command data is the same as the operation example described with reference to FIGS. 68, 70, and 71, with “depth display position designation information” shown in FIG. It has been changed to. In S6805 of FIG. 68, when the received 3D video content does not include parallax control command data, predetermined predetermined parallax control command data is stored in the memory, and this is stored in the standard parallax control command information. It is sufficient to display a display character string of subtitles. Other operations are the same as those in FIGS. 68, 70, and 71, and thus the description thereof is omitted.

<Processing example during recording / playback>
Next, processing at the time of recording and playback of content including the 3D video data and caption data described above will be described.

<Recording 3D broadcast with subtitle data as it is / Recording for each CSI>
When the 3D content stream including the caption data described above is received and recorded on the recording medium, for example, the caption data PES including the above-described depth display position designation information is directly recorded by the recording / reproducing unit 27 by the recording medium 26. To record. Also, the subtitle data read from the recording medium 26 at the time of reproduction is controlled by the demultiplexing unit 29 and the like in the same manner as the broadcast signal reception process shown in FIGS. 68, 70, and 71. Thereby, it is possible to view the caption corresponding to the 3D display. If the control data is included in the caption data PES as shown in FIG. 52, for example, even when video data or audio data is edited at the time of recording (eg, transcode processing), the above-described recording / reproduction is performed. Processing can be handled.

  When the 3D program content is converted into 2D format and recorded, or when the recording / playback apparatus can only perform 2D display, the depth display position designation information shown in FIG. 65 and the left-right parallax shown in FIG. Information related to the depth display position and parallax for 3D display of caption data, such as the information segment and the parallax control command in FIG. 73 (c), may be deleted during recording. By reducing the data amount in this way, it is possible to effectively use the recording capacity of the recording medium.

  Contrary to the processing example at the time of recording described above, the video data of the received stream is 2D video, the depth display position designation information in FIG. 65, the left / right parallax information segment in FIG. 72 (d), FIG. In the case of not having information about the depth display position and parallax for 3D display of caption data, such as the parallax control command of c), when converting video data into 3D video and recording at the time of recording, Information regarding depth display position and parallax for 3D display of these caption data may be recorded together with video data and caption data after 3D conversion.

<When subtitle data and TV-specific OSD are superimposed in 3D display>
Consider the case where the receiving device or the recording / reproducing device simultaneously displays a unique OSD on the screen in contrast to the caption data display described above. FIG. 74 (a) shows a conceptual diagram of the plane (plane) for writing caption data and OSD data. In the receiving device 4, the display surface is configured so that the OSD data is in front of the caption data as shown in the figure. Further, when generating a 3D display screen, the parallax is controlled so that the depth display position of the OSD is displayed in the foreground. By doing so, it is possible to prevent the OSD display from causing the user to feel uncomfortable due to the relationship with the depth display position of the caption data. For example, even if the caption data is located in the foreground, the OSD display data overwrites the caption in the order in which the planes are overlaid to synthesize the screen, resulting in a display with no discomfort. An example of the display screen after the synthesis is shown in FIG. Even when the OSD data has a property of being transmitted, it is possible to generate a display screen without a sense of incongruity by performing display control in the same manner.

<Example of HDMI output control>
As an example of a device configuration different from the above-described embodiment, a configuration in which the receiving device 4 and the display device 63 are separated as shown in FIG. 75 and connected by, for example, a serial transmission method will be described. The transmission bus 62 connects the display device 4 and the display device 63, transmits video / audio data, and can transmit commands that can be sent in a prescribed format. As a transmission method, for example, connection by HDMI (trademark) can be cited. The display device 63 is a device for displaying video / audio data transmitted by the transmission bus 62, and has a display panel, a speaker, and the like. In the case of this configuration, in order to output and display the caption data on the display device 63, data obtained by synthesizing caption data on the video data may be generated by the reception device 4 and transmitted to the display device 63. When viewing 3D video, 3D display is possible on the display device 63 according to the 3D video data transmission method defined by the transmission method. The display device 63 may display a left-eye image and a right-eye image as shown in FIG. 69 (a) or 69 (b), respectively.

  Similarly, when the OSD is superimposed on the receiving device 4, an image on which the OSD is superimposed on the receiving device 4 is generated and transmitted to the display device 63. The display device 63 displays the left-eye image and the right-eye image, respectively. That's fine.

  On the other hand, when a 3D display image is created by the receiving device 4 and an OSD is displayed on the display device 63 on the 3D display image, the display device 63 grasps the maximum parallax amount of the 3D display image generated on the receiving device 4 side. If it is not possible, it cannot be displayed in the foreground. Therefore, the parallax information is transmitted from the receiving device 4 to the display device 63 via the transmission bus 62. Thereby, it is possible to grasp the maximum amount of parallax of the 3D display image generated on the receiving device 4 side in the display device 63. As a specific transmission method of parallax information, for example, transmission by CEC which is a device control signal in HDMI connection can be mentioned. This can be dealt with by providing a new location for describing the amount of parallax in the Reserved area of the HDMI Vendor Specific InfoFrame Packet Contents.

  As shown in the example shown in FIG. 74 (a) or 74 (b) described above, when the OSD is displayed on the foreground, a display without discomfort is possible. By transmitting parallax information such as the number of pixels as the maximum value, the display device 63 can display the OSD on the forefront with respect to the display image. For example, the parallax information may be transmitted at a fixed maximum value once when the 3D program display is started on the receiving device 4 side. In this case, there is an advantage that the number of transmissions is small and the processing load is small. In addition, when there is a method in which the user can set the maximum amount of parallax with the receiving device 4, it may be transmitted every time it is changed.

  FIG. 76A shows an example of a display image transmitted from the receiving device 4 to the display device 63. For example, it is a 3D display image in which caption data is displayed in front of the display image. When the OSD is not displayed on the display device 63, this image is displayed as it is.

  On the other hand, FIG. 76B is an example of an image in which the OSD is displayed on the display device 63 that has received the parallax maximum value information from the reception device 4 by the transmission process described above. By using the parallax maximum value information, the OSD is superimposed at a position in front of any display image and caption data in the image transmitted from the receiving device 4, thereby making it possible to display without discomfort.

  76 (a) and 76 (b) show display examples including subtitle data. Even when the subtitle data is not displayed on the reception device 4, the display device 63 transmits disparity information from the reception device 4 according to the above procedure. The OSD can be displayed on the forefront. Even when the reception device 4 transmits data in which caption data and OSD are superimposed, the OSD created by the display device 63 is transmitted from the caption data and the OSD of the reception device 4 by transmitting disparity information from the reception device 4 in the above procedure. Can also be displayed on the front side, and display without a sense of incongruity is possible. In this embodiment, the example of transmitting the maximum parallax value has been described. However, the minimum value is transmitted together, or the screen is divided into a plurality of areas, and the maximum value and the minimum value for each area are transmitted. May be. The timing for transmitting the parallax value may also be sent at regular time intervals such as 1 second intervals. By performing these processes, it is possible to widen the width of the position in the depth direction where the display device 63 can display the OSD without a sense of incongruity.

DESCRIPTION OF SYMBOLS 1 Transmission apparatus 2 Relay apparatus 3 Network 4 Reception apparatus 10 Recording / reproducing part 11 Source generation part 12 Encoding part 13 Scramble part 14 Modulation part 15 Transmission antenna part 16 Management information 17 Encryption part 18 Channel encoding part 19 Network I / F Part 21 CPU
22 General-purpose bus 23 Tuner 24 Descrambler 25 Network I / F
26 Recording medium 27 Recording / reproducing unit 29 Demultiplexing unit 30 Video decoding unit 31 Audio decoding unit 32 Video conversion processing unit 33 Control signal transmission / reception unit 34 Timer 41 Video output unit 42 Audio output unit 43 Control signal output unit 44 Device control signal transmission 45 User operation input 46 High-speed digital interface 47 Display 48 Speaker 51 System control unit 52 User instruction reception unit 53 Device control signal transmission unit 54 Program information analysis unit 55 Time management unit 56 Network control unit 57 Decoding control unit 58 Recording / playback control unit 59 Station control unit 60 OSD creation unit 61 Video conversion control unit 62 Serial transmission bus 63 Display device

Claims (3)

A receiving unit for receiving 3D video content including video data, subtitle data, and depth display position information or parallax information about the subtitle data;
A video processing unit that performs video processing for 3D display or 2D display of the received video data and the caption data;
An operation input unit for inputting an operation input signal from a user,
For video processing by the video processing unit,
First video processing for displaying the received video data of the 3D video content in 3D, and displaying the received caption data in 3D using the depth display position information or the parallax information;
When an operation input signal is input from the operation input unit to switch 3D display to 2D display, the received video data of the 3D video content is displayed in 2D, and the received caption data is displayed as the depth display position information or the A receiving apparatus comprising: second video processing for 2D display without being based on parallax information. A receiving device receiving 3D video content including video data, caption data, and depth display position information or parallax information for the caption data;
A video processing step for performing video processing for 3D display or 2D display of the received video data and the caption data;
In the video processing in the video processing step,
First video processing for displaying the received video data of the 3D video content in 3D, and displaying the received caption data in 3D using the depth display position information or the parallax information;
When an operation input signal is input from the operation input unit to switch 3D display to 2D display, the received video data of the 3D video content is displayed in 2D, and the received caption data is displayed as the depth display position information or the A receiving method comprising: a second video processing for 2D display without being based on parallax information. Transmitting a 3D video content including video data and depth display position information or parallax information about the caption data and the caption data;
A receiving device receiving the 3D video content;
The receiving device includes a video processing step for performing video processing for 3D display or 2D display of the received video data and the caption data;
In the video processing in the video processing step,
First video processing for displaying the received video data of the 3D video content in 3D, and displaying the received caption data in 3D using the depth display position information or the parallax information;
When the operation input signal is input from the operation input unit of the receiving device to switch the 3D display to the 2D display, the received video data of the 3D video content is displayed in 2D, and the received caption data is displayed in the depth display position. And a second video processing for 2D display without being based on information or the parallax information.

Images