JP7001639B2 - system - Google Patents

Description

The present invention relates to a system.

One of the extended functions of the digital broadcasting service is data broadcasting, which transmits digital data by broadcasting waves and displays various information such as weather forecasts, news, and recommended programs. A large number of television receivers capable of receiving data broadcasting are already on the market, and a large number of technologies related to data broadcasting reception, including the following Patent Document 1, have been published.

Japanese Unexamined Patent Publication No. 2001-186486

In response to changes in the environment related to content distribution in recent years, TV receivers are also required to expand their functions in various ways. In particular, there are many demands for distribution of contents and linked applications using a broadband network environment such as the Internet, and demands for higher resolution / definition of video contents. However, it is difficult to provide a high-value-added TV receiver that can meet the above-mentioned demand only by diversion of the data broadcast receiving function or the like provided in the current TV receiver or only the function expansion of the data broadcast receiving function or the like. ..

An object of the present invention is to provide a broadcast receiving device capable of executing a function having higher added value.

As a means for solving the above-mentioned problems, the technique described in the claims is used.

By using the technique of the present invention, it is possible to provide a broadcast receiving device capable of executing a function having higher added value.

It is a system block diagram which shows an example of the broadcasting communication system including the broadcasting receiving apparatus which concerns on Example 1. FIG. It is explanatory drawing of the outline of the coded signal in MMT. It is a block diagram of MPU in MMT. It is a block diagram of the MMTP packet in MMT. It is a conceptual diagram of the protocol stack of the broadcasting system using MMT. It is a hierarchical structure diagram of the control information used in a broadcasting system. It is a list of tables used in TLV-SI of a broadcasting system. It is a list of descriptors used in TLV-SI of a broadcasting system. It is a list of messages used in MMT-SI of a broadcasting system. It is a list of tables used in MMT-SI of a broadcasting system. It is a list of descriptors used in MMT-SI of a broadcasting system (No. 1). It is a list of descriptors used in MMT-SI of a broadcasting system (No. 2). It is a figure which shows the relationship between the data transmission of a broadcasting system and each table. It is a block diagram of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a block diagram of the logical plane structure of the presentation function of the broadcast receiving apparatus which concerns on Example 1. FIG. FIG. 5 is a system configuration diagram of clock synchronization / presentation synchronization of the broadcast receiving device according to the first embodiment. It is a software block diagram of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a block diagram of the broadcasting station server which concerns on Example 1. FIG. It is a block diagram of the service provider server which concerns on Example 1. FIG. It is a block diagram of the mobile information terminal which concerns on Example 1. FIG. It is a software block diagram of the mobile information terminal which concerns on Example 1. FIG. It is a figure which shows the data structure of MH-TOT of a broadcasting system. It is a figure which shows the format of the JST_time parameter of a broadcasting system. It is a figure which shows the calculation method of the present date from MJD of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a figure which shows the structure of the NTP format of a broadcasting system. It is a figure which shows the data structure of the MPU time stamp descriptor of a broadcasting system. It is a figure which shows the data structure of the time information of the TMCC extended information area of a broadcasting system. It is operation sequence diagram at the time of the channel scan of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a figure which shows the data structure of the TLV-NIT of a broadcasting system. It is a figure which shows the data structure of the satellite distribution system descriptor of a broadcasting system. It is a figure which shows the data structure of the service list descriptor of a broadcasting system. It is a figure which shows the data structure of the AMT of a broadcasting system. It is operation sequence diagram at the time of channel selection of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a figure which shows the data structure of the MPT of a broadcasting system. It is a figure which shows the data structure of the LCT of a broadcasting system. It is a figure which shows the example of the layout assignment to the layout number based on LCT. It is a figure which shows the example of the layout assignment to the layout number based on LCT. It is a figure which shows the example of the layout assignment to the layout number based on LCT. It is a figure which shows the example of the layout assignment to the layout number based on LCT. It is a figure explaining the operation of exception handling of screen layout control based on LCT. It is a figure explaining the operation of exception handling of screen layout control based on LCT. It is a figure which shows the data structure of MH-EIT of a broadcasting system. It is a screen display figure of the EPG screen of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a screen display figure of the EPG screen of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a screen display figure of the EPG screen of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a screen display figure at the time of the emergency warning broadcast display of the broadcast receiving apparatus which concerns on Example 1. FIG. It is a block diagram of the broadcast receiving apparatus which concerns on Example 2. FIG. It is a figure explaining the inconsistency of the present time display at the time of switching a broadcasting service. It is a figure explaining the operation of the selection control of the present time information reference source which concerns on Example 2. FIG. It is a screen display figure of the EPG screen of the broadcast receiving apparatus which concerns on Example 2. FIG. It is a screen display figure of the EPG screen of the broadcast receiving apparatus which concerns on Example 2. FIG. It is a figure which shows the bitstream structure of the LATM / LOAS format of a broadcasting system. It is a figure which shows an example of the structure of a dialog control information. It is a figure which shows the speaker arrangement at the time of 22.2ch audio output which concerns on Example 3. FIG. It is a figure which shows the recommended range of the speaker arrangement at the time of 22.2ch audio output which concerns on Example 3. FIG. It is a figure explaining the coding method of 22.2ch audio data which concerns on Example 3. FIG. It is a conceptual diagram of the dialog control function of a broadcasting system. It is a conceptual diagram of the dialog control function of a broadcasting system. It is a figure explaining the selection method of the replacement voice (dialog) which concerns on Example 3. FIG. It is a figure explaining the selection method of the replacement voice (dialog) which concerns on Example 3. FIG. It is a figure explaining the selection method of the replacement voice (dialog) which concerns on Example 3. FIG. It is a figure explaining the selection method of the replacement voice (dialog) which concerns on Example 3. FIG. It is a figure explaining the selection method of the replacement voice (dialog) which concerns on Example 3. FIG. It is a figure explaining the volume adjustment method of the dialog sound and the background sound which concerns on Example 3. FIG. It is a figure explaining the volume adjustment method of the dialog sound and the background sound which concerns on Example 3. FIG. It is a figure explaining the volume adjustment method of the dialog sound and the background sound which concerns on Example 3. FIG. It is a screen display figure of the volume level information of the dialog sound and the background sound which concerns on Example 3. FIG. It is a figure explaining the sound quality adjustment method of the dialog sound and the background sound which concerns on Example 3. FIG. It is a figure explaining the sound quality adjustment method of the dialog sound and the background sound which concerns on Example 3. FIG. It is a figure explaining the outline of the volume adjustment process of the background sound according to the presence / absence of the dialog sound which concerns on Example 3. FIG. It is a figure explaining the outline of the reproduction time extension processing of the dialog sound which concerns on Example 3. FIG.

Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings.

(Example 1)
[System configuration]
FIG. 1 is a system configuration diagram showing an example of a broadcasting communication system including the broadcasting receiving device of the present embodiment. The broadcasting communication system of this embodiment includes a broadcasting receiving device 100 and an antenna 100a, a broadband network such as the Internet 200, a router device 200r and an access point 200a, a broadcasting station radio tower 300t and a broadcasting satellite (or communication satellite) 300s, and a broadcasting station. It is composed of a server 300, a service provider server 400, another application server 500, a mobile telephone communication server 600, a base station 600b of a mobile telephone communication network, and a mobile information terminal 700.

The broadcast receiving device 100 receives the broadcast wave transmitted from the radio tower 300t via the broadcasting satellite (or communication satellite) 300s and the antenna 100a. Alternatively, the broadcast wave transmitted from the radio tower 300t may be received directly from the antenna 100a without going through the broadcasting satellite (or communication satellite) 300s. Further, the broadcast receiving device 100 can be connected to the Internet 200 via the router device 200r, and can transmit and receive data by communicating with each server device and other communication devices on the Internet 200.

The router device 200r is connected to the Internet 200 by wired communication, is connected to the broadcast receiving device 100 by wired communication or wireless communication, and is connected to the portable information terminal 700 by wireless communication. For the wireless communication, a method such as Wi-Fi (registered trademark) may be used. As a result, each server device and other communication devices on the Internet 200, the broadcast receiving device 100, and the portable information terminal 700 can mutually exchange data via the router device 200r. The communication between the broadcast receiving device 100 and the mobile information terminal 700 may be performed directly by a method such as BlueTooth (registered trademark) or NFC (Near Field Communication) without going through the router device 200r.

The radio tower 300t is a broadcasting facility of a broadcasting station, and transmits broadcast waves including coded data of broadcast programs, subtitle information, other applications, general-purpose data, and the like. The broadcasting satellite (or communication satellite) 300s receives the broadcasting wave transmitted from the radio tower 300t of the broadcasting station, performs frequency conversion and the like as appropriate, and then broadcasts the broadcast to the antenna 100a connected to the broadcasting receiving device 100. It is a repeater that retransmits waves. Further, the broadcasting station shall include a broadcasting station server 300. The broadcasting station server 300 stores metadata such as broadcast programs (video contents, etc.), program titles, program IDs, program outlines, performer information, broadcast dates, etc. of each broadcast program, and stores the video contents and each metadata. , It shall be possible to provide to the service provider based on the contract. The video content and each metadata may be provided to the service provider through an API (Application Programming Interface) provided in the broadcasting station server 300.

The service provider server 400 is a server device prepared by the service provider, and is capable of providing various services linked to a broadcast program distributed from a broadcasting station. In addition, the service provider server 400 stores, manages, and distributes video content and metadata provided by the broadcasting station server 300, various contents and applications linked to the broadcasting program, and the like. It also has a function to search for contents and applications that can be provided and to provide a list in response to inquiries from TV receivers and the like. The storage, management and distribution of the content and metadata and the storage, management and distribution of the application may be performed by different server devices. The broadcasting station and the service provider may be the same or different. A plurality of service provider servers 400 may be prepared for each different service. Further, the function of the service provider server 400 may be provided by the broadcasting station server 300.

The other application server 500 is a known server device that stores, manages, and distributes other general applications, operation programs, contents, data, and the like. There may be a plurality of other application servers 500 on the Internet 200.

The mobile telephone communication server 600 is connected to the Internet 200, while being connected to the mobile information terminal 700 via the base station 600b. The mobile telephone communication server 600 manages telephone communication (call) and data transmission / reception via the mobile telephone communication network of the mobile information terminal 700, and each server device and other communication devices on the mobile information terminal 700 and the Internet 200. Enables transmission and reception of data by communication with. Communication between the base station 600b and the mobile information terminal 700 is performed by the W-CDMA (Wideband Code Division Multiple Access) (registered trademark) method, the GSM (Global System for Mobile communications) (registered trademark) method, and the LTE (LongTor) method. , Or it may be performed by another communication method.

The mobile information terminal 700 shall have a function of telephone communication (call) and data transmission / reception via a mobile telephone communication network and a function of wireless communication by Wi-Fi (registered trademark) or the like. The mobile information terminal 700 can be connected to the Internet 200 via a router device 200r or an access point 200a, or via a base station 600b and a mobile telephone communication server 600 of a mobile telephone communication network, and can be connected to the Internet 200 on the Internet 200. It is possible to send and receive data by communicating with each server device and other communication devices. The access point 200a is connected to the Internet 200 by wire communication, and is connected to the mobile information terminal 700 by wireless communication. For the wireless communication, a method such as Wi-Fi (registered trademark) may be used. Communication between the mobile information terminal 700 and the broadcast receiving device 100 is performed via the access point 200a, the Internet 200, and the router device 200r, or the base station 600b and the mobile telephone communication server 600, and the Internet 200 and the router device 200r. It may be done through.

[Overview of MMT method]
The broadcast receiving device 100 shown in FIG. 1 is defined by the MPEG (Moving Picture Experts Group) -2 system, which is widely used in conventional digital broadcasting systems as a media transport method for transmitting data such as video and audio. It is assumed that the TV receiver is compatible with MMT (MPEG Media Transport) in place of the TS (Transport Stream) (hereinafter referred to as MPEG2-TS). It may be a television receiver compatible with both MPEG2-TS and MMT.

MPEG2-TS is characterized in that components such as video and audio constituting a program are multiplexed into one stream together with a control signal and a clock. Since it is treated as one stream including the clock, it is suitable for transmitting one content on one transmission line whose transmission quality is ensured, and has been adopted in many conventional digital broadcasting systems. On the other hand, MPEG2-TS functions for changes in the environment related to content distribution, such as the diversification of content in recent years, the diversification of devices that use content, the diversification of transmission channels for distributing content, and the diversification of content storage environments. The newly formulated media transport method is MMT because of its limitations.

FIG. 2A shows an example of an outline of the coded signal in the MMT of this embodiment. As shown in the figure, the MMT of this embodiment has an MFU (Media Fragment Unit), an MPU (Media Processing Unit), an MMTP (MMT Protocol) payload, and an MMTP packet as elements constituting the coded signal. And. The MFU is a format at the time of transmission of video, audio, and the like, and may be configured in NAL (Network Operation Layer) unit units or access unit units. The MPU may be composed of MPU metadata including information on the configuration of the entire MPU, movie fragment metadata including information on encoded media data, and sample data which is encoded media data. Further, it is assumed that the MFU can be extracted from the sample data. Further, in the case of media such as a video component and an audio component, the presentation time and the decoding time may be specified for each MPU or access unit. FIG. 2B shows an example of the configuration of the MPU.

The MMTP packet is composed of a header part and an MMTP payload, and transmits MFU and MMT control information. The MMTP payload shall include a payload header according to the content (data unit) stored in the payload unit. FIG. 2C shows an example of an outline of configuring an MFU from a video / audio signal, further storing it in an MMTP payload, and constructing an MMTP packet. In the video signal encoded by using the inter-frame prediction, it is desirable to configure the MPU in GOP (Group Of Pictures) units. Further, when the size of the MFU to be transmitted is small, one MFU may be stored in one payload unit, or a plurality of MFUs may be stored in one payload unit. Further, when the size of the MFU to be transmitted is large, one MFU may be divided into a plurality of payload units and stored. Further, the MMTP packet may be protected by using a technique such as AL-FEC (Application Layer Forward Error) or ARQ (Automatic Repeat Request) in order to recover the packet loss on the transmission path.

In the broadcasting system of this embodiment, MPEG-H HEVC (High Efficiency Video Coding) is used as the video coding method, and MPEG-4 AAC (Advanced Audio Coding) or MPEG-4 ALS (Audio Lossless) is used as the audio coding method. Coding) shall be used. Encoded data such as video and audio of broadcast programs encoded by each of the above methods is in the form of MFU or MPU, further mounted on an MMTP payload, converted into an MMTP packet, and transmitted as an IP (Internet Protocol) packet. And. Further, the data content related to the broadcast program may also be in the format of MFU or MPU, further mounted on the MMTP payload, converted into an MMTP packet, and transmitted as an IP packet. Data content transmission methods include subtitle / character super transmission method used for streaming data synchronized with broadcasting, application transmission method used for data transmission asynchronous with broadcasting, and synchronized / asynchronous messages for applications running on TV receivers. Four types of event message transmission method used for notification and general-purpose data transmission method for transmitting other general-purpose data synchronously / asynchronously shall be prepared.

For the transmission of MMTP packets, UDP / IP (User Datagram Protocol / Internet Protocol) is used in the broadcast transmission line, and UDP / IP or TCP / IP (Transmission Control Protocol / Internet Protocol) is used in the communication line. .. Further, in the broadcast transmission line, a TLV (Type Length Value) multiplexing method is used for efficient transmission of IP packets. FIG. 3 shows an example of the protocol stack of the broadcasting system of this embodiment. In the figure, (A) is an example of a protocol stack in a broadcast transmission line, and (B) is an example of a protocol stack in a communication line.

In the broadcasting system of this embodiment, a mechanism for transmitting two types of control information, MMT-SI (MMT-Signaling Information) and TLV-SI (TLV-Signaling Information), shall be prepared. MMT-SI is control information indicating the structure of a broadcast program and the like. It shall be in the form of an MMT control message, put on an MMTP payload, converted into an MMTP packet, and transmitted as an IP packet. The TLV-SI is control information regarding the multiplexing of IP packets, and shall provide information for channel selection and information on the correspondence between the IP address and the service.

Further, even in a broadcasting system using MMT, time information is transmitted in order to provide an absolute time. In addition, while MPEG2-TS shows the display time of the component based on a different clock for each TS, MMT shows the display time of the component based on Coordinated Universal Time (UTC). do. These mechanisms enable terminal devices to synchronously display components transmitted from different transmission points on different transmission lines. In order to provide UTC, it is assumed that an IP packet in NTP (Network Time Protocol) format is used.

[Control information of broadcasting system using MMT]
In the broadcasting system supported by the broadcasting receiving device 100 of this embodiment, as described above, the control information includes TLV-SI related to the TLV multiplexing method for multiplexing IP packets and MMT which is the media transport method. Prepare the MMT-SI involved. The TLV-SI provides information for the broadcast receiving device 100 to demultiplex the IP packets multiplexed on the broadcast transmission line. TLV-SI is composed of a "table" and a "descriptor". The "table" shall be transmitted in section format and the "descriptor" shall be placed within the "table". The MMT-SI is transmission control information indicating information related to the configuration of the MMT package and the broadcasting service. MMT-SI consists of three layers: a "message" that stores "tables" and "descriptors", a "table" that has elements and attributes that show specific information, and a "descriptor" that shows more detailed information. It shall be. FIG. 4 shows an example of the hierarchical structure of the control information used in the broadcasting system of this embodiment.

<Table used in TLV-SI>
FIG. 5A shows a list of "tables" used in the TLV-SI of the broadcasting system supported by the broadcasting receiving device 100 of this embodiment. In this embodiment, the following is used as the "table" of TLV-SI.

(1) TLV-NIT
The network information table for TLV (Network Information Table for TLV: TLV-NIT) represents information on the physical configuration of the TLV stream transmitted by the network and the characteristics of the network itself.

(2) AMT
The address map table (Addless Map Table: AMT) provides a list of multicast groups of IP packets that make up each service transmitted in the network.

(3) Table set by the business operator In addition, it is possible to prepare a table set by the service provider or the like.

<Descriptor used in TLV-SI>
FIG. 5B shows a list of "descriptors" arranged in the TLV-SI of the broadcasting system supported by the broadcasting receiving device 100 of this embodiment. In this embodiment, the following is used as the "descriptor" of the TLV-SI.

(1) Service list descriptor The service list descriptor provides a list of services by service identification and service type.

(2) Satellite distribution system descriptor The satellite distribution system descriptor indicates the physical conditions of the satellite transmission line.

(3) System management descriptor The system management descriptor is used to distinguish between broadcast and non-broadcast.

(4) Network name descriptor The network name descriptor describes the network name in character code.

(5) Descriptor set by the business operator In addition, it is possible to prepare a descriptor set by the service provider or the like.

<Message used in MMT-SI>
FIG. 6A shows a list of "messages" used in the MMT-SI of the broadcasting system supported by the broadcasting receiving device 100 of this embodiment. In this embodiment, the following "message" of MMT-SI is used.

(1) PA message The Package Access (PA) message is used to transmit various tables.

(2) M2 section message The M2 section message is used to transmit the section extension format of MPEG-2 Systems.

(3) CA message The CA message is used to transmit a table for identifying the limited reception method.

(4) M2 short section message The M2 short section message is used to transmit the section short format of MPEG-2 Systems.

(5) Data transmission message A data transmission message is a message that stores a table related to data transmission.

(6) Message set by the business operator In addition, it is possible to prepare a message independently set by the service provider or the like.

<Table used in MMT-SI>
FIG. 6B shows a list of "tables" used in the MMT-SI of the broadcasting system supported by the broadcasting receiving device 100 of this embodiment. The table is control information having elements and attributes indicating specific information, and is stored in a message and transmitted as an MMTP packet. The message for storing the table may be determined according to the table. In this embodiment, the following is used as the "table" of MMT-SI.

(1) MPT
The MMT Package Table (MPT) provides information that constitutes a package, such as a list of assets and the location of the assets on the network. The MPT may be stored in a PA message.

(2) PLT
The package list table (Package List Table: PLT) shows a list of IP data flows and packet IDs for transmitting PA messages of MMT packages provided as broadcasting services, and IP data flows for transmitting IP services. The PLT may be stored in a PA message.

(3) LCT
The layout setting table (Layout Configuration Table: LCT) is used to associate the layout information for presentation with the layout number. The LCT may be stored in a PA message.

(4) ECM
The Enterprise Control Message (ECM) is common information consisting of program information and control information, and delivers key information for descrambling and the like. The ECM may be stored in the M2 section message.

(5) EMM
The Enterprise Mobility (EMM) transmits individual information including contract information for each subscriber and key information for decrypting ECM (common information). The EMM may be stored in the M2 section message.

(6) CAT (MH)
A CA table (Conditional Access Table: CAT) (MH) is used to store a descriptor for identifying a conditional access method. CAT (MH) may be stored in a CA message.

(7) DCM
The Download Control Message (DCM) transmits key-related information including a key for decrypting a transmission line code for download. The DCM may be stored in the M2 section message.

(8) DMM
The Download Management Message (DMM) transmits key-related information such as a download key for decrypting the DCM. The DMM may be stored in the M2 section message.

(9) MH-EIT
The MH-Event Information Table (MH-EIT) is time-series information about the events included in each service. The MH-EIT may be stored in the M2 section message.

(10) MH-AIT
The MH-Application Information Table (MH-AIT) stores all information about the application, the startup state required for the application, and the like. The MH-AIT may be stored in the M2 section message.

(11) MH-BIT
The MH-Broadcaster Information Table (MH-BIT) is used to present information on Broadcasters existing on the network. The MH-BIT may be stored in the M2 section message.

(12) MH-SDTT
The MH-Software Download Trigger Table (MH-Software Download Trigger Table: MH-SDTT) is used for download notification information. The MH-SDTT may be stored in the M2 section message.

(13) MH-SDT
The MH-Service Description Table (MH-SDT) has a subtable representing services included in a specific TLV stream, and information about the organization channel such as the name of the organization channel and the name of the broadcaster. To transmit. The MH-SDT may be stored in the M2 section message.

(14) MH-TOT
The MH-Time Offset Table (MH-TOT) transmits JST time and date (corrected Julian day) information. The MH-TOT may be stored in the M2 short section message.

(15) MH-CDT
The MH-Common Data Table (MH-CDT) is used to transmit common data to be stored in the non-volatile memory in a section format to all receivers that receive it. The MH-CDT may be stored in the M2 section message.

(16) DDM table The data directory management table (Data Directory Management Table: DDM table) provides a directory structure of files constituting an application in order to separate the file structure of the application from the structure for file transmission. The DDM table may be stored in the data transmission message.

(17) DAM table The data asset management table (Data Asset Management Table: DAM table) provides the configuration of MPUs in assets and version information for each MPU. The DAM table may be stored in the data transmission message.

(18) DCC Table The Data Content Management Table (DCC Table) provides configuration information of a file as data content in order to realize flexible and effective cache control. The DCC table may be stored in the data transmission message.

(19) EMT
The Event Message Table (EMT) is used to transmit information about event messages. The EMT may be stored in the M2 section message.

(20) Table set by the business operator In addition, it is possible to prepare a table independently set by the service provider or the like.

<Descriptor used in MMT-SI>
6C and 6D show a list of "descriptors" arranged in the MMT-SI of the broadcasting system supported by the broadcasting receiving device 100 of this embodiment. The descriptor is the control information that provides more detailed information and shall be placed in the table. The table in which the descriptor is placed may be determined according to the descriptor. In this embodiment, the following is used as the "descriptor" of MMT-SI.

(1) Asset group descriptor The asset group descriptor provides the group relationship of assets and the priority within the group. The asset group descriptor may be placed in the MPT.

(2) Event package descriptor The event package descriptor provides a correspondence between an event representing a program and a package. The event package descriptor may be placed in the MH-EIT transmitted by the M2 section message.

(3) Background color specification descriptor The background color specification descriptor provides the backmost background color in the layout specification. The background color specification descriptor may be placed in the LCT.

(4) MPU presentation area designation descriptor The MPU presentation area designation descriptor provides a position for presenting the MPU. The MPU presentation area specification descriptor may be placed in the MPT.

(5) MPU time stamp descriptor The MPU time stamp descriptor indicates the presentation time of the first access unit in the presentation order in the MPU. The MPU timestamp descriptor may be placed in the MPT.

(6) Dependency Dependency Dependency Dependency Dependency provides the asset ID of the asset in the dependency. The dependency descriptor may be placed in the MPT.

(7) Access control descriptor The access control descriptor provides information for identifying the limited reception method. The access control descriptor may be located in MPT or CAT (MH).

(8) Scramble method descriptor The scramble method descriptor provides information for identifying the encryption target and the type of the encryption algorithm at the time of scrambling. The scrambled descriptor may be located in MPT or CAT (MH).

(9) Message authentication method descriptor The message authentication method descriptor provides information for identifying the message authentication method when performing message authentication. The message authentication method descriptor may be placed in MPT or CAT (MH).

(10) Emergency information descriptor (MH)
The emergency information descriptor (MH) is used when performing an emergency warning broadcast. The emergency information descriptor (MH) may be placed in the MPT.

(11) MH-MPEG-4 Audio Descriptor The MH-MPEG-4 audio descriptor describes basic information for specifying the coding parameters of the ISO / IEC 14496-3 (MPEG-4 audio) audio stream. Used for The MH-MPEG-4 audio descriptor may be located in the MPT.

(12) MH-MPEG-4 Audio Extension Descriptor The MH-MPEG-4 Audio Extension Descriptor is used to describe the profile and level of the MPEG-4 audio stream and the settings specific to the encoding method. The MH-MPEG-4 audio extension descriptor may be placed in the MPT.

(13) MH-HEVC Video Descriptor The MH-HEVC video descriptor is described in the ITU-T Recommendation H.D. 265 | Used to describe the basic coding parameters of the ISO / IEC 2608-2 video stream (HEVC stream). The MH-HEVC video descriptor may be placed in the MPT.

(14) MH-Link Descriptor The MH-link descriptor identifies a service provided when the viewer requests additional information related to a particular one described in the program sequence information system. The MH-link descriptor may be arranged in MPT, MH-EIT, MH-SDT, or the like.

(15) MH-event group descriptor The MH-event group descriptor is used to indicate that a group of events is grouped when there is a relationship between a plurality of events. The MH-event group descriptor may be located in the MH-EIT.

(16) MH-Service List Descriptor The MH-Service List Descriptor provides a list of services by service identification and service type. The MH-service list descriptor may be placed in the MH-BIT.

(17) MH-Short Event Descriptor The MH-Short Event Descriptor represents an event name and a short description of the event in text format. The MH-short event descriptor may be located in the MH-EIT.

(18) MH-Extended Event Descriptor The MH-Extended Event Descriptor is used in addition to the MH-Short Event Descriptor to provide a detailed description of the event. The MH-extended event descriptor may be located in the MH-EIT.

(19) Video component descriptor The video component descriptor shows parameters and explanations related to the video component, and is also used to express the elementary stream in a character format. The video component descriptor may be placed in MPT or MH-EIT.

(20) MH-stream identification descriptor The MH-stream identification descriptor is used because the component stream of the service is labeled and the description content indicated by the video component descriptor in the MH-EIT can be referred to by this label. .. The MH-stream identification descriptor may be placed in the MPT.

(21) MH-content descriptor The MH-content descriptor indicates the genre of the event. The MH-content descriptor may be placed in the MH-EIT.

(22) MH-Parental Rate Descriptor The MH-Parental Rate Descriptor represents age-based viewing restrictions and is used to extend to be based on other restriction conditions. The MH-parrent rate descriptor may be placed in the MPT or MH-EIT.

(23) MH-Audio Component Descriptor The MH-Audio Component Descriptor indicates each parameter of the audio elemental stream and is also used to express the elementary stream in character format. The MH-voice component descriptor may be located in the MPT or MH-EIT.

(24) MH-Target Area Descriptor The MH-Target Area Descriptor is used to describe the target area of a program or some streams constituting the program. The MH-Target Area Descriptor may be located in the MPT.

(25) MH-series descriptor The MH-series descriptor is used to identify a series program. The MH-series descriptor may be placed in the MH-EIT.

(26) MH-SI transmission parameter descriptor The MH-SI transmission parameter descriptor is used to indicate the transmission parameter of SI. The MH-SI transmission parameter descriptor may be located in the MH-BIT.

(27) MH-Broadcaster name descriptor The MH-Broadcaster name descriptor describes the name of the Broadcaster. The MH-broadcaster name descriptor may be located in the MH-BIT.

(28) MH-Service Descriptor The MH-Service Descriptor represents the organization channel name and its operator name in character code together with the service type. The MH-service descriptor may be located in the MH-SDT.

(29) IP data flow descriptor The IP data flow descriptor provides information on the IP data flow constituting the service. The IP data flow descriptor may be located in the MH-SDT.

(30) MH-CA activation descriptor The MH-CA activation descriptor describes activation information for invoking a CAS program on the CAS platform. The MH-CA activation descriptor may be located in MPT or CAT (CA).

(31) MH-Type Descriptor The MH-Type descriptor indicates the type of the file transmitted by the application transmission method. The MH-Type descriptor may be placed in the DAM table.

(32) MH-Info Descriptor The MH-Info descriptor describes information about an MPU or an item. The MH-Info descriptor may be placed in the DAM table.

(33) MH-Expire Descriptor The MH-Expire descriptor describes the expiration date of an item. The MH-Expire descriptor may be placed in the DAM table.

(34) MH-Compression Type Descriptor The MH-Compression Type descriptor means that the item to be transmitted is compressed, and indicates the compression algorithm and the number of bytes of the item before compression. The MH-Compression Type descriptor may be placed in the DAM table.

(35) MH-data encoding scheme descriptor The MH-data encoding scheme descriptor is used to identify the data encoding scheme. The MH-data coding scheme descriptor may be located in the MPT.

(36) UTC-NPT Reference Descriptor The UTC-NPT reference descriptor is used to convey the relationship between NPT (Normal Play Time) and UTC. The UTC-NPT reference descriptor may be placed in the EMT.

(37) Event message descriptor The event message descriptor conveys information about event messages in general. The event message descriptor may be placed in the EMT.

(38) MH-Local Time Offset Descriptor The MH-local time offset descriptor is used to give a constant offset value to the actual time (for example, UTC + 9 hours) and the display time to the human system when the daylight saving time is executed. The MH-local time offset descriptor may be located in the MH-TOT.

(39) MH-Component Group Descriptor The MH-Component Group Descriptor defines and identifies a combination of components in an event. The MH-component group descriptor may be located in the MH-EIT.

(40) MH-Logo Transmission Descriptor The MH-logo transmission descriptor is used to describe a character string for a simple logo, pointing to a logo in CDT format, and the like. The MH-logo transmission descriptor may be located in the MH-SDT.

(41) MPU Extended Timestamp Descriptor The MPU Extended Timestamp Descriptor provides the decryption time of the access unit in the MPU. The MPU extended timestamp descriptor may be placed in the MPT.

(42) MPU Download Content Descriptor The MPU download content descriptor is used to describe the attribute information of the content downloaded by using the MPU. The MPU download content descriptor may be placed in the MH-SDTT.

(43) MH-Network Download Content Descriptor The MH-Network Download Content Descriptor is used to describe the attribute information of the content downloaded using the network. The MH-Network Downloadable Content Descriptor may be located in the MH-SDTT.

(44) MH-Application Descriptor The MH-Application Descriptor describes information about the application. The MH-application descriptor may be located in the MH-AIT.

(45) MH-Transmission Protocol Descriptor The MH-Transmission Protocol Descriptor is used to specify a transmission protocol such as broadcasting or communication and to indicate location information of an application depending on the transmission protocol. The MH-transmission protocol descriptor may be located in the MH-AIT.

(46) MH-Simple Application Location Descriptor The MH-Simple Application Location Descriptor is described to indicate the details of the acquisition destination of the application. The MH-Simple Application Location Descriptor may be located in the MH-AIT.

(47) MH-Application Boundary Authority Setting Descriptor The MH-Application Boundary Authority Setting Descriptor is described to set the application boundary and to set the broadcasting resource access authority for each area (URL). The MH-Application Boundary Authority Setting Descriptor may be located in the MH-AIT.

(48) MH-Startup Priority Information Descriptor The MH-Startup Priority Information Descriptor is described to specify the start-up priority of the application. The MH-start priority information descriptor may be placed in the MH-AIT.

(49) MH-cache information descriptor The MH-cache information descriptor is described for use in cache control when the resources constituting the application are cached and held when the application is expected to be reused. .. The MH-cache information descriptor may be placed in the MH-AIT.

(50) MH-Stochastic Application Delay Descriptor The MH-stochastic application delay descriptor is for delaying the timing of application control by a probabilistically set delay amount, assuming load balancing of server access for application acquisition. Describe in. The MH-stochastic application delay descriptor may be placed in the MH-AIT.

(51) Link destination PU descriptor The link destination PU descriptor describes another presentation unit that may transition from the presentation unit (PU). The linked PU descriptor may be placed in the DCC table.

(52) Lock cache specification descriptor The lock cache specification descriptor describes the specification of the file to be cached and locked in the presentation unit. The lock cache specification descriptor may be placed in the DCC table.

(53) Unlock cache specification descriptor The unlock cache specification descriptor describes the specification of the file to be unlocked among the files locked in the presentation unit. The unlock cache specification descriptor may be placed in the DCC table.

(54) Descriptor set by the business operator In addition, it is possible to prepare a descriptor set by the service provider or the like.

<Relationship between data transmission and each control information in the MMT method>
Here, with reference to FIG. 6E, the relationship between data transmission and a typical table in the broadcasting system supported by the broadcasting receiving device 100 of this embodiment will be described.

In the broadcasting system supported by the broadcasting receiving device 100 of the present embodiment, data transmission can be performed by a plurality of routes such as a TLV stream via a broadcasting transmission line and an IP data flow via a communication line. The TLV stream includes a TLV-SI such as TLV-NIT or AMT, and an IP data flow which is a data flow of an IP packet. The IP data flow includes a video asset including a series of video MPUs and an audio asset including a series of audio MPUs. Similarly, the IP data flow may include a subtitle asset including a series of subtitle MPUs, a character super asset including a series of character super MPUs, a data asset including a series of data MPUs, and the like. These various assets are associated with each other in a unit called "package" by the MPT (MMT package table) stored and transmitted in the PA message. Specifically, the MPT has a package ID (corresponding to the "MMT_package_id_byte" parameter shown in FIG. 17 described later) and an asset ID of each asset included in the package (corresponding to the "asset_id_byte" parameter shown in FIG. 17 described later). Is described, the above association is made.

The assets constituting the package may be only the assets in the TLV stream, but as shown in FIG. 6E, the assets transmitted by the IP data flow of the communication line may be included. This includes the location information of each asset included in the package (corresponding to "MMT_general_location_info ()" shown in FIG. 17 described later) in the MPT, and the broadcast receiving device 100 of this embodiment refers to each asset. This can be achieved by making it understandable. Specifically, by changing the value of the "MMT_general_location_infolocalation_type" parameter arranged in the location information.
(1) Data multiplexed in the same IP data flow as MPT (location_type = 0x00)
(2) Data multiplexed in the IPv4 data flow (location_type = 0x01)
(3) Data multiplexed in the IPv6 data flow (location_type = 0x02)
(4) Data multiplexed with MPEG2-TS of broadcasting (location_type = 0x03)
(5) Data multiplexed in MPEG2-TS format in the IP data flow (location_type = 0x04)
(6) Data at the specified URL (location_type = 0x05)
It is possible to configure the broadcast receiving device 100 so that various data transmitted by various transmission paths can be referred to.

Among the above-mentioned references, (1) is, for example, an IP data flow received via a digital broadcast signal received by the tuner / demodulation unit 131 of the broadcast receiver 100 of FIG. 7A, which will be described later. When the MPT is included in the IP data flow on the communication line side for transmission, the reference destination in (1) may be the IP data flow received by the LAN communication unit 121 described later via the communication line. Further, the above (2), (3), (5), and (6) are IP data flows received by the LAN communication unit 121, which will be described later, via a communication line. Further, (4) is, for example, a reception function for receiving a digital broadcast signal using the MMT method and a digital broadcast using the MPEG2-TS method, as in the broadcast receiving device 800 of the second embodiment shown in FIG. 24 to be described later. In the case of a broadcast receiving device having both a receiving function for receiving a signal, a digital broadcast using the MPEG2-TS system based on MPT location information (“MMT_general_location_info ()”) included in a digital broadcast signal using the MMT system. It can be used to refer to the data multiplexed in the MPEG2-TS received by the receiving function for receiving the signal.

The data constituting the "package" is specified in this way, but in the broadcasting system supported by the broadcast receiving device 100 of this embodiment, a series of data in the "package" unit is converted into a "service" unit of digital broadcasting. Treat as.

Further, the MPT describes the presentation time information of each MPU designated by the MPT (corresponding to the "mpu_presentation_time" parameter shown in FIG. 13B described later), and a plurality of presentation time information designated by the MPT using the presentation time information. The MPU can be presented (display, output, etc.) in conjunction with the clock based on NTP, which is the time information in UTC notation. The presentation control of various data using the clock based on the NTP will be described later.

In the data transmission method of this embodiment shown in FIG. 6E, there is a concept of "event". "Event" is a concept indicating a so-called "program" handled by MH-EIT included in an M2 section message and sent. Specifically, in the "package" indicated by the event package descriptor stored in the MH-EIT, the duration is from the disclosure time stored in the MH-EIT (corresponding to the "start_time" parameter shown in FIG. 21 described later). A series of data included in the period (corresponding to the “duration” parameter shown in FIG. 21 described later) is the data included in the concept of the “event”. The MH-EIT performs various processes in the "event" unit in the broadcast receiving device 100 of this embodiment (for example, program table generation process, recording reservation and viewing reservation control, copyright management process such as temporary storage). It can be used for such purposes.

[Hardware configuration of broadcast receiver]
FIG. 7A is a block diagram showing an example of the internal configuration of the broadcast receiving device 100. The broadcast receiving device 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage (storage) unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, and a separation unit 132. , Video decoder 141, video color gamut conversion unit 142, audio decoder 143, character super decoder 144, subtitle decoder 145, subtitle synthesis unit 146, subtitle color gamut conversion unit 147, data decoder 151, cache unit 152, application control unit 153, It consists of a browser unit 154, an application color gamut conversion unit 155, a sound source unit 156, a video synthesis unit 161, a monitor unit 162, a video output unit 163, a voice synthesis unit 164, a speaker unit 165, an audio output unit 166, and an operation input unit 170. Will be done.

The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 according to a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operation block in the broadcast receiving device 100.

The ROM (Read Only Memory) 103 is a non-volatile memory in which a basic operation program such as an operating system and other operation programs are stored. Used. The ROM 103 may store the operation setting values necessary for the operation of the broadcast receiving device 100. The RAM (Random Access Memory) 104 serves as a work area for executing a basic operation program and other operation programs. The ROM 103 and the RAM 104 may be integrated with the main control unit 101. Further, the ROM 103 does not have an independent configuration as shown in FIG. 7A, and a partial storage area in the storage (storage) unit 110 may be used.

The storage (storage) unit 110 stores an operation program of the broadcast receiving device 100, an operation setting value, personal information of a user of the broadcast receiving device 100, and the like. Further, it is possible to store an operation program downloaded via the Internet 200 and various data created by the operation program. In addition, contents such as moving images, still images, and sounds acquired from broadcast waves or downloaded via the Internet 200 can also be stored. A part of the storage (storage) unit 110 may be used to replace all or part of the functions of the ROM 103. Further, the storage (storage) unit 110 needs to hold the stored information even when the broadcast receiving device 100 is not supplied with power from the outside. Therefore, for example, a device such as a non-volatile semiconductor device memory such as a flash ROM or SSD (Solid State Drive), a magnetic disk drive such as an HDD (Hard Disk Drive), or the like is used.

It is assumed that each of the operation programs stored in the ROM 103 and the storage (storage) unit 110 can be added, updated, and expanded in function by a download process from each server device on the Internet 200.

The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via the router device 200r, and transmits / receives data to / from each server device and other communication devices on the Internet 200. In addition, the MMT data string (or a part thereof) of the program transmitted via the communication line shall be acquired. The connection with the router device 200r may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 is provided with a coding circuit, a decoding circuit, and the like. Further, the broadcast receiving device 100 may further include other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, and an infrared communication unit.

The tuner / demodulation unit 131 receives the broadcast wave transmitted from the radio tower 300t via the antenna 100a, and tunes (selects) to the channel of the service desired by the user based on the control of the main control unit 101. Further, the tuner / demodulation unit 131 demodulates the received broadcast signal to acquire the MMT data string. Although the example shown in FIG. 7A illustrates a configuration in which one tuner / demodulation unit is used, the broadcast receiving device 100 uses the tuner / demodulation unit for the purpose of simultaneous display on multiple screens, counterprogram recording, and the like. It may be configured to mount multiple devices.

The separation unit 132 is an MMT decoder, and based on the control signal in the input MMT data string, the video data string, the audio data string, the character super data string, the subtitle data string, and the like, which are real-time presentation elements, are converted into the video decoder 141, respectively. , Audio decoder 143, character super decoder 144, subtitle decoder 145, and the like. The data input to the separation unit 132 is an MMT data string transmitted via a broadcast transmission line and demodulated by the tuner / demodulation unit 131, or MMT data transmitted via a communication line and received by the LAN communication unit 121. It can be a line. Further, the separation unit 132 reproduces the multimedia application and the file-based data which is a component thereof, and is temporarily stored in the cache unit 152. Further, the separation unit 132 extracts general-purpose data and outputs it to the data decoder 151 in order to use it for streaming data to a data or an application used by a player that presents data other than video / audio subtitles. Further, the separation unit 132 may perform error correction, access restriction control, and the like for the input MMT data string based on the control of the main control unit 101.

The video decoder 141 decodes the video data string input from the separation unit 132 and outputs the video information. The video color gamut conversion unit 142 performs color space conversion processing on the video information decoded by the video decoder 141 for the video composition processing by the video composition unit 161 as necessary. The voice decoder 143 decodes the voice data string input from the separation unit 132 and outputs the voice information. Further, even if streaming data such as MPEG-DASH (MPEG-Dynamic Adaptive Streaming over HTTP) format acquired from the Internet 200 via the LAN communication unit 121 is input to the video decoder 141 and the audio decoder 143. good. Further, a plurality of video decoder 141, video color gamut conversion unit 142, audio decoder 143, etc. may be provided in order to simultaneously decode a plurality of types of video data strings and audio data strings.

The character super decoder 144 decodes the character super data string input from the separation unit 132 and outputs the character super information. The subtitle decoder 145 decodes the subtitle data string input from the separation unit 132 and outputs the subtitle information. The character super information output from the character super decoder 144 and the subtitle information output from the subtitle decoder 145 are combined by the subtitle composition unit 146, and further, the subtitle color gamut conversion unit 147 is used in the video composition unit 161. Color space conversion processing is performed as necessary for the image composition processing. In this embodiment, among the services centered on text information presented at the same time as the video of the broadcast program, those related to the content of the video are referred to as subtitles, and the others are referred to as character supermarkets. do. In addition, when they are not distinguished, they are collectively referred to as subtitles.

The browser unit 154 uses the multimedia application file acquired from the server device on the Internet 200 via the cache unit 152 or the LAN communication unit 121 and the file system data which is a component thereof, as well as the control information included in the MMT data string and the LAN. It is presented according to the instruction of the application control unit 153 that interprets the control information acquired from the server device on the Internet 200 via the communication unit 121. The multimedia application file may be an HTML (Hyper Text Markup Language) document, a BML (Broadcast Markup Language) document, or the like. The application information output from the browser unit 154 is further subjected to color space conversion processing in the application color gamut conversion unit 155 for the video composition processing in the video composition unit 161 as necessary. Further, the browser unit 154 also acts on the sound source unit 156 to reproduce the application voice information.

The video compositing unit 161 inputs video information output from the video color gamut conversion unit 142, subtitle information output from the subtitle color gamut conversion unit 147, application information output from the application color gamut conversion unit 155, and the like, as appropriate. Performs processing such as selection and / or superimposition. The video synthesis unit 161 includes a video RAM (not shown), and the monitor unit 162 and the like are driven based on the video information and the like input to the video RAM. Further, the video compositing unit 161 is an EPG (Electronic Program Guide) created based on information such as scaling processing and MH-EIT included in the MMT-SI, if necessary, based on the control of the main control unit 101. Performs screen information superimposition processing, etc. The monitor unit 162 is a display device such as a liquid crystal panel, and provides the user of the broadcast receiving device 100 with the video information selected and / or superimposed by the video compositing unit 161. The video output unit 163 is a video output interface that outputs video information selected and / or superposed by the video compositing unit 161.

The presentation function of the broadcast receiving device 100 of this embodiment is provided with a logical plane structure in order to display the multimedia service as intended by the provider. FIG. 7B shows an example of the configuration of the logical plane structure provided in the presentation function of the broadcast receiving device 100 of this embodiment. In the logical plane structure, the character super plane for displaying the character super is arranged in the foreground, and the subtitle plane for displaying the subtitle is arranged in the next layer. A multimedia plane for displaying broadcast video, a multimedia application, or a composite video thereof is placed on the third layer, and a background plane is placed on the backmost surface. The subtitle composition unit 146 and the video composition unit 161 draw the character super information on the character super plane, draw the subtitle information on the subtitle plane, and draw the video information, application information, and the like on the multimedia plane. Further, the background color is drawn on the background plane based on the LCT or the like included in the MMT-SI. It is assumed that a plurality of third-layer multimedia planes can be prepared according to the number of video decoders 141. However, even when there are a plurality of multimedia planes, the application information and the like output from the application color gamut conversion unit 155 are output only to the foremost multimedia plane.

The voice synthesis unit 164 inputs the voice information output from the voice decoder 143 and the application voice information reproduced by the sound source unit 156, and appropriately selects and / or performs processing such as mixing. The speaker unit 165 provides the user of the broadcast receiving device 100 with the voice information selected and / or mixed by the voice synthesis unit 164. The voice output unit 166 is a voice output interface that outputs voice information selected and / or mixed by the voice synthesis unit 164.

The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100, and in this embodiment, it is configured to include an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. do. The analog video / audio interface inputs analog video / audio signals from an external video / audio output device, outputs analog video / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to send and receive data. Broadcast programs and contents may be recorded by connecting an HDD. You may also connect a keyboard or other USB device. The memory interface connects a memory card or other memory medium to send and receive data.

The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. The digital interface unit 125 can output the MMT data string obtained by demodulation by the tuner / demodulation unit 131, the MMT data string acquired via the LAN communication unit 121, or the mixed data of each MMT data string as it is. It shall be. Further, the MMT data string input from the digital interface unit 125 may be controlled to be input to the separation unit 132. The digital content stored in the storage (storage) unit 110 may be output, or the digital content may be stored in the storage (storage) unit 110 via the digital interface unit 125.

The digital interface unit 125 is a DVI terminal, an HDMI (registered trademark) terminal, a DisplayPort (registered trademark) terminal, or the like, and data is output or input in a format compliant with the DVI specification, HDMI specification, DisplayPort specification, or the like. It may be something. It may be output or input in the form of serial data conforming to the IEEE1394 specifications and the like. Further, it may be configured as an IP interface that outputs a digital interface via hardware such as Ethernet (registered trademark) or wireless LAN. In this case, the digital interface unit 125 and the LAN communication unit 121 may share the hardware configuration.

The operation input unit 170 is an instruction input unit for inputting operation instructions to the broadcast receiving device 100, and in this embodiment, a remote control receiving unit and a button switch for receiving commands transmitted from a remote controller (not shown) are arranged. It shall consist of operation keys. Only one of them may be used. Further, the operation input unit 170 may be replaced with a touch panel arranged on the monitor unit 162. A keyboard or the like connected to the expansion interface unit 124 may be used instead. The remote controller (not shown) may be replaced with a mobile information terminal 700 having a remote controller command transmission function.

As described above, when the broadcast receiving device 100 is a television receiver or the like, the video output unit 163 and the audio output unit 166 are not essential configurations in the present invention. Further, the broadcast receiving device 100 may be an optical disk drive recorder such as a DVD (Digital Versaille Disc) recorder, a magnetic disk drive recorder such as an HDD recorder, an STB (Set Top Box), or the like, in addition to a television receiver. It may be a PC (Personal Computer), a tablet terminal, a navigation device, a game machine, or the like having a digital broadcast reception function or a broadcast communication cooperation function. When the broadcast receiving device 100 is a DVD recorder, an HDD recorder, an STB, or the like, the monitor unit 162 and the speaker unit 165 may not be provided. By connecting an external monitor and an external speaker to the video output unit 163 and the audio output unit 166 or the digital interface unit 125, the same operation as the broadcast receiving device 100 of this embodiment can be performed.

[System configuration for clock synchronization / presentation synchronization of broadcast receiver]
FIG. 7C is an example of a system configuration of clock synchronization / presentation synchronization in the broadcasting system supported by the broadcasting receiving device 100 of this embodiment. In the broadcasting system of this embodiment, UTC is transmitted from the broadcasting transmitting system to a receiver (such as the broadcasting receiving device 100 of this embodiment) in a 64-bit length NTP time stamp format. In the NTP time stamp format, "more than a second" of UTC is represented by 32 bits, and "less than a second" is represented by 32 bits. However, in reality, it is difficult to reproduce one second with 32-bit accuracy. Therefore, the system clock for synchronizing the video system and the system clock for operating the NTP format clock are, for example, "2 to the 24th power" Hz (about 16.8 MHz) as shown in the figure. The frequency of may be used. Considering that the system clock in the conventional broadcasting system was 27 MHz and that the hardware configuration of the receiver can be easily constructed, 2 of about "2 to the 24th power" to "2 to the 28th power". It is desirable to use the power frequency as the system clock.

When the system clock is set to a power frequency of 2 such as "2 to the 24th power" to "2 to the 28th power" as described above on the broadcast transmission system side or the receiver side, it is received from the broadcast transmission system side. In the NTP time stamp format transmitted to the machine side, the lower 8 to 4 bits not referred to by the PLL (Phase Locked Loop) system for reproducing the system clock or the NTP format clock are "0" or "1". It may be fixed to. That is, if the system clock is "2 to the nth root" Hz (n = 24 in the example of FIG. 7C), the lower "32-n" bits in the NTP time stamp format are fixed to "0" or "1". You may do so. Alternatively, the receiver may perform processing so as to ignore the lower "32-n" bits of the NTP time stamp format.

On the broadcast transmission system side, when NTP format time information is obtained from the outside, a PLL system is configured with a 32 + n-bit counter by a VCO (Voltage Controlled Oscillator) of "2 to the nth power" Hz, and the time information given from the outside is used. Realize a synchronous sending system clock. In addition, the entire signal processing system is operated in synchronization with the system clock of "2 to the nth root" Hz. Further, the output of the transmission system clock is periodically transmitted to the receiver side via the broadcast transmission line as time information in NTP length format.

The receiver side receives the time information in NTP length format via the broadcast transmission line, and reproduces the reception system clock by the PLL system based on the VCO of "2 to the nth power" Hz as in the broadcast transmission system side. As a result, the reception system clock becomes a clock synchronized with the broadcast transmission system side. In addition, by operating the signal processing system of the receiver in synchronization with the system clock of "2 to the nth power" Hz, clock synchronization between the broadcast transmission system side and the receiver side is realized, and stable signal reproduction is possible. Become. Further, the decoding time and the presentation time for each presentation unit of the video / audio signal are set on the broadcast transmission system side based on the time information in the NTP format. Here, the MPU time stamp descriptor shown in FIG. 13B, which will be described later, is stored in the MPT stored in the PA message transmitted by the broadcast signal. The "mpu_sequence_number (MPU sequence number)" parameter in the MPU time stamp descriptor of FIG. 13B indicates the sequence number of the MPU that describes the time stamp, and the "mpu_presentation_time (MPU presentation time)" parameter indicates the MPU presentation time as 64-bit NTP. Shown in time stamp format. Therefore, the receiver can refer to the MPU time stamp descriptor stored in the MPT and control the presentation (display, output, etc.) timing of each MPU such as a video signal, an audio signal, subtitles, and a character supermarket. ..

When paying attention to the above-mentioned control of the decoding timing and the presentation timing for each presentation unit of the video / audio signal, the video / audio signal is synchronized even with a clock of about "2 to the 16th power" Hz (about 65.5 KHz). Can be secured, and in this case, it is not necessary to refer to the lower 16 bits of the NTP time stamp format described in the MPU time stamp descriptor or the like. That is, when a "2 mth" Hz clock generated by dividing the system clock by dividing the system clock is used to control the decoding timing and the presentation timing, it is lower than the NTP time stamp format described in the MPU time stamp descriptor or the like. The "32-m" bit does not have to be referenced. Therefore, the lower "32-m" bit of the NTP time stamp format described in the MPU time stamp descriptor or the like may be fixed to "0" or "1".

[Software configuration of broadcast receiver]
FIG. 7D is a software configuration diagram of the broadcast receiving device 100 of this embodiment, and shows the software configuration of the ROM 103, the RAM 104, and the storage (storage) unit 110. In this embodiment, the basic operation program 1001 and other operation programs are stored in the ROM 103, and the reception function program 1002 and other operation programs are stored in the storage (storage) unit 110. Further, the storage (storage) unit 110 stores the content storage area 1200 for storing contents such as moving images, still images, and voices, and authentication for storing authentication information necessary for accessing an external mobile terminal device or each server device. It shall be provided with an information storage area 1300 and various information storage areas for storing various other information.

The basic operation program 1001 stored in the ROM 103 is expanded in the RAM 104, and the main control unit 101 further executes the expanded basic operation program to form the basic operation execution unit 1101. Further, the reception function program 1002 stored in the storage (storage) unit 110 is also expanded in the RAM 104, and the main control unit 101 further executes the expanded reception function program to configure the reception function execution unit 1102. do. Further, the RAM 104 is provided with a temporary storage area for temporarily holding the data created at the time of executing each operation program as needed.

In the following, in order to simplify the explanation, the main control unit 101 performs a process of controlling each operation block by expanding and executing the basic operation program 1001 stored in the ROM 103 in the RAM 104. It is described as assuming that the unit 1101 controls each operation block. The same description is made for other operation programs.

The reception function execution unit 1102 controls each operation block of the broadcast reception device 100 in order to reproduce components such as video and audio transmitted by the broadcast system of this embodiment. In particular, the transport processing unit 1102a mainly controls the MMT decoder function of the separation unit 132, and distributes the video data string, the audio data string, and the like separated from the MMT data string to the corresponding decoding processing units. The AV decoding processing unit 1102b mainly controls the video decoder 141, the audio decoder 143, and the like. The application processing unit 1102c mainly controls the cache unit 152, the application control unit 153, the browser unit 154, and the sound source unit 156. The character super processing unit 1102d mainly controls the character super decoder 144. The subtitle processing unit 1102e mainly controls the subtitle decoder 151. The general-purpose data processing unit 1102f mainly controls the data decoder 151. The EPG generation unit 1102g interprets the description contents such as MH-EIT included in the MMT-SI and generates the EPG screen. Based on the logical plane structure, the presentation processing unit 1102h includes a video color gamut conversion unit 142, a subtitle synthesis unit 146, a subtitle color gamut conversion unit 147, an application color gamut conversion unit 155, a video synthesis unit 161 and a voice synthesis unit 164. Is mainly controlled.

Each of the operation programs may be stored in the ROM 103 and / or the storage (storage) unit 110 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121. Further, each operation program stored in a memory card, an optical disk, or the like may be acquired via the expansion interface unit 124 or the like.

[Broadcasting station server configuration]
FIG. 8 is a block diagram showing an example of the internal configuration of the broadcasting station server 300. The broadcasting station server 300 is composed of a main control unit 301, a system bus 302, a RAM 304, a storage unit 310, a LAN communication unit 321 and a digital broadcasting signal transmission unit 360.

The main control unit 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operation program. The system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operation block in the broadcasting station server 300. The RAM 304 serves as a work area when each operation program is executed.

The storage unit 310 stores a basic operation program 3001, a broadcast content management / distribution program 3002, and a broadcast content transmission program 3003, and further includes a broadcast content storage area 3200 and a metadata storage area 3300. The broadcast content storage area 3200 stores the program content and the like of each broadcast program broadcast by the broadcasting station. The metadata storage area 3300 stores metadata such as a program title, a program ID, a program outline, a performer, a broadcast date and time, and copy control information related to each program content of each broadcast program.

Further, the basic operation program 3001 and the broadcast content management / distribution program 3002 and the broadcast content transmission program 3003 stored in the storage unit 310 are each expanded in the RAM 304, and the main control unit 301 further executes each of the expanded programs. As a result, the basic operation execution unit 3101, the broadcast content management / distribution execution unit 3102, and the broadcast content transmission execution unit 3103 are configured.

In the following, in order to simplify the explanation, the main control unit 301 basically expands the basic operation program 3001 stored in the storage unit 310 into the RAM 304 and executes the process to control each operation block. It is described as assuming that the operation execution unit 3101 controls each operation block. The same description is made for other operation programs.

The broadcast content management / distribution execution unit 3102 manages the program content and the like of each broadcast program and each metadata stored in the broadcast content storage area 3200 and the metadata storage area 3300, and the program content and the like of each broadcast program and each. Controls the provision of metadata to service providers based on contracts. Further, when the broadcast content management / distribution execution unit 3102 provides the program content and the like of each broadcast program and each metadata to the service provider, the service provider based on the contract is required. The authentication process of the server 400 may be performed.

The broadcast content transmission execution unit 3103 stores the program content of the broadcast program stored in the broadcast content storage area 3200, the program title of the broadcast program stored in the metadata storage area 3300, the program ID, copy control information of the program content, and the like. Time schedule management and the like are performed when the MMT data string including the MMT data string is transmitted from the radio tower 300t via the digital broadcast signal transmission unit 360.

The LAN communication unit 321 is connected to the Internet 200 and communicates with a service provider server 400 or the like on the Internet 200. The LAN communication unit 321 is provided with a code circuit, a decoding circuit, and the like. The digital broadcast signal transmission unit 360 modulates an MMT data string composed of a video data string, an audio data string, a program information data string, etc. of the program content of each broadcast program stored in the broadcast content storage area 3200. , It is transmitted as a digital broadcast wave via the radio tower 300t.

[Service provider server configuration]
FIG. 9 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 is composed of a main control unit 401, a system bus 402, a RAM 404, a storage unit 410, and a LAN communication unit 421.

The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operation program. The system bus 402 is a data communication path for transmitting / receiving data between the main control unit 401 and each operation block in the service provider server 400. The RAM 404 serves as a work area when each operation program is executed.

The storage unit 410 stores the basic operation program 4001, the video content management / distribution program 4002, and the application management / distribution program 4004, and further stores the video content storage area 4200, the metadata storage area 4300, the application storage area 4400, and the user information storage. It comprises a region 4500. The video content storage area 4200 stores the program content of the broadcast program provided by the broadcasting station server 300 as the video content. It also stores video content and the like produced by the service provider. The metadata storage area 4300 stores each metadata provided from the broadcasting station server 300, metadata related to the video content produced by the service provider, and the like. The application storage area 4400 stores various applications for realizing a service linked to a broadcast program for distribution in response to a request from each television receiver. The user information storage area 4500 stores information (personal information, authentication information, etc.) about a user who is permitted to access the service provider server 400.

Further, the basic operation program 4001 and the video content management / distribution program 4002 and the application management / distribution program 4004 stored in the storage unit 410 are each expanded in the RAM 404, and the main control unit 401 further expands the expanded basic operation program and the video. By executing the content management / distribution program and the application management / distribution program, the basic operation execution unit 4101, the video content management / distribution execution unit 4102, and the application management / distribution execution unit 4104 are configured.

In the following, in order to simplify the explanation, the main control unit 401 basically expands the basic operation program 4001 stored in the storage unit 410 into the RAM 404 and executes the process to control each operation block. It is described as assuming that the operation execution unit 4101 controls each operation block. The same description is made for other operation programs.

The video content management / distribution execution unit 4102 acquires the program content and metadata of the broadcast program from the broadcasting station server 300, the video content and the like stored in the video content storage area 4200 and the metadata storage area 4300, and each metadata. And control the distribution of the video content and each metadata to each TV receiver. Further, the video content management / distribution execution unit 4102 performs authentication processing of each television receiver and the like as necessary when distributing the video content and the like and the metadata to the television receivers. You may go. Further, the application management / distribution execution unit 4104 manages each application stored in the application storage area 4400 and controls the distribution of each application in response to a request from each television receiver. Further, the application management / distribution execution unit 4104 may perform authentication processing of each television receiver as necessary when distributing the application to each television receiver.

The LAN communication unit 421 is connected to the Internet 200 and communicates with the broadcast receiving device 100 via the broadcasting station server 300 on the Internet 200 and the router device 200r. The LAN communication unit 421 shall include a coding circuit, a decoding circuit, and the like.

[Hardware configuration of mobile information terminal]
FIG. 10A is a block diagram showing an example of the internal configuration of the mobile information terminal 700. The portable information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an extended interface unit 724, an operation unit 730, an image processing unit 740, a voice processing unit 750, and a sensor unit 760. Consists of ,.

The main control unit 701 is a microprocessor unit that controls the entire mobile information terminal 700 according to a predetermined operation program. The system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operation block in the portable information terminal 700.

The ROM 703 is a memory in which a basic operation program such as an operating system and other operation programs are stored, and a rewritable ROM such as an EEPROM or a flash ROM is used. The RAM 704 serves as a work area for executing a basic operation program and other operation programs. The ROM 703 and the RAM 704 may be integrated with the main control unit 701. Further, the ROM 703 does not have an independent configuration as shown in FIG. 10A, and a partial storage area in the storage unit 710 may be used.

The storage unit 710 stores the operation program and operation setting value of the mobile information terminal 700, the personal information of the user of the mobile information terminal 700, and the like. Further, it is possible to store an operation program downloaded via the Internet 200 and various data created by the operation program. In addition, contents such as moving images, still images, and sounds downloaded via the Internet 200 can also be stored. A part of the storage unit 710 may be used to replace all or part of the functions of the ROM 703. Further, the storage unit 710 needs to hold the stored information even when the mobile information terminal 700 is not supplied with power from the outside. Therefore, for example, a device such as a non-volatile semiconductor element memory such as a flash ROM or SSD, a magnetic disk drive such as an HDD, or the like is used.

It is assumed that each of the operation programs stored in the ROM 703 and the storage unit 710 can be added, updated, and expanded in function by a download process from each server device on the Internet 200.

The communication processing unit 720 is composed of a LAN communication unit 721, a mobile telephone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via the router device 200r and the access point 200a, and transmits / receives data to / from each server device and other communication devices on the Internet 200. The connection with the router device 200r and the access point 200a shall be made by wireless connection such as Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (call) and data transmission / reception by wireless communication with the base station 600b of the mobile telephone network. The NFC communication unit 723 performs wireless communication when it is in close proximity to the corresponding reader / writer. The LAN communication unit 721, the mobile telephone network communication unit 722, and the NFC communication unit 723 shall each include a code circuit, a decoding circuit, an antenna, and the like. Further, the communication processing unit 720 may further include other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.

The expansion interface unit 724 is a group of interfaces for expanding the functions of the portable information terminal 700, and in this embodiment, it is composed of a video / audio interface, a USB interface, a memory interface, and the like. The video / audio interface inputs video / audio signals from an external video / audio output device, outputs video / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to send and receive data. You may also connect a keyboard or other USB device. The memory interface connects a memory card or other memory medium to send and receive data.

The operation unit 730 is an instruction input unit for inputting operation instructions to the mobile information terminal 700, and in this embodiment, it is composed of a touch panel 730t arranged on the display unit 741 and an operation key 730k in which button switches are arranged. It shall be. Only one of them may be used. The mobile information terminal 700 may be operated by using a keyboard or the like connected to the extended interface unit 724. The mobile information terminal 700 may be operated by using a separate terminal device connected by wired communication or wireless communication. That is, the mobile information terminal 700 may be operated from the broadcast receiving device 100. Further, the touch panel function may be provided in the display unit 741.

The image processing unit 740 includes a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides the image data processed by the image signal processing unit 742 to the user of the mobile information terminal 700. The image signal processing unit 742 includes a video RAM (not shown), and the display unit 741 is driven based on the image data input to the video RAM. Further, the image signal processing unit 742 shall have a function of performing format conversion, menu and other OSD (On Screen Display) signal superimposition processing, etc., as necessary. The first image input unit 743 and the second image input unit 744 convert the light input from the lens into an electric signal by using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Sensor) sensor. , A camera unit that inputs image data of surroundings and objects.

The voice processing unit 750 is composed of a voice output unit 751, a voice signal processing unit 752, and a voice input unit 753. The voice output unit 751 is a speaker, and provides the voice signal processed by the voice signal processing unit 752 to the user of the mobile information terminal 700. The voice input unit 753 is a microphone, which converts a user's voice or the like into voice data and inputs it.

The sensor unit 760 is a sensor group for detecting the state of the portable information terminal 700. In this embodiment, the GPS receiving unit 761, the gyro sensor 762, the geomagnetic sensor 763, the acceleration sensor 764, the illuminance sensor 765, and the proximity sensor 766 are used. , Consists of. With these sensor groups, it is possible to detect the position, tilt, direction, movement, ambient brightness, proximity status of surrounding objects, and the like of the portable information terminal 700. Further, the mobile information terminal 700 may further include other sensors such as a barometric pressure sensor.

The mobile information terminal 700 may be a mobile phone, a smart phone, a tablet terminal, or the like. It may be a PDA (Personal Digital Assistants) or a notebook PC. Further, it may be a digital still camera, a video camera capable of shooting a moving image, a portable game machine, a navigation device, or the like, or other portable digital devices.

The configuration example of the mobile information terminal 700 shown in FIG. 10A includes many configurations that are not essential to this embodiment, such as the sensor unit 760, but the present embodiment even if the configuration is not provided with these. Does not impair the effect of. Further, a configuration (not shown) such as a digital broadcast receiving function and an electronic money payment function may be further added.

[Software configuration of mobile information terminal]
FIG. 10B is a software configuration diagram of the mobile information terminal 700 of this embodiment, and shows the software configuration of the ROM 703, the RAM 704, and the storage unit 710. In this embodiment, the basic operation program 7001 and other operation programs are stored in the ROM 703, and the cooperation control program 7002 and other operation programs are stored in the storage unit 710. Further, the storage unit 710 has a content storage area 7200 for storing contents such as moving images, still images, and voices, and an authentication information storage area 7300 for storing authentication information and the like required for accessing a TV receiver and each server device. It shall be provided with various information storage areas for storing various other information.

The basic operation program 7001 stored in the ROM 703 is expanded in the RAM 704, and the main control unit 701 further executes the expanded basic operation program to form the basic operation execution unit 7101. Further, the cooperation control program 7002 stored in the storage unit 710 is also expanded in the RAM 704, and the main control unit 701 further executes the expanded cooperation control program to form the cooperation control execution unit 7102. Further, the RAM 704 is provided with a temporary storage area for temporarily holding the data created at the time of executing each operation program as needed.

In the following, for the sake of simplicity, the main control unit 701 expands the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executes the process to control each operation block. It is described as assuming that the unit 7101 controls each operation block. The same description is made for other operation programs.

The cooperation control execution unit 7102 manages device authentication and connection, transmission / reception of each data, and the like when the mobile information terminal 700 performs a linked operation with the television receiver. Further, the cooperation control execution unit 7102 is provided with a browser engine function for executing an application linked with the television receiver.

Each of the operation programs may be stored in the ROM 703 and / or the storage unit 710 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Further, each of the operation programs stored in the memory card, the optical disk, or the like may be acquired via the extended interface unit 724 or the like.

[Time management of broadcast receiver]
The broadcast receiving device of this embodiment has two types of time management functions. The first time management function is an NTP-based time management function, which has already been described with reference to FIG. 7C. The second time management function is a time management function based on the MH-TOT, which is a time managed based on the time information transmitted by the MH-TOT described with reference to FIG. 6B.

FIG. 13A shows an example of the configuration of time information transmitted by NTP. Further, an example of the data structure of the MPU time stamp descriptor is shown in FIG. 13B. The "reference_timestamp" parameter, "transmit_timestamp" parameter, etc. in the NTP format are 64-bit length NTP length format time data, and the "mpu_presentation_time" parameter in the MPU time stamp descriptor is also a 64-bit length NTP time stamp. It is time data in the format. The time data in the NTP length format and the time data in the NTP time stamp format are data in which "more than a second" of UTC is represented by 32 bits and "less than a second" is represented by 32 bits. That is, the time information in the NTP format can transmit the time information up to "less than a second". Further, since the time information in NTP format is expressed in UTC, unlike the clock management in the conventional digital broadcasting, as shown in FIG. 3B, the communication that can be received by the communication line path (for example, the LAN communication unit 121 in FIG. 7A). It can also be matched with NTP included in the signal received by the line).

On the other hand, the information transmitted by MH-TOT is as follows. It is assumed that the broadcast receiving device 100 can acquire the current date and the Japanese standard time by MH-TOT. FIG. 11A shows an example of the data structure of MH-TOT. The broadcast receiving device 100 can acquire the current date and the current time from the "JST_time" parameter of the MH-TOT. As shown in FIG. 11B, the "JST_time" parameter has the lower 16 bits of the coded data of the current date by the modified Julian Date (MJD) and the Japanese standard time (Japan Standard Time: JST) of 6 4 4 bits. It is assumed to include 24-bit information expressed in Bit Binary Coded Decimal (BCD). The current date can be calculated by performing a predetermined operation on the 16-bit coded data of the MJD. The 6 4-bit 2-evolved decimal numbers represent "hours" in 2 decimal digits by 2 4-bit 2-evolved decimal numbers, and the next 2 4-bit 2-evolved decimal numbers are in decimal system 2. The digits represent "minutes", and the last two 4-bit 2-evolved decimal numbers represent "seconds" in two decimal digits.

Therefore, the difference between the time based on NTP and the time based on MH-TOT is the information in UTC notation that the former NTP can transmit the time information up to "less than a second" as described above. The point is that the information transmitted by TOT is information up to "seconds" in JST notation.

The broadcast receiving device 100 of this embodiment has a time management function based on NTP, which is time information in UTC notation, and is used for decoding and display synchronization processing of video, audio, subtitles, character supermarkets, and other presented data which are broadcast signal contents. By using the above, more accurate synchronization processing can be realized. Furthermore, by referring to the information in the UTC notation instead of the clock notation of the broadcasting station, the video, audio, subtitles, character supermarkets, or other data that are the contents of the broadcasting signal received by the broadcasting signal are acquired by the communication line path. Decoding and display synchronization processing with video, audio, subtitles, text supervision, or other data can also be performed.

Further, the broadcast receiving device of this embodiment presents the current time to the user with a time management function based on "JST_time" including 24-bit information represented by 6 4-bit binary coded decimal numbers of MH-TOT. It may be used for each process or each process for handling the MH-event information table (MH-EIT) described with reference to FIG. 6B. In general, in the process of presenting the current time to the user in the broadcast receiving device, accuracy of less than a second is rarely required. Further, each time information described in the MH-event information table (MH-EIT) is represented by 6 4-bit 2-evolved decimal numbers as in the conventional EIT of digital broadcasting transmitted by the MPEG2-TS method. The 24-bit information is stored in "hours", "minutes", and "seconds" in two decimal digits. Therefore, the time management function based on MH-TOT in the broadcast receiving device 100 of this embodiment is easy to match with the processing using MH-EIT. Specifically, the process using MH-EIT is a program table generation process (described later), a control of recording reservation and viewing reservation, a copyright management process such as temporary storage, and the like. This is because accuracy of less than a second is rarely required for any of the processes, and accuracy in units of one second is sufficient.

In addition, the processing of generating the program guide, the control of recording reservation and viewing reservation, and the copyright management processing such as temporary storage are functions that are also installed in the receiver of the digital broadcasting system using the conventional MPEG2-TS method. .. Then, also in the broadcasting system of this embodiment, in the processing such as the generation processing of the program guide, the control of recording reservation and viewing reservation, and the copyright management processing such as temporary storage, the conventional MPEG2-TS system digital broadcasting system is used. If configured so that it can be handled by consistent time management processing, it constitutes a broadcast receiving device having both a conventional MPEG2-TS system digital broadcast receiving function and an MMT system digital broadcasting receiving function. At the same time, in these processes (processing such as program guide generation processing, recording reservation and viewing reservation control, copyright management processing such as temporary storage), it is no longer necessary to design processing algorithms separately, and the cost is low. can do.

Further, even if the receiver does not have the conventional MPEG2-TS digital broadcast receiving function but only the MMT digital broadcast receiving function, it can generate a program guide, control recording reservation and viewing reservation, and control the recording reservation and viewing reservation. Even if you do not create a completely new algorithm for processing such as copyright management processing such as temporary storage, you can use the algorithm of the function installed in the receiver of the digital broadcasting system using the conventional MPEG2-TS method. It can be developed at a lower cost.

Therefore, the configuration that uses the time management function based on the "JST_time" parameter of MH-TOT for these processes (processing such as program table generation processing, recording reservation and viewing reservation control, and copyright management processing such as temporary storage). By doing so, even a broadcast receiving device for MMT type digital broadcasting can be provided at a lower cost by improving the consistency with the conventional type broadcasting system.

As described above, the broadcast receiving device 100 of this embodiment has a time management function using two types of time information having different accuracy. One time information is notation time information consistent with the conventional digital broadcasting system, the other time information is time information having a higher resolution than the one time information, and the latter time information is the broadcast signal. By using it for synchronization processing of each content data, it realizes more advanced information presentation processing than the conventional broadcasting system, and the former time information is used for program guide generation processing, recording reservation and viewing reservation control, temporary storage, etc. A broadcast receiving device can be provided at low cost by using it for rights management processing and the like.

Therefore, the broadcast receiving device 100 of the present embodiment can realize more advanced information presentation processing and reduce the cost by providing the two types of time management functions described above.

[First modification of time management]
Next, a first modification of time management in the broadcasting system of this embodiment will be described below.

In the first modification, in order to improve the accuracy of the management time of the NTP-based time management function already described with reference to FIG. 7C, the time management server (not shown) or the broadcasting station server 300 to the broadcasting receiving device 100 Information on the estimated delay time in time information transmission is included in the broadcast signal and transmitted, and the broadcast receiving device 100 is configured to use the information on the estimated delay time to correct the system clock of the time management function based on NTP. Is also good.

At this time, the information regarding the assumed delay time may be configured to be transmitted not in the TLV multiplexing stream shown in FIG. 3A but in the TMCC (Transmission and Multiplexing Control) region outside the TLV multiplexing stream. good. If the transmission is performed within the TMCC region, the broadcast receiving device 100 can extract the information regarding the assumed delay time without going through the separation processing (demax processing) of the TLV multiplexed stream. That is, it is possible to acquire information that is not easily affected by the delay due to the separation process in the broadcast receiving device 100, and therefore, it is possible to perform a highly accurate correction process of the system clock. An example of the data structure of the time information transmitted by the TMCC signal will be described with reference to FIG. 13C. The time information may be stored in the TMCC extended information area and transmitted, for example. In the time information in the TMCC extended information area of FIG. 13C, the "delta" parameter is a 32-bit value of the assumed transmission delay from the time management server that distributes UTC or the server device that creates the TMCC signal to a general broadcast receiving device. Represented by a signed fixed-point. The upper 16 bits describe the integer part, and the lower 16 bits describe the decimal point. The "transmit_timestamp" parameter is a transmission time stamp, and describes the time when the TMCC signal is transmitted from the server device in the NTP time stamp length format. The upper 32 bits represent the integer part, and the lower 32 bits represent the decimal point.

In the first modification, the broadcast receiving device 100 of the present embodiment is stored in the TMCC extended information area and transmitted, and the information regarding the estimated delay time described in the time information (for example, the above-mentioned "delta"). The system clock of the NTP-based time management function used for the synchronization processing of each content data of the broadcast signal can be corrected with higher accuracy by using the parameter and / or the “transmit_timestop” parameter).

[Second variant of time management]
Next, a second modification of time management in the broadcasting system of this embodiment will be described below.

As described above, the broadcast receiving device 100 of the present embodiment has a time management function of acquiring the current date and the Japanese standard time from the information transmitted by the MH-TOT and managing the time. The current date and the Japanese standard time acquired by the information transmitted by the MH-TOT are superimposed on the video information, the application information, etc. by the video synthesis unit 161 of the broadcast receiving device 100, and thereby on the monitor unit 162 and the video output unit 163. It can be output and provided to the user. As described above, the MH-TOT has the data structure shown in FIG. 11A, and the broadcast receiving device 100 can acquire the current date and the current time from the "JST_time" parameter of the MH-TOT.

However, since only the lower 16 bits of the MJD encoded data are used in the above-mentioned "JST_time" parameter, an overflow will occur on "April 22, 2038", and the predetermined calculation will occur. It is not possible to express the date after "April 23, 2038" by itself. Therefore, in the second modification of this embodiment, the date after "April 23, 2038" is expressed by switching the calculation method between the case where the value of MJD is equal to or more than the predetermined value and the case where the value is less than the predetermined value. It shall be controlled so that it can be done.

FIG. 12 shows an example of a first calculation method used when the value of MJD is equal to or more than a predetermined value and a second calculation method used when the value of MJD is less than a predetermined value. For example, when the predetermined value is "32768 (0x8000)", the current date is calculated using the first calculation method when the MJD is "32768" or more, and when the MJD is less than "32768". Calculates the current date using the second calculation method. The case where the MJD is less than "32768" is equivalent to the case where the most significant bit of the 16-bit data of the MJD is "0". As a result, in the broadcast receiving device 100 of this embodiment, it is possible to express the date after "April 23, 2038". However, the predetermined value can be arbitrarily set, and the predetermined value may be set to "16384 (0x4000)", "49152 (0xC000)", or the like. The switching condition of the calculation method may be set when the upper 2 bits of the 16-bit data of the MJD are "00" and the upper 2 bits of the 16-bit data of the MJD are not "11". If the above-mentioned means is used with the predetermined value set to "32768", the date before "September 4, 1948" cannot be expressed, but there is no particular problem in practical use as a television receiver. ..

Further, instead of switching between the first calculation method and the second calculation method according to the comparison result between the MJD and the predetermined value, the "reserved" parameter in the data structure of the MH-TOT shown in FIG. 11A The first calculation method and the second calculation method may be switched according to a flag in which a part or all is replaced or a newly added flag. For example, the flag is set to "1" if the most significant bit of the 16-bit encoded data of the MJD is "0" and the MJD indicates "April 23, 2038" or later. However, if it does not indicate "April 23, 2038" or later, "0" may be set. Then, when the flag is "1", the second calculation method shown in FIG. 12 may be used, and when the flag is "0", the first calculation method may be used. Alternatively, a new descriptor having the same meaning as the flag may be newly prepared and placed in the MH-TOT.

Further, in the broadcasting system of this embodiment, as described above, an absolute time in NTP format is transmitted, and the broadcasting receiving device 100 of this embodiment has a time management function based on the NTP. Further, in the broadcast receiving device 100 of the present embodiment, the decoding timing and presentation for each presentation unit of the video / audio signal are referred to by referring to the NTP time stamp or the like described in the MPU time stamp descriptor set for each MPU. The timing is controlled. As described above, the NTP format time information has the configuration shown in FIG. 13A. Further, the MPU time stamp descriptor has the configuration shown in FIG. 13B.

Therefore, in the broadcast receiving device 100 of the present embodiment, the "reference_time stamp" parameter, the "transmit_time stamp" parameter, the "mpu_presentation_time" parameter, or the like is referred to, and the above-mentioned first is performed according to the value of the time data or the like referred to. You may choose whether to use one calculation method or the second calculation method. That is, for example, when the most significant bit of the 64-bit length NTP length format time data is "0", the second calculation method is used, and when it is not "0", the first calculation method is used. And so on.

By any of the above methods, the broadcast receiving device 100 of the present embodiment can express the date after "April 23, 2038".

[Tuning process of broadcast receiver (initial scan)]
The AMT of the broadcasting system of this embodiment provides a list of multicast groups of IP packets for receiving IP packets transmitted by the TLV multiplexing method as indistinguishably as possible from IP packets transmitted on a communication line. It shall be. It is possible to list multiple IP multicast groups for one service identification. It is also possible to use an address mask to efficiently describe consecutive IP addresses.

In the broadcast receiving device 100 of this embodiment, a list of services acquired from TLV-NIT at the time of channel scan at the time of initial setting or at the time of rescan for setting change is displayed in a non-volatile memory such as ROM 103 or storage unit 110. Further, the list of IP multicast groups corresponding to the respective services can be stored in the non-volatile memory in association with the respective services as IP-related information. do. By storing the list of services and IP-related information in the non-volatile memory so that they can be referred to at all times, it is not necessary to reacquire TLV-NIT and AMT when switching channels, etc., and the acquisition of broadcast contents is efficient. It will be possible to do.

FIG. 14 is a diagram showing an example of an operation sequence at the time of channel scan (rescan) in the broadcast receiving device 100 of this embodiment.

When the channel scan is started, the reception function execution unit 1102 instructs the tuner / demodulation unit 131 to set an initial frequency value and tune to the frequency value (S101). When the tuner / demodulation unit 131 succeeds in locking to the set frequency value (S102: Yes), the reception function execution unit 1102 next acquires the TLV-NIT from the received signal (S103).

When the TLV-NIT acquired in the process of S103 is valid data (S104: Yes), the reception function executing unit 1102 acquires information such as a TLV stream ID, an original network ID, etc. from the acquired TLV-NIT. (S105). FIG. 15A shows an example of the data structure of TLV-NIT. It is assumed that the information of the TLV stream ID can be acquired from the "tlv_stream_id" parameter, and the information of the original network ID can be acquired from the "original_network_id" parameter. Further, the distribution system information regarding the physical conditions of the broadcast transmission line corresponding to each TLV stream ID / original network ID is acquired from the distribution system descriptor (S106), and the list of service IDs is acquired from the service list descriptor (S106). S107). FIG. 15B shows an example of the data structure of the satellite distribution system descriptor. FIG. 15C shows an example of the data structure of the service list descriptor. If the TLV-NIT has a plurality of different data such as a TLV stream ID, an original network ID, a distribution system information, a list of service IDs, and the like, the processes of S105 to S107 are repeated. Next, the reception function execution unit 1102 creates a service list based on data such as the TLV stream ID, the original network ID, the distribution system information, and the list of service IDs acquired in the processes of S105 to S107, and the service list is created. The service list is stored in the ROM 103, the storage unit 110, or the like (updated at the time of rescanning) (S108).

Next, the reception function execution unit 1102 acquires AMT from the received signal (S109), and further acquires a list of IP multicast groups for each service ID stored in the service list (S110). FIG. 15D shows an example of the data structure of AMT. If the AMT has a list of IP multicast groups related to a plurality of service IDs, the process of S110 is repeated. When there are a plurality of AMTs having a list of IP multicast groups related to different service IDs, the processes of S109 to S110 are repeated. Next, the reception function execution unit 1102 stores the list of IP multicast groups acquired in the process of S110 in the ROM 103 or the storage unit 110 or the like as IP-related information in association with the service ID (updated at the time of rescanning). (S111).

If the tuner / demodulation unit 131 did not succeed in locking to the set frequency value in the processing of S102 (S102: No), and the TLV-NIT acquired in the processing of S103 is not valid data. In the case (S104: No), the processes of S105 to S111 are not performed.

When the processing of S111 is completed, the reception function executing unit 1102 ends the processing if the frequency value set in the tuner / demodulation unit 131 is the final frequency value in the channel scan range (S112: Yes). On the other hand, if the set frequency value is not the final frequency value in the channel scan range (S112: No), the frequency value set in the tuner / demodulation unit 131 is increased (S113), and the processes of S102 to S111 are performed. repeat. If one TLV-NIT can acquire service IDs related to all services constituting the broadcasting network, and further can acquire an AMT having a list of IP multicast groups related to the service IDs, S112 to S113. No processing is required.

By the series of processes described above, the broadcast receiving device 100 of the present embodiment has a list of services (service list) constituting the broadcast network at the time of channel scan at the time of initial setting or at the time of rescan for setting change. At the same time as the creation / update, the list of IP multicast groups (IP-related information) corresponding to each service can be created / updated and further stored in a non-volatile memory such as the ROM 103 or the storage unit 110.

The rescan for changing the setting is automatically performed when it is detected that the information in the table has changed by referring to the "version_number" parameter of TLV-NIT or AMT. May be. When a change in one of the "version_number" parameters of TLV-NIT and AMT is detected, only the information about the table in which the change in the parameter is detected may be automatically updated. However, when the above-mentioned automatic update is performed, it is desirable to notify the user that the rescan has been automatically performed. Further, the user may be notified that the information in the table has changed, and the user may be allowed to select whether or not to perform the rescan.

[Channel selection process (channel switching) of broadcast receiver]
FIG. 16 is a diagram showing an example of an operation sequence at the time of channel selection (channel switching) in the broadcast receiving device 100 of this embodiment.

When the user operates a remote controller or the like (not shown) to instruct to switch channels, the reception function executing unit 1102 interprets the command transmitted from the remote controller and specifies the service ID of the target service (S201). Next, the reception function execution unit 1102 starts acquiring AMT from the reception signal of the tuner / demodulation unit 131. When the acquisition of the AMT is successful within a predetermined time (S202: Yes), the information regarding the list of IP multicast groups corresponding to the service ID is acquired from the acquired AMT (S204). On the other hand, when the acquisition of AMT is not successful within a predetermined time (S202: No), the IP corresponding to the service ID is obtained by referring to the IP-related information stored in the ROM 103 or the storage unit 110 (S203). Acquire information about the list of multicast groups (S204). It should be noted that the IP-related information stored in the ROM 103, the storage unit 110, or the like may always be referred to without performing the determination process of S202.

Next, the reception function execution unit 1102 starts acquiring the TLV-NIT from the reception signal of the tuner / demodulation unit 131. When the acquisition of the TLV-NIT is successful within a predetermined time (S205: Yes), the distribution system information for acquiring the IP data flow corresponding to the service ID is acquired from the acquired TLV-NIT (S207). On the other hand, if the acquisition of the TLV-NIT is not successful within a predetermined time (S205: No), the service ID is supported by referring to the service list stored in the ROM 103 or the storage unit 110 (S206). The distribution system information for acquiring the IP data flow is acquired (S207). It should be noted that the determination process of S205 may not be performed, and the service list stored in the ROM 103, the storage unit 110, or the like may always be referred to. When the distribution system information is acquired in the process of S207, the reception function execution unit 1102 then controls the tuner / demodulation unit 131 with the frequency value indicated by the acquired distribution system information, and the service ID. (S208), the MMT data string is extracted from the received IP data flow and output to the separation unit 132.

In the separation unit 132, the transport processing unit 1102a acquires an MMTP packet having a packet ID of "0" from the input MMT data string (S209), and further acquires an MPT included in the acquired MMTP packet. (S210). Next, the transport processing unit 1102a refers to the "MMT_package_id_byte" parameter possessed by the acquired MPT, and confirms whether or not the lower 16 bits of the "MMT_package_id_byte" parameter have the same value as the service ID. In an example of the MPT data structure shown in FIG. 17, when the lower 16 bits of the “MMT_package_id_byte” parameter have the same value as the service ID (S211: Yes), the MMTP packet having the packet ID “0” is the above. It is determined that the MMTP packet has the data of the program corresponding to the service ID, and the acquisition of the MFU is executed based on the information possessed by the acquired MPT (S216).

On the other hand, when the lower 16 bits of the "MMT_packet_id_byte" parameter are not the same value as the service ID (S211: No), the MMTP packet having the packet ID "0" has the data of the program corresponding to the service ID. Judge that it is not a packet. In this case, the transport processing unit 1102a acquires the PLT again (S212), and by confirming the acquired PLT, the packet ID of the MMTP packet transmitting the MPT having the "MMT_packet_id_byte" parameter corresponding to the service ID. Confirm (let's say x) (S213). Further, the transport processing unit 1102a acquires an MMTP packet whose packet ID is “x” from the input MMT data string (S214), and acquires an MPT included in the acquired MMTP packet (S215). Further, the MFU is acquired based on the acquired information of the MPT (S216).

It should be noted that the processing of S209 to S211 may not be performed, and the processing of S212 to S215 may always be performed. In this case, when the program data corresponding to the service ID is stored in the MMTP packet other than the packet ID "0", the processing time can be shortened.

When the MFU is acquired by the processing of S216, the transport processing unit 1102a extracts the coded video data, the coded audio data, and the like from the acquired MFU and outputs them to the video decoder 141, the audio decoder 143, and the like. Hereinafter, video / audio decoding processing based on the control of the AV decoding processing unit 1102b and presentation processing based on the control of the presentation processing unit 1102h are performed, but since each of the above processes is known, detailed description thereof will be omitted.

Through the above series of processes, the broadcast receiving device 100 of this embodiment can execute a channel selection (channel switching) operation. In particular, as described with reference to FIGS. 14 and 16, a service list and IP-related information are created at the time of channel scan at the time of initial setting or at the time of rescan for setting change, and the ROM 103 and the storage unit. By storing it in a non-volatile memory such as 110 so that it can be referred to at all times, and referring to the service list and IP-related information stored in the non-volatile memory such as the ROM 103 and the storage unit 110 at the time of channel selection (channel switching). It makes it possible to improve the efficiency of operation during channel selection (channel switching). That is, it is possible to shorten the time from the start of channel selection (channel switching) to the end of channel selection (channel switching) as compared with the case of reacquiring AMT or TLV-NIT at the time of channel selection (channel switching). Become.

[Screen layout control of broadcast receiver]
It is assumed that the broadcast receiving device 100 of this embodiment can control the screen layout based on the description of the LCT. FIG. 18 shows an example of the LCT data structure.

In the figure, in particular, the "left_top_pos_x" parameter and the "right_down_pos_x" parameter set the horizontal position on the upper left and the horizontal position on the lower right of the area when the left side of the full screen display is "0" / the right side is "100". Each is shown as a ratio to the total number of pixels in the horizontal direction. The "left_top_pos_y" parameter and the "right_down_pos_y" parameter are the vertical positions of the upper left and lower right of the area when the upper side of the full screen display is "0" and the lower side is "100". It shall be shown as a ratio to the total number of pixels. Further, the "layer_order" parameter shall indicate the relative position of the region in the depth direction.

An example of assigning a layout to a layout number based on the setting of each parameter is shown in FIGS. 19A to 19D together with the setting value of each parameter.

FIG. 19A is a default layout setting of the broadcast receiving device 100 of this embodiment, and is an example of setting only one area on the full screen. FIG. 19B is an example in which the entire screen is divided into three areas, and the respective areas are set as "area 0", "area 1", and "area 2". For example, when the number of pixels of the full screen is 7680 pixels horizontally / 4320 pixels vertically, the "region 0" has a "left_top_pos_x" parameter of "0", a "left_top_pos_y" parameter of "0", and a "right_down_pos_x" parameter of "80". , "Right_down_pos_y" parameter is "80", so it is set in the range of (0,0)-(6143,3455). Similarly, "region 1" is set in the range of (6144,0)-(7679,4319), and "region 2" is set in the range of (0,3456)-(6143,4319).

FIG. 19C is an example of setting three regions as in FIG. 19B, but "region 0" is set in the range of (0,0)-(7679,4319), and "region 1" and "region 1" are set. 2 ”is arranged in front of“ region 0 ”in the same range as described above, depending on the setting of the“ layer_order ”parameter. In FIG. 19D, "region 0" is set in device 0 (default device: broadcast receiving device 100 in this embodiment), and "region 1" is set in device 1 (portable information terminal 700 in this embodiment). This is an example of the case where it is done.

As described above, in the broadcasting system of the present embodiment, by using the LCT, it is possible to control the screen layout for displaying the multimedia service on the receiver as intended by the service provider.

In addition, the fraction after the decimal point generated when the screen is divided according to the set value of the parameter such as "left_top_pos_x" may be rounded up or rounded down. It may be rounded (or rounded to zero in binary). For example, the number of pixels of the full screen is 7680 pixels / vertical 4320 pixels, the "left_top_pos_x" parameter of "area 0" is "0", the "left_top_pos_y" parameter is "0", the "right_down_pos_x" parameter is "51", and "right_down_". When the parameter is "51", "area 0" may be set in the range of (0,0)-(3916,2203) by rounding up, or (0,0)-(3915,) by rounding down. "Area 0" may be set in the range of 2202). Further, in consideration of the macroblock in the video compression processing, the rounding up / rounding down processing may be performed in units of 8 pixels, 16 pixels, or the like. By the processing, it becomes possible to efficiently perform the area setting based on the LCT and the resolution conversion processing of the multimedia content in the area.

[Exception handling of screen layout control of broadcast receiver]
In the broadcast receiving device 100 of this embodiment, even when the area control of the screen layout is performed by the above-mentioned LCT, when the user instructs to display the EPG screen, as an exception handling, It is assumed that it is possible to perform screen layout control ignoring the description contents of the LCT. FIG. 20A shows an example of the operation of exception handling of screen layout control based on LCT.

The screen layout control similar to that in FIG. 19B is performed according to the description of the LCT, the broadcast program image is displayed in the "region 0", and the broadcast of the program linkage data and the like linked to the broadcast program in the "region 1" and the "region 2". When the user instructs the display of the EPG screen by the remote controller (not shown) while the content is displayed, the broadcast receiving device 100 of the present embodiment describes the LCT as shown in FIG. 20A (A). Regardless of the content, the screen layout setting is returned to the default setting (that is, the screen layout control similar to that shown in FIG. 19A is performed), and the EPG screen is controlled to be displayed on the entire screen. Further, when the user instructs the end of the display of the EPG screen, the screen layout control according to the description contents of the LCT is re-executed.

By performing the above-mentioned control, the EPG screen can be displayed larger than the case where the EPG screen is displayed while maintaining the area control of the screen layout as shown in FIG. 20A (B). It is possible to improve the visibility.

The exception handling of the screen layout control is not applied only when displaying the EPG screen, and as shown in FIG. 20B, various setting screens of the broadcast receiving device 100 (recording setting screen in the illustrated example). ) May be applied when the child screen is displayed or when the two screens are displayed.

In the case of the recording setting screen shown in the figure (A), the display area of the broadcast content is changed from the entire screen to only the sub screen portion at the lower right of the screen. Similarly, in the case of the two-screen display shown in FIG. 3B, the display area of the broadcast content is changed from the entire screen to only the split screen portion on the left side of the middle stage of the screen. In either case, the display area for displaying the broadcast content is narrower than when the entire screen is used, so that the area control of the screen layout is maintained within the display area (that is, the area division is performed). It is not preferable in terms of visual recognition to go and display a plurality of broadcast contents at the same time. Therefore, in the broadcast receiving device 100 of the present embodiment, in the above situation, only the broadcast content of the "region 0" is selected and displayed in the display area. It should be noted that the broadcast contents of "Area 1" and "Area 2" may be selected and displayed according to the immediately preceding area selection status.

By performing the above-mentioned control, it is possible to improve the visibility of the broadcast content as compared with the case where various broadcast contents are displayed while maintaining the area control of the screen layout. The same applies to the display of a sub screen on the recorded program list screen, the display of Internet content in a browser, and the like.

[EPG display of broadcast receiver]
In the broadcasting system of this embodiment, time-series information regarding an event (so-called program) included in each service constituting the broadcasting network is transmitted by MH-EIT. FIG. 21 shows an example of the data structure of the MH-EIT of this embodiment. The MH-EIT is identified into two classes by the table ID (corresponding to the "talbe_id" parameter in the figure), and indicates the information of the current / next event of the own TLV stream and the schedule information of each event of the own TLV stream. Shall be possible. The broadcast receiving device 100 of this embodiment refers to the MH-EIT or the like and identifies by a service ID (corresponding to the "service_id" parameter in the figure), thereby providing information such as the start time and broadcast time of each event. It is possible to create an EPG screen by acquiring the above, and it is possible to superimpose the created EPG on video information or the like in the video synthesis unit 161 and display it on the monitor unit 162.

FIG. 22A is a diagram showing an example of an EPG screen in the broadcast receiving device 100 of this embodiment. The EPG screen 162a has a matrix shape with a vertical axis displaying time and a horizontal axis displaying service ID (channel), and displays detailed information of broadcast programs broadcast on each channel in each time zone. Further, the detailed information 162a1 of each broadcast program is mainly composed of a title area 162a2 and a detailed explanation area 162a3.

In the title area 162a2, a program title of the broadcast program, a symbol representing the attribute of the broadcast program, and the like are displayed. The symbol / character indicating the attribute of the broadcast program is, for example, a symbol / character indicating that the program is a new program, a symbol / character indicating that the program is a rebroadcast program, or the like. Alternatively, it may be a mark or the like symbolizing "data" which means that it corresponds to data broadcasting by a broadcasting service. Further, the mark 162a4 or the like symbolizing "NetWork", which means that the content or application related to the broadcast program can be acquired from the network, may be used. Further, by differentiating the background color of the detailed information 162a1 from others, or by surrounding the display area of the detailed information 162a1 with a thick frame, a symbol or the like representing the attribute of the broadcast program may be substituted.

It should be noted that each control information (message, table, descriptor, etc.) in the broadcasting system of this embodiment indicates that the content, application, or the like related to the broadcasting program can be acquired from the network. However, if the LAN cable is not connected to the LAN communication unit 121 of the broadcast receiving device 100 and the access to each server device on the network is not possible, the mark 162a4 in which the above-mentioned "NetWork" is symbolized Etc. may be controlled so as not to be displayed.

Further, the broadcast program is a broadcast program distributed via the Internet 200 and cannot be acquired only from the broadcast wave. Further, as described above, the broadcast receiving device 100 is a server device on the network. In a state where access to is not possible, as shown in FIG. 22B, the portion of the detailed information 162b1 displayed on the EPG screen 162b may be controlled to be grayed out. That is, it is controlled so that the detailed information of the distributed program that cannot be viewed is not displayed. Further, by differentiating the background color of the detailed information 162b1 from others, it may be used as an alternative to the grayout process. When the detailed information 162b1 is selected by operating the remote controller (not shown), the broadcast receiving device 100 is in a state where it cannot access each server device on the network, or the distribution program associated with the detailed information 162b1 is viewed. The user may be notified by a pop-up or the like that it cannot be performed.

With each of the above-mentioned controls, the broadcast receiving device 100 can provide the program information of each broadcast program to the user in a more comfortable format according to the network connection status.

FIG. 22C is a diagram showing another example of the EPG screen in the broadcast receiving device 100 of this embodiment. In the figure, "M1 TV", "M2 broadcast", "M3 channel", "M4TV", "TV M5", etc. are the names of the broadcasting stations of each channel, and in particular, the "M2 broadcasting" station is based on the broadcasting wave. It is assumed that the broadcast program to be delivered and the broadcast program delivered via the Internet 200 (information 162c1 in the frame shown in "net broadcast" in the figure) are provided at the same time.

As shown in the figure, when there is a channel having only a distribution program distributed via the Internet 200, all channels (including information 162c1) are normally shown in the EPG screen 162c of the figure (A). Control to display the information of. On the other hand, when the broadcast receiving device 100 is in a state where it cannot access each server device on the network, as shown in the EPG screen 162d of FIG. It may be controlled not to display the channel information of "M2 broadcasting (net broadcasting)" (information 162c1 in the figure (A)).

With each of the above-mentioned controls, the user of the broadcast receiving device 100 can eliminate the need to confirm the information of the channel that cannot be viewed by himself / herself.

[Emergency warning broadcast display of broadcast receiver]
The broadcast receiving device 100 of this embodiment performs an emergency warning broadcast reception process when the emergency warning broadcast start control signal bit of the TMCC signal included in the transmission data including the TLV stream changes from "0" to "1". It shall be possible to do so.

The emergency warning broadcast may be provided as a full-screen display application, or may be provided as character information in a character supermarket. When the emergency warning broadcast is provided as character information in the character supermarket, it is preferable to display the character information of the character supermarket regardless of the state of the broadcast receiving device 100 immediately before receiving the emergency warning broadcast. That is, as shown in FIG. 23, when the user watches a normal broadcast program and receives the emergency warning broadcast while the program screen 162e of the broadcast program is displayed on the monitor unit 162, the emergency warning broadcast is performed. The character information 162e1 is superimposed and displayed on the program screen 162e. Similarly, when the user instructs the display of the EPG screen and receives the emergency warning broadcast while the EPG screen 162f is displayed on the monitor unit 162, the character information 162f1 by the emergency warning broadcast is superimposed on the EPG screen 162f. And control to display.

By the above-mentioned control, in the broadcast receiving device 100 of this embodiment, even when the user selects and displays the EPG screen, various setting screens, the recorded program list screen, the Internet browser, etc., the emergency warning broadcast is performed. Is received, it is possible to avoid overlooking important text information based on the emergency warning broadcast. It should be noted that this control may be performed on the character information of a normal character supermarket that is not based on the emergency warning broadcast.

[Various exception handling]
When the broadcast receiving device 100 of this embodiment cannot acquire the data outside the TLV stream in the same package, for example, the following exception handling may be performed.

As described with reference to FIG. 6E, in the broadcasting system supported by the broadcast receiving device 100 of the present embodiment, in the TLV stream based on the location information stored in the MPT (corresponding to “MMT_general_location_info ()” in FIG. 17). The data to be acquired and the data to be acquired by a route other than the TLV stream can be included in the same package. However, the data transmission path other than the TLV stream (for example, IPv4 data flow, IPv6 data flow, MPEG2-TS of broadcasting, etc.) indicated by the location information is a reception function different from the reception function of the TLV / MMT stream. Therefore, even if the broadcast receiving device 100 is in operation, the receiving function of these transmission paths is not operating, or the receiving function itself is operating but the relay device or the like is not operating. There may be situations where data cannot be acquired from these transmission paths, such as when the transmission paths are not connected by wire or wirelessly, or when the broadcast receiving device 100 is installed in an environment where these transmission paths cannot be connected in the first place. ..

Under such circumstances, an event indicating that the location information stored in the MPT associates the data acquired in the TLV stream with the data acquired by a route other than the TLV stream so as to be included in the same package. When received, the broadcast receiving device 100 of this embodiment may perform the following operations, for example.

For example, as shown in FIGS. 19B and 19C, the LCT sets a plurality of areas in the screen, displays the video included in the TLV stream in "area 0", and displays "area 1" and "area 2". ] Is associated so that the data acquired by the transmission path other than the TLV stream is displayed, and the data of the transmission path other than the TLV stream to be displayed in the “region 1” and the “region 2” is displayed. If it cannot be acquired, the layout display of a plurality of areas specified by the LCT may be prohibited. Specifically, even if the LCT is received, the video of the content to be received in the TLV stream is left displayed in the "region 0" of the default layout display shown in FIG. 19A, as shown in FIGS. 19B and 19C. It is sufficient not to shift to the layout display of multiple areas. Further, in this state, even if an instruction to change from the default layout to the layout shown by LCT is input to the operation input unit 170 of FIG. 7A, the default layout display shown in FIG. 19A can be left as it is, or other data broadcasting screens. It may be possible not to shift to the layout display of a plurality of areas as shown in FIGS. 19B and 19C by switching to.

As shown in FIGS. 19B and 19C, the LCT sets a plurality of areas in the screen, displays the video included in the TLV stream in "area 0", and displays the video contained in the TLV stream in "area 1" and "area 2". When the data acquired by the transmission path other than the TLV stream is associated so as to be displayed, the data of the transmission path other than the TLV stream to be displayed in "Area 1" or "Area 2" cannot be acquired. As another operation example of the case, the display frames of the multiple areas of FIGS. 19B and 19C shown by the LCT are once displayed, and the background color and a predetermined still image are displayed for the "area 1" and the "area 2". If the data of the transmission path other than the TLV stream indicated by the location information of the MPT cannot be acquired even after the lapse of a predetermined time, the display may be switched to return to the state of the default layout display shown in FIG. 19A. In this case, if the program video included in the TLV stream is continuously displayed in the "region 0" even when the layouts of FIGS. 19A, 19B, and 19C are changed, the user's program video itself Is preferable because it continues.

Further, since the data of the transmission path other than the TLV stream to be displayed in "Area 1" and "Area 2" cannot be acquired, the content received in the TLV stream in "Area 0" of the default layout display shown in FIG. 19A. When the video is displayed, the various communication functions and various reception functions of the broadcast receiving device 100 of this embodiment start to operate, and the communication environment, communication status, and various reception functions of the various communication functions are displayed. Due to changes in the reception environment and reception status, it is possible that data on a transmission path other than the TLV stream to be displayed in "region 1" or "region 2" can be acquired. In this case, the broadcast receiving device 100 of the present embodiment immediately switches from the default layout display shown in FIG. 19A to the layout of a plurality of areas as shown in FIGS. 19B and 19C shown by the LCT, and the TLV is set to "area 0". The video of the content received in the stream may be displayed, and the data acquired from a transmission path other than the TLV stream may be displayed in the "region 1" or the "region 2". Further, the layout change may be executed after the change instruction from the default layout to the layout indicated by the LCT is input from the operation input unit 170 without immediately changing the layout.

[Copyright protection function]
In the digital broadcasting system supported by the broadcast receiving device 100 of the present embodiment, by transmitting the MPT including the copy control information, for example, "unlimited copy possible"("unlimited copy possible and storage" by the copy control information. It may be divided into two types: "encryption processing required at the time of output" and "unlimited copy possible and no encryption processing required at the time of storage and output"), "copying only for one generation", "copying possible multiple times" ( For example, if 9 times copy is possible + 1 move is possible, so-called "dubbing 10"), "copy prohibition", and the like may be configured to indicate the copy control state of the content referred to by the MPT for transmission. In this case, the broadcast receiving device 100 of the present embodiment stores the content in the storage (storage) unit 110, records the content in the removable recording medium, outputs the content to the external device, and transfers the content to the external device according to the copy control information. It may be configured to control copying, moving processing to an external device, and the like. The target of the storage process may include not only the storage (storage) unit 110 inside the broadcast receiving device 100 but also a record that has been subjected to protection processing such as encryption processing so that it can be reproduced only by the broadcast receiving device 100. .. Specifically, the target of the storage process includes an external recording device or the like that can be recorded and reproduced only by the broadcast receiving device 100.

A specific example of the process based on the copy control information will be described below.

First, when the copy control information included in the MPT indicates "unlimited copying is possible", the broadcast receiving device 100 of this embodiment is stored in the storage (storage) unit 110, recorded in a removable recording medium, and an external device. You can output to, copy to an external device, and move to an external device without any restrictions. However, if "unlimited copy possible and encryption processing required for storage and output" and "unlimited copy possible and encryption processing not required for storage and output" are separated, "unlimited copy possible and storage and output" When "sometimes encryption processing is required", the number of times of storage in the storage (storage) unit 110, recording on a removable recording medium, output to an external device, copying to an external device, and move processing to an external device is limited. However, it is necessary to perform encryption processing in each case.

Further, when the copy control information included in the MPT indicates "copying is possible only for one generation", the broadcast receiving device 100 of this embodiment enables encrypted storage in the storage (storage) unit 110. When the stored content is output to an external device for viewing, it is encrypted and output together with the copy control information of "copy prohibited". However, so-called move processing to an external device (a process of copying the content to the external device and disabling the content in the storage (storage) unit 110 of the broadcast receiving device 100 by an erasing process or the like) is possible.

Further, when the copy control information included in the MPT indicates "copying is possible a predetermined number of times", the broadcast receiving device 100 of this embodiment can be encrypted and stored in the storage (storage) unit 110. When the stored content is output to an external device for viewing, it is encrypted and output together with the copy control information of "copy prohibited". However, it may be possible to make a predetermined number of copies and move processes to an external device. In the case of the so-called "dubbing 10" regulation, 9 copies and 1 move process may be performed on an external device.

Further, when the copy control information included in the MPT indicates "copy prohibited", the broadcast receiving device 100 of this embodiment prohibits copying to the storage (storage) unit 110. However, the broadcast receiving device 100 has a predetermined time or a storage (storage) unit 110 only for a predetermined time specified by the control information (for example, according to the MH-Expire descriptor shown in FIG. 6D) included in the broadcast signal. When it is configured to have a "temporary storage" mode that enables holding to the storage (storage) unit 110, even if the copy control information included in the MPT indicates "copy prohibited". It enables temporary retention of the content. When the copy control information included in the MPT is "copy prohibited" and the content is output for viewing on an external device, it is encrypted and output together with the "copy prohibited" copy control information.

The output for viewing to the above-mentioned external device may be performed via the video output unit 163 and the audio output unit 166 of FIG. 7A, the digital I / F unit 125, the LAN communication unit 121, or the like. The copy or move process to the above-mentioned external device may be performed via the digital I / F unit 125 or the LAN communication unit 121 of FIG. 7A.

According to the process described above, appropriate content protection can be realized according to the copy control information associated with the content.

Further, the copy control information is a copy process of the content indicating the copy restriction such as "only one generation can be copied", "predetermined multiple times can be copied", and "copy prohibited" to the external device via the LAN communication unit 121. Is possible only when the IP address of the external device that is the destination of the transmission packet from the broadcast receiving device 100 is in the same subnet as the IP address of the broadcasting receiving device 100, and the IP address of the external device is the broadcasting receiving device. If it is outside the same subnet as the IP address of 100, it may be prohibited. The content whose copy control information is "unlimited copying is possible and encryption processing is required at the time of storage and output" may be handled in the same manner.

Similarly, once the copy control information indicates copy restrictions such as "only one generation can be copied", "predetermined multiple copies are possible", "unlimited copies are possible and encryption processing is required at the time of storage and output". In the process of moving to an external device via the LAN communication unit 121 after storing in the storage (storage) unit 110, the IP address of the external device that is the destination of the transmission packet from the broadcast receiving device 100 is the broadcast receiving device 100. It is possible only when it is in the same subnet as the IP address of, and it may be prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100.

As for the video output and audio output for viewing of the content stored in the storage (storage) unit 110 of the broadcast receiving device 100, in principle, the IP address of the external device that is the destination of the transmission packet from the broadcast receiving device 100 receives the broadcast. It is possible only when it is in the same subnet as the IP address of the device 100, and it is prohibited when the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100. However, the registration process as a device that is connected to the external device within the same subnet as the IP address of the broadcast receiving device 100 within a predetermined period and can be viewed even outside the same subnet as the IP address of the broadcast receiving device 100. In the case of a device that has been (paired), even if the IP address of the external device is outside the same subnet as the IP address of the broadcast receiving device 100, the storage (storage) of the broadcasting receiving device 100 in the external device is performed. It may be configured to enable viewing video output and audio output of the content stored in the unit 110. In this case, the video output and audio output for viewing are performed by encrypting the content.

According to the process described above, both user convenience and content protection are achieved by performing different processes depending on whether the external device is in the same subnet as the IP address of the broadcast receiving device 100 or outside the same subnet. Can be realized.

Next, as described with reference to FIG. 6E, in the digital broadcasting system supported by the broadcasting receiving device 100 of the present embodiment, the location information in the MPT (“MMT_general_location_info ()” in FIG. 17) is used in the TLV stream of the broadcasting path. Data acquired by a route different from the acquired data (IPv4, IPv6, MPEG2-TS, URL, etc.) may be included in the same package and event as the data acquired in the TLV stream, but at this time, it is copied to MPT. Content protection when control information is included will be described.

First, when copy control information is included in the MPT, the data included in the same package and the same event in the location information is a route different from the data acquired in the TLV stream of the broadcast route (IPv4, IPv6, MPEG2-TS, URL, etc.). ) May be controlled according to the copy control information included in the TLV stream. As described above, the copy control state of the content specified by these copy control information is "unlimited copy possible" ("unlimited copy possible and encryption processing required at storage and output" and "unlimited copy possible". And it may be divided into two types, "encryption processing is not required at the time of storage and output"), "copying is possible only for one generation", "copying is possible a predetermined number of times" (for example, if copying is possible 9 times + move 1 time is possible, so-called " Dubbing 10 ”),“ copy prohibited ”, etc. can be specified.

Here, when the position of the data indicated by the location information includes the MPEG2-TS data transmitted by another digital broadcast signal, the MPEG2-TS data is associated with the copy control information even in the other digital broadcast signal. It is being broadcast. Then, the question is how to control the copy of the MPEG2-TS data according to what information (whether the copy control information included in the TLV / MMT stream or the copy control information contained in the MPEG2-TS is followed). ..

In the digital broadcasting system of this embodiment, as a solution to this problem, the broadcast receiving device 100 may operate any of the following plurality of solutions.

<Operation example 1>
In the first operation example, when the MPT contains the copy control information and the location information includes the MPEG2-TS data transmitted by another digital broadcast signal in the data included in the same package and the same event, the MPEG2-. The copy control state indicated by the copy control information included in the TLV stream is preferentially controlled over the copy control state indicated by the copy control information included in the TS.

For example, the copy control state indicated by the copy control information included in the TLV stream is "1st generation copy possible", and the copy control state indicated by the copy control information included in the MPEG2-TS is "predetermined multiple times copy possible". If there is, copy control may be performed as the content of "1st generation copy possible" even if the data is acquired by a route different from the data acquired by the TLV stream (digital broadcasting of MPEG2-TS transmission format). For example, the copy control state indicated by the copy control information included in the TLV stream is "unlimited copy possible", and the copy control state indicated by the copy control information included in the MPEG2-TS is "predetermined multiple times copy possible". If there is, copy control may be performed as the content of "unlimited copy possible" even if the data is acquired by a route different from the data acquired by the TLV stream (digital broadcasting of MPEG2-TS transmission format).

In the case of this operation, the data acquired by a route other than the TLV stream can also be put into the copy state to be managed in the broadcasting system supported by the broadcasting receiving device 100 of this embodiment.

<Operation example 2>
In the second operation example, when the MPT contains copy control information and the data included in the same package and the same event in the location information includes the MPEG2-TS data transmitted by another digital broadcast signal, the TLV stream. The copy control state indicated by the copy control information contained in MPEG2-TS is compared with the copy control state indicated by the copy control information contained in MPEG2-TS, and the copy control state indicated by the copy control information contained in MPEG2-TS is used. Is stricter than the copy control state indicated by the copy control information included in the TLV stream, the storage process is performed in the storage (storage) unit 110 or the like, the recording process is performed in the removable recording medium, or the output processing is performed from the digital interface. At that time, it operates so as to exclude the MPEG2-TS data from the processing target content.

In the case of this operation, the data acquired by a route other than the TLV stream is copied on the broadcast receiving device 100 of this embodiment while respecting the original copy control information set in the broadcasting system that transmits the data. It is possible to eliminate duplication of control states.

Further, as a result of the comparison, when the copy control state indicated by the copy control information included in the MPEG2-TS is the same as the copy control state indicated by the copy control information included in the TLV stream, or a looser copy control state. May perform copy control on the MPEG2-TS data included in the same package and the same event in the location information as the content in the copy control state indicated by the copy control information included in the TLV stream.

In the case of this operation, the data acquired by a route other than the TLV stream is copied on the broadcast receiving device 100 of this embodiment while respecting the original copy control information set in the broadcasting system that transmits the data. It is possible to eliminate duplication of control states.

In the above description, the copyright protection function of the broadcast receiving device 100 of this embodiment has been described as being performed based on the copy control information included in the MPT. However, the table in which the copy control information is arranged is not limited to the MPT. In addition to the MPT, the MH-service description table (MH-SDT), the MH-event information table (MH-EIT) described in FIG. 6B, or other tables are arranged for transmission, and the broadcast receiving device 100 follows these. Copyright protection processing may be performed.

According to the present embodiment described above, it is possible to provide a broadcast receiver compatible with MMT digital broadcasting.

(Example 2)
Hereinafter, the second embodiment of the present invention will be described. The configuration, treatment, effect, etc. in this embodiment shall be the same as in Example 1 unless otherwise specified. Therefore, in the following, the differences between the present embodiment and the first embodiment will be mainly described, and the common points will be omitted as much as possible in order to avoid duplication. Further, the broadcast receiving device of this embodiment will be described below assuming that it is a television receiver that supports both the MMT system and the MPEG2-TS system as the media transport system.

[Hardware configuration of broadcast receiver]
FIG. 24 is a block diagram showing an example of the internal configuration of the broadcast receiving device 800. The broadcast receiving device 800 includes a main control unit 801, a system bus 802, a ROM 803, a RAM 804, a storage unit 810, a LAN communication unit 821, an expansion interface unit 824, a digital interface unit 825, a first tuner / demodulation unit 831 and a second tuner /. Demodulation unit 832, MMT decoding processing unit 841, MPEG2-TS decoding processing unit 842, video synthesis unit 861, monitor unit 862, video output unit 863, audio synthesis unit 864, speaker unit 865, audio output unit 866, operation input unit 870 Consists of ,.

Main control unit 801, system bus 802, ROM 803, RAM 804, storage unit 810, expansion interface unit 824, digital interface unit 825, monitor unit 862, video output unit 863, speaker unit 865, audio output unit 866, operation input unit 870, Etc. are the main control unit 101, the system bus 102, ROM 103, RAM 104, the storage (storage) unit 110, the expansion interface unit 124, the digital interface unit 125, the monitor unit 162, and the video output unit 163 in the broadcast receiving device 100 of the first embodiment. , The speaker unit 165, the audio output unit 166, the operation input unit 170, and the like have the same functions, respectively, and detailed description thereof will be omitted.

The first tuner / demodulation unit 831 receives the broadcast wave of the broadcast service that employs MMT as the media transport method via an antenna (not shown), and the service desired by the user is controlled by the main control unit 801. Tuning (selecting) to the channel of. Further, the first tuner / demodulation unit 831 demodulates the received broadcast signal to acquire the MMT data string, and outputs the MMT data string to the MMT decoding processing unit 841. The second tuner / demodulation unit 832 receives the broadcast wave of the broadcasting service adopting MPEG2-TS as the media transport method via an antenna (not shown), and the user desires based on the control of the main control unit 801. Synchronize (select) the channel of the service to be performed. Further, the second tuner / demodulation unit 832 demodulates the received broadcast signal to acquire the MPEG2-TS data string, and outputs the MPEG2-TS data string to the MPEG2-TS decoding processing unit 842.

The MMT decoding processing unit 841 inputs the MMT data string output from the first tuner / demodulation unit 831, and based on the control signal included in the MMT data string, the video data string and the audio data string, which are real-time presentation elements, Separation processing of character super data string, subtitle data string, etc., decoding processing, etc. are performed. The MMT decoding processing unit 841 includes a separation unit 132, a video decoder 141, a video color gamut conversion unit 142, an audio decoder 143, a character super decoder 144, a subtitle decoder 145, and a subtitle synthesis unit 146 in the broadcast receiving device 100 of the first embodiment. It is provided with functions corresponding to the subtitle color gamut conversion unit 147, the data decoder 151, the cache unit 152, the application control unit 153, the browser unit 154, the application color gamut conversion unit 155, the sound source unit 156, and the like. The MMT decoding processing unit 841 can perform various processes described in the first embodiment. Since the details of the various processes are as described in the first embodiment, the description thereof will be omitted.

The MPEG2-TS decoding processing unit 842 inputs the MPEG2-TS data string output from the second tuner / demodulation unit 832, and the video data which is a real-time presentation element based on the control signal included in the MPEG2-TS data string. Separation processing, decoding processing, etc. of columns, audio data strings, character super data strings, subtitle data strings, etc. are performed. The MPEG2-TS decoding processing unit 842 has the same function as the IRD (Integrated Receiver Decorder) unit of a conventional television receiver that receives broadcast waves of a broadcasting service that adopts MPEG2-TS as a media transport method. A detailed description will be omitted.

The video composition unit 861 inputs video information, subtitle information, and application information output from the MMT decoding processing unit 841 and video information, subtitle information, and application information output from the MPEG2-TS decoding processing unit 842. Perform processing such as selection and / or superimposition as appropriate. The video synthesis unit 861 includes a video RAM (not shown), and the monitor unit 862 and the like are driven based on the video information and the like input to the video RAM. Further, the video compositing unit 861 performs scaling processing, overlay processing of EPG screen information, and the like, if necessary, based on the control of the main control unit 801. The voice synthesis unit 164 inputs the voice information output from the MMT decoding processing unit 841 and the voice information output from the MPEG2-TS decoding processing unit 842, and appropriately selects and / or performs processing such as mixing.

The LAN communication unit 821 is connected to the Internet 200 via the router device 200r, and transmits / receives data to / from each server device and other communication devices on the Internet 200. Further, the MMT data string (or a part thereof) or the MPEG2-TS data string (or a part thereof) of the program transmitted via the communication line is acquired, and the MMT decoding processing unit 841 or the MPEG2-TS is appropriately obtained. It is output to the decoding processing unit 842.

[Time display of broadcast receiver]
In the broadcast receiving device 800 of this embodiment, it is assumed that the current date and the current time can be displayed on the EPG screen, various setting screens, and the like. The information regarding the current date and the current time is transmitted by MH-TOT or the like in a broadcasting service that uses MMT as the media transport method, and MPEG- in a broadcasting service that uses MPEG2-TS as the media transport method. 2 It is transmitted by TOT (Time Offset Table) or the like provided in SI (Service Information) specified in the system. The broadcast receiving device 800 can acquire information on the current date and the current time by referring to the MH-TOT and the TOT.

Further, in general, when the video compositing unit 861 mainly selects the video information or the like output from the MMT decoding processing unit 841, the information regarding the current date and the current time acquired from the MH-TOT is used. When the video compositing unit 861 mainly selects the video information or the like output from the MPEG2-TS decoding processing unit 842 by superimposing it on the video information or the like, the information regarding the current date or the current time acquired from the TOT is described above. It may be controlled so as to be superimposed on video information or the like.

However, since there are differences in the coding / decoding processing, transmission path, etc. between the broadcasting service that uses MMT as the media transport method and the broadcasting service that uses MPEG2-TS as the media transport method, the current time is displayed in particular. In the above, there is a possibility that inconsistency may occur between the selection of the broadcasting service adopting MMT as the media transport method and the selection of the broadcasting service adopting MPEG2-TS as the media transport method. For example, as shown in FIG. 25, the EPG screen 162g that displays the channel information of the broadcasting service that adopts MMT as the media transport method displays the channel information of the broadcasting service that adopts MPEG2-TS as the media transport method. When the screen display is switched to the screen 162h, the display of the current time is switched from the current time display 162g1 to the current time display 162h1, which may cause the user to feel a visual discomfort due to the inconsistency.

In the broadcast receiving device 800 of this embodiment, even when the video compositing unit 861 mainly selects the video information or the like output from the MMT decoding processing unit 841 in order to prevent the user's visual discomfort. , Information on the current date and the current time acquired from the TOT is controlled to be superimposed on the video information and the like. That is, the content of the broadcasting service that adopts MMT as the media transport method is controlled so as to superimpose the current time information provided by the broadcasting service that adopts MPEG2-TS as the media transport method.

By performing the above control, the broadcast receiving device 800 of the present embodiment always displays the current time information acquired by referring to the TOT when displaying the current time. Therefore, even when switching between a broadcasting service that uses MMT as the media transport method and a broadcasting service that uses MPEG2-TS as the media transport method, the user will feel a visual discomfort due to the inconsistency in the display of the current time. It is possible to prevent it from being caused.

Note that FIG. 26 shows an example of selection control of the current time information reference source according to the reception status of each broadcast service in the broadcast receiving device 800 of this embodiment. In the broadcast receiving device 800 of this embodiment, when the broadcasting service adopting MPEG2-TS as the media transport method can be received, the current time information is always acquired by referring to the TOT. The MH-TOT is only available when the broadcast service that uses MPEG2-TS as the media transport method cannot be received and that the broadcast service that uses MMT as the media transport method can be received. Control to get the current time information by referring to.

Further, contrary to the above-mentioned control, the current time information provided by the broadcasting service adopting MMT as the media transport method is superimposed on the content of the broadcasting service adopting MPEG2-TS as the media transport method. Even if it is controlled, the same effect as described above can be obtained.

As described above, when controlling so as to superimpose the current time information provided by the broadcasting service adopting MPEG2-TS as the media transport method on the contents of the broadcasting service adopting MMT as the media transport method. In any case, the content of the broadcasting service that adopts MPEG2-TS as the media transport method is controlled so as to superimpose the current time information provided by the broadcasting service that adopts MMT as the media transport method. Also in the present case, the current time information can be corrected by referring to the "delta" parameter of the time information in the TMCC extended information area, as described in [Time management of broadcast receiving device] in the first embodiment. It is possible.

[EPG display of broadcast receiver]
The event schedule information of the broadcasting service that adopts MMT as the media transport method is transmitted by MH-EIT or the like. On the other hand, the event schedule information of the broadcasting service adopting MPEG2-TS as the media transport method is transmitted by EIT (Event Information Table) or the like provided in SI defined in the MPEG-2 system. Therefore, in general, when displaying video information or the like provided by a broadcasting service that uses MMT as a media transport method, event schedule information (MH-EIT) of the broadcasting service that uses MMT is displayed. ) Is available, and when the video information provided by the broadcasting service that uses MPEG2-TS as the media transport method is displayed, the event schedule information of the broadcasting service that uses MPEG2-TS. (EIT) can be obtained.

However, the broadcast receiving device 800 of this embodiment is also displaying video information or the like provided by a broadcasting service that employs MMT as the media transport method, or MPEG2-TS as the media transport method. It is possible to acquire both the MH-EIT and the EIT even when displaying the video information or the like provided by the broadcasting service adopting the above, and the usability for the user is improved.

FIG. 27A shows an example of the EPG screen in the broadcast receiving device 800 of this embodiment. In the figure, the EPG screen 162i is an EPG screen created based on the MH-EIT of a broadcasting service that adopts MMT as a media transport method, and is an EPG screen of "M1 TV", "M2 broadcasting", "M3 channel", and "M4TV". , "Television M5", etc. are the names of broadcasting stations of broadcasting services that adopt MMT as the media transport method, respectively. The EPG screen 162j is an EPG screen created based on the EIT of a broadcasting service that adopts MPEG2-TS as a media transport method, and is "T6 TV", "T7 broadcasting", "T8 channel", "T9TV". , "TV TA" and the like are the names of broadcasting stations of broadcasting services that adopt MPEG2-TS as the media transport method, respectively.

For example, when a user is instructing to display the EPG screen by operating a remote controller (not shown) while watching a broadcast program provided by a broadcast service that uses MMT as the media transport method, the initial screen of the EPG screen (shown). Omitted) is displayed. The initial screen of the EPG screen is an EPG screen created based on the MH-EIT of a broadcasting service that adopts MMT as a media transport method, and is "17:00-on October 7, 2014 (today)". (Nearby of the current time) ”is displayed with detailed information on the broadcast program of each channel. Next, the user wants to confirm the detailed information of the broadcast program of each channel of "20 o'clock-" of "October 9, 2014", and instructs to update the EPG screen by operating the remote controller (not shown). Then, the EPG screen 162i is displayed.

Furthermore, when the user wants to confirm the detailed information of the broadcast program provided by the broadcast service that adopts MPEG2-TS as the media transport method and instructs to switch the network by operating the remote controller (not shown), the EPG. The screen 162j is displayed. At this time, in the broadcast receiving device 800 of this embodiment, the initial screen of the EPG screen created based on the EIT of the broadcasting service adopting MPEG2-TS as the media transport method (that is, "October 7, 2014" (Detailed information of the broadcast program of each channel of "17:00 ~"), but the same time zone as the EPG screen 162i displayed immediately before (that is, "20: 00 ~" of "October 9, 2014" 』) Control to display the detailed information of the broadcast program of each channel.

By the above-mentioned control, the user can continuously confirm the detailed information about the broadcast programs of the same day and the same time zone of a plurality of networks having different media transport methods by a simple operation. That is, the usability of the broadcast receiving device 800 is improved.

FIG. 27B is a diagram showing an example different from the above-mentioned EPG screen in the broadcast receiving device 800 of this embodiment. The EPG screen 162k shows a state in which the EPG screen 162i shown in FIG. 27A is scrolled in the channel direction (horizontal direction) by operating a remote controller (not shown). That is, in the example shown in FIG. 27B, the EPG screen is scrolled in the channel direction (horizontal direction), so that the channel information and the media are created based on the MH-EIT of the broadcasting service that adopts MMT as the media transport method. Channel information created based on the EIT of a broadcasting service that uses MPEG2-TS as the transport method is seamlessly displayed on the same time axis.

Therefore, it is created based on the EIT of the broadcasting service that adopts MPEG2-TS as the media transport method while the user is checking the channel information created based on the MH-EIT of the broadcasting service that adopts MMT as the media transport method. Even when it is desired to confirm the channel information, it is possible to eliminate the need for instructions for switching the network by operating the remote controller (not shown). Further, the user can simultaneously confirm detailed information about broadcast programs of the same day and the same time zone of a plurality of networks having different media transport methods. That is, the usability of the broadcast receiving device 800 is improved.

(Example 3)
Hereinafter, Example 3 of the present invention will be described. The configuration, treatment, effect, etc. in this embodiment shall be the same as in Example 1 unless otherwise specified. Therefore, in the following, the differences between the present embodiment and the first embodiment will be mainly described, and the common points will be omitted as much as possible in order to avoid duplication.

[Voice data transmission method]
As described in the above description of the first embodiment, in the broadcasting system of the present embodiment, MPEG-4 AAC or MPEG-4 ALS is used as the audio coding method. The interface between the MPEG-4 AAC or MPEG-4 ALS and the MMT, which is a media transport method, may be in the LATM / LOAS stream format. LATM (Low Overhead MPEG-4 Audio Transport Multiplex) can provide multiple functions such as ordering and concatenation of audio data in addition to including channel configuration information of audio data. Further, LOAS (Low Overhead Audio Stream) can provide a synchronization function.

FIG. 28A shows an example of a bitstream structure in the LATM / LOAS format. The LATM / LOAS stream format shall be composed of LOAS (however, not shown), LATM header, and Raw_data block composed of synchronization bytes and voice-coded information defined in ISO / IEC14496-3. It is assumed that it is possible to have a maximum of 22.2ch multi-channel stereo coded audio data for each Raw_data block. The SCE in the Raw_data block is an element for storing mono-voice. CPE is an element that stores 2ch pair audio. The LFE is an element for storing the low frequency effect channel sound. The DSE is an element that stores the downmix coefficient from 22.2ch to 5.1ch, dialog control information, replacement voice, and the like. The PCE is an element that stores audio format information that is not described in CICP, a downmix coefficient from 5.1ch to 2ch, a dialog control flag, and the like. TERM is a stream terminator. The number of elements such as SCE, CPE, LFE, DSE, etc. arranged in one Raw_data block is not limited to the number shown in the figure.

Here, FIG. 29A shows an example of the speaker arrangement when outputting the 22.2ch audio signal. The screen 100s in the figure may be a television receiver or the like. In this case, the television receiver or the like becomes the broadcast receiving device 100 of this embodiment. When the broadcast receiving device 100 is a DVD recorder, STB, or the like, the screen 100s may be a monitor device or the like that displays an output image of the DVD recorder, STB, or the like. When the broadcast receiving device 100 is a projector or the like, the screen 100s may be a screen on which the image of the projector is projected.

In this embodiment, when 22.2ch audio output is performed, 24 speakers are three-dimensionally arranged in three layers. In the upper layer (Top Layer), the front left side (TpFL) speaker 901, the front center (TpFC) speaker 903, the front right side (TpFR) speaker 905, the left side (TpSiL) speaker 911, and the center (TpC) speaker. 913, a speaker 915 on the right side (TpSiR), a speaker 921 on the rear left side (TpBL), a speaker 923 on the rear center (TpBC), and a speaker 925 on the rear right side (TpBR) are arranged. In the middle layer (Middle Layer), the front left side (FL) speaker 931, the front left center (FLc) speaker 932, the front center (FC) speaker 933, the front right center (FRc) speaker 934, and the front right side (FR). ) Speaker 935, left side (SiL) speaker 941, right side (SiR) speaker 945, rear left side (BL) speaker 951, rear center (BC) speaker 953, rear right side (BR) speaker 955, Is placed. In the lower layer (Bottom Layer), a speaker 961 on the front left side (BtFL), a speaker 963 on the front center (BtFC), and a speaker 965 on the front right side (BtFR) are arranged, and further, for low frequency effect (LFE1, LFE2). Speaker 972 and speaker 974 are arranged. Further, the recommended arrangement range of each speaker is shown in FIG. 29B.

As shown in FIG. 29C, the 22.2ch audio data is encoded as a mono signal for the speakers (FC, BC, TpFC, TpC, TpBC, BtFC) arranged on the median surface, and LATM. It is assumed that the / LOAS stream is transmitted by 6 SCE elements in the Raw_data block. The audio data for the speakers (FLc and FRc, FL and FR, SiL and SiR, BL and BR, TpFL and TpFR, TpSiL and TpSiR, TpBL and TpBR, BtFL and BtFR) located symmetrically are stereo signals, respectively. It is assumed that it is encoded by utilizing the correlation and transmitted by the eight CPE elements of the Raw_data block. Further, it is assumed that the audio data for the speakers (LFE1 and LFE2) of the low frequency effect channel is transmitted by the two LFE elements of the Raw_data block.

The 22.2ch audio output and the LATM / LOAS format bitstream structure described above are examples, and different methods may be used. For example, the audio output is 7.1ch or 5.1ch multi-channel stereo, 2ch stereo, monaural output, dual mono output, etc., and only the coded audio data of the corresponding channel is used in the Raw_data block of the LATM / LOAS stream. It may be transmitted. In the case of 7.1ch audio output, for example, FC coded audio data is transmitted by one SCE element in the Raw_data block of the LATM / LOAS stream, and the codes of FL and FR, SiL and SiR, BL and BR are transmitted. The converted voice data may be transmitted by three CPE elements, and the LFE may be transmitted by one LFE element.

In the ISO / IEC14496-3 (MPEG-4 AAC) standard, an "index" is assigned to each audio channel in each of the audio coding modes. For example, in the above-mentioned coding mode "3/3 / 3-5 / 2/3-3 / 0 / 0.2 (channel configuration = 13)" capable of transmitting 22.2ch, "1: FC". , 2: FLc, 3: FRc, 4: FL, 5: FR, 6: SiL, 7: SiR, 8: BL, 9: BR, 10: BC, 11: LFE1, 12: LFE2, 13: TpFC, 14 : TpFL, 15: TpFR, 16: TpSiL, 17: TpSiR, 18: TpC, 19: TpBL, 20: TpBR, 21: TpBC, 22: BtFC, 23: BtFL, 24: BtFR. ing.

Next, an example of the configuration of the dialog control information included in the DSE element will be described with reference to FIG. 28B. Parameters as shown in FIG. 28B, for example, are stored and transmitted in the dialog control information. Specifically, "ext_dialogue_status" is information indicating whether or not dialog information exists. For example, "1 (exists)" or "0 (does not exist)". "Num_dialogue_chans" indicates the number of dialog-only channels. "Num_additional_lang_chans" indicates the number of additional dialogs. "Dialogue_src_index" i "" indicates the index of the dialog-dedicated channel. The value obtained by subtracting 1 from the index value described in the above-mentioned example of "channel configuration = 13" is stored. "I" is an argument for identifying the dialog-dedicated channel, and values from "0" to "num_dialogue_chans-1" are used. If there are two dialog-only channels ("num_dialogue_chans" = 2), the argument of "i = 0,1" is used.

"Dialogue_main_range_coment_bytes" indicates the number of bytes of character string information for indicating the contents of the main dialog. The main dialog is a dialog transmitted within the number of channels of each coding mode. For example, in the above-mentioned example of "channel configuration = 13", the dialog transmitted within 22.2ch is the main dialog. On the other hand, the dialog transmitted outside 22.2ch is the addition dialog. The audio data of the main dialog and the audio data of the add dialog are included in the same concept in the sense of the audio data assigned as the dialog. "Dialogue_main_range_comment_data" is byte data of character string information for indicating the contents of the main dialog. "Dialogue_main_lang_code" indicates the language code of the main dialog.

"Dialogue_additional_lang_code [j]" indicates the language code of the j + 1th additional dialog. "J" is an argument for identifying the addition dialog, and a value from "0" to "num_additional_lang_chans-1" is used. If there are three additional dialogs ("num_additional_lang_chans" = 3), the argument of "j = 0,1,2" is used. "Dialogue_additional_lang_coment_bytes [j]" indicates the number of bytes of character string information for indicating the contents of the j + 1th addition dialog. "Dialogue_additional_lang_comment_data [j]" is byte data of character string information for indicating the contents of the j + 1th addition dialog.

By transmitting the dialog control information as described above, is there a dialog-dedicated channel in the audio of multiple channels included in the LATM / LOAS format bitstream, which is the dialog-dedicated channel, and what is the content of the main dialog? The broadcaster can tell the receiver how many additional dialogs there are, what the contents of the additional dialogs are, and so on.

[Dialog control function]
It is assumed that the broadcast receiving device 100 of this embodiment has a function that allows the viewer to individually adjust the volume and the like of the dialog (speech, narration, etc.). That is, it prevents the dialog from becoming difficult to hear due to individual differences in the preferable dialog volume, etc., performance differences of the playback device (broadcast receiving device), environmental factors such as living noise around the playback device (broadcast receiving device), and the like. Because.

30A and 30B show conceptual diagrams of the dialog control function in the broadcasting system of this embodiment. The "background sound" used in the following explanation means the sound transmitted on a channel other than the channel assigned for the dialog when transmitting the dialog sound (a channel that is neither the main dialog nor the additional dialog). ..

For example, as shown in FIG. 30A, a broadcasting station uses the above-mentioned LATM / LOAS stream format to transmit background sound on a number of channels transmitted in the coding mode, and transmits the background sound in the coding mode. Additional dialog audio for replacement may be transmitted with a number other than the number of channels to be used. For example, 22.2ch audio (background sound) is transmitted by each element of SCE, CPE, and LFE, and 4ch replacement audio (additional dialog) is transmitted by DSE2 to 5 elements. In this case, the 4ch is an additional dialog audio channel because it is transmitted with an outside number of 22.2ch transmitted in the coding mode of "channel configuration = 13". Since the 22.2ch does not include the main dialog and is not an additional dialog audio channel, it can be expressed as a "background sound" channel. The broadcast receiving devices A to C receive the broadcast wave including the LATM / LOAS stream format, select 1ch from the 4ch replacement audio (addition dialog), and select the selected 1ch replacement audio (additional). The process of appropriately adjusting the volume of the 22.2ch audio (background sound) and the 22.2ch audio (background sound), and the 1ch replacement audio (additional dialog) selected and the 22.2ch audio (background sound) are mixed. Output processing, etc.

Alternatively, as another example, as shown in FIG. 30B, the broadcasting station uses the above-mentioned LATM / LOAS stream format, and the main dialog sound and the background sound are used in a number of channels transmitted in the coding mode. May be transmitted. For example, the dialog sound for 2ch (for example, FC and BtFC) is transmitted by the SCE element, and the background sound for 20.2ch (each channel excluding FC and BtFC) is transmitted by each element of SCE, CPE, and LFE. .. In this case, the 2ch is the main dialog audio channel assigned for the dialog in the number of 22.2ch transmitted in the coding mode of "channel configuration = 13". Since the 20.2ch is an audio channel other than the channel assigned for the main dialog and is not an additional dialog audio channel, it can be expressed as a “background sound” channel. In the broadcast receiving devices D to F, the process of receiving the broadcast wave including the LATM / LOAS stream format and extracting the main dialog sound for the 2 channels, the volume of the extracted 2 channels of the main dialog sound, and the like, and the above 20 . Perform processing such as adjusting the volume of the background sound for 2 channels independently and outputting it.

Alternatively, as another example, although not shown, the broadcasting station uses the above-mentioned LATM / LOAS stream format to transmit the main dialog sound and the background sound on a number of channels transmitted in the coding mode. Then, the additional dialog voice for replacement may be transmitted by the number other than the number of channels transmitted in the coding mode. For example, 2ch (for example, FC and BtFC) of the 22.2ch (for example, FC and BtFC) main dialog audio transmitted in the coding mode of "channel configuration = 13" is transmitted by the SCE element, and the remaining 20.2ch (the FC mentioned above). The background sound for each channel (excluding BtFC) is transmitted by each element of SCE, CPE, and LFE, and the replacement audio (additional dialog) of 4ch, which is an outside number of 22.2ch, is transmitted by DSE2 to 5 elements. In this case, the 2ch is an audio channel assigned for the main dialog. The 4ch is an audio channel assigned for an additional dialog for replacement. Since the other 20.2ch is an audio channel that is neither a main dialog nor an additional dialog, it can be expressed as a "background sound" channel. In the broadcast receiving device, a process of receiving a broadcast wave including the LATM / LOAS stream format and selecting 1ch from the 4ch replacement audio (additional dialog), and the selected 1ch replacement audio (additional dialog). The process of replacing the main dialog sound for the 2 channels, the process of independently adjusting and outputting the volume of the replaced main dialog sound for the 2 channels and the background sound for the 20.2 channels, and the like are performed.

By performing such processing, in the broadcast receiving device 100 that receives the broadcast wave of the broadcast system of the present embodiment, the viewer can select a dialog and adjust the volume balance according to his / her own taste. It will be possible.

Hereinafter, the details of the dialog control process in the broadcast receiving device 100 of this embodiment will be described.

<Dialog voice selection process>
First, the operation of the process of selecting 1ch from a plurality of replacement voices (additional dialogs) of the LATM / LOAS stream format (4 channels in the example of the figure) as shown in FIG. 30A will be described.

FIG. 31A shows a first example of the process of selecting 1ch from a plurality of replacement voices (additional dialogs) in the broadcast receiving device 100 of this embodiment. In the first example, it is displayed by pressing the "menu" key (may be expressed as a button; the same applies in the following description) of the remote controller (remote controller) capable of operating the broadcast receiving device 100. In the main menu, use the "replacement voice selection submenu" that is displayed by selecting the "voice setting" item and the "replacement voice selection" item in order. The "replacement voice selection submenu" is a list of the plurality of replacement voices (addition dialogs), and the viewer can operate the "cursor" key and the "decision" key of the remote controller to perform the plurality of replacement voices (addition dialog). It is possible to select a desired 1ch from the replacement voice (addition dialog) of. The display items, the hierarchical structure, and the like of the main menu may be different from those shown in the figure. Further, the "dialogue selection" key may be prepared in the remote controller, and the "replacement voice selection submenu" may be directly displayed by pressing the "dialog selection" key.

Further, in order to cancel the replacement process of the replacement voice (addition dialog), as shown in FIG. 31B, the "original" item may be selected in the "replacement voice selection submenu". Further, in order to change the replacement voice (addition dialog) to another replacement voice (addition dialog), a desired item other than "original" may be selected in the "replacement voice selection submenu". The "replacement voice selection submenu" shown in the figure is a display example in a state where "Japanese" is selected as the replacement voice (addition dialog) and the replacement processing is being executed.

FIG. 31C shows a second example of the process of selecting 1ch from a plurality of replacement voices (additional dialogs) in the broadcast receiving device 100 of this embodiment. In the second example, the "replacement audio selection box" displayed by pressing the "information" key of the remote controller capable of operating the broadcast receiving device 100 is used. The "replacement voice selection box" displays the plurality of replacement voices (addition dialogs) in association with the "color" key of the remote controller, and the viewer presses the "color" key of the remote controller. By pressing the button, it is possible to select a desired 1ch from the plurality of replacement voices (additional dialogs). When the "information" key is pressed, other information (for example, the program name, broadcast time, channel information, etc. of the currently displayed broadcast program) may be further displayed. Further, the shape and the like of the "replacement voice selection box" may be different from those shown in the figure. Further, by preparing a "dialog selection" key on the remote controller and pressing the "dialog selection" key, only the "replacement voice selection box" may be displayed.

To cancel the replacement process of the replacement voice (addition dialog), press the "color" key associated with the "original" item in the "replacement voice selection box" as shown in FIG. 31D. It's fine. Further, in order to change the replacement voice (addition dialog) to another replacement voice (addition dialog), the "color" associated with the desired item other than the "original" in the "replacement voice selection box" is used. Just press the key. The "replacement voice selection box" shown in the figure is a display example in a state where "Japanese" is selected as the replacement voice (addition dialog) and the replacement processing is being executed.

FIG. 31E shows a third example of the process of selecting 1ch from a plurality of replacement voices (additional dialogs) in the broadcast receiving device 100 of this embodiment. In the third example, each time the "dialog selection" key of the remote controller capable of operating the broadcast receiving device 100 is pressed, the replacement sound (additional dialog) and the original sound that can be selected by the broadcast receiving device 10 are sequentially changed. To. Specifically, when the "dialog selection" key is pressed once, the "dialog voice information" indicating information about the currently selected replacement voice (additional dialogue) or the original voice is displayed at a predetermined position on the screen (the same figure). In the example of, it is displayed in the lower right). After that, the selection of the replacement voice (additional dialog) and the original voice can be sequentially changed each time the "dialog selection" key is repeatedly pressed. The above-mentioned original sound indicates a state in which only the background sound is output on 22.2ch without performing the replacement process of the replacement sound (additional dialog).

The display order and sequential selection order of the replacement voices in each of the above examples are, for example, the order according to "j" which is an argument for identifying the additional dialog stored in the dialog control information described with reference to FIG. 28B. Is also good. By doing so, by setting the argument "j" of the additional dialog that the broadcasting station wants to preferentially select to a small value, it is preferentially selected in the display or sequential selection on the broadcast receiving device 100 side. Become. In this case, the intention of the broadcasting station is reflected on the receiver side, which is preferable. Further, as another example, it is character string information for indicating the order of the values of the language code "dialogue_additional_lang_code [j]" of the additional dialog stored in the dialog control information described with reference to FIG. 28B, and the contents of the additional dialog. The sort order of the first character of "dialogue_additional_language_comment_data [j]" may be used. Alternatively, the official language in the country where the broadcast receiving device 100 is used (for example, Japanese in Japan) may be given the highest priority, and the order may be in accordance with the above rules for other additional dialogs.

In addition, when performing the above processing, immediately after pressing the "dialog selection" key, the voice switching processing (change from the original voice to the replacement voice (addition dialog), replacement voice (addition dialog) to another replacement voice) Do not execute (change to (addition dialog), etc.). For example, if the "dialog selection" key is not pressed again for a predetermined time or more after the "dialog selection" key is pressed, the voice switching process is executed. That is, this is to prevent the annoyance of frequent voice switching during repeated pressing of the "dialog selection" key.

In the above-mentioned "replacement audio selection submenu", "replacement audio selection box", "dialog audio information", etc., when the currently displayed broadcast program has replacement audio (additional dialog) data. It is desirable to display only in. Specifically, the parameter indicating the number of additional dialogs described in the dialog control information of the DSE (for example, "num_additional_lang_chans" or the like) is referred to, and the parameter indicating the number of additional dialogs is described. The display of the "replacement voice selection submenu", "replacement voice selection box", "dialog voice information", etc. may be controlled. The control may be performed depending on the presence or absence of a parameter indicating the existence of other additional dialogs (for example, "dialogue_additional_lang_code [j]" stored in the dialog control information described with reference to FIG. 28B).

For example, in the first example, when the value of the parameter indicating the number of the additional dialogs indicates that the currently displayed broadcast program does not have the data of the replacement audio (additional dialog). , When you operate the remote controller and select the "Voice setting" item from the main menu, you can control so that the "Replacement voice selection" item is not displayed. Alternatively, when the "Voice setting" item is selected from the main menu by operating the remote control, the "Replacement voice selection" item is displayed, but the "Replacement voice selection" item cannot be selected. It may be controlled so that it is left (grayed out, etc.). In the second example, when the value of the parameter indicating the number of the additional dialogs indicates that the currently displayed broadcast program does not have the data of the replacement audio (additional dialog), the remote controller is used. It is sufficient to control so that the "replacement voice selection box" is not displayed when the "information" key of is pressed. The other information may be displayed without any problem. In the third example, when the value of the parameter indicating the number of the additional dialogs indicates that the currently displayed broadcast program does not have the data of the replacement audio (additional dialog), the remote controller When you press the "Dialog selection" key, you can control to display messages such as "Dialog voice cannot be selected" and "This function cannot be used at this time".

In addition, when the original voice is replaced with the replacement voice (addition dialog) by each of the above-mentioned processes, or when the replacement voice (addition dialog) is changed to another replacement voice (addition dialog), the original voice is used. When canceling the replacement process to the replacement voice (addition dialog), the voice before the change is faded out and the voice after the change is faded in during the voice switching process such as the voice before the change. It is desirable to perform a process of cross-fading the voice after the change, a process of inserting a silence for a predetermined period between the voice before the change and the voice after the change, and the like.

<Dialog audio channel extraction process>
Next, as shown in FIG. 30B, the voice of the dialogue voice channel (2ch in the example of the figure) from the voice data (22.2ch in the example of the figure) transmitted in the LATM / LOAS stream format. The operation of the process of extracting data will be described.

In the broadcasting system of this embodiment, it is possible to use a predetermined channel of audio data transmitted in the LATM / LOAS stream format as a channel for dialog audio. In this case, as described with reference to FIG. 28B, a parameter indicating whether the dialog information exists in the dialog control information of the DSE (for example, "ext_dialoge_status") and a parameter indicating the number of dialog-dedicated channels (for example, "num_dialogue_chans"). ) Etc. shall be described. The broadcast receiving device 100 of the present embodiment refers to a parameter indicating whether or not the dialog information exists, a parameter indicating the number of dialog-dedicated channels, and the like, and displays audio data transmitted in the LATM / LOAS stream format for dialog audio. It is possible to know whether or not a channel exists. Further, by referring to a parameter indicating the index of the dialog-dedicated channel (for example, "dialogue_src_index [i]"), which channel of the audio data transmitted in the LATM / LOAS stream format is used as the dialog audio channel. It is possible to grasp whether it is done. Therefore, the broadcast receiving device 100 of this embodiment can specify the dialog audio channel and extract the dialog audio data by referring to each of the above parameters.

<Dialog audio / background sound volume adjustment processing>
The broadcast receiving device 100 of this embodiment can appropriately adjust and output the volume (level) of the dialog sound and the background sound. Hereinafter, the volume adjustment processing of the dialog sound and the background sound in the broadcast receiving device 100 will be described.

There are three patterns in the volume adjustment processing of the dialog sound and the background sound in the broadcast receiving device 100 of this embodiment. In the first pattern, as in the broadcast receiving device A shown in FIG. 30A and the broadcasting receiving device D shown in FIG. 30B, after adjusting the volume of the dialog sound, the volume of the sound of all channels including the dialog sound is set. It is a pattern to make adjustments. In the second pattern, as in the broadcast receiving device B shown in FIG. 30A and the broadcasting receiving device E shown in FIG. 30B, after adjusting the volume of the background sound, the volume of the sound of all channels including the background sound is used. It is a pattern to make adjustments. The third pattern is a pattern in which the volume control of the dialog sound and the volume control of the background sound are independently performed, as in the broadcast receiving device C shown in FIG. 30A and the broadcast receiving device F shown in FIG. 30B. .. In the following description, in the configuration diagram of the broadcast receiving devices A to F, the level adjustment (volume adjustment) with the letter "M" is referred to as "main volume control", and the letter "S" or "s" is used. The attached level adjustment (volume adjustment) may be referred to as "sub volume adjustment" and explained.

FIG. 32A shows a first example of the processing of "main volume control" and "sub volume control" in the broadcast receiving device 100 of this embodiment. In the first example, the "main volume adjustment" is performed by operating the "volume" key of the remote controller that can operate the broadcast receiving device 100. In this figure, as an example, a direct operation key for volume up / down adjustment that can directly execute an up operation for raising the volume and a down operation for lowering the volume will be described. In addition, in the main menu displayed by pressing the "Menu" key on the remote controller, the "Replacement voice volume adjustment bar" displayed by selecting the "Voice setting" item and the "Replacement voice volume" item in order. "Sub volume control" is performed by operating ". The viewer can perform "sub-volume adjustment" by operating the "cursor" key of the remote controller to adjust the knob position of the "replacement audio volume adjustment bar". The display items and hierarchical structure of the main menu, the shape of the "replacement audio volume control bar", and the like may be different from those shown in the figure.

In the "main volume control", in the broadcast receiving device A, the broadcast receiving device B, the broadcast receiving device D, the broadcast receiving device E, etc., the dialog sound is linked to the operation of the "volume" key of the remote controller. It is assumed that the volume level of the audio data of all channels including the background sound is adjusted. On the other hand, in the broadcast receiving device C, the broadcast receiving device F, etc., only the volume level of the background sound is adjusted in conjunction with the operation of the "volume" key of the remote controller.

Further, in the "sub-volume control", in the broadcast receiving device A, the broadcast receiving device C, the broadcast receiving device D, the broadcast receiving device F, etc., the knob position of the "replacement audio volume control bar" is set to "Max". It shall be controlled so that the volume level of the dialog voice is raised according to the process of adjusting to the side. On the other hand, in the broadcast receiving device B, the broadcasting receiving device E, etc., the volume level of the background sound is lowered according to the process of adjusting the knob position of the "replacement audio volume adjustment bar" to the "Max" side. As a result, it is assumed that the volume level of the dialog sound is controlled to be raised relative to the volume level of the background sound.

FIG. 32B shows a second example of the processing of "main volume control" and "sub volume control" in the broadcast receiving device 100 of this embodiment. In the second example, the remote controller capable of operating the broadcast receiving device 100 has a "volume (M)" key for performing "main volume control" and a "volume (S)" for performing "sub volume control". Prepare the key as another independent direct operation key for volume up / down adjustment. The viewer can perform "main volume adjustment" by operating the "volume (M)" key of the remote controller, and "sub volume adjustment" by operating the "volume (S)" key. Can be done directly.

In the "main volume control", in the broadcast receiving device A, the broadcast receiving device B, the broadcast receiving device D, the broadcast receiving device E, etc., in conjunction with the operation of the "volume (M)" key of the remote controller, It is assumed that the volume level of the audio data of all channels including the dialog sound and the background sound is adjusted. On the other hand, in the broadcast receiving device C, the broadcast receiving device F, etc., only the volume level of the background sound is adjusted in conjunction with the operation of the "volume (M)" key of the remote controller.

Further, in the "sub-volume control", in the broadcast receiving device A, the broadcasting receiving device C, the broadcasting receiving device D, the broadcasting receiving device F, etc., the "volume (S)" key is pressed on the Up side. It is assumed that the volume level of the dialog voice is controlled to be raised. On the other hand, in the broadcast receiving device B, the broadcast receiving device E, etc., the volume level of the background sound is lowered in response to the pressing of the "volume (S)" key on the Up side, and as a result, the volume of the dialog sound. The level shall be controlled so as to be raised relative to the volume level of the background sound.

FIG. 32C shows a third example of the processing of "main volume control" and "sub volume control" in the broadcast receiving device 100 of this embodiment. In the third example, the "voice selection" key is prepared on the remote controller that can operate the broadcast receiving device 100. By pressing the "voice selection" key, the viewer can switch between "main volume control" and "sub volume control" when the "volume" key of the remote controller is operated. It will be possible. That is, in the initial state, "main volume adjustment" is possible when the "volume" key of the remote controller is operated, and after pressing the "voice selection" key once, the operation of the "volume" key is performed. "Sub volume control" is possible. After pressing the "voice selection" key again, the "main volume adjustment" can be performed again by operating the "volume" key.

In the "main volume control", in the broadcast receiving device A, the broadcast receiving device B, the broadcast receiving device D, the broadcast receiving device E, etc., the dialog sound is linked to the operation of the "volume" key of the remote controller. It is assumed that the volume level of the audio data of all channels including the background sound is adjusted. On the other hand, in the broadcast receiving device C, the broadcast receiving device F, etc., only the volume level of the background sound is adjusted in conjunction with the operation of the "volume" key of the remote controller.

Further, in the "sub-volume control", in the broadcast receiving device A, the broadcasting receiving device C, the broadcasting receiving device D, the broadcasting receiving device F, etc., a dialog is given in response to the pressing of the "volume" key on the Up side. It shall be controlled so that the volume level of the voice is raised. On the other hand, in the broadcast receiving device B, the broadcasting receiving device E, etc., the volume level of the background sound is lowered in response to the pressing of the "volume" key on the Up side, and as a result, the volume level of the dialog sound becomes the background. It shall be controlled so as to be raised relative to the volume level of the sound.

In the example of FIG. 32A, "sub volume control" is performed by menu operation, and in the example of FIG. 32C, two different volume adjustment functions of "main volume control" and "sub volume control" are commonly used to increase the volume. Operate using the direct operation key for down adjustment. In these cases, there is only one direct operation key for adjusting the volume up / down of the remote controller. Therefore, when manufacturing a remote controller, it is possible to use a molding mold that is common to a remote controller that has only one direct operation key for volume up / down adjustment, such as a remote controller for broadcast receivers that do not have a dialog volume adjustment function. Can be manufactured at a cost.

On the other hand, in the example of FIG. 32B, two different volume adjustment functions of "main volume control" and "sub volume control" are operated by using independent direct operation keys for volume up / down adjustment. In this case, since different keys corresponding to the different volume adjustment functions are prepared, the user can easily execute the adjustment functions of "main volume adjustment" and "sub volume adjustment" properly. For example, it is possible to realize a remote controller that is easy to use even for elderly users who have a high need for a dialog voice volume adjustment function.

In each of the first to third examples, the selection of the audio data to be the target of the "main volume control" or the "sub volume control" is performed using the information stored in the dialog control information described with reference to FIG. 28B.

For example, in the broadcast receiving device A of FIG. 30A, the dialog control information is used to determine that there are four additional dialog audio data, and the user is made to select one of the four additional dialog audio data, and the selected audio data is selected. Determined as the target audio data for "sub volume control". Also, using the dialog control information, it is determined that there is no main dialog in 22.2ch, all 22.2ch are determined to be "background sound", and the 22.2ch and audio data after "sub volume adjustment" are determined. The mixed voice with and is determined as the target voice data of "main volume control". That is, in the broadcast receiving device A, the determination of the audio data to be the target of the "main volume control" or the "sub volume control" is performed by using the information stored in the dialog control information.

Further, in the broadcast receiving device B of FIG. 30A, using the dialog control information, it is determined that there is no main dialog in 22.2ch, all 22.2ch are determined to be "background sound", and these audio data are used. Determined as the target audio data for "sub volume control". In addition, using the dialog control information, it is determined that there are four additional dialog voice data, and one of the four is selected by the user, and the selected voice data and the voice data after "sub volume adjustment" are used. The mixed voice of is determined as the target voice data of "main volume control". That is, in the broadcast receiving device B, the determination of the audio data to be the target of the "main volume control" or the "sub volume control" is performed by using the information stored in the dialog control information.

Further, in the broadcast receiving device C of FIG. 30A, using the dialog control information, it is determined that there is no main dialog in 22.2ch, all 22.2ch are determined to be "background sound", and these audio data are used. Determined as the target audio data for "main volume control". In addition, using the dialog control information, it is determined that there are four additional dialog voice data, one of the four is selected by the user, and the selected voice data is used as the target voice data for "sub-volume adjustment". I have decided. That is, in the broadcast receiving device C, the determination of the audio data to be the target of the "main volume control" or the "sub volume control" is performed by using the information stored in the dialog control information.

Further, in the broadcast receiving device D of FIG. 30B, it is determined that there are 2 channels of main dialog audio data in 22.2ch by using the dialog control information, and the main dialog audio data is used as the audio data targeted for "sub volume adjustment". To be determined as. In addition, using the dialog control information, 20.2ch audio data other than the main dialog in 22.2ch is specified, and these audio data are judged as "background sound", and the 20.2ch and "sub volume adjustment" are performed. The mixed voice with the voice data after "" is determined as the target voice data of "main volume control". That is, in the broadcast receiving device D, the determination of the audio data to be the target of the "main volume control" or the "sub volume control" is performed by using the information stored in the dialog control information.

Further, in the broadcast receiving device E of FIG. 30C, it is determined that the main dialog audio data is 2ch in 22.2ch by using the dialog control information, and the audio of 20.2ch other than the main dialog in 22.2ch is recorded. The data is specified, and these voice data are determined as "background sound" and determined as the target voice data for "sub volume control". Further, the mixed voice of the 2ch main dialog voice data specified by using the dialog control information and the voice data after the "sub volume control" is determined as the target voice data of the "main volume control". That is, in the broadcast receiving device E, the determination of the audio data to be the target of the "main volume control" or the "sub volume control" is performed by using the information stored in the dialog control information.

Further, in the broadcast receiving device F of FIG. 30B, it is determined that the main dialog audio data is 2ch in 22.2ch by using the dialog control information, and the audio of 20.2ch other than the main dialog in 22.2ch is recorded. The data is specified, and these voice data are determined as "background sound" and determined as the target voice data for "main volume control". Further, the 2ch main dialog voice data specified by using the dialog control information is determined as the target voice data of the "sub volume control". That is, in the broadcast receiving device F, the determination of the audio data to be the target of the "main volume control" or the "sub volume control" is performed by using the information stored in the dialog control information.

FIG. 32D is a screen display showing an example of volume level information displayed on the monitor unit 162 of the broadcast receiving device 100 when "main volume control" or "sub volume control" is performed in the first to third examples. It is a figure. In the broadcast receiving device 100 of the present embodiment, by displaying the volume level information shown in the figure in response to the operation of the above-mentioned "main volume control" or "sub volume control", the viewer is notified. It is possible to simultaneously or individually notify the volume level of the current dialog voice and / or the volume level of the voice data of all channels including the background sound.

FIG. 3A is a first example of a method of displaying volume level information according to the operation of the “main volume control” or the “sub volume control”. In the first example, either the volume level of the audio data of all channels corresponding to the operation of the "main volume adjustment" and the volume level of the dialog audio corresponding to the operation of the "sub volume adjustment" are the same. It is displayed by displaying the volume level information of the shape. In this case, the volume level of the voice data of all the channels and the volume level of the dialog voice may be distinguishable by the difference in the display color of the volume level information or the like. When the display method of the first example is used for displaying the volume level information, it is possible to reduce the area of the displayed program hidden by the volume level information, which is preferable for viewing.

FIG. 3B is a second example of a method of displaying volume level information according to the operation of the “main volume control” or the “sub volume control”. In the second example, the volume level of the audio data of all channels corresponding to the operation of the "main volume adjustment" and the volume level of the dialog audio corresponding to the operation of the "sub volume adjustment" are displayed at the same time. Is. In this case, the viewer can easily confirm the balance between the volume level of the audio data of all the channels and the volume level of the dialog audio.

FIG. 3C is a third example of a method of displaying volume level information according to the operation of the “main volume control” or the “sub volume control”. In the third example, the volume level of the audio data of all channels corresponding to the operation of the "main volume adjustment" and the volume level of the dialog audio corresponding to the operation of the "sub volume adjustment" are set to the main / sub. The type information is added and displayed. In this case, the viewer can easily confirm the type of the displayed volume level information, and further, it is possible to reduce the area of the displayed program hidden by the volume level information. The main / sub type information may have different words such as background sound / dialog.

The "replacement voice volume adjustment bar" and the volume level information related to the dialog voice are displayed only when the currently displayed broadcast program has the data of the replacement voice (additional dialog). Is desirable. Specifically, the parameter indicating the number of additional dialogs described in the dialog control information of the DSE (for example, "num_additional_lang_chans" or the like) is referred to, and the parameter indicating the number of additional dialogs is described. It suffices to control the display of the "replacement voice volume adjustment bar" and the volume level information related to the dialog voice. The control may be performed with reference to a parameter indicating that another additional dialog exists. When the parameter referred to above indicates that the additional dialog does not exist, the processing such as invalidating (graying out, etc.) the menu item and displaying the message is described in the above-mentioned <Dialog voice selection processing>. You can do the same.

If the parameter indicating the number of the additional dialogs indicates that the currently displayed broadcast program does not have the data of the replacement voice (additional dialog), the "volume (S)" of the remote controller is used. When the key (in the case of the second example above) or the "voice selection" key (in the case of the third example above) is pressed, "the volume of the dialog voice cannot be adjusted" or "this function cannot be used at this time". It is good to control to display such messages.

<Sound quality adjustment process for dialog sound / background sound>
The broadcast receiving device 100 of this embodiment can appropriately adjust and output the sound quality (voice mode, etc.) of the dialog sound and the background sound. Hereinafter, the sound quality adjustment processing of the dialog sound and the background sound in the broadcast receiving device 100 will be described.

In the process of adjusting the sound quality (audio mode, etc.) of the present embodiment, the sound quality of the background sound (audio mode, etc.) is the same as the level adjustment (volume adjustment) process in the broadcast receiving device C and the broadcasting receiving device F. ) And the sound quality of the dialog sound (voice mode, etc.) shall be adjusted independently. Further, in the following, the process of adjusting the sound quality (voice mode, etc.) of the background sound will be referred to as "main sound quality adjustment", and the process of adjusting the sound quality of the dialog sound (voice mode, etc.) will be referred to as "sub sound quality adjustment". May be done.

FIG. 33A shows a first example of the processing of "main sound quality adjustment" and "sub sound quality adjustment" in the broadcast receiving device 100 of this embodiment. In the first example, the "audio setting" item and the "audio mode" item are selected in order in the main menu displayed by pressing the "menu" key of the remote controller capable of operating the broadcast receiving device 100. Perform "main sound quality adjustment" by operating the displayed "voice mode selection submenu" (however, not shown). In addition, "sub sound quality adjustment" is performed by operating the "replacement voice sound quality selection submenu" displayed by sequentially selecting the "voice setting" item and the "replacement voice sound quality" item in the main menu. The viewer can perform "main sound quality adjustment" and "sub sound quality adjustment" by operating the "cursor" key and the "decision" key of the remote controller. The display items, the hierarchical structure, and the like of the main menu may be different from those shown in the figure. In addition, display items of the "voice mode selection submenu" and the "replacement voice sound quality selection submenu" (that is, selectable background sound sound quality (voice mode, etc.) and dialog sound quality (voice mode, etc.)). May be the same or different.

The second example of the processing of "main sound quality adjustment" and "sub sound quality adjustment" in the broadcast receiving device 100 of this embodiment is a processing of selecting 1ch from a plurality of replacement sounds (dialogs) shown in FIG. 31C. Similarly, the "sound quality selection box" (however, illustrated) that displays the sound quality of the background sound (voice mode, etc.) and the sound quality of the dialog sound (voice mode, etc.) that can be selected by the broadcast receiving device 100 in association with the "color" key. Omitted) is used. By pressing the "color" key on the remote controller, the viewer can select the desired sound quality of the background sound (voice mode, etc.) and the sound quality of the dialog sound (voice mode, etc.). Whether the sound quality of the background sound (voice mode, etc.) or the sound quality of the dialog sound (voice mode, etc.) can be selected by using the "sound quality selection box" is determined by, for example, the "information" key of the remote controller. It may be switched each time you press.

The third example of the processing of "main sound quality adjustment" and "sub sound quality adjustment" in the broadcast receiving device 100 of this embodiment is a processing of selecting 1ch from a plurality of replacement audio (dialogs) shown in FIG. 31E. Similarly, it is possible to select the desired sound quality (voice mode, etc.) of the dialog voice according to the number of times the "dialog selection" key of the remote controller is pressed. Further, in this case, the sound quality of the background sound (voice mode, etc.) may be selected from the main menu as in the first example.

FIG. 33B shows a fourth example of the processing of "main sound quality adjustment" and "sub sound quality adjustment" in the broadcast receiving device 100 of this embodiment. In the fourth example, the "sound quality adjustment box" displayed by pressing the "equalizer" key of the remote controller capable of operating the broadcast receiving device 100 is used. The "sound quality adjustment box" is an application display that enables independent level adjustment of each band of the audible range divided into a plurality of bands. The viewer can operate the "cursor (left / right)" key of the remote controller to select the frequency band to be adjusted, and operate the "cursor (up / down) key" to adjust the level of the frequency band. .. That is, it is possible to adjust the sound quality of the background sound and the dialog sound.

When the first to fourth "main sound quality adjustment" and "sub sound quality adjustment" processes described above are performed in the broadcast receiving device C of FIG. 30A, the broadcast receiving device C uses the dialog control information to 22. It is determined that there is no main dialog in 2ch, all 22.2ch are determined to be "background sounds", and these audio data are determined as "main sound quality adjustment" target audio data. In addition, using the dialog control information, it is determined that there are four additional dialog voice data, one of the four is selected by the user, and the selected voice data is used as the target voice data for "sub sound quality adjustment". I have decided. That is, in the broadcast receiving device C, the determination of the audio data to be the target of the "main sound quality adjustment" or the "sub sound quality adjustment" is performed by using the information stored in the dialog control information.

Further, when the first to fourth "main sound quality adjustment" and "sub sound quality adjustment" processing described above are performed in the broadcast receiving device F of FIG. 30B, the broadcast receiving device F uses the dialog control information to 22 . It is determined that there is 2ch of main dialog sound data in 2ch, 20.2ch of sound data other than the main dialog in 22.2ch is specified, and these sound data are judged as "background sound", and "main". "Sound quality adjustment" is determined as the target audio data. Further, the 2ch main dialog voice data specified by using the dialog control information is determined as the target voice data of the "sub sound quality adjustment". That is, in the broadcast receiving device F, the determination of the audio data to be the target of the "main sound quality adjustment" or the "sub sound quality adjustment" is performed by using the information stored in the dialog control information.

The above-mentioned "replacement audio sound quality selection submenu", "sound quality selection box", "sound quality adjustment box", etc. are used when the currently displayed broadcast program has replacement audio (additional dialog) data. It is desirable to display only. Specifically, the parameter indicating the number of additional dialogs described in the dialog control information of the DSE (for example, "num_additional_lang_chans" or the like) is referred to, and the parameter indicating the number of additional dialogs is described. The display of the "replacement voice sound quality selection submenu", "sound quality selection box", "sound quality adjustment box", etc. may be controlled. The control may be performed with reference to a parameter indicating that another additional dialog exists. When the parameter referred to above indicates that the additional dialog does not exist, the processing such as invalidating (graying out, etc.) the menu item and displaying the message is described in the above-mentioned <Dialog voice selection processing>. You can do the same.

<Dialog audio replacement / mix processing>
Next, the operation of the dialog sound replacement process and the mix process in the broadcast receiving device 100 of this embodiment will be described.

In the case of the example shown in FIG. 30A, the 1ch replacement audio (additional dialog) selected from the plurality of replacement audios (addition dialog) is replaced with the predetermined channel of the background sound of 22.2ch. Alternatively, a mix process may be possible. The predetermined channel is designated by a parameter (for example, "dialogue_src_index [i]") indicating the index of the dialog-dedicated channel described in the dialog control information of the DSE as described with reference to FIG. 30B. It may be a channel for transmitting the dialog sound, or it may be another channel, for example, a channel arbitrarily selected by the viewer. In any case, the channel corresponding to the speaker (FC, BC, TpFC, TpC, TpBC, BtFC) arranged on the median surface may be selected independently, except for the low frequency effect channel speaker (LFE1, LFE2). Other channels shall be selected in left and right pairs.

The replacement process is a process of outputting the audio data of the selected 1ch replacement audio (additional dialog) in place of the audio data of the predetermined channel. On the other hand, the mix process is a process of synthesizing and outputting the audio data of the selected 1ch replacement audio (additional dialog) with the audio data of the predetermined channel. In the broadcast receiving device 100 of this embodiment, which of the replacement process and the mix process is performed may be predetermined by the function setting of the broadcast receiving device 100 and the like.

For example, when the predetermined predetermined channel is an FC and BtFC channel (that is, the channel can be selected independently), the replacement process causes the speaker 933 (FC) to display the FC channel. The voice data of the replacement voice (additional dialog) is output instead of the voice data. Further, the speaker 963 (BtFC) outputs the audio data of the replacement audio (additional dialog) in place of the audio data of the BtFC channel. Further, when performing the mix processing, the speaker 933 (FC) outputs the addition result of the audio data of the FC channel and the audio data of the replacement audio (additional dialog). Further, the speaker 963 (BtFC) outputs the addition result of the voice data of the BtFC channel and the voice data of the replacement voice (additional dialog). In these cases, the audio data of the replacement audio (additional dialog) output from the speaker 933 (FC) and the audio data of the replacement audio (additional dialog) output from the speaker 963 (BtFC) are independent of each other. The level may be adjusted.

Further, for example, when the predetermined predetermined channel is an FL and FR channel (that is, a channel to be selected in a pair), the FL from the speaker 931 (FL) is subjected to the replacement process. The audio data of the replacement audio (additional dialog) is output in place of the audio data of the channel. Further, the speaker 935 (FR) outputs the voice data of the replacement voice (additional dialog) in place of the voice data of the channel of the FR. Further, when performing the mix processing, the speaker 931 (FL) outputs the addition result of the audio data of the FL channel and the audio data of the replacement audio (additional dialog). Further, the speaker 935 (FR) outputs the addition result of the audio data of the channel of the FR and the audio data of the replacement audio (additional dialog). In these cases, the audio data of the replacement audio (additional dialog) output from the speaker 931 (FL) and the audio data of the replacement audio (additional dialog) output from the speaker 935 (FR) are level-adjusted or the like. When is performed, it shall be linked. The interlocking may be the same processing such as level adjustment.

<Other dialog voice control processing>
A. Background sound volume adjustment processing according to the presence or absence of dialog sound FIG. 34 shows an outline of the background sound level adjustment processing according to the presence or absence of dialogue sound in the broadcast receiving device 100 of this embodiment. In the broadcast receiving device 100 of the present embodiment, the volume (level) of the background sound is automatically set when there is a dialog sound (when there is no silence) according to the presence or absence of the dialog sound, regardless of the viewer's operation. In addition, it shall have a function to perform a process of reducing.

For example, in the case of the broadcast receiving device A shown in FIG. 30A, first, a broadcast wave including the LATM / LOAS stream format is received, and a process of selecting 1ch from the replacement audio (additional dialog) of the 4ch is performed. Next, it is confirmed whether or not the selected 1ch replacement voice (additional dialog) is silent. Further, when the selected 1ch replacement voice (additional dialog) is not silent, the volume (level) of the 22.2ch voice (background sound) corresponding to the non-silent period is reduced by a predetermined amount. Take control. In the example shown in FIG. 34, the period from t1 to t2 of the selected 1ch replacement voice (additional dialog) is a non-silent period, and therefore, a predetermined period including at least the period from t1 to t2, 22. . Control is performed to reduce the volume (level) of the 2ch sound (background sound) by 3 dB.

Further, for example, in the case of the broadcast receiving device F shown in FIG. 30B, first, a process of receiving a broadcast wave including the LATM / LOAS stream format and extracting the dialog sound for the 2 channels is performed. Next, it is confirmed whether or not the extracted dialog voice for 2 channels is silent. Further, when any channel of the extracted 2ch dialog sound is not silent, the volume (level) of the 20.2ch background sound corresponding to the non-silent period is controlled to be reduced by a predetermined amount. I do. In the example shown in FIG. 34, any of the extracted 2ch dialog voices is not silent in the period from t1 to t2, and therefore, for a predetermined period including at least the period from t1 to t2, for the 20.2ch. Control is performed to reduce the volume (level) of the background sound by 3 dB.

After the processing, the volume adjustment processing of the dialog sound and the background sound according to the operation of the viewer may be performed as described in the above-mentioned <dialog sound / background sound volume adjustment processing>.

By performing the above processing, in the broadcast receiving device 100 of the present embodiment, it is possible to prevent the dialog from becoming difficult to hear due to the background sound. It is desirable to be able to select whether or not to execute the background sound level adjustment process according to the presence or absence of the dialog sound described above by the viewer's operation. For example, although not shown, the main menu may be configured so as to enable the selection from the main menu displayed by pressing the "menu" key of the remote controller capable of operating the broadcast receiving device 100. ..

B. Dialog voice reproduction time extension processing FIG. 35 shows an outline of the dialog voice reproduction time extension processing in the broadcast receiving device 100 of this embodiment. It is assumed that the broadcast receiving device 100 of the present embodiment has a function of extending the reproduction speed of the dialog sound (that is, slowing down the reproduction speed) by utilizing the silent period of the dialog sound.

For example, as shown in FIG. 35, the dialog voice has a voice in the first period from t3 to t5 and is silent in the second period from t5 to t7 following the first period. And. On the other hand, it is assumed that the background sound has sound in the third period from t4 to t6 and is silent in the fourth period from t6 to t7 following the third period. When a broadcast wave including a LATM / LOAS stream format having audio data as described above is received, the broadcast receiving device 100 of the present embodiment expands the reproduction speed of the extracted dialog audio (or replacement audio). On the other hand, the above processing is not performed on the background sound. Specifically, for the dialog voice, the period having the voice is extended from the first period (the period from t3 to t5) to the fifth period from t3 to t8, and the period having the voice is also extended. Data processing by digital signal processing is performed so as to compress the silent period following from the second period (the period from t5 to t7) to the sixth period from t8 to t7. As for the data processing by the digital signal processing that performs the decompression processing, a known technique may be used, and detailed description thereof will be omitted.

After the above processing, if necessary, the volume adjustment processing of the dialog sound and the background sound according to the operation of the viewer is performed as described in the above-mentioned <dialog sound / background sound volume adjustment processing>. Is also good.

By performing the above processing, the broadcast receiving device 100 of the present embodiment can slowly reproduce the dialog sound, and prevents a situation where the narration or the like is difficult to hear quickly when the viewer is an elderly person or the like. It becomes possible. On the other hand, since the BGM or the like is reproduced in the original state, the atmosphere of the program (content) is not impaired. It is desirable to be able to select whether or not to execute the above-mentioned dialog sound reproduction time extension processing by the operation of the viewer. For example, although not shown, the main menu may be configured so as to enable the selection from the main menu displayed by pressing the "menu" key of the remote controller capable of operating the broadcast receiving device 100. ..

As described above, according to the broadcast receiving device 100 of the present embodiment, the broadcast wave of the broadcasting system that transmits the audio data of the MPEG-4 AAC or the MPEG-4 ALS system in the LATM / LOAS stream format is received and included in the broadcast wave. It is possible to individually control the dialog voice. That is, it becomes possible to provide a broadcast receiving device capable of executing a function having higher added value.

Although examples of the embodiment of the present invention have been described above with reference to Examples 1 to 3, the configuration for realizing the technique of the present invention is not limited to the above-described embodiment, and various modifications can be considered. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these belong to the category of the present invention. Further, the numerical values and messages appearing in the text and figures are merely examples, and even if different ones are used, the effect of the present invention is not impaired.

The above-mentioned functions and the like of the present invention may be realized by hardware, for example, by designing a part or all of them by an integrated circuit. Further, it may be realized by software by interpreting and executing an operation program in which a microprocessor unit or the like realizes each function or the like. Hardware and software may be used together.

The software for controlling the broadcast receiving device 100 may be stored in the ROM 103 and / or the storage (storage) unit 110 of the broadcast receiving device 100 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121. Further, the software stored in the memory card, the optical disk, or the like may be acquired via the extended interface unit 124 or the like.

In addition, the control lines and information lines shown in the figure show what is considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In practice, it can be considered that almost all configurations are interconnected.

100,800 ... Broadcast receiver, 100a ... Antenna, 101,801 ... Main control unit, 102,802 ... System bus, 103,803 ... ROM, 104,804 ... RAM, 110,810 ... Storage unit, 121,821 ... LAN communication unit, 124,824 ... expansion interface unit, 125,825 ... digital interface unit, 131,831,832 ... tuner / demodulation unit, 132 ... separation unit, 141 ... video decoder, 142 ... video color range conversion unit, 143 ... Voice decoder, 144 ... Character super decoder, 145 ... Subtitle decoder, 146 ... Subtitle synthesis unit, 147 ... Subtitle color range conversion unit, 151 ... Data decoder, 152 ... Cache unit, 153 ... Application control unit, 154 ... Browser unit, 155 ... Application color range conversion unit, 156 ... Sound source unit, 161,861 ... Video synthesis unit, 162,862 ... Monitor unit, 163,863 ... Video output unit, 164,864 ... Audio synthesis unit, 165,865 ... Speaker unit , 166, 866 ... Audio output unit, 170, 870 ... Operation input unit, 841 ... MMT decoding processing unit, 842 ... MPEG2-TS decoding processing unit, 200 ... Internet, 200r ... Router device, 200a ... Access point, 300t ... Radio Tower, 300s ... Broadcast satellite (or communication satellite), 300 ... Broadcast station server, 400 ... Service provider server, 500 ... Other application server, 600 ... Mobile telephone communication server, 600b ... Base station, 700 ... Mobile information terminal ..

Claims (1)

A broadcast receiving device capable of receiving digital content including a plurality of audio data transmitted as audio channels having a predetermined number of different channels and having dialog audio data in at least one of the plurality of audio data, and dialog control information. And a system including a remote controller that controls the broadcast receiving device.
The broadcast receiving device is
A receiver that receives the digital content and the dialog control information,
An operation input unit that can input instructions from the remote controller,
A speaker that can output audio based on the received audio data,
A control unit capable of controlling audio output via the speaker based on an instruction input to the operation input unit, and a control unit.
Equipped with
The remote controller includes a volume operation input unit which is a key or a button capable of inputting an instruction for output volume adjustment processing for audio data received by the broadcast receiving device.
The control unit has two types of output voice adjustment processing, that is, a first output voice adjustment process and a second output voice adjustment process, based on an instruction input via the key or the button of the volume control input unit. Volume control can be executed, and information on the number of channels for transmitting dialog audio data, which is a number of the predetermined number of channels, and the dialog audio data shown in the dialog control information received by the receiving unit. From the plurality of audio data received by the receiver based on the information for identifying the channel for transmission, the audio data to be controlled by the volume adjustment of the first output audio adjustment process and the second audio data. The control is performed to change the combination of the voice data to be controlled by the volume control of the output voice adjustment process, and the output volume of the voice data to be controlled by the volume control of the second output voice control process is the output volume. Output volume according to whether the audio data targeted for volume control control of the first output audio adjustment process is a silent period or a non-silent period without inputting an instruction via the key or the button of the volume operation input unit. The voice data to be adjusted and to be the target of the volume control of the first output voice adjustment process during the period when the voice data to be controlled by the volume control of the first output voice control process is not silent. Is a system in which the output volume adjustment process is performed so that the output volume of the audio data subject to the volume control control of the second output audio adjustment process is smaller than that of the silent period .

Images