JP2021106395A - Broadcast receiver and display method - Google Patents

Abstract

To provide a digital broadcast receiver and a display method, capable of executing a function of higher added value.SOLUTION: A broadcast receiver controls a display unit to execute any one of a display of a program list generated by a program list generation unit, a display of a broadcast program video decoded by a decoding unit, or a simultaneous display of two videos, which are one video obtained through a network and the other video of the broadcast program decoded by the decoding unit, by an application executed by an application execution unit, with regard to a broadcast program which is selected of broadcast programs displayed in the program list, to display a program attribute including a program name of the broadcast program and the presence or absence of an application cooperated with the broadcast program. In addition, the application execution unit determines whether the application can be executed by referring to an application profile included in application-related information, and launches the application if it can be executed.SELECTED DRAWING: Figure 2A

Description

The present invention relates to a broadcast receiving device and a display method.

One of the extended functions of the digital broadcasting service is data broadcasting, which transmits digital data by broadcasting waves and displays various information such as weather forecasts, news, and recommended programs. Many television receivers capable of receiving data broadcasting are already on the market, and many technologies related to data broadcasting reception have been published including the following Patent Document 1.

JP 2001-186486

One of the features of data broadcasting is that a television receiver that supports digital broadcasting services can receive data broadcasting by itself and can acquire / display various information. On the other hand, in data broadcasting, the amount of data that can be transmitted is limited due to the limitation of the radio wave band, so it is difficult to obtain high-definition screen display and high-performance effects. There was a problem that it was difficult to execute with a broadcast receiver.

An object of the present invention is to provide a digital broadcast receiver and a display method capable of performing higher value-added functions.

As a means for solving the above-mentioned problems, the technique described in the claims is used.

To give an example, the technique according to claims 1 and 2 is used.

By using the technique of the present invention, it is possible to provide a digital broadcast receiver and a display method capable of performing higher value-added functions.

It is a system block diagram of the communication system which concerns on embodiment. It is a block diagram of the broadcast receiving apparatus which concerns on embodiment. It is a software block diagram of the broadcast receiving apparatus which concerns on embodiment. It is a block diagram of the information display device which concerns on embodiment. It is a figure which shows the example of the viewer instruction input part of the information display device which concerns on embodiment. It is a block diagram of the broadcasting station server which concerns on embodiment. It is a block diagram of the service provider server which concerns on Example. It is a block diagram of the mobile information terminal which concerns on embodiment. It is a software block diagram of the mobile information terminal which concerns on embodiment. It is a data block diagram of application control information which concerns on Example. It is operation sequence diagram at the time of application activation of the broadcast receiving apparatus which concerns on embodiment. It is operation sequence diagram at the time of application activation of the broadcast receiving apparatus which concerns on embodiment. It is operation sequence diagram at the time of application activation of the broadcast receiving apparatus which concerns on embodiment. It is operation sequence diagram at the time of cooperation of the mobile information terminal which concerns on embodiment. It is operation sequence diagram at the time of cooperation of the mobile information terminal which concerns on embodiment. It is operation sequence diagram at the time of cooperation of the mobile information terminal which concerns on embodiment. It is operation sequence diagram at the time of application activation of a broadcast receiving device and a mobile information terminal which concerns on embodiment. It is a screen display figure of the basic screen of the cooperation control application of the mobile information terminal which concerns on embodiment. It is a screen display figure of the basic screen of the cooperation control application of the mobile information terminal which concerns on embodiment. It is a screen display figure of the data broadcasting screen of the broadcasting receiving apparatus which concerns on embodiment. It is a screen display figure of the notification screen of the broadcast receiving apparatus which concerns on embodiment. It is a screen display figure of the broadcast cooperation application launcher of the broadcast receiver device which concerns on embodiment. It is a screen display figure of the broadcasting cooperation application execution screen of the broadcasting receiving apparatus which concerns on embodiment. It is a screen display figure of the broadcasting cooperation application execution screen of the broadcasting receiving apparatus which concerns on embodiment. It is a screen display figure of the broadcasting cooperation application execution screen of the broadcasting receiving apparatus which concerns on embodiment. It is a screen display figure of the broadcasting cooperation application execution screen of the broadcasting receiving apparatus which concerns on embodiment. It is a screen display figure of the error display screen of the broadcast receiving apparatus which concerns on embodiment. It is a screen display figure of the broadcasting cooperation application execution screen of the mobile information terminal which concerns on Example. It is a screen display figure of the EPG display screen of the broadcast receiving apparatus which concerns on embodiment. It is a figure of the detailed information of the EPG display screen of the broadcast receiving apparatus which concerns on embodiment. It is operation sequence diagram at the time of acquisition of the broadcast cooperation application of the broadcast receiver device which concerns on embodiment. It is operation sequence diagram at the time of terminal cooperation which concerns on embodiment. It is operation sequence diagram at the time of terminal cooperation which concerns on embodiment. It is operation sequence diagram at the time of terminal cooperation which concerns on embodiment. It is operation sequence diagram at the time of terminal cooperation which concerns on embodiment. It is a screen display figure of the broadcast cooperation application launcher of the broadcast receiver device which concerns on embodiment. It is a screen display figure of the broadcast cooperation application launcher of the broadcast receiver device which concerns on embodiment. It is a screen display figure of the broadcast cooperation application launcher of the broadcast receiver device which concerns on embodiment. It is a screen display figure of the broadcast cooperation application launcher of the broadcast receiver device which concerns on embodiment. It is a screen display figure of the broadcast receiving apparatus which concerns on embodiment. It is a screen display figure of the broadcasting cooperation application launcher of the mobile information terminal which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is operation sequence diagram of the information display device which concerns on Example. It is operation sequence diagram of the information display device which concerns on Example. It is operation sequence diagram of the information display device which concerns on Example. It is operation sequence diagram of the information display device which concerns on Example. It is a button arrangement figure of the remote control which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the mobile information terminal which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is a figure of the window frame of the information display device which concerns on embodiment. It is a screen display figure of the information display device which concerns on embodiment. It is operation sequence diagram of the information display device which concerns on Example.

Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings.

First, an example of a digital broadcasting service that can be received by the broadcasting receiving device of this embodiment will be described.

For example, in an example of BS / terrestrial digital broadcasting that can be received by the broadcast receiving device of this embodiment, a plurality of transport streams (Transport Stream: TS) can be multiplexed and transmitted to one transponder (frequency channel). The TS has a predetermined length obtained by dividing a data string such as a video / audio elementary stream (ES) and program specific information (PSI) / service information (SI) and adding a TS header. Is a series of TS packets.

PSI is a unique information table for identifying which program each ES included in TS belongs to, which is defined by the standard of MPEG (Moving Picture Experts Group) -2 system. PSI is composed of PAT (Program Association Table), PMT (Program Map Table), CAT (Conditional Access Table), and the like. The PAT defines a list of programs included in the TS by the PID (Packet Identity) of the PMT. The PMT defines the PIDs of the components of each program. The CAT contains information about conditional access.

In addition, SI is an extension of PSI to include program information, etc., and is an electronic program guide (Electronic Program Guide) specified by the Association of Radio Industries and Businesses (ARIB) in ARIB STD-B10. EPG) information is provided. SI is composed of BIT (Broadcaster Information Table), SDT (Service Description Table), EIT (Even Information Table), TOT (Time Office Table), and the like. The BIT includes broadcasting station identification information, affiliated information, broadcasting station SI transmission information, and the like. The SDT includes information such as a network ID for identifying a network, a TS ID for identifying a TS, and a service ID (so-called channel number) for identifying an individual service (so-called channel) in the network. The EIT includes a service ID for identifying each service in the network, and information about the event such as the name of each event (so-called program), the broadcast date and time, and the broadcast content. The TOT contains information about the current date and time.

In addition, the TS includes PCR (Program Lock Reference) information as a reference for reproduction timing in the decoder, BML documents subsetted based on the BML (Broadcast Markup Language) specifications defined by ARIB STD-B24, and the like. ..

In the broadcast receiving device of this embodiment, a user can use a broadcast program, an EPG, a data broadcasting screen produced by using BML, or the like by receiving and decoding a TS composed of the video / audio ES and various information. It is possible to provide to.

In addition, the broadcast receiving device of this embodiment links a function using a broadband network to a digital broadcasting service, acquires additional contents via the broadband network, performs arithmetic processing on a server device, and presents processing by linking with a mobile terminal device. It is possible to support a broadcasting communication cooperation system that combines such as with a digital broadcasting service. In order to realize the broadcast communication cooperation system, the broadcast receiving device of this embodiment can execute an application described in HTML (HyperText Markup Language) or the like. In addition, in the broadcast communication cooperation system supported by this broadcast receiver, the extended PSI / required when transmitting application control information (Application Information Table: AIT) and applications in the extended BML specifications and broadcast communication cooperation system by broadcast waves Use SI information. The AIT is information for providing or disseminating various information necessary for starting an application such as an application acquisition destination and control information for controlling the start / end of the application.

The above description is based on the digital broadcasting service of Japan, but is not limited to the application only in Japan, including the broadcasting communication cooperation system supported by the broadcasting receiving device of this embodiment.

Next, a specific configuration example of the embodiment in this embodiment will be described.

[System configuration]
FIG. 1 is a system configuration diagram showing an example of the communication system of the present embodiment that realizes a broadcast communication cooperation system. The communication system of this embodiment includes a broadcast receiving device 100 and an antenna 100a, a broadband network 200 such as the Internet and a router device 210, a broadcasting station radio tower 300t, a broadcasting station server 300, a service provider server 400, and other application servers 500. It is composed of a mobile telephone communication server 600, a base station 600b of a mobile telephone communication network, and a mobile information terminal 700.

The broadcast receiving device 100 is a television receiver having a function corresponding to the broadcast communication cooperation system in addition to the existing digital broadcast receiving function. The broadcast receiving device 100 receives the broadcast wave transmitted from the radio tower 300t via the antenna 100a. Further, the broadcast receiving device 100 can be connected to the Internet 200 via the router device 210, and can transmit and receive data by communicating with each server device on the Internet 200.

The router device 210 is connected to the Internet 200 by wireless communication or wired communication, is connected to the broadcast receiving device 100 by wireless communication or wired communication, and is connected to the mobile information terminal 700 by wireless communication. As a result, each server device on the Internet 200, the broadcast receiving device 100, and the portable information terminal 700 can mutually perform data transmission / reception via the router device 210. The communication between the broadcast receiving device 100 and the mobile information terminal 700 may be performed directly by a method such as Bluetooth (registered trademark) or NFC (Near Field Communication) without going through the router device 210.

The radio tower 300t transmits a broadcast wave including a digital broadcast signal, AIT, control information related to application presentation, and the like from the broadcasting equipment of the broadcasting station. The control information related to the application presentation is control information related to superimposition of the broadcast program and the application on the television receiver and whether or not the application can be presented. Further, the broadcasting station shall include a broadcasting station server 300. The broadcasting station server 300 stores metadata such as broadcast programs (video contents, etc.), program titles, program IDs, program outlines, performers, broadcast dates, etc. of each broadcast program, and stores the video contents and each metadata. Based on the contract, it shall be possible to provide to the service provider. The moving image content and each metadata may be provided to the service provider through an API (Application Programming Interface) provided in the broadcasting station server 300.

The service provider server 400 is a server device prepared by the service provider to provide a service by the broadcast communication cooperation system. The service provider server 400 stores, manages, and distributes the video content and metadata provided by the broadcasting station server 300, and the content and application created for the broadcasting communication cooperation system. It also has a function to search for available applications and provide a list in response to inquiries from TV receivers. The storage, management and distribution of the content and metadata and the storage, management and distribution of the application may be performed by different server devices. The broadcasting station and the service provider may be the same or different operators. A plurality of service provider servers 400 may be prepared for each different service. Further, the function of the service provider server 400 may be provided by the broadcasting station server 300.

The other application server 500 is a known server device that stores, manages, and distributes general applications, operation programs, contents, and data other than those related to the broadcast communication cooperation system.

The mobile telephone communication server 600 is connected to the Internet 200, while it is connected to the mobile information terminal 700 via the base station 600b. The mobile telephone communication server 600 manages telephone communication (call) and data transmission / reception via the mobile telephone communication network of the mobile information terminal 700, and collects data by communication between the mobile information terminal 700 and each server device on the Internet 200. Enables transmission and reception. The communication between the personal digital assistant 700 and the broadcast receiving device 100 may be performed via the base station 600b, the mobile telephone communication server 600, the Internet 200, and the router device 210.

[Hardware configuration of broadcast receiver]
FIG. 2A is a block diagram showing an example of the internal configuration of the broadcast receiving device 100. The broadcast receiving device 100 includes a main control unit 101, a system bus 102, a ROM 103, a RAM 104, a storage unit 110, a LAN communication unit 121, an expansion interface unit 124, a digital interface unit 125, a tuner / demodulation unit 131, and a first separation unit 132. First video decoding unit 133, first audio decoding unit 134, first subtitle decoding unit 135, data broadcast reception processing unit 141, data broadcasting engine 142, streaming reception processing unit 151, second separation unit 152, second video decoding unit 153, 2nd audio decoding unit 154, 2nd subtitle decoding unit 155, application control unit 161, application engine 162, video superimposition unit 171, audio selection unit 172, video display unit 173, speaker 174, video output unit 175, audio output It is composed of a unit 176, a presentation synchronization control unit 181 and a terminal cooperation control unit 191.

The main control unit 101 is a microprocessor unit that controls the entire broadcast receiving device 100 according to a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operation block in the broadcast receiving device 100.

The ROM (Read Only Memory) 103 is a memory in which a basic operation program such as an operating system and other operation programs are stored. For example, a rewritable ROM such as an EEPROM (Electrically Erasable Program ROM) or a flash ROM is used. .. The RAM (Random Access Memory) 104 serves as a work area for executing a basic operation program and other operation programs. The ROM 103 and the RAM 104 may be integrated with the main control unit 101. Further, the ROM 103 may not have an independent configuration as shown in FIG. 2A, but may use a partial storage area in the storage unit 110.

The storage unit 110 stores an operation program of the broadcast receiving device 100, an operation setting value, personal information of a user of the broadcast receiving device 100, and the like. In addition, it is possible to store an operation program downloaded from the network and various data created by the operation program. In addition, contents such as moving images, still images, and sounds acquired from broadcast waves or downloaded from the network can also be stored. A part of the area of the storage unit 110 may be used to replace all or part of the functions of the ROM 103. Further, the storage unit 110 needs to hold the stored information even when the broadcast receiving device 100 is not supplied with power from the outside. Therefore, for example, a device such as a semiconductor element memory such as a flash ROM or SSD (Solid State Drive), a magnetic disk drive such as an HDD (Hard Disk Drive), or the like is used.

It is assumed that each of the operation programs stored in the ROM 103 and the storage unit 110 can be updated and expanded in function by a download process from each server device on the Internet 200.

The LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via the router device 210, and transmits / receives data to / from each server device on the Internet 200. The connection with the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). The LAN communication unit 121 is provided with a code circuit, a decoding circuit, and the like. Further, the broadcast receiving device 100 may further include other communication units such as a Bluetooth (registered trademark) communication unit, an NFC communication unit, and an infrared communication unit.

The tuner / demodulation unit 131 receives the broadcast wave from the radio tower 300t via the antenna 100a, and tunes (selects) the channel of the service desired by the user based on the control of the main control unit 101. Further, the tuner / demodulation unit 131 demodulates the received broadcast signal to acquire the TS. In the example shown in FIG. 2A, a configuration in which one tuner / demodulation unit is used is illustrated, but the broadcast receiving device 100 uses the tuner / demodulation unit for the purpose of simultaneous display of a plurality of screens, counterprogram recording, or the like. It may be configured to mount multiple devices. Further, the access restriction for the demodulated TS may be controlled based on the control of the main control unit 101.

The first separation unit 132 inputs the TS output from the tuner / demodulation unit 131, and each data such as a video data string, an audio data string, a subtitle data string, a program information data string, an AIT data string, and a BML data string. Output separately in columns. These data strings may be in ES format, for example. The first video decoding unit 133 decodes the video data string input from the first separation unit 132 and outputs the video information. The first voice decoding unit 134 decodes the voice data string input from the first separation unit 132 and outputs the voice information. The first subtitle decoding unit 135 decodes the subtitle data string input from the first separation unit 132 and outputs the subtitle information.

The data broadcasting reception processing unit 141 decodes the BML data string input from the first separation unit 132 and reproduces the BML document. The data broadcasting engine 142 is a BML browser that executes a BML document, executes a BML document reproduced by the data broadcasting reception processing unit 141, and outputs data broadcasting screen information.

Based on the control of the main control unit 101, the streaming reception processing unit 151 accesses the video content or the like placed on each server device on the Internet 200 via the LAN communication unit 121, and the program stream of the video content or the like ( Program Stream (PS) is acquired. Further, based on the control of the main control unit 101, the DRM (Digital Rights Management) process for the acquired PS may be controlled.

The second separation unit 152 inputs the PS output from the streaming reception processing unit 151, and separates and outputs each data string such as a video data string, an audio data string, and a subtitle data string. These data strings may be in ES format, for example. The second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155 perform the same processing as the first video decoding unit 133, the first audio decoding unit 134, and the first subtitle decoding unit 135, respectively. Therefore, the description will be omitted.

The first separation unit 132 and the second separation unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, the first subtitle decoding unit 135 and the first The two subtitle decoding units 155 may be used in combination.

The application control unit 161 works on the application engine 162 with respect to the application created for the broadcast communication cooperation system based on the AIT data string input from the first separation unit or the AIT file acquired from each server device on the Internet 200. Controls and manages the life cycle and events of each application. In addition, the functional constraints of the application are appropriately controlled depending on the state of the application and the instruction of the AIT. The application engine 162 is an HTML browser that acquires and executes an application created for the broadcast communication cooperation system based on the control of the application control unit 161.

The video superimposing unit 171 includes video information output from the first video decoding unit 133, subtitle information output from the first subtitle decoding unit 135, data broadcasting screen information output from the data broadcasting engine 142, and a second video decoding unit. The video information output from 153, the subtitle information output from the second subtitle decoding unit 155, and the application execution screen information output from the application engine 162 are input to perform processing such as selection and / or superimposition. The video superimposing unit 171 includes a video RAM (not shown), and the video display unit 173 and the like are driven based on the video information input to the video RAM. Further, the video superimposition unit 171 superimposes the EPG screen information created based on the scaling process and the program information data string output from the first separation unit 132, if necessary, based on the control of the main control unit 101. Perform processing, etc.

The voice selection unit 172 inputs the voice information output from the first voice decoding unit 134, the voice information output from the second voice decoding unit 154, and the application execution voice information output from the application engine 162, and performs main control. The voice information is appropriately selected and output according to the control of unit 101.

The video display unit 173 is a display device such as a liquid crystal panel, and provides the user of the broadcast receiving device 100 with video information selected and / or superposed by the video superimposing unit 171. The speaker 174 provides the user of the broadcast receiving device 100 with the audio information output from the audio selection unit 172. The video output unit 175 is a video output interface that outputs video information selected and / or superposed by the video superimposing unit 171. The audio output unit 176 is an audio output interface that outputs audio information output from the audio selection unit 172. As described above, when the broadcast receiving device 100 is a television receiver or the like, the video output unit 175 and the audio output unit 176 are not essential configurations in the present invention.

The presentation synchronization control unit 181 decodes the video information, audio information, etc. obtained by decoding the TS acquired from the broadcast wave, and the video information obtained by decoding the PS acquired from each server device on the Internet 200. Control of presentation synchronization of application execution screen information and application execution audio information output from the application engine 162, audio information, etc., on the video display unit 173 and speaker 174, or on the video output unit 175 and audio output unit 176. For example, based on PCR information and the like.

When linking with an external mobile terminal device, the terminal link control unit 191 discovers and authenticates the linked device (mobile terminal device), connects the broadcast receiving device 100 to the linked device, links applications, and the like. Manage and control.

The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100, and in this embodiment, it is composed of an analog video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. do. The analog video / audio interface inputs analog video / audio signals from an external video / audio output device, outputs analog video / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to send and receive data. A HDD may be connected to record broadcast programs and contents. You may also connect a keyboard or other USB device. The memory interface connects a memory card or other memory medium to send and receive data.

The digital interface unit 125 is an interface for outputting or inputting encoded digital video data and / or digital audio data. It is assumed that the digital interface unit 125 can output the TS acquired by the tuner / demodulation unit 131 and the PS acquired by the streaming reception processing unit 151 as they are. Further, the TS or PS input from the digital interface unit 125 may be controlled to be input to the first separation unit 132 or the second separation unit 152. The output of the digital content stored in the storage unit 110 or the storage of the digital content in the storage unit 110 may be performed via the digital interface unit 125. The digital interface unit 125 may be a DVI terminal, an HDMI terminal, or the like, and may output or input data in a format conforming to the DVI specification, the HDMI specification, or the like. It may be output or input in the form of serial data conforming to the IEEE1394 specifications and the like.

The broadcast receiving device 100 may be an optical disk drive recorder such as a DVD (Digital Versaille Disc) recorder, a magnetic disk drive recorder such as an HDD recorder, an STB (Set Top Box), or the like, in addition to a television receiver. It may be a PC (Personal Computer), a tablet terminal, a game machine, or the like having a digital broadcast reception function and a broadcast communication cooperation function. When the broadcast receiving device 100 is a DVD recorder, an HDD recorder, an STB, or the like, the video display unit 173 and the speaker 174 may not be provided. By connecting an external monitor and an external speaker to the video output unit 175 and the audio output unit 176, the same operation as that of the broadcast receiving device 100 of this embodiment can be performed.

[Software configuration of broadcast receiver]
FIG. 2B is a software configuration diagram of the broadcast receiving device 100 of this embodiment, and shows the software configuration of the ROM 103, the RAM 104, and the storage unit 110. In this embodiment, the basic operation program 1001 and other operation programs are stored in the ROM 103, and the reception function program 1002, the BML browser program 1003, the HTML browser program 1004, and other operation programs are stored in the storage unit 110. There is. Further, the storage unit 110 includes a content storage area 1011 for storing contents such as moving images, still images, and sounds, and an authentication information storage area 1012 for storing authentication information and the like used when linking with an external mobile terminal device. It shall be provided with various information storage areas for storing various other information.

The basic operation program 1001 stored in the ROM 103 is expanded in the RAM 104, and the main control unit 101 further executes the expanded basic operation program to form the basic operation execution unit 1101. Further, the reception function program 1002, the BML browser program 1003, and the HTML browser program 1004 stored in the storage unit 110 are each expanded in the RAM 104, and the main control unit 101 further executes each of the expanded operation programs to receive the program. The function execution unit 1102, the BML browser engine 1103, and the HTML browser engine 1104 are configured. Further, the RAM 104 is provided with a temporary storage area for temporarily holding the data created at the time of executing each operation program as needed.

In the following, for the sake of simplicity, the main control unit 101 performs a process of controlling each operation block by expanding the basic operation program 1001 stored in the ROM 103 into the RAM 104 and executing the basic operation. It is described as assuming that the unit 1101 controls each operation block. The same description is made for other operation programs.

The reception function execution unit 1102 controls each operation block of the broadcast reception device 100 in order to realize the broadcast reception function and the broadcast communication cooperation function. In particular, the broadcast program reproduction unit 1102a includes a tuner / demodulation unit 131, a first separation unit 132, a first video decoding unit 133, a first audio decoding unit 134, a first subtitle decoding unit 135, a data broadcasting reception processing unit 141, and data. It mainly controls the broadcasting engine 142. The data broadcasting engine 142 may be replaced by the BML browser engine 1103 deployed on the RAM 104. Further, the communication content reproduction unit 1102b mainly controls the streaming reception processing unit 151, the second separation unit 152, the second video decoding unit 153, the second audio decoding unit 154, and the second subtitle decoding unit 155. The linked application control unit 1102c mainly controls the application control unit 161 and the application engine 162. The application engine 162 may be replaced by the HTML browser engine 1104 deployed on the RAM 104. The terminal cooperation management unit 1102d mainly controls the terminal cooperation control unit 191.

Each of the operation programs may be stored in the ROM 103 and / or the storage unit 110 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121. Further, each of the operation programs stored in a memory card, an optical disk, or the like may be acquired via the expansion interface unit 124 or the like.

[Broadcasting station server configuration]
FIG. 3 is a block diagram showing an example of the internal configuration of the broadcasting station server 300. The broadcasting station server 300 is composed of a main control unit 301, a system bus 302, a RAM 304, a storage unit 310, and a LAN communication unit 321.

The main control unit 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operation program. The system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operation block in the broadcasting station server 300. The RAM 304 serves as a work area when each operation program is executed.

The storage unit 310 stores the basic operation program 3001 and the content management / distribution program 3002, and further includes a moving image content storage area 3011 and a metadata storage area 3012. The video content storage area 3011 stores video content and the like of each broadcast program broadcast by the broadcasting station. The metadata storage area 3012 stores metadata such as the program title, program ID, program outline, performers, broadcast date and time of each broadcast program.

Further, the basic operation program 3001 and the content management / distribution program 3002 stored in the storage unit 310 are each expanded in the RAM 304, and the main control unit 301 further executes the expanded basic operation program and the content management / distribution program. As a result, the basic operation execution unit 3101 and the content management / distribution execution unit 3102 are configured.

In the following, in order to simplify the explanation, the main control unit 301 controls each operation block by expanding and executing the basic operation program 3001 stored in the storage unit 310 in the RAM 304. It is described as assuming that the operation execution unit 3101 controls each operation block. The same description is made for other operation programs.

The content management / distribution execution unit 3102 manages the video content and each metadata stored in the video content storage area 3011 and the metadata storage area 3012, and provides the video content and each metadata in a service business based on the contract. Control when providing to a person. Further, when the content management / distribution execution unit 3102 provides the video content or the like and each metadata to the service provider, the content management / distribution execution unit 3102 authenticates the service provider server 400 based on the contract, if necessary. It also processes.

The LAN communication unit 321 is connected to the Internet 200 and communicates with the service provider server 400 or the like on the Internet 200. The LAN communication unit 321 is provided with a code circuit, a decoding circuit, and the like.

[Service provider server configuration]
FIG. 4 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 is composed of a main control unit 401, a system bus 402, a RAM 404, a storage unit 410, and a LAN communication unit 421.

The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operation program. The system bus 402 is a data communication path for transmitting and receiving data between the main control unit 401 and each operation block in the service provider server 400. The RAM 404 serves as a work area when each operation program is executed.

The storage unit 410 stores the basic operation program 4001, the content management / distribution program 4002, and the application management / distribution program 4003, and further includes a moving image content storage area 4011, a metadata storage area 4012, and an application storage area 4013. The video content storage area 4011 and the metadata storage area 4012 store the video content and the like provided by the broadcasting station server 300 and each metadata, the content produced by the service provider, and the metadata related to the content. The application storage area 4013 stores applications required for realizing each service of the broadcast communication cooperation system for distribution in response to a request from each television receiver.

Further, the basic operation program 4001, the content management / distribution program 4002, and the application management / distribution program 4003 stored in the storage unit 410 are each expanded in the RAM 404, and the main control unit 401 further expands the expanded basic operation program and the content management. By executing the / distribution program and the application management / distribution program, the basic operation execution unit 4101, the content management / distribution execution unit 4102, and the application management / distribution execution unit 4103 are configured.

In the following, in order to simplify the explanation, the main control unit 401 controls each operation block by expanding and executing the basic operation program 4001 stored in the storage unit 410 in the RAM 404. It is described as assuming that the operation execution unit 4101 controls each operation block. The same description is made for other operation programs.

The content management / distribution execution unit 4102 acquires video contents and each metadata from the broadcasting station server 300, manages the video contents and the like and each metadata stored in the video content storage area 4011 and the metadata storage area 4012. And controls the distribution of the moving image contents and each metadata to each TV receiver. Further, the application management / distribution execution unit 4103 manages each application stored in the application storage area 4013 and controls when the application is distributed in response to a request from each television receiver. Further, the application management / distribution execution unit 4103 also performs authentication processing of each television receiver, etc., if necessary, when distributing the application to each television receiver.

The LAN communication unit 421 is connected to the Internet 200 and communicates with the broadcast receiving device 100 and the personal digital assistant 700 via the broadcasting station server 300 on the Internet 200 and the router device 210. The LAN communication unit 421 is provided with a code circuit, a decoding circuit, and the like.

[Hardware configuration of mobile information terminal]
FIG. 5A is a block diagram showing an example of the internal configuration of the mobile information terminal 700. The mobile information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an expansion interface unit 724, an operation unit 730, an image processing unit 740, a voice processing unit 750, and a sensor unit 760. Consists of ,.

The main control unit 701 is a microprocessor unit that controls the entire mobile information terminal 700. The system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operation block in the personal digital assistant 700.

The ROM 703 is a memory in which a basic operation program such as an operating system and other operation programs are stored, and a rewritable ROM such as an EEPROM or a flash ROM is used. The RAM 704 serves as a work area when executing a basic operation program and other operation programs. The ROM 703 and the RAM 704 may be integrated with the main control unit 701. Further, the ROM 703 does not have an independent configuration as shown in FIG. 5A, and a partial storage area in the storage unit 710 may be used.

The storage unit 710 stores the operation program and operation setting value of the mobile information terminal 700, the personal information of the user of the mobile information terminal 700, and the like. In addition, it is possible to store an operation program downloaded from the network and various data created by the operation program. In addition, contents such as moving images, still images, and sounds downloaded from the network can be stored. A part of the function of the ROM 703 may be replaced by a part of the storage unit 710. Further, the storage unit 710 needs to hold the stored information even when the mobile information terminal 700 is not supplied with power from the outside. Therefore, for example, devices such as flash ROMs, SSDs, and HDDs are used.

It is assumed that each of the operation programs stored in the ROM 703 and the storage unit 710 can be updated and expanded in function by a download process from each server device on the Internet 200.

The communication processing unit 720 is composed of a LAN communication unit 721, a mobile telephone network communication unit 722, and an NFC communication unit 723. The LAN communication unit 721 is connected to the Internet 200 via the router device 210, and transmits / receives data to / from each server device on the Internet 200. The connection with the router device 210 shall be made by a wireless connection such as Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (call) and data transmission / reception by wireless communication with the base station 600b of the mobile telephone network. The NFC communication unit 723 performs wireless communication when it is in close proximity to the corresponding reader / writer. The LAN communication unit 721, the mobile telephone network communication unit 722, and the NFC communication unit 723 shall each include a code circuit, a decoding circuit, an antenna, and the like. Further, the communication processing unit 720 may further include other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.

The expansion interface unit 724 is a group of interfaces for expanding the functions of the personal digital assistant 700, and in this embodiment, it is composed of a video / audio interface, a USB interface, a memory interface, and the like. The video / audio interface inputs video / audio signals from an external video / audio output device, outputs video / audio signals to an external video / audio input device, and the like. The USB interface connects to a PC or the like to send and receive data. You may also connect a keyboard or other USB device. The memory interface connects a memory card or other memory medium to send and receive data.

The operation unit 730 is an instruction input unit for inputting operation instructions to the mobile information terminal 700. In this embodiment, the operation unit 730 is composed of a touch panel 730t arranged on the display unit 741 and an operation key 730k in which button switches are arranged. It shall be. Only one of them may be used. The mobile information terminal 700 may be operated by using a keyboard or the like connected to the extended interface unit 724. The mobile information terminal 700 may be operated by using a separate mobile terminal device connected by wired communication or wireless communication. Further, the touch panel function may be provided in the display unit 741.

The image processing unit 740 includes a display unit 741, an image signal processing unit 742, a first image input unit 743, and a second image input unit 744. The display unit 741 is a display device such as a liquid crystal panel, and provides the user of the mobile information terminal 700 with the image data processed by the image signal processing unit 742. The image signal processing unit 742 includes a video RAM (not shown), and the display unit 741 is driven based on the image data input to the video RAM. Further, the image signal processing unit 742 shall have a function of performing format conversion, menu and other OSD (On Screen Display) signal superimposition processing, etc., as necessary. The first image input unit 743 and the second image input unit 744 convert the light input from the lens into an electric signal by using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Sensor) sensor. , A camera unit that inputs image data of surroundings and objects.

The voice processing unit 750 is composed of a voice output unit 751, a voice signal processing unit 752, and a voice input unit 753. The voice output unit 751 is a speaker, and provides the user of the mobile information terminal 700 with the voice signal processed by the voice signal processing unit 752. The voice input unit 753 is a microphone, which converts a user's voice or the like into voice data and inputs it.

The sensor unit 760 is a group of sensors for detecting the state of the portable information terminal 700. In this embodiment, the GPS receiving unit 761, the gyro sensor 762, the geomagnetic sensor 763, the acceleration sensor 764, the illuminance sensor 765, and the proximity sensor 766. Consists of ,. With these sensor groups, it is possible to detect the position, tilt, direction, movement, ambient brightness, proximity status of surrounding objects, and the like of the portable information terminal 700. Further, the portable information terminal 700 may further include other sensors such as a barometric pressure sensor.

The mobile information terminal 700 may be a mobile phone, a smart phone, a tablet terminal, or the like. It may be a PDA (Personal Digital Assistants) or a notebook PC. Further, it may be a digital still camera, a video camera capable of shooting a moving image, a portable game machine, or other portable digital device.

The configuration example of the mobile information terminal 700 shown in FIG. 5A includes many configurations that are not essential to this embodiment, such as the sensor unit 760, but the present embodiment even if the configuration is not provided with these. Does not impair the effect of. Further, configurations (not shown) such as a digital broadcast reception function and an electronic money payment function may be further added.

[Software configuration of mobile information terminal]
FIG. 5B is a software configuration diagram of the mobile information terminal 700 of this embodiment, and shows the software configuration of the ROM 703, the RAM 704, and the storage unit 710. In this embodiment, the basic operation program 7001 and other operation programs are stored in the ROM 703, and the cooperation control program 7002, the HTML browser program 7003, and other operation programs are stored in the storage unit 710. In addition, the storage unit 710 has a content storage area 7011 for storing contents such as moving images, still images, and sounds, an authentication information storage area 7012 for storing authentication information used in cooperation with a TV receiver, and the like. It shall be provided with various information storage areas for storing various information.

The basic operation program 7001 stored in the ROM 703 is expanded in the RAM 704, and the main control unit 701 further executes the expanded basic operation program to form the basic operation execution unit 7101. Further, the cooperation control program 7002 and the HTML browser program 7003 stored in the storage unit 710 are expanded in the RAM 704, respectively, and the main control unit 701 executes each of the expanded operation programs to execute the cooperation control execution unit 7102 and the HTML browser program 7003. It constitutes the HTML browser engine 7103. Further, the RAM 704 is provided with a temporary storage area for temporarily holding the data created at the time of executing each operation program as needed.

In the following, for the sake of simplicity, the main control unit 701 performs a process of controlling each operation block by expanding the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executing the basic operation. It is described as assuming that the unit 7101 controls each operation block. The same description is made for other operation programs.

The cooperation control execution unit 7102 manages device authentication and connection, transmission / reception of each data, and the like when the mobile information terminal 700 performs a cooperation operation with the television receiver. The HTML browser engine 7103 is an HTML browser that executes an application created for a broadcast communication cooperation system on a personal digital assistant 700.

Each of the operation programs may be stored in the ROM 703 and / or the storage unit 710 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722. Further, each of the operation programs stored in the memory card, the optical disk, or the like may be acquired via the expansion interface unit 724 or the like.

[Overview of Application Control Information (AIT)]
The application control information (AIT) of this embodiment is an application (AIT) linked to a broadcasting service with respect to a television receiver or the like (in this embodiment, the broadcasting receiving device 100) in the broadcasting communication cooperation function supported by the broadcasting receiving device 100. Hereinafter, it may be referred to as a broadcast cooperation application.) It is assumed that the information is intended to inform the existence of the existence and instruct its control. The broadcast cooperation application operates only in the broadcast reception state based on (1) a control signal such as start / end included in the broadcast signal, and access to the broadcast resource is permitted based on the control signal. Applications, non-broadcast managed applications that allow access to broadcast resources based on means such as application authentication in an operation mode in which the start / end is not controlled by the broadcast signal, and (3) broadcast resources. It may be distinguished from other general applications that are not allowed access.

As the transmission method of AIT, a method of transmitting AIT in section format or XML (XML (XML) Language) format by broadcast wave by a data carousel (Data Carousel: DC) method or the like, and a method of transmitting the AIT file in section format or XML format on the Internet. Either a method of distributing from the server device on the 200 by http (Hypertext Transmission Protocol) or https (Hypertext Transmission Protocol) may be used. Other methods may be adopted.

FIG. 6 is a data structure diagram showing an example of the data structure of AIT. The AIT mainly includes application type 901, application identifier 902, application control code 903, application profile 904, application acquisition destination information 905, application boundary and access authority setting 906, startup priority 907, cache information 908, and server access distribution parameter 909. , Etc. are composed of each information. In addition, other information may be included.

Application type 901 defines an application description scheme. In this embodiment, it is assumed that the description method of the application is HTML. The application identifier 902 is identification information for identifying an application unit, which is composed of an organization identification for identifying a business operator and an application identification numbered for each business operator. The application unit is a set of HTML documents and reference resources thereof, in which the HTML document existing at the location specified in the application acquisition destination information 905 is used as the entry document. The application control code 903 defines the operation control for the target application, and one of (1) automatic start, (2) operable, (3) termination, and (4) prefetch is described. .. The application profile 904 is a value indicating the function of the television receiver required by the application, and indicates a combination of the functions that the television receiver has as an option. By referring to this value, the availability of the application is determined.

The application acquisition destination information 905 is information for specifying the acquisition destination of the application, and is location information for acquiring the HTML document to be first referred to when the application is started. Since it is assumed that the application is transmitted by broadcasting or placed on a server device on the communication network, the location information specified in the application acquisition destination information 905 also supports both broadcasting acquisition and communication acquisition. Regulations are made. The application boundary and access restriction setting 906 is information indicating the operable range as a broadcast managed application as a set of one or more areas (URL: Uniform Resource Locator). In addition, access restrictions to broadcast resources for each area are set for each function. The application boundary and access restriction setting 906 specifies the range of document transitions to prevent unexpected document transitions and access to inappropriate broadcast resources due to the chain of document transitions from the entry document when the application is started. do. Further, it is possible to set the access authority to a specific broadcast resource in each area within the range of the document transition.

The activation priority 907 defines which of the data broadcasting by the broadcasting service and the broadcasting managed application by the HTML document is to be started with priority when they exist at the same time. Unconditionally specify data broadcasting as the highest priority on the PMT, specify the startup priority of a specific application type on the PMT, and specify the startup priority of the target application with the startup priority 907. Shall be possible. The cache information 908 is information used for cache control when holding an application resource in preparation for reuse of an application. With this information, it is possible to cache application resources that are supposed to be reused even after the application is terminated. The server access distribution parameter 909 is a parameter set for distributing access for the purpose of reducing the load on the server where access is concentrated at the application acquisition destination or the like. The television receiver may operate to stochastically delay the application of the application control code according to the setting of this parameter.

Hereinafter, the operation of the broadcast receiving device 100 of this embodiment will be described.

[Operation sequence when starting the application]
First, the activation process of the broadcast cooperation application based on the AIT transmitted by the broadcast wave in the broadcast receiving device 100 of the present embodiment will be described. In the broadcast receiving device 100 of this embodiment, which is prioritized when the data broadcasting by the broadcasting service and the broadcasting cooperation application exist at the same time based on the information on the PMT, the application control code 903 of the AIT, the activation priority 907, and the like. It is possible to specify whether to start.

FIG. 7A is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when the broadcast cooperation application is specified to be started with priority. The figure shows a series of flow until the broadcast receiving device 100 appropriately confirms the PMT and AIT and activates a predetermined broadcast cooperation application.

When the tuner / demodulation unit 131 of the broadcast receiving device 100 performs tuning processing of the channel desired by the user and acquires the TS, the main control unit 101 then acquires the PMT data string separated by the first separation unit 132. (S101), the activation priority described in the PMT is confirmed. When it is confirmed that the activation priority of the broadcast cooperation application is high in the processing of S101 (S102), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S103), and the acquired AIT The application control code 903 of the data string is confirmed (S104). When the application control code 903 is "automatic start" in the process of S104, the application profile 904 of the acquired AIT data string is further confirmed (S105), and the broadcast cooperation application specified in the AIT is executed. When it is confirmed that it is possible, the transmission request of the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 based on the information described in the application acquisition destination information 905. (S106).

The service provider server 400 that has received the transmission request of the broadcast cooperation application performs authentication processing of the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then stores the broadcast receiving device 100 in the application storage area 4013. The stored predetermined broadcast cooperation application is distributed via the LAN communication unit 421 (S107). A known method may be used for the authentication process, and detailed description thereof will be omitted. Next, the application engine 162 of the broadcast receiving device 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 based on the control of the application control unit 161. (S108).

FIG. 7B is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when it is specified to preferentially start the data broadcasting by the broadcast service. The figure shows a series of flow until the broadcast receiving device 100 appropriately confirms the PMT and AIT and activates a predetermined broadcast cooperation application.

When the tuner / demodulation unit 131 of the broadcast receiving device 100 performs tuning processing of the channel desired by the user and acquires the TS, the main control unit 101 then acquires the PMT data string separated by the first separation unit 132. (S201), the activation priority described in the PMT is confirmed. When it is confirmed that the activation priority of the data broadcasting by the broadcasting service is high in the processing of S201 (S202), the data broadcasting reception processing unit 141 acquires the BML data string separated by the first separation unit 132 and obtains the BML document. Play (S203). When the automatic start of data broadcasting is set by the BML document, and when the user makes a data broadcasting start request using an operation terminal (mobile information terminal 700, remote control, etc.) (S204), the data broadcasting engine 142 Generates data broadcasting screen information by executing the reproduced BML document and displays it on the video display unit 173 (S205).

After the processing of S205 or at the same time as the processing of S205, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S206), and confirms the application profile 904 of the acquired AIT data string. (S207). When it is confirmed in the process of S207 that the broadcast cooperation application specified in the AIT can be executed, an entry button for the executeable broadcast cooperation application is displayed on the data broadcasting screen. The entry button may be displayed at all times, and the color scheme may be changed from the inactive color to the active color only when the broadcast cooperation application can be executed. By changing the shape, the inactive state and the active state of the entry button may be switched.

When the user selects the entry button using the operation terminal (S208), the data broadcasting engine 142 ends the process of executing the BML document and generating the data broadcasting screen information (S209). Subsequently, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S210), and confirms the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information described in the application acquisition destination information 905 confirmed in S210, a transmission request of the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S211).

The service provider server 400 that has received the transmission request of the broadcast cooperation application performs authentication processing of the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then stores the broadcast receiving device 100 in the application storage area 4013. The stored predetermined broadcast cooperation application is distributed via the LAN communication unit 421 (S212). Next, the application engine 162 of the broadcast receiving device 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 based on the control of the application control unit 161. (S213).

FIG. 7C is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when none of the priority activations is specified. The figure shows a series of flow until the broadcast receiving device 100 appropriately confirms the PMT and AIT and activates a predetermined broadcast cooperation application.

When the tuner / demodulation unit 131 of the broadcast receiving device 100 performs tuning processing of the channel desired by the user and acquires the TS, the main control unit 101 then acquires the PMT data string separated by the first separation unit 132. (S301), the activation priority described in the PMT is confirmed. When it is confirmed that the activation priority of the broadcast cooperation application is high in the processing of S301 (S302), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S303), and the acquired AIT The application control code 903 of the data string is confirmed (S304). In the process of S304, when the application control code 903 is "startable" instead of "automatically started", the display of the broadcast program is continued without starting either the data broadcasting by the broadcasting service or the broadcasting cooperation application.

When the user makes a data broadcasting activation request using the operation terminal in the state after the processing of S304 is completed (S305), the acquisition of the BML data string and the BML are performed in the same manner as the processing after S205 in FIG. 7B. Documents are played back, data broadcasting screen information is generated, etc. (however, not shown). On the other hand, when the user requests to start the broadcast cooperation application launcher using the operation terminal after the processing of S304 is completed (S306), the application control unit 161 separates the AIT data by the first separation unit 132. The column is acquired (S307), and the application profile 904 of the acquired AIT data column is confirmed (S308). Further, the application control unit 161 displays a list of executable broadcast cooperation applications on the video display unit 173 as a broadcast cooperation application launcher (S309).

When the user selects a predetermined broadcast cooperation application from the broadcast cooperation application launcher displayed in S309 using the operation terminal (S310), the application control unit 161 selects the AIT data string separated by the first separation unit 132. Acquire (S311), and confirm the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information described in the application acquisition destination information 905 confirmed in S311, a transmission request of the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S312).

The service provider server 400 that has received the transmission request of the broadcast cooperation application performs authentication processing of the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then stores the broadcast receiving device 100 in the application storage area 4013. The stored predetermined broadcast cooperation application is distributed via the LAN communication unit 421 (S313). Next, the application engine 162 of the broadcast receiving device 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 based on the control of the application control unit 161. (S314).

In the activation sequence of the broadcast cooperation application described with reference to FIGS. 7A to 7C, an example of acquiring AIT from the broadcast wave is described, but a predetermined server device specified by the information description of PMT or the like is described. You may get the AIT file from. Further, the acquisition of the broadcast cooperation application may be performed not from the server device (service provider server 400) on the network but from the broadcast wave. That is, when the location information described in the application acquisition destination information 905 of the AIT indicates a broadcast wave, the HTML data string transmitted by the application control unit 161 by the data carousel method or the like and separated and output by the first separation unit 132. The HTML document may be reproduced from the above, and the reproduced HTML document (broadcasting cooperation application) may be executed by the application engine 162.

If there is no information to specify the activation priority when the data broadcasting by the broadcasting service and the broadcasting cooperation application exist on the PMT at the same time, the activation is performed only by the information such as the AIT application control code 903 and the activation priority 907. You may want to check the priority. Similarly, even if the acquisition of the information on the PMT fails, the startup priority may be confirmed only by the information such as the application control code 903 of the AIT and the startup priority 907. That is, the AIT is checked regularly regardless of the information on the PMT, and if the broadcast cooperation application specified by "automatic start" exists in the application control code 903 of the AIT, the broadcast cooperation application is used. Priority may be given to activation, and if the broadcasting cooperation application specified by "automatic activation" does not exist in the application control code 903 of AIT, priority may be given to activation of data broadcasting by the broadcasting service.

If there is no response from the service provider server 400 for a predetermined time or more when a broadcast cooperation application distribution request is made in S106, S211, or S312, a message such as "Please wait" is sent to the video display unit 173. It may be displayed. Alternatively, in this case, a message asking the user to cancel the execution of the broadcast cooperation application may be displayed.

Further, it goes without saying that the activation sequence of the broadcast cooperation application is not limited to the above-mentioned three patterns, and may be activated by a different sequence.

[Operation sequence when linking mobile information terminals]
In the broadcast receiving device 100 of this embodiment, it is assumed that the function of the broadcasting communication cooperation service can be expanded by the cooperation operation between the broadcasting receiving device 100 and the mobile information terminal 700. For example, by installing an application (cooperation control application) prepared by the manufacturer of the television receiver, the portable information terminal 700 can be used as a high-performance remote controller of the broadcast receiving device 100. Further, the broadcast cooperation application can be executed on the mobile information terminal 700, and for example, a service linked to the broadcast program displayed by the broadcast receiving device 100 can be displayed on the mobile information terminal 700. In order to expand the functions by the cooperative operation of the broadcast receiving device 100 and the mobile information terminal 700, it is desirable that the cooperative control application is started on the mobile information terminal 700 and operates on the mobile information terminal 700. It is assumed that the broadcast cooperation application to be operated is controlled by the cooperation control application.

FIG. 8A is an operation sequence diagram showing an example of an operation sequence when the cooperation control application is started on the mobile information terminal 700. The figure shows a series of flow (first time) until the mobile information terminal 700 performs the authentication process with the broadcast receiving device 100 and the cooperative operation becomes possible. It is assumed that the cooperation control application is installed in advance in the storage unit 710 of the mobile information terminal 700 as the cooperation control program 7002.

When the user instructs the mobile information terminal 700 to start the cooperation control application (S401), the cooperation control execution unit 7102 of the mobile information terminal 700 searches for a TV receiver capable of communication (cooperation operation) on the network (S401). S402), the search results are displayed on the display unit 741 as a list of television receivers. If a communicable TV receiver cannot be found, a message to that effect is displayed and the process ends. When the user selects an arbitrary television receiver (broadcast receiver 100 of this embodiment) from the television receiver list, the cooperation control execution unit 7102 displays a login screen for connecting to the broadcast receiver 100 on the display unit 741. do. When the user inputs authentication information (login name and password specified by the broadcast receiving device 100, etc.) to the login screen via the operation unit 730 (S403), the cooperation control execution unit 7102 receives the input authentication information. Is stored in the authentication information storage area 7012 and simultaneously transmitted to the broadcast receiving device 100 (S404). The processing of transmitting the authentication information to the broadcast receiving device 100 may be performed via the LAN communication unit 721 and the router device 210, or may be directly performed to the broadcast receiving device 100 via the NFC communication unit 723. ..

The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 confirms whether or not the received authentication information is correct by referring to the authentication information storage area 1012. (S405). When it is confirmed by the process of S405 that the received authentication information is correct, the information of the mobile information terminal 700 is stored in the authentication information storage area 1012, and the mobile information terminal 700 is authenticated (S406). The mobile information terminal 700 certified by the broadcast receiving device 100 displays the basic screen (for example, a high-performance remote controller screen) of the cooperative control application on the display unit 741 (S407). If the received authentication information is not confirmed to be correct in S405, the terminal cooperation control unit 191 of the broadcast receiving device 100 returns an error to the mobile information terminal 700. By the above processing, the cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.

FIG. 8B is an operation sequence diagram showing an example of an operation sequence when the cooperation control application is started on the mobile information terminal 700. The figure shows a series of flows (second and subsequent times) until the mobile information terminal 700 performs the authentication process with the broadcast receiving device 100 and the cooperative operation becomes possible.

When the user instructs the mobile information terminal 700 to start the cooperation control application (S501), the cooperation control execution unit 7102 of the mobile information terminal 700 searches for a communicable TV receiver on the network and displays the search result on the TV. It is displayed on the display unit 741 as a list of receivers. If a communicable TV receiver cannot be found, a message to that effect is displayed and the process ends. The user selects an arbitrary TV receiver (broadcast receiving device 100 of this embodiment) from the TV receiver list (S502), and the selected broadcast receiving device 100 has connected (coordinated operation) in the past. In the case of a certain device, the cooperation control execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S503).

The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 confirms whether or not the received authentication information is correct by referring to the authentication information storage area 1012. (S504). When it is confirmed by the process of S504 that the received authentication information is correct, the mobile information terminal 700 is authenticated (S505). The mobile information terminal 700 certified by the broadcast receiving device 100 displays the basic screen of the cooperation control application on the display unit 741 (S506). By the above processing, the cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.

In addition, when the broadcast cooperation application is started in the broadcast receiving device 100 following the processing of FIGS. 8A to 8B, the processing of FIGS. 7A to 7C may be performed after the processing of FIGS. 8A to 8B.

FIG. 8C is an operation sequence diagram showing an example of an operation sequence when the cooperation control application is started on the mobile information terminal 700. The figure shows a series of flows (second and subsequent times) until the mobile information terminal 700 performs the authentication process with the broadcast receiving device 100 and the cooperative operation becomes possible. However, in the figure, it is an example of the case where the broadcast receiving device 100 that executes the activation sequence of the broadcast cooperation application requires the activation of the cooperation control application on the mobile information terminal 700.

When the tuner / demodulation unit 131 of the broadcast receiving device 100 performs tuning processing of the channel desired by the user and acquires the TS, the main control unit 101 then acquires the PMT data string separated by the first separation unit 132. (S601), the activation priority described in the PMT is confirmed. When it is confirmed that the activation priority of the broadcast cooperation application is high in the processing of S601 (S602), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S603), and the acquired AIT The application control code 903 of the data string is confirmed (S604). When the application control code 903 is "automatic start" in the process of S604, the application profile 904 of the acquired AIT data string is further confirmed (S605). In the process of S605, when it is confirmed that the broadcast cooperation application specified in the AIT can be executed and it is determined that the cooperation control of the mobile terminal device is necessary, the terminal cooperation control unit 191 authenticates. By referring to the information storage area 1012, the mobile information terminal 700 is selected as the mobile terminal device, and the cooperation control application activation request is transmitted to the selected mobile information terminal 700 (S606).

The selection of the mobile information terminal 700 by referring to the authentication information storage area 1012 is made based on the latest information of the authentication information storage area 1012 or based on the most frequently used information of the authentication information storage area 1012. You can do it.

Further, in the process of S606, when the mobile terminal device to which the cooperation control application activation request should be transmitted cannot be found, a message indicating that fact may be displayed on the video display unit 173. Alternatively, in this case, a message asking the user to cancel the execution of the broadcast cooperation application may be displayed.

The main control unit 701 of the mobile information terminal 700 activates the cooperation control application (cooperation control execution unit 7102) in response to the cooperation control application activation request received via the LAN communication unit 721 (S607), and further cooperate control. The execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S608).

The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 confirms whether or not the received authentication information is correct by referring to the authentication information storage area 1012. (S609). When it is confirmed by the process of S609 that the received authentication information is correct, the mobile information terminal 700 is authenticated (S610). The mobile information terminal 700 certified by the broadcast receiving device 100 displays the basic screen of the cooperation control application on the display unit 741 (S611). By the above processing, the cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700 becomes possible.

When the broadcast cooperation application is executed on both the broadcast receiving device 100 and the mobile information terminal 700 following the above-described processing, the processing shown in FIG. 9 may be performed. FIG. 9 is an operation sequence diagram showing an example of the activation sequence of the broadcast cooperation application of the broadcast receiving device 100 and the mobile information terminal 700.

That is, after the processing of S601 to S611 in FIG. 8C, the application control unit 161 of the broadcast receiving device 100 acquires the AIT data string separated by the first separation unit 132 (S612), and the application of the acquired AIT data string. Confirm the acquisition destination information 905. Further, based on the information described in the application acquisition destination information 905 confirmed in S612, a transmission request of the broadcast cooperation application (television side) is transmitted to the predetermined service provider server 400 via the LAN communication unit 121. (S613).

The service provider server 400 that has received the transmission request of the broadcast cooperation application (television side) performs the authentication process of the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then applies the application. The predetermined broadcast cooperation application (television side) stored in the storage area 4013 is distributed via the LAN communication unit 421 (S614). The application engine 162 of the broadcast receiving device 100 receives the predetermined broadcast cooperation application (television side) distributed from the service provider server 400 received via the LAN communication unit 121 based on the control of the application control unit 161. Start (S615).

Next, the terminal cooperation control unit 191 of the broadcast receiving device 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700, which is acquired from the broadcast cooperation application (television side) executed by AIT or S615. The URL information and the like are transmitted to the mobile information terminal 700 (S616). The cooperation control execution unit 7102 of the mobile information terminal 700 is a predetermined service business via the LAN communication unit 721 based on the acquisition destination URL information of the broadcast cooperation application (terminal side) received via the LAN communication unit 721. A transmission request of the broadcast cooperation application (terminal side) is transmitted to the person server 400 (S617).

The service provider server 400 that has received the transmission request of the broadcast cooperation application (terminal side) performs the authentication process of the mobile information terminal 700 as necessary based on the control of the application management / distribution execution unit 4103, and then applies the application. The predetermined broadcast cooperation application (terminal side) stored in the storage area 4013 is distributed via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the mobile information terminal 700 activates the predetermined broadcast cooperation application (terminal side) distributed from the service provider server 400 received via the LAN communication unit 721 (S619).

It should be noted that the AIT file can be acquired from a predetermined server device, the broadcast cooperation application can be acquired from the broadcast wave instead of from the server device on the network, and the like are the same as the operation sequences of FIGS. 7A to 7C. be. When the broadcast cooperation application is acquired from the broadcast wave, the broadcast reception device 100 acquires the broadcast cooperation application (terminal side) to be executed by the mobile information terminal 700 from the broadcast wave, and the acquired broadcast cooperation application (terminal side). ) May be transferred to the mobile information terminal 700 via the communication unit 121. Alternatively, the broadcast receiving device 100 acquires the broadcast cooperation application (terminal side) to be executed by the mobile information terminal 700 from the broadcast wave, stores it in the storage unit 110, and transmits it to the mobile information terminal 700 in the process of S616 in FIG. As the URL information to be used, the location information of the storage unit 110 of the broadcast receiving device 100 may be transmitted. The broadcast receiving device 100 may acquire the broadcast cooperation application (television side) from the broadcast wave, and the mobile information terminal 700 may acquire the broadcast cooperation application (terminal side) from the server device on the network. Using the digital broadcast reception function of the mobile information terminal 700, the broadcast cooperation application (terminal side) may be acquired directly from the broadcast wave.

Further, the operation sequences of FIGS. 7A to 7C, 8A to 8C, and 9 can be partially combined as appropriate, and some operation steps are appropriately rearranged with other operation steps. , Simultaneous operation, etc. are possible.

[Mobile information terminal cooperation control application basic screen]
FIG. 10A is a screen display diagram showing an example of a basic screen of the cooperation control application displayed by the process of S407 of FIG. 8A, the process of S506 of FIG. 8B, the process of S611 of FIG. 8C, and the like. In this embodiment, the basic screen 741a of the cooperation control application is provided with a function as a high-performance remote controller corresponding to the broadcast receiving device 100.

As shown in FIG. 10A, the basic screen 741a of the cooperation control application has a power key 741a1, a network selection key (terrestrial digital, BS, CS) 741a2, a number key (1 to 12) 741a3, and a volume UP / DOWN key 741a4. Channel UP / DOWN key 741a5, input switching key 741a6, program guide key 741a7, data key 741a8, linked app key 741a9, menu key 741aa, return key 741ab, cursor key (up, down, left, right) 741ac, enter key 741ad , Color keys (blue, red, green, yellow) 741ae. Other operation keys may be further displayed.

It is convenient if each of the operation keys has the same key layout / operation as the dedicated remote controller attached to the broadcast receiving device 100. Further, the power key 741a1, the network selection key 741a2, the number key 741a3, and the like have the same functions as the operation keys of the known TV remote controller, and detailed description thereof will be omitted. The cooperation application key 741a9 is an operation key prepared for the broadcasting communication cooperation function of this embodiment.

In the processing of S204 of FIG. 7B and S305 of FIG. 7C, it is assumed that the data broadcasting can be started / stopped by selecting the data key 741a8. Further, in the processing of S208 of FIG. 7B and S310 of FIG. 7C, it is assumed that the executable broadcasting cooperation application can be selected by operating the cursor key 741ac and the enter key 741ad. Further, in the process of S306 of FIG. 7C, it is assumed that the activation request of the broadcast cooperation application launcher can be made by selecting the cooperation application key 741a9.

By preparing the linked application key 741a9 or another operation key having the same function on the basic screen 741a of the linked control app in this way, each broadcast linked application used in the broadcast linked system of this embodiment can be easily selected / It becomes possible to start. Further, the cooperation application key 741a9 or another operation key having a similar function may be provided in the dedicated remote controller attached to the broadcast receiving device 100.

FIG. 10B is a screen display diagram showing an example of the basic screen of the cooperative control application displayed by the process of S407 of FIG. 8A, the process of S506 of FIG. 8B, the process of S611 of FIG. 8C, and the like. This is a different example.

The basic screen 741b of the cooperation control application is composed of a cooperation control in progress message 741b1 and a cooperation control application operation screen 741b2. Other objects may be displayed further. The cooperation control message 741b1 is a message display for causing the user to recognize that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. The cooperation control application operation screen 741b2 is an area in which an arbitrary screen is displayed by the cooperation control application, and detailed description thereof will be omitted in this embodiment. For example, the configuration in the cooperation control application operation screen 741b2 may be the same as the basic screen 741a of the cooperation control application described above. The sub screen of the broadcast program displayed on the broadcast receiving device 100 may be displayed.

As shown in FIG. 10B, by displaying the link control in progress message 741b1, the user of the mobile information terminal 700 can easily grasp that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. Will be. The link control message 741b1 is not limited to the character display, but may be a symbol display, a graphic display, or the like. It may be a substitute for the message 741b1 during cooperation control due to a difference in background color or the like.

[Data broadcasting screen of broadcast receiving device]
FIG. 11 is a screen display diagram showing an example of a data broadcasting screen displayed by the process of S205 of FIG. 7B. In this embodiment, it is assumed that the three broadcast cooperation applications, the cooperation application A, the cooperation application B, and the cooperation application C, can be executed by the broadcast receiving device 100 according to the description of the AIT and the like. In this case, the entry button 173a2 of the cooperation application A, the entry button 173a3 of the cooperation application B, and the entry button 173a4 of the cooperation application C are displayed at arbitrary positions on the data broadcasting screen 173a.

On the data broadcasting screen 173a as shown in FIG. 11, when the entry button 173a2, the entry button 173a3, the entry button 173a4, etc. are selected by using the cursor key 741ac and the enter key 741ad of the basic screen 741a of the cooperation control application, the data broadcasting is performed. At the same time as ending the display of the screen 173a, the cooperation application A, the cooperation application B, the cooperation application C, and the like are started by the control of the application control unit 161 and the application engine 162.

When displaying the data broadcasting screen 173a, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button should be changed as appropriate according to the type of broadcasting cooperation application, security status, etc. You can do it. For example, when the linked application A is a broadcast managed application, the frame color of the entry button 173a2 is blue, and when the linked application B is a non-broadcast managed application, the frame color of the entry button 173a3 is yellow. When the linked application C is a general application, the frame color of the entry button 173a4 is changed to red, and so on. Alternatively, if it is determined that the linked application A is reliable in terms of security, the frame color of the entry button 173a2 is changed to blue, and if it is determined that the linked application B is not always reliable in terms of security, the entry button is displayed. The frame color of the 173a3 is changed to yellow, and the frame color of the entry button 173a4 is changed to red when the linked application C is determined to be dangerous in terms of security.

In addition, depending on the function and genre of the broadcast cooperation application, or according to the expiration date of each broadcast cooperation application, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button, etc. May be changed as appropriate. Depending on whether or not the broadcast cooperation application has been acquired from the network, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate. .. For example, if the linked application A has already been acquired from the network (cached in the RAM 104 or the storage unit 110), the frame color of the entry button 173a2 is set to blue, and if the linked application B is being acquired, the frame color is changed to blue. The frame color of the entry button 173a3 is changed to yellow, and the frame color of the entry button 173a4 is changed to red when the cooperation application C has not been acquired.

In this way, the user of the broadcast receiving device 100 can easily grasp the type and security status of the broadcast cooperation application that can be executed by the broadcast receiving device 100.

[Broadcast cooperation application launcher screen of broadcast receiver]
FIG. 12A is a screen display diagram showing an example of a notification screen for making the user recognize that there is a broadcast cooperation application that can be activated in the broadcast receiving device 100 of this embodiment.

For example, in the operation sequence shown in FIG. 7C, after the processing of S304, the display of the broadcast program is continued without activating either the data broadcasting by the broadcasting service or the broadcasting cooperation application. On the other hand, in this case, if the icon 173b0 as shown in FIG. 12A is displayed in order to make the user recognize that there is a broadcast cooperation application that can be started, the usability of the broadcast receiving device 100 is improved. That is, by displaying the icon 173b0, it is possible to prevent the user from overlooking the existence of the broadcast cooperation application that can be started.

The display position of the icon 173b0 may be any position on the screen, but it is desirable that the display position does not interfere with the viewing of the broadcast program. For example, the four corners of the screen. Further, the icon 173b0 may be a character display as shown in FIG. 12A, or may be a symbol, a figure, or the like. Further, the icon 173b0 may be displayed at all times, or may be displayed for a predetermined time after the power is turned on or the channel is switched. Alternatively, it may be displayed at the same time when the program information, the channel number, or the like is displayed.

FIG. 12B is a screen display diagram showing an example of a broadcast cooperation application launcher displayed by the process of S306 of FIG. 7C. In this embodiment, it is assumed that the three broadcast cooperation applications, the cooperation application A, the cooperation application B, and the cooperation application C, can be executed by the broadcast receiving device 100 according to the description of the AIT and the like. In this case, the broadcast cooperation application launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b, and further, the entry button 173b2 of the cooperation application A, the entry button 173b3 of the cooperation application B, and the cooperation application C are displayed in the broadcast cooperation application launcher 173b1. Entry button 173b4 and back button 173b5 are displayed.

While the broadcast cooperation application launcher 173b1 as shown in FIG. 12B is displayed, the entry button 173b2, the entry button 173b3, the entry button 173b4, using the cursor key 741ac and the enter key 741ad on the basic screen 741a of the cooperation control application. When the above is selected, the cooperation application A, the cooperation application B, the cooperation application C, and the like are started by the control of the application control unit 161 and the application engine 162. When the back button 173b5 is selected, the display of the broadcast cooperation application launcher 173b1 ends.

When displaying the broadcast cooperation application launcher 173b1 on the broadcast program screen 173b, depending on the type and security status of the broadcast cooperation application, the function and genre of the broadcast cooperation application, the acquisition status of the broadcast application from the network, etc. , The frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate. Is the same as when displaying.

Further, when there is no broadcast cooperation application that can be executed by the broadcast reception device 100, the broadcast cooperation application launcher 173b1 may not be displayed. Alternatively, in this case, a message such as "There is no available application" may be displayed inside the broadcast cooperation application launcher 173b1.

[Broadcast cooperation application execution screen of broadcast receiver]
13A is a screen display diagram showing an example of the broadcast cooperation application execution screen displayed by the processing of S108 of FIG. 7A, the processing of S213 of FIG. 7B, the processing of S314 of FIG. 7, the processing of S615 of FIG. 9, and the like. be. It is assumed that the broadcast cooperation application of this embodiment has graphics performance, effect performance, etc. by HTML description, and can be overlaid with a broadcast program screen on the video display unit 173. For example, as shown in FIG. 13A, the broadcast cooperation application unit 173c1 that displays information such as the weather forecast and news is displayed as an overlay at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application unit 173c1 is composed of a first main object 173c2, a second main object 173c3, a third main object 173c4, a background object 173c5, and the like. Other objects may be displayed further.

By selecting the data key 741a8 of the basic screen 741a of the cooperation control application while the broadcast cooperation application unit 173c1 is overlaid on the broadcast program screen 173c, the execution of the broadcast cooperation application is completed and the data broadcasting screen is displayed. It shall be possible to move to. Further, by selecting the cooperation application key 741a9 on the basic screen 741a of the cooperation control application, it is possible to end the execution of the broadcast cooperation application and return to the display of only the broadcast program screen 173c. The process may be realized by different operation keys.

Further, the transparency of the broadcast cooperation application unit 173c1 is changed by operating each operation key of the basic screen 741a of the cooperation control application while the broadcast cooperation application unit 173c1 is overlaid on the broadcast program screen 173c. It shall be possible. The transparency change processing may be performed collectively for the entire broadcasting cooperation application unit 173c1, or the first main object 173c2, the second main object 173c3, the third main object 173c4, and the background object 173c5, respectively. It may be performed alone. It may be performed for each predetermined group (for example, a plurality of objects existing in the same graphics layer).

When performing the transparency change processing, for example, the object is selected by using the cursor key 741ac on the basic screen 741a of the cooperation control application, and the transparency of the object is increased by using the "blue" key of the color key 741ae. Use the "Yellow" key to reduce the transparency of the object. The transparency changing process may be performed using different operation keys. If the entire broadcast cooperation application unit 173c1 is collectively set to 100% transparency, the broadcast cooperation application unit 173c1 can be temporarily hidden. For example, when an emergency broadcast is delivered by a broadcast wave, it is possible to set the entire broadcast cooperation application unit to have 100% transmittance and display only the broadcast program screen of the emergency broadcast on the video display unit 173. Alternatively, the CM detection unit (not shown) detects that the broadcast program has changed from the main video to the CM video, and the entire broadcast cooperation application unit 173c1 is collectively 100% transparent (or the video of the broadcast program is clarified). It may be controlled so as to have a transparency that can be confirmed in.

By performing the above processing, if you want to check the broadcast program screen in the background while the broadcast cooperation application is running, you can check the broadcast program screen without terminating the broadcast cooperation application. Become.

13B shows an example of the broadcast cooperation application execution screen displayed by the processing of S108 of FIG. 7A, the processing of S213 of FIG. 7B, the processing of S314 of FIG. 7C, the processing of S615 of FIG. 9, and the like, which are different from the above. It is a screen display figure which shows. In the example shown in FIG. 13B, the broadcast cooperation application unit 173c6 that introduces the recommended program is displayed as an overlay at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application unit 173c6 displays the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, and the like. More recommended program information may be displayed by scrolling, page switching, or the like.

Each of the recommended program information may be information on a program recommended in connection with the displayed broadcast program (broadcast program screen 173c), or information on a program recommended based on the viewing history of the user. It may be information on a program that has become a hot topic on the Internet or the like. It may be the information of the recommended program sent to the user by a friend of the user of the broadcast receiving device 100. Further, the recommended program may be a program transmitted by a broadcast wave of a digital broadcasting service, or a VOD (Video On Demand) program distributed from each server device on the Internet 200. good. It may be an information screen such as a home page prepared in a server device on the Internet 200.

With the broadcast cooperation application unit 173c6 overlaid on the broadcast program screen 173c, the first recommended program information 173c7 and the second recommended program are used by using the cursor key 741ac and the enter key 741ad on the basic screen 741a of the cooperation control application. By selecting information 173c8, third recommended program information 173c9, etc., each program image recommended by the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc. is displayed on the video display unit. It is displayed at 173.

FIG. 13C is a screen display diagram showing an example in the case where the program video recommended by the broadcast cooperation application unit 173c6 that introduces the recommended program is displayed. For example, when the first recommended program information 173c7 of the broadcasting cooperation application unit 173c6 is selected by using the cursor key 741ac and the enter key 741ad of the basic screen 741a of the cooperation control application, the first recommended program information 173c7 is displayed on the video display unit 173. The program image 173ca of the recommended program is displayed. The program video 173ca may be paused, a timed jump, or the like by the operation of the operation terminal by the user. Further, when displaying the program video 173ca, the original broadcast program screen 173c may be displayed at an arbitrary position in a PIP (Picture In Picture) format. In this case, it may be possible to change which of the program video 173ca of the recommended program and the original broadcast program screen 173c is the main screen by operating the operation terminal of the user. The size of the window of the original broadcast program screen 173c may be adjusted by operating the user's operation terminal.

Further, an icon display 173cc indicating that the program video 173ca of the recommended program is a video displayed by selecting any recommended program information displayed on the broadcasting cooperation application unit 173c6 is displayed at an arbitrary position on the screen. If it is displayed in, the convenience of the user can be improved. Needless to say, the transparency of the broadcast cooperation application unit 173c6 may be changed in the same manner as described above on the broadcast cooperation application execution screen shown in FIG. 13B.

13D shows an example of the broadcast cooperation application execution screen displayed by the processing of S108 of FIG. 7A, the processing of S213 of FIG. 7B, the processing of S314 of FIG. 7C, the processing of S615 of FIG. 9, and the like, which are different from the above. It is a screen display figure which shows. In the example shown in FIG. 13D, the broadcast cooperation application unit 173cc, which serves as a portal for the SNS (Social Networking Service) service, is overlaid at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application unit 173cc displays an entry button 173cd of the first SNS service, an entry button 173ce of the second SNS service, an entry button 173cf of the third SNS service, and the like. More SNS service entry buttons may be displayed by scrolling, page switching, or the like.

With the broadcast cooperation application unit 173cc superimposed on the broadcast program screen 173c, using the cursor key 741ac and the enter key 741ad on the basic screen 741a of the cooperation control application, the entry button 173cd of the first SNS service, the second By selecting the entry button 173ce of the SNS service, the entry button 173cf of the third SNS service, etc., the functions assigned to each entry button such as the chat function, the bulletin board function, and the Internet telephone function are enabled. This makes it possible to enjoy the broadcast program (broadcast program screen 173c) being displayed while exchanging information with others. At the same time, the basic screen 741a of the cooperation control application on the personal digital assistant 700 may be changed to a character input screen such as a software keyboard or a voice input screen for chatting or writing on a bulletin board by voice input. good.

Further, as a broadcast cooperation application that can be executed by the broadcast receiving device 100 of this embodiment, in addition to the above-mentioned example, the broadcasting receiving device 100 and the mobile information terminal 700 are further synchronized with the broadcasting timing of the CM by using the cooperation function. Then, the related CM application may be presented to both the broadcast receiving device 100 and the mobile information terminal 700. Alternatively, in the paid service that can be used by the broadcast receiving device 100, the broadcast cooperation application confirms whether or not the user of the broadcast receiving device 100 has subscribed to the paid service, and depending on the result, the broadcast receiving device 100 and / or the mobile information terminal 700 It may be something like changing the display of. In the broadcast receiving device 100 of this embodiment, it is possible to enjoy the effects described with reference to FIGS. 13A and 13B regardless of which broadcast cooperation application is executed.

[Broadcast receiver error display screen]
FIG. 14 shows broadcasting cooperation by confirming the application profile 904 of the acquired AIT data string in the processing of S105 in FIG. 7A, the processing of S207 in FIG. 7B, the processing of S308 in FIG. 7C, the processing of S605 in FIG. 8C, and the like. It is a screen display diagram which shows an example of an error display screen, such as when it is judged that the application cannot be executed, when the description of AIT is insufficient, or when the acquisition of AIT fails.

In the broadcast receiving device 100 of this embodiment, when it is determined that the broadcast cooperation application cannot be executed, the reason why the broadcast cooperation application cannot be executed, such as the confirmation result of the application profile 904, is explained. It is displayed in the error message 173d1. For example, as a result of checking the application profile 904, if a predetermined optional function is insufficient on the television receiver side, an error message 173d1 indicating that fact is displayed. The error code and the guide (URL, etc.) of the homepage of the television receiver manufacturer in which the explanation of the error code is described may be displayed. Alternatively, when the broadcast cooperation application is acquired from the network, the network connection status is naturally confirmed in advance, but at this time, for example, the broadcast cooperation application may be acquired due to an inadequate connection of the LAN cable or the like. If it is not possible, an error message 173d1 is displayed to that effect. Further, the error message 173d1 may be displayed even when the network connection is established but the broadcast cooperation application cannot be acquired correctly due to the poor error situation. The error message 173d1 may be displayed when the acquisition of the broadcast cooperation application is being executed and the broadcast cooperation application cannot be executed yet. In addition, the error message 173d1 is displayed even when the reception status of the broadcast wave is not stable and the information such as AIT cannot be received in the middle of the process even though the information such as AIT could be received at the beginning. good. In such a case, if the broadcast cooperation application acquired from each server device is cached as it is, it can be used as it is after the reception status of the broadcast wave is restored.

In addition, as a result of checking the application profile 904, when a predetermined optional function is insufficient on the TV receiver side, an error message 173d1 is displayed to recommend checking or updating the latest TV receiver firmware. You may do so. Alternatively, the broadcast receiving device 100 may automatically check or update the latest firmware. Alternatively, if the broadcast cooperation application can be executed by adding paid optional hardware or software to the TV receiver, the information on the paid optional hardware or software may be displayed. good. The error message 173d1 may be displayed on the mobile information terminal 700 instead of the broadcast receiving device 100.

[Broadcasting cooperation application execution screen of mobile information terminal]
FIG. 15 is a screen display diagram showing an example of the broadcast cooperation application (terminal side) execution screen displayed in the process of S619 of FIG. The broadcast cooperation application execution screen 741c shown in FIG. 15 is composed of a main window 741c1, a sub window 741c2, a selection marker 741c3, cursor keys 741c4, 741c5, a commentary display unit 741c6, and an end button 741c7. Other objects may be added.

In this embodiment, the broadcast cooperation application (terminal side) executed by the mobile information terminal 700 is an application for confirming the details of the broadcast program displayed by the broadcast receiving device 100. Further, the main window 741c1 displays the same image as the broadcast program screen displayed by the broadcast receiving device 100, and the sub window 741c2 displays an enlarged image at the position specified by the selection marker 741c3. It is assumed that the position of the selection marker 741c3 can be changed by selecting the cursor keys 741c4 and 741c5. It is assumed that the commentary display unit 714c6 displays commentary subtitles related to the broadcast program displayed in the main window 741c1 and comments posted by other users regarding the broadcast program. The end button 741c7 is a button for ending the operation of the broadcast cooperation application (terminal side).

By operating the broadcast cooperation application (terminal side) on the mobile information terminal 700, it is possible to expand the function of the broadcast communication cooperation service by the cooperation operation between the broadcast receiving device 100 and the mobile information terminal 700.

[EPG screen of broadcast receiver]
FIG. 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving device 100 of this embodiment. The EPG display screen 173e is a distribution schedule of broadcast programs in the digital broadcasting service of this embodiment, which is created by the main control unit 101 based on the program information data string output from the first separation unit 132. By selecting the program guide key 741a7 on the basic screen 741a of the cooperation control application, the EPG display screen 173e is displayed on the video display unit 173.

In this embodiment, the EPG display screen 173e has a matrix shape in which the vertical axis represents time and the horizontal axis represents service ID (channel), and detailed information of each broadcast program broadcast on each channel in each time zone is displayed. indicate. As shown in FIG. 16A, the detailed information 173e1 of each broadcast program is mainly composed of a title area 173e2 and a detailed explanation area 173e3.

In the title area 173e2, the program title of each broadcast program and symbols representing the attributes of each broadcast program are displayed. The symbols representing the attributes of each broadcast program are, for example, a mark symbolizing "New" meaning a new program, a mark symbolizing "Replay" meaning a rebroadcast program, and the like. And so on. Alternatively, it may be a mark or the like symbolizing "data" which means that it corresponds to data broadcasting by a broadcasting service. Further, in the case of a broadcast program for which a broadcast cooperation application that can be executed by the broadcast receiving device 100 of this embodiment is prepared, a mark or the like symbolizing "Linkage" indicating that fact may be used. The detailed explanation area 173e3 displays related information such as the program contents and performers of each broadcast program, the URL of the homepage introducing each broadcast program, and the like.

The mark or the like symbolizing the "Linkage" displayed in the title area 173e2 is an information display device as a result of checking the application profile 904 even when the broadcast cooperation application is prepared for the broadcast program. If the execution at 100 is not possible, it may not be displayed. In addition, the mark that symbolizes "Linkage", which is displayed in the title area 173e2 and indicates that the program is a broadcast program for which the executable broadcast cooperation application is prepared, can be further linked with a mobile terminal device. The color, shape, font, etc. may be changed depending on whether or not. When the operation in cooperation with the mobile terminal device is possible, the mark symbolizing "Mobile" may be displayed together with the mark symbolizing "Linkage".

Whether or not the mark symbolizing "Linkage" or the mark symbolizing "Mobile" is displayed is described in advance in the EIT information including detailed information of each broadcast program, and each broadcast program is a book. Whether or not the broadcast program is provided with a broadcast cooperation application that can be executed by the broadcast receiving device 100 of the embodiment, and whether or not the executeable broadcast cooperation application can operate in cooperation with a mobile terminal device. It may be controlled by acquiring information such as. Alternatively, the information acquired from the program distribution information of the digital broadcast program prepared in the predetermined server device on the Internet 200 is added to the electronic program table created based on the program information data string acquired from the broadcast wave of the digital broadcast service. You may add it.

As described above, on the EPG display screen 173e, a mark symbolizing "Linkage" indicating that the program is a broadcast program for which an executable broadcast cooperation application is prepared, and cooperation operation with a mobile terminal device are possible. By displaying the mark symbolizing "Mobile" indicating "Mobile", the user can easily grasp the correspondence status of each broadcast program in the broadcast receiving device 100 to the broadcast communication cooperation service. Needless to say, the mark in which a predetermined character representing the attribute of each broadcast program is symbolized may be replaced with the character itself, a sentence, or the like. By changing the background color of the detailed information 173e1 of each broadcast program, the correspondence status of each broadcast program to the broadcast communication cooperation service may be shown. Further, the mark symbolizing "Linkage" and the mark symbolizing "Mobile" are not normally displayed in the title area 173e2, and pop up only when each broadcast program is selected by the program selection cursor 173e4. It may be displayed.

The broadcast receiving device 100 of this embodiment has a function of making a viewing reservation and / or a recording reservation for each broadcast program from the EPG display screen 173e. For example, while the EPG display screen 173e is displayed, the program selection cursor 173e4 on the EPG display screen 173e is moved by using the cursor key 741ac of the basic screen 741a of the cooperation control application, and an arbitrary broadcast program is moved by the enter key 741ad. By selecting, the viewing reservation and / or the recording reservation of the selected broadcast program is performed.

In the above process, when the broadcast program for which the viewing reservation and / or the recording reservation has been made is a broadcast program corresponding to the broadcast communication cooperation service, the broadcasting is triggered by the viewing reservation and / or the recording reservation. The acquisition of the broadcast cooperation application prepared for the broadcast program may be started without waiting for the broadcast start time of the program. That is, the information (location information such as URL) for designating the acquisition destination of the broadcast cooperation application is described in the EIT information including the detailed information of each broadcast program. In this way, the broadcast receiving device 100 can grasp the information of the acquisition destination of the broadcast cooperation application prepared for each broadcast program when the broadcast program is selected by the program selection cursor 173e4. Become. Therefore, the broadcast receiving device 100 can start the acquisition of the broadcast cooperation application before the broadcast start time of the broadcast program is reached.

If the broadcast program for which viewing reservation and / or recording reservation has been made is a broadcast program corresponding to the broadcast communication cooperation service and can be operated in cooperation with the mobile terminal device, it is used for the mobile terminal device. The broadcast cooperation application (terminal side) prepared in the above may also be started to be acquired before the broadcast start time of the broadcast program by the same process as described above. Further, as shown in FIG. 16B, the EPG display screen 173e displays a two-dimensional bar code 173e5 or the like indicating the acquisition destination information (location information such as URL) of the broadcasting cooperation application (terminal side) prepared for the mobile terminal device. It may be displayed on the screen to encourage the user to download the broadcast cooperation application (terminal side) prepared for the mobile terminal device.

In this way, if the broadcast receiving device 100 refers to the acquisition destination information of the broadcast cooperation application included in the EPG information and starts the acquisition of the broadcast cooperation application before the broadcast start time of the broadcast program. , It becomes possible to distribute the load of the service provider server 400 that stores the broadcast cooperation application. Further, even when the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, the broadcast cooperation application can be effectively used immediately after the start of broadcasting of the broadcast program. become.

FIG. 17 is an operation sequence diagram showing an example of the acquisition sequence of the broadcast cooperation application when the viewing reservation and / or the recording reservation of the broadcast program is made from the EPG display screen 173e.

While viewing the digital broadcasting service, the main control unit 101 of the broadcast receiving device 100 acquires the program information data string output from the first separation unit 132 (S701). When the user makes a request to start the EPG screen using the operation terminal (S702), the EPG display screen 173e is displayed on the video display unit 173 (S703). When the user selects an arbitrary broadcast program on the EPG display screen 173e using the operation terminal to make a viewing reservation and / or a recording reservation for the broadcast program (S704), the main control unit 101 performs the first separation. The program information data string acquired from the unit 132 is confirmed (S705), and further, the location of the acquisition destination of the broadcast cooperation application linked to the broadcast program for which the viewing reservation and / or the recording reservation is made is confirmed (S706).

After the process of S706, the application control unit 161 transmits a transmission request of the broadcast cooperation application to the predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). The service provider server 400 that has received the transmission request of the broadcast cooperation application performs authentication processing of the broadcast receiving device 100 as necessary based on the control of the application management / distribution execution unit 4103, and then stores the broadcast receiving device 100 in the application storage area 4013. The stored predetermined broadcast cooperation application is distributed via the LAN communication unit 421 (S708). Subsequently, the application control unit 161 caches the predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 in the RAM 104 or the storage unit 110 (S709).

According to the broadcast receiving device 100 of the present embodiment described above, it is possible to execute a function having higher added value.

Hereinafter, Example 2 of the present invention will be described. Unless otherwise specified, the configuration and effects of this example shall be the same as those of Example 1. Therefore, in the following, the differences between the present embodiment and the first embodiment will be mainly described, and the common points will be omitted as much as possible in order to avoid duplication.

Although the embodiment in the case of performing the mobile information terminal cooperation processing (hereinafter referred to as terminal cooperation) is described in the first embodiment, a more detailed embodiment will be described.

When linking mobile information terminals, it may be desired to limit the use of terminal linkage only to the mobile information terminal 700 in the same home as the broadcast receiving device 100 (hereinafter, this limitation is referred to as the same home restriction). For example, in an application for using broadcast cooperation (hereinafter referred to as a broadcast cooperation application), the display screen of the broadcast receiving device 100 and the display screen of the mobile information terminal 700 are closely related, or the broadcast receiving device 100. This is a case where the user of the mobile information terminal 700 is surely to watch the displayed advertisement video.

The point that must be considered as a procedure is to determine whether or not the target broadcast cooperation application imposes the same in-home restriction. This judgment is not necessary if it is assumed that all broadcast cooperation applications have the same in-home restriction, but if there is no restriction, the broadcast receiving device 100 provides control information regarding the presence or absence of the same in-home restriction. Needs to get and change the operating procedure. The control information regarding the presence or absence of this restriction may be acquired from the broadcast signal (for example, described as an item of AIT), or may be acquired from a server designated by the broadcasting station.

Including the above procedure, in this embodiment, a procedure for guaranteeing that the mobile information terminal 700 exists in the same house as the broadcast receiving device 100 will be described.

Usually, the devices existing in the same house exist on the local network connected to the same router device 210. Therefore, since the mobile information terminal 700 is connected to the same local network as the broadcast receiving device 100, it can be determined that the mobile information terminal 700 exists in the same house. Whether or not the target device is connected to the local network may be determined by using a known method, and the description thereof will be omitted.

Further, even if the mobile information terminal 700 is not on the local network, it can be determined that it exists in the same house by directly communicating with the broadcast receiving device 100 by NFC, Bluetooth, infrared communication or the like. In this case, the communication for acquiring the broadcast cooperation application or the like may be the above-mentioned direct communication or mobile telephone communication.

As described above, a plurality of methods for confirming the existence in the same house can be considered, but which method is used is described in, for example, AIT, and is read by the broadcast receiving device 100.

Further, once it can be confirmed that the mobile information terminal 700 exists in the same house, it may be regarded as existing in the same house until the end of the program, or a certain effective time (for example, 10 minutes) is set and within the effective time. Is considered to exist in the same house, but if the valid time has expired, it can be considered that it does not exist in the same house without new confirmation. This effective time is described in, for example, AIT, and is read by the broadcast receiving device 100.

Further, for example, an event signal is set in the broadcast signal at an arbitrary time during the program progress, and each time the event signal is received, it is confirmed that the mobile information terminal 700 exists in the same house. You can also.

It is also possible to use the former two methods in combination.

Next, a specific procedure for permitting terminal cooperation only to the mobile information terminal 700 existing in the same house will be described. In this embodiment, restrictions are set when the mobile information terminal 700 acquires the broadcast cooperation application or the information used in the broadcast cooperation application (hereinafter, the information used in the broadcast cooperation application and the broadcast cooperation application, specifically. These are, for example, HTML documents and streaming video, but these are collectively referred to as broadcast cooperation information). There are two types of methods for acquiring broadcast cooperation information: communication acquisition acquired from the broadcasting station server 300 or the operator server 400, and broadcasting acquisition acquired from the broadcast wave. In the case of communication acquisition, there are two types, one is to acquire after the start of broadcast reception and the other is to acquire before the start of broadcast reception. Further, in the case of communication acquisition, there are cases where the broadcast receiving device 100 once acquires and the mobile information terminal 700 acquires from the broadcast receiving device 100, and cases where the mobile information terminal 700 directly acquires from the broadcasting station server 300 or the operator server 400. There is. There are various methods, but when viewed from the mobile information terminal 700, they can be roughly divided into two cases, one is to acquire from the broadcast receiving device 100 and the other is to acquire from the broadcasting station server 300 or the operator server 400.

In this embodiment, the case where the mobile information terminal 700 acquires the broadcast cooperation information from the broadcast receiving device 100 will be described, and the case where the mobile information terminal 700 acquires the broadcast cooperation information from the server will be described in the next embodiment.

FIG. 18A shows the procedure of this embodiment.

First, before performing terminal cooperation, each of the mobile information terminal 700 and the broadcast receiving device 100 activates a cooperation control application, which is an application for controlling terminal cooperation (S10001, S10002). In this state, the mobile information terminal 700 makes a terminal cooperation request to the broadcast receiving device 100 (S1003). Next, AIT is acquired from the broadcast signal (S10004). From this AIT information, it is determined whether the target mobile information terminal application has the same in-home restrictions (S10006), and if there are restrictions, proceed to the procedure of S10008, and the first stage when there is a terminal cooperation request. Then, the process proceeds to the step of S10009, and it is determined whether or not the mobile information terminal 700 for which the terminal cooperation request has been made is in the same house as the broadcast receiver 100 (S10009). As a result of the determination, if it is determined that they are not in the same house, a response of disapproval of cooperation is made to the cooperation control application on the mobile information terminal side, and the process is terminated (S10011).

Here, in the first place, if it is assumed that all the broadcasting cooperation applications have the same in-home restriction, the determination of S10006 is not performed and the application is skipped. The determination of S10006 is performed when there may be both an application having the same in-home restriction and an application not having the same in-home restriction.

If it is determined that the mobile information terminal 700 is in the same home, or if the application has no restrictions in the same home, the process proceeds to S10012 to provide a broadcast cooperation application-related service. This service (S10012) processes the broadcast cooperation information distribution request (S10013) from the mobile information terminal 700, and distributes the broadcast cooperation information to the mobile information terminal 700 (S10018). The broadcast cooperation information includes information distributed by the broadcast receiving device 100 from the distribution server which is the operator server 300 (S10014, S10015, S10016), information acquired from the broadcast signal (S10017), and stored in the broadcast receiving device 100. There are things that have been done. The reception of the broadcast cooperation information (S10016, S10017) by the broadcast reception device 100 is not limited to the case of the broadcast cooperation information distribution request (S10013) from the mobile information terminal 700, but the broadcast reception device 100 autonomously acquires the information. It may be acquired based on the occurrence of an event from a broadcast signal. Then, the distribution of the broadcast cooperation information (S10018) to the mobile information terminal 700 may also be voluntary from the broadcast receiving device 100 side.

After receiving (acquiring) and distributing a series of broadcast cooperation information, it is determined whether or not the broadcast receiving device 100 continues to watch the same program (S10019), and if not, the mobile information terminal side. A response of disapproval of cooperation is made to the cooperation control application, and the process is terminated (S10020).

If the viewing is continued, the procedure returns to S1005, and if there is a home restriction, it is confirmed whether the mobile information terminal 700 is in the same home (S10009), but the preset valid time has elapsed since the previous confirmation. It is determined whether the confirmation request (S10007) has been generated from the broadcast signal or the distribution server since the previous confirmation (S10008), and if none of the conditions are met, it is determined whether the user is in the same house. The confirmation (S10009) is not performed, and the next broadcast cooperation application-related service (S10012) is executed via S10010. Here, the confirmation request (S10007) from the broadcast signal is described so as to be acquired from the broadcast cooperation information, but here, the event message is also described as being included in the broadcast cooperation information. Further, this confirmation request may be described in the AIT.

The procedure described above is a loop processing procedure for the broadcast signal, the broadcast receiving device 100, the personal digital assistant 700, and the entire distribution server in the section indicated by the arrow in S10022. The confirmation request of S10007 may be made at any timing in the loop.

Further, the authentication information described in the AIT may be incorporated into the authentication key used for the authentication (S10015) on the distribution server. This confirms that the authentication request is legitimate. Further, if the authentication information described in the AIT is changed as the program progresses and the distribution server does not perform authentication unless the authentication key incorporates the information synchronized with the progress of the program, the same program is used. You can confirm that you continue to watch. In this case, the AIT information is appropriately read and updated (S10021). The authentication information to be incorporated in the broadcast signal may be incorporated as broadcast cooperation information in addition to being described in the AIT. Furthermore, as a method of substantially changing the authentication information, it is also possible to use a method of changing the URL itself of the distribution server according to the progress of the program.

In this way, while executing the broadcast cooperation application-related service (S10012), the mobile information terminal 700 receives the broadcast every preset effective time, or every time there is a broadcast signal or a confirmation request from the distribution server. By confirming whether or not the device 100 is in the same house, it is possible to appropriately execute a broadcast-related application having the same house restrictions. Furthermore, by using the authentication information incorporated in the broadcast signal for authentication on the distribution server, the validity of the distribution request can be ensured, and if the authentication information of the broadcast signal is changed as appropriate, the same program can be obtained. You can also confirm that you are continuing to watch.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the same in-home restriction for the mobile information terminal linked with the broadcast receiving device.

In this embodiment, a case where the mobile information terminal 700 acquires broadcast cooperation information from the distribution server will be described.

FIG. 18B shows the procedure of this embodiment.

First, before performing terminal cooperation, each of the mobile information terminal 700 and the broadcast receiving device 100 activates a cooperation control application, which is an application for controlling terminal cooperation (S10101, S10102). In this state, the mobile information terminal 700 makes a terminal cooperation request to the broadcast receiving device 100 (S10103). Next, AIT is acquired from the broadcast signal (S10104). Information such as a URL related to the distribution server is acquired from this AIT information, and the information is transmitted to the mobile information terminal 700 (S10105). Next, the broadcast receiving device 100 issues a time confirmation request to the distribution server (S10106), and based on this request, the distribution server transmits time information to the broadcast receiving device 100 (S10107). As a result, the authentication key issuance (S10115) in the subsequent stage can be performed according to the time of the distribution server, but it may be omitted if there is no problem with the time lag.

After that, the loop control indicated by the arrow of S10127 is started.

First, the mobile information terminal 700 issues an authentication key issuance request or a broadcast cooperation information distribution request to the broadcast receiving device 100 (S10109). The authentication key is used in the broadcast cooperation information distribution request to the distribution server in the latter stage (S10125). The broadcast cooperation distribution request in S10109 is a distribution request for information acquired from a broadcast signal, and corresponds to the procedure of S10126 in the subsequent stage.

In any case, when the request of S10109 is issued from the mobile information terminal, it is determined whether or not the application is a broadcasting cooperation application having the same in-home restriction (S10111). Skip to S10114. If all the broadcast cooperation applications have the same in-home restriction, the determination of S10111 is not performed, and the process proceeds to S10112. In S10112, it is determined whether or not the mobile information terminal that issued the request is in the same house, and if not, the terminal cooperation is terminated (S10113). If they are in the same house, the requested procedure, acquisition of broadcast cooperation information from the distribution server (S10125), or acquisition of broadcast cooperation information from the broadcast signal (S10126) is performed. Since acquisition from the broadcast signal may be performed in addition to acquisition from the distribution server, the procedure of S10126 is also described.

First, the procedure (S10125) for acquiring broadcast cooperation information from the distribution server will be described.

First, the broadcast receiver 100 issues the authentication key requested by the information cooperation terminal 700. At this time, it is assumed that the authentication key is valid only within a predetermined time (for example, 10 minutes) including the time information at the time of issuance. The distribution server confirms the authentication information including whether or not the authentication key is within the valid time, and if the authentication is OK, the distribution of the broadcast cooperation information is permitted. After that, the distribution of information is permitted if it is within the valid time, but the distribution is stopped when the valid time has passed. For example, the streaming video cannot be viewed after the valid time.

The preset valid time may be held in the distribution server, or the broadcast receiving device 100 may acquire the valid time from the broadcast signal (for example, AIT) and incorporate the valid time information into the authentication key. The mobile information terminal 700 is notified in advance of the valid time information, and is requested to issue an authentication key before the valid time expires. Alternatively, the valid time is managed by the broadcast receiving device 100, and before the valid time expires, after confirming that the mobile information terminal 700 is in the same house, the broadcast receiving device 100 automatically shifts to the mobile information terminal 700. An authentication key may be issued for this.

The effective time may be the same in one program, or may be changed according to the progress of the program. Further, if the valid time is not set, the authentication may be valid while the program is being watched once the authentication is performed.

Further, the authentication information described in the AIT may be incorporated into the authentication key used for the authentication (S10117) on the distribution server. This confirms that the authentication request is legitimate. Further, if the authentication information described in the AIT is changed as the program progresses and the distribution server does not perform authentication unless the authentication key incorporates the information synchronized with the progress of the program, the same program is used. You can confirm that you continue to watch. In this case, the AIT information is appropriately read and updated (S10124). The authentication information to be incorporated in the broadcast signal may be incorporated as broadcast cooperation information in addition to being described in the AIT. Furthermore, as a method of substantially changing the authentication information, it is also possible to use a method of changing the URL itself of the distribution server according to the progress of the program. The URL change in this case is when the distribution server is the same but the entrance is different, but it may be changed to a new distribution server due to a change in the broadcasting cooperation application or the like. In this case, each time the change is made, the procedure of transmitting the distribution server information (S10105), requesting the time confirmation (S10106), and transmitting the time information (S10107) is performed.

Next, a procedure (S10126) for acquiring broadcast cooperation information from a broadcast signal will be described.

In this case, after it is confirmed that the mobile information terminal 700 is in the same house, the broadcast receiving device 100 acquires the broadcast cooperation information from the broadcast signal (S10119), and subsequently distributes the information to the mobile information terminal 700. (S10120).

When the broadcast cooperation information is changed as the program progresses, a notification of the change may be issued from the broadcast signal (S10110), and the broadcast cooperation information may be acquired as a trigger. In that case, if the acquisition is from the distribution server, the broadcast receiving device 100 issues an authentication key to the mobile information terminal (S10115) to notify that there is a change notification. If it is within the valid time, the issuance of the authentication key may be omitted and only the change notification may be notified. In the case of acquisition from a broadcast signal, the broadcast receiving device 100 acquires the information (S10119) and distributes it to the mobile information terminal (S10120). In the case of acquisition from a broadcast signal, it may be confirmed that the mobile information terminal 700 is in the same house for each change notification, and the confirmation is omitted if it is within the valid time as in the second embodiment. It doesn't matter. Here, the change notification (S10110) from the broadcast signal is described so as to be acquired from the broadcast cooperation information, but here, the event message is also described as being included in the broadcast cooperation information. Further, this change notification may be described in the AIT.

After receiving (acquiring) and distributing a series of broadcast cooperation information, it is determined whether or not the broadcast receiving device 100 continues to watch the same program (S10121), and if not, the mobile information terminal side. A response of disapproval of cooperation is made to the cooperation control application, and the process is terminated (S10123). If the viewing is continued, the process returns to S10108 and the loop processing S10127 is continued.

In this way, by including the time information in the authentication key used for the authentication of the distribution server and managing the valid time, it can be confirmed that the portable information terminal 700 is in the same house as the broadcast receiving device 100 on a regular basis. It is possible to appropriately execute a broadcast cooperation application that has the same in-home restrictions. Furthermore, by using the authentication information incorporated in the broadcast signal for authentication on the distribution server, the validity of the distribution request can be ensured, and if the authentication information of the broadcast signal is changed as appropriate, the same program can be obtained. You can also confirm that you are continuing to watch.

According to the mobile information terminal cooperation technology according to the present embodiment described above, even when the mobile information terminal linked with the broadcast receiving device acquires the broadcast cooperation information from the distribution server, it is possible to realize the same in-home restriction. ..

In Examples 2 and 3, the procedure for realizing the same in-home restriction in terminal cooperation has been described, but depending on the broadcast cooperation application, use from outside the home may be permitted. In this embodiment, such a case will be described. For example, when a program such as TV shopping is publicity / promotion, it is desirable for a broadcaster to be able to use a broadcasting cooperation application regardless of whether it is inside or outside the house. In the case of such a program, once registered in the broadcast receiving device 100, the use of the broadcast cooperation application may be permitted regardless of whether or not the mobile information terminal 700 is in the house. In this case, convenience is further enhanced if there is a broadcast cooperation application that converts the broadcast video itself into streaming data and distributes it from the broadcast receiving device 100 to the mobile information terminal 700 via the Internet. The streaming data may be encrypted by the broadcast receiving device 100 for copyright protection. Whether or not the broadcast cooperation application permits the use from outside the home, including the distribution of the broadcast video outside the home, is described in the data in the broadcast signal (for example, AIT).

The specific procedure is shown in FIG. 18C. Since some of the procedures are common to Examples 2 and 3, the description of the parts overlapping with Examples 2 and 3 will be omitted. When the broadcast receiving device 100 receives a terminal cooperation request (S10203) from outside the home, the broadcast receiving device 100 confirms whether the request source is a registered mobile information terminal if the application is permitted to be used outside the home (S10203). In S10205), the cooperation is permitted. Here, if necessary, the mobile information terminal 700 and the broadcast receiving device 100 may be authenticated in order to protect the copyright of the broadcast video and the broadcast cooperation information (S10207). At that time, the authentication may be the authentication on the distribution server (S10207). Information on the necessity of copyright protection and information on the authentication method for copyright protection are acquired from a broadcast signal (for example, it is described in AIT), and control is performed accordingly. When such information is not stored in the broadcast signal, the broadcast receiving device 100 follows a predetermined method predetermined. For example, a predetermined copyright protection process may be performed. Further, if such information is not stored in the broadcast signal, it may be determined in advance that the broadcast receiving device 100 does not perform the copyright protection process.

A specific example of certification for copyright protection is shown below. Only one of the following authentications may be performed. Alternatively, a combination of a plurality of authentications exemplified below may be performed. Further, the authentication illustrated below may be combined with other authentication processes not exemplified below.

[Authentication by ID and password]
When the mobile information terminal 700 is registered in the broadcast receiving device 100, an ID and a password are issued, and the broadcast receiving device 100 permits cooperation by confirming the ID and the password.

[Use of encryption key]
In addition to the above-mentioned authentication using the ID and password, the broadcast receiving device 100 transmits an encryption key for decrypting the encrypted video data or the like to the mobile information terminal. This encryption key may be obtained from a broadcast signal (for example, described in AIT).

[Use of distribution server]
A method of issuing an encryption key for decrypting encrypted video data, etc. from a distribution server. The mobile information terminal 700 transmits an ID and a password to the distribution server and acquires an encryption key. In this case, the location information (specifically, the URL) of the distribution server is acquired from the broadcast signal (for example, described in AIT), and this location information is transmitted from the broadcast receiving device 100 to the mobile information terminal 700. More secure. Since the video or the like cannot be decrypted unless the mobile information terminal 700 can obtain the encryption key, the broadcast receiving device 100 may request the authentication on the distribution server to authenticate the copyright protection, or the mobile information terminal. The authentication may be completed by notifying the broadcast receiving device 100 that the encryption key has been obtained from the 700. Note that billing by the distribution server may be performed.

[Mutual authentication of encryption key]
The encryption keys of the broadcast receiving device 100 and the mobile information terminal 700 are mutually authenticated and confirmed to be copyright protection.

If the information stored in the broadcast signal indicates that the copyright protection is required by the predetermined method, and the copyright protection cannot be authenticated by the predetermined method, the terminal cooperation is not permitted. Further, even if the broadcast signal is not specified and the authentication is performed by the default method of the broadcast receiving device 100, if the copyright protection cannot be authenticated by the default method, the terminal cooperation is not permitted.

When the terminal cooperation is permitted, it is not confirmed whether or not the mobile information terminal 700 exists in the same house thereafter, the request from the mobile information terminal 700 (S10211), the autonomous control of the broadcast receiving device 100, and the broadcast signal. In accordance with the request from (S10210), the broadcast cooperation information is distributed to the personal digital assistant 700 (S10217), and the authentication key for the distribution server is issued (S10212). In this case, the control for which the effective time is set does not have to be performed. The mobile information terminal 700 outside the home acquires broadcast cooperation information from the distribution server using the broadcast receiving device 100 or the issued authentication key (S10215). Further, the authentication key issued by the broadcast receiving device 100 incorporates the authentication information acquired from the broadcast signal (for example, it is described in the AIT), and the distribution server uses the authentication key incorporating the authentication information acquired from the broadcast signal. If there is, if access is permitted, it is possible to further optimize the use outside the home.

In addition, there are cases where it is better not to allow unlimited use of broadcast-linked apps, such as when discounting as a premium for watching programs. In such cases, once the authentication is performed with the mobile information terminal in the same house. After that, it is preferable to allow the use of the distribution server even if it is not in the same house. In this case, the mobile information terminal 700 may not be registered in the broadcast receiving device 100.

The specific procedure in this case is shown in FIG. 18D. Since some of the procedures are the same as those in FIG. 18C, the description of overlapping parts will be omitted. First, in a state where the mobile information terminal 700 is in the same house as the broadcast receiving device 100, the mobile information terminal 700 makes a terminal cooperation request to the broadcast receiving device 100, and the broadcast receiving device 100 has the mobile information terminal 700 in the same house. After confirming that it is in (S10305), the cooperation is permitted. Here, if necessary, the mobile information terminal 700 and the broadcast receiving device 100 may be authenticated in order to protect the copyright of the broadcast video and the broadcast cooperation information (S10307). At that time, the authentication may be authentication on an external distribution server. Information on the necessity of copyright protection and information on the authentication method for copyright protection are acquired from a broadcast signal (for example, it is described in AIT), and control is performed accordingly. When such information is not stored in the broadcast signal, the broadcast receiving device 100 follows a predetermined method predetermined. For example, a predetermined copyright protection process may be performed. Further, if such information is not stored in the broadcast signal, it may be determined in advance that the broadcast receiving device 100 does not perform the copyright protection process.

A specific example of certification for copyright protection is shown below. Only one of the following authentications may be performed. Alternatively, a combination of a plurality of authentications exemplified below may be performed. Further, the authentication illustrated below may be combined with other authentication processes not exemplified below.

[Use of encryption key]
While the mobile information terminal 700 is in the same house, the broadcast receiving device 100 transmits an encryption key for decrypting the encrypted video data or the like to the mobile information terminal. This encryption key may be obtained from a broadcast signal (for example, described in AIT). Authentication is performed by handing over this encryption key in the same house. Furthermore, if the encryption key cannot be obtained from the broadcast signal until a certain point in the program and the delivery of the encryption key to the mobile information terminal 700 is limited to the same house, the user must be in the same house at that time. Restrictions can be set, and it can also be used to give a premium to viewing.

[Use of distribution server]
A method of issuing an encryption key for decrypting encrypted video data, etc. from a distribution server. The mobile information terminal 700 transmits an ID and a password to the distribution server and acquires an encryption key. In this case, the location information (specifically, the URL) of the distribution server is acquired from the broadcast signal (for example, described in AIT), and this location information is transmitted from the broadcast receiving device 100 to the mobile information terminal 700. More secure. Since the video or the like cannot be decrypted unless the mobile information terminal 700 can obtain the encryption key, the broadcast receiving device 100 may request the authentication on the distribution server to authenticate the copyright protection, or the mobile information terminal. The authentication may be completed by notifying the broadcast receiving device 100 that the encryption key has been obtained from the 700. Access to the distribution server may be performed inside or outside the home, but the location information of the distribution server cannot be obtained from the broadcast signal until at some point in the program, and the location information is sent to the mobile information terminal 700. If the delivery is limited to the same house, it is possible to set a restriction that the user must be in the same house at that time, and it can also be used to give a premium to viewing. Note that billing by the distribution server may be performed.

[Mutual authentication of encryption key]
The encryption keys of the broadcast receiving device 100 and the mobile information terminal 700 are mutually authenticated and confirmed to be copyright protection. This authentication may be performed inside the house or outside the house.

If the information stored in the broadcast signal indicates that the copyright protection is required by the predetermined method, and the copyright protection cannot be authenticated by the predetermined method, the terminal cooperation is not permitted. Further, even if the broadcast signal is not specified and the authentication is performed by the default method of the broadcast receiver 100, if the copyright protection cannot be authenticated by the default method, the terminal cooperation is not permitted. Since the procedure after permitting the terminal cooperation is the same as the procedure shown in FIG. 18C, the description thereof will be omitted.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the use of the mobile information terminal linked with the broadcast receiving device from outside the house while paying attention to copyright protection.

In the actual usage situation, it is more desirable to easily know whether or not there is a terminal cooperation application by the program and which terminal cooperation application can be used. In this embodiment, a method of displaying the availability status of the terminal cooperation application will be described. The terminal cooperation application refers to a broadcasting cooperation application used in terminal cooperation.

FIG. 19A is an example of the launcher screen (173b11) of the broadcast cooperation application when there is a terminal cooperation application. The broadcast cooperation application is displayed with a framed character icon. The broadcast cooperation application (173b12 to 173b14) for the broadcast receiving device 100 linked to the program being viewed and the broadcast cooperation application (173b15 to 173b17) for the mobile information terminal are displayed. In the case of this example, the thickness of the border surrounding the character string and the color inside the frame indicate the status of the application. The main body application A, B (173b12, 173b13) and the terminal application A, B (173b15, 173b16) are available, and the main body application C (173b14) and the terminal application C (173b17) cannot be used. .. The state in which the terminal application cannot be used means that none of the mobile information terminals 700 in a state of being able to communicate with the broadcast receiving device 100 has a function of executing the application.

FIG. 19B is a screen after selecting the terminal application A in FIG. 19A. The state of each mobile information terminal 700 with respect to the terminal application A is shown. The mobile information terminal displayed on this screen is a terminal that has been linked or registered with the broadcast receiving device 100 in the past.

The mobile terminal 1 (173b22) and the mobile terminal 2 (173b23) whose icon border is a solid line are in a state where they can communicate with the broadcast receiving device 100, and the mobile terminal 3 (173b24) whose border is a dotted line. And the mobile terminal 4 (173b25) are not in a state of being able to communicate with the broadcast receiving device 100. Further, the mobile terminal 1 (173b22) and the mobile terminal 3 (173b24) whose icon frame is white have a function of executing the terminal application A, and the mobile terminal 2 (173b23) and the mobile terminal 4 whose frame is gray. (173b25) indicates that it does not have the function of executing the terminal application A. Furthermore, if the app is already running on the device, you may use an icon designed to indicate that.

In addition, the icon is easier to understand visually if a pattern is used, so an example is shown below.

FIG. 19C is an example of a launcher screen (173b31) showing a list of broadcast cooperation applications. In addition to the broadcast receiving device 100, icons are shown for each type of personal digital assistant 700. 173b32 and 173b33 are icons indicating the broadcast receiving device 100, 173b34 and 173b35 are icons indicating the smartphone type mobile information terminal 700, and 173b36 is an icon indicating the head-mounted display type mobile information terminal 700. Each app is for the device indicated by the icon.

In FIG. 19C, when the application cannot be used, a mark indicating that the application cannot be used (in this case, a diagonal line mark in a circle) is displayed overlaid on the pattern of the device. Further, regarding the broadcast receiving device 100, if the application is already running, a mark indicating that fact (in this case, a dot in a circle) may be superimposed and displayed. With this display, it is possible to prevent a useless operation of advancing the launcher procedure even though it has already been executed. In the case of the mobile information terminal 700, it is also possible to display a mark indicating that the application is being executed on all terminals that are in a state of being able to communicate with the broadcast receiving device and that the application can be executed.

FIG. 19D is a screen (173b41) after selecting the application C (173b34) in FIG. 19C. The state of the mobile information terminal 700 of the type corresponding to the application C is shown. On this screen, if the mobile information terminal 700 does not have the execution function of the broadcast cooperation application, if it is not in a state where it can communicate with the broadcast reception device 100, or if the broadcast cooperation application is already being executed, that is indicated. The mark to be represented is displayed on top of the icon. In this example, a circle with diagonal lines (173b44, 173b46) if it does not have an execution function, a triangle with an exclamation mark (173b45, 173b46) if it is not in a communicable state, and a circle with a dot if it is already running. Mark (173b43) is displayed.

Furthermore, it is desirable to have a display method that shows that there is a broadcast cooperation application when the situation changes without starting the launcher one by one. For example, when the power is turned on, when the channel is changed, when the broadcast cooperation application is changed at the beginning of the program or in the middle of the program, there is a change in the communication state between the broadcast receiving device 100 and the mobile information terminal 700. In that case, when the execution status of the application changes, the icon is displayed for a predetermined time and the state at that time is displayed.

FIG. 19E shows an example in that case. If an icon indicating the type of each device is displayed, it indicates that there is a broadcasting cooperation application corresponding to the device of that type. In this case, the diagonal slash mark in the circle indicates that no device of that type is available to run the app. A dot mark in the circle indicates that the app is running on all devices of that type that are available.

FIG. 19F is a display screen (10401) on the mobile information terminal 700. When requesting terminal cooperation from the mobile information terminal 700, it is convenient to know from a list which broadcast cooperation application can be used with which broadcast receiving device 100. An example of the list is shown in FIG. 19F (10402). This table shows which broadcast receiving device 100 in the home can use the broadcast cooperation application corresponding to the program to be examined. Further, if the status of each broadcast receiving device 100 is also displayed, the convenience is further enhanced especially when the broadcast receiving device 100 is used from outside the house. In this example, a display example such as receiving the program, receiving another program, vacant, and having a reservation for another program (when recording of another program is reserved from the middle of the program) is shown. Here, when a plurality of tuners are present in the broadcast receiving device 100, it is more convenient if the status is displayed for each of the plurality of tuners. In Table 10202, the branch numbers indicate the distinction between tuners in the same device. For example, the receiving device B-1 and the receiving device B-2 are tuners in the same broadcast receiving device 100. In the case of terminal cooperation, if the broadcast video and audio can be delivered as streaming data, it is not necessary to use the video unit of the broadcast receiver 100, and if the tuner in the broadcast receiver 100 can be used, the broadcast can be used. Therefore, it is convenient to know the usage status of each tuner.

In addition, in order to perform the display described in this embodiment, information on whether the application is compatible with the broadcast receiving device 100 or what type of mobile information terminal 700 is supported for each broadcast cooperation application. Must be. Further, the broadcast receiving device 100 and the mobile information terminal 700 need information for executing the corresponding application. This information can be acquired by the broadcast receiving device 100 by describing it in AIT, for example.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to use a more convenient broadcast cooperation service by displaying information on the broadcast cooperation application, the broadcast receiving device 100, and the mobile information terminal 700. It becomes.

Hereinafter, in the sixth to tenth embodiments, the broadcast receiving device 100 will be referred to as an information display device.

First, Example 6 will be described with reference to FIGS. 2C, 2D, and 20 to 24. The configuration and effects of Example 6 shall be the same as those of Example 1 unless otherwise specified. Therefore, in the following, the differences between the sixth embodiment and the first embodiment will be mainly described, and the common points will be omitted as much as possible.

In the first to fifth embodiments, one broadcast program is displayed on the broadcast receiver 100. On the other hand, there are a plurality of broadcast programs displayed on the information display device of the sixth embodiment.

[Hardware configuration of information display device]
FIG. 2C is a block diagram of the information display device 1000 according to the sixth embodiment. As shown in FIG. 2C, the information display device 1000 includes a video display unit 173, a video output unit 175, an audio reproduction unit 174b, an audio output unit 176, and a viewer instruction input unit 25001 (described later, FIG. 2D). , A content input unit 25002, a content reproduction unit 25003, a content recording / reproduction unit 25004, and a control unit 25005.

Instruction information received by the device (for example, a remote controller (described later, FIG. 22A)) from the viewer is input to the viewer instruction input unit 25001.

The content input unit 25002 acquires content (for example, broadcast content, content on the Internet, recorded content). Specifically, the content input unit 25002 externally outputs the tuner / demodulation unit 131 (described above, FIG. 2A) for receiving the broadcast content, the LAN communication unit 121 (described above, FIG. 2A) for acquiring the content on the Internet, and the recorded content. The extended interface unit 124 (above, FIG. 2A) or the digital interface unit 125 (above, FIG. 2A) when inputting from the content reproduction device or the like.

The content reproduction unit 25003 reproduces the recorded content. Specifically, the content reproduction unit 25003 is a storage unit 110 (described above, FIG. 2A). Specifically, the storage unit 110 is a drive or the like for a recording medium of an optical disc.

The content recording / playback unit 25004 records / reproduces the content (recording / reading in the case of content on the Internet). Specifically, the content recording / playback unit 25004 is a storage unit 110 (above, FIG. 2A), a RAM 104 (above, FIG. 2A), and the like.

The control unit 25005 is a set of control unit groups including the main control unit 101 (above, FIG. 2A).

The control unit 25005 is for displaying a main window in which the main content, which is the main image of the broadcast program, is displayed, and a sub-window for displaying the sub-content included in the execution screen of the broadcast cooperation application linked with the broadcast program. The video information is output to the video output unit 175. The video output unit 175 outputs the video information output from the control unit 25005 to an external display device (display or the like).

Further, the control unit 25005 causes the video display unit 173 to display the main window and the sub window. Information associated with the main video of the broadcast program (for example, weather forecast, response from the viewer of the broadcast program, profile of the performer of the broadcast program, etc.) is displayed on the execution screen of the broadcast cooperation application. NS. For example, when the broadcast program is a marathon broadcast, a video from the relay (for example, a video of a player running near the head) is displayed in the main window, and a position away from the head is displayed in the sub window. The video of the player is displayed.

Further, the control unit 25005 controls the display of the window group displayed on the video display unit 173. Further, the control unit 25005 controls the audio reproduction unit 174b and the audio output unit 176.

The sound reproduction unit 174b reproduces the sound. Specifically, the audio reproduction unit 174b is a speaker 174 (above, FIG. 2A). The audio reproduction unit 174b also includes earphones.

The voice output unit 176 outputs voice information. For example, the voice output unit 176 outputs voice information (voice signal) to an external output device (speaker or the like). In the following description, in order to distinguish from the case where the audio information (audio signal) is output from the audio output unit 176, the case where the audio is output from the audio reproduction unit 174b is referred to as audio reproduction.

The video display unit 173 includes the window shape designation information and the window context designation information included in the window-related designation information (the window-related designation information is a general term for the window-related designation information such as the window shape designation information and the window context designation information). Display the main window based on the specified information. Further, the window shape designation information may be included in the broadcast signal (for example, AIT). Further, it may be included in the window shape designation information whether a part or all of the window-related designation information can be changed by the viewer's selection. Further, in the case of recorded content, the video display unit 173 may display the main window based on the window shape designation information stored in advance as the information related to the content group. Further, in the case of content on the Internet, the video display unit 173 may display the main window based on the window shape designation information distributed together with the content as information related to the content group. Further, since it is desirable to adjust the size of the window, that is, the size of the image display area, according to the size of the information display device 1000 and the number of pixels, the window-related designated information is set to the size of the information display device 1000 and the number of pixels. It may be a plurality of designated information according to the situation.

The video display unit 173 displays a main window for displaying the main video of the broadcast program and a sub-window for displaying the execution screen of the broadcast cooperation application linked with the broadcast program.

Further, the video display unit 173 displays a recorded program or content on the Internet in addition to the broadcast program received from the broadcast wave. Hereinafter, broadcast contents received from broadcast waves, contents on the Internet, recorded contents, and the like may be collectively referred to as contents.

The video output unit 175 provides video information for displaying a main window for displaying the main video of the broadcast program and a sub-window for displaying the execution screen of the broadcast cooperation application linked with the broadcast program to an external display device. Output.

Further, the video output unit 175 outputs video information for displaying a recorded program or content on the Internet to an external display device in addition to the broadcast program received from the broadcast wave.
[Viewer instruction input section]

FIG. 2D is a diagram showing an example of the viewer instruction input unit 25001 of the information display device according to the embodiment. Instruction information that the device has received input from the viewer is input to the viewer instruction input unit 25001.

Specifically, the device that accepts the input of instruction information from the viewer is a remote controller 25102, a mouse 25104, a touch pad 25106, a keyboard 25108, a personal digital assistant 25110, a touch panel 25111, and the like.

When these input devices (remote control 25102, mouse 25104, touch pad 25106, keyboard 25108, personal digital assistant 25110, touch panel 25111) are integrated with the information display device 1000, the input device itself is the viewer instruction input unit 25001. It becomes. On the other hand, when these input devices are not integrated with the information display device 1000 and are connected to the information display device 1000 via wireless or wired, the input ports 25101, 25103, 25105, 25107, 25109 may be used. It becomes the viewer instruction input unit 25001. When the mobile information terminal 25110 is used as an input device to connect to the information display device via LAN, the LAN communication unit 121 (above, FIG. 2A) becomes the viewer instruction input unit 25001.

The keyboard 25108 (including the case where a personal digital assistant is used as a character input means) launches an Internet browser and accepts character input to the browser when searching for a group of contents on the Internet.

The mobile information terminal 25110 and the touch panel 25111 detect a touch operation on the screen display area and execute a process corresponding to the position where the touch operation is received.

[Screen display of information display device]
Hereinafter, an example of a screen when the video display unit 173 displays two broadcast programs will be described with reference to FIG. 20A.

FIG. 20A shows a first main window 20000 corresponding to the broadcast signal 1, a first subwindow 20001 corresponding to the broadcast signal 1, a second main window 20002 corresponding to the broadcast signal 2, and a second main window 20002 corresponding to the broadcast signal 2. The state in which the image display unit 173 displays the two subwindows 20003 is shown. Here, the main images of the broadcast program are displayed in the first main window 20000 and the second main window 20002, which are the main windows shown in FIG. 20A. On the other hand, in the first sub-window 20001 and the second sub-window 20003, which are sub-windows, the execution screen of the broadcast cooperation application linked with the broadcast program is displayed.

Hereinafter, the content included in the main window such as the first main window 20000 or the second main window 20002 displayed by the video display unit 173 may be referred to as the main content. Further, the contents included in the sub-windows such as the first sub-window 20001 and the second sub-window 20003 may be referred to as sub-contents.

Further, a set of contents including a main content and a sub-content related to the main content may be referred to as a content group. It should be noted that there may be cases where there is only main content, but here, such cases are also referred to as a content group. Therefore, the content group described below includes a main content and a set of contents including sub-contents related to the main content or a single main content having no related sub-content.

Further, as a specific example, the content group includes the main video of the above-mentioned broadcast program (including the broadcast program received from the terrestrial wave and the recorded program) and the execution screen of the broadcast cooperation application linked with the broadcast program. It consists of. Further, as another specific example, the content group includes content on the Internet (for example, a WEB page) and a streaming video included in the content (for example, a streaming video included in the WEB page). Further, as another specific example, the content group includes content on the Internet (for example, a WEB page) and other content displayed in a plurality of windows opened by the same application. The sub-window displayed by the video display unit 173 may include a plurality of sub-contents. Further, in the case of VOD (Video On Demand) or a broadcast cooperation application of a recorded program, the application may be deleted from the designated distribution server. In such a case, perform the alternative processing described in the AIT or accompanying information (for example, connect to the alternative connection URL), or if there is no provision for the alternative processing, display that fact in the sub window and do not start the application. May be.

The video output unit 175 outputs video information for displaying the video of a plurality of content groups in different windows for each content group to an external display device.

The image display unit 173 displays images of a plurality of content groups in different windows for each content group.

The viewer instruction input unit 25001 accepts an input for setting a content group to be selected from a plurality of content groups.

In each content group displayed by the video display unit 173 at the same time (or output by the video output unit 175), only one content group is set as the selected state, and all the other content groups are set as the non-selected state. Then, the voice output unit 176 outputs the voice information of the voice corresponding to the content group in the selected state. In addition, the audio reproduction unit 174b reproduces the audio corresponding to the selected content group. This makes it possible to prevent the audio of a plurality of content groups from being mixed.

When the input for switching the content group in the selected state is accepted, the content group after the switching is set as the setting state, and the content group that has been selected so far is set as the non-selected state. Then, the audio reproduction unit 174b / audio output unit 176 stops the reproduction / output of the audio that has been reproduced so far, and reproduces / outputs the audio of the content group that is newly set.

Specifically, a pointing device such as a mouse 25104 or a touch pad 25106 (including the case where the mobile information terminal 25110 is used as a pointing device) moves the cursor 20004 to a window for displaying the content group to be selected and clicks. By accepting the input to be (for example, double-clicking), the input to switch to the selected content group is accepted. Further, in the case of the touch panel 25111, the touch panel 25111 accepts an input for switching to the content group to be selected by double tapping.

In the case shown in FIG. 20A, the content group displayed in the first main window 20000 and the first sub window 20001 is in the selected state, and the content group displayed in the second main window and the second sub window 20003 is not selected. It is in a state. Then, the audio reproduction unit 174b / audio output unit 176 reproduces / outputs the audio of the content group of the broadcast signal 1 corresponding to the first main window 20000 in the selected state.

The audio reproduced / output by the audio reproduction unit 174b / audio output unit 176 may be the audio of the main content or the audio of the sub-content. Further, when a plurality of sounds are included in the same content group, the sound reproduction unit 174b / audio output unit 176 may select one of them to reproduce / output.

Further, in the case of VOD (Video On Demand), the menu list may be displayed in the main windows 20000 and 20002, and the video may be displayed in the sub windows 20001 and 20003.

Further, the shape, size, and position of the window may be freely changed based on the input received from the viewer. Specifically, the shape, size, and position of the window are determined based on the input received by the touch panel 25111 (for example, the input for moving the position of the window by dragging or the input for changing the size of the window by pinching in or pinching out). change. Further, the shape, size, and position of the window are changed based on the input received by the pointing device such as the mouse 25104 or the touch pad 25106 (for example, the input by the drag operation).

The video display unit displays a window in which the selected content group is displayed and a window in which the non-selected content group is displayed in different modes. For example, the video display unit 173 displays the border of the window in which the contents of the same content group are displayed in the same mode (for example, displayed in the same color). Further, the video display unit 173 displays the border of the window displaying the selected content group and the border of the window displaying the non-selected content group in different modes. This makes it easier to identify windows that belong to the same content group.

In the example of FIG. 20A, it is shown that the content group displayed in the first main window 20000 and the first sub window 20001 is in the selected state. That is, the borders of the first main window 20000 and the first subwindow 20001 are displayed as thick lines, while the borders of the second main window and the second subwindow 20003 are displayed as broken lines. The color of the border of the window displaying the selected content group and the color of the border of the window displaying the non-selected content group may be displayed in different colors. Specifically, the display color in the window displaying the non-selected content group may be displayed in a lighter color than the display color in the window displaying the selected content group.

Further, the video display unit 173 displays the main window and the sub window in different modes. For example, as shown in FIG. 20A, the video display unit 173 displays the marks 2006, 20007 on the main window. As shown in FIG. 23A, the window attribute display unit 20310 may display the main window and the sub-window separately.

Here, when the windows are in overlapping positions, the context of which window is displayed in front of the other windows becomes a problem. Next, a case where the window for displaying the selected content group and the window for displaying the non-selected content group overlap each other will be described with reference to FIG. 20B.

As shown in FIG. 20B, the window for displaying the selected content group is displayed superimposed on the window for displaying the non-selected content group. That is, the first main window 20000 and the first sub-window 20001 displaying the selected contents are displayed superimposed on the second main window and the second sub-window 20003.

The broadcast signal (for example, AIT) may include window context specification information that specifies the context between related windows.

Further, it may be included in the window context designation information whether a part or all of the window-related designation information can be changed by the viewer's selection.

Further, in the case of recorded content, the video display unit 173 may display the main window based on the window context designation information stored in advance as information related to the content group.

Further, in the case of content on the Internet, the video display unit 173 may display the main window based on the window context designation information distributed together with the content as information related to the content group.

It is also possible to determine which window is displayed in front of the other window based on the input received from the viewer. Specifically, as shown in FIG. 20C, a pointing device such as a mouse 25104 or a touch pad 25106 moves the cursor 20004 to the first subwindow 20001 and accepts a single-click input, whereby the image display unit 173 , The first main window 20000 and the first sub window 20001 are superimposed and displayed on the second main window and the second sub window 20003. Further, the touch panel 25111 may accept the operation of single-tapping the window to be displayed on the front surface, so that the window for which the operation is received is displayed on the front surface. It is preferable that the click operation for switching the content group and the click operation for the window display operation are different operations such as single click and double click.

Further, as shown in FIG. 20D, the pointing device such as the mouse 25104 or the touch pad 25106 moves the cursor 20004 to the first sub-window 20001 and displays the confirmation window 20005 after receiving the click input. You may. This makes it possible to prevent the selected content group from switching to an unintended content group.

The remote controller 25102 accepts an input for switching a group of contents to be in the selected state (hereinafter, may be simply switching windows) by operating a button. Hereinafter, the remote controller 25102 will be described in detail with reference to FIG. 22A.

When the content addition button 20213 shown in FIG. 22A accepts the input, the mode is switched to either the switching mode or the addition mode. For example, when the content addition button 20213 receives an input in the switching mode, the mode is switched from the switching mode to the additional mode. On the other hand, when the content addition button 20213 receives the input in the addition mode, the mode is switched from the addition mode to the switching mode.

In the switching mode, the total number of contents displayed by the video display unit 173 does not change. On the other hand, in the additional mode, the total number of content groups displayed by the video display unit 173 increases.

Specifically, when the channel button 20211 receives an input in the switching mode, the content group of the broadcast program corresponding to the channel button 20211 is added. Then, the video display unit 173 deletes the window for displaying the content group that was selected immediately before, and displays a new window for displaying the added content group. Then, the newly added content group is in the selected state, and the audio reproduction unit 174b / audio output unit 176 stops the audio that has been reproduced / output so far, and reproduces / reproduces the audio of the newly added content group. Output.

The video display unit 173 may delete the window displaying the content group having the longest elapsed time from the non-selected state to the present time. Further, the viewer may accept an input for selecting a content group to be stopped displayed.

When the channel button 20211 accepts the input in the add mode, the content group of the broadcast program corresponding to the channel button 20211 is added. Then, the video display unit 173 displays a new window in which the added content group is displayed. Then, the newly added content group is in the selected state, and the audio reproduction unit 174b / audio output unit 176 stops the audio that has been reproduced / output so far, and reproduces / reproduces the audio of the newly added content group. Output.

If the total number of added content groups exceeds the number of tuners, the video display unit 173 deletes the window displaying the content group having the longest elapsed time since the non-selected state. You can do it. Further, the viewer may accept an input for selecting a content group to be stopped displayed.

When the content switching button 20101 shown in FIG. 22A accepts the input, the content group in the tentatively selected state is switched. After that, when the enter button 2022 accepts the input, the content group in the tentative selection state is put into the selection state. Hereinafter, the above processing will be specifically described with reference to FIG. 22B.

FIG. 22B shows an example in which the content group displayed in the second main window 20002 is in the tentative selection state. As shown in FIG. 22B, a temporary selection frame 20204 is displayed around the second main window 20002.

After that, when the enter button 2022 accepts the input, the content group displayed in the second main window 20002 is set as the selected state.

When the back button 2023 accepts the input, the provisional selection state of the content group displayed in the second main window 20002 is released. This makes it possible not to switch the content group even if the tentative selection is made. Further, the window of the content group in the temporarily selected state may be displayed in front of the window of another content group, and the sound may be switched. As a result, the contents of the content group of the switching candidates can be confirmed, and the convenience is improved.

Further, the content group may be set as a tentative selection state or a selection state by accepting an input in which the content switching button 20101, the channel button 20211, and the color button 20212 are combined.

Further, the number corresponding to the channel button 20211 may be displayed in the window displayed by the video display unit 173. In this case, the channel button 20211 accepts the input after the content switching button 20101 accepts the input, so that the window corresponding to the channel button 20211, that is, the content group is set to the tentative selection state or the selection state. Further, as shown in FIG. 23A, the number corresponding to the channel button 20211 may be displayed on the window attribute display unit 20310.

Further, a part of the window (for example, the border of the window) displayed by the image display unit 173 may be displayed in the color corresponding to the color button 20212. In this case, the channel button 20211 accepts the input after the content switching button 20101 accepts the input, so that the window corresponding to the color button 20212, that is, the content group is set to the tentative selection state or the selection state.

Further, as shown in FIG. 22C, the content group may be added by accepting the input on the menu screen displayed by the mobile information terminal 25110. On the menu screen shown in FIG. 22C, each content group is iconified. Then, when the icon 20206 displayed on the mobile information terminal 25110 is selected (for example, a touch operation), the mobile information terminal 25110 accepts an input for adding a content group. In the example shown in FIG. 22C, "channel B" is selected as the content group to be added. The border of the icon 20206 corresponding to "channel B" is displayed in a mode different from that of the other icons 20206 (in the example of FIG. 22C, the border is thickened).

In the above-mentioned example, a process of designating or adding a content group by operating an input device has been described together with an example of a display screen. Hereinafter, the process of adding the content group of the broadcast program by designating from the EPG will be described with reference to FIGS. 22H and 22I.

As shown in FIG. 22H, the border of the broadcast program in the tentative selection state is surrounded by the tentative selection frame 20226.

When the decision button 2022 of the remote controller (above, FIG. 22A) accepts the input, the video display unit 173 displays a new window in which the content group added in place of the EPG 173e is displayed. Then, the content group of the broadcast program in the tentatively selected state is added.

When the content addition button 20213 on the remote controller accepts the input, the content group of the broadcast program in the tentatively selected state is put into the selected state. Further, the border line 20224 of the broadcast program in the selected state is displayed thickly. In this case, EPG173e does not close and continues to accept input for adding the content group of the broadcast program. Then, a new temporary selection frame 20226 for selecting a broadcast program to be in the temporary selection state is displayed.

When the content addition button 20213 accepts the input in the state shown in FIG. 22H, the content group of the broadcast program that was in the tentatively selected state becomes the selected state. Further, as shown in FIG. 22I, the border line 20224 of the broadcast program in the selected state is displayed thickly. Further, the content group of the broadcast program that was in the selected state in FIG. 22H is in the semi-selected state in FIG. 22I. Then, as shown in FIG. 22I, the frame line of the broadcast program in the semi-selected state is displayed thickly, and a diagonal line is displayed in the corner. In this way, when the content addition button 20213 accepts the input, the content group of the broadcast program that has been selected so far becomes the semi-selected state, and the content group of the broadcast program that has been temporarily selected becomes the selected state. Therefore, every time the content addition button 20213 accepts the input, the content group in the semi-selected state is added.

When the enter button 2022 of the remote controller accepts the input in the state shown in FIG. 22I, the content group of the broadcast program in the semi-selected state and the content group of the broadcast program in the selected state are added. NS. Then, the video display unit 173 displays two windows in which each added content group is displayed. In this case, the audio reproduction unit 174b / audio output unit 176 reproduces / outputs the audio of the content group of the broadcast program selected in the EPG173e. That is, the audio reproduction unit 174b / audio output unit 176 does not reproduce / output the audio of the content group of the broadcast program that was in the semi-selected state in the EPG173e. The content group of the broadcast program that was in the semi-selected state in EPG173e becomes the content group in the non-selected state when the content group is displayed. If there is a content group that has been selected in the video display unit 173 before the addition of the content group by EPG173e, the content group is not selected.

After selecting the content group for which the selected state or the semi-selected state is released by EPG173e, the content end button 20216 accepts the input, so that the selected state or the semi-selected state of the content group is released. In that case, when the broadcast program whose selection state is released becomes the selection state, the content group in the semi-selection state is changed to the selection state.

The content group added by being specified from EPG173e may be in the semi-selected state. In this case, if there is a content group that has been selected in the video display unit 173 before the addition of the content group by EPG173e, the content group maintains the selected state.

Next, the process of adding the content group by receiving the input by the remote controller (FIG. 22A described above) while the launcher menu (described later, FIG. 22J) is displayed will be described with reference to FIGS. 22A and 22J. do.

When the menu button 20232 of the remote controller receives the input, the video display unit 173 displays the launcher menu 20230 shown in FIG. 22J.

As shown in FIG. 22J, the launcher menu 20230 displays a list of a plurality of menu items 20233 for selecting contents and applications. The application is also selected as one of the contents.

Further, as shown in FIG. 22J, the frame line of the menu item 20233 in the tentative selection state is surrounded by the tentative selection frame 20231. When the arrow button 20214 of the remote controller (above, FIG. 22A) accepts the input, the menu item 20233 surrounded by the temporary selection frame 20231 is switched, and the content group (content or application) in the temporary selection state is switched accordingly.

When the content addition button 20213 on the remote controller accepts the input, the content group (content or application) corresponding to the menu item 20233 in the temporarily selected state is selected. In addition, the border of the selected content group is displayed thickly. In addition, as the new content group becomes selected, the content group that was previously selected becomes semi-selected, and the frame of the content that has become semi-selected is displayed thicker and the corners. A diagonal line is displayed in. After that, when the decision button 2022 of the remote controller receives the input, the audio output unit 176 displays a window in which each added content group is displayed instead of the launcher menu 20230. In this case, the content group in the semi-selected state in the launcher menu 20230 and the content group in the selected state are added as new content groups. Then, the audio output unit 176 outputs the audio of the content group selected in the launcher menu 20230. That is, the audio of the content group that has been in the semi-selected state is not output. The content group in the semi-selected state in the launcher menu 20230 becomes the content group in the non-selected state when the content group is displayed.

Specifically, in FIG. 22J, "App 3" is tentatively selected. In this state, when the content addition button 20213 accepts the input, the tentative selection state "App 3" is in the selection state. Further, the "content 3" which has been selected so far is changed to the semi-selected state, the frame line of the "content 3" is displayed thickly, and a diagonal line is displayed in the corner. After that, when the enter button 2022 of the remote controller accepts the input, the semi-selected "content 1", "content 3", and "app 2" and the content group of the selected "app 3" are displayed. Is added as a new content group. Then, the video display unit 173 displays a main window for displaying the added "content 1", "content 2", "app 2", and "app 3". In this case, the audio output unit 176 outputs the audio of the "application 3" that has been selected in the launcher menu 20230. That is, the sounds of "content 1", "content 2", and "app 2" that have been in the semi-selected state are not output. If the added application is an application that does not require display on the video display unit 173, it is only started. Further, the "content" in the launcher menu 20230 may be the main content, and the "app" may be a sub-content corresponding to the "content".

After selecting the content group to be released from the selected state or the half-selected state in the launcher menu 20230, the content end button 20216 accepts the input, so that the selected state or the half-selected state of the content group is canceled.

Next, a process of adding a content group by designating from a launcher menu with a pointing device such as a mouse 25104 or a touch pad 25106 or a touch panel 25111 will be described with reference to FIGS. 22J and 22K.

When the launcher icon 20240 shown in FIG. 22K receives an input clicked (in the case of the touch pad 25106, a touch operation), the screen is switched to the screen of FIG. 22J and the launcher menu 20230 is displayed.

When the non-selected menu item 20233 receives a click input (in the case of the touch pad 25106, a touch operation), the corresponding content group is selected. In addition, the content group that has been selected so far becomes a semi-selected state.

Further, when the selected menu item 20233 receives a click input (in the case of the touch pad 25106, a touch operation), the corresponding content group is in the semi-selected state, and the semi-selected menu item 20233 is the click input. When (in the case of the touch pad 25106, a touch operation) is accepted, the corresponding content group is in the non-selected state.

When the decision button 2022 of the remote controller receives the input, the video display unit 173 displays a window in which each added content group is displayed instead of the launcher menu 20230. In this case, the content group in the semi-selected state in the launcher menu 20230 and the content group in the selected state are added as new content groups. In this case, the audio reproduction unit 174b / audio output unit 176 reproduces / outputs the audio of the content group of the broadcast program that has been selected. The content group in the semi-selected state in the launcher menu 20230 becomes the content group in the non-selected state when displaying.

After the information display device 1000 is turned on, the launcher menu 20230 may be displayed as a screen to be displayed as the initial screen by the video display unit 173. Further, after the launcher menu 20230 is displayed, the frequently selected contents or applications may be pre-selected according to the viewer's preference.

As shown in FIG. 22D, the information display device 1000 may display only the content on the Internet without displaying the broadcast program.

Further, not only the main window but also the sub-window may be selected so that the related content group can be selected.

[Operation sequence of information display device]
21A to 21D show operation sequence diagrams of the information display device 1000 according to the sixth embodiment. A process of further adding a content group of another broadcast program will be described with reference to FIG. 21A in a state where only the content group of the broadcast program is displayed.

First, after the power of the information display device 1000 is turned on, the main content in the selected state is displayed in the main window from the programs that were being watched when the power was momentarily cut off last time. Here, when the channel button 20211 of the remote controller (described above, FIG. 22A) accepts the input and a different broadcast channel is selected, the displayed content group is switched to the content group corresponding to the selected broadcast channel. When the power of the information display device 1000 is turned on, only the window in which the content is not displayed is displayed, and then the channel button 20211 of the remote controller accepts the input to display the image of the selected channel in the window. You may.

Hereinafter, the description will be made on the premise that the program of the first broadcast signal (hereinafter, may be referred to as broadcast signal 1) is selected as the main content.

First, the information display device 1000 acquires the PMT data string (S20101).

Next, the information display device 1000 acquires the AIT data string (S20102).

Next, the information display device 1000 confirms window-related designation information (window-related designation information is a general term for window-related designation information such as the above-mentioned window shape designation information and window context designation information) (S20103). ..

Next, the information display device 1000 displays the first main window 20000 (main window 1 in the figure) corresponding to the broadcast signal 1 based on the window shape designation information and the window context designation information included in the window-related designation information. (S20104).

After displaying the first main window 20000, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20107).

As a result, the broadcast cooperation application is executed, and the execution screen of the broadcast cooperation screen is displayed in the first sub window 20001 (sub window 1 in the figure) corresponding to the broadcast signal 1 (S20108).

After that, the information display device 1000 accepts an input for adding a new content group. Specifically, the content addition button 20213 accepts the input. After that, when the channel button 20211 corresponding to the second broadcast signal to be added (hereinafter, may be referred to as broadcast signal 2) accepts the input, the content group corresponding to the broadcast signal 2 is added. Further, the content group corresponding to the added broadcast signal 2 becomes the content group in the selected state, and undergoes the same processing (S20109 to S20111, S20113 to S2015) as when the broadcast signal 1 is selected, and then becomes the broadcast signal 2. The corresponding second main window 20002 (main window 2 in the figure) and the second sub window 20003 (sub window 2 in the figure) are displayed (S20112, S2016), and the audio is switched to the audio of the content group of the broadcast signal 2. .. Even after the second main window 20002 and the second sub-window 20003 are displayed, the displayed state of the first main window 20000 and the first sub-window 20001 is maintained.

When an input (for example, double-click) selected by either the first main window 20000 or the first sub-window 20001 is received, the selected content group is switched to the content group corresponding to the broadcast signal 1, and the audio is output. It switches to the audio of the content group of the broadcast signal 1.

Here, the number of tuners included in the information display device 1000 is limited. The information display device 1000 closes the window of the last selected content group when the number of tuners becomes insufficient due to the addition of the content group. When the last selected content group is broadcast on the Internet by streaming, the information display device 1000 may switch to streaming broadcasting instead of closing the window.

Further, when the recording is completed and the tuner receiving the broadcast signal is released, the information display device 1000 may display the closed window again. Further, when the recording is completed and the tuner receiving the broadcast signal is released, the information display device 1000 may restore the display switched to the streaming broadcast.

Further, the information display device 1000 may accept an input for selecting a closing window from the viewer.

Next, the process of further adding the content group distributed via the Internet while only the content group of the broadcast program is displayed will be described with reference to FIG. 21B, mainly different from FIG. 21A.

The information display device 1000 confirms window-related designation information (window-related designation information is a general term for window-related designation information such as the above-mentioned window shape designation information and window context designation information) (S20103).

Next, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 based on the window shape designation information and the window context designation information included in the window-related designation information (S20104).

After displaying the first main window 20000, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20107). Then, the execution screen of the broadcast cooperation screen is displayed in the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).

The information display device 1000 accepts the input of information (for example, a URL or a search keyword) for specifying the content for which the distribution request is made, and then requests the distribution of the content specified from the input-accepted information (S2017).

Hereinafter, the process of accepting the input of information for specifying the content for which distribution is requested by using the remote controller (FIG. 22A described above) will be described in detail with reference to FIGS. 22A, 22D, and 22E.

First, when the content addition button 20213 of the remote controller accepts the input and then the input switching button accepts the input, the image display unit 173 of the information display device 1000 displays the screen shown in FIG. 22D.

The input switching menu 20220 is displayed on the screen shown in FIG. 22D. Further, in the input switching menu 20220, each category of contents (TV broadcasting, recorder, external input 1, external input 2, Internet, etc.) is displayed. On the screen shown in FIG. 22D, "Internet" is tentatively selected as a category, and the frame of the tentatively selected "Internet" is displayed with a thick line.

Further, as shown in FIG. 22D, when the input switching menu 20220 is displayed and the arrow button 20214 of the remote controller accepts the input, the temporarily selected category is switched from "Internet" to another category. .. In addition, the temporarily selected category is switched, the thick line displayed in the "Internet" frame disappears, and the frame of the category after switching is displayed as a thick line.

For example, when the arrow button 20214 with an upward arrow accepts input, the temporarily selected category is switched to "external input 2" located above the currently temporarily selected "Internet". After that, when the arrow button 20214 with the downward arrow accepts the input, the category temporarily selected is switched to the "Internet" located under the currently temporarily selected "external input 2".

When the decision button 2022 of the remote controller accepts the input, the tentatively selected category is determined as the category of the newly added content.

Here, when the enter button 2022 accepts the input while the "Internet" is temporarily selected, the screen shown in FIG. 22E is displayed on the video display unit 173 of the information display device 1000.

On the screen shown in FIG. 22E, a designation window 20221 for accepting input for designating newly added content on the Internet is displayed. By inputting a URL or a search keyword (Search in FIG. 22E) in the text box included in the designation window 20221, the content to be newly added is specified. In the screen shown in FIG. 22E, the URL is selected as the input target, and the frame of the text box in which the URL is input is displayed with a thick line. When the arrow button 20214 of the remote controller accepts the input while the designated window 20221 is displayed, the input target is switched from the URL to the search keyword. Further, as the input target is switched, the thick line displayed in the frame of the text box in which the URL is input disappears, and the frame of the text box in which the search keyword is input is displayed as a thick line.

The channel button 20211 on the remote controller also functions as a character input button. Then, when the channel button 20211 accepts the input, the character is input to the text box to be input, and the URL or the search keyword is input by this. For example, when the enter button 2022 accepts the input after the URL is input in the text box, the information display device 1000 requests the distribution of the content specified from the URL. The content addition button 20213 first enters the input switching operation without accepting the input, and finally the enter button 2022 accepts the input to switch the content, and the content addition button 20213 accepts the input to input the content. You may add it.

See FIG. 21B again. Next, the content requested for distribution in S2017 is distributed to the information display device 1000 (S2018).

Next, the information display device 1000 confirms the window-related designation information if there is window-related designation information (general term for window-related designation information such as the above-mentioned window shape designation information and window context designation information). (S2019). Then, the information display device 1000 displays the third main window (main window 3 in the figure) corresponding to the broadcast signal 3 based on the window shape designation information and the window context designation information included in the confirmed window-related designation information. (S20120).

If the delivered content includes related content, the information display device 1000 requests the related content to be delivered (S20121). Then, the related content requested for distribution in S20121 is distributed to the information display device 1000 (S20122). Then, the information display device 1000 displays the third sub-window (sub-window 3 in the figure). The information display device 1000 requests distribution of related contents by the launcher shown in the main window.

Here, when the third main window is displayed, the audio that has been reproduced so far is switched to the audio of the distributed content. Even after the audio is switched, the display of the first main window 20000 and the first sub window 20001 remains. Therefore, a window for displaying the contents of the broadcast program (first main window 20000 and the first sub-window 20001) and a window for displaying the contents on the Internet (third main window and the third sub-window) are displayed. Become in a state. In this state, when either the first main window 20000 or the first sub window 20001 is double-clicked, the selected content group is switched from the distributed content to the content group of the broadcast program. Then, the reproduced audio is switched from the audio of the distributed content to the audio of the broadcast program. After that, when the third main window or the third sub-window is double-clicked, the selected content group is switched from the content group of the broadcast program to the content group corresponding to the distributed content. Then, the reproduced audio is switched from the audio of the broadcast program to the audio of the distributed content.

In the above example, after the content on the Internet is distributed, the audio of the broadcast program is switched to the audio of the distributed content, but some of the distributed content does not require audio. be. When the delivered content does not require audio, the delivered content may be displayed without audio without switching the audio from the selected content group selected immediately before. In this case, for example, as shown in FIG. 22F, after the content is delivered, a button 20222 that accepts an input for selecting whether to switch the audio to the delivered content or not may be displayed. Furthermore, when the button 20222 accepts an input to select not to switch the audio, the delivered content is set as the non-selected content group, and the content group in which the audio is continuously played is left as the selected content group. You can do it.

Next, the process of further adding the content group of the recorded program while only the content group of the broadcast program is displayed will be described mainly with reference to FIGS. 21C and 22D, different from FIG. 21A.

The information display device 1000 confirms window-related designation information (window-related designation information is a general term for window-related designation information such as the above-mentioned window shape designation information and window context designation information) (S20103).

Next, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 based on the window shape designation information and the window context designation information included in the window-related designation information (S20104).

After displaying the first main window 20000, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20107). Then, the execution screen of the broadcast cooperation screen is displayed in the first sub-window 20001 corresponding to the broadcast signal 1 (S20108).

With the first main window 20000 and the first sub-window displayed, the information display device 1000 requests playback of the recorded content (S20124).

Next, the information display device 1000 receives the reproduction signal (content reproduction in the figure) of the recorded content requested to be reproduced in S20124 (S20125).

Next, the information display device 1000 confirms the window-related designation information if there is window-related designation information (general term for window-related designation information such as the above-mentioned window shape designation information and window context designation information). (S20126).

Next, the information display device 1000 displays the fourth main window (main window 4 in the figure) based on the window shape designation information and the window context designation information included in the confirmed window-related designation information (S10127).

Next, if the delivered content includes related content, the information display device 1000 requests playback of the related content (S20128). Hereinafter, the process of accepting the input of information for requesting the reproduction of the recorded content by using the remote controller (FIG. 22A described above) will be described in detail with reference to FIGS. 22D and 22G.

First, when the content addition button 20213 of the remote controller accepts the input and then the input switching button accepts the input, the image display unit 173 of the information display device 1000 displays the screen shown in FIG. 22D.

Here, when the enter button 2022 accepts the input while the "recorder" is temporarily selected, the image display unit 173 of the information display device 1000 displays the screen shown in FIG. 22G.

On the screen shown in FIG. 22G, a recorded content list 20223 that accepts an input for selecting a newly added (playback request) recorded content is displayed. In the recorded content list 20223, the names of the recorded contents are displayed in a list. In FIG. 22G, "football 1" is tentatively selected as the recorded content to be reproduced in the recorded content list 20223. In this state, when the enter button 2022 accepts the input, the information display device 1000 makes a playback request for the temporarily selected recorded content, whereby "football 1" is added as a new content group. The content addition button 20213 first enters the input switching operation without accepting the input, and finally the enter button 2022 accepts the input to switch the content, and the content addition button 20213 accepts the input to input the content. You may add it.

See FIG. 21C again. The related content (reproduction of the related content in the figure) requested to be reproduced in S20128 is delivered to the information display device 1000 (S2012). Then, the information display device 1000 displays the fourth sub-window (sub-window 4 in the figure).

Here, when the fourth main window is displayed, the audio that has been reproduced so far is switched to the audio of the recorded content. Even after the audio is switched, the display of the first main window 20000 and the first sub window 20001 remains. Therefore, a window (first main window 20000 and first sub-window 20001) in which the content group of the broadcast program is displayed and a window (fourth main window and fourth sub-window) corresponding to the recorded content are displayed. In this state, when either the first main window 20000 or the first sub window 20001 is double-clicked, the selected content group is switched from the recorded content to the broadcast program content group. Then, the reproduced audio is switched from the audio of the recorded content to the audio of the broadcast program. After that, when the fourth main window or the fourth sub-window is double-clicked, the selected content group is switched from the broadcast program to the content group of the recorded content. Then, the reproduced audio is switched from the audio of the broadcast program to the audio of the recorded content.

The recorded content playback device may be a built-in device or an external device for the information display device. Further, the content related to the recorded content may be content on the Internet. Further, as shown in FIG. 21D, the control of this embodiment can be applied even when the broadcast program is not received.

The difference between the seventh embodiment and the sixth embodiment is that a window frame for accepting an input for designating a new content is displayed after the selection of the provisionally selected content has been completed. In the following, the differences between the sixth and seventh embodiments will be mainly described, and the common points will be omitted as much as possible.

When the content addition button 20213 or the content switching button 20101 of the remote controller (above, FIG. 22A) accepts the input, the selection of the temporarily selected content is completed, and then the content addition button 20213 or the content switching button 20101 further inputs the input. Upon acceptance, the video display unit 173 displays a window frame 20301 that accepts an input for designating the content.

The window frame 20301 shown in FIG. 23A includes a content display area 20302, a content specification frame 20303 that specifies the content to be displayed in the content display area 20302, a function button 20304, a window minimization button 20305, and a window maximization. Button 20306 and window close button 20307 are displayed.

No content is displayed in the content display area 20302 as an initial state. After that, by designating the content in the content designation frame 20303, the designated content is displayed in the content display area 20302. Specifically, by inputting the URL in the content designation frame 20303, the content to be displayed in the content display area 20302 is designated. The content designation frame 20303 accepts channel input if the designated content is a broadcast program. Further, the content designation frame 20303 accepts the input of the device name when the designated content is the content stored in the built-in device. Further, the content designation frame 20303 accepts the input of the port name when the designated content is the content input from the input port.

In the content display area 20302, frequently selected content may be displayed as an initial state according to the preference of the viewer. Further, the content that has not been tentatively selected may be displayed. Further, in the case of a broadcast program, the video of the selected channel may be displayed in the window by receiving the input by the channel button 20211 after the content addition button 20213 of the remote controller receives the input.

When the content is not specified in the content designation frame 20303 and the content addition button 20213 or the content switching button 20201 accepts the input, the video display unit 173 displays the display on the screen for selecting the content from the window frame 20301. Switch. Further, when the content end button 20216 of the remote controller receives the input in the state where the content is specified, the video display unit 173 switches the display from the window frame 20301 to the screen for selecting the content. In that case, the content specified in the window frame 20131 is not displayed on the screen for selecting the content.

Functions such as starting a broadcast cooperation application and calling related contents are assigned to the function button 20304. When the function button 20304 to which the function of calling the broadcast cooperation application or the related content is assigned accepts the input, a new window frame 20301 is launched. Then, the sub-content is displayed in the newly launched window frame 20131.

When the window close button 20307 accepts the input, the main window and the main window and the corresponding sub-window are closed. When closing the main window, whether or not to close all related sub-windows may be set for each content.

When the window frame launch icon 20308 shown in FIG. 23B receives a click input (in the case of the touch pad 25106, a touch operation) by the pointing device, the window frame 20301 may be displayed.

Further, the window frame 20301 may be supplied by a broadcast wave as a broadcast cooperation application. It may also be supplied from a server on the Internet. Further, the window frame stored in advance in the information display device 1000 may be used. Further, a plurality of window frames 20301 may be included in the broadcast signal (for example, AIT) with the window frame selection information. Further, in the case of recorded content or content on the Internet, the window frame selection information may be recorded / distributed as information related to the content. This allows the viewer to select the window frame. Further, the window frame selection information may be included in the window-related designation information. Further, since it is desirable to adjust the design of the window frame according to the size and the number of pixels of the information display device 1000, the window frame information can be used as a plurality of designated information according to the size and the number of pixels of the information display device 1000. good.

The difference between the eighth embodiment and the sixth embodiment is that the sub-window of the program that is not selected when the content group selection is switched is hidden. As a result, when displaying a plurality of content groups at the same time, the display becomes easier to see and the convenience can be improved. In the following, the differences between the eighth embodiment and the sixth embodiment will be mainly described, and the common points will be omitted as much as possible.

In the eighth embodiment, the video display unit 173 hides at least a part of the information (for example, a subwindow) of the content group when the content group is switched from the selected state to the non-selected state. In addition, when the content group is switched from the non-selected state to the selected state, the information of the hidden content is redisplayed.

Hereinafter, a process of switching the content group (that is, the broadcast program) will be described with reference to FIG. 24 in a state where only the content group of the broadcast program is displayed. Originally, the flow of display control of the information display device 1000 in FIG. 24 should be expressed on one line, but the flow of display control of the window group related to the broadcast program 1 and the flow of the display control of the window group related to the broadcast program 2 are related. In order to distinguish the flow of display control of the window group, it is shown on two lines.

First, the information display device 1000 receives an input for selecting a program of the broadcast signal 1 (S20401).

Next, the information display device 1000 confirms the window-related designated information included in the broadcast signal 1 (S20402).

Next, the information display device 1000 displays the first main window 20000 (main window 1 in the figure) corresponding to the broadcast signal 1 based on the window shape designation information and the window context designation information included in the window-related designation information. (S20403).

Next, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20404).

Next, the information display device 1000 displays the execution screen of the broadcast cooperation screen in the first sub-window 20001 (sub-window 1 in the figure) corresponding to the broadcast signal 1 (S20405).

Next, the information display device 1000 receives an input for selecting a program of the broadcast signal 2 (S20406).

Next, the information display device 1000 stores the information necessary for displaying the first subwindow 20001 in the storage device (S20407). As a result, the information display device 1000 saves the information necessary for displaying the first subwindow 20001 in the storage device.

Next, the information display device 1000 closes the first subwindow 20001 (S20408). That is, the information display device 1000 erases the displayed first subwindow 20001.

Next, the information display device 1000 confirms the window-related designated information included in the broadcast signal 2 (S20409).

Next, the information display device 1000 displays the second main window 20002 (main window 2 in the figure) corresponding to the broadcast signal 2 based on the window shape designation information and the window context designation information included in the window-related designation information. (S20410).

Next, the information display device 1000 starts the broadcast cooperation application by the automatic start or the start instruction received from the viewer (S20411).

Next, the information display device 1000 displays the execution screen of the broadcast cooperation screen in the second sub-window 20003 (sub-window 2 in the figure) corresponding to the broadcast signal 2 (S20412).

Next, the information display device 1000 receives an input for reselecting the program of the broadcast signal 1 (S20413).

Next, the information display device 1000 stores the information necessary for displaying the second subwindow 20003 in the storage device (S20414). As a result, the information display device 1000 saves the information necessary for displaying the second subwindow 20003 in the storage device.

Next, the information display device 1000 closes the second subwindow 20003 (S20415). That is, the information display device 1000 erases the displayed second subwindow 20003.

Next, the information display device 1000 acquires the information necessary for displaying the first subwindow 20001 stored in S20407 (S20416). That is, the information display device 1000 restores the information saved in S20407.

Next, the information display device 1000 redisplays the execution screen of the broadcast cooperation screen in the first sub-window 20001 corresponding to the broadcast signal 1 based on the information acquired in S20416 (S20417).

When the non-selected content group is selected again after deleting the sub-window of the deselected program, the deleted sub-window may be automatically redisplayed.

Further, information indicating whether or not to hide the sub-window at the time of non-selection may be included in the broadcast signal (for example, AIT) or the accompanying information of the content on the Internet or the recorded content as the window-related designated information.

In addition, information indicating whether or not to redisplay the sub-window that was hidden when the content group is reselected should be included in the broadcast signal (for example, AIT) or the accompanying information of the content or recorded content on the Internet as the window-related designated information. You can do it.

Further, the viewer may accept an input for specifying whether or not to hide the sub window when it is not selected. In this case, the information display device 1000 may store the viewer's preference and perform processing according to the preference.

Further, when the sub-window is redisplayed when the content group is reselected, the information related to the sub-window may be saved as cache data in the information display device 1000.

The difference between the ninth embodiment and the sixth embodiment is that the broadcast cooperation application of the non-selected content group is prohibited from being automatically started. In the following, the differences between the ninth and seventh embodiments will be mainly described, and the common points will be omitted as much as possible.

Some broadcast-linked apps are set to start automatically. Here, when all the broadcasting cooperation applications are automatically started, there is a problem that the number of sub-windows increases and the screen display becomes messy.

In the ninth embodiment, it is prohibited that the broadcast cooperation application of the content group in the non-selected state is automatically started. That is, only the broadcast cooperation application of the selected content group is automatically started. This makes it possible to reduce the number of subwindows displayed at one time and improve the visibility of the screen.

In addition, the broadcast cooperation application of the content group in the non-selected state may be put into the start standby state. In this case, when the content group is selected, the broadcast cooperation application in the start standby state is started.

In addition, whether to prohibit automatic activation when not selected or to enter the activation standby state may be included in the broadcast signal (for example, AIT) or the accompanying information of the content or recorded content on the Internet as window-related designated information.

In addition, the viewer may accept an input for specifying whether to prohibit automatic startup or to enter the startup standby state when not selected. In this case, the information display device 1000 may store the viewer's preference and perform processing according to the preference.

The difference between the tenth embodiment and the sixth embodiment is that a window is displayed on the video display unit 173 of the information display device 1000 and the mobile information terminal 25110 connected to the information display device 1000 by wire or wirelessly. In the following, the differences between the tenth embodiment and the seventh embodiment will be mainly described, and the common points will be omitted as much as possible.

In the tenth embodiment, the video display unit 173 of the information display device 1000 displays the main window, and the mobile information terminal 25110 connected to the information display device 1000 by wire or wirelessly displays the sub window. As a result, when displaying and viewing a plurality of content groups at the same time, the mobile information terminal 25110 can be effectively used, and the convenience can be enhanced.

The main content or sub-content included in the content group that has been deselected by the information display device 1000 may be displayed on the mobile information terminal 25110.

Further, the video display unit 173 of the information display device 1000 may display a plurality of content groups and output the sound of the content group from the earphone of the portable information terminal 25110. Further, the earphone of the portable information terminal 25110 outputs the sound of any one content group displayed on the video display unit 173 of the information display device 1000. As a result, when multiple viewers do not agree on the content group they want to watch, they can play and listen to the audio of the content group they want to watch on the mobile information terminal 25110 at the same time. Viewing becomes possible.

The audio reproduction unit 174b / audio output unit 176 of the information display device 1000 may not reproduce / output audio.

Further, the viewer may accept an input for designating the sub-content to be displayed on the mobile information terminal 25110.

Although the invention made according to the present invention has been specifically described above based on the embodiments, the present invention is not limited to the above embodiments and can be variously modified without departing from the gist thereof. Needless to say.

For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these belong to the category of the present invention. In addition, numerical values and messages appearing in sentences and figures are merely examples, and the effects of the present invention may not be impaired even if different ones are used.

The above-mentioned functions and the like of the present invention may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, it may be realized by software by interpreting and executing an operation program in which the microprocessor unit or the like realizes each function or the like. Hardware and software may be used together.

The software that controls the broadcast receiving device 100 may be stored in the ROM 103 and / or the storage unit 110 of the broadcast receiving device 100 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121. Further, the software stored in the memory card, the optical disk, or the like may be acquired via the expansion interface unit 124 or the like. Similarly, the software that controls the mobile information terminal 700 may be stored in the ROM 703 and / or the storage unit 710 of the mobile information terminal 700 in advance at the time of product shipment. After the product is shipped, it may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722 or the like. Further, the software stored in the memory card, the optical disk, or the like may be acquired via the expansion interface unit 724 or the like.

Further, the present invention can be applied to a device that does not receive a broadcast program as long as it is a device that displays a content group. That is, the information display device 1000 includes all devices of various forms other than the personal computer, the tablet terminal, and the smartphone.

In addition, the control lines and information lines shown in the figure indicate those considered necessary for explanation, and do not necessarily indicate all the control lines and information lines on the product. In practice, it can be considered that almost all configurations are interconnected.

100: Broadcast receiver, 100a: Antenna, 101: Main control unit, 102: System bus, 103: ROM, 104: RAM, 110: Storage unit, 121: LAN communication unit, 124: Expansion interface unit, 125: Digital interface Unit, 131: Tuner / Demodulation unit, 132: First separation unit, 133: First video decoding unit, 134: First audio decoding unit, 135: First subtitle decoding unit, 141: Data broadcast reception processing unit, 142: Data broadcasting engine, 151: Streaming reception processing unit, 152: Second separation unit, 153: Second video decoding unit, 154: Second audio decoding unit, 155: Second subtitle decoding unit, 161: Application control unit, 162: Application engine, 171: Video superimposition unit, 172: Audio selection unit, 173: Video display unit, 174: Speaker, 174b: Audio reproduction unit, 175: Video output unit, 176: Audio output unit, 181: Presentation synchronization control unit, 191 Terminal cooperation control unit,
200: Internet, 210: Router device,
300t: Radio tower, 300: Broadcasting station server, 301: Main control unit, 302: System bus, 304: RAM, 310: Storage unit, 321: LAN communication unit,
400: Service provider server, 401: Main control unit, 402: System bus, 404: RAM, 410: Storage unit, 421: LAN communication unit,
500: Other application server, 600: Mobile telephone communication server, 600b: Base station,
700: Mobile information terminal, 701: Main control unit, 702: System bus, 703: ROM, 704: RAM, 710: Storage unit, 720: Communication processing unit, 721: LAN communication unit, 722: Mobile telephone network communication unit , 723: NFC communication unit, 724: expansion interface unit, 730: operation unit, 740: image processing unit, 741: display unit, 742: image signal processing unit, 743: first image input unit, 744: second image input Unit, 750: Audio processing unit, 751: Audio output unit, 752: Audio signal processing unit, 753: Audio input unit, 760: Sensor unit, 761: GPS receiving unit, 762: Gyro sensor, 763: Geomagnetic sensor, 764: Acceleration sensor, 765: Illumination sensor, 766: Proximity sensor,
1000: Information display device,
20000: 1st main window, 20001: 1st sub-window, 20002: 2nd main window, 20003: 2nd sub-window, 20301: window frame,
25001: Viewer instruction input unit, 25002: Content input unit, 25003: Content playback unit, 25004: Content recording / playback unit, 25005: Control unit, 25102: Remote control, 25104: Mouse, 25106: Touch pad, 25108: Keyboard, 25110 : Mobile information terminal, 25111: Touch panel.

Claims (2)

A broadcast receiving device capable of receiving video information of a broadcast program, program information of a broadcast program, and application-related information related to an application that can be executed in conjunction with the broadcast program via a broadcast wave.
A broadcast receiver that receives the broadcast wave and
A communication unit that can receive data via a network,
A decoding unit that decodes the video information of the broadcast program included in the broadcast wave received by the broadcast reception unit to generate the video of the broadcast program, and the decoding unit.
A program guide generation unit that generates a program guide based on the program information of a broadcast program included in the broadcast wave received by the broadcast reception unit, and a program guide generation unit.
An application acquisition unit that acquires application-related information from a broadcast wave received by the broadcast reception unit and acquires an application from the network based on the location information included in the application-related information.
The application execution unit that executes the acquired application and
Display and
With a control unit
The program guide generation unit acquires program information about a plurality of programs from the broadcast wave received by the broadcast reception unit, and generates a program guide based on the acquired program information.
The application-related information has an application profile that includes information about the execution of the application on the broadcast receiver.
The control unit
The display of the program guide generated by the program guide generation unit, the display of the video of the broadcast program decoded by the decoding unit, or the video acquired via the network and the decoding by the application executed by the application execution unit. The display unit is controlled so as to simultaneously display two images with the image of the broadcast program decoded by the unit.
In the case of the simultaneous display, the size of either the video acquired via the network or the video of the broadcast program is controlled to be changed according to the instruction of the user.
Among the broadcast programs displayed in the program guide displayed on the display unit, for the selected broadcast program, the program attributes including the program name of the broadcast program and the presence / absence of an application linked to the broadcast program are displayed. Control to
The application execution unit determines whether the application can be executed by referring to the application profile possessed by the application-related information, and starts the application if it can be executed.
The application-related information is in section format or XML format.
Broadcast receiver. It is a display method in a broadcast receiving device capable of receiving video information of a broadcast program, program information of the broadcast program, and application-related information related to an application that can be executed in conjunction with the broadcast program via a broadcast wave.
A broadcast reception step for receiving the broadcast wave and
Communication steps that can receive data over the network,
A decoding step that decodes the video information of the broadcast program included in the broadcast wave received in the broadcast reception step to generate the video of the broadcast program, and
A program guide generation step that generates a program guide based on the program information of the broadcast program included in the broadcast wave received in the broadcast reception step, and a program guide generation step.
An application acquisition step of acquiring application-related information from a broadcast wave received in the broadcast reception step and acquiring an application from the network based on location information included in the application-related information.
An application execution step that executes the application acquired in the application acquisition step, and an application execution step.
Control steps to control the display and
Including
In the program guide generation step, program information about a plurality of programs is acquired from the broadcast wave received in the broadcast reception step, and a program guide is generated based on the acquired program information.
The application-related information has an application profile that includes information about the execution of the application on the broadcast receiver.
In the control step,
The display of the program guide generated in the program guide generation step, the display of the video of the broadcast program decoded in the decoding step, or the video acquired via the network and the decoding by the application executed in the application execution step. The display unit is controlled so as to simultaneously display two images with the image of the broadcast program decoded in the step.
In the case of the simultaneous display, the size of either the video acquired via the network or the video of the broadcast program is controlled to be changed according to the instruction of the user.
Among the broadcast programs displayed in the program guide displayed on the display unit, for the selected broadcast program, the program attributes including the program name of the broadcast program and the presence / absence of an application linked to the broadcast program are displayed. Control to
In the application execution step, it is determined whether or not the application can be executed by referring to the application profile possessed by the application-related information.
If it is executable, launch the application and
The application-related information is in section format or XML format.
Display method.

Images