JP2023027379A - Application start method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an application start method capable of executing a function with a higher added value.

SOLUTION: The method includes: an image output unit 175 which outputs image information for displaying images of a plurality of contents in different windows for each content and/or an image display unit 173 which displays the images of the of contents in the different windows for each content; a viewer instruction input unit 25001 which receives an input of selecting a content to be selected, out of the contents; and a voice output unit 176 which outputs voice information of a voice corresponding to the selected content and/or a voice reproduction unit 174b which reproduces the voice corresponding to the selected content.

SELECTED DRAWING: Figure 2C

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an application activation method.

One of the extended functions of digital broadcasting services is data broadcasting that transmits digital data by broadcast waves and displays various information such as weather forecasts, news, and recommended programs. A large number of television receivers capable of receiving data broadcasting are already on the market, and a large number of technologies related to data broadcasting reception, including the following patent document 1, have been published.

Japanese Patent Laid-Open No. 2001-186486

One of the characteristics of data broadcasting is that a television receiver compatible with digital broadcasting services can receive data broadcasting by itself and can acquire/display various information. On the other hand, data broadcasting limits the amount of data that can be transmitted due to radio band limitations, making it difficult to obtain high-definition screen displays and highly functional effects. The problem was that it was difficult to implement in a broadcast receiver.

SUMMARY OF THE INVENTION An object of the present invention is to provide an application activation method capable of executing functions with higher added value.

As means for solving the above problems, the technology described in the claims is used.

As an example, the technology described in claim 1 is used.

By using the technology of the present invention, it is possible to provide an application activation method capable of executing functions with higher added value.

1 is a system configuration diagram of a communication system according to an embodiment; FIG. 1 is a block diagram of a broadcast receiving device according to an embodiment; FIG. 1 is a software configuration diagram of a broadcast receiving device according to an embodiment; FIG. 1 is a block diagram of an information display device according to an embodiment; FIG. FIG. 10 is a diagram showing an example of a viewer instruction input unit of the information display device according to the embodiment; 3 is a block diagram of a broadcasting station server according to an embodiment; FIG. 3 is a block diagram of a service provider server according to an embodiment; FIG. 1 is a block diagram of a mobile information terminal according to an embodiment; FIG. 3 is a software configuration diagram of a portable information terminal according to an embodiment; FIG. 4 is a data configuration diagram of application control information according to the embodiment; FIG. FIG. 5 is an operation sequence diagram of the broadcast receiving apparatus according to the embodiment when an application is started; FIG. 5 is an operation sequence diagram of the broadcast receiving apparatus according to the embodiment when an application is started; FIG. 5 is an operation sequence diagram of the broadcast receiving apparatus according to the embodiment when an application is started; FIG. 10 is an operation sequence diagram when the mobile information terminals according to the embodiment are linked; FIG. 10 is an operation sequence diagram when the mobile information terminals according to the embodiment are linked; FIG. 10 is an operation sequence diagram when the mobile information terminals according to the embodiment are linked; FIG. 10 is an operation sequence diagram of the broadcast receiving apparatus and the portable information terminal according to the embodiment when an application is started; FIG. 10 is a screen display diagram of a basic screen of the cooperative control application of the portable information terminal according to the embodiment; FIG. 10 is a screen display diagram of a basic screen of the cooperative control application of the portable information terminal according to the embodiment; FIG. 4 is a screen display diagram of a data broadcast screen of the broadcast receiving device according to the embodiment; FIG. 10 is a screen display diagram of a notification screen of the broadcast receiving device according to the embodiment; It is a screen display diagram of the broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. It is a screen display diagram of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. FIG. 10 is a screen display diagram of an error display screen of the broadcast receiving device according to the embodiment; FIG. 11 is a screen display diagram of a broadcast-linked application execution screen of the mobile information terminal according to the embodiment; FIG. 4 is a screen display diagram of an EPG display screen of the broadcast receiving device according to the embodiment; FIG. 10 is a diagram of detailed information on an EPG display screen of the broadcast receiving device according to the embodiment; FIG. 10 is an operation sequence diagram of the broadcast receiving device according to the embodiment when acquiring a broadcast cooperation application; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; It is a screen display diagram of the broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. It is a screen display diagram of the broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. It is a screen display diagram of the broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. It is a screen display diagram of the broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. It is a screen display diagram of the broadcast receiving device according to the embodiment. FIG. 10 is a screen display diagram of a broadcast cooperation application launcher of the portable information terminal according to the embodiment; It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. 4 is an operation sequence diagram of the information display device according to the embodiment; FIG. 4 is an operation sequence diagram of the information display device according to the embodiment; FIG. 4 is an operation sequence diagram of the information display device according to the embodiment; FIG. 4 is an operation sequence diagram of the information display device according to the embodiment; FIG. 4 is a button layout diagram of the remote controller according to the embodiment; FIG. It is a screen display figure of the information display device concerning an example. FIG. 4 is a screen display diagram of the portable information terminal according to the embodiment; It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. It is a screen display figure of the information display device concerning an example. FIG. 4 is a diagram of a window frame of the information display device according to the example; It is a screen display figure of the information display device concerning an example. 4 is an operation sequence diagram of the information display device according to the embodiment; FIG.

Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings.

First, an example of a digital broadcast service that can be received by the broadcast receiver of this embodiment will be described.

For example, in an example of BS/terrestrial digital broadcasting that can be received by the broadcast receiver of this embodiment, a plurality of transport streams (TS) can be multiplexed and transmitted in one transponder (frequency channel). TS is a predetermined length obtained by dividing a data string such as video/audio elementary stream (ES) and program specific information (PSI)/service information (Service Information: SI) and adding a TS header. is a series of TS packets.

The PSI is a unique information table for identifying which program each ES included in the TS belongs to, defined by the MPEG (Moving Picture Experts Group)-2 system standard. PSI is composed of PAT (Program Association Table), PMT (Program Map Table), CAT (Conditional Access Table), and the like. The PAT defines a list of programs included in the TS with the PID (Packet Identifier) of the PMT. The PMT defines, for example, the PIDs of the constituent elements of each program. The CAT contains information about conditional access.

In addition, SI is an extension of PSI to include program information, etc., and is an electronic program guide defined by ARIB STD-B10 by the Association of Radio Industries and Businesses (ARIB). EPG). The SI includes a BIT (Broadcaster Information Table), an SDT (Service Description Table), an EIT (Event Information Table), a TOT (Time Offset Table), and the like. The BIT includes broadcasting station identification information, affiliated information, broadcasting station SI transmission information, and the like. The SDT includes information such as a network ID for identifying a network, a TS ID for identifying a TS, and a service ID (so-called channel number) for identifying each service (so-called channel) within the network. The EIT includes service IDs for identifying individual services within the network, and event-related information such as the name of each event (so-called program), broadcast date and time, and broadcast content. The TOT contains information about the current date and time.

In addition, the TS includes PCR (Program Clock Reference) information that serves as a reference for playback timing in the decoder, and BML documents that are subsets based on the BML (Broadcast Markup Language) specifications stipulated by ARIB STD-B24. .

The broadcast receiving apparatus of the present embodiment receives and decodes the TS composed of the video/audio ES and various information, thereby allowing the user to view data broadcast screens produced using broadcast programs, EPG, and BML. can be provided to

In addition, the broadcast receiving apparatus of the present embodiment links digital broadcasting services with functions using a broadband network, acquires additional content via the broadband network, performs arithmetic processing in a server device, and presents processing in cooperation with a mobile terminal device. It is possible to correspond to a broadcasting and communication cooperation system that combines such as digital broadcasting service. In order to realize the broadcast-communication cooperation system, the broadcast receiving apparatus of this embodiment shall be capable of executing an application described in HTML (Hyper Text Markup Language) or the like. In addition, in the broadcast-communication collaboration system that this broadcast receiver supports, the extended PSI/ SI information is used. Note that the AIT is information for providing or disseminating various information necessary for starting an application, such as an application acquisition destination, and control information for controlling the starting/terminating of an application.

The above description is based on the digital broadcasting service in Japan, but it is not limited to application only in Japan, including the broadcast communication cooperation system to which the broadcast receiving apparatus of this embodiment is compatible.

Next, a specific configuration example of the embodiment in this example will be described.

[System configuration]
FIG. 1 is a system configuration diagram showing an example of a communication system according to the present embodiment that realizes a broadcast-communication cooperation system. The communication system of this embodiment includes a broadcast receiving device 100 and an antenna 100a, a broadband network 200 such as the Internet, a router device 210, a broadcasting station radio tower 300t, a broadcasting station server 300, a service provider server 400, and other application servers 500. , a mobile telephone communication server 600, a mobile telephone communication network base station 600b, and a mobile information terminal 700. FIG.

The broadcast receiving apparatus 100 is a television receiver having a function corresponding to the above-mentioned broadcast-communication cooperation system in addition to an existing digital broadcast receiving function. The broadcast receiving apparatus 100 receives broadcast waves transmitted from the radio tower 300t via the antenna 100a. Also, the broadcast receiving apparatus 100 can be connected to the Internet 200 via the router apparatus 210 and can transmit and receive data through communication with each server apparatus on the Internet 200 .

The router device 210 is connected to the Internet 200 by wireless or wired communication, is connected to the broadcast receiving device 100 by wireless or wired communication, and is connected to the portable information terminal 700 by wireless communication. As a result, each server device on the Internet 200 , the broadcast receiving device 100 , and the mobile information terminal 700 can mutually transmit and receive data via the router device 210 . Note that the communication between the broadcast receiving device 100 and the mobile information terminal 700 may be performed directly by a method such as BlueTooth (registered trademark) or NFC (Near Field Communication) without going through the router device 210 .

The radio tower 300t transmits a broadcast wave including a digital broadcast signal, AIT, control information related to application presentation, etc., from the broadcasting facility of the broadcasting station. The control information related to application presentation is control information related to superimposition of a broadcast program and an application on a television receiver and whether or not to present an application. Also, the broadcasting station is assumed to have a broadcasting station server 300 . The broadcasting station server 300 stores broadcast programs (video content, etc.) and metadata such as program titles, program IDs, program summaries, performers, broadcast dates, etc. of each broadcast program, and stores the video content and each metadata, Based on the contract, it shall be possible to provide it to the service provider. The video content and each metadata may be provided to the service provider through an API (Application Programming Interface) of the broadcasting station server 300 .

The service provider server 400 is a server device prepared by the service provider to provide services by the broadcast-communication cooperation system. The service provider server 400 stores, manages, and distributes moving image content and metadata provided by the broadcasting station server 300, and content and applications created for the broadcast-communication cooperation system. It also has a function of searching for applications that can be provided and providing a list in response to an inquiry from a television receiver. Note that the storage, management, and distribution of the content and metadata and the storage, management, and distribution of the application may be performed by different server devices. The broadcasting station and the service provider may be the same or may be different providers. A plurality of service provider servers 400 may be prepared for different services. Also, the functions of the service provider server 400 may be provided by the broadcasting station server 300 .

The other application server 500 is a known server device that stores, manages, and distributes general applications, operating programs, contents, and data other than those related to the broadcast-communication cooperation system.

A mobile phone communication server 600 is connected to the Internet 200, and is connected to a mobile information terminal 700 via a base station 600b. The mobile phone communication server 600 manages telephone communication (call) and data transmission/reception via the mobile phone communication network of the mobile information terminal 700, and transfers data through communication between the mobile information terminal 700 and each server device on the Internet 200. Enables sending and receiving. Communication between mobile information terminal 700 and broadcast receiving apparatus 100 may be performed via base station 600 b , mobile telephone communication server 600 , Internet 200 and router apparatus 210 .

[Hardware Configuration of Broadcast Receiver]
FIG. 2A is a block diagram showing an example of the internal configuration of the broadcast receiving apparatus 100. As shown in FIG. Broadcast receiver 100 includes main control unit 101, system bus 102, ROM 103, RAM 104, storage unit 110, LAN communication unit 121, expansion interface unit 124, digital interface unit 125, tuner/demodulation unit 131, first separation unit 132, First video decoding unit 133, first audio decoding unit 134, first caption decoding unit 135, data broadcasting reception processing unit 141, data broadcasting engine 142, streaming reception processing unit 151, second separation unit 152, second video decoding unit 153, second audio decoding unit 154, second subtitle decoding unit 155, application control unit 161, application engine 162, video superimposition unit 171, audio selection unit 172, video display unit 173, speaker 174, video output unit 175, audio output It is composed of a unit 176 , a presentation synchronization control unit 181 , and a terminal cooperation control unit 191 .

The main control section 101 is a microprocessor unit that controls the entire broadcast receiving apparatus 100 according to a predetermined operation program. A system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operation block in the broadcast receiving apparatus 100 .

A ROM (Read Only Memory) 103 is a memory that stores a basic operation program such as an operating system and other operation programs. For example, a rewritable ROM such as EEPROM (Electrically Erasable Programmable ROM) or flash ROM is used. . A RAM (Random Access Memory) 104 serves as a work area for executing the basic operating program and other operating programs. The ROM 103 and RAM 104 may be configured integrally with the main control unit 101 . Also, the ROM 103 may use a partial storage area in the storage section 110 instead of having an independent configuration as shown in FIG. 2A.

The storage unit 110 stores an operation program and operation setting values of the broadcast receiving device 100, personal information of the user of the broadcast receiving device 100, and the like. Further, it is possible to store an operation program downloaded from a network, various data created by the operation program, and the like. In addition, it is also possible to store content such as moving images, still images, and audio obtained from broadcast waves or downloaded from networks. All or part of the functions of the ROM 103 may be replaced by a partial area of the storage unit 110 . Moreover, the storage unit 110 needs to retain the stored information even when power is not supplied to the broadcast receiving apparatus 100 from the outside. Therefore, for example, devices such as semiconductor element memories such as flash ROMs and SSDs (Solid State Drives), and magnetic disk drives such as HDDs (Hard Disc Drives) are used.

It should be noted that each operation program stored in the ROM 103 and the storage unit 110 can be updated and expanded in function by downloading from each server device on the Internet 200 .

A LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via a router device 210 and transmits and receives data to and from each server device on the Internet 200 . The connection with the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). It is assumed that the LAN communication unit 121 includes an encoding circuit, a decoding circuit, and the like. Also, the broadcast receiving apparatus 100 may further include other communication units such as a BlueTooth (registered trademark) communication unit, an NFC communication unit, an infrared communication unit, and the like.

The tuner/demodulator 131 receives broadcast waves from the radio tower 300t via the antenna 100a, and tunes (selects) to a service channel desired by the user under the control of the main controller 101. FIG. Further, the tuner/demodulator 131 demodulates the received broadcast signal to acquire the TS. Although the example shown in FIG. 2A exemplifies a configuration in which there is one tuner/demodulator, the broadcast receiving apparatus 100 may include a tuner/demodulator for the purpose of simultaneous display of multiple screens, recording of counterprograms, and the like. It is good also as a structure which mounts more than one. Also, based on the control of the main control unit 101, control of access restriction to the demodulated TS, etc. may be performed.

The first separation unit 132 receives the TS output from the tuner/demodulation unit 131, and separates each data such as a video data string, an audio data string, a caption data string, a program information data string, an AIT data string, a BML data string, and the like. Separate the output into columns. These data strings may be in ES format, for example. The first video decoding unit 133 decodes the video data string input from the first separating unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data string input from the first separating unit 132 and outputs audio information. The first caption decoding unit 135 decodes the caption data string input from the first separation unit 132 and outputs caption information.

The data broadcast reception processing unit 141 decodes the BML data string input from the first separation unit 132 and reproduces the BML document. The data broadcasting engine 142 is a BML browser that executes BML documents, executes the BML documents reproduced by the data broadcasting reception processing unit 141, and outputs data broadcasting screen information.

Under the control of the main control unit 101, the streaming reception processing unit 151 accesses the moving image content stored in each server device on the Internet 200 via the LAN communication unit 121, and receives the program stream ( Program Stream: PS). Also, based on the control of the main control unit 101, control of DRM (Digital Rights Management) processing for the acquired PS may be performed.

The second separation unit 152 receives the PS output from the streaming reception processing unit 151, separates it into data strings such as a video data string, an audio data string, a caption data string, and outputs the data strings. These data strings may be in ES format, for example. The second video decoding unit 153, the second audio decoding unit 154, and the second caption decoding unit 155 perform the same processing as the first video decoding unit 133, the first audio decoding unit 134, and the first caption decoding unit 135, respectively. Therefore, the description is omitted.

Note that the first separating unit 132 and the second separating unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, the first caption decoding unit 135 and the second The two-caption decoding unit 155 may be used in common.

Based on the AIT data string input from the first separation unit or the AIT file obtained from each server device on the Internet 200, the application control unit 161 works on the application engine 162 regarding the application created for the broadcasting and communication cooperation system, Control and manage the lifecycle and events of each application. Also, depending on the state of the application and the instructions of the AIT, it appropriately controls the functional restrictions of the application. The application engine 162 is an HTML browser that acquires and executes an application created for the broadcast-communication cooperation system under the control of the application control unit 161 .

The video superimposing unit 171 combines the video information output from the first video decoding unit 133, the subtitle information output from the first subtitle decoding unit 135, the data broadcasting screen information output from the data broadcasting engine 142, and the second video decoding unit. The video information output from 153, the subtitle information output from the second subtitle decoding unit 155, and the application execution screen information output from the application engine 162 are input, and processing such as selection and/or superimposition is performed. The image superimposing unit 171 includes a video RAM (not shown), and the image display unit 173 and the like are driven based on the image information input to the video RAM. In addition, the video superimposing unit 171 superimposes EPG screen information created based on scaling processing and the program information data string output from the first separating unit 132 as necessary based on the control of the main control unit 101. processing, etc.

The audio selection unit 172 receives audio information output from the first audio decoding unit 134, audio information output from the second audio decoding unit 154, and application execution audio information output from the application engine 162, and performs main control. The voice information is appropriately selected and output according to the control of the unit 101 .

The video display unit 173 is a display device such as a liquid crystal panel, for example, and provides the user of the broadcast receiving apparatus 100 with video information selected and/or superimposed by the video superimposing unit 171 . Speaker 174 provides the user of broadcast receiving apparatus 100 with the audio information output from audio selector 172 . The video output unit 175 is a video output interface that outputs video information selected and/or superimposed by the video superimposition unit 171 . The audio output unit 176 is an audio output interface that outputs audio information output from the audio selection unit 172 . As described above, when the broadcast receiving apparatus 100 is a television receiver or the like, the video output section 175 and the audio output section 176 are not essential components of the present invention.

The presentation synchronization control unit 181 combines video information, audio information, etc. obtained by decoding the TS obtained from the broadcast wave, and video information obtained by decoding the PS obtained from each server device on the Internet 200. , audio information, etc., and application execution screen information and application execution audio information output from the application engine 162, on the video display unit 173 and the speaker 174, or on the video output unit 175 and the audio output unit 176. Synchronous control of presentation is performed based on, for example, PCR information.

When cooperating with an external mobile terminal device, the terminal cooperation control unit 191 performs functions such as discovery and authentication of a cooperating device (mobile terminal device), connection between the broadcast receiving apparatus 100 and the cooperating device, application cooperation, and the like. Manage and control.

The extension interface unit 124 is a group of interfaces for extending the functions of the broadcast receiving apparatus 100, and in this embodiment, it is assumed to be composed of an analog video/audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like. do. The analog video/audio interface inputs analog video/audio signals from an external video/audio output device, outputs analog video/audio signals to an external video/audio input device, and the like. The USB interface is connected to a PC or the like to transmit and receive data. Broadcast programs and contents may be recorded by connecting an HDD. Also, a keyboard or other USB devices may be connected. A memory interface connects a memory card or other memory medium to transmit and receive data.

The digital interface unit 125 is an interface that outputs or inputs encoded digital video data and/or digital audio data. The digital interface unit 125 can directly output the TS acquired by the tuner/demodulator 131 and the PS acquired by the streaming reception processing unit 151 . Also, the TS and PS input from the digital interface unit 125 may be controlled to be input to the first separation unit 132 and the second separation unit 152 . Output of digital content stored in the storage unit 110 or storage of digital content in the storage unit 110 may be performed via the digital interface unit 125 . The digital interface unit 125 is a DVI terminal, an HDMI terminal, or the like, and may output or input data in a format conforming to the DVI specification, the HDMI specification, or the like. It may be output or input in the form of serial data conforming to the IEEE1394 specification or the like.

Broadcast receiving apparatus 100 may be a television receiver, an optical disk drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disk drive recorder such as an HDD recorder, a STB (Set Top Box), or the like. A PC (Personal Computer), a tablet terminal, a game machine, or the like having a digital broadcast reception function and a broadcast communication cooperation function may be used. If the broadcast receiving apparatus 100 is a DVD recorder, HDD recorder, STB, or the like, the video display section 173 and speaker 174 may not be provided. By connecting an external monitor and an external speaker to the video output unit 175 and the audio output unit 176, the same operation as that of the broadcast receiving apparatus 100 of this embodiment is possible.

[Software Configuration of Broadcast Receiver]
FIG. 2B is a software configuration diagram of the broadcast receiving apparatus 100 of this embodiment, and shows the software configuration in the ROM 103, RAM 104, and storage unit 110. As shown in FIG. In this embodiment, the ROM 103 stores a basic operating program 1001 and other operating programs, and the storage unit 110 stores a receiving function program 1002, a BML browser program 1003, an HTML browser program 1004 and other operating programs. there is The storage unit 110 also includes a content storage area 1011 that stores content such as moving images, still images, and audio, an authentication information storage area 1012 that stores authentication information used when linking with an external mobile terminal device, and the like. Various information storage areas for storing various other information are provided.

A basic operation program 1001 stored in the ROM 103 is loaded into the RAM 104, and the main control unit 101 executes the loaded basic operation program to configure a basic operation execution unit 1101. FIG. Also, the receiving function program 1002, the BML browser program 1003, and the HTML browser program 1004 stored in the storage unit 110 are expanded in the RAM 104, and the main control unit 101 executes the expanded operation programs to receive the data. A function execution unit 1102, a BML browser engine 1103, and an HTML browser engine 1104 are configured. The RAM 104 is also assumed to have a temporary storage area for temporarily holding data created during execution of each operating program as needed.

In the following description, for the sake of simplicity, the basic operation program 1001 stored in the ROM 103 is loaded into the RAM 104 and executed by the main control unit 101 to control each operation block. It is assumed that the unit 1101 controls each operation block. Similar descriptions are made for other operating programs.

The receiving function executing unit 1102 controls each operation block of the broadcast receiving apparatus 100 in order to realize the broadcast receiving function and the broadcast communication cooperation function. In particular, the broadcast program reproduction unit 1102a includes a tuner/demodulation unit 131, a first separation unit 132, a first video decoding unit 133, a first audio decoding unit 134, a first caption decoding unit 135, a data broadcasting reception processing unit 141, and a data It primarily controls the broadcast engine 142 . Incidentally, the data broadcasting engine 142 may be replaced by the BML browser engine 1103 developed on the RAM 104 . The broadband content reproduction unit 1102 b mainly controls the streaming reception processing unit 151 , the second separation unit 152 , the second video decoding unit 153 , the second audio decoding unit 154 and the second caption decoding unit 155 . The cooperative application control unit 1102 c mainly controls the application control unit 161 and the application engine 162 . Note that the application engine 162 may be replaced by the HTML browser engine 1104 developed on the RAM 104 . The terminal cooperation management unit 1102 d mainly controls the terminal cooperation control unit 191 .

Each operating program may be stored in the ROM 103 and/or the storage unit 110 in advance at the time of product shipment. It may be acquired from other application servers 500 or the like on the Internet 200 via the LAN communication unit 121 after product shipment. Further, each operation program stored in a memory card, an optical disc, or the like may be obtained through the expansion interface section 124 or the like.

[Broadcast station server configuration]
FIG. 3 is a block diagram showing an example of the internal configuration of the broadcasting station server 300. As shown in FIG. The broadcasting station server 300 is composed of a main control section 301 , a system bus 302 , a RAM 304 , a storage section 310 and a LAN communication section 321 .

The main control section 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operation program. A system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operation block in the broadcasting station server 300 . A RAM 304 serves as a work area when each operation program is executed.

The storage unit 310 stores a basic operation program 3001 and a content management/distribution program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. A moving image content storage area 3011 stores moving image content of each broadcast program broadcast by a broadcasting station. The metadata storage area 3012 stores metadata such as the program title, program ID, program outline, performers, broadcast date and time of each broadcast program.

Further, the basic operation program 3001 and the content management/distribution program 3002 stored in the storage unit 310 are developed in the RAM 304, and the main control unit 301 executes the expanded basic operation program and content management/distribution program. Thus, a basic operation execution unit 3101 and a content management/distribution execution unit 3102 are configured.

In the following description, for the sake of simplicity, the basic operation program 3001 stored in the storage unit 310 is loaded into the RAM 304 and executed by the main control unit 301 to control each operation block. It is assumed that the action execution unit 3101 controls each action block. Similar descriptions are made for other operating programs.

The content management/distribution execution unit 3102 manages the video content and the like stored in the video content storage area 3011 and the metadata storage area 3012 and metadata, and distributes the video content and the metadata to service business based on the contract. control the provision of information to users. Furthermore, the content management/distribution execution unit 3102 authenticates the service provider server 400 based on the contract as necessary when providing the video content and each metadata to the service provider. Processing, etc. are also performed.

The LAN communication unit 321 is connected to the Internet 200 and communicates with the service provider server 400 and the like on the Internet 200 . It is assumed that the LAN communication unit 321 includes an encoding circuit, a decoding circuit, and the like.

[Configuration of service provider server]
FIG. 4 is a block diagram showing an example of the internal configuration of the service provider server 400. As shown in FIG. The service provider server 400 is composed of a main control unit 401, a system bus 402, a RAM 404, a storage unit 410, and a LAN communication unit 421.

The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operating program. A system bus 402 is a data communication path for transmitting and receiving data between the main control unit 401 and each operation block in the service provider server 400 . A RAM 404 serves as a work area when each operation program is executed.

The storage unit 410 stores a basic operation program 4001 , a content management/distribution program 4002 and an application management/distribution program 4003 . The moving image content storage area 4011 and the metadata storage area 4012 store the moving image content and the like provided by the broadcasting station server 300 and each metadata, the content produced by the service provider and the metadata related to the content, and the like. The application storage area 4013 stores applications necessary for realizing each service of the broadcast-communication cooperation system to be distributed in response to requests from each television receiver.

Further, the basic operation program 4001, the content management/distribution program 4002, and the application management/distribution program 4003 stored in the storage unit 410 are expanded in the RAM 404, and furthermore, the main control unit 401 executes the expanded basic operation program and content management program. By executing the /distribution program and the application management/distribution program, a basic operation execution unit 4101, a content management/distribution execution unit 4102, and an application management/distribution execution unit 4103 are configured.

In the following description, for the sake of simplicity, the basic operation program 4001 stored in the storage unit 410 is loaded into the RAM 404 and executed by the main control unit 401 to control each operation block. It is assumed that the action execution unit 4101 controls each action block. Similar descriptions are made for other operating programs.

The content management/distribution execution unit 4102 acquires video content and the like from the broadcasting station server 300 and metadata, manages the video content and the metadata accumulated in the video content storage area 4011 and the metadata storage area 4012, And it controls the distribution of the moving image content etc. and each metadata to each television receiver. Also, the application management/distribution execution unit 4103 manages each application stored in the application storage area 4013 and controls when each application is distributed in response to a request from each television receiver. Furthermore, the application management/distribution executing unit 4103 performs authentication processing of each television receiver, etc., as necessary when distributing each application to each television receiver.

The LAN communication unit 421 is connected to the Internet 200 and communicates with the broadcast receiving device 100 and the mobile information terminal 700 via the broadcasting station server 300 on the Internet 200 and the router device 210 . It is assumed that the LAN communication unit 421 includes an encoding circuit, a decoding circuit, and the like.

[Hardware configuration of portable information terminal]
FIG. 5A is a block diagram showing an example of the internal configuration of portable information terminal 700. As shown in FIG. The portable information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an extended interface unit 724, an operation unit 730, an image processing unit 740, an audio processing unit 750, and a sensor unit 760. , consists of

A main control unit 701 is a microprocessor unit that controls the entire portable information terminal 700 . A system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operation block in the portable information terminal 700 .

A ROM 703 is a memory storing a basic operation program such as an operating system and other operation programs, and a rewritable ROM such as an EEPROM or a flash ROM is used. A RAM 704 serves as a work area for executing the basic operation program and other operation programs. The ROM 703 and RAM 704 may be configured integrally with the main control section 701 . Also, the ROM 703 may use a partial storage area in the storage section 710 instead of having an independent configuration as shown in FIG. 5A.

The storage unit 710 stores an operation program and operation setting values of the mobile information terminal 700, personal information of the user of the mobile information terminal 700, and the like. Further, it is possible to store an operation program downloaded from a network, various data created by the operation program, and the like. In addition, it is possible to store contents such as moving images, still images, and sounds downloaded from the network. All or part of the functions of the ROM 703 may be replaced by a partial area of the storage unit 710 . Moreover, the storage unit 710 needs to retain stored information even when power is not supplied to the portable information terminal 700 from the outside. Therefore, for example, devices such as flash ROMs, SSDs, and HDDs are used.

It should be noted that each operation program stored in the ROM 703 and storage unit 710 can be updated and expanded in function by downloading from each server device on the Internet 200 .

The communication processing unit 720 is composed of a LAN communication unit 721 , a mobile telephone network communication unit 722 and an NFC communication unit 723 . The LAN communication unit 721 is connected to the Internet 200 via the router device 210 and transmits and receives data to and from each server device on the Internet 200 . It is assumed that the connection with the router device 210 is performed by wireless connection such as Wi-Fi (registered trademark). The mobile phone network communication unit 722 performs telephone communication (phone call) and data transmission/reception by wireless communication with the base station 600b of the mobile phone network. The NFC communication unit 723 performs wireless communication with a corresponding reader/writer when in close proximity. The LAN communication unit 721, the mobile phone network communication unit 722, and the NFC communication unit 723 are each provided with an encoding circuit, a decoding circuit, an antenna, and the like. Also, the communication processing unit 720 may further include other communication units such as a BlueTooth (registered trademark) communication unit and an infrared communication unit.

The extended interface unit 724 is a group of interfaces for extending the functions of the mobile information terminal 700, and in this embodiment, it is assumed to be composed of a video/audio interface, a USB interface, a memory interface, and the like. The video/audio interface inputs video/audio signals from an external video/audio output device, outputs video/audio signals to an external video/audio input device, and the like. The USB interface is connected to a PC or the like to transmit and receive data. Also, a keyboard or other USB devices may be connected. A memory interface connects a memory card or other memory medium to transmit and receive data.

The operation unit 730 is an instruction input unit for inputting an operation instruction to the portable information terminal 700, and in this embodiment, it is composed of a touch panel 730t arranged over the display unit 741 and an operation key 730k arranged with button switches. shall be Only one of them may be used. The portable information terminal 700 may be operated using a keyboard or the like connected to the extended interface section 724 . The mobile information terminal 700 may be operated using a separate mobile terminal device connected by wired communication or wireless communication. Also, the touch panel function may be provided by the display unit 741 .

The image processing section 740 is composed of a display section 741 , an image signal processing section 742 , a first image input section 743 and a second image input section 744 . The display unit 741 is a display device such as a liquid crystal panel, and provides the user of the mobile information terminal 700 with image data processed by the image signal processing unit 742 . The image signal processing unit 742 includes a video RAM (not shown), and the display unit 741 is driven based on the image data input to the video RAM. Also, the image signal processing unit 742 has functions such as format conversion and superimposition processing of menus and other OSD (On Screen Display) signals, if necessary. The first image input unit 743 and the second image input unit 744 convert the light input from the lens into an electrical signal using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. , is a camera unit that inputs image data of surroundings and objects.

The audio processing unit 750 is composed of an audio output unit 751 , an audio signal processing unit 752 and an audio input unit 753 . The audio output unit 751 is a speaker, and provides the user of the portable information terminal 700 with the audio signal processed by the audio signal processing unit 752 . A voice input unit 753 is a microphone that converts a user's voice or the like into voice data and inputs the voice data.

The sensor unit 760 is a group of sensors for detecting the state of the mobile information terminal 700, and in this embodiment includes a GPS receiver unit 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. , consists of These sensors make it possible to detect the position, tilt, direction, movement of the mobile information terminal 700, the brightness of the surroundings, the proximity of surrounding objects, and the like. Moreover, the mobile information terminal 700 may further include other sensors such as an air pressure sensor.

The mobile information terminal 700 may be a mobile phone, a smart phone, a tablet terminal, or the like. A PDA (Personal Digital Assistant) or a notebook PC may be used. It may also be a digital still camera, a video camera capable of shooting moving images, a portable game machine, or other portable digital equipment.

Note that the configuration example of the mobile information terminal 700 shown in FIG. 5A includes many components such as the sensor unit 760 that are not essential to the present embodiment, but even if the configuration does not include these components, the present embodiment without compromising the effect of In addition, a configuration (not shown) such as a digital broadcast reception function, an electronic money payment function, and the like may be added.

[Software configuration of portable information terminal]
FIG. 5B is a software configuration diagram of the portable information terminal 700 of this embodiment, and shows the software configuration in the ROM 703, the RAM 704, and the storage unit 710. As shown in FIG. In this embodiment, the ROM 703 stores a basic operating program 7001 and other operating programs, and the storage unit 710 stores a cooperation control program 7002, an HTML browser program 7003 and other operating programs. In addition, the storage unit 710 includes a content storage area 7011 for storing content such as moving images, still images, and audio, an authentication information storage area 7012 for storing authentication information used for cooperative operation with a television receiver, and other information. It is assumed that various information storage areas for storing various information are provided.

A basic operation program 7001 stored in the ROM 703 is loaded into the RAM 704, and the main control unit 701 executes the loaded basic operation program to configure a basic operation execution unit 7101. FIG. In addition, the cooperation control program 7002 and the HTML browser program 7003 stored in the storage unit 710 are developed in the RAM 704, respectively, and the main control unit 701 executes the expanded operation programs, thereby executing the cooperation control execution unit 7102 and the HTML browser program 7003. Configure HTML browser engine 7103 . The RAM 704 also has a temporary storage area for temporarily holding data created during execution of each operation program as needed.

In the following description, for the sake of simplicity, the basic operation program 7001 stored in the ROM 703 is loaded into the RAM 704 and executed by the main control unit 701 to control each operation block. It is assumed that the unit 7101 controls each operation block. Similar descriptions are made for other operating programs.

The cooperation control execution unit 7102 manages device authentication, connection, transmission and reception of each data, etc. when the portable information terminal 700 performs cooperative operation with the television receiver. The HTML browser engine 7103 is an HTML browser that executes an application created for the broadcast-communication cooperation system on the mobile information terminal 700 .

Each operation program may be stored in the ROM 703 and/or the storage unit 710 in advance at the time of product shipment. It may be obtained from other application servers 500 or the like on the Internet 200 via the LAN communication section 721 or the mobile telephone network communication section 722 after product shipment. Further, each operation program stored in a memory card, an optical disc, or the like may be acquired via the expansion interface section 724 or the like.

[Overview of application control information (AIT)]
The application control information (AIT) of this embodiment is an application ( Hereafter, it may be referred to as a broadcast cooperation application.) and is information intended to instruct its control. In addition, the broadcast cooperation application is (1) a broadcast managed system that operates only in a broadcast reception state based on a control signal such as start/end contained in a broadcast signal, and is permitted to access broadcast resources based on the control signal. applications, (2) non-broadcast managed applications that are allowed to access broadcast resources based on means such as application authentication in an operation mode in which activation/termination, etc. are not controlled by broadcast signals, and (3) broadcast resources. It may be distinguished from other general applications for which access is not permitted.

AIT transmission methods include a method of transmitting AIT in section format or XML (eXtensible Markup Language) format by broadcasting waves using a data carousel (DC) method or the like, and a method of transmitting AIT files in section format or XML format over the Internet. 200 server device using http (Hypertext Transfer Protocol) or https (Hypertext Transfer Protocol Secure). Other methods may be adopted.

FIG. 6 is a data configuration diagram showing an example of the data configuration of AIT. AIT mainly includes application type 901, application identifier 902, application control code 903, application profile 904, application acquisition source information 905, application boundary and access authority setting 906, activation priority 907, cache information 908, server access distribution parameter 909. , etc. Furthermore, other information may be included.

The application type 901 defines the application description method. In this embodiment, it is assumed that the description method of the application is HTML. The application identifier 902 is identification information composed of an organization identification for identifying a business and an application identification numbered for each business, for identifying an application unit. Note that an application unit is a set of HTML documents and their reference resources, each of which has an HTML document existing at a location specified by the application acquisition source information 905 as an entry document. The application control code 903 defines operation control for the target application, and describes one of (1) automatic activation, (2) operable, (3) termination, and (4) prefetch. . The application profile 904 is a value indicating the functions of the television receiver required by the application, and indicates a combination of functions that the television receiver has as options. Whether or not the application can be used is determined by referring to this value.

The application acquisition destination information 905 is information specifying the acquisition destination of the application, and is location information for acquiring the HTML document to be referred to first when the application is started. Since applications are assumed to be transmitted by broadcasting and stored on a server device on a communication network, the location information specified by the application acquisition destination information 905 also corresponds to both cases of acquisition by broadcasting and acquisition by communication. Regulations are made. The application boundary and access restriction setting 906 is information indicating an operable range as a broadcast managed application as a set of one or more areas (URL: Uniform Resource Locator). Also, access restrictions to broadcast resources for each area are set for each function. Application boundary and access restriction settings 906 specify the range of document transitions to prevent unexpected document transitions and access to inappropriate broadcast resources due to the chain of document transitions from the entry document when the application is started. do. In addition, it is possible to set access authority to specific broadcast resources for each area within the range of the document transition.

Activation priority 907 defines which of the data broadcast by the broadcast service and the broadcast managed application by the HTML document should be preferentially activated when they exist at the same time. unconditionally designating data broadcasting as top priority on the PMT, designating the startup priority of a specific application type on the PMT, and designating the startup priority of the target application with the startup priority 907; shall be possible. The cache information 908 is information used for cache control when holding application resources in preparation for reuse of the application. With this information, it is possible to cache application resources assuming reuse even after the application ends. The server access distribution parameter 909 is a parameter set for distributing access for the purpose of reducing the load on the server where access is concentrated at the acquisition destination of the application. The television receiver may operate to stochastically delay the application of application control codes according to the setting of this parameter.

The operation of the broadcast receiving apparatus 100 of this embodiment will be described below.

[Operation sequence at application startup]
First, the process of activating the broadcast cooperation application based on the AIT transmitted by the broadcast wave in the broadcast receiving apparatus 100 of the present embodiment will be described. In the broadcast receiving apparatus 100 of the present embodiment, when the data broadcast by the broadcast service and the broadcast cooperation application exist at the same time, which one is prioritized based on the information on the PMT, the application control code 903 of the AIT, the activation priority 907, and the like. It is possible to specify whether to start with

FIG. 7A is an operation sequence diagram showing an example of the operation sequence of the broadcast-linked application when it is specified that the broadcast-linked application should be preferentially activated. The figure shows a series of flows until the broadcast receiving apparatus 100 confirms the PMT and AIT as appropriate and activates a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiver 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 acquires the PMT data string separated by the first separator 132. (S101), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S101 that the activation priority of the broadcast-linked application is high (S102), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S103), and the acquired AIT The application control code 903 in the data string is confirmed (S104). In the process of S104, if the application control code 903 is "automatic start", furthermore, the application profile 904 of the acquired AIT data string is confirmed (S105), and execution of the broadcast cooperation application specified in the AIT is confirmed. When it is confirmed that it is possible, based on the information described in the application acquisition destination information 905, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121. (S106).

Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S107). Note that a known method may be used for the authentication process, and a detailed description thereof will be omitted. Next, under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400, received via the LAN communication unit 121. (S108).

FIG. 7B is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when it is specified that the data broadcast by the broadcast service should be preferentially activated. The figure shows a series of flows until the broadcast receiving apparatus 100 confirms the PMT and AIT as appropriate and activates a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiver 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 acquires the PMT data string separated by the first separator 132. (S201), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S201 that the data broadcast by the broadcast service has a high activation priority (S202), the data broadcast reception processing unit 141 acquires the BML data string separated by the first separation unit 132 and converts it into a BML document. Play back (S203). When automatic activation of data broadcasting is set by the BML document, and when the user uses an operation terminal (portable information terminal 700, remote controller, etc.) to request activation of data broadcasting (S204), the data broadcasting engine 142 generates data broadcasting screen information by executing the reproduced BML document, and displays it on the video display unit 173 (S205).

After the process of S205 or simultaneously with the process of S205, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S206), and confirms the application profile 904 of the acquired AIT data string. (S207). In the process of S207, when it is confirmed that the broadcast-linked application specified by the AIT can be executed, an entry button to the executable broadcast-linked application is displayed on the data broadcasting screen. The entry button may always be displayed, and the color scheme may be changed from the inactive color to the active color only when the broadcast cooperation application can be executed. By changing the shape, the entry button may be switched between an inactive state and an active state.

When the user selects the entry button using the operation terminal (S208), the data broadcasting engine 142 ends the process of executing the BML document and generating data broadcasting screen information (S209). Subsequently, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S210), and confirms the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information described in the application acquisition destination information 905 confirmed in S210, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S211).

Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S212). Next, under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400, received via the LAN communication unit 121. (S213).

FIG. 7C is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when no priority activation is specified. The figure shows a series of flows until the broadcast receiving apparatus 100 confirms the PMT and AIT as appropriate and activates a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiver 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 acquires the PMT data string separated by the first separator 132. (S301), the startup priority described in the PMT is confirmed. When it is confirmed in the process of S301 that the broadcast-linked application has a high activation priority (S302), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S303), and the acquired AIT The application control code 903 in the data string is confirmed (S304). In the process of S304, if the application control code 903 is "startable" instead of "automatic start", the display of the broadcast program is continued without starting neither the data broadcasting by the broadcasting service nor the broadcast cooperation application.

In the state after the processing of S304 is completed, when the user uses the operation terminal to request the activation of data broadcasting (S305), the acquisition of the BML data string and the processing of the BML Reproduction of documents, generation of data broadcasting screen information, etc. are performed (not shown). On the other hand, when the user uses the operation terminal to request activation of the broadcast-linked application launcher after the processing of S304 is finished (S306), the application control unit 161 separates the AIT data separated by the first separation unit 132. A string is obtained (S307), and the application profile 904 of the obtained AIT data string is confirmed (S308). Furthermore, the application control unit 161 displays a list of executable broadcast-linked applications as a broadcast-linked application launcher on the video display unit 173 (S309).

When the user selects a predetermined broadcast-linked application from the broadcast-linked application launcher displayed in S309 using the operation terminal (S310), the application control unit 161 separates the AIT data string separated by the first separation unit 132 into (S311), and confirms the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information described in the application acquisition destination information 905 confirmed in S311, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S312).

Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S313). Next, under the control of the application control unit 161, the application engine 162 of the broadcast receiving device 100 activates the predetermined broadcast cooperation application distributed from the service provider server 400, received via the LAN communication unit 121. (S314).

In addition, in the activation sequence of the broadcast cooperation application described with reference to FIGS. 7A to 7C, an example of acquiring AIT from broadcast waves is described. Alternatively, the AIT file may be acquired from. Also, the acquisition of the broadcast cooperation application may be performed not from the server device (service provider server 400) on the network but from the broadcast wave. That is, when the location information described in the application acquisition destination information 905 of AIT indicates a broadcast wave, the application control unit 161 transmits the HTML data string by the data carousel method or the like and is separated and output by the first separating unit 132. , and the application engine 162 executes the reproduced HTML document (broadcast-linked application).

It should be noted that if there is no information specifying the activation priority when the data broadcast by the broadcasting service and the broadcast cooperation application exist simultaneously on the PMT, the activation is performed only by information such as the application control code 903 and the activation priority 907 of the AIT. You may make it confirm a priority. Similarly, even if the acquisition of the information on the PMT fails, the activation priority may be confirmed only by information such as the application control code 903 of the AIT and the activation priority 907 . That is, regardless of the information on the PMT, the AIT is periodically checked, and if there is a broadcast-linked application specified by "automatic start" in the application control code 903 of the AIT, the broadcast-linked application Activation is prioritized, and if there is no broadcast-linked application designated by "automatic activation" in the application control code 903 of the AIT, activation of data broadcasting by the broadcasting service may be prioritized.

Further, when there is no response from the service provider server 400 for a predetermined period of time or more when the distribution request for the broadcast cooperation application is made in S106, S211, or S312, a message such as "Please wait for a while" is displayed on the video display unit 173. You may make it display. Alternatively, in this case, a message may be displayed asking the user to stop executing the broadcast cooperation application.

Further, the activation sequence of the broadcast cooperation application is not limited to the three patterns described above, and it goes without saying that the activation sequence may be different.

[Operational sequence when linking mobile information terminals]
In the broadcast receiving device 100 of the present embodiment, it is assumed that the functions of the broadcast communication cooperation service can be expanded by cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700 . For example, by installing an application (cooperation control application) prepared by the television receiver maker, the portable information terminal 700 can be used as a high-performance remote control for the broadcast receiving apparatus 100 . Also, the broadcast cooperation application can be executed on the portable information terminal 700, and for example, a service linked to the broadcast program being displayed on the broadcast receiving device 100 can be displayed on the portable information terminal 700 as well. It should be noted that in order to extend the functions by cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700, it is desirable that the cooperation control application is activated on the mobile information terminal 700, and the operation on the mobile information terminal 700 is performed. It is assumed that the broadcast cooperation application to operate is controlled by the cooperation control application.

FIG. 8A is an operation sequence diagram showing an example of an operation sequence when the cooperative control application is activated on the mobile information terminal 700. FIG. This figure shows a series of flows (first time) from when the portable information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 to when the cooperative operation becomes possible. It is assumed that the cooperative control application is installed in the storage unit 710 of the mobile information terminal 700 in advance as the cooperative control program 7002 .

When the user instructs the activation of the cooperative control application on the portable information terminal 700 (S401), the cooperative control execution unit 7102 of the portable information terminal 700 searches for a television receiver capable of communication (cooperative operation) on the network ( S402), the search result is displayed on the display unit 741 as a television receiver list. If a communicable television receiver cannot be found, a message to that effect is displayed and the process ends. When the user selects an arbitrary television receiver (broadcast receiving device 100 of this embodiment) from the television receiver list, the cooperation control execution unit 7102 displays a login screen for connecting to the broadcast receiving device 100 on the display unit 741. do. When the user inputs authentication information (login name and password specified by the broadcast receiving apparatus 100, etc.) to the login screen via the operation unit 730 (S403), the cooperation control execution unit 7102 receives the input authentication information. is stored in the authentication information storage area 7012 and simultaneously transmitted to the broadcast receiving apparatus 100 (S404). The process of transmitting the authentication information to the broadcast receiving device 100 may be performed via the LAN communication unit 721 and the router device 210, or may be performed directly to the broadcast receiving device 100 via the NFC communication unit 723. .

Terminal cooperation control section 191 of broadcast receiving apparatus 100 that has received the authentication information via LAN communication section 121 refers to authentication information storage area 1012 to check whether the received authentication information is correct. (S405). When the received authentication information is confirmed to be correct by the process of S405, the information of the mobile information terminal 700 is stored in the authentication information storage area 1012, and the mobile information terminal 700 is authenticated (S406). The portable information terminal 700 that has obtained the authentication of the broadcast receiving apparatus 100 displays the basic screen of the cooperative control application (for example, the advanced remote control screen) on the display unit 741 (S407). In S<b>405 , if the received authentication information is not confirmed to be correct, the terminal cooperation control section 191 of the broadcast receiving apparatus 100 returns an error to the mobile information terminal 700 . By the above processing, the cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700 becomes possible.

FIG. 8B is an operation sequence diagram showing an example of an operation sequence when the cooperative control application is activated on the mobile information terminal 700. As shown in FIG. This figure shows a series of flows (second and subsequent times) from when the portable information terminal 700 performs the authentication process with the broadcast receiving apparatus 100 until the cooperative operation becomes possible.

When the user gives an instruction to start the cooperative control application on the mobile information terminal 700 (S501), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for a communicable television receiver on the network, and displays the search result on the television. A list of receivers is displayed on the display unit 741 . If a communicable television receiver cannot be found, a message to that effect is displayed and the process ends. The user selects an arbitrary television receiver (broadcast receiving device 100 of the present embodiment) from the television receiver list (S502), and the selected broadcast receiving device 100 has performed connection (cooperation operation) in the past. If it is a certain device, the cooperative control execution unit 7102 reads the authentication information of the broadcast receiving apparatus 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving apparatus 100 (S503).

Terminal cooperation control section 191 of broadcast receiving apparatus 100 that has received the authentication information via LAN communication section 121 refers to authentication information storage area 1012 to check whether the received authentication information is correct. (S504). When the received authentication information is confirmed to be correct by the process of S504, the portable information terminal 700 is authenticated (S505). The portable information terminal 700 that has obtained the authentication of the broadcast receiving apparatus 100 displays the basic screen of the cooperation control application on the display unit 741 (S506). By the above processing, the cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700 becomes possible.

8A and 8B, when the broadcast cooperation application is activated in the broadcast receiving apparatus 100, the processes of FIGS. 7A and 7C may be performed after the processes of FIGS. 8A and 8B.

FIG. 8C is an operation sequence diagram showing an example of an operation sequence when the cooperative control application is activated on the mobile information terminal 700. As shown in FIG. This figure shows a series of flows (second and subsequent times) from when the portable information terminal 700 performs the authentication process with the broadcast receiving apparatus 100 until the cooperative operation becomes possible. However, in the same figure, it is an example of a case where activation of the cooperation control application on the mobile information terminal 700 is requested by the broadcast receiving apparatus 100 that executes the activation sequence of the broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiver 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 acquires the PMT data string separated by the first separator 132. (S601), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S601 that the activation priority of the broadcast cooperation application is high (S602), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S603), and the acquired AIT The application control code 903 in the data string is confirmed (S604). In the process of S604, if the application control code 903 is "automatic start", the application profile 904 of the acquired AIT data string is confirmed (S605). In the process of S605, when it is confirmed that the broadcast cooperation application specified by the AIT can be executed, and furthermore, when it is determined that cooperation control of the mobile terminal device is necessary, the terminal cooperation control unit 191 performs authentication. By referring to the information storage area 1012, the portable information terminal 700 is selected as the portable terminal device, and a cooperative control application activation request is transmitted to the selected portable information terminal 700 (S606).

The selection of the portable information terminal 700 by referring to the authentication information storage area 1012 is based on the latest information in the authentication information storage area 1012 or based on the information with the highest frequency of use in the authentication information storage area 1012. You should do it like this.

Further, in the processing of S606, if the mobile terminal device to which the cooperative control application activation request should be sent cannot be found, a message to that effect may be displayed on the video display unit 173. FIG. Alternatively, in this case, a message may be displayed asking the user to stop executing the broadcast cooperation application.

The main control unit 701 of the portable information terminal 700 activates the cooperation control application (cooperation control execution unit 7102) in response to the cooperation control application activation request received via the LAN communication unit 721 (S607). The executing unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S608).

Terminal cooperation control section 191 of broadcast receiving apparatus 100 that has received the authentication information via LAN communication section 121 refers to authentication information storage area 1012 to check whether the received authentication information is correct. (S609). When the received authentication information is confirmed to be correct by the process of S609, the portable information terminal 700 is authenticated (S610). The portable information terminal 700 that has obtained the authentication of the broadcast receiving apparatus 100 displays the basic screen of the cooperation control application on the display unit 741 (S611). By the above processing, the cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700 becomes possible.

Note that when the broadcast cooperation application is executed in both the broadcast receiving device 100 and the mobile information terminal 700 following the above-described processing, the processing shown in FIG. 9 may be performed. FIG. 9 is an operation sequence diagram showing an example of the activation sequence of the broadcast cooperation application of the broadcast receiving apparatus 100 and the mobile information terminal 700. As shown in FIG.

8C, the application control unit 161 of the broadcast receiving device 100 obtains the AIT data string separated by the first separation unit 132 (S612), and the application of the obtained AIT data string Confirm the acquisition source information 905 . Further, based on the information described in the application acquisition destination information 905 confirmed in S612, a transmission request for the broadcast cooperation application (TV side) is transmitted to the predetermined service provider server 400 via the LAN communication unit 121. (S613).

Service provider server 400, which has received the transmission request of the broadcast cooperation application (television side), performs authentication processing of broadcast receiving apparatus 100 as necessary based on the control of application management/distribution execution unit 4103, and then performs application A predetermined broadcast cooperation application (TV side) stored in the storage area 4013 is distributed via the LAN communication unit 421 (S614). The application engine 162 of the broadcast receiving device 100, based on the control of the application control unit 161, receives the predetermined broadcast cooperation application (TV side) distributed from the service provider server 400, received via the LAN communication unit 121. Start up (S615).

Next, the terminal cooperation control unit 191 of the broadcast receiving apparatus 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700, which is acquired from the AIT or the broadcast cooperation application (TV side) executed in S615. URL information and the like are transmitted to the portable information terminal 700 (S616). Linkage control execution unit 7102 of mobile information terminal 700 receives via LAN communication unit 721 based on the acquisition destination URL information of the broadcast collaboration application (terminal side), etc., via LAN communication unit 721, a predetermined service business A transmission request for the broadcast cooperation application (terminal side) is transmitted to the personal server 400 (S617).

Service provider server 400, which has received the transmission request of the broadcast cooperation application (terminal side), performs authentication processing of portable information terminal 700 as necessary based on the control of application management/distribution execution unit 4103, and then performs application The predetermined broadcast cooperation application (terminal side) stored in the storage area 4013 is distributed via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the portable information terminal 700 activates the predetermined broadcast cooperation application (terminal side) received via the LAN communication unit 721 and distributed from the service provider server 400 (S619).

It should be noted that the AIT file can be obtained from a predetermined server device, the broadcast-linked application can be obtained not from a server device on the network but from broadcast waves, etc., are the same as the operation sequences of FIGS. 7A to 7C. be. In addition, when the acquisition of the broadcast cooperation application is performed from the broadcast wave, the broadcast reception apparatus 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave, and the acquired broadcast cooperation application (terminal side ) to the portable information terminal 700 via the communication unit 121 . Alternatively, the broadcast receiving apparatus 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave, stores it in the storage unit 110, and transmits it to the mobile information terminal 700 in the process of S616 in FIG. As URL information to be transmitted, location information of the storage unit 110 of the broadcast receiving apparatus 100 may be transmitted. The broadcast receiving apparatus 100 may acquire the broadcast cooperation application (TV side) from broadcast waves, and the portable information terminal 700 may acquire the broadcast cooperation application (terminal side) from a server device on the network. Using the digital broadcasting reception function of the portable information terminal 700, the broadcast cooperation application (terminal side) may be acquired directly from the broadcast wave.

7A to 7C, 8A to 8C, and 9 can be partially combined as appropriate, and some operation steps can be replaced with other operation steps as appropriate. , simultaneous operation, etc.

[Basic screen of cooperative control application for mobile information terminal]
FIG. 10A is a screen display diagram showing an example of the basic screen of the cooperative control application displayed by the processing of S407 of FIG. 8A, the processing of S506 of FIG. 8B, the processing of S611 of FIG. 8C, and the like. In this embodiment, the basic screen 741 a of the cooperative control application is assumed to have a function as a high-performance remote control corresponding to the broadcast receiving apparatus 100 .

The basic screen 741a of the cooperative control application includes, as shown in FIG. Channel up/down key 741a5, input switching key 741a6, program guide key 741a7, data key 741a8, cooperative application key 741a9, menu key 741aa, return key 741ab, cursor keys (up, down, left, right) 741ac, decision key 741ad , color keys (blue, red, green, yellow) 741ae. Other operation keys may also be displayed.

The operation keys described above are easy to use if they are arranged and operated in the same manner as the dedicated remote control attached to the broadcast receiving apparatus 100 . Also, the power key 741a1, the network selection key 741a2, the numeric keys 741a3, etc. are assumed to have the same functions as the operation keys of a known TV remote control, and detailed description thereof will be omitted. The cooperation application key 741a9 is an operation key prepared for the broadcast communication cooperation function of this embodiment.

In addition, in the processing of S204 in FIG. 7B and S305 in FIG. 7C, it is possible to start/end the data broadcasting by selecting the data key 741a8. Further, in the processing of S208 of FIG. 7B and S310 of FIG. 7C, it is assumed that the executable broadcast-linked application can be selected by operating the cursor key 741ac and the decision key 741ad. Also, in the process of S306 in FIG. 7C, it is assumed that a request to activate the broadcast cooperation application launcher can be made by selecting the cooperation application key 741a9.

If the cooperative application key 741a9 or other operation keys having similar functions are prepared on the basic screen 741a of the cooperative control application, each broadcast cooperative application used in the broadcast cooperative system of the present embodiment can be easily selected/selected. It is possible to start. Also, the dedicated remote control attached to the broadcast receiving apparatus 100 may be provided with the cooperative application key 741 a 9 or other operation keys having similar functions.

FIG. 10B is a screen display diagram showing an example of the basic screen of the cooperative control application displayed by the processing of S407 of FIG. 8A, the processing of S506 of FIG. 8B, the processing of S611 of FIG. 8C, and the like. A different example.

The basic screen 741b of the cooperation control application includes a message 741b1 during cooperation control and a cooperation control application operation screen 741b2. Other objects may also be displayed. The cooperative control in progress message 741b1 is a message display for making the user aware that the portable information terminal 700 is in cooperative operation with the broadcast receiving apparatus 100. FIG. The cooperative control application operation screen 741b2 is an area where arbitrary screen display is performed by the cooperative control application, and detailed description thereof will be omitted in this embodiment. For example, the configuration within the cooperative control application operation screen 741b2 may be the same as the basic screen 741a of the aforementioned cooperative control application. A sub-screen or the like of the broadcast program being displayed on the broadcast receiving device 100 may be displayed.

As shown in FIG. 10B, by displaying the cooperation control in progress message 741b1, the user of the mobile information terminal 700 can easily understand that the mobile information terminal 700 is currently operating in cooperation with the broadcast receiving apparatus 100. become. Note that the message 741b1 during cooperation control is not limited to character display, and may be symbol display, graphic display, or the like. The message 741b1 may be substituted for the cooperation control in progress message 741b1 by changing the background color or the like.

[Data Broadcast Screen of Broadcast Receiver]
FIG. 11 is a screen display diagram showing an example of the data broadcast screen displayed by the process of S205 in FIG. 7B. In the present embodiment, it is assumed that three broadcast cooperation applications, cooperation application A, cooperation application B, and cooperation application C, can be executed by the broadcast receiving apparatus 100 according to the description of the AIT or the like. In this case, the entry button 173a2 of the cooperative application A, the entry button 173a3 of the cooperative application B, and the entry button 173a4 of the cooperative application C are displayed at arbitrary positions on the data broadcasting screen 173a.

On the data broadcast screen 173a as shown in FIG. 11, when the entry button 173a2, the entry button 173a3, the entry button 173a4, etc. are selected using the cursor key 741ac and enter key 741ad on the basic screen 741a of the cooperative control application, the data broadcast When the display of the screen 173a ends, under the control of the application control unit 161 and the application engine 162, the cooperative application A, the cooperative application B, the cooperative application C, etc. are activated.

When the data broadcasting screen 173a is displayed, the frame color, internal color, shape, font, size, blinking state, etc. of each entry button may be appropriately changed according to the type of broadcast cooperation application, security status, etc. You can do it. For example, if the cooperative application A is a broadcast managed application, the frame color of the entry button 173a2 is set to blue, and if the cooperative application B is a non-broadcast managed application, the frame color of the entry button 173a3 is set to yellow. For example, if the cooperative application C is a general application, the frame color of the entry button 173a4 is red. Alternatively, the frame color of the entry button 173a2 is set to blue when the cooperative application A is determined to be reliable for security, and the entry button is displayed when it is determined that the cooperative application B is not necessarily reliable for security. For example, the frame color of the entry button 173a3 is set to yellow, and the frame color of the entry button 173a4 is set to red when it is determined that the cooperative application C is dangerous in terms of security.

In addition, frame color, internal color, shape, font, size, blinking status, etc. of each entry button, depending on the function and genre of the broadcast collaboration application, or depending on the expiration date of use of each broadcast collaboration application. may be changed as appropriate. The frame color, internal color, shape, font, size, blinking state, etc. of each entry button may be appropriately changed depending on whether the broadcast cooperation application has been acquired from the network. . For example, if the cooperative application A has already been acquired from the network (cached in the RAM 104 or the storage unit 110), the frame color of the entry button 173a2 is blue, and if the cooperative application B is being acquired, For example, the frame color of the entry button 173a3 is yellow, and the frame color of the entry button 173a4 is red if the cooperative application C has not yet been acquired.

In this way, the user of the broadcast receiving device 100 can easily grasp the types of broadcast cooperation applications that can be executed by the broadcast receiving device 100, the security status, and the like.

[Broadcast-linked application launcher screen of broadcast receiver]
FIG. 12A is a screen display diagram showing an example of a notification screen for making the user aware that there is a broadcast cooperation application that can be activated in the broadcast receiving apparatus 100 of this embodiment.

For example, in the operation sequence shown in FIG. 7C, after the process of S304, the display of the broadcast program is continued without activating either the data broadcast by the broadcast service or the broadcast cooperation application. On the other hand, in this case, if an icon 173b0 as shown in FIG. 12A is displayed in order to make the user aware that there is a broadcast cooperation application that can be started, the usability of the broadcast receiving apparatus 100 is improved. That is, by displaying the icon 173b0, it is possible to prevent the user from overlooking the existence of the broadcast cooperation application that can be activated.

The icon 173b0 may be displayed at any position on the screen, but it is desirable that the icon 173b0 be displayed at a position that does not interfere with the viewing of the broadcast program. For example, four corners of the screen. Also, the icon 173b0 may be a character display as shown in FIG. 12A, or may be a symbol, a figure, or the like. Also, the icon 173b0 may be displayed all the time, or may be displayed for a predetermined period of time after the power is turned on or after the channel is switched. Alternatively, it may be displayed at the same time when the program information, channel number, etc. are displayed.

FIG. 12B is a screen display diagram showing an example of a broadcast-linked application launcher displayed by the process of S306 in FIG. 7C. In the present embodiment, it is assumed that three broadcast cooperation applications, cooperation application A, cooperation application B, and cooperation application C, can be executed by the broadcast receiving apparatus 100 according to the description of the AIT or the like. In this case, a broadcast-linked application launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b. Entry button 173b4 and Return button 173b5 are displayed.

While the broadcast collaboration application launcher 173b1 as shown in FIG. 12B is displayed, use the cursor key 741ac and enter key 741ad on the basic screen 741a of the collaboration control application to select the entry button 173b2, the entry button 173b3, the entry button 173b4, and the entry button 173b3. When , etc. are selected, under the control of the application control unit 161 and the application engine 162, the cooperative application A, the cooperative application B, the cooperative application C, etc. are activated. When the return button 173b5 is selected, the display of the broadcast-linked application launcher 173b1 ends.

In addition, when displaying the broadcast-linked application launcher 173b1 on the broadcast program screen 173b, depending on the type and security status of the broadcast-linked application, the function and genre of the broadcast-linked application, the acquisition status of the broadcast application from the network, etc. , the frame color, internal color, shape, font, size, blinking state, etc. of each entry button may be changed as appropriate. is the same as displaying

Further, when there is no broadcast-linked application that can be executed by the broadcast receiving apparatus 100, the broadcast-linked application launcher 173b1 may not be displayed. Alternatively, in this case, a message such as "There is no usable application" may be displayed inside the broadcast-linked application launcher 173b1.

[Broadcast cooperation application execution screen of broadcast receiving device]
13A is a screen display diagram showing an example of a broadcast-linked application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. 9, and the like. be. It is assumed that the broadcast cooperation application of the present embodiment has graphics performance, effect performance, etc. based on HTML description, and can be overlaid on the video display unit 173 with the broadcast program screen. For example, as shown in FIG. 13A, a broadcast cooperation application section 173c1 that displays information such as weather forecast and news is overlaid on an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application section 173c1 is composed of a first main object 173c2, a second main object 173c3, a third main object 173c4, a background object 173c5, and the like. Other objects may also be displayed.

By selecting the data key 741a8 on the basic screen 741a of the cooperation control application in a state where the broadcast cooperation application section 173c1 is overlaid on the broadcast program screen 173c, the execution of the broadcast cooperation application is ended and the data broadcasting screen is displayed. It shall be possible to move to Also, by selecting the cooperative application key 741a9 on the basic screen 741a of the cooperative control application, it is possible to end the execution of the broadcast cooperative application and return to display only the broadcast program screen 173c. The processing may be realized by different operation keys.

In addition, while the broadcast cooperation application section 173c1 is overlaid on the broadcast program screen 173c, by operating each operation key on the basic screen 741a of the cooperation control application, the transparency of the broadcast cooperation application section 173c1 is changed. shall be possible. The change processing of the degree of transparency may be performed collectively for the entire broadcast cooperation application section 173c1, or may be performed for the first main object 173c2, the second main object 173c3, the third main object 173c4, and the background object 173c5. It may be performed alone. It may be performed for each predetermined group (for example, multiple objects existing in the same graphics layer).

When performing the transparency change process, for example, the cursor key 741ac on the basic screen 741a of the cooperative control application is used to select an object, and the "blue" key of the color key 741ae is used to increase the transparency of the object. Use the "yellow" key to reduce the transparency of the object. A different operation key may be used to change the transparency. If the transparency of the entire broadcast-linked application section 173c1 is collectively set to 100%, the broadcast-linked application section 173c1 can be temporarily hidden. For example, when an emergency broadcast is distributed by airwaves, it is also possible to display only the broadcast program screen of the emergency broadcast on the video display unit 173 by setting the transparency of the entire broadcast cooperation application unit to 100%. Alternatively, the CM detection unit (not shown) detects that the broadcast program has changed from the main video to the CM video, and collectively sets the transparency of the entire broadcast cooperation application unit 173c1 to 100% (or the broadcast program video is clearly displayed). It may be controlled so as to have a degree of transparency that can be confirmed directly.

By performing the above-described processing, if it is desired to check the broadcast program screen in the background while the broadcast cooperation application is running, it is possible to confirm the broadcast program screen without terminating the broadcast cooperation application. Become.

FIG. 13B shows an example different from the above of the broadcast-linked application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. is a screen display diagram showing. In the example shown in FIG. 13B, a broadcast cooperation application section 173c6 that introduces recommended programs is overlaid on an arbitrary position on the broadcast program screen 173c. First recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, and the like are displayed in the broadcast cooperation application section 173c6. A larger amount of recommended program information may be displayed by scrolling, page switching, or the like.

Each of the recommended program information may be information of a program recommended in relation to the currently displayed broadcast program (broadcast program screen 173c), or information of a program recommended based on the viewing history of the user. Alternatively, the information may be information about a program that has become a hot topic on the Internet or the like. Information on recommended programs sent to the user by a friend of the user of the broadcast receiving device 100 may also be used. Further, the recommended program may be a program transmitted by a broadcast wave of a digital broadcasting service, or may be a VOD (Video On Demand) program distributed from each server device on the Internet 200. good. An information screen such as a home page prepared in a server device on the Internet 200 may be used.

While the broadcast cooperation application unit 173c6 is overlaid on the broadcast program screen 173c, the first recommended program information 173c7 and the second recommended program are displayed using the cursor key 741ac and the enter key 741ad on the basic screen 741a of the cooperation control application. By selecting information 173c8, third recommended program information 173c9, etc., each program video recommended by first recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, etc. is displayed on the video display section. 173.

FIG. 13C is a screen display diagram showing an example when a program video recommended by the broadcast cooperation application unit 173c6 for introducing recommended programs is displayed. For example, when the first recommended program information 173c7 of the broadcast cooperation application section 173c6 is selected using the cursor key 741ac and the enter key 741ad of the basic screen 741a of the cooperation control application, the video display section 173 displays the first recommended program information 173c7. A program video 173ca of the recommended program is displayed. The program image 173ca may be paused, jumped at a specified time, or the like by the user's operation of the operation terminal. Moreover, when displaying the program image 173ca, the original broadcast program screen 173c may be displayed at an arbitrary position in PIP (Picture In Picture) format. In this case, it may be possible to change which of the program video 173ca of the recommended program and the original broadcast program screen 173c should be used as the main screen by the user's operation on the operation terminal. The size of the window of the original broadcast program screen 173c may be adjusted by the user's operation on the operating terminal.

In addition, an icon display 173cb indicating that the program video 173ca of the recommended program is a video displayed by selecting any of the recommended program information displayed in the broadcast cooperation application section 173c6 is displayed at an arbitrary position on the screen. , the convenience of the user can be improved. Needless to say, the degree of transparency of the broadcast-linked application section 173c6 may be changed on the broadcast-linked application execution screen shown in FIG. 13B as well, as described above.

FIG. 13D shows an example different from the above of the broadcast-linked application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. is a screen display diagram showing. In the example shown in FIG. 13D, a broadcast cooperation application section 173cc serving as a portal for SNS (Social Networking Service) services is overlaid on an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application unit 173cc displays a first SNS service entry button 173cd, a second SNS service entry button 173ce, a third SNS service entry button 173cf, and the like. Entry buttons for more SNS services may be displayed by scrolling, page switching, or the like.

While the broadcast cooperation application section 173cc is overlaid on the broadcast program screen 173c, the entry button 173cd of the first SNS service, the entry button 173cd of the second SNS service, and the second By selecting the entry button 173ce of the SNS service, the entry button 173cf of the third SNS service, and the like, the functions assigned to each entry button, such as the chat function, the bulletin board function, and the Internet phone function, are activated. This makes it possible to enjoy the broadcast program being displayed (broadcast program screen 173c) while exchanging information with others. At the same time, the basic screen 741a of the cooperative control application on the mobile information terminal 700 may be changed to a character input screen such as a software keyboard or a voice input screen for chatting or posting on a bulletin board by voice input. good.

In addition to the above examples, as a broadcast cooperation application that can be executed by the broadcast receiving device 100 of the present embodiment, using the cooperation function between the broadcast receiving device 100 and the mobile information terminal 700, it is possible to further synchronize with the broadcast timing of CM. Then, the related CM application may be presented on both the broadcast receiving device 100 and the mobile information terminal 700 . Alternatively, in a paid service available in the broadcast receiving device 100, the broadcast cooperation application checks whether the user of the broadcast receiving device 100 has subscribed to a paid service, and depending on the result, the broadcast receiving device 100 and/or the mobile information terminal 700 It may be something like changing the display of. In the broadcast receiving apparatus 100 of the present embodiment, the effects described with reference to FIGS. 13A and 13B and the like can be obtained regardless of which broadcast cooperation application is executed.

[Error display screen of broadcast receiver]
FIG. 14 shows the processing of S105 in FIG. 7A, the processing of S207 in FIG. 7B, the processing of S308 in FIG. 7C, the processing of S605 in FIG. FIG. 10 is a screen display diagram showing an example of an error display screen when it is determined that the application cannot be executed, when the description of the AIT is insufficient, or when acquisition of the AIT fails.

In the broadcast receiving apparatus 100 of the present embodiment, when it is determined that the broadcast cooperation application cannot be executed, the reason why the broadcast cooperation application cannot be executed, such as the confirmation result of the application profile 904, is It is displayed in the error message 173d1. For example, as a result of checking the application profile 904, if a predetermined optional function is lacking on the television receiver side, an error message 173d1 to that effect is displayed. It is also possible to display an error code and a guide (URL or the like) of the home page of the television receiver maker in which an explanation of the error code is described. Alternatively, when the broadcast-linked application is acquired from the network, the network connection status is of course confirmed in advance. If it is not possible, an error message 173d1 to that effect is displayed. Also, the error message 173d1 may be displayed when the broadcast cooperation application cannot be correctly acquired due to a bad error situation, even though the network connection is established. An error message 173d1 may be displayed when acquisition of a broadcast-linked application is being executed and the broadcast-linked application cannot be executed yet. In addition, the error message 173d1 is also displayed when the reception of the broadcast wave is unstable and the information such as AIT can be received at first, but the information such as AIT cannot be received halfway through. good. In such a case, if the broadcast cooperation application acquired from each server device is cached as it is, it can be used as it is after the reception condition of the broadcast wave is recovered.

Also, if the result of checking the application profile 904 is that the television receiver lacks a predetermined optional function, an error message 173d1 is displayed to the effect that confirmation or update of the latest firmware for the television receiver is recommended. You can do it. Alternatively, the confirmation or update of the latest firmware may be automatically performed by the broadcast receiving apparatus 100 . Alternatively, if the broadcast cooperation application can be executed by adding paid optional hardware or optional software to the television receiver, a guide for the paid optional hardware or optional software may be displayed. good. Note that the error message 173d1 may be displayed on the mobile information terminal 700 instead of the broadcast receiving device 100. FIG.

[Broadcast-linked application execution screen on mobile information terminal]
FIG. 15 is a screen display diagram showing an example of a broadcast cooperation application (terminal side) execution screen displayed in the process of S619 of FIG. The broadcast-linked application execution screen 741c shown in FIG. 15 includes a main window 741c1, a sub-window 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an end button 741c7. Other objects may be added as well.

In this embodiment, it is assumed that the broadcast cooperation application (terminal side) executed on the mobile information terminal 700 is an application for confirming the details of the broadcast program being displayed on the broadcast receiving device 100 . The main window 741c1 displays the same image as the broadcast program screen displayed on the broadcast receiver 100, and the sub-window 741c2 displays an enlarged image of the position designated by the selection marker 741c3. By selecting the cursor keys 741c4 and 741c5, it is possible to change the position of the selection marker 741c3. The commentary display section 714c6 displays the commentary subtitles regarding the broadcast program being displayed in the main window 741c1, comments posted by other users regarding the broadcast program, and the like. The end button 741c7 is a button for ending the operation of the broadcast cooperation application (terminal side).

By operating the broadcast cooperation application (terminal side) on the mobile information terminal 700, it is possible to expand the function of the broadcast communication cooperation service by the cooperation operation between the broadcast receiving apparatus 100 and the mobile information terminal 700. FIG.

[EPG screen of broadcast receiving device]
FIG. 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving apparatus 100 of this embodiment. The EPG display screen 173e is a distribution schedule of broadcast programs in the digital broadcasting service of this embodiment, which is created by the main control unit 101 based on the program information data string output from the first separation unit 132. FIG. It is assumed that the EPG display screen 173e is displayed on the video display unit 173 by selecting the program guide key 741a7 on the basic screen 741a of the cooperative control application.

In this embodiment, the EPG display screen 173e is in a matrix form with the vertical axis representing time and the horizontal axis representing service IDs (channels). indicate. Detailed information 173e1 of each broadcast program is mainly composed of a title area 173e2 and a detailed description area 173e3, as shown in FIG. 16A.

The title area 173e2 displays the program title of each broadcast program, symbols representing attributes of each broadcast program, and the like. The symbols and the like representing the attributes of each broadcast program are, for example, a symbol that symbolizes "New" that means that it is a new program, a symbol that symbolizes "Replay" that means that it is a rebroadcast program, etc. Alternatively, a mark or the like that symbolizes "data", which means that data broadcasting by a broadcasting service is supported, may be used. Further, in the case of a broadcast program for which a broadcast cooperation application that can be executed by the broadcast receiving apparatus 100 of the present embodiment is prepared, a mark or the like that symbolizes "Linkage" to that effect may be used. The detailed explanation area 173e3 displays related information such as the contents of each broadcast program, the performers, the URL of the homepage introducing each broadcast program, and the like.

It should be noted that even if a broadcast cooperation application is prepared for the broadcast program, the mark or the like symbolizing the "Linkage" displayed in the title area 173e2 is displayed on the information display device as a result of checking the application profile 904. If execution by 100 is not possible, it may not be displayed. In addition, the mark symbolized by "Linkage", which is displayed in the title area 173e2 and indicates that the broadcast program is prepared with the executable broadcast-linked application, furthermore, the linked operation with the portable terminal device is possible. The color, shape, font, etc. may be changed depending on whether or not it is. If the linked operation with the portable terminal device is possible, the symbol symbolized "Mobile" may be displayed together with the symbol symbolized "Linkage".

The presence or absence of the mark symbolizing "Linkage" and the symbol symbolizing "Mobile" is indicated in advance in the EIT information including detailed information of each broadcast program. Whether or not the broadcast program has a broadcast cooperation application that can be executed by the broadcast receiving apparatus 100 of the embodiment, whether or not the executable broadcast cooperation application can perform cooperative operation with a mobile terminal device, It may be controlled by acquiring information such as. Alternatively, the information obtained from the program distribution information of the digital broadcast programs prepared in a predetermined server device on the Internet 200 is stored in an electronic program guide created based on the program information data string obtained from the broadcast waves of the digital broadcast service. You may make it add.

As described above, on the EPG display screen 173e, there is a symbolic mark of "Linkage" indicating that the broadcast program is prepared with an executable broadcast-linked application, and that linkage operation with a mobile terminal device is possible. By displaying a mark that symbolizes "Mobile" indicating , the user can easily grasp the correspondence status of each broadcast program in the broadcast receiving apparatus 100 to the broadcast-communication cooperation service. Needless to say, the marks obtained by symbolizing the predetermined characters representing the attributes of each broadcast program may be replaced with the characters themselves, sentences, or the like. By changing the background color of the detailed information 173e1 of each broadcast program, the correspondence status of each broadcast program to the broadcast-communication cooperation service may be indicated. In addition, the symbolized mark of "Linkage" and the symbolized mark of "Mobile" are not usually displayed in the title area 173e2. It may be made to be displayed.

The broadcast receiving apparatus 100 of this embodiment has a function of making viewing reservation and/or recording reservation for each broadcast program from the EPG display screen 173e. For example, while the EPG display screen 173e is displayed, the cursor key 741ac on the basic screen 741a of the cooperative control application is used to move the program selection cursor 173e4 on the EPG display screen 173e, and the enter key 741ad selects an arbitrary broadcast program. is selected, reservation for viewing and/or recording of the selected broadcast program is made.

In the above-described process, if the broadcast program for which the viewing reservation and/or the recording reservation has been made is a broadcast program corresponding to the broadcast and communication cooperation service, the broadcasting is triggered by the viewing reservation and/or the recording reservation. Acquisition of the broadcast cooperation application prepared for the broadcast program may be started without waiting for the broadcast start time of the program. That is, information (location information such as URL) designating the acquisition destination of the broadcast cooperation application is described in the EIT information including detailed information of each broadcast program. In this way, the broadcast receiving device 100 can grasp the information of the acquisition destination of the broadcast cooperation application prepared for each broadcast program at the time when the broadcast program is selected with the program selection cursor 173e4. Become. Therefore, the broadcast receiving apparatus 100 can start acquiring the broadcast cooperation application before the broadcast start time of the broadcast program.

In addition, if the broadcast program for which the viewing reservation and/or recording reservation has been made is a broadcast program compatible with the broadcast and communication cooperation service and is a broadcast program that can be operated in cooperation with the mobile terminal device, The broadcast cooperation application (terminal side) provided in the above may also start acquiring before the broadcast start time of the broadcast program by the same processing as described above. Also, as shown in FIG. 16B, a two-dimensional barcode 173e5 or the like indicating the information (location information such as URL) of the acquisition source of the broadcast cooperation application (terminal side) prepared for the mobile terminal device is displayed on the EPG display screen 173e. may be displayed to prompt the user to download the broadcast cooperation application (terminal side) prepared for the mobile terminal device.

In this way, if the broadcast receiving apparatus 100 refers to the acquisition destination information of the broadcast-linked application included in the EPG information and starts acquiring the broadcast-linked application before the broadcast start time of the broadcast program. , it becomes possible to distribute the load on the service provider server 400 that stores the broadcast cooperation application. Also, even if the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, the broadcast cooperation application can be effectively used immediately after the broadcast program starts broadcasting. become.

FIG. 17 is an operation sequence diagram showing an example of a broadcast cooperation application acquisition sequence when a broadcast program viewing reservation and/or recording reservation is made on the EPG display screen 173e.

While viewing a digital broadcast service, the main control unit 101 of the broadcast receiving device 100 acquires the program information data string output from the first separating unit 132 (S701). When the user uses the operating terminal to request activation of the EPG screen (S702), an EPG display screen 173e is displayed on the video display unit 173 (S703). When the user selects an arbitrary broadcast program using the operation terminal on the EPG display screen 173e to make a viewing reservation and/or recording reservation for the broadcast program (S704), the main control unit 101 performs the first separation The program information data string acquired from the unit 132 is confirmed (S705), and further, the location of the acquisition destination of the broadcast cooperation application linked to the broadcast program for which the viewing reservation and/or recording reservation has been made is confirmed (S706).

After the process of S706, the application control unit 161 transmits a transmission request for the broadcast cooperation application to the predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S708). Subsequently, the application control unit 161 caches the predetermined broadcast cooperation application distributed from the service provider server 400, which is received via the LAN communication unit 121, in the RAM 104 or the storage unit 110 (S709).

According to the broadcast receiving apparatus 100 of the present embodiment described above, it is possible to execute functions with higher added value.

A second embodiment of the present invention will be described below. It should be noted that the configuration and effects of this embodiment are the same as those of the first embodiment unless otherwise specified. Therefore, the differences between the present embodiment and the first embodiment will be mainly described below, and descriptions of common points will be omitted as much as possible to avoid duplication.

Although Embodiment 1 has also described an embodiment in which mobile information terminal cooperation processing (hereinafter referred to as terminal cooperation) is performed, a more detailed embodiment will be described.

When performing mobile information terminal cooperation, there are cases where it is desired to restrict the use of terminal cooperation to only mobile information terminal 700 in the same home as broadcast receiving apparatus 100 (this restriction is hereinafter referred to as same-home restriction). For example, in an application for using broadcast cooperation (hereinafter referred to as a broadcast cooperation application), when the display screen of the broadcast receiving device 100 and the display screen of the mobile information terminal 700 are closely related, or when the broadcast receiving device 100 This is the case, for example, when it is desired that the user of the mobile information terminal 700 certainly views the displayed advertisement video.

A point that must be considered as a procedure is a judgment as to whether or not the target broadcast-linked application imposes same-home restrictions. If it is assumed that all broadcast-linked applications are restricted within the same home, this determination is not necessary. will need to acquire and change operating procedures. The control information regarding the presence or absence of this restriction may be acquired from the broadcast signal (for example, described as an item of AIT) or may be acquired from a server designated by the broadcasting station.

In this embodiment, including the above procedure, the procedure for ensuring that the portable information terminal 700 and the broadcast receiving apparatus 100 are in the same home will be described.

Generally, devices existing in the same home exist on a local network connected to the same router device 210 . Therefore, it can be determined that the mobile information terminal 700 is connected to the same local network as the broadcast receiving apparatus 100, and that the mobile information terminal 700 exists in the same house. A well-known method may be used to determine whether or not the target device is connected to the local network, and a description thereof will be omitted.

Also, even if the portable information terminal 700 is not on the local network, it can be determined that it exists in the same home by directly communicating with the broadcast receiving apparatus 100 using NFC, BlueTooth, infrared communication, or the like. In this case, the communication for acquiring the broadcast-linked application or the like may be the above-described direct communication or mobile phone communication.

As described above, there are a plurality of possible methods for confirming the presence in the same home.

Furthermore, once it is confirmed that the portable information terminal 700 exists in the same home, it may be assumed that it exists in the same home until the end of the program. is assumed to exist in the same house, but if the valid time has passed, it is not assumed to exist in the same house unless a new confirmation is made. This valid time is described in AIT, for example, and read by the broadcast receiving apparatus 100 .

Furthermore, for example, an event signal may be set in the broadcast signal at an arbitrary point during program progress, and the presence of the portable information terminal 700 in the same home may be confirmed each time the event signal is received. can also

It is also possible to use a combination of the former two methods.

Next, a specific procedure for permitting terminal cooperation only to portable information terminals 700 existing in the same home will be described. In this embodiment, restrictions are set when the mobile information terminal 700 acquires a broadcast-linked application or acquires information used by the broadcast-linked application (hereinafter referred to as a broadcast-linked application and information used by the broadcast-linked application, specifically Typically, it is an HTML document, streaming video, etc., but they are collectively called broadcast link information). There are two methods for obtaining the broadcast linkage information: communication acquisition, which acquires from the broadcasting station server 300 or the provider server 400, and broadcast acquisition, which acquires from broadcast waves. In the case of communication acquisition, there are two methods: acquisition after the start of broadcast reception and acquisition before the start of broadcast reception. Furthermore, in the case of communication acquisition, when the broadcast receiving device 100 acquires once and the mobile information terminal 700 acquires from the broadcast receiving device 100, and when the mobile information terminal 700 acquires directly from the broadcast station server 300 or the operator server 400 There is There are various methods, but when viewed from the portable information terminal 700 , it can be roughly divided into two cases: acquisition from the broadcast receiving device 100 and acquisition from the broadcast station server 300 or the provider server 400 .

In this embodiment, a case where the mobile information terminal 700 acquires the broadcast cooperation information from the broadcast receiving apparatus 100 will be described, and a case where it is acquired from the server will be described in the next embodiment.

FIG. 18A shows the procedure of this example.

First, before performing terminal cooperation, a cooperation control application, which is an application for controlling terminal cooperation, is activated in each of the mobile information terminal 700 and the broadcast receiving apparatus 100 (S10001, S10002). In this state, the portable information terminal 700 makes a terminal cooperation request to the broadcast receiving apparatus 100 (S10003). Next, AIT is obtained from the broadcast signal (S10004). From this AIT information, it is determined whether or not the application for the target mobile information terminal has restrictions within the same home (S10006). Then, the process proceeds to step S10009, and it is determined whether or not the mobile information terminal 700 that requested terminal cooperation is in the same home as the broadcast receiver 100 (S10009). As a result of the determination, if it is determined that the device is not in the same home, a response of non-permission of cooperation is sent to the cooperation control application on the portable information terminal side, and the process ends (S10011).

Here, in the case of the premise that all broadcast cooperation applications have the same in-house restriction, the determination in S10006 is skipped without being performed. S10006 is determined when there are both applications with and without the same in-house restriction.

If it is determined that mobile information terminal 700 is in the same home, or if the application does not have same-home restrictions, the process advances to S10012 to perform broadcast-linked application-related services. In this service (S10012), the broadcast cooperation information distribution request (S10013) from the mobile information terminal 700 is processed, and the broadcast cooperation information is distributed to the mobile information terminal 700 (S10018). This broadcast cooperation information includes information received by the broadcast receiving apparatus 100 from a distribution server, which is the provider server 300 (S10014, S10015, S10016), information acquired from the broadcast signal (S10017), and information stored in the broadcast receiving apparatus 100. There are things that have been done. The reception of the broadcast cooperation information by the broadcast receiving device 100 (S10016, S10017) is not limited to the broadcast cooperation information delivery request (S10013) from the mobile information terminal 700, but the broadcast receiving device 100 autonomously obtains it, There may be cases where acquisition is based on occurrence of events from broadcast signals. Also, the distribution of the broadcast linkage information to the portable information terminal 700 (S10018) may be voluntarily performed by the broadcast receiving apparatus 100 side.

After a series of reception (acquisition) and distribution processing of the broadcast cooperation information is completed, it is determined whether or not the broadcast receiving apparatus 100 continues viewing the same program (S10019). A response of cooperation disapproval is sent to the cooperation control application, and the process ends (S10020).

If the viewing is continued, the procedure returns to S10005, and if there is an in-home restriction, it is checked whether the mobile information terminal 700 is in the same home (S10009). or whether there has been a confirmation request (S10007) from the broadcast signal or distribution server since the previous confirmation (S10008). Confirmation (S10009) is not performed, and execution of the next broadcast-linked application-related service (S10012) is performed via S10010. Here, it is described that the confirmation request (S10007) from the broadcast signal is obtained from the broadcast cooperation information, but here, the event message is also included in the broadcast cooperation information. Furthermore, this confirmation request may be written in the AIT.

The procedure described above is a loop processing procedure for the entire broadcast signal, broadcast receiving apparatus 100, mobile information terminal 700, and distribution server in the section indicated by the arrow in S10022. The confirmation request in S10007 may be made at any timing within the loop.

Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication in the distribution server (S10015). This makes it possible to confirm that the authentication request is legitimate. In addition, if the authentication information described in the AIT is changed as the program progresses, and if the delivery server does not perform authentication unless the authentication key incorporates information synchronized with the progress of the program, then the same program You can confirm that you continue to watch. In this case, the AIT information is appropriately read and updated (S10021). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast cooperation information instead of being described in the AIT. Furthermore, as a method of substantially changing the authentication information, it is also possible to use a method of changing the URL itself of the distribution server according to the progress of the program.

In this way, while executing the broadcast-linked application-related service (S10012), the portable information terminal 700 receives the broadcast at each preset effective time, or at each broadcast signal or confirmation request from the distribution server. By confirming whether or not the device 100 is in the same home as the device 100, it is possible to appropriately execute broadcast-related applications with same-home restrictions. Furthermore, by using the authentication information embedded in the broadcast signal for authentication in the distribution server, it is possible to ensure the validity of the distribution request. You can also confirm that you are still watching.

According to the mobile information terminal linking technology according to the present embodiment described above, it is possible to implement the same home restriction for the mobile information terminal linked with the broadcast receiving apparatus.

In this embodiment, a case will be described in which the mobile information terminal 700 acquires the broadcast cooperation information from the distribution server.

FIG. 18B shows the procedure of this example.

First, before performing terminal cooperation, a cooperation control application, which is an application for controlling terminal cooperation, is activated in each of the mobile information terminal 700 and the broadcast receiving apparatus 100 (S10101, S10102). In this state, the mobile information terminal 700 makes a terminal cooperation request to the broadcast receiving apparatus 100 (S10103). Next, AIT is obtained from the broadcast signal (S10104). Information such as the URL of the distribution server is obtained from this AIT information, and the information is transmitted to the portable information terminal 700 (S10105). Next, the broadcast receiving apparatus 100 issues a time confirmation request to the distribution server (S10106), and based on this request, the distribution server transmits time information to the broadcast receiving apparatus 100 (S10107). As a result, the subsequent authentication key issuance (S10115) can be performed according to the time of the distribution server.

Thereafter, loop control indicated by an arrow in S10127 is entered.

First, portable information terminal 700 issues an authentication key issuance request or a broadcast cooperation information distribution request to broadcast receiving apparatus 100 (S10109). The authentication key is used in the broadcast cooperation information distribution request to the distribution server in the latter stage (S10125). The broadcast cooperation distribution request in S10109 is a distribution request for information acquired from the broadcast signal, and corresponds to the procedure of S10126 in the latter stage.

In any case, when the request of S10109 is issued from the portable information terminal, it is determined whether or not the broadcast collaboration application has restrictions within the same home (S10111). Skip to S10114. If all the broadcast cooperation applications have the same in-home restriction, the determination in S10111 is not performed, and the process proceeds to S10112. In S10112, it is determined whether or not the portable information terminal that has issued the request is in the same home, and if not, terminal cooperation is terminated (S10113). If it is in the same house, the requested procedure, acquisition of broadcast cooperation information from the distribution server (S10125) or acquisition of broadcast cooperation information from the broadcast signal (S10126), is performed. The procedure of S10126 is also described because acquisition from the broadcast signal may be performed in addition to the acquisition from the distribution server.

First, the acquisition procedure (S10125) of the broadcast cooperation information from the distribution server will be described.

First, the broadcasting receiver 100 issues an authentication key requested by the information linking terminal 700 . At this time, it is assumed that the authentication key includes time information at the time of issuance and is valid only within a predetermined period of time (for example, 10 minutes). The distribution server confirms the authentication information including whether the authentication key is within the validity period, and permits distribution of the broadcast cooperation information if the authentication is OK. After that, the distribution of information is permitted within the effective time, but the distribution is stopped when the effective time expires. For example, the streaming video cannot be viewed after the effective time has passed.

The preset valid time may be held in the distribution server, or may be obtained by the broadcast receiving apparatus 100 from the broadcast signal (for example, AIT), and the valid time information may be incorporated into the authentication key. The valid time information is notified to the mobile information terminal 700 in advance so that the issuance of the authentication key is requested before the valid time expires. Alternatively, the valid time is managed by the broadcast receiving device 100, and after confirming that the mobile information terminal 700 is in the same home before the valid time expires, the broadcast receiving device 100 automatically sends the mobile information terminal 700. You may issue an authentication key to it.

The valid time may be the same in one program, or may be changed according to the progress of the program. Also, if there is no valid time setting, once authentication is performed, the authentication may be valid while the program is being viewed.

Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication on the distribution server (S10117). This makes it possible to confirm that the authentication request is legitimate. In addition, if the authentication information described in the AIT is changed as the program progresses, and if the delivery server does not perform authentication unless the authentication key incorporates information synchronized with the progress of the program, then the same program You can confirm that you continue to watch. In this case, the AIT information is appropriately read and updated (S10124). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast cooperation information instead of being described in the AIT. Furthermore, as a method of substantially changing the authentication information, it is also possible to use a method of changing the URL itself of the distribution server according to the progress of the program. In this case, the URL is changed when the distribution server is the same but the entrance is different. In this case, the procedures of transmitting distribution server information (S10105), requesting time confirmation (S10106), and transmitting time information (S10107) are performed each time the change is made.

Next, a procedure (S10126) for acquiring broadcast cooperation information from a broadcast signal will be described.

In this case, after confirming that mobile information terminal 700 is in the same home, broadcast receiving apparatus 100 acquires broadcast cooperation information from the broadcast signal (S10119), and then distributes the information to mobile information terminal 700. (S10120).

When the broadcast cooperation information is changed as the program progresses, a change notification may be issued from the broadcast signal (S10110), and the broadcast cooperation information may be acquired with the notification as a trigger. In this case, if it is acquired from the distribution server, the broadcast receiving apparatus 100 issues an authentication key to the portable information terminal (S10115) and notifies that there has been a change notification. If it is within the validity period, the issuance of the authentication key may be omitted and only the change notification may be sent. In the case of acquisition from a broadcast signal, the broadcast receiving apparatus 100 acquires information (S10119) and distributes it to the mobile information terminal (S10120). In addition, in the case of acquisition from a broadcast signal, it may be confirmed that the mobile information terminal 700 is in the same home for each change notification. I don't mind. Here, it is described that the notification of change from the broadcast signal (S10110) is obtained from the broadcast linkage information, but here it is described that the event message is also included in the broadcast linkage information. Furthermore, this change notification may be written in the AIT.

After a series of reception (acquisition) and distribution processing of the broadcast cooperation information is completed, it is determined whether or not the broadcast receiving apparatus 100 continues viewing the same program (S10121). A response of cooperation disapproval is sent to the cooperation control application, and the process ends (S10123). If viewing is continued, the process returns to S10108 to continue loop processing S10127.

In this way, by including the time information in the authentication key used for authentication of the distribution server and managing the validity period, it is possible to periodically confirm that the portable information terminal 700 is in the same home as the broadcast receiving apparatus 100. It is possible to appropriately execute the broadcast cooperation application with the same in-house restriction. Furthermore, by using the authentication information embedded in the broadcast signal for authentication in the distribution server, it is possible to ensure the validity of the distribution request. You can also confirm that you are still watching.

According to the mobile information terminal cooperation technology according to the present embodiment described above, even when the mobile information terminal that cooperates with the broadcast receiving apparatus acquires the broadcast cooperation information from the distribution server, it is possible to realize the same home restriction. .

In Embodiments 2 and 3, the procedure for realizing the intra-house restriction in terminal cooperation has been described, but depending on the broadcast cooperation application, use from outside the home may also be permitted. This embodiment will explain such a case. For example, when a program such as television shopping is publicity/advertisement, it is desirable for broadcasters to be able to use the broadcast cooperation application regardless of whether it is inside or outside the home. In the case of such a program, once registered in the broadcast receiving apparatus 100, use of the broadcast cooperation application may be permitted regardless of whether the mobile information terminal 700 is at home. In this case, if there is a broadcast cooperation application that converts the broadcast video itself into streaming data and distributes it from the broadcast receiving device 100 to the mobile information terminal 700 via the Internet, the convenience will be further enhanced. Streaming data may be encrypted in broadcast receiving apparatus 100 for copyright protection. Whether or not the broadcast cooperation application permits use from outside the home, including distribution of broadcast video outside the home, is described in data (for example, AIT) in the broadcast signal.

A specific procedure is shown in FIG. 18C. Since a part of the procedure is common to the second and third embodiments, the description of the parts overlapping with the second and third embodiments will be omitted. When there is a terminal cooperation request (S10203) from outside the home, if the application is permitted to be used outside the home, the broadcast receiving device 100 confirms whether the request source is a registered portable information terminal ( S10205) allows cooperation. If necessary, personal digital assistant 700 and broadcast receiver 100 may be authenticated for copyright protection of broadcast video and broadcast link information (S10207). At that time, the authentication may be authentication in the distribution server (S10207). Information on whether or not copyright protection is required and information on the authentication method for copyright protection are acquired from the broadcast signal (for example, described in AIT), and control is performed accordingly. If such information is not stored in the broadcast signal, a predetermined method predetermined in broadcast receiving apparatus 100 is followed. For example, predetermined copyright protection processing may be performed. Further, it may be determined in advance that the broadcast receiving apparatus 100 does not perform copyright protection processing when such information is not stored in the broadcast signal.

A specific example of authentication for copyright protection is shown below. Only one of each of the following authentications may be performed. Alternatively, a plurality of authentications exemplified below may be combined. Also, the authentication illustrated below may be combined with other authentication processing not illustrated below.

[Authentication by ID and password]
When the mobile information terminal 700 is registered with the broadcast receiving apparatus 100, an ID and password are issued, and the broadcast receiving apparatus 100 confirms the ID and password and permits cooperation.

[Use encryption key]
In addition to authentication by the above ID and password, an encryption key for decrypting encrypted video data or the like is transmitted from the broadcast receiving apparatus 100 to the portable information terminal. This encryption key may be acquired from a broadcast signal (for example, described in AIT).

[Use of distribution server]
A method in which a distribution server issues an encryption key for decrypting encrypted video data. Portable information terminal 700 transmits the ID and password to the distribution server and acquires the encryption key. In this case, the location information (specifically, the URL) of the distribution server is acquired from the broadcast signal (for example, described in the AIT), and by transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700, More safety. If the mobile information terminal 700 cannot obtain the encryption key, it cannot decrypt the video or the like. Authentication may be completed by notifying broadcast receiving apparatus 100 from 700 that the encryption key has been obtained. Note that billing may be performed by the distribution server.

[Mutual Authentication of Encryption Key]
The encryption keys possessed by the broadcast receiving apparatus 100 and the portable information terminal 700 are mutually authenticated, and copyright protection is authenticated by obtaining confirmation.

When information stored in a broadcast signal indicates that copyright protection is required by a prescribed method, terminal cooperation is not permitted if copyright protection cannot be authenticated by the prescribed method. Moreover, even if there is no designation in the broadcast signal and authentication is performed by the default method of the broadcast receiving apparatus 100, terminal cooperation is not permitted if copyright protection cannot be authenticated by the default method.

When terminal cooperation is permitted, it is not confirmed whether or not the mobile information terminal 700 exists in the same house thereafter, and the request from the mobile information terminal 700 (S10211), the autonomous control of the broadcast receiving apparatus 100, the broadcast signal In accordance with the request (S10210) from (S10210), broadcast cooperation information is distributed to the mobile information terminal 700 (S10217), and an authentication key for the distribution server is issued (S10212). In this case, it is not necessary to perform control in which the valid time is set. Portable information terminal 700 outside the home acquires the broadcast cooperation information from broadcast receiving apparatus 100 or the distribution server using the issued authentication key (S10215). Also, the authentication information obtained from the broadcast signal (for example, described in the AIT) is embedded in the authentication key issued by the broadcast receiving apparatus 100, and the distribution server uses the authentication key in which the authentication information obtained from the broadcast signal is embedded. If access is permitted if there is, it is possible to further optimize the use outside the home.

Furthermore, there are cases where it is better not to allow unlimited use of broadcast-linked apps, such as when discounting premiums for watching programs. After that, it is preferable to permit the use of the distribution server even if it is not in the same house. In this case, mobile information terminal 700 does not have to be registered with broadcast receiving apparatus 100 .

A specific procedure in this case is shown in FIG. 18D. Since this procedure is partly the same as that of FIG. 18C, the explanation of the overlapping parts is omitted. First, in a state where mobile information terminal 700 is in the same home as broadcast receiving apparatus 100, mobile information terminal 700 issues a terminal cooperation request to broadcast receiving apparatus 100. (S10305) and permits cooperation. If necessary, personal digital assistant 700 and broadcast receiving apparatus 100 may be authenticated for copyright protection of broadcast video and broadcast link information (S10307). At that time, the authentication may be performed by an external distribution server. Information on whether or not copyright protection is required and information on the authentication method for copyright protection are acquired from the broadcast signal (for example, described in AIT), and control is performed accordingly. If such information is not stored in the broadcast signal, a predetermined method predetermined in broadcast receiving apparatus 100 is followed. For example, predetermined copyright protection processing may be performed. Further, it may be determined in advance that the broadcast receiving apparatus 100 does not perform copyright protection processing when such information is not stored in the broadcast signal.

A specific example of authentication for copyright protection is shown below. Only one of each of the following authentications may be performed. Alternatively, a plurality of authentications exemplified below may be combined. Also, the authentication illustrated below may be combined with other authentication processing not illustrated below.

[Use encryption key]
While portable information terminal 700 is in the same home, broadcast receiving apparatus 100 transmits an encryption key for decrypting encrypted video data and the like to the portable information terminal. This encryption key may be acquired from a broadcast signal (for example, described in AIT). Authentication is achieved by handing over this encryption key within the same home. Furthermore, if the encryption key cannot be obtained from the broadcast signal until a certain point in the program, and the transfer of the encryption key to the portable information terminal 700 is limited to within the same home, the user must be in the same home at that time. Limits can be set and can be used to award premiums for viewing.

[Use of distribution server]
A method in which a distribution server issues an encryption key for decrypting encrypted video data. Portable information terminal 700 transmits the ID and password to the distribution server and acquires the encryption key. In this case, the location information (specifically, the URL) of the distribution server is acquired from the broadcast signal (for example, described in the AIT), and by transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700, More safety. If the mobile information terminal 700 cannot obtain the encryption key, it cannot decrypt the video or the like. Authentication may be completed by notifying broadcast receiving apparatus 100 from 700 that the encryption key has been obtained. Access to the distribution server may be performed inside or outside the home, but the location information of the distribution server cannot be obtained from the broadcast signal until a certain point in the program. If the delivery of the content is limited to within the same home, it is possible to set a restriction that the user must be in the same home at that time, which can be used to give a premium to viewing. Note that billing may be performed by the distribution server.

[Mutual Authentication of Encryption Key]
The encryption keys possessed by the broadcast receiving apparatus 100 and the portable information terminal 700 are mutually authenticated, and copyright protection is authenticated by obtaining confirmation. This authentication may be performed inside the house or outside the house.

When information stored in a broadcast signal indicates that copyright protection is required by a prescribed method, terminal cooperation is not permitted if copyright protection cannot be authenticated by the prescribed method. Moreover, even if there is no designation in the broadcast signal and authentication is performed by the default method of the broadcast receiver 100, terminal cooperation is not permitted if copyright protection cannot be authenticated by the default method. The procedure after terminal cooperation is permitted is the same as the procedure in FIG. 18C, so the explanation is omitted.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to use the mobile information terminal that cooperates with the broadcast receiving apparatus from outside the home while paying attention to copyright protection.

In an actual usage situation, it is more desirable to easily know whether or not there is a terminal-linked application for each program and which terminal-linked application can be used. In this embodiment, a method for displaying the availability of terminal-linked applications will be described. A terminal cooperation application refers to a broadcast cooperation application used in terminal cooperation.

FIG. 19A is an example of the launcher screen (173b11) of the broadcast cooperation application when there is a terminal cooperation application. The broadcast-linked application is displayed as a framed character icon. Broadcast cooperation applications (173b12 to 173b14) for the broadcast receiving apparatus 100 and broadcast cooperation applications (173b15 to 173b17) for the portable information terminal, which are associated with the program being viewed, are displayed. In this example, the application status is indicated by the thickness of the border surrounding the character string and the color of the border. Main body applications A, B (173b12, 173b13) and terminal applications A, B (173b15, 173b16) are available, and main body application C (173b14) and terminal application C (173b17) are unavailable. . A state in which the terminal application cannot be used means that none of the mobile information terminals 700 that are in a state of being able to communicate with the broadcast receiving apparatus 100 have the function to execute the application.

FIG. 19B is a screen after terminal application A is selected in FIG. 19A. The state of each mobile information terminal 700 related to terminal application A is shown. The portable information terminals displayed on this screen are terminals that have been linked with or registered with the broadcast receiving apparatus 100 in the past.

Mobile terminal 1 (173b22) and mobile terminal 2 (173b23) whose icons have a solid line frame are in a state capable of communicating with the broadcast receiving apparatus 100, and mobile terminal 3 (173b24) whose icon frame has a dotted line. and mobile terminal 4 (173b25) are not in a state where communication with broadcast receiving apparatus 100 is possible. Mobile terminal 1 (173b22) and mobile terminal 3 (173b24) whose icon frames are white have the function of executing terminal application A, and mobile terminal 2 (173b23) and mobile terminal 4 whose icon frames are gray. (173b25) indicates that the terminal application A does not have the function to execute. Furthermore, if the app is already running on the device, you may use an icon with a design that indicates that.

In addition, the icon is visually easier to understand if a pattern is used, so an example is shown below.

FIG. 19C is an example of a launcher screen (173b31) showing a list of broadcast cooperation applications. Icons are shown for each type of mobile information terminal 700 in addition to the broadcast receiving device 100 . Icons 173b32 and 173b33 indicate the broadcast receiver 100, icons 173b34 and 173b35 indicate the smart phone type mobile information terminal 700, and icon 173b36 indicates the head mounted display type mobile information terminal 700. FIG. Each app is for the device indicated by the icon.

In FIG. 19C, when the application cannot be used, a mark (in this case, a circle with diagonal lines) is displayed superimposed on the image of the device to indicate that the application is not available. Also, regarding the broadcast receiving apparatus 100, if the application is already running, a mark indicating that fact (in this case, a circle with a dot) may be superimposed and displayed. With this display, it is possible to prevent the unnecessary operation of advancing the launcher procedure even though it has already been executed. In the case of the portable information terminal 700, it is also possible to display a mark indicating that the application is being executed when the application is being executed on all terminals that are capable of communicating with the broadcast receiver and that can execute the application.

FIG. 19D is the screen (173b41) after selecting application C (173b34) in FIG. 19C. The state of the portable information terminal 700 of the type corresponding to the application C is shown. On this screen, if the mobile information terminal 700 does not have the function of executing the broadcast-linked application, if it is not in a state capable of communicating with the broadcast receiving device 100, or if the broadcast-linked application is already being executed, it is displayed. A mark representing the object is superimposed on the icon. In this example, a circle is marked with a slash (173b44, 173b46) if it does not have an execution function, a triangle is marked with an exclamation mark (173b45, 173b46) if communication is not possible, and a circle is marked if it is already running. mark (173b43) is displayed.

Furthermore, it is desirable to have a display method that shows that there is a broadcast cooperation application when the situation changes without having to activate the launcher each time. For example, when the power is turned on, when the channel is changed, when the broadcast cooperation application is changed at the beginning of the program or during the program, there is a change in the communication state between the broadcast receiving device 100 and the portable information terminal 700. In this case, when the execution status of the application changes, the icon is displayed only for a predetermined time, and the status at that time is displayed.

FIG. 19E shows an example of such a case. When an icon indicating the type of each device is displayed, it indicates that there is a broadcast cooperation application corresponding to that type of device. In this case, a circle with a slash indicates that there are no devices of that type that are enabled to run the app. A dot in a circle indicates that the app is running on all enabled devices of that type.

FIG. 19F is a display screen (10401) on the portable information terminal 700. FIG. When requesting terminal cooperation from the portable information terminal 700, it is more convenient to use a list that shows which broadcast cooperation application can be used in which broadcast receiving device 100. FIG. FIG. 19F shows an example of the list (10402). This table shows which broadcast receiver 100 at home can use the broadcast cooperation application corresponding to the program to be checked. In addition, if the status of each broadcast receiving device 100 is also displayed, the convenience will be enhanced especially when the device is used from outside the home. This example shows display examples such as the program being received, another program being received, empty, and another program reserved (when recording of another program is reserved from the middle of the program). Here, if a plurality of tuners exist in the broadcast receiving apparatus 100, displaying the status for each of the plurality of tuners will further enhance convenience. In Table 10202, branch numbers indicate tuners in the same device. For example, the receiving device B-1 and the receiving device B-2 are tuners in the same broadcast receiving device 100. FIG. In the case of terminal cooperation, if broadcast video and audio can be distributed as streaming data, there is no need to use the video unit of the broadcast receiving device 100, and if the tuner in the broadcast receiving device 100 can be used, broadcasting can be used. Therefore, it is convenient to know the usage status of each tuner.

In addition, in order to perform the display described in this embodiment, information indicating whether the application corresponds to the broadcast receiving apparatus 100 or what type of portable information terminal 700 the application corresponds to is required for each broadcast-linked application. must be Also, broadcast receiving apparatus 100 and mobile information terminal 700 require information for executing corresponding applications. These pieces of information can be obtained by the broadcast receiving apparatus 100 by describing them in the AIT, for example.

According to the portable information terminal cooperation technology according to the present embodiment described above, it is possible to use a more convenient broadcast cooperation service by displaying information about the broadcast cooperation application, the broadcast receiving device 100, and the portable information terminal 700. becomes.

Hereinafter, in Embodiments 6 to 10, the broadcast receiving apparatus 100 will be referred to as an information display apparatus.

First, Example 6 will be described with reference to FIGS. 2C, 2D, and 20 to 24. FIG. It should be noted that the configuration, effect, etc., of Example 6 are the same as those of Example 1 unless otherwise specified. Therefore, the differences between the sixth embodiment and the first embodiment will be mainly described below, and descriptions of the common points will be omitted as much as possible.

In Examples 1 to 5, one broadcast program is displayed on the broadcast receiving apparatus 100 . On the other hand, a plurality of broadcast programs are displayed on the information display device of the sixth embodiment.

[Hardware configuration of information display device]
FIG. 2C is a block diagram of the information display device 1000 according to the sixth embodiment. As shown in FIG. 2C, the information display device 1000 includes a video display unit 173, a video output unit 175, an audio reproduction unit 174b, an audio output unit 176, and a viewer instruction input unit 25001 (described later, FIG. 2D). , a content input unit 25002 , a content playback unit 25003 , a content recording/playback unit 25004 , and a control unit 25005 .

A viewer instruction input unit 25001 receives instruction information received from a viewer by a device (for example, a remote control (described later, FIG. 22A)).

The content input unit 25002 acquires content (for example, broadcast content, content on the Internet, recorded content). Specifically, the content input unit 25002 includes the tuner/demodulator unit 131 (described above, FIG. 2A) that receives broadcast content, the LAN communication unit 121 (described above, FIG. 2A) that acquires content on the Internet, and the external recording content. 2A) or the digital interface unit 125 (described above, FIG. 2A) when inputting from a content reproducing device or the like.

The content reproduction unit 25003 reproduces recorded content. Specifically, the content reproduction unit 25003 is the storage unit 110 (described above, FIG. 2A). More specifically, the storage unit 110 is a drive or the like for recording media such as optical discs.

The content recording/playback unit 25004 performs recording/playback of content (recording/reading in the case of content on the Internet). Specifically, the content recording/playback unit 25004 is the storage unit 110 (described above, FIG. 2A), the RAM 104 (described above, FIG. 2A), and the like.

The controller 25005 is a set of controllers including the main controller 101 (described above, FIG. 2A).

The control unit 25005 is used to display a main window that displays main content, which is the main video of the broadcast program, and a sub window that displays sub-content included in the execution screen of the broadcast cooperation application that cooperates with the broadcast program. The video information is output to the video output unit 175 . Video output unit 175 outputs the video information output from control unit 25005 to an external display device (such as a display).

Further, the control unit 25005 causes the video display unit 173 to display the main window and the sub-window. In addition, on the execution screen of the broadcast cooperation application, information accompanying the main video of the broadcast program (for example, weather forecast, response from the viewer of the broadcast program, profile of the performer of the broadcast program, etc.) is displayed. be. For example, if the broadcast program is a marathon broadcast, the main window displays an image from a relay person (for example, an image of a runner running near the top), and the subwindow displays an image of a runner running away from the top. A player image is displayed.

The control unit 25005 also controls the display of windows displayed on the video display unit 173 . Also, the control unit 25005 controls the audio reproduction unit 174b and the audio output unit 176. FIG.

The audio reproduction unit 174b reproduces audio. Specifically, the audio reproduction unit 174b is the speaker 174 (described above, FIG. 2A). Note that the audio reproducing unit 174b also includes an earphone.

The audio output unit 176 outputs audio information. For example, the audio output unit 176 outputs audio information (audio signal) to an external output device (such as a speaker). In the following description, in order to distinguish from the case of outputting audio information (audio signal) from the audio output unit 176, the case of outputting audio from the audio reproducing unit 174b is referred to as audio reproduction.

The image display unit 173 displays the window shape specification information and the window contextual relationship included in the window related specification information (the window related specification information is a general term for the window related specification information such as the window shape specification information and the window contextual relationship specification information). Display the main window based on the specified information. Also, the broadcast signal (for example, AIT) may include window shape designation information. Furthermore, the window shape specification information may include whether part or all of the window-related specification information can be changed by the viewer's selection. In the case of recorded content, the video display unit 173 may display a main window based on window shape designation information stored in advance as content group related information. Further, in the case of content on the Internet, the video display unit 173 may display a main window based on window shape designation information distributed together with the content as content group related information. The size of the window, that is, the size of the image display area is preferably adjusted according to the size and the number of pixels of the information display device 1000. It is good also as several designated information according to.

Video display unit 173 displays a main window that displays the main video of the broadcast program, and a sub-window that displays the execution screen of the broadcast cooperation application that cooperates with the broadcast program.

In addition, the video display unit 173 displays recorded programs and content on the Internet in addition to broadcast programs received from broadcast waves. Hereinafter, broadcast content received from broadcast waves, content on the Internet, recorded content, and the like may be collectively referred to as content.

The video output unit 175 outputs video information to an external display device for displaying a main window for displaying the main video of the broadcast program and a sub-window for displaying the execution screen of the broadcast collaboration application linked with the broadcast program. Output.

The video output unit 175 also outputs video information for displaying recorded programs and contents on the Internet to an external display device in addition to broadcast programs received from broadcast waves.
[Audience instruction input unit]

FIG. 2D is a diagram showing an example of the viewer instruction input unit 25001 of the information display device according to the example. The viewer instruction input unit 25001 receives instruction information input by the device from the viewer.

Devices that receive input of instruction information from the viewer are, specifically, the remote control 25102, the mouse 25104, the touch pad 25106, the keyboard 25108, the mobile information terminal 25110, the touch panel 25111, and the like.

When these input devices (remote controller 25102, mouse 25104, touch pad 25106, keyboard 25108, mobile information terminal 25110, touch panel 25111) are integrated with the information display device 1000, the input devices themselves are the viewer instruction input unit 25001. becomes. On the other hand, when these input devices are not integrated with the information display device 1000 and are connected to the information display device 1000 via wireless or wired connection, the input ports 25101, 25103, 25105, 25107, and 25109 are It becomes a viewer instruction input unit 25001 . Also, when the portable information terminal 25110 is used as an input device and connected to the information display device via a LAN, the LAN communication section 121 (described above, FIG. 2A) becomes the viewer instruction input section 25001 .

A keyboard 25108 (including a case where a portable information terminal is used as character input means) activates an Internet browser and accepts character input to the browser when searching for content groups on the Internet.

The mobile information terminal 25110 and the touch panel 25111 detect a touch operation on the screen display area, and execute processing corresponding to the position where the touch operation is accepted.

[Screen display of information display device]
An example of a screen when video display unit 173 displays two broadcast programs will be described below with reference to FIG. 20A.

20A shows a first main window 20000 corresponding to broadcast signal 1, a first sub-window 20001 corresponding to broadcast signal 1, a second main window 20002 corresponding to broadcast signal 2, and a second main window 20002 corresponding to broadcast signal 2. 2 sub-window 20003 is displayed by the video display unit 173. FIG. Here, the main video of the broadcast program is displayed in the first main window 20000 and the second main window 20002, which are the main windows, shown in FIG. 20A. On the other hand, in first subwindow 20001 and second subwindow 20003, which are subwindows, execution screens of broadcast cooperation applications that cooperate with broadcast programs are displayed.

Hereinafter, the content included in the main windows such as the first main window 20000 and the second main window 20002 displayed by the video display unit 173 may be referred to as main content. Contents included in subwindows such as the first subwindow 20001 and the second subwindow 20003 are sometimes referred to as subcontents.

Also, a set of contents consisting of main contents and sub-contents related to the main contents may be called a content group. There may be cases where there is only main content, but here, such a case is also called a content group. Therefore, the content group described below includes main content, a set of content consisting of main content and related sub-contents, or a single main content that does not have related sub-contents.

In addition, as a specific example, the content group includes the main video of the above-described broadcast program (including the broadcast program received from the terrestrial wave and the recorded program), and the execution screen of the broadcast cooperation application that cooperates with the broadcast program. Consists of As another specific example, the content group consists of content on the Internet (eg, WEB page) and streaming video included in the content (eg, streaming video included in the WEB page). As another specific example, the content group consists of content on the Internet (for example, a WEB page) and other content displayed in multiple windows opened by the same application. Note that the sub-window displayed by the video display unit 173 may include a plurality of sub-contents. Also, in the case of a VOD (Video On Demand) or a broadcast cooperation application for a recorded program, the application may be deleted from the designated distribution server. In such a case, perform alternative processing (for example, connecting to an alternative connection URL) described in the AIT or accompanying information, or if there is no provision for alternative processing, display that in a subwindow and do not start the application. It is good as

The video output unit 175 outputs video information for displaying videos of a plurality of content groups in different windows for each content group to an external display device.

The video display unit 173 displays videos of a plurality of content groups in different windows for each content group.

A viewer instruction input unit 25001 receives an input for setting a content group to be selected from a plurality of content groups.

Of the content groups simultaneously displayed by the video display unit 173 (or output by the video output unit 175), only one content group is set as selected, and all the other content groups are set as non-selected. Then, the audio output unit 176 outputs audio information of audio corresponding to the selected content group. Also, the audio reproduction unit 174b reproduces audio corresponding to the selected content group. As a result, it is possible to prevent the sounds of a plurality of content groups from being mixed.

When an input to switch the content group to be in the selected state is received, the content group after switching is set as the set state, and the content group that was in the selected state so far is set as the non-selected state. Then, the audio reproducing unit 174b/audio output unit 176 stops reproducing/outputting the audio that has been reproduced so far, and reproduces/outputs the audio of the content group that is newly set.

Specifically, a pointing device such as a mouse 25104 or a touch pad 25106 (including a case where the portable information terminal 25110 is used as a pointing device) moves the cursor 20004 to a window displaying a content group to be selected, and clicks. By accepting an input (for example, double-clicking), an input to switch to a selected content group is accepted. In the case of the touch panel 25111, the touch panel 25111 accepts an input to switch to a group of contents selected by double tapping.

In the case shown in FIG. 20A, the content group displayed in the first main window 20000 and the first subwindow 20001 is selected, and the content group displayed in the second main window and the second subwindow 20003 is not selected. state. Then, the audio reproduction unit 174b/audio output unit 176 reproduces/outputs the audio of the content group of the broadcast signal 1 corresponding to the first main window 20000 in the selected state.

The audio reproduced/output by the audio reproduction unit 174b/audio output unit 176 may be the audio of the main content or the audio of the sub-content. Furthermore, when a plurality of sounds are included in the same content group, the sound reproduction unit 174b/sound output unit 176 may select one of them and reproduce/output it.

In the case of VOD (Video On Demand), the menu list may be displayed in main windows 20000 and 20002 and the video may be displayed in subwindows 20001 and 20003 .

Also, the shape, size, and position of the window may be freely changed based on the input received from the viewer. Specifically, the shape, size, and position of the window are changed based on the input received by the touch panel 25111 (for example, an input to move the position of the window by dragging or an input to change the size of the window by pinching in and out). change. Also, the shape, size, and position of the window are changed based on the input (for example, input by drag operation) received by the pointing device such as the mouse 25104 and the touch pad 25106 .

The video display unit displays a window in which the content group in the selected state is displayed and a window in which the content group in the non-selected state is displayed in different modes. For example, the video display unit 173 displays the frame lines of the windows in which the contents of the same content group are displayed in the same manner (for example, displayed in the same color). In addition, the image display unit 173 displays the frame lines of the window displaying the content group in the selected state and the frame line of the window displaying the content group in the non-select state in different manners. This makes it easier to identify windows belonging to the same content group.

The example of FIG. 20A indicates that the content group displayed in the first main window 20000 and the first subwindow 20001 is in a selected state. That is, the frame lines of the first main window 20000 and the first subwindow 20001 are displayed with thick lines, while the frame lines of the second main window and the second subwindow 20003 are displayed with broken lines. It should be noted that the border color of the window displaying the content group in the selected state and the border color of the window displaying the content group in the non-selected state may be displayed in different colors. Specifically, the display color in the window displaying the non-selected content group may be displayed in a lighter color than the display color in the window displaying the selected content group.

In addition, video display portion 173 displays the main window and the sub-window in different modes. For example, as shown in FIG. 20A, the image display unit 173 displays marks 20006 and 20007 on the main window. Note that, as shown in FIG. 23A, the window attribute display section 20310 may display the difference between the main window and the sub-window.

Here, when the windows are in overlapping positions, the problem is which window is displayed in front of the other window. Next, with reference to FIG. 20B, a case where a window displaying selected content groups and a window displaying non-selected content groups overlap will be described.

As shown in FIG. 20B, the window displaying the content group in the selected state is superimposed on the window displaying the content group in the non-selected state. That is, the first main window 20000 and the first subwindow 20001 displaying the content group in the selected state are displayed so as to overlap the second main window and the second subwindow 20003 .

Note that the broadcast signal (for example, AIT) may include window anteroposterior relationship specifying information that specifies the anteroposterior relationship between related windows.

In addition, whether or not part or all of the window-related specification information can be changed by the viewer's selection may be included in the window context specification information.

Further, in the case of recorded content, the video display unit 173 may display the main window based on window anteroposterior relation specifying information stored in advance as content group related information.

In addition, in the case of content on the Internet, the video display unit 173 may display the main window based on window context designation information distributed together with the content as content group related information.

Also, it may be determined which window is to be displayed in front of the other windows based on the input received from the viewer. Specifically, as shown in FIG. 20C , a pointing device such as a mouse 25104 or a touch pad 25106 moves a cursor 20004 to a first subwindow 20001 and accepts an input of single-clicking. , the first main window 20000 and the first sub-window 20001 are superimposed on the second main window and the second sub-window 20003 and displayed. Further, the touch panel 25111 may receive an operation of single-tapping a window to be displayed in the front, thereby displaying the window that received the operation in the front. Note that it is preferable that the click operation for switching the content group and the click operation for operating the window display are different operations, such as a single click and a double click.

Also, as shown in FIG. 20D , a pointing device such as a mouse 25104 or a touch pad 25106 moves the cursor 20004 to the first subwindow 20001 and displays a confirmation window 20005 after receiving a click input. can be This makes it possible to prevent the selected content group from being switched to an unintended content group.

The remote controller 25102 receives an input to switch the selected content group (hereinafter sometimes simply referred to as switching windows) by button operation. The remote controller 25102 will be described in detail below with reference to FIG. 22A.

When the add content button 20213 shown in FIG. 22A receives an input, the mode switches to either the switching mode or the adding mode. For example, when the content addition button 20213 receives input in the switching mode, the mode switches from the switching mode to the adding mode. On the other hand, when the add content button 20213 receives an input in the add mode, the mode is switched from the add mode to the switching mode.

In the switching mode, the total number of content groups displayed by the video display unit 173 does not change. On the other hand, in the addition mode, the total number of content groups displayed by the video display unit 173 increases.

Specifically, when the channel button 20211 receives an input in the switching mode, a content group of broadcast programs corresponding to the channel button 20211 is added. Then, the video display unit 173 erases the window displaying the previously selected content group, and displays a new window displaying the added content group. Then, the newly added content group is in a selected state, and the audio reproduction unit 174b/audio output unit 176 stops the audio that has been reproduced/output so far, and reproduces/plays the audio of the newly added content group. Output.

Note that the video display unit 173 may erase the window that displays the content group for which the longest time has elapsed since the non-selected state until the present time. Also, an input for selecting a content group whose display is to be stopped may be received from the viewer.

When the channel button 20211 receives an input in the addition mode, a content group of broadcast programs corresponding to the channel button 20211 is added. Then, the video display unit 173 displays a new window in which the added content group is displayed. Then, the newly added content group is in a selected state, and the audio reproduction unit 174b/audio output unit 176 stops the audio that has been reproduced/output so far, and reproduces/plays the audio of the newly added content group. Output.

Note that if the total number of added content groups exceeds the number of tuners, the video display unit 173 deletes the window displaying the content group that has elapsed the longest time since being deselected. You can do it. Also, an input for selecting a content group whose display is to be stopped may be received from the viewer.

When the content switching button 20201 shown in FIG. 22A receives an input, the content group in the provisionally selected state is switched. After that, when the enter button 20202 accepts an input, the content group in the provisionally selected state becomes selected. The above process will be specifically described below with reference to FIG. 22B.

FIG. 22B shows an example in which the content group displayed in the second main window 20002 is in a provisionally selected state. As shown in FIG. 22B, a temporary selection frame 20204 is displayed around the second main window 20002 .

After that, when the decision button 20202 receives an input, the content group displayed in the second main window 20002 is set as selected.

When the return button 20203 receives an input, the provisional selection state of the content group displayed in the second main window 20002 is canceled. This makes it possible not to switch the content group even if provisionally selected. Also, the window of the content group in the provisionally selected state may be displayed in front of the windows of other content groups, and the audio may be switched. As a result, it becomes possible to confirm the contents of the switching candidate content group, thereby improving convenience.

Also, by receiving an input combining the content switching button 20201, the channel button 20211, and the color button 20212, the content group may be set in a provisional selection state or a selection state.

Furthermore, the number corresponding to the channel button 20211 may be displayed in the window displayed by the video display unit 173. FIG. In this case, when the channel button 20211 receives input after the content switching button 20201 receives input, the window corresponding to the channel button 20211, that is, the content group is set to the provisional selection state or selection state. Also, as shown in FIG. 23A, the number corresponding to the channel button 20211 may be displayed in the window attribute display section 20310. FIG.

Furthermore, a part of the window displayed by the image display unit 173 (for example, the frame line of the window) may be displayed in a color corresponding to the color button 20212 . In this case, when the channel button 20211 receives input after the content switching button 20201 receives input, the window corresponding to the color button 20212, that is, the content group is set to the provisional selection state or selection state.

Also, as shown in FIG. 22C, a content group may be added by receiving an input on the menu screen displayed by the portable information terminal 25110. FIG. Each content group is iconized on the menu screen shown in FIG. 22C. When icon 20206 displayed on mobile information terminal 25110 is selected (for example, by a touch operation), mobile information terminal 25110 receives an input to add a content group. In the example shown in FIG. 22C, "channel B" is selected as the content group to add. The frame line of the icon 20206 corresponding to "Channel B" is displayed in a manner different from that of the other icons 20206 (in the example of FIG. 22C, the frame line is thick).

In the above-described example, the process of designating or adding a content group by operating the input device has been described along with the example of the display screen. Processing for adding a content group of a broadcast program by designating it from the EPG will be described below with reference to FIGS. 22H and 22I.

As shown in FIG. 22H , the frames of the provisionally selected broadcast programs are surrounded by provisional selection frames 20226 .

When the decision button 20202 of the remote controller (described above, FIG. 22A) receives an input, the video display unit 173 displays a new window in which the added content group is displayed instead of the EPG 173e. Then, the content group of the broadcast programs in the provisionally selected state is added.

When the content addition button 20213 of the remote control receives an input, the content group of the broadcast program in the provisionally selected state becomes selected. In addition, the frame line 20224 of the selected broadcast program is displayed thick. In this case, the EPG 173e does not close and continues to accept input for adding content groups of broadcast programs. Then, a new temporary selection frame 20226 is displayed for selecting a broadcast program to be temporarily selected.

In the state shown in FIG. 22H, when the content addition button 20213 receives an input, the content group of the broadcast program that has been in the provisionally selected state is changed to the selected state. Also, as shown in FIG. 22I, the frame line 20224 of the selected broadcast program is displayed thick. Also, the content group of the broadcast program, which was in the selected state in FIG. 22H, is in the semi-selected state in FIG. 22I. Then, as shown in FIG. 22I, the frame line of the broadcast program in the half-selected state is displayed with a thick frame, and diagonal lines are displayed at the corners. In this way, when the add content button 20213 receives an input, the content group of the broadcast program that has been selected so far becomes semi-selected, and the content group of the broadcast program that has been provisionally selected becomes selected. Therefore, each time the add content button 20213 receives an input, the content group in the semi-selected state is added.

In the state shown in FIG. 22I, when the enter button 20202 of the remote control receives an input, a content group of broadcast programs in a semi-selected state and a content group of broadcast programs in a selected state are added. be. Then, the video display unit 173 displays two windows in which each added content group is displayed. In this case, the audio reproduction unit 174b/audio output unit 176 reproduces/outputs the audio of the content group of the broadcast program selected in the EPG 173e. In other words, the audio reproduction unit 174b/audio output unit 176 does not reproduce/output the audio of the content group of the broadcast program that has been half-selected in the EPG 173e. The content group of the broadcast program in the semi-selected state in the EPG 173e becomes a non-selected content group when the content group is displayed. If there is a content group that was in a selected state on the video display unit 173 before the content group was added by the EPG 173e, that content group will be in a non-selected state.

After selecting a content group to cancel the selected or semi-selected state in the EPG 173e, the content end button 20216 accepts an input to cancel the selected or semi-selected state of the content group. In that case, when the broadcast program whose selection state is canceled becomes selected, the content group in the semi-selected state is changed to the selected state.

It should be noted that the content group added by being specified from the EPG 173e may all be in a semi-selected state. In this case, if there is a content group in the selected state on the video display unit 173 before the addition of the content group by the EPG 173e, the selected content group is maintained.

Next, the process of adding a content group by receiving an input from the remote controller (described above, FIG. 22A) while the launcher menu (described later, FIG. 22J) is displayed will be described with reference to FIGS. 22A and 22J. do.

When the menu button 20232 of the remote control receives an input, the image display portion 173 displays the launcher menu 20230 shown in FIG. 22J.

As shown in FIG. 22J, launcher menu 20230 displays a list of menu items 20233 for selecting content and applications. Note that the application is also selected as one of the content groups.

In addition, as shown in FIG. 22J, the frame line of the menu item 20233 in the provisionally selected state is surrounded by a provisional selection frame 20231 . When the arrow button 20214 of the remote controller (described above, FIG. 22A) receives an input, the menu item 20233 surrounded by the provisional selection frame 20231 is switched, and accordingly the content group (content or application) to be provisionally selected is switched.

When content addition button 20213 of the remote controller receives an input, content group (content or application) corresponding to menu item 20233 in the provisionally selected state is selected. In addition, the frame line of the selected content group is displayed thick. In addition, as the new content group is selected, the previously selected content group becomes semi-selected. A slash appears in the After that, when decision button 20202 of the remote controller receives an input, voice output unit 176 displays a window displaying each added content group instead of launcher menu 20230 . In this case, the content group half-selected and the content group selected in the launcher menu 20230 are added as a new content group. Audio output unit 176 then outputs the audio of the content group selected in launcher menu 20230 . That is, the audio of the content group in the half-selected state is not output. The content group in a half-selected state in the launcher menu 20230 becomes a non-selected content group when the content group is displayed.

Specifically, in FIG. 22J, "application 3" is provisionally selected. In this state, when the content addition button 20213 receives an input, the provisionally selected “application 3” becomes selected. Also, "content 3", which has been in a selected state so far, is now in a semi-selected state, and the frame line of "content 3" is displayed in bold and diagonal lines are displayed in the corners. After that, when the decision button 20202 of the remote control receives an input, the content group of "content 1", "content 3", and "application 2" which are in a semi-selected state and "application 3" which is in a selected state. is added as a new content group. Then, the video display unit 173 displays a main window displaying the added "content 1", "content 2", "application 2", and "application 3". In this case, audio output unit 176 outputs the audio of “application 3” that has been selected in launcher menu 20230 . That is, the audio of "content 1", "content 2", and "application 2" which are in the semi-selected state is not output. Note that if the added application does not require display on the video display unit 173, it is only started. Also, the "content" in the launcher menu 20230 may be the main content, and the "application" may be the sub-content corresponding to the "content".

After selecting a content group whose selected state or half-selected state is to be canceled in launcher menu 20230, the selected state or half-selected state of the content group is canceled by receiving an input from content end button 20216. FIG.

Next, processing for adding a content group by designating from the launcher menu with a pointing device such as the mouse 25104 or the touch pad 25106 or the touch panel 25111 will be described with reference to FIGS. 22J and 22K.

When the launcher icon 20240 shown in FIG. 22K receives the click input (touch operation in the case of the touch pad 25106), the screen is switched to the screen shown in FIG. 22J, and the launcher menu 20230 is displayed.

When a non-selected menu item 20233 receives a click input (a touch operation in the case of the touch pad 25106), the corresponding content group is selected. In addition, the content group that has been in the selected state is now in the semi-selected state.

When the selected menu item 20233 receives a click input (a touch operation in the case of the touch pad 25106), the corresponding content group is semi-selected, and the semi-selected menu item 20233 receives a click input. When (in the case of the touch pad 25106, a touch operation) is received, the corresponding content group is put into a non-selected state.

When enter button 20202 of the remote control receives an input, video display portion 173 displays a window in which each added content group is displayed instead of launcher menu 20230 . In this case, the content group half-selected and the content group selected in the launcher menu 20230 are added as a new content group. In this case, the audio reproduction unit 174b/audio output unit 176 reproduces/outputs the audio of the content group of the selected broadcast program. The content group in a half-selected state in the launcher menu 20230 becomes a non-selected content group when displayed.

Note that the launcher menu 20230 may be displayed as the initial screen displayed by the video display unit 173 after the power of the information display device 1000 is turned on. Also, after the launcher menu 20230 is displayed, often-selected content or applications may be preliminarily selected according to the viewer's preference.

Note that, as shown in FIG. 22D, the information display device 1000 may display only content on the Internet without displaying broadcast programs.

Also, not only the main window but also a sub-window may be selected so that related content groups can be selected.

[Operation sequence of information display device]
21A to 21D show operation sequence diagrams of the information display device 1000 according to the sixth embodiment. With reference to FIG. 21A, a process of adding a content group of another broadcast program while only the content group of the broadcast program is displayed will be described.

First, after the power of the information display device 1000 is turned on, the selected main content is displayed in the main window from among the programs that were viewed when the power was last interrupted. Here, when a different broadcast channel is selected by receiving an input from the channel button 20211 of the remote control (described above, FIG. 22A), the displayed content group is switched to the content group corresponding to the selected broadcast channel. When the power of the information display device 1000 is turned on, only windows not displaying contents are displayed, and then the channel button 20211 of the remote control accepts an input to display the video of the selected channel in the window. can be

The following description assumes that the program of the first broadcast signal (hereinafter sometimes referred to as broadcast signal 1) is selected as the main content.

First, the information display device 1000 acquires a PMT data string (S20101).

Next, the information display device 1000 acquires an AIT data string (S20102).

Next, the information display device 1000 confirms the window-related designation information (the window-related designation information is a general term for window-related designation information such as the window shape designation information and the window context designation information) (S20103). .

Next, information display device 1000 displays first main window 20000 (main window 1 in the figure) corresponding to broadcast signal 1 based on the window shape designation information and the window context designation information included in the window-related designation information. (S20104).

After displaying the first main window 20000, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20107).

As a result, the broadcast cooperation application is executed, and the execution screen of the broadcast cooperation screen is displayed in the first subwindow 20001 (subwindow 1 in the drawing) corresponding to the broadcast signal 1 (S20108).

After that, information display device 1000 accepts an input to add a new content group. Specifically, the add content button 20213 accepts input. After that, when the channel button 20211 corresponding to the second broadcast signal to be added (hereinafter sometimes referred to as broadcast signal 2) receives an input, a content group corresponding to broadcast signal 2 is added. In addition, the content group corresponding to the added broadcast signal 2 becomes the content group in the selected state, and through the same processing (S20109 to S20111, S20113 to S20115) as when the broadcast signal 1 is selected, the broadcast signal 2 and A corresponding second main window 20002 (main window 2 in the figure) and second sub-window 20003 (sub-window 2 in the figure) are displayed (S20112, S20116), and the sound is switched to the sound of the content group of broadcast signal 2. . Even after second main window 20002 and second subwindow 20003 are displayed, first main window 20000 and first subwindow 20001 remain displayed.

When either the first main window 20000 or the first sub-window 20001 receives a selection input (for example, double-click), the content group in the selected state is switched to the content group corresponding to the broadcast signal 1, and the audio is It switches to the audio of the content group of broadcast signal 1 .

Here, the number of tuners included in the information display device 1000 is limited. When the number of tuners becomes insufficient due to the addition of the content group, the information display device 1000 closes the window of the content group selected last. If the last selected content group is being streamed on the Internet, the information display device 1000 may switch to streaming instead of closing the window.

Furthermore, when the recording ends and the tuner receiving the broadcast signal is released, the information display device 1000 may display the closed window again. In addition, when the recording is completed and the tuner receiving the broadcast signal is released, the information display device 1000 may restore the display switched to the streaming broadcast.

Further, the information display device 1000 may receive an input for selecting a window to be closed from the viewer.

Next, the process of adding a content group distributed via the Internet in a state where only the content group of the broadcast program is displayed will be described mainly with reference to FIG. 21B, focusing on the differences from FIG. 21A.

The information display device 1000 confirms the window-related designation information (the window-related designation information is a general term for window-related designation information such as the window shape designation information and the window context designation information) (S20103).

Next, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 based on the window shape specification information and window context specification information included in the window related specification information (S20104).

After displaying the first main window 20000, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20107). Then, the execution screen of the broadcast cooperation screen is displayed in the first subwindow 20001 corresponding to the broadcast signal 1 (S20108).

The information display device 1000 accepts input of information (for example, URL or search keyword) for specifying the content to be distributed, and then requests delivery of the content specified from the received information (S20117).

Processing for accepting input of information for specifying content to be distributed using the remote control (described above, FIG. 22A) will be described in detail below with reference to FIGS. 22A, 22D, and 22E.

First, when content addition button 20213 of the remote controller receives input, and then input is received by input switching button, video display unit 173 of information display device 1000 displays the screen shown in FIG. 22D.

An input switching menu 20220 is displayed on the screen shown in FIG. 22D. Also, the input switching menu 20220 displays each category of content (TV broadcast, recorder, external input 1, external input 2, Internet, etc.). On the screen shown in FIG. 22D, "Internet" is provisionally selected as the category, and the frame of the provisionally selected "Internet" is displayed with a thick line.

Also, as shown in FIG. 22D, when the arrow button 20214 of the remote control accepts an input while the input switching menu 20220 is displayed, the tentatively selected category is switched from "Internet" to another category. . In addition, the temporarily selected category is switched, the thick line displayed in the frame of "Internet" disappears, and the frame of the changed category is displayed with a thick line.

For example, when the arrow button 20214 with an upward arrow receives an input, the temporarily selected category is switched to "external input 2" located above the currently temporarily selected "internet". After that, when the arrow button 20214 with a downward arrow receives an input, the temporarily selected category is switched to "Internet" located below the currently temporarily selected "external input 2".

When the enter button 20202 of the remote controller receives an input, the provisionally selected category is determined as the newly added content category.

22E is displayed on the image display unit 173 of the information display device 1000 when the decision button 20202 accepts an input while "Internet" is provisionally selected.

The screen shown in FIG. 22E displays a designation window 20221 for accepting input for designating content on the Internet to be newly added. By entering a URL or a search keyword (Search in FIG. 22E) in the text box included in the specification window 20221, the content to be newly added is specified. On the screen shown in FIG. 22E, a URL is selected as an input target, and the frame of the text box in which the URL is input is displayed with a thick line. When the arrow button 20214 of the remote controller accepts input while the designation window 20221 is displayed, the input target is switched from the URL to the search keyword. In addition, the input object is switched, the thick line displayed in the frame of the text box in which the URL is input disappears, and the frame of the text box in which the search keyword is input is displayed in bold line.

The channel button 20211 of the remote controller also functions as a character input button. When the channel button 20211 receives an input, characters are input to the input target text box, thereby inputting a URL or a search keyword. For example, when the decision button 20202 accepts the input after the URL is input in the text box, the information display device 1000 requests distribution of the content specified by the URL. First, the content addition button 20213 enters the input switching operation without accepting the input, and finally the decision button 20202 accepts the input to switch the content, and the content addition button 20213 accepts the input to switch the content. You can add it.

Refer again to FIG. 21B. Next, the content requested for distribution in S20117 is distributed to the information display device 1000 (S20118).

Next, the information display device 1000, if there is window-related designation information (a general term for window-related designation information such as the above-described window shape designation information and window contextual relationship designation information), confirms this window-related designation information. (S20119). Then, information display device 1000 displays a third main window (main window 3 in the drawing) corresponding to broadcast signal 3 based on the window shape designation information and the window anteroposterior relation designation information included in the confirmed window-related designation information. (S20120).

Also, if the distributed content includes related content, the information display device 1000 requests distribution of the related content (S20121). Then, the related content requested in S20121 is distributed to the information display device 1000 (S20122). Information display device 1000 then displays a third sub-window (sub-window 3 in the drawing). Note that the information display device 1000 requests delivery of the related content using the launcher shown in the main window.

Here, when the third main window is displayed, the sound that has been reproduced so far is switched to the sound of the distributed content. The display of the first main window 20000 and the first sub-window 20001 remains even after the sound is switched. Therefore, a window (first main window 20000 and first sub-window 20001) displaying content groups of broadcast programs and a window (third main window and third sub-window) displaying content groups on the Internet are displayed. become a state. In this state, when either the first main window 20000 or the first subwindow 20001 is double-clicked, the selected content group is switched from the distributed content to the broadcast program content group. Then, the sound to be reproduced is switched from the sound of the distributed content to the sound of the broadcast program. After that, when the third main window or the third sub-window is double-clicked, the selected content group is switched to the content group corresponding to the content distributed from the broadcast program content group. Then, the sound to be reproduced is switched from the sound of the broadcast program to the sound of the distributed content.

In the above example, after the content on the Internet is distributed, the sound of the broadcast program is switched to the sound of the distributed content, but some of the distributed content does not require sound. be. If the delivered content does not require audio, the delivered content may be displayed without audio without switching the audio from the previously selected content group. In this case, for example, as shown in FIG. 22F, after the content is delivered, a button 20222 may be displayed to accept input for selecting whether to switch the audio to the delivered content or not. Furthermore, when the button 20222 receives an input to select not to switch the sound, the distributed content is set as the non-selected content group, and the content group whose sound is continuously played remains as the selected content group. You can do it.

Next, a process of adding a recorded program content group while only the broadcast program content group is displayed will be described with reference to FIGS. 21C and 22D, mainly focusing on differences from FIG.

The information display device 1000 confirms the window-related designation information (the window-related designation information is a general term for window-related designation information such as the window shape designation information and the window context designation information) (S20103).

Next, the information display device 1000 displays the first main window 20000 corresponding to the broadcast signal 1 based on the window shape specification information and window context specification information included in the window related specification information (S20104).

After displaying the first main window 20000, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20107). Then, the execution screen of the broadcast cooperation screen is displayed in the first subwindow 20001 corresponding to the broadcast signal 1 (S20108).

With the first main window 20000 and the first sub-window displayed, the information display device 1000 requests playback of recorded content (S20124).

Next, the information display device 1000 receives a playback signal (content playback in the drawing) of the recorded content requested to be played back in S20124 (S20125).

Next, the information display device 1000, if there is window-related designation information (a general term for window-related designation information such as the above-described window shape designation information and window contextual relationship designation information), confirms this window-related designation information. (S20126).

Next, information display device 1000 displays a fourth main window (main window 4 in the drawing) based on the window shape designation information and the window context designation information included in the confirmed window-related designation information (S20127).

Next, if the distributed content includes related content, the information display device 1000 requests reproduction of the related content (S20128). Processing for accepting input of information for requesting playback of recorded content using the remote controller (described above, FIG. 22A) will be described in detail below with reference to FIGS. 22D and 22G.

First, when content addition button 20213 of the remote controller receives input, and then input is received by input switching button, video display unit 173 of information display device 1000 displays the screen shown in FIG. 22D.

Here, when the decision button 20202 accepts an input with the "recorder" provisionally selected, the image display section 173 of the information display device 1000 displays the screen shown in FIG.

The screen shown in FIG. 22G displays a recorded content list 20223 for accepting input for selecting recorded content to be newly added (playback request). Recorded content list 20223 displays a list of recorded content names. In FIG. 22G, in the recorded content list 20223, "football 1" is provisionally selected as the recorded content to be played back. In this state, when the decision button 20202 receives an input, the information display device 1000 makes a playback request for the temporarily selected recorded content, thereby adding "football 1" as a new content group. First, the content addition button 20213 enters the input switching operation without accepting the input, and finally the decision button 20202 accepts the input to switch the content, and the content addition button 20213 accepts the input to switch the content. You can add it.

Refer again to FIG. 21C. The related content requested to be reproduced in S20128 (related content reproduction in the figure) is distributed to the information display device 1000 (S20129). Information display device 1000 then displays a fourth sub-window (sub-window 4 in the drawing).

Here, when the fourth main window is displayed, the sound that has been reproduced so far is switched to the sound of the recorded content. The display of the first main window 20000 and the first sub-window 20001 remains even after the sound is switched. Therefore, a window (first main window 20000 and first sub-window 20001) displaying the content group of the broadcast program and a window (fourth main window and fourth sub-window) corresponding to the recorded content are displayed. In this state, when either the first main window 20000 or the first subwindow 20001 is double-clicked, the selected content group is switched from the recorded content to the broadcast program content group. Then, the reproduced sound is switched from the sound of the recorded content to the sound of the broadcast program. After that, when the fourth main window or the fourth sub-window is double-clicked, the selected content group is switched from the broadcast program to the recorded content group. Then, the reproduced sound is switched from the broadcast program sound to the recorded content sound.

Note that the recorded content playback device may be built in the information display device or may be externally attached. Furthermore, content related to recorded content may be content on the Internet. Also, the control of this embodiment can be applied even when no broadcast program is received, as shown in FIG. 21D.

The difference between the seventh embodiment and the sixth embodiment is that a window frame for receiving an input designating a new content is displayed after the content to be provisionally selected has been selected. In the following, differences between the sixth and seventh embodiments will be mainly described, and descriptions of common points will be omitted as much as possible.

By receiving an input from the content addition button 20213 or the content switching button 20201 of the remote controller (described above, FIG. 22A), the content to be provisionally selected is selected. Upon acceptance, video display portion 173 displays window frame 20301 for accepting an input designating content.

A window frame 20301 shown in FIG. 23A includes a content display area 20302, a content designation frame 20303 for designating content to be displayed in the content display area 20302, a function button 20304, a window minimize button 20305, and a window maximize button. A button 20306 and a window close button 20307 are displayed.

No content is displayed in the content display area 20302 as an initial state. After that, by specifying the content in the content specifying frame 20303 , the specified content is displayed in the content display area 20302 . Specifically, the content displayed in the content display area 20302 is specified by entering a URL in the content specification frame 20303 . Note that the content designation frame 20303 accepts channel input if the designated content is a broadcast program. Also, the content designation frame 20303 accepts the input of the device name if the designated content is stored in the built-in device. Also, the content designation frame 20303 accepts the input of the port name when the designated content is the content input from the input port.

It should be noted that in the content display area 20302, frequently selected content may be displayed as an initial state according to the viewer's preference. Alternatively, content that has not been provisionally selected may be displayed. In the case of a broadcast program, the video of the selected channel may be displayed in the window by receiving input from the channel button 20211 after receiving input from the content addition button 20213 on the remote controller.

If content is not specified in content specifying frame 20303 and content addition button 20213 or content switching button 20201 accepts an input, image display portion 173 causes window frame 20301 to display a screen for selecting content. switch. Further, when content end button 20216 of the remote controller receives an input while content is designated, video display unit 173 switches display from window frame 20301 to a screen for selecting content. In that case, the content specified by the window frame 20301 is not displayed on the content selection screen.

Function buttons 20304 are assigned functions such as launching a broadcast-linked application and calling related content. When a function button 20304 to which functions such as launching a broadcast cooperation application and calling related content are assigned receives an input, a new window frame 20301 is launched. Then, the sub-contents are displayed in the newly opened window frame 20301 .

When the window close button 20307 receives an input, the main window and the subwindows corresponding to the main window are closed. It should be noted that whether or not to close all related sub-windows when the main window is closed may be set for each content.

Note that the window frame 20301 may be displayed when the window frame start-up icon 20308 shown in FIG. 23B receives an input (a touch operation in the case of the touch pad 25106) of clicking with a pointing device.

Also, the window frame 20301 may be supplied by broadcast waves as a broadcast cooperation application. Alternatively, it may be supplied from a server on the Internet. Alternatively, a window frame pre-stored in the information display device 1000 may be used. Also, window frame selection information for a plurality of window frames 20301 may be included in the broadcast signal (for example, AIT). In the case of recorded content or content on the Internet, window frame selection information may be recorded/distributed as information related to the content. This allows the viewer to select the window frame. Also, the window frame selection information may be included in the window-related specification information. Further, since it is desirable to adjust the design of the window frame according to the size and the number of pixels of the information display device 1000, the window frame information can be used as a plurality of designation information corresponding to the size and the number of pixels of the information display device 1000. good.

The eighth embodiment differs from the sixth embodiment in that sub-windows of non-selected programs are not displayed at the time of content group selection switching. As a result, when displaying a plurality of content groups at the same time, the display becomes easier to see and the convenience can be improved. In the following, the points of difference between the eighth embodiment and the sixth embodiment will be mainly described, and the description of the common points will be omitted as much as possible.

In the eighth embodiment, the video display unit 173 hides at least part of information (for example, sub-window) of the content group when the content group is switched from the selected state to the non-selected state. In addition, when the content group is switched from the non-selected state to the selected state, the information of the hidden content is displayed again.

Processing for switching content groups (that is, broadcast programs) in a state in which only content groups of broadcast programs are displayed will be described below with reference to FIG. Originally, the flow of display control of the information display device 1000 in FIG. In order to distinguish and describe the flow of display control of the window group, it is described on two lines.

First, information display device 1000 receives an input for selecting a program of broadcast signal 1 (S20401).

Next, the information display device 1000 confirms the window-related designation information included in the broadcast signal 1 (S20402).

Next, information display device 1000 displays first main window 20000 (main window 1 in the figure) corresponding to broadcast signal 1 based on the window shape designation information and the window context designation information included in the window-related designation information. (S20403).

Next, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20404).

Next, the information display device 1000 displays the execution screen of the broadcast linkage screen on the first subwindow 20001 (subwindow 1 in the drawing) corresponding to the broadcast signal 1 (S20405).

Next, information display device 1000 accepts an input for selecting a program of broadcast signal 2 (S20406).

Next, information display device 1000 stores the information required to display first subwindow 20001 in the storage device (S20407). As a result, the information display device 1000 saves the information necessary for displaying the first subwindow 20001 to the storage device.

Next, the information display device 1000 closes the first subwindow 20001 (S20408). That is, information display device 1000 erases displayed first subwindow 20001 .

Next, the information display device 1000 confirms the window-related designation information included in the broadcast signal 2 (S20409).

Next, the information display device 1000 displays a second main window 20002 (main window 2 in the figure) corresponding to the broadcast signal 2 based on the window shape designation information and window context designation information included in the window related designation information. (S20410).

Next, the information display device 1000 activates the broadcast cooperation application by automatic activation or an activation instruction received from the viewer (S20411).

Next, the information display device 1000 displays the execution screen of the broadcast cooperation screen on the second subwindow 20003 (subwindow 2 in the drawing) corresponding to the broadcast signal 2 (S20412).

Next, the information display device 1000 receives an input for reselecting the program of the broadcast signal 1 (S20413).

Next, information display device 1000 stores information necessary for displaying second subwindow 20003 in the storage device (S20414). As a result, the information display device 1000 saves the information necessary for displaying the second subwindow 20003 to the storage device.

Next, the information display device 1000 closes the second subwindow 20003 (S20415). That is, the information display device 1000 erases the displayed second subwindow 20003 .

Next, the information display device 1000 acquires the information required to display the first subwindow 20001 stored in S20407 (S20416). That is, the information display device 1000 restores the information saved in S20407.

Next, based on the information acquired in S20416, the information display device 1000 redisplays the execution screen of the broadcast cooperation screen on the first subwindow 20001 corresponding to the broadcast signal 1 (S20417).

It should be noted that, after erasing the sub-window of the non-selected program, when the non-selected content group is selected again, the erased sub-window may be automatically re-displayed.

Information indicating whether or not to hide the sub-window when not selected may be included as window-related designation information in the broadcast signal (for example, AIT) or accompanying information of content on the Internet or recorded content.

Also, information indicating whether or not to redisplay the sub-window that was hidden when reselecting the content group is included in the accompanying information of the broadcast signal (for example, AIT) or content on the Internet or recorded content as window-related designation information. You can do it.

Also, an input specifying whether or not to hide the sub-window when not selected may be received from the viewer. In this case, the information display device 1000 may be made to store the viewer's preference and perform processing according to the preference.

When re-displaying a sub-window when re-selecting a content group, information related to the sub-window may be stored as cache data in the information display device 1000 .

The ninth embodiment differs from the sixth embodiment in that automatic activation of the broadcast cooperation application of the content group in the non-selected state is prohibited. Below, the points of difference between the ninth embodiment and the seventh embodiment will be mainly described, and the description of the common points will be omitted as much as possible.

Some broadcast-linked applications are set to be automatically started. Here, when all the broadcast cooperation applications are automatically started, there is a problem that the number of sub-windows increases and the screen display becomes cluttered.

In the ninth embodiment, the automatic activation of the broadcast cooperation application of the content group in the non-selected state is prohibited. That is, only the broadcast cooperation application of the content group in the selected state is automatically activated. This makes it possible to reduce the number of sub-windows displayed at one time, improving the visibility of the screen.

It should be noted that the broadcast cooperation application of the content group in the unselected state may be set to the activation standby state. In this case, when the content group is selected, the broadcast cooperation application in the activation standby state is activated.

Further, it is also possible to include in broadcast signals (for example, AIT) or incidental information of content on the Internet or recorded content as window-related designation information whether automatic activation is prohibited when not selected or whether to be in an activation standby state.

Further, it is also possible to receive an input from the viewer specifying whether to prohibit the automatic activation when not selected or to set the activation standby state. In this case, the information display device 1000 may be made to store the viewer's preference and perform processing according to the preference.

The tenth embodiment differs from the sixth embodiment in that windows are displayed on the video display unit 173 of the information display device 1000 and the portable information terminal 25110 connected to the information display device 1000 by wire or wirelessly. In the following, differences between the tenth embodiment and the seventh embodiment will be mainly described, and descriptions of common points will be omitted as much as possible.

In the tenth embodiment, the video display unit 173 of the information display device 1000 displays the main window, and the portable information terminal 25110 connected to the information display device 1000 by wire or wirelessly displays the sub-window. As a result, when a plurality of content groups are displayed and viewed at the same time, the portable information terminal 25110 can be effectively used, and convenience can be improved.

It should be noted that the main content and sub-contents included in the content group that has been unselected on the information display device 1000 may be displayed on the mobile information terminal 25110 .

Also, the video display unit 173 of the information display device 1000 may display a plurality of content groups, and the earphones of the portable information terminal 25110 may output the audio of the content groups. Also, the earphone of the portable information terminal 25110 outputs the audio of any one content group displayed on the video display unit 173 of the information display device 1000 . As a result, when a plurality of viewers do not agree on the content group they want to view, the content group can be viewed simultaneously by a plurality of viewers by reproducing and listening to the sound of the content group they want to view on the portable information terminal 25110. viewing becomes possible.

Note that the audio reproduction unit 174b/audio output unit 176 of the information display device 1000 may not reproduce/output audio.

Also, an input specifying sub-contents to be displayed on the portable information terminal 25110 may be received from the viewer.

Although the invention made according to the present invention has been specifically described above based on the embodiments, it should be understood that the present invention is not limited to the above-described embodiments, and that various modifications can be made without departing from the gist of the invention. Needless to say.

For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. These all belong to the scope of the present invention. Numerical values, messages, and the like appearing in the sentences and drawings are merely examples, and the effects of the present invention are not impaired even if different ones are used.

Some or all of the above-described functions and the like of the present invention may be realized by hardware by designing them in an integrated circuit, for example. Alternatively, the functions may be realized by software, in which the microprocessor unit or the like interprets and executes an operation program for realizing each function. Hardware and software may be used together.

The software for controlling the broadcast receiving device 100 may be stored in advance in the ROM 103 and/or the storage unit 110 of the broadcast receiving device 100 at the time of product shipment. It may be obtained from another application server 500 or the like on the Internet 200 via the LAN communication unit 121 after product shipment. Also, the software stored in a memory card, an optical disc, or the like may be acquired via the expansion interface section 124 or the like. Similarly, the software for controlling the mobile information terminal 700 may be stored in the ROM 703 and/or the storage unit 710 of the mobile information terminal 700 in advance at the time of product shipment. It may be acquired from other application servers 500 or the like on the Internet 200 via the LAN communication section 721 or the mobile telephone network communication section 722 or the like after product shipment. Also, the software stored in a memory card, an optical disc, or the like may be acquired via the expansion interface section 724 or the like.

The present invention can also be applied to devices that do not receive broadcast programs as long as they display content groups. In other words, the information display device 1000 includes all types of devices other than personal computers, tablet terminals, and smart phones.

Also, the control lines and information lines shown in the drawings are those considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In fact, it may be considered that almost all configurations are interconnected.

100: broadcast receiver, 100a: antenna, 101: main control unit, 102: system bus, 103: ROM, 104: RAM, 110: storage unit, 121: LAN communication unit, 124: expansion interface unit, 125: digital interface Section 131: Tuner/Demodulator 132: First Separation Section 133: First Video Decoding Section 134: First Audio Decoding Section 135: First Subtitle Decoding Section 141: Data Broadcasting Reception Processing Section 142: Data Broadcasting Engine 151: Streaming Reception Processing Unit 152: Second Separation Unit 153: Second Video Decoding Unit 154: Second Audio Decoding Unit 155: Second Caption Decoding Unit 161: Application Control Unit 162: Application engine 171: video superimposition unit 172: audio selection unit 173: video display unit 174: speaker 174b: audio reproduction unit 175: video output unit 176: audio output unit 181: presentation synchronization control unit 191 terminal cooperation control unit,
200: Internet, 210: Router device,
300t: radio tower, 300: broadcasting station server, 301: main control unit, 302: system bus, 304: RAM, 310: storage unit, 321: LAN communication unit,
400: service provider server, 401: main control unit, 402: system bus, 404: RAM, 410: storage unit, 421: LAN communication unit,
500: other application servers, 600: mobile phone communication server, 600b: base station,
700: portable information terminal, 701: main control section, 702: system bus, 703: ROM, 704: RAM, 710: storage section, 720: communication processing section, 721: LAN communication section, 722: mobile telephone network communication section , 723: NFC communication unit, 724: expansion interface unit, 730: operation unit, 740: image processing unit, 741: display unit, 742: image signal processing unit, 743: first image input unit, 744: second image input Unit, 750: Audio processing unit, 751: Audio output unit, 752: Audio signal processing unit, 753: Audio input unit, 760: Sensor unit, 761: GPS receiving unit, 762: Gyro sensor, 763: Geomagnetic sensor, 764: acceleration sensor, 765: illuminance sensor, 766: proximity sensor,
1000: information display device,
20000: first main window, 20001: first sub-window, 20002: second main window, 20003: second sub-window, 20301: window frame,
25001: viewer instruction input unit, 25002: content input unit, 25003: content playback unit, 25004: content recording/playback unit, 25005: control unit, 25102: remote controller, 25104: mouse, 25106: touch pad, 25108: keyboard, 25110 : portable information terminal, 25111: touch panel.

Claims (1)

In an application launching method for launching an application for accessing broadcast resources in a broadcast receiving apparatus,
The application for accessing the broadcast resource includes a broadcast managed application activated by application control information included in the broadcast signal and a non-broadcast managed application activated by other than the application control information included in the broadcast signal,
receiving a broadcast signal;
confirming the start priority of the broadcast managed application for data broadcasting based on PMT (Program Map Table) information included in the received broadcast signal;
a first application launching step of launching the broadcast managed application based on application control information included in the received broadcast signal;
a launcher screen display step of displaying a launcher screen by an application launcher provided in the broadcast receiving device on the broadcast receiving device;
a second application launching step of launching the non-broadcast managed application based on a user operation via the displayed launcher screen;
a communication step of communicating with an external mobile terminal;
a third application launching step of launching the non-broadcast managed application based on a user operation via the external portable terminal by the communication step;
comprising
Application launch method.

Images