JP7271756B2 - Display method - Google Patents

Description

The present invention relates to a display method.

One of the extended functions of digital broadcasting services is data broadcasting that transmits digital data by broadcast waves and displays various information such as weather forecasts, news, and recommended programs. A large number of television receivers capable of receiving data broadcasting are already on the market, and a large number of technologies related to data broadcasting reception, including the following patent document 1, have been published.

Japanese Patent Laid-Open No. 2001-186486

One of the characteristics of data broadcasting is that a television receiver compatible with digital broadcasting services can receive data broadcasting by itself and can acquire/display various information. On the other hand, data broadcasting limits the amount of data that can be transmitted due to radio band limitations, making it difficult to obtain high-definition screen displays and highly functional effects. The problem was that it was difficult to implement in a broadcast receiver.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a display method capable of performing functions with higher added value.

As means for solving the above problems, the technology described in the claims is used.

For example, a display method in a broadcast receiving device capable of receiving, via broadcast waves, video information of a broadcast program and application-related information relating to an application that can be executed in conjunction with the broadcast program, comprising: a decoding step of decoding video information of a channel-selected broadcast program included in the received broadcast wave to generate a video of the broadcast program; and extracting application-related information from the received broadcast wave. If the location information included in the application-related information indicates that the application exists in a server on a network, the application is acquired from the server, and the location information is transmitted by broadcast waves. When indicating that, an application acquisition step of acquiring an application via a broadcast wave, an application execution step of executing the acquired application on the broadcast receiving device, and the executed application are transmitted via a network. A video acquisition step of acquiring a video and display of the decoded video of the broadcast program, or simultaneous display of two videos, the video acquired via the network by the application and the decoded video of the broadcast program, is possible. and, in the displaying step, from a first display state in which a decoded video of the broadcast program selected for the channel is displayed, the video and the broadcast program acquired by the application via the network. It is possible to transition to a second display state in which the decoded video of the broadcast program and the video transmitted via the network are simultaneously displayed in the second display state. and the application-related information includes a URL as information on the boundary of the application for specifying the range of resources that the application can access, and the URL as the information on the boundary of the application. to limit the transition range of the HTML document that the application can refer to, limit the range of resources that the application can access, and furthermore, at the time of channel selection, the acquired application-related information is used by the application a display method, wherein when information indicating automatic activation is included, the application is obtained in the application obtaining step, the obtained application is activated in the application execution step, and application-related information indicating the automatic activation is repeatedly transmitted; Use

By using the technology of the present invention, it is possible to provide a display method capable of executing functions with higher added value.

1 is a system configuration diagram of a communication system according to an embodiment; FIG. 1 is a block diagram of a broadcast receiver according to an embodiment; FIG. FIG. 2 is a software configuration diagram of the broadcast receiving apparatus according to the embodiment; 3 is a block diagram of a broadcasting station server according to an embodiment; FIG. 4 is a block diagram of a service provider server according to an embodiment; FIG. 1 is a block diagram of a mobile information terminal according to an embodiment; FIG. FIG. 2 is a software configuration diagram of a portable information terminal according to an embodiment; 4 is a data configuration diagram of application control information according to the embodiment; FIG. FIG. 4 is an operation sequence diagram of the broadcast receiving apparatus according to the embodiment when an application is started; FIG. 4 is an operation sequence diagram of the broadcast receiving apparatus according to the embodiment when an application is started; FIG. 4 is an operation sequence diagram of the broadcast receiving apparatus according to the embodiment when an application is started; FIG. 10 is an operation sequence diagram when the portable information terminals according to the embodiment are linked; FIG. 10 is an operation sequence diagram when the portable information terminals according to the embodiment are linked; FIG. 10 is an operation sequence diagram when the portable information terminals according to the embodiment are linked; FIG. 4 is an operation sequence diagram of the broadcast receiving apparatus and the mobile information terminal according to the embodiment when an application is started; FIG. 10 is a screen display diagram of a basic screen of the cooperative control application of the portable information terminal according to the embodiment; FIG. 10 is a screen display diagram of a basic screen of the cooperative control application of the portable information terminal according to the embodiment; FIG. 4 is a screen display diagram of a data broadcast screen of the broadcast receiving apparatus according to the embodiment; FIG. 4 is a screen display diagram of a notification screen of the broadcast receiving device according to the embodiment; FIG. 10 is a screen display diagram of a broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. The screen display figure of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. The screen display figure of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. The screen display figure of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. The screen display figure of the broadcast cooperation application execution screen of the broadcast receiving apparatus which concerns on an Example. FIG. 5 is a screen display diagram of an error display screen of the broadcast receiving apparatus according to the embodiment; The screen display figure of the broadcast cooperation application execution screen of the portable information terminal which concerns on an Example. FIG. 4 is a screen display diagram of an EPG display screen of the broadcast receiving device according to the embodiment; FIG. 4 is a diagram of detailed information on an EPG display screen of the broadcast receiving device according to the embodiment; FIG. 10 is an operation sequence diagram when the broadcast receiving apparatus according to the embodiment acquires a broadcast cooperation application; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is an operation sequence diagram when terminals are linked according to the embodiment; FIG. 10 is a screen display diagram of a broadcast cooperation application launcher of the broadcast receiving device according to the embodiment; FIG. 10 is a screen display diagram of a broadcast cooperation application launcher of the broadcast receiving device according to the embodiment; FIG. 10 is a screen display diagram of a broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. FIG. 10 is a screen display diagram of a broadcast cooperation application launcher of the broadcast receiving device according to the embodiment. FIG. 4 is a screen display diagram of the broadcast receiving apparatus according to the embodiment; The screen display figure of the broadcast cooperation application launcher of the portable information terminal which concerns on an Example.

Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings.

First, an example of a digital broadcast service that can be received by the broadcast receiver of this embodiment will be described.

For example, in an example of BS/terrestrial digital broadcasting that can be received by the broadcast receiving apparatus of this embodiment, one transponder (frequency channel) has a plurality of transport streams (Tran
TS) can be multiplexed and transmitted. TS divides data strings such as video/audio elementary stream (ES) and program specific information (PSI)/service information (SI) into TS.
It is a series of TS packets of a predetermined length with added headers.

PSI stands for MPEG (Moving Picture Experts Group)
-2 It is a specific information table for identifying which program each ES included in the TS belongs to, which is defined by the standard of the -2 system. PSI stands for PAT (Program Asso
Ciation Table), PMT (Program Map Table), CA
T (Conditional Access Table), etc. The PAT uses the PID (Packet Identifier) of the PMT for the list of programs contained in the TS.
er). The PMT defines, for example, the PIDs of the constituent elements of each program. CAT
contains information about conditional access.

SI is an extension of PSI that includes program information, etc.
Association of Radio Industries and Busi
nesses: ARIB) electronic program guide (Elec
tronic Program Guide (EPG). SI is
BIT (Broadcaster Information Table), SDT (S
Service Description Table), EIT (Event Info
rmation Table), TOT (Time Offset Table), and the like. The BIT includes broadcasting station identification information, affiliated information, broadcasting station SI transmission information, and the like. S.
DT is a network ID for identifying a network and a TS for identifying a TS
ID, service I for identifying individual services (so-called channels) within the network
It includes information such as D (so-called channel number). The EIT includes service IDs for identifying individual services within the network, and event-related information such as the name of each event (so-called program), broadcast date and time, and broadcast content. The TOT contains information about the current date and time.

In addition, TS is a PCR (Program
Clock Reference) information and BM specified by ARIB STD-B24
It includes BML documents and the like that are subsets based on the L (Broadcast Markup Language) specification.

The broadcast receiving apparatus of the present embodiment receives and decodes the TS composed of the video/audio ES and various information, thereby allowing the user to view data broadcast screens produced using broadcast programs, EPG, and BML. can be provided to

In addition, the broadcast receiving apparatus of the present embodiment links digital broadcasting services with functions using a broadband network, acquires additional content via the broadband network, performs arithmetic processing in a server device, and presents processing in cooperation with a mobile terminal device. It is possible to correspond to a broadcasting and communication cooperation system that combines such as digital broadcasting service. In order to realize the broadcast-communication cooperation system, the broadcast receiver of this embodiment uses HTML (Hyper Text
It is assumed that it is possible to execute an application written in Markup Language) or the like. In addition, in the broadcast-communication collaboration system that this broadcast receiver supports, the extended BML specifications and application control information (Appli) in the broadcast-communication collaboration system
cation Information Table (AIT) and extended PSI/SI information required when transmitting applications by broadcast waves. Note that the AIT is information for providing or disseminating various information necessary for starting an application, such as an application acquisition destination, and control information for controlling the starting/terminating of an application.

The above description is based on the digital broadcasting service in Japan, but it is not limited to application only in Japan, including the broadcast communication cooperation system to which the broadcast receiving apparatus of this embodiment is compatible.

Next, a specific configuration example of the embodiment in this example will be described.

[System configuration]
FIG. 1 is a system configuration diagram showing an example of a communication system according to the present embodiment that realizes a broadcast-communication cooperation system. The communication system of this embodiment includes a broadcast receiving device 100, an antenna 100a,
A broadband network 200 such as the Internet, a router device 210, a broadcasting station radio tower 300t, a broadcasting station server 300, a service provider server 400, other application servers 500, a mobile telephone communication server 600, and a base station of the mobile telephone communication network 600
b and a mobile information terminal 700 .

The broadcast receiving apparatus 100 is a television receiver having a function corresponding to the above-mentioned broadcast-communication cooperation system in addition to an existing digital broadcast receiving function. The broadcast receiving device 100 is connected to a radio tower 300t.
A broadcast wave sent from is received via an antenna 100a. Also, the broadcast receiving device 10
0 can be connected to the Internet 200 via a router device 210 and can transmit and receive data through communication with each server device on the Internet 200 .

The router device 210 is connected to the Internet 200 by wireless or wired communication, is connected to the broadcast receiving device 100 by wireless or wired communication, and is connected to the portable information terminal 700 by wireless communication. As a result, each server device on the Internet 200 , the broadcast receiving device 100 , and the mobile information terminal 700 can mutually transmit and receive data via the router device 210 . Communication between the broadcast receiving device 100 and the mobile information terminal 700 is
Bluetooth (registered trademark) or NFC (Near F
Direct communication may be performed by a method such as Field Communication.

The radio tower 300t transmits a broadcast wave including a digital broadcast signal, AIT, control information related to application presentation, etc., from the broadcasting facility of the broadcasting station. The control information related to application presentation is control information related to superimposition of a broadcast program and an application on a television receiver and whether or not to present an application. Also, the broadcasting station is assumed to have a broadcasting station server 300 . Broadcasting station server 300 broadcasts programs (video content, etc.)
and stores metadata such as the program title, program ID, program outline, performers, broadcast date and time of each broadcast program, and provides the video content and each metadata to the service provider based on the contract. shall be possible. It should be noted that the provision of the video content and each metadata to the service provider is based on the API (Appli.
programming interface).

The service provider server 400 is a server device prepared by the service provider to provide services by the broadcast-communication cooperation system. The service provider server 400 stores, manages, and distributes moving image content and metadata provided by the broadcasting station server 300, and content and applications created for the broadcast-communication collaboration system. It also has a function of searching for applications that can be provided and providing a list in response to an inquiry from a television receiver. Note that the storage, management, and distribution of the content and metadata and the storage, management, and distribution of the application may be performed by different server devices. The broadcasting station and the service provider may be the same or may be different providers. A plurality of service provider servers 400 may be prepared for different services.
Also, the functions of the service provider server 400 may be provided by the broadcasting station server 300 .

The other application server 500 is a known server device that stores, manages, and distributes general applications, operating programs, contents, and data other than those related to the broadcast-communication cooperation system.

The mobile telephony server 600 is connected to the Internet 200, while the base station 600
It is connected to the portable information terminal 700 via b. The mobile phone communication server 600 manages telephone communication (call) and data transmission/reception via the mobile phone communication network of the mobile information terminal 700, and transfers data through communication between the mobile information terminal 700 and each server device on the Internet 200. Enables sending and receiving. Communication between mobile information terminal 700 and broadcast receiving apparatus 100 is performed by base station 60.
0b, the mobile telephone communication server 600, the Internet 200, and the router device 210.

[Hardware Configuration of Broadcast Receiver]
FIG. 2A is a block diagram showing an example of the internal configuration of the broadcast receiving apparatus 100. As shown in FIG. Broadcast receiver 100 includes main control unit 101, system bus 102, ROM 103, RAM 104, storage unit 110, LAN communication unit 121, expansion interface unit 124, digital interface unit 125, tuner/demodulation unit 131, first separation unit 132, first video decoding unit 133,
First audio decoding unit 134, first caption decoding unit 135, data broadcasting reception processing unit 141, data broadcasting engine 142, streaming reception processing unit 151, second separation unit 152, second video decoding unit 153, second audio decoding unit 154, second caption decoding unit 155, application control unit 16
1, application engine 162, video superimposition unit 171, audio selection unit 172, video display unit 173, speaker 174, video output unit 175, audio output unit 176, presentation synchronization control unit 18
1 and a terminal cooperation control unit 191 .

The main control section 101 is a microprocessor unit that controls the entire broadcast receiving apparatus 100 according to a predetermined operation program. A system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operation block in the broadcast receiving apparatus 100 .

A ROM (Read Only Memory) 103 is a memory storing a basic operating program such as an operating system and other operating programs.
EPROM (Electrically Erasable Programmable)
ROM) or a rewritable ROM such as a flash ROM is used. RAM (R
The anddom Access Memory) 104 serves as a work area when the basic operation program and other operation programs are executed. A ROM 103 and a RAM 104 are included in the main control unit 10
1 may be integrated. Also, the ROM 103 may use a partial storage area in the storage section 110 instead of having an independent configuration as shown in FIG. 2A.

The storage unit 110 stores an operation program and operation setting values of the broadcast receiving device 100, personal information of the user of the broadcast receiving device 100, and the like. Further, it is possible to store an operation program downloaded from a network, various data created by the operation program, and the like. In addition, videos, still images, etc. obtained from broadcast waves or downloaded from the network
Content such as audio can also be stored. ROM 1 using a partial area of the storage unit 110
03 may be replaced in whole or in part. Moreover, the storage unit 110 needs to retain the stored information even when power is not supplied to the broadcast receiving apparatus 100 from the outside. Therefore, for example, flash ROM or SSD (Solid Stat
e Drive) and other semiconductor device memory, HDD (Hard Disc Drive)
A device such as a magnetic disk drive such as a

It should be noted that each operation program stored in the ROM 103 and the storage unit 110 can be updated and expanded in function by downloading from each server device on the Internet 200 .

A LAN (Local Area Network) communication unit 121 is a router device 210
It is connected to the Internet 200 via the Internet 200 and transmits and receives data to and from each server device on the Internet 200 . The connection with the router device 210 may be a wired connection, or a Wi-F connection.
Wireless connection such as i (registered trademark) may be used. It is assumed that the LAN communication unit 121 includes an encoding circuit, a decoding circuit, and the like. In addition, the broadcast receiving device 100 uses the BlueTooth (registered trademark)
Other communication units such as a communication unit, an NFC communication unit, an infrared communication unit, and the like may be further provided.

The tuner/demodulator 131 receives broadcast waves from the radio tower 300t via the antenna 100a, and tunes (or
select). Further, the tuner/demodulator 131 demodulates the received broadcast signal to acquire the TS. Although the example shown in FIG. 2A exemplifies a configuration in which there is one tuner/demodulator, the broadcast receiving apparatus 100 may include a tuner/demodulator for the purpose of simultaneous display of multiple screens, recording of counterprograms, and the like. It is good also as a structure which mounts more than one. Also, based on the control of the main control unit 101, control of access restriction to the demodulated TS, etc. may be performed.

The first separation unit 132 receives the TS output from the tuner/demodulation unit 131, and separates each data such as a video data string, an audio data string, a caption data string, a program information data string, an AIT data string, a BML data string, and the like. Separate the output into columns. These data strings may be in ES format, for example. The first video decoding unit 133 decodes the video data string input from the first separation unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data string input from the first separating unit 132 and outputs audio information. The first caption decoding unit 135 decodes the caption data string input from the first separation unit 132 and outputs caption information.

The data broadcast reception processing unit 141 decodes the BML data string input from the first separation unit 132 and reproduces the BML document. The datacasting engine 142 is a BML engine that executes BML documents.
It is a browser that executes the BML document reproduced by the data broadcasting reception processing unit 141 and outputs data broadcasting screen information.

Under the control of the main control unit 101, the streaming reception processing unit 151 accesses the moving image content stored in each server device on the Internet 200 via the LAN communication unit 121, and receives the program stream ( Program Stream
m:PS). Also, based on the control of the main control unit 101, control of DRM (Digital Rights Management) processing for the acquired PS may be performed.

The second separation unit 152 receives the PS output from the streaming reception processing unit 151,
Each data string such as a video data string, an audio data string, a caption data string, etc. is separated and output. These data strings may be in ES format, for example. The second video decoding unit 153, the second audio decoding unit 154, and the second caption decoding unit 155 perform the same processing as the first video decoding unit 133, the first audio decoding unit 134, and the first caption decoding unit 135, respectively. Therefore, the description is omitted.

Note that the first separating unit 132 and the second separating unit 152, the first video decoding unit 133 and the second video decoding unit 153, the first audio decoding unit 134 and the second audio decoding unit 154, the first caption decoding unit 135 and the second The two-caption decoding unit 155 may be used in common.

Based on the AIT data string input from the first separation unit or the AIT file obtained from each server device on the Internet 200, the application control unit 161 works on the application engine 162 regarding the application created for the broadcasting and communication cooperation system, Control and manage the lifecycle and events of each application. Also, depending on the state of the application and the instructions of the AIT, it appropriately controls the functional restrictions of the application. The application engine 162 is an HTML browser that acquires and executes an application created for the broadcast-communication cooperation system under the control of the application control unit 161 .

The video superimposing unit 171 combines the video information output from the first video decoding unit 133, the subtitle information output from the first subtitle decoding unit 135, the data broadcasting screen information output from the data broadcasting engine 142, and the second video decoding unit. The video information output from 153, the subtitle information output from the second subtitle decoding unit 155, and the application execution screen information output from the application engine 162 are input, and processing such as selection and/or superimposition is performed. The image superimposing unit 171 includes a video RAM (not shown), and the image display unit 173 and the like are driven based on the image information input to the video RAM. In addition, the video superimposing unit 171 superimposes EPG screen information created based on scaling processing and the program information data string output from the first separating unit 132 as necessary based on the control of the main control unit 101. processing, etc.

The audio selection unit 172 receives audio information output from the first audio decoding unit 134, audio information output from the second audio decoding unit 154, and application execution audio information output from the application engine 162, and performs main control. The voice information is appropriately selected and output according to the control of the unit 101 .

The video display unit 173 is a display device such as a liquid crystal panel, for example, and provides the user of the broadcast receiving apparatus 100 with video information selected and/or superimposed by the video superimposing unit 171 . Speaker 174 provides the user of broadcast receiving apparatus 100 with the audio information output from audio selector 172 . The video output unit 175 is a video output interface that outputs video information selected and/or superimposed by the video superimposition unit 171 . The audio output unit 176 is an audio output interface that outputs audio information output from the audio selection unit 172 . As described above, when the broadcast display device 100 is a television receiver or the like, the video output section 175 and the audio output section 176 are not essential components of the present invention.

The presentation synchronization control unit 181 combines video information, audio information, etc. obtained by decoding the TS obtained from the broadcast wave, and video information obtained by decoding the PS obtained from each server device on the Internet 200. , audio information, etc., and application execution screen information and application execution audio information output from the application engine 162, on the video display unit 173 and the speaker 174, or on the video output unit 175 and the audio output unit 176. Synchronous control of presentation is performed based on, for example, PCR information.

When cooperating with an external mobile terminal device, the terminal cooperation control unit 191 performs functions such as discovery and authentication of a cooperating device (mobile terminal device), connection between the broadcast receiving apparatus 100 and the cooperating device, application cooperation, and the like. Manage and control.

The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving apparatus 100. In this embodiment, an analog video/audio interface, USB (Univ.
serial bus) interface, memory interface and the like. The analog video/audio interface inputs analog video/audio signals from an external video/audio output device, outputs analog video/audio signals to an external video/audio input device, and the like. The USB interface is connected to a PC or the like to transmit and receive data. Broadcast programs and contents may be recorded by connecting an HDD. Also, a keyboard or other USB devices may be connected. A memory interface connects a memory card or other memory medium to transmit and receive data.

The digital interface unit 125 is an interface that outputs or inputs encoded digital video data and/or digital audio data. The digital interface unit 125 receives the TS acquired by the tuner/demodulator 131 and the streaming reception processing unit 15
It is assumed that the PS acquired in 1 can be output as it is. Also, the TS and PS input from the digital interface unit 125 may be controlled to be input to the first separation unit 132 and the second separation unit 152 . Output of digital content stored in the storage unit 110, or
Digital interface unit 125 stores digital content in storage unit 110
You can go through The digital interface unit 125 is a DVI terminal, an HDMI (registered trademark) terminal, or the like, and may output or input data in a format conforming to the DVI specification, the HDMI specification, or the like. It may be output or input in the form of serial data conforming to the IEEE1394 specification or the like.

Broadcast receiving apparatus 100 is a television receiver as well as a DVD (Digital Versati
It may be an optical disk drive recorder such as a le Disc recorder, a magnetic disk drive recorder such as an HDD recorder, a STB (Set Top Box), or the like. PC (Personal Computer) equipped with digital broadcast reception function and broadcast communication cooperation function
ter), a tablet terminal, a game machine, or the like. If the broadcast receiving apparatus 100 is a DVD recorder, HDD recorder, STB, or the like, the video display section 173 and speaker 174 may not be provided. By connecting an external monitor and an external speaker to the video output unit 175 and the audio output unit 176, the same operation as that of the broadcast receiving apparatus 100 of this embodiment is possible.

[Software Configuration of Broadcast Receiver]
FIG. 2B is a software configuration diagram of the broadcast receiving apparatus 100 of this embodiment, and the ROM 103
, the configuration of software in the RAM 104 and the storage unit 110. FIG. In this embodiment, the ROM 103 stores a basic operating program 1001 and other operating programs, and the storage unit 110 stores a receiving function program 1002, a BML browser program 1003, an HTML browser program 1004 and other operating programs. there is The storage unit 110 also includes a content storage area 1011 that stores content such as moving images, still images, and audio, an authentication information storage area 1012 that stores authentication information used when linking with an external mobile terminal device, and the like. Various information storage areas for storing various other information are provided.

A basic operation program 1001 stored in the ROM 103 is loaded into the RAM 104, and the main control unit 101 executes the loaded basic operation program to configure a basic operation execution unit 1101. FIG. Also, the receiving function program 1002, the BML browser program 1003, and the HTML browser program 1004 stored in the storage unit 110 are expanded in the RAM 104, and the main control unit 101 executes the expanded operation programs to receive the data. function execution unit 1102, BML browser engine 1103,
Configure HTML browser engine 1104 . The RAM 104 is also assumed to have a temporary storage area for temporarily holding data created during execution of each operating program as needed.

In the following description, for the sake of simplicity, the basic operation program 1001 stored in the ROM 103 is loaded into the RAM 104 and executed by the main control unit 101 to control each operation block. It is assumed that the unit 1101 controls each operation block. Similar descriptions are made for other operating programs.

The receiving function executing unit 1102 controls each operation block of the broadcast receiving apparatus 100 in order to realize the broadcast receiving function and the broadcast communication cooperation function. In particular, the broadcast program reproducing unit 1102a includes a tuner/demodulator 131, a first separating unit 132, a first video decoding unit 133, a first audio decoding unit 134,
It mainly controls the first caption decoding unit 135 , the data broadcasting reception processing unit 141 and the data broadcasting engine 142 . It should be noted that the data broadcasting engine 142 is the BML developed on the RAM 104.
The browser engine 1103 may be substituted. The broadband content reproduction unit 1102 b mainly controls the streaming reception processing unit 151 , the second separation unit 152 , the second video decoding unit 153 , the second audio decoding unit 154 and the second caption decoding unit 155 . Linked application control unit 110
2c mainly controls the application control unit 161 and the application engine 162 . Note that the application engine 162 is an HTM developed on the RAM 104
L browser engine 1104 may be substituted. The terminal cooperation management unit 1102 d mainly controls the terminal cooperation control unit 191 .

Each operating program may be stored in the ROM 103 and/or the storage unit 110 in advance at the time of product shipment. It may be acquired from other application servers 500 or the like on the Internet 200 via the LAN communication unit 121 after product shipment. Further, each operation program stored in a memory card, an optical disc, or the like may be obtained through the expansion interface section 124 or the like.

[Broadcast station server configuration]
FIG. 3 is a block diagram showing an example of the internal configuration of the broadcasting station server 300. As shown in FIG. The broadcasting station server 300 includes a main control unit 301, a system bus 302, a RAM 304, a storage unit 310,
LAN communication unit 321 .

The main control section 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operation program. A system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operation block in the broadcasting station server 300 . R.
The AM 304 becomes a work area when executing each operation program.

The storage unit 310 stores a basic operation program 3001 and a content management/distribution program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. A moving image content storage area 3011 stores moving image content of each broadcast program broadcast by a broadcasting station. The metadata storage area 3012 stores metadata such as the program title, program ID, program outline, performers, broadcast date and time of each broadcast program.

Further, the basic operation program 3001 and the content management/distribution program 3002 stored in the storage unit 310 are developed in the RAM 304, and the main control unit 301 executes the expanded basic operation program and content management/distribution program. Thus, a basic operation execution unit 3101 and a content management/distribution execution unit 3102 are configured.

In the following description, for the sake of simplicity, the basic operation program 3001 stored in the storage unit 310 is loaded into the RAM 304 and executed by the main control unit 301 to control each operation block. It is assumed that the action execution unit 3101 controls each action block. Similar descriptions are made for other operating programs.

The content management/distribution execution unit 3102 manages the video content and the like stored in the video content storage area 3011 and the metadata storage area 3012 and metadata, and distributes the video content and the metadata to service business based on the contract. control the provision of information to users. Furthermore, the content management/distribution execution unit 3102 authenticates the service provider server 400 based on the contract as necessary when providing the video content and each metadata to the service provider. Processing, etc. are also performed.

The LAN communication unit 321 is connected to the Internet 200 and communicates with the service provider server 400 and the like on the Internet 200 . It is assumed that the LAN communication unit 321 includes an encoding circuit, a decoding circuit, and the like.

[Configuration of service provider server]
FIG. 4 is a block diagram showing an example of the internal configuration of the service provider server 400. As shown in FIG. The service provider server 400 is composed of a main control unit 401, a system bus 402, a RAM 404, a storage unit 410, and a LAN communication unit 421.

The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operating program. A system bus 402 is a data communication path for transmitting and receiving data between the main control unit 401 and each operation block in the service provider server 400 . A RAM 404 serves as a work area when each operation program is executed.

The storage unit 410 stores a basic operation program 4001 , a content management/distribution program 4002 and an application management/distribution program 4003 . The moving image content storage area 4011 and the metadata storage area 4012 store the moving image content and the like provided by the broadcasting station server 300 and each metadata, the content produced by the service provider and the metadata related to the content, and the like. The application storage area 4013 stores applications necessary for realizing each service of the broadcast-communication cooperation system to be distributed in response to requests from each television receiver.

Further, the basic operation program 4001, the content management/distribution program 4002, and the application management/distribution program 4003 stored in the storage unit 410 are expanded in the RAM 404, and furthermore, the main control unit 401 executes the expanded basic operation program and content management program. By executing the /distribution program and the application management/distribution program, a basic operation execution unit 4101, a content management/distribution execution unit 4102, and an application management/distribution execution unit 4103 are configured.

In the following description, for the sake of simplicity, the basic operation program 4001 stored in the storage unit 410 is loaded into the RAM 404 and executed by the main control unit 401 to control each operation block. It is assumed that the action execution unit 4101 controls each action block. Similar descriptions are made for other operating programs.

The content management/distribution execution unit 4102 acquires video content and the like from the broadcasting station server 300 and metadata, and manages the video content storage area 4011 and the metadata storage area 40
12, and controls distribution of the moving image content and each metadata to each television receiver. Also, the application management/distribution execution unit 4103 manages each application stored in the application storage area 4013 and controls when each application is distributed in response to a request from each television receiver. Furthermore, the application management/distribution executing unit 4103 performs authentication processing of each television receiver, etc., as necessary when distributing each application to each television receiver.

The LAN communication unit 421 is connected to the Internet 200 and communicates with the broadcast receiving device 100 and the mobile information terminal 700 via the broadcasting station server 300 on the Internet 200 and the router device 210 . It is assumed that the LAN communication unit 421 includes an encoding circuit, a decoding circuit, and the like.

[Hardware configuration of portable information terminal]
FIG. 5A is a block diagram showing an example of the internal configuration of portable information terminal 700. As shown in FIG. The portable information terminal 700 includes a main control unit 701, a system bus 702, a ROM 703, a RAM 704, a storage unit 710, a communication processing unit 720, an extended interface unit 724, an operation unit 730, an image processing unit 740, an audio processing unit 750, and a sensor unit 760. , consists of

A main control unit 701 is a microprocessor unit that controls the entire portable information terminal 700 . A system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operation block in the portable information terminal 700 .

A ROM 703 is a memory storing a basic operation program such as an operating system and other operation programs, and a rewritable ROM such as an EEPROM or a flash ROM is used. A RAM 704 serves as a work area for executing the basic operation program and other operation programs. A ROM 703 and a RAM 704 are included in the main control unit 70
1 may be integrated. Also, the ROM 703 may use a partial storage area in the storage section 710 instead of having an independent configuration as shown in FIG. 5A.

The storage unit 710 stores an operation program and operation setting values of the mobile information terminal 700, personal information of the user of the mobile information terminal 700, and the like. Further, it is possible to store an operation program downloaded from a network, various data created by the operation program, and the like. In addition, it is possible to store contents such as moving images, still images, and sounds downloaded from the network. All or part of the functions of the ROM 703 may be replaced by a partial area of the storage unit 710 . Moreover, the storage unit 710 needs to retain stored information even when power is not supplied to the portable information terminal 700 from the outside. Therefore, for example, devices such as flash ROMs, SSDs, and HDDs are used.

It should be noted that each operation program stored in the ROM 703 and storage unit 710 can be updated and expanded in function by downloading from each server device on the Internet 200 .

The communication processing unit 720 is composed of a LAN communication unit 721 , a mobile telephone network communication unit 722 and an NFC communication unit 723 . The LAN communication unit 721 is connected to the Internet 200 via the router device 210 and transmits and receives data to and from each server device on the Internet 200 . It is assumed that the connection with the router device 210 is performed by wireless connection such as Wi-Fi (registered trademark).
The mobile phone network communication unit 722 performs telephone communication (phone call) and data transmission/reception by wireless communication with the base station 600b of the mobile phone network. The NFC communication unit 723 performs wireless communication with a corresponding reader/writer when in close proximity. LAN communication unit 721, mobile telephone network communication unit 722, NF
The C communication units 723 are each provided with an encoding circuit, a decoding circuit, an antenna, and the like. Also, the communication processing unit 720 may further include other communication units such as a BlueTooth (registered trademark) communication unit and an infrared communication unit.

The extended interface unit 724 is a group of interfaces for extending the functions of the mobile information terminal 700, and in this embodiment, it is assumed to be composed of a video/audio interface, a USB interface, a memory interface, and the like. The video/audio interface inputs video/audio signals from an external video/audio output device, outputs video/audio signals to an external video/audio input device, and the like. The USB interface is connected to a PC or the like to transmit and receive data. Also, a keyboard or other USB devices may be connected. A memory interface connects a memory card or other memory medium to transmit and receive data.

The operation unit 730 is an instruction input unit for inputting an operation instruction to the portable information terminal 700, and in this embodiment, it is composed of a touch panel 730t arranged over the display unit 741 and an operation key 730k arranged with button switches. shall be Only one of them may be used.
The portable information terminal 700 may be operated using a keyboard or the like connected to the extended interface section 724 . The mobile information terminal 700 may be operated using a separate mobile terminal device connected by wired communication or wireless communication. Further, the touch panel function is the display unit 741
It may be something that is prepared by

The image processing unit 740 includes a display unit 741, an image signal processing unit 742, a first image input unit 743,
A second image input unit 744 is provided. The display unit 741 is a display device such as a liquid crystal panel, for example, and provides the user of the mobile information terminal 700 with image data processed by the image signal processing unit 742 . The image signal processing unit 742 includes a video RAM (not shown), and the video R
The display unit 741 is driven based on the image data input to AM. In addition, the image signal processing unit 742 performs format conversion, menu and other OSD (On Scr
een Display) signal has a function of performing superimposition processing and the like. The first image input section 743 and the second image input section 744 are CCD (Charge Coupled De
vice) and CMOS (Complementary Metal Oxide Sem
It is a camera unit that inputs image data of surroundings and objects by converting light input from a lens into an electrical signal using an electronic device such as a sensor.

The audio processing unit 750 includes an audio output unit 751, an audio signal processing unit 752, an audio input unit 753,
consists of The audio output unit 751 is a speaker, and provides the user of the mobile information terminal 700 with the audio signal processed by the audio signal processing unit 752 . A voice input unit 753 is a microphone that converts a user's voice or the like into voice data and inputs the voice data.

The sensor unit 760 is a group of sensors for detecting the state of the mobile information terminal 700, and in this embodiment includes a GPS receiver unit 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. , consists of These sensors make it possible to detect the position, tilt, direction, movement of the mobile information terminal 700, the brightness of the surroundings, the proximity of surrounding objects, and the like. Moreover, the mobile information terminal 700 may further include other sensors such as an air pressure sensor.

The mobile information terminal 700 may be a mobile phone, a smart phone, a tablet terminal, or the like. P.
It may be a DA (Personal Digital Assistant) or a notebook PC. It may also be a digital still camera, a video camera capable of shooting moving images, a portable game machine, or other portable digital equipment.

Note that the configuration example of the mobile information terminal 700 shown in FIG. 5A includes many components such as the sensor unit 760 that are not essential to the present embodiment, but even if the configuration does not include these components, the present embodiment without compromising the effect of In addition, a configuration (not shown) such as a digital broadcast reception function, an electronic money payment function, and the like may be added.

[Software configuration of portable information terminal]
FIG. 5B is a software configuration diagram of the portable information terminal 700 of this embodiment, and the ROM 703
, RAM 704 and storage unit 710. FIG. In this embodiment, the ROM 703 stores a basic operating program 7001 and other operating programs, and the storage unit 710 stores a cooperation control program 7002, an HTML browser program 7003 and other operating programs. Also, the storage unit 7
Reference numeral 10 denotes a content storage area 7011 for storing content such as moving images, still images, audio, etc.;
, and various information storage areas for storing various other information.

A basic operation program 7001 stored in the ROM 703 is loaded into the RAM 704, and the main control unit 701 executes the loaded basic operation program to configure a basic operation execution unit 7101. FIG. Also, the cooperation control program 7002 and the HTML browser program 7003 stored in the storage unit 710 are developed in the RAM 704,
Further, the main control unit 701 executes each expanded operation program to configure a cooperative control execution unit 7102 and an HTML browser engine 7103 . Moreover, the RAM 704
shall be provided with a temporary storage area for temporarily holding data created during execution of each operating program as needed.

In the following description, for the sake of simplicity, the basic operation program 7001 stored in the ROM 703 is loaded into the RAM 704 and executed by the main control unit 701 to control each operation block. It is assumed that the unit 7101 controls each operation block. Similar descriptions are made for other operating programs.

The cooperation control execution unit 7102 manages device authentication, connection, transmission and reception of each data, etc. when the mobile information terminal 700 performs cooperative operation with the television receiver. The HTML browser engine 7103 loads an application created for the broadcast-communication cooperation system to the mobile information terminal 70.
0 is an HTML browser.

Each operation program may be stored in the ROM 703 and/or the storage unit 710 in advance at the time of product shipment. It may be obtained from other application servers 500 or the like on the Internet 200 via the LAN communication section 721 or the mobile telephone network communication section 722 after product shipment. Further, each operation program stored in a memory card, an optical disc, or the like may be acquired via the expansion interface section 724 or the like.

[Overview of application control information (AIT)]
The application control information (AIT) of this embodiment is an application ( Hereafter, it may be referred to as a broadcast cooperation application.) and is information intended to instruct its control. In addition, the broadcast cooperation application is (1) a broadcast managed system that operates only in a broadcast reception state based on a control signal such as start/end contained in a broadcast signal, and is permitted to access broadcast resources based on the control signal. applications, (2) non-broadcast managed applications that are allowed to access broadcast resources based on means such as application authentication in an operation mode in which activation/termination, etc. are not controlled by broadcast signals, and (3) broadcast resources. It may be distinguished from other general applications for which access is not permitted.

AIT transmission methods include section format and XML (eXtensible M
AIT in the arkup Language format is converted to a data carousel (Data Carousel).
usel: DC) method, etc., and the section format or XM
An L-format AIT file is sent from a server device on the Internet 200 via http (Hype
rtext Transfer Protocol) or https (Hyperte
xt Transfer Protocol Secure) or the like may be used. Other methods may be adopted.

FIG. 6 is a data configuration diagram showing an example of the data configuration of AIT. AIT is primarily
Application type 901, application identifier 902, application control code 903, application profile 904, application acquisition source information 90
5, application boundary and access authority setting 906, activation priority 907, cache information 908, server access distribution parameter 909, and other information. Furthermore, other information may be included.

The application type 901 defines the application description method. In this embodiment, it is assumed that the description method of the application is HTML. The application identifier 902 is identification information composed of an organization identification for identifying a business and an application identification numbered for each business, for identifying an application unit. Note that an application unit is a set of HTML documents and their reference resources, each of which has an HTML document existing at a location specified by the application acquisition source information 905 as an entry document. The application control code 903 defines operation control for the target application, and is (1) automatic start, (2) operable, (3) termination,
(4) prefetching. application profile 904
is a value indicating the function of the television receiver requested by the application, and indicates a combination of functions that the television receiver has as options. Whether or not the application can be used is determined by referring to this value.

The application acquisition destination information 905 is information specifying the acquisition destination of the application, and is location information for acquiring the HTML document to be referred to first when the application is started. Since applications are assumed to be transmitted by broadcasting and stored on a server device on a communication network, the location information specified by the application acquisition destination information 905 also corresponds to both cases of acquisition by broadcasting and acquisition by communication. Regulations are made. The application boundary and access restriction setting 906 defines an operable range as a broadcast managed application in one or more areas (URL: Uniform Resource
Locator) is information shown as a set. Also, access restrictions to broadcast resources for each area are set for each function. Application boundary and access restriction setting 90
6 designates a range of document transitions for preventing transitions to unexpected documents due to a chain of document transitions from an entry document at the time of application startup, access to inappropriate broadcast resources, and the like. In addition, it is possible to set access authority to specific broadcast resources for each area within the range of the document transition.

Activation priority 907 defines which of the data broadcast by the broadcast service and the broadcast managed application by the HTML document should be preferentially activated when they exist at the same time. unconditionally designating data broadcasting as top priority on the PMT, designating the startup priority of a specific application type on the PMT, and designating the startup priority of the target application with the startup priority 907; shall be possible. The cache information 908 is information used for cache control when holding application resources in preparation for reuse of the application. With this information, it is possible to cache application resources assuming reuse even after the application ends. The server access distribution parameter 909 is a parameter set for distributing access for the purpose of reducing the load on the server where access is concentrated at the acquisition destination of the application. The television receiver may operate to stochastically delay the application of application control codes according to the setting of this parameter.

The operation of the broadcast receiving apparatus 100 of this embodiment will be described below.

[Operation sequence at application startup]
First, the process of activating the broadcast cooperation application based on the AIT transmitted by the broadcast wave in the broadcast receiving apparatus 100 of the present embodiment will be described. In the broadcast receiving apparatus 100 of this embodiment, PM
It is possible to specify which one should be preferentially started when the data broadcasting by the broadcasting service and the broadcast-linked application exist at the same time, based on the information on T, the application control code 903 of the AIT, the startup priority 907, etc. is.

FIG. 7A is an operation sequence diagram showing an example of the operation sequence of the broadcast-linked application when it is specified that the broadcast-linked application should be preferentially activated. The figure shows a broadcast receiving device 10.
0 indicates a series of flows from appropriately confirming the PMT and AIT to activating a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiving device 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 separates the PM separated by the first separating unit 132.
The T data string is acquired (S101), and the activation priority described in the PMT is confirmed. S1
When confirming that the activation priority of the broadcast cooperation application is high in the process of 01 (S102),
The application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S103), and confirms the application control code 903 of the acquired AIT data string (S104). In the process of S104, if the application control code 903 is "automatic start", furthermore, the application profile 904 of the acquired AIT data string is confirmed (S105), and execution of the broadcast cooperation application specified in the AIT is confirmed. When it is confirmed that it is possible, based on the information described in the application acquisition destination information 905, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121. (S106).

Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S107). Note that a known method may be used for the authentication process, and a detailed description thereof will be omitted. Next, the application engine 162 of the broadcast receiving device 100, based on the control of the application control unit 161,
The predetermined broadcast cooperation application distributed from the service provider server 400 received via the LAN communication unit 121 is activated (S108).

FIG. 7B is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when it is specified that the data broadcast by the broadcast service should be preferentially activated. The figure shows a series of flows until the broadcast receiving apparatus 100 confirms the PMT and AIT as appropriate and activates a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiving device 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 separates the PM separated by the first separating unit 132.
The T data string is obtained (S201), and the activation priority described in the PMT is confirmed. S2
In the process of 01, it is confirmed that the activation priority of the data broadcasting by the broadcasting service is high (
S202) and the data broadcast reception processing unit 141 acquires the BML data string separated by the first separation unit 132 and reproduces the BML document (S203). When automatic activation of data broadcasting is set by the BML document, and when the user requests activation of data broadcasting using an operation terminal (portable information terminal 700, remote control, etc.) (S204), the data broadcasting engine 14
2 generates data broadcasting screen information by executing the reproduced BML document and displays it on the video display unit 173 (S205).

After the process of S205 or simultaneously with the process of S205, the application control unit 161
acquires the AIT data string separated by the first separating unit 132 (S206), and extracts the acquired A
The application profile 904 of the IT data string is confirmed (S207). S207
In the process of 1), when it is confirmed that execution of the broadcast-linked application specified by the AIT is possible, an entry button to the executable broadcast-linked application is displayed on the data broadcasting screen. The entry button may always be displayed, and the color scheme may be changed from the inactive color to the active color only when the broadcast cooperation application can be executed. By changing the shape, the entry button may be switched between an inactive state and an active state.

When the user selects the entry button using the operation terminal (S208), the data broadcasting engine 142 ends the process of executing the BML document and generating data broadcasting screen information (S209). Subsequently, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S210), and confirms the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information described in the application acquisition destination information 905 confirmed in S210, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S211).

Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S212). Next, the broadcast receiving device 10
The application engine 162 of No. 0 activates the predetermined broadcast cooperation application distributed from the service provider server 400 and received via the LAN communication unit 121 under the control of the application control unit 161 (S213).

FIG. 7C is an operation sequence diagram showing an example of the operation sequence of the broadcast cooperation application when no priority activation is specified. In the figure, the broadcast receiving apparatus 100 receives PMT and AIT.
is appropriately confirmed and a predetermined broadcast cooperation application is activated.

When the tuner/demodulator 131 of the broadcast receiving device 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 separates the PM separated by the first separating unit 132.
The T data string is obtained (S301), and the activation priority described in the PMT is confirmed. S3
01, confirming that the activation priority of the broadcast cooperation application is high (S302),
The application control unit 161 acquires the AIT data string separated by the first separating unit 132 (S303), and confirms the application control code 903 of the acquired AIT data string (S304). In the process of S304, if the application control code 903 is "startable" instead of "automatic start", the display of the broadcast program is continued without starting neither the data broadcasting by the broadcasting service nor the broadcast cooperation application.

When the user uses the operation terminal to make a request to start data broadcasting after the process of S304 (S305), the BML data string is acquired and the BML Playback of documents, generation of data broadcasting screen information, etc. are performed (however, illustration is omitted)
. On the other hand, when the user uses the operation terminal to request activation of the broadcast-linked application launcher after the processing of S304 is completed (S306), the application control unit 161 separates the AIT data separated by the first separation unit 132. A string is obtained (S307), and the application profile 904 of the obtained AIT data string is confirmed (S308). Furthermore, the application control unit 161 displays a list of executable broadcast-linked applications as a broadcast-linked application launcher on the video display unit 173 (S309).

When the user selects a predetermined broadcast-linked application from the broadcast-linked application launcher displayed in S309 using the operation terminal (S310), the application control unit 161 separates the AIT data string separated by the first separation unit 132 into (S311), and confirms the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information described in the application acquisition destination information 905 confirmed in S311, a transmission request for the broadcast cooperation application is transmitted to the predetermined service provider server 400 via the LAN communication unit 121 (S31
2).

Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S313). Next, the broadcast receiving device 10
The application engine 162 of No. 0 activates the predetermined broadcast cooperation application distributed from the service provider server 400 and received via the LAN communication unit 121 under the control of the application control unit 161 (S314).

In addition, in the activation sequence of the broadcast cooperation application described with reference to FIGS. 7A to 7C, an example of acquiring AIT from broadcast waves is described. Alternatively, the AIT file may be acquired from. In addition, the acquisition of the broadcast cooperation application is not from the server device (service provider server 400) on the network,
You can also go from broadcast waves. That is, when the location information described in the application acquisition destination information 905 of AIT indicates a broadcast wave, the application control unit 161 transmits the HTML data string by the data carousel method or the like and is separated and output by the first separating unit 132. , and the application engine 162 executes the reproduced HTML document (broadcast-linked application).

Note that if there is no information specifying the activation priority when the data broadcast by the broadcast service and the broadcast-linked application exist simultaneously on the PMT, the application control code 90 of the AIT
3, the activation priority 907, or the like may be used to confirm the activation priority.
Similarly, even if the acquisition of the information on the PMT fails, the activation priority may be confirmed only by information such as the application control code 903 of the AIT and the activation priority 907 . That is, regardless of the information on the PMT, the AIT is periodically checked, and if there is a broadcast-linked application specified by "automatic start" in the application control code 903 of the AIT, the broadcast-linked application Priority is given to startup, AIT application control code 90
If there is no broadcast-linked application specified in 3 "automatic start", the start-up of the data broadcast by the broadcast service may be prioritized.

Further, when there is no response from the service provider server 400 for a predetermined period of time or more when the distribution request for the broadcast cooperation application is made in S106, S211, or S312, a message such as "Please wait for a while" is displayed on the video display unit 173. You may make it display. Alternatively, in this case, a message may be displayed asking the user to stop executing the broadcast cooperation application.

Also, the startup sequence of the broadcast cooperation application is not limited to the three patterns described above,
Needless to say, it may be activated by a different sequence.

[Operational sequence when linking mobile information terminals]
In the broadcast receiving device 100 of the present embodiment, it is assumed that the functions of the broadcast communication cooperation service can be expanded by cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700 . For example, by installing an application (cooperation control application) prepared by the television receiver maker, the portable information terminal 700 can be used as a high-performance remote control for the broadcast receiving apparatus 100 . Also, the broadcast cooperation application can be executed on the portable information terminal 700, and for example, a service linked to the broadcast program being displayed on the broadcast receiving device 100 can be displayed on the portable information terminal 700 as well. It should be noted that in order to extend the functions by cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700, it is desirable that the cooperation control application is activated on the mobile information terminal 700, and the operation on the mobile information terminal 700 is performed. It is assumed that the broadcast cooperation application to operate is controlled by the cooperation control application.

FIG. 8A is an operation sequence diagram showing an example of an operation sequence when the cooperative control application is activated on the mobile information terminal 700. FIG. In the figure, a mobile information terminal 700 is a broadcast receiving device 100
It shows a series of flow (first time) from performing authentication processing with to enabling cooperative operation. It is assumed that the cooperative control application is installed in the storage unit 710 of the mobile information terminal 700 in advance as the cooperative control program 7002 .

When the user instructs the activation of the cooperative control application on the portable information terminal 700 (S401), the cooperative control execution unit 7102 of the portable information terminal 700 searches for a television receiver capable of communication (cooperative operation) on the network ( S402), the display unit 741 displays the search result as a television receiver list.
to display. If a communicable television receiver cannot be found, a message to that effect is displayed and the process ends. When the user selects an arbitrary television receiver (broadcast receiving device 100 of this embodiment) from the television receiver list, the cooperation control execution unit 7102 displays a login screen for connecting to the broadcast receiving device 100 on the display unit 741. do. The user enters the authentication information (login name and password specified by the broadcast receiving apparatus 100, etc.) on the login screen via the operation unit 730.
(S403), the cooperation control execution unit 7102 stores the input authentication information in the authentication information storage area 7012 and simultaneously transmits it to the broadcast receiving apparatus 100 (S404).
. The process of transmitting the authentication information to the broadcast receiving device 100 may be performed via the LAN communication unit 721 and the router device 210, or via the NFC communication unit 723.
You can go directly to 0.

Terminal cooperation control section 191 of broadcast receiving apparatus 100 that has received the authentication information via LAN communication section 121 refers to authentication information storage area 1012 to check whether the received authentication information is correct. (S405). If the received authentication information is confirmed to be correct by the process of S405, the information of the portable information terminal 700 is stored in the authentication information storage area 101.
2 and authenticates the portable information terminal 700 (S406). Broadcast receiving device 10
The mobile information terminal 700 that has obtained 0 authentication displays the basic screen of the cooperative control application (for example, the high-performance remote controller screen) on the display unit 741 (S407). In S405, if the received authentication information is not confirmed to be correct, the terminal cooperation control unit 19 of the broadcast receiving apparatus 100
1 returns an error to the portable information terminal 700 . By the above processing, the cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700 becomes possible.

FIG. 8B is an operation sequence diagram showing an example of an operation sequence when the cooperative control application is activated on the mobile information terminal 700. As shown in FIG. In the figure, a mobile information terminal 700 is a broadcast receiving device 100
This shows a series of flows (second and subsequent times) from performing authentication processing with the user until the cooperative operation becomes possible.

When the user gives an instruction to start the cooperative control application on the mobile information terminal 700 (S501), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for a communicable television receiver on the network, and displays the search result on the television. A list of receivers is displayed on the display unit 741 . If a communicable television receiver cannot be found, a message to that effect is displayed and the process ends. The user selects an arbitrary television receiver (broadcast receiving device 100 of this embodiment) from the list of television receivers (S5
02), if the selected broadcast receiving device 100 is a device that has been connected (coordinated operation) in the past, the cooperation control execution unit 7102 reads out the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012. and transmits it to the broadcast receiving apparatus 100 (S503).

Terminal cooperation control section 191 of broadcast receiving apparatus 100 that has received the authentication information via LAN communication section 121 refers to authentication information storage area 1012 to check whether the received authentication information is correct. (S504). When the received authentication information is confirmed to be correct by the process of S504, the portable information terminal 700 is authenticated (S505). The portable information terminal 700 that has obtained the authentication of the broadcast receiving apparatus 100 displays the basic screen of the cooperation control application on the display unit 741 (S506). By the above processing, the broadcast receiving device 100 and the mobile information terminal 7
00 is ready for cooperative operation.

8A and 8B, when the broadcast cooperation application is activated in the broadcast receiving apparatus 100, the processes of FIGS. 7A and 7C may be performed after the processes of FIGS. 8A and 8B.

FIG. 8C is an operation sequence diagram showing an example of an operation sequence when the cooperative control application is activated on the mobile information terminal 700. As shown in FIG. In the figure, a mobile information terminal 700 is a broadcast receiving device 100
This shows a series of flows (second and subsequent times) from performing authentication processing with the user until the cooperative operation becomes possible. However, in the same figure, it is an example of a case where activation of the cooperation control application on the mobile information terminal 700 is requested by the broadcast receiving apparatus 100 that executes the activation sequence of the broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiving device 100 selects the channel desired by the user and acquires the TS, next, the main control unit 101 separates the PM separated by the first separating unit 132.
The T data string is acquired (S601), and the activation priority described in the PMT is confirmed. S6
When confirming that the activation priority of the broadcast cooperation application is high in the process of 01 (S602),
The application control unit 161 acquires the AIT data string separated by the first separating unit 132 (S603), and confirms the application control code 903 of the acquired AIT data string (S604). In the process of S604, if the application control code 903 is "automatic start", the application profile 904 of the acquired AIT data string is confirmed (S605). In the process of S605, when it is confirmed that the broadcast cooperation application specified by the AIT can be executed, and furthermore, when it is determined that cooperation control of the mobile terminal device is necessary, the terminal cooperation control unit 191 performs authentication. By referring to the information storage area 1012, the portable information terminal 700 is selected as the portable terminal device, and a cooperative control application activation request is transmitted to the selected portable information terminal 700 (S606).

Note that the selection of the mobile information terminal 700 by referring to the authentication information storage area 1012 is
Based on the latest information in the authentication information storage area 1012, or
based on the most frequently used information.

Further, in the processing of S606, if the mobile terminal device to which the cooperative control application activation request should be sent cannot be found, a message to that effect may be displayed on the video display unit 173. FIG. Alternatively, in this case, a message may be displayed asking the user to stop executing the broadcast cooperation application.

The main control unit 701 of the portable information terminal 700 activates the cooperation control application (cooperation control execution unit 7102) in response to the cooperation control application activation request received via the LAN communication unit 721 (
S607), furthermore, the cooperative control execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S608).

Terminal cooperation control section 191 of broadcast receiving apparatus 100 that has received the authentication information via LAN communication section 121 refers to authentication information storage area 1012 to check whether the received authentication information is correct. (S609). When the received authentication information is confirmed to be correct by the process of S609, the portable information terminal 700 is authenticated (S610). The portable information terminal 700 that has obtained the authentication of the broadcast receiving apparatus 100 displays the basic screen of the cooperation control application on the display unit 741 (S611). By the above processing, the broadcast receiving device 100 and the mobile information terminal 7
00 is ready for cooperative operation.

It should be noted that following the above-described processing, the broadcast cooperation application is
0, the processing shown in FIG. 9 may be performed. FIG. 9 is an operation sequence diagram showing an example of the activation sequence of the broadcast cooperation application of the broadcast receiving apparatus 100 and the mobile information terminal 700. As shown in FIG.

That is, after the processing of S601 to S611 in FIG. 8C, the application control unit 161 of the broadcast receiving device 100 acquires the AIT data string separated by the first separating unit 132 (S612),
The application acquisition destination information 905 of the acquired AIT data string is confirmed. Furthermore, S
Based on the information described in the application acquisition destination information 905 confirmed in 612, the LAN
A transmission request for the broadcast cooperation application (TV side) is transmitted to the predetermined service provider server 400 via the communication unit 121 (S613).

Service provider server 400, which has received the transmission request of the broadcast cooperation application (television side), performs authentication processing of broadcast receiving apparatus 100 as necessary based on the control of application management/distribution execution unit 4103, and then performs application Distribution of the predetermined broadcast cooperation application (TV side) stored in the storage area 4013 is performed via the LAN communication unit 421 (S614).
. The application engine 162 of the broadcast receiving device 100 is the application control unit 1
61, received via the LAN communication unit 121, the service provider server 4
00 (S615).

Next, the terminal cooperation control unit 191 of the broadcast receiving apparatus 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700, which is acquired from the AIT or the broadcast cooperation application (TV side) executed in S615. URL information and the like are transmitted to the portable information terminal 700 (S616
). Linkage control execution unit 7102 of mobile information terminal 700 receives via LAN communication unit 721, based on the acquisition destination URL information of the broadcast collaboration application (terminal side), etc., LAN communication unit 721
, to a predetermined service provider server 400 (S617).

The service provider server 400 that has received the transmission request of the broadcast cooperation application (terminal side)
Based on the control of the application management/distribution executing unit 4103, after authentication processing of the mobile information terminal 700 is performed as necessary, distribution of the predetermined broadcast cooperation application (terminal side) stored in the application storage area 4013 is performed via the LAN. This is done via the communication unit 421 (S618). The HTML browser engine 7103 of the portable information terminal 700 activates the predetermined broadcast cooperation application (terminal side) received via the LAN communication unit 721 and distributed from the service provider server 400 (S619).

It should be noted that the fact that the AIT file can be obtained from a predetermined server device, that the broadcast-linked application can be obtained not from a server device on the network but from a broadcast wave, etc. are described in FIGS.
It is similar to the operation sequence of FIG. 7C. In addition, when acquiring a broadcast-linked application from a broadcast wave, the broadcast-linked application (terminal side) to be executed by the mobile information terminal 700 by the broadcast receiving apparatus 100
is acquired from the broadcast wave, and the acquired broadcast cooperation application (terminal side) is sent to the mobile information terminal 700,
The data may be transferred via the communication unit 121 . Alternatively, the broadcast receiving apparatus 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave, stores it in the storage unit 110, and transmits it to the mobile information terminal 700 in the process of S616 in FIG. U to do
As the RL information, location information of the storage unit 110 of the broadcast receiving apparatus 100 may be transmitted. The broadcast receiving apparatus 100 may acquire the broadcast cooperation application (TV side) from broadcast waves, and the portable information terminal 700 may acquire the broadcast cooperation application (terminal side) from a server device on the network. Using the digital broadcasting reception function of the portable information terminal 700, the broadcast cooperation application (terminal side) may be acquired directly from the broadcast wave.

7A to 7C, 8A to 8C, and 9 can be partially combined as appropriate, and further, some operation steps can be combined with other operation steps as appropriate.
It is assumed that order change, simultaneous operation, etc. are possible.

[Basic screen of cooperative control application for mobile information terminal]
FIG. 10A is a screen display diagram showing an example of the basic screen of the cooperative control application displayed by the processing of S407 of FIG. 8A, the processing of S506 of FIG. 8B, the processing of S611 of FIG. 8C, and the like. In this embodiment, the basic screen 741 a of the cooperative control application is assumed to have a function as a high-performance remote control corresponding to the broadcast receiving apparatus 100 .

The basic screen 741a of the cooperative control application is, as shown in FIG. 10A, a power key 741a1.
, network selection keys (terrestrial digital broadcasting, BS, CS) 741a2, numeric keys (1 to 12) 74
1a3, volume up/down key 741a4, channel up/down key 741a5
, input switching key 741a6, program guide key 741a7, data key 741a8, cooperative application key 741a9, menu key 741aa, return key 741ab, cursor keys (up,
down, left, right) 741ac, determination key 741ad, color keys (blue, red, green, yellow) 741a
e. Other operation keys may also be displayed.

The operation keys described above are easy to use if they are arranged and operated in the same manner as the dedicated remote control attached to the broadcast receiving apparatus 100 . Also, a power key 741a1, a network selection key 741a
2. Numerical keys 741a3, etc. are assumed to have the same functions as the operation keys of a known TV remote controller, and detailed description thereof will be omitted. The cooperative application key 741a9 is an operation key prepared for the broadcast cooperative communication function of this embodiment.

In addition, in the processing of S204 in FIG. 7B and S305 in FIG. 7C, it is possible to start/end the data broadcasting by selecting the data key 741a8. Also, S in FIG. 7B
208 and in the processing of S310 in FIG. 7C, the cursor key 741ac and the decision key 741a
It is assumed that the executable broadcast-linked application can be selected by the operation d. Also, in the process of S306 in FIG. 7C, it is assumed that a request to activate the broadcast cooperation application launcher can be made by selecting the cooperation application key 741a9.

If the cooperative application key 741a9 or other operation keys having similar functions are prepared on the basic screen 741a of the cooperative control application, each broadcast cooperative application used in the broadcast cooperative system of the present embodiment can be easily selected/selected. It is possible to start. In addition, linked application key 7
41 a 9 or another operation key having a similar function may be provided on a dedicated remote controller attached to the broadcast receiving apparatus 100 .

FIG. 10B is a screen display diagram showing an example of the basic screen of the cooperative control application displayed by the processing of S407 of FIG. 8A, the processing of S506 of FIG. 8B, the processing of S611 of FIG. 8C, and the like. A different example.

The basic screen 741b of the cooperation control application includes a message 741b1 during cooperation control and a cooperation control application operation screen 741b2. Other objects may also be displayed. The cooperative control in progress message 741b1 is a message display for making the user aware that the portable information terminal 700 is in cooperative operation with the broadcast receiving apparatus 100. FIG. The cooperative control application operation screen 741b2 is an area where arbitrary screen display is performed by the cooperative control application, and detailed description thereof will be omitted in this embodiment. For example, the configuration within the cooperative control application operation screen 741b2 may be the same as the basic screen 741a of the aforementioned cooperative control application. A sub-screen or the like of the broadcast program being displayed on the broadcast receiving device 100 may be displayed.

As shown in FIG. 10B, by displaying the cooperation control in progress message 741b1, the user of the mobile information terminal 700 can easily understand that the mobile information terminal 700 is currently operating in cooperation with the broadcast receiving apparatus 100. become. In addition, message 741b during cooperation control
1 is not limited to character display, but may be symbol display, graphic display, or the like. The message 741b1 may be substituted for the cooperation control in progress message 741b1 by changing the background color or the like.

[Data Broadcast Screen of Broadcast Receiver]
FIG. 11 is a screen display diagram showing an example of the data broadcast screen displayed by the process of S205 in FIG. 7B. In the present embodiment, it is assumed that three broadcast cooperation applications, cooperation application A, cooperation application B, and cooperation application C, can be executed by the broadcast receiving apparatus 100 according to the description of the AIT or the like. In this case, the entry button 173a2 of the cooperative application A, the entry button 173a3 of the cooperative application B, and the entry button 173a4 of the cooperative application C are displayed at arbitrary positions on the data broadcasting screen 173a.

In the data broadcasting screen 173a as shown in FIG. 11, the basic screen 7 of the cooperative control application
Entry button 17 by using the cursor key 741ac and decision key 741ad of 41a.
3a2, entry button 173a3, entry button 173a4, etc. are selected,
When the display of the data broadcasting screen 173a ends, under the control of the application control unit 161 and the application engine 162, the cooperative application A, the cooperative application B, the cooperative application C, etc. are activated.

When the data broadcasting screen 173a is displayed, the frame color, internal color, shape, font, size, blinking state, etc. of each entry button may be appropriately changed according to the type of broadcast cooperation application, security status, etc. You can do it. For example, if the cooperative application A is a broadcast managed application, the frame color of the entry button 173a2 is set to blue, and if the cooperative application B is a non-broadcast managed application, the frame color of the entry button 173a3 is set to yellow. For example, if the cooperative application C is a general application, the frame color of the entry button 173a4 is red. Alternatively, the frame color of the entry button 173a2 is set to blue when the cooperative application A is determined to be reliable for security, and the entry button is displayed when it is determined that the cooperative application B is not necessarily reliable for security. For example, the frame color of the entry button 173a3 is set to yellow, and the frame color of the entry button 173a4 is set to red when it is determined that the cooperative application C is dangerous in terms of security.

In addition, frame color, internal color, shape, font, size, blinking status, etc. of each entry button, depending on the function and genre of the broadcast collaboration application, or depending on the expiration date of use of each broadcast collaboration application. may be changed as appropriate. The frame color, internal color, shape, font, size, blinking state, etc. of each entry button may be appropriately changed depending on whether the broadcast cooperation application has been acquired from the network. . For example, if the cooperative application A has already been acquired from the network (cached in the RAM 104 or the storage 110), the frame color of the entry button 173a2 is blue, and if the cooperative application B is being acquired, the entry button 173a2 is displayed. For example, the frame color of the button 173a3 is set to yellow, and the frame color of the entry button 173a4 is set to red when the cooperative application C has not yet been obtained.

In this way, the user of the broadcast receiving device 100 can easily grasp the types of broadcast cooperation applications that can be executed by the broadcast receiving device 100, the security status, and the like.

[Broadcast-linked application launcher screen of broadcast receiver]
FIG. 12A is a screen display diagram showing an example of a notification screen for making the user aware that there is a broadcast-linked application that can be activated in the broadcast receiving apparatus 100 of this embodiment.

For example, in the operation sequence shown in FIG. 7C, after the process of S304, the display of the broadcast program is continued without activating either the data broadcast by the broadcast service or the broadcast cooperation application. on the other hand,
In this case, in order to make the user aware that there is a broadcast-linked application that can be started, the
If icon 173b0 as shown in 1 is displayed, usability of broadcast receiving apparatus 100 is improved. That is, by displaying the icon 173b0, it is possible to prevent the user from overlooking the existence of the broadcast cooperation application that can be activated.

The icon 173b0 may be displayed at any position on the screen, but it is desirable that the icon 173b0 be displayed at a position that does not interfere with the viewing of the broadcast program. For example, four corners of the screen. Also, the icon 173b0 may be a character display as shown in FIG. 12A, or may be a symbol, a figure, or the like. Also, the icon 173b0 may be displayed all the time, or may be displayed for a predetermined period of time after the power is turned on or after the channel is switched. Alternatively, it may be displayed at the same time when the program information, channel number, etc. are displayed.

FIG. 12B is a screen display diagram showing an example of a broadcast-linked application launcher displayed by the process of S306 in FIG. 7C. In this embodiment, by the description of AIT, etc., the cooperative application A,
It is assumed that three broadcast-linked applications, linked application B and linked application C, are in a state in which broadcast receiving apparatus 100 can execute them. In this case, a broadcast-linked application launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b.
An entry button 173b4 and a return button 173b5 for cooperative application C are displayed.

While the broadcast-linked application launcher 173b1 as shown in FIG. 12B is displayed,
Entry button 173b2, entry button 173b3, and entry button 1 are operated using the cursor key 741ac and enter key 741ad on the basic screen 741a of the cooperative control application.
73b4, etc., under the control of the application control unit 161 and the application engine 162, the cooperative application A, the cooperative application B, the cooperative application C, etc. are activated. When the return button 173b5 is selected, the display of the broadcast-linked application launcher 173b1 ends.

When displaying the broadcast-linked application launcher 173b1 on the broadcast program screen 173b,
The frame color, internal color,
The shape, font, size, blinking state, etc. may be changed as appropriate, as in the case of displaying the entry buttons of each broadcast-linked application on the data broadcasting screen 173a of FIG.

Further, when there is no broadcast-linked application that can be executed by the broadcast receiving apparatus 100, the broadcast-linked application launcher 173b1 may not be displayed. Alternatively, in this case, a message such as "There is no usable application" may be displayed inside the broadcast-linked application launcher 173b1.

[Broadcast cooperation application execution screen of broadcast receiving device]
13A is a screen display diagram showing an example of a broadcast-linked application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. 9, and the like. be. It is assumed that the broadcast cooperation application of the present embodiment has graphics performance, effect performance, etc. based on HTML description, and can be overlaid on the video display unit 173 with the broadcast program screen. For example, as shown in FIG. 13A, a broadcast program screen 173c
A broadcast cooperation application section 173c1 that displays information such as weather forecast and news is overlaid on an arbitrary position above. The broadcast cooperation application part 173c1 is the first main object 173c
2, a second main object 173c3, a third main object 173c4, a background object 173c5, and so on. Other objects may also be displayed.

By selecting the data key 741a8 on the basic screen 741a of the cooperation control application in a state where the broadcast cooperation application section 173c1 is overlaid on the broadcast program screen 173c, the execution of the broadcast cooperation application is ended and the data broadcasting screen is displayed. It shall be possible to move to Also, by selecting the cooperative application key 741a9 on the basic screen 741a of the cooperative control application, it is possible to end the execution of the broadcast cooperative application and return to display only the broadcast program screen 173c. The processing may be realized by different operation keys.

Further, by operating each operation key of the basic screen 741a of the cooperation control application in a state where the broadcast cooperation application section 173c1 is overlaid on the broadcast program screen 173c,
It is assumed that it is possible to change the transparency of the broadcast cooperation application section 173c1. The change processing of the degree of transparency may be performed collectively for the entire broadcast cooperation application section 173c1, or may be performed for the first main object 173c2, the second main object 173c3, the third main object 173c4, and the background object 173c5. It may be performed alone. It may be performed for each predetermined group (for example, multiple objects existing in the same graphics layer).

When performing the transparency change processing, for example, an object is selected using the cursor key 741ac on the basic screen 741a of the cooperative control application, and the color key 741ae "blue" is selected.
The key increases the transparency of the object, and the "yellow" key decreases the transparency of the object. A different operation key may be used to change the transparency. If the transparency of the entire broadcast-linked application section 173c1 is collectively set to 100%, the broadcast-linked application section 173c1 can be temporarily hidden. For example, when an emergency broadcast is distributed by airwaves, it is also possible to display only the broadcast program screen of the emergency broadcast on the video display unit 173 by setting the transparency of the entire broadcast cooperation application unit to 100%. Alternatively, the CM detection unit (not shown) detects that the broadcast program has changed from the main video to the CM video, and the broadcast cooperation application unit 173c
1 100% transparency for the whole (or transparency that allows you to clearly see the video of the broadcast program)
You may control as follows.

By performing the above-described processing, if it is desired to check the broadcast program screen in the background while the broadcast cooperation application is running, it is possible to confirm the broadcast program screen without terminating the broadcast cooperation application. Become.

FIG. 13B shows an example different from the above of the broadcast-linked application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. is a screen display diagram showing. In the example shown in FIG. 13B, a broadcast cooperation application section 173c6 that introduces recommended programs is overlaid on an arbitrary position on the broadcast program screen 173c. First recommended program information 173c7, second recommended program information 173
c8, third recommended program information 173c9, etc. are displayed. A larger amount of recommended program information may be displayed by scrolling, page switching, or the like.

Each of the recommended program information may be information of a program recommended in relation to the currently displayed broadcast program (broadcast program screen 173c), or information of a program recommended based on the viewing history of the user. Alternatively, the information may be information about a program that has become a hot topic on the Internet or the like. Information on a recommended program sent to the user by a friend of the user of the broadcast receiving device 100 may also be used. Further, the recommended program may be a program transmitted by a broadcast wave of a digital broadcasting service, or a VOD (Vid) distributed from each server device on the Internet 200
eo On Demand) program or the like. An information screen such as a home page prepared in a server device on the Internet 200 may be used.

In a state where the broadcast cooperation application section 173c6 is overlaid on the broadcast program screen 173c, the cursor key 741ac and the enter key 74 on the basic screen 741a of the cooperation control application are pressed.
1ad is used to select the first recommended program information 173c7, the second recommended program information 173c8, the third recommended program information 173c9, etc., thereby obtaining the first recommended program information 173c7, the second recommended program information 173c8, and the third recommended program information. Each program image recommended by the program information 173 c 9 and the like is displayed on the display unit 173 .

FIG. 13C is a screen display diagram showing an example when a program video recommended by the broadcast cooperation application unit 173c6 for introducing recommended programs is displayed. For example, the basic screen 741 of the cooperative control application
Broadcast cooperation application unit 173
When the first recommended program information 173c7 of c6 is selected, the first recommended program information 1 is displayed on the display section 173.
A program video 173ca of the program recommended in 73c7 is displayed. The program video 173ca is
It may be possible to pause, jump at a specified time, or the like by operating the operation terminal by the user. Also, when displaying the program video 173ca, the original broadcast program screen 173c is PIP (Pi
It may be displayed at an arbitrary position in the picture in picture format. In this case, it may be possible to change which of the program video 173ca of the recommended program and the original broadcast program screen 173c is used as the main screen by the user's operation on the operation terminal. The size of the window of the original broadcast program screen 173c may be adjusted by the user's operation on the operation terminal.

In addition, an icon display 173cb indicating that the program video 173ca of the recommended program is a video displayed by selecting any of the recommended program information displayed in the broadcast cooperation application section 173c6 is displayed at an arbitrary position on the screen. , the user's convenience can be improved. Needless to say, the degree of transparency of the broadcast-linked application section 173c6 may be changed on the broadcast-linked application execution screen shown in FIG. 13B as well, as described above.

FIG. 13D shows an example different from the above of the broadcast-linked application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. is a screen display diagram showing. In the example shown in FIG. 13D, a broadcast cooperation application section 173cc serving as a portal for SNS (Social Networking Service) services is overlaid on an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application unit 173cc includes a first SNS service entry button 173cd, a second SNS service entry button 173ce, a third SNS service entry button 173cf,
etc. is displayed. Entry buttons for more SNS services may be displayed by scrolling, page switching, or the like.

In a state where the broadcast cooperation application portion 173cc is overlaid on the broadcast program screen 173c, the cursor key 741ac and the enter key 74 on the basic screen 741a of the cooperation control application are pressed.
1ad, the first SNS service entry button 173cd, the second SNS service entry button 173ce, the third SNS service entry button 173cf,
By selecting etc., the functions assigned to each entry button, such as the chat function, bulletin board function, Internet phone function, etc., are activated. This makes it possible to enjoy the broadcast program being displayed (broadcast program screen 173c) while exchanging information with others. again,
At the same time, the basic screen 741a of the cooperative control application on the mobile information terminal 700 may be changed to a character input screen such as a software keyboard or a voice input screen for chatting or posting on a bulletin board by voice input.

In addition to the above examples, as a broadcast cooperation application that can be executed by the broadcast receiving device 100 of the present embodiment, using the cooperation function between the broadcast receiving device 100 and the mobile information terminal 700, it is possible to further synchronize with the broadcast timing of CM. Then, the related CM application is broadcast receiving device 100 and mobile information terminal 700
may be presented on both sides. Alternatively, in a paid service available in the broadcast receiving device 100, the broadcast cooperation application checks whether the user of the broadcast receiving device 100 has subscribed to the paid service, and depending on the result, the broadcast receiving device 100 and/or the mobile information terminal 700 It may be something like changing the display of. In the broadcast receiving apparatus 100 of the present embodiment, the effects described with reference to FIGS. 13A and 13B and the like can be obtained regardless of which broadcast cooperation application is executed.

[Error display screen of broadcast receiver]
FIG. 14 shows the processing of S105 in FIG. 7A, the processing of S207 in FIG. 7B, the processing of S308 in FIG. 7C, the processing of S605 in FIG. If it is determined that the application cannot be executed, A
FIG. 10 is a screen display diagram showing an example of an error display screen when the description of IT is insufficient, or when acquisition of AIT fails.

In the broadcast receiving apparatus 100 of the present embodiment, when it is determined that the broadcast cooperation application cannot be executed, the reason why the broadcast cooperation application cannot be executed, such as the confirmation result of the application profile 904, is It is displayed in the error message 173d1. For example, as a result of checking the application profile 904, if a predetermined optional function is lacking on the television receiver side, an error message 173d1 to that effect is displayed. It is also possible to display an error code and a guide (URL or the like) of the home page of the television receiver maker in which an explanation of the error code is described. Alternatively, when the broadcast-linked application is acquired from the network, the network connection status is of course confirmed in advance. If it is not possible, an error message 173d1 to that effect is displayed. Also, the error message 173d1 may be displayed when the broadcast cooperation application cannot be acquired correctly due to poor communication conditions, although the network connection is established. An error message 173d1 may be displayed when acquisition of a broadcast-linked application is being executed and the broadcast-linked application cannot be executed yet. In addition, the error message 173d1 is also displayed when the reception of the broadcast wave is unstable and the information such as AIT can be received at first, but the information such as AIT cannot be received halfway through. good. In such a case, if the broadcast cooperation application acquired from each server device is cached as it is, it can be used as it is after the reception condition of the broadcast wave is recovered.

Also, if the result of checking the application profile 904 is that the television receiver lacks a predetermined optional function, an error message 173d1 is displayed to the effect that confirmation or update of the latest firmware for the television receiver is recommended. You can do it. Alternatively, the confirmation or update of the latest firmware is performed by the broadcast receiving device 1
00 may be automatically performed. Alternatively, if the broadcast cooperation application can be executed by adding paid optional hardware or optional software to the television receiver, a guide for the paid optional hardware or optional software may be displayed. good. Note that the error message 173d1 may be displayed on the mobile information terminal 700 instead of the broadcast receiving device 100. FIG.

[Broadcast-linked application execution screen on mobile information terminal]
FIG. 15 is a screen display diagram showing an example of a broadcast cooperation application (terminal side) execution screen displayed in the process of S619 of FIG. The broadcast-linked application execution screen 741c shown in FIG. 15 includes a main window 741c1, a sub-window 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an end button 741c7. Other objects may be added as well.

In this embodiment, it is assumed that the broadcast cooperation application (terminal side) executed on the mobile information terminal 700 is an application for confirming the details of the broadcast program being displayed on the broadcast receiving device 100 . The main window 741c1 displays the same image as the broadcast program screen displayed on the broadcast receiver 100, and the sub-window 741c2 displays an enlarged image of the position designated by the selection marker 741c3. Cursor keys 741c4 and 741c5
By selecting , the position of the selection marker 741c3 can be changed. The commentary display portion 714c6 displays the commentary subtitles regarding the broadcast program being displayed in the main window 741c1, comments posted by other users regarding the broadcast program, and the like. The end button 741c7 is a button for ending the operation of the broadcast cooperation application (terminal side).

By operating the broadcast cooperation application (terminal side) on the mobile information terminal 700, it is possible to expand the function of the broadcast communication cooperation service by the cooperation operation between the broadcast receiving apparatus 100 and the mobile information terminal 700. FIG.

[EPG screen of broadcast receiving device]
FIG. 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving apparatus 100 of this embodiment. The EPG display screen 173e is a distribution schedule of broadcast programs in the digital broadcasting service of this embodiment, which is created by the main control unit 101 based on the program information data string output from the first separation unit 132. FIG. It is assumed that the EPG display screen 173e is displayed on the video display unit 173 by selecting the program guide key 741a7 on the basic screen 741a of the cooperative control application.

In this embodiment, the EPG display screen 173e has a vertical axis representing time and a horizontal axis representing service I.
Detailed information of each broadcast program broadcast on each channel in each time slot is displayed in a matrix form of D (channel) display. Detailed information 173e1 of each broadcast program is mainly composed of a title area 173e2 and a detailed description area 173e3, as shown in FIG. 16A.

The title area 173e2 displays the program title of each broadcast program, symbols representing attributes of each broadcast program, and the like. The symbols and the like representing the attributes of each broadcast program are, for example, a symbol of "New" which means that it is a new program, or a symbol of "Replay" that means that it is a rebroadcast program.
], etc. Alternatively, a mark or the like that symbolizes "data", which means that data broadcasting by a broadcasting service is supported, may be used. Also, the broadcast receiving device 1 of the present embodiment
00, in the case of a broadcast program for which a broadcast cooperation application that can be executed is prepared, a mark or the like that symbolizes "Linkage" to that effect may be used. The detailed explanation area 173e3 displays related information such as the contents of each broadcast program, the performers, the URL of the homepage introducing each broadcast program, and the like.

It should be noted that even if a broadcast cooperation application is prepared for the broadcast program, the mark or the like symbolizing the "Linkage" displayed in the title area 173e2 is displayed on the information display device as a result of checking the application profile 904. If execution by 100 is not possible, it may not be displayed. In addition, the mark symbolized by "Linkage", which is displayed in the title area 173e2 and indicates that the broadcast program is prepared with the executable broadcast-linked application, furthermore, the linked operation with the portable terminal device is possible. Whether it is, its color, shape, font,
etc. may be changed. If the linked operation with the mobile terminal device is possible, the above-mentioned "Linkag
It is also possible to display the symbolized mark of "Mobile" together with the symbolized mark of "e".

The presence or absence of the mark symbolizing "Linkage" and the symbol symbolizing "Mobile" is indicated in advance in the EIT information including detailed information of each broadcast program. Whether or not the broadcast program has a broadcast cooperation application that can be executed by the broadcast receiving apparatus 100 of the embodiment, whether or not the executable broadcast cooperation application can perform cooperative operation with a mobile terminal device, It may be controlled by acquiring information such as. Alternatively, the information obtained from the program distribution information of the digital broadcast programs prepared in a predetermined server device on the Internet 200 is stored in an electronic program guide created based on the program information data string obtained from the broadcast waves of the digital broadcast service. You may make it add.

As described above, on the EPG display screen 173e, there is a symbolic mark of "Linkage" indicating that the broadcast program is prepared with an executable broadcast-linked application, and that linkage operation with a mobile terminal device is possible. By displaying the symbolized mark of "Mobile" indicating , the user can easily grasp the correspondence status of each broadcast program in the broadcast receiving apparatus 100 to the broadcast-communication cooperation service. Needless to say, the marks obtained by symbolizing the predetermined characters representing the attributes of each broadcast program may be replaced with the characters themselves, sentences, or the like. By changing the background color of the detailed information 173e1 of each broadcast program, the correspondence status of each broadcast program to the broadcast-communication cooperation service may be indicated. In addition, a mark symbolizing the above-mentioned "Linkage" and "Mobil
The mark symbolizing "e" may not normally be displayed in the title area 173e2, but may be displayed as a pop-up only when each broadcast program is selected with the program selection cursor 173e4.

The broadcast receiving apparatus 100 of this embodiment has a function of making viewing reservation and/or recording reservation for each broadcast program from the EPG display screen 173e. For example, while the EPG display screen 173e is being displayed, E
Move the program selection cursor 173e4 on the PG display screen 173e and press the enter key 741ad.
By selecting an arbitrary broadcast program by , a reservation for viewing and/or recording of the selected broadcast program is made.

In the above-described process, if the broadcast program for which the viewing reservation and/or the recording reservation has been made is a broadcast program corresponding to the broadcast and communication cooperation service, the broadcasting is triggered by the viewing reservation and/or the recording reservation. Acquisition of the broadcast cooperation application prepared for the broadcast program may be started without waiting for the broadcast start time of the program. That is, information (location information such as URL) designating the acquisition destination of the broadcast cooperation application is described in the EIT information including detailed information of each broadcast program. In this way, the broadcast receiving device 100 can grasp the information of the acquisition destination of the broadcast cooperation application prepared for each broadcast program at the time when the broadcast program is selected with the program selection cursor 173e4. Become. Therefore, the broadcast receiving apparatus 100 can start acquiring the broadcast cooperation application before the broadcast start time of the broadcast program.

In addition, if the broadcast program for which the viewing reservation and/or recording reservation has been made is a broadcast program compatible with the broadcast and communication cooperation service and is a broadcast program that can be operated in cooperation with the mobile terminal device, The broadcast cooperation application (terminal side) provided in the above may also start acquiring before the broadcast start time of the broadcast program by the same processing as described above. Further, as shown in FIG. 16B, information (
A two-dimensional barcode 173e5 or the like indicating location information such as a URL is displayed on the EPG display screen 1.
73e to prompt the user to download the broadcast cooperation application (terminal side) prepared for the portable terminal device.

In this way, if the broadcast receiving apparatus 100 refers to the acquisition destination information of the broadcast-linked application included in the EPG information and starts acquiring the broadcast-linked application before the broadcast start time of the broadcast program. , it becomes possible to distribute the load on the service provider server 400 that stores the broadcast cooperation application. Also, even if the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, the broadcast cooperation application can be effectively used immediately after the broadcast program starts broadcasting. become.

FIG. 17 is an operation sequence diagram showing an example of a broadcast cooperation application acquisition sequence when a broadcast program viewing reservation and/or recording reservation is made on the EPG display screen 173e.

While viewing a digital broadcast service, the main control unit 101 of the broadcast receiving device 100 acquires the program information data string output from the first separating unit 132 (S701). When the user uses the operating terminal to request activation of the EPG screen (S702), the video display unit 173 displays the EPG display screen 1.
73e is displayed (S703). When the user selects an arbitrary broadcast program using the operation terminal on the EPG display screen 173e to make a viewing reservation and/or recording reservation for the broadcast program (S704), the main control unit 101 performs the first separation. The program information data string acquired from the unit 132 is confirmed (S705), and further, the location of the acquisition destination of the broadcast cooperation application linked to the broadcast program for which the viewing reservation and/or recording reservation has been made is confirmed (S706).

After the process of S706, the application control unit 161 transmits a transmission request for the broadcast cooperation application to the predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). Service provider server 400 that has received the transmission request of the broadcast cooperation application, based on the control of application management / distribution execution unit 4103, after performing authentication processing of broadcast receiving device 100 as necessary, in application storage area 4013 Distribution of the stored predetermined broadcast cooperation application is performed via the LAN communication unit 421 (S708). Subsequently, application control unit 161 receives the predetermined broadcast cooperation application distributed from service provider server 400 via LAN communication unit 121 as RA.
It is made to be cached in M104 or storage 110 (S709).

According to the transmitting/receiving apparatus 100 of the present embodiment described above, it is possible to execute functions with higher added value.

A second embodiment of the present invention will be described below. It should be noted that the configuration and effects of this embodiment are the same as those of the first embodiment unless otherwise specified. Therefore, the differences between the present embodiment and the first embodiment will be mainly described below, and descriptions of common points will be omitted as much as possible to avoid duplication.

Although Embodiment 1 has also described an embodiment in which mobile information terminal cooperation processing (hereinafter referred to as terminal cooperation) is performed, a more detailed embodiment will be described.

When the mobile information terminal cooperation is performed, the mobile information terminal 70 located in the same home as the broadcast receiving apparatus 100
There are cases where it is desired to restrict the use of terminal cooperation to only 0 (hereinafter this restriction will be referred to as same-home restriction).
. For example, in an application for using broadcast cooperation (hereinafter referred to as a broadcast cooperation application), when the display screen of the broadcast receiving device 100 and the display screen of the mobile information terminal 700 are closely related, or when the broadcast receiving device 100 This is the case, for example, when it is desired that the user of the mobile information terminal 700 certainly views the displayed advertisement video.

A point that must be considered as a procedure is a judgment as to whether or not the target broadcast-linked application imposes same-home restrictions. If it is assumed that all broadcast-linked applications are restricted within the same home, this determination is not necessary. will need to acquire and change operating procedures. The control information regarding the presence or absence of this restriction may be acquired from the broadcast signal (for example, described as an item of AIT) or may be acquired from a server designated by the broadcasting station.

In this embodiment, including the above procedure, the procedure for ensuring that the portable information terminal 700 and the broadcast receiving apparatus 100 are in the same home will be described.

Generally, devices existing in the same home exist on a local network connected to the same router device 210 . Therefore, it can be determined that the mobile information terminal 700 is connected to the same local network as the broadcast receiving apparatus 100, and that the mobile information terminal 700 exists in the same house. A well-known method may be used to determine whether or not the target device is connected to the local network, and a description thereof will be omitted.

Also, even if the mobile information terminal 700 is not on the local network,
By directly communicating with the broadcast receiving apparatus 100 by eTooth, infrared communication, etc., it is possible to determine that the apparatus exists in the same house. In this case, the communication for acquiring the broadcast-linked application, etc.
The above direct communication may be used, or mobile phone communication may be used.

As described above, there are a plurality of possible methods for confirming the presence in the same home.

Furthermore, once it is confirmed that the portable information terminal 700 exists in the same home, it may be assumed that it exists in the same home until the program ends, or a certain valid time (for example, 10 minutes).
is provided, and it is assumed that they exist in the same house within the valid time, but if the valid time has passed, they are not considered to exist in the same house unless they are newly confirmed. This valid time is described in AIT, for example, and read by the broadcast receiving apparatus 100 .

Furthermore, for example, an event signal is set in the broadcast signal at an arbitrary time during the program progress,
A method of confirming that mobile information terminal 700 exists in the same home each time this event signal is received can also be adopted.

It is also possible to use a combination of the former two methods.

Next, a specific procedure for permitting terminal cooperation only to portable information terminals 700 existing in the same home will be described. In this embodiment, when the mobile information terminal 700 acquires the broadcast cooperation application,
Alternatively, set restrictions when acquiring information used in the broadcast collaboration application (hereinafter referred to as information used by the broadcast collaboration application and the broadcast collaboration application, specifically HTML documents and streaming video, etc.). (referred to as federation information). There are two methods for obtaining the broadcast linkage information: communication acquisition, which acquires from the broadcasting station server 300 or the provider server 400, and broadcast acquisition, which acquires from broadcast waves. In the case of communication acquisition, there are two methods: acquisition after the start of broadcast reception and acquisition before the start of broadcast reception. Furthermore, in the case of communication acquisition, when the broadcast receiving device 100 acquires once and the mobile information terminal 700 acquires from the broadcast receiving device 100, and when the mobile information terminal 700 acquires directly from the broadcast station server 300 or the operator server 400 There is There are various methods, but when viewed from the portable information terminal 700 , it can be roughly divided into two cases: acquisition from the broadcast receiving device 100 and acquisition from the broadcast station server 300 or the provider server 400 .

In this embodiment, a case where the mobile information terminal 700 acquires the broadcast cooperation information from the broadcast receiving apparatus 100 will be described, and a case where it is acquired from the server will be described in the next embodiment.

FIG. 18A shows the procedure of this example.

First, before performing terminal cooperation, each of the mobile information terminal 700 and the broadcast receiving apparatus 100
A cooperation control application, which is an application for controlling terminal cooperation, is started (S1000
1, S10002). In this state, the portable information terminal 700 makes a terminal cooperation request to the broadcast receiving apparatus 100 (S10003). Next, AIT is acquired from the broadcast signal (S1000
4). From this AIT information, it is determined whether or not the application for the target mobile information terminal has restrictions within the same home (S10006). Then, the process proceeds to step S10009, and it is determined whether or not the mobile information terminal 700 that requested terminal cooperation is in the same home as the broadcast receiver 100 (S10
009). As a result of the determination, if it is determined that the device is not in the same home, a response of non-permission of cooperation is sent to the cooperation control application on the portable information terminal side, and the process ends (S10011).

Here, in the first place, in the case of the premise that all the terminal cooperation applications have the same in-house restriction, S
10006 is skipped without being judged. S10006 is determined when there are both applications with and without the same in-house restriction.

If it is determined that mobile information terminal 700 is in the same home, or if the application does not have same-home restrictions, the process advances to S10012 to perform broadcast-linked application-related services. This service (S100
In 12), the broadcast cooperation information distribution request (S10013) from the mobile information terminal 700 is processed, and the broadcast cooperation information is distributed to the mobile information terminal 700 (S10018). The broadcast cooperation information includes information received by the broadcast receiving apparatus 100 from the distribution server (S10014, S1001
5, S10016), acquired from the broadcast signal (S10017), broadcast receiving apparatus 100
There are things that are stored in . Receipt of broadcast cooperation information by broadcast receiving device 100 (S100
16, S10017) is a broadcast cooperation information distribution request from the portable information terminal 700 (S1001
In addition to the case of 3), it may be acquired autonomously by the broadcast receiving apparatus 100 or may be acquired based on the occurrence of an event from the broadcast signal. And portable information terminal 70
0 (S10018) may also be voluntarily performed by the broadcast receiving apparatus 100 side.

After receiving (obtaining) and distributing a series of broadcast-related information, it is determined whether or not the broadcast receiving apparatus 100 continues viewing the same program (S10019). A response of cooperation disapproval is sent to the cooperation control application, and the process ends (S100
20).

If the viewing is continued, the procedure returns to S10005, and if there is an in-home restriction, it is checked whether the mobile information terminal 700 is in the same home (S10009). or whether there has been a confirmation request (S10007) from the broadcast signal or distribution server since the previous confirmation (S10008). Confirmation (S10009) is not performed,
Via S10010, execution of the next broadcast-linked application-related service (S10012) is performed. Here, it is described that the confirmation request (S10008) from the broadcast signal is obtained from the broadcast cooperation information, but it is described here assuming that the event message is also included in the broadcast cooperation information. Furthermore, this confirmation request may be written in the AIT.

The procedure described above is a loop processing procedure for the entire broadcast signal, broadcast receiving apparatus 100, mobile information terminal 700, and distribution server in the section indicated by the arrow in S10022. The confirmation request in S10007 may be made at any timing within the loop.

Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication in the distribution server (S10015). This makes it possible to confirm that the authentication request is legitimate. Also, if the authentication information described in the AIT is changed as the program progresses, and if the authentication server does not authenticate unless the authentication key incorporates information synchronized with the progress of the program, You can confirm that you continue to watch. In this case, the AIT information is appropriately read and updated (S10021). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast cooperation information instead of being described in the AIT. Furthermore, as a method of substantially changing the authentication information, it is also possible to use a method of changing the URL itself of the distribution server according to the progress of the program.

In this way, while executing the broadcast-linked application-related service (S10012), the portable information terminal 700 receives the broadcast at each preset effective time, or at each broadcast signal or confirmation request from the distribution server. By checking whether it is in the same house as the device 100,
It is possible to appropriately execute broadcast-related applications with same-home restrictions. Furthermore, by using the authentication information embedded in the broadcast signal for authentication in the distribution server, it is possible to ensure the validity of the distribution request. You can also confirm that you are still watching.

According to the mobile information terminal linking technology according to the present embodiment described above, it is possible to implement the same home restriction for the mobile information terminal linked with the broadcast receiving apparatus.

In this embodiment, a case will be described in which the mobile information terminal 700 acquires the broadcast cooperation information from the distribution server.

FIG. 18B shows the procedure of this example.

First, before performing terminal cooperation, each of the mobile information terminal 700 and the broadcast receiving apparatus 100
A cooperation control application, which is an application for controlling terminal cooperation, is started (S1010).
1, S10102). In this state, the mobile information terminal 700 makes a terminal cooperation request to the broadcast receiving apparatus 100 (S10103). Next, AIT is acquired from the broadcast signal (S1010
4). Information such as the URL of the distribution server is obtained from this AIT information, and the information is transmitted to the portable information terminal 700 (S10105). Next, the broadcast receiving apparatus 100 issues a time confirmation request to the distribution server (S10106), and based on this request, the distribution server transmits time information to the broadcast receiving apparatus 100 (S10107). As a result, the subsequent authentication key issuance (S10115) can be performed according to the time of the distribution server.

Thereafter, loop control indicated by an arrow in S10127 is entered.

First, portable information terminal 700 issues an authentication key issuance request or a broadcast cooperation information distribution request to broadcast receiving apparatus 100 (S10109). The authentication key is used in the broadcast cooperation information distribution request to the distribution server in the latter stage (S10125). The broadcast cooperation distribution request in S10109 is a distribution request for information acquired from the broadcast signal, and corresponds to the procedure of S10126 in the latter stage.

In any case, when the request of S10109 is issued from the mobile information terminal, it is determined whether or not the broadcast collaboration application has restrictions within the same home (S10111).
2. If not, skip the procedure of S10112 and proceed to S10114. If all the broadcast cooperation applications have the same in-home restriction, the determination in S10111 is not performed, and the process proceeds to S10112. In S10112, it is determined whether or not the portable information terminal that has issued the request is in the same home, and if not, terminal cooperation is terminated (S10113). If it is in the same house, the requested procedure, acquisition of broadcast cooperation information from the distribution server (S10125) or acquisition of broadcast cooperation information from the broadcast signal (S10126), is performed. The procedure of S10126 is also described because acquisition from the broadcast signal may be performed in addition to the acquisition from the distribution server.

First, the acquisition procedure (S10125) of the broadcast cooperation information from the distribution server will be described.

First, the broadcasting receiver 100 issues an authentication key requested by the information linking terminal 700 . At this time, the authentication key contains time information at the time of issuance, and is stored within a predetermined period of time (for example, 1
0 minutes). The distribution server confirms the authentication information including whether the authentication key is within the validity period, and permits distribution of the broadcast cooperation information if the authentication is OK. After that, the distribution of information is permitted within the effective time, but the distribution is stopped when the effective time expires. For example, the streaming video cannot be viewed after the effective time has passed.

The preset valid time may be held in the distribution server, or may be stored in the broadcast receiving apparatus 100
may be acquired from a broadcast signal (eg, AIT) and the valid time information may be incorporated into the authentication key. The valid time information is notified to the mobile information terminal 700 in advance so that the issuance of the authentication key is requested before the valid time expires. Alternatively, the valid time is managed by the broadcast receiving device 100, and after confirming that the mobile information terminal 700 is in the same home before the valid time expires, the broadcast receiving device 100 automatically sends the mobile information terminal 700. You may issue an authentication key to it.

The valid time may be the same in one program, or may be changed according to the progress of the program. Also, if there is no valid time setting, once authentication is performed, the authentication may be valid while the program is being viewed.

Furthermore, the authentication information described in the AIT may be incorporated into the authentication key used for authentication on the distribution server (S10117). This makes it possible to confirm that the authentication request is legitimate. Also, if the authentication information described in the AIT is changed as the program progresses, and if the authentication server does not authenticate unless the authentication key incorporates information synchronized with the progress of the program, You can confirm that you continue to watch. In this case, the AIT information is appropriately read and updated (S10124). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast cooperation information instead of being described in the AIT. Furthermore, as a method of substantially changing the authentication information, it is also possible to use a method of changing the URL itself of the distribution server according to the progress of the program. In this case, the URL is changed when the distribution server is the same but the entrance is different. In this case, the procedures of transmitting distribution server information (S10105), requesting time confirmation (S10106), and transmitting time information (S10107) are performed each time the change is made.

Next, a procedure (S10126) for acquiring broadcast cooperation information from a broadcast signal will be described.

In this case, after confirming that mobile information terminal 700 is in the same home, broadcast receiving apparatus 100 acquires broadcast cooperation information from the broadcast signal (S10119), and then distributes the information to mobile information terminal 700. (S10120).

When the broadcast cooperation information is changed as the program progresses, a change notification may be issued from the broadcast signal (S10110), and the broadcast cooperation information may be acquired with the notification as a trigger. In this case, if it is acquired from the distribution server, the broadcast receiving apparatus 100 issues an authentication key to the portable information terminal (S10115) and notifies that there has been a change notification. If it is within the validity period, the issuance of the authentication key may be omitted and only the change notification may be sent. In the case of acquisition from a broadcast signal, broadcast receiving apparatus 100 acquires information (S10120) and distributes it to the mobile information terminal (S10120). In addition, in the case of acquisition from a broadcast signal, it may be confirmed that the mobile information terminal 700 is in the same home for each change notification. I don't mind. Here, the change notification from the broadcast signal (S101
10) is described as being acquired from the broadcast linkage information, but here, the event message is also described as being included in the broadcast linkage information. Furthermore, this change notification may be written in the AIT.

After a series of reception (acquisition) and distribution processing of broadcast-related information is completed, it is determined whether or not the broadcast receiving apparatus 100 continues viewing the same program (S10121). A response of cooperation disapproval is sent to the cooperation control application, and the process ends (S101
23). If viewing is continued, the process returns to S10108 to continue loop processing S10127.

In this way, by including the time information in the authentication key used for authentication of the distribution server and managing the validity period, it is possible to periodically confirm that the portable information terminal 700 is in the same home as the broadcast receiving apparatus 100. It is possible to appropriately execute broadcast-related applications with same-home restrictions.
Furthermore, by using the authentication information embedded in the broadcast signal for authentication at the distribution server,
The validity of the distribution request can be ensured, and if the authentication information of the broadcast signal is appropriately changed, it is possible to confirm that the same program is being viewed continuously.

According to the mobile information terminal cooperation technology according to the present embodiment described above, even when the mobile information terminal that cooperates with the broadcast receiving apparatus acquires the broadcast cooperation information from the distribution server, it is possible to realize the same home restriction. .

In Embodiments 2 and 3, the procedure for realizing the intra-house restriction in terminal cooperation has been described, but depending on the broadcast cooperation application, use from outside the home may also be permitted. This embodiment will explain such a case. For example, when a program such as television shopping is publicity/advertisement, it is desirable for broadcasters to be able to use the broadcast cooperation application regardless of whether it is inside or outside the home. In the case of such a program, once registered in the broadcast receiving apparatus 100, use of the broadcast cooperation application may be permitted regardless of whether the mobile information terminal 700 is at home. In this case, the broadcast video itself is used as streaming data, and the broadcast receiving device 1
00 via the Internet to the portable information terminal 700, the convenience will be further improved. Streaming data may be encrypted in broadcast receiving apparatus 100 for copyright protection. Whether or not the broadcast cooperation application permits use from outside the home, including distribution of broadcast video outside the home, is described in data (for example, AIT) in the broadcast signal.

A specific procedure is shown in FIG. 18C. Since a part of the procedure is common to the second and third embodiments, the description of the parts overlapping with the second and third embodiments will be omitted. When there is a terminal cooperation request (S10203) from outside the home, if the application is permitted to be used outside the home, the broadcast receiving device 100 confirms whether the request source is a registered portable information terminal ( S10205) allows cooperation. Here, if necessary, authentication may be performed between mobile information terminal 700 and broadcast receiving apparatus 100 in order to protect the copyright of broadcast video and broadcast link information (
S10207). At that time, the authentication may be the authentication in the authentication server (S
10207). Information on whether or not copyright protection is required and information on the authentication method for copyright protection are acquired from the broadcast signal (for example, described in AIT), and control is performed accordingly. If such information is not stored in the broadcast signal, a predetermined method predetermined in broadcast receiving apparatus 100 is followed. For example, predetermined copyright protection processing may be performed. Moreover, when these information are not stored in the broadcast signal, the broadcast receiver 1
00, it may be determined in advance that the copyright protection process is not performed.

Specific examples (1) to (4) of authentication for copyright protection are shown below. Only one of each of the following authentications may be performed. Alternatively, a plurality of authentications exemplified below may be combined. Also, the authentication illustrated below may be combined with other authentication processing not illustrated below.

(1) Authentication by ID and Password When the portable information terminal 700 is registered in the broadcast receiving apparatus 100, an ID and password are issued, and the broadcast receiving apparatus 100 confirms the ID and password to permit cooperation.

(2) Use of Encryption Key In addition to authentication using the above ID and password, the broadcast receiving apparatus 100 transmits an encryption key for decrypting encrypted video data and the like to the portable information terminal. This encryption key may be acquired from a broadcast signal (for example, described in AIT).

(3) Use of authentication server A method of issuing an encryption key for decrypting encrypted video data from an authentication server.
The portable information terminal 700 transmits the ID and password to the authentication server and acquires the encryption key. In this case, the location information (specifically, the URL) of the authentication server is transmitted in a broadcast signal (for example, A
IT) and transmitting this location information from the broadcast receiving apparatus 100 to the mobile information terminal 700 further enhances safety. If the mobile information terminal 700 cannot obtain the encryption key, it cannot decrypt the video or the like. Authentication may be completed by notifying broadcast receiving apparatus 100 from 700 that the encryption key has been obtained. Note that billing may be performed by the authentication server.

(4) Mutual Authentication of Encryption Key The encryption keys possessed by the broadcast receiving apparatus 100 and the portable information terminal 700 are mutually authenticated, and copyright protection is authenticated by obtaining confirmation.

When information stored in a broadcast signal indicates that copyright protection is required by a prescribed method, terminal cooperation is not permitted if copyright protection cannot be authenticated by the prescribed method.
Moreover, even if there is no designation in the broadcast signal and authentication is performed by the default method of the broadcast receiver 100, terminal cooperation is not permitted if copyright protection cannot be authenticated by the default method.

When terminal cooperation is permitted, it is not confirmed whether or not the mobile information terminal 700 exists in the same house thereafter, and the request from the mobile information terminal 700 (S10211), the broadcast receiving apparatus 100
autonomous control, broadcast linking information distribution (S10217) to mobile information terminal 700 according to request from broadcast signal (S10210), authentication key for distribution server issuance (S10212
)I do. In this case, it is not necessary to perform control in which the effective time is set. Portable information terminal 700 outside the home acquires the broadcast cooperation information from broadcast receiving apparatus 100 or the distribution server using the issued authentication key (S10215). Also, the authentication information obtained from the broadcast signal (for example, described in the AIT) is embedded in the authentication key issued by the broadcast receiving apparatus 100, and the distribution server uses the authentication key in which the authentication information obtained from the broadcast signal is embedded. If access is permitted if there is, it is possible to further optimize the use outside the home.

In addition, there are cases where it is better not to allow unlimited use of broadcast-linked apps, such as when discounts are given as a premium for watching programs. After that, it is preferable to permit the use of the distribution server even if it is not in the same house. In this case, mobile information terminal 700 does not have to be registered with broadcast receiving apparatus 100 .

A specific procedure in this case is shown in FIG. 18D. Since this procedure is partly the same as that of FIG. 18C, the explanation of the overlapping parts is omitted. First, while mobile information terminal 700 is in the same home as broadcast receiving apparatus 100, broadcast receiving apparatus 10 is received from mobile information terminal 700.
0, and broadcast receiving apparatus 100 confirms that mobile information terminal 700 is in the same home (S10305), and then permits the cooperation. where, if necessary,
For copyright protection of broadcast video and broadcast link information, authentication may be performed between portable information terminal 700 and broadcast receiving apparatus 100 (S10307). At that time, the authentication may be performed by an external authentication server. Information on whether or not copyright protection is required, and information on authentication methods for copyright protection are broadcast signals (for example, recorded in AIT).
from and control accordingly. If such information is not stored in the broadcast signal, a predetermined method predetermined in broadcast receiving apparatus 100 is followed. For example, predetermined copyright protection processing may be performed. Further, it may be determined in advance that the broadcast receiving apparatus 100 does not perform copyright protection processing when such information is not stored in the broadcast signal.

Specific examples (5) to (7) of authentication for copyright protection are shown below. Only one of each of the following authentications may be performed. Alternatively, a plurality of authentications exemplified below may be combined. Also, the authentication illustrated below may be combined with other authentication processing not illustrated below.

(5) Use of Encryption Key While mobile information terminal 700 is in the same home, broadcast receiving apparatus 100 transmits an encryption key for decrypting encrypted video data to the mobile information terminal. This encryption key may be acquired from a broadcast signal (for example, described in AIT). Authentication is achieved by handing over this encryption key within the same home. Furthermore, if the encryption key cannot be obtained from the broadcast signal until a certain point in the program, and the transfer of the encryption key to the portable information terminal 700 is limited to within the same home, the user must be in the same home at that time. Limits can be set and can be used to award premiums for viewing.

(6) Use of authentication server A method of issuing an encryption key for decrypting encrypted video data from an authentication server.
The portable information terminal 700 transmits the ID and password to the authentication server and acquires the encryption key. In this case, the location information (specifically, the URL) of the authentication server is transmitted in a broadcast signal (for example, A
IT) and transmitting this location information from the broadcast receiving apparatus 100 to the mobile information terminal 700 further enhances safety. If the mobile information terminal 700 cannot obtain the encryption key, it cannot decrypt the video or the like. Authentication may be completed by notifying broadcast receiving apparatus 100 from 700 that the encryption key has been obtained. The access to the authentication server may be done inside or outside the house, but the location information of the authentication server cannot be acquired from the broadcast signal until a certain point in the program. If delivery is limited to within the same house, it is possible to set a restriction that the user must be in the same house at that time, which can also be used to give a premium to viewing. Note that billing may be performed by the authentication server.

(7) Mutual Authentication of Encryption Key The encryption keys possessed by the broadcast receiving apparatus 100 and the portable information terminal 700 are mutually authenticated, and copyright protection is authenticated by obtaining confirmation. This authentication may be performed inside the house or outside the house.

When information stored in a broadcast signal indicates that copyright protection is required by a predetermined method, terminal cooperation is not permitted if copyright protection cannot be authenticated by the predetermined method. Also, even if there is no designation in the broadcast signal and authentication is performed by the default method of the broadcast receiver 100,
If copyright protection cannot be authenticated by the prescribed method, terminal cooperation is not permitted. The procedure after terminal cooperation is permitted is the same as the procedure in FIG. 18C, so the explanation is omitted.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to use the mobile information terminal that cooperates with the broadcast receiving apparatus from outside the home while paying attention to copyright protection.

In an actual usage situation, it is more desirable to easily know whether or not there is a terminal-linked application for each program and which terminal-linked application can be used. In this embodiment, a method for displaying the availability of terminal-linked applications will be described.

FIG. 19A shows the launcher screen (173b1
This is an example of 1). The broadcast-linked application is displayed as a framed character icon. Broadcast cooperation applications (173b12 to 173b14) for the broadcast receiving apparatus 100 and broadcast cooperation applications (173b15 to 173b17) for the portable information terminal, which are associated with the program being viewed, are displayed. In this example, the application status is indicated by the thickness of the border surrounding the character string and the color of the border. Main body applications A, B (173b12, 173b13) and terminal applications A, B (173b15, 173
b16) is available, and main body application C (173b14) and terminal application (173
b17) is unavailable. A state in which the terminal application cannot be used means that none of the mobile information terminals 700 that are in a state of being able to communicate with the broadcast receiving apparatus 100 have the function to execute the application.

FIG. 19B is a screen after terminal application A is selected in FIG. 19A. The state of each mobile information terminal 700 related to terminal application A is shown. The portable information terminals displayed on this screen are terminals that have been linked with or registered with the broadcast receiving apparatus 100 in the past.

Mobile terminal 1 (173b22) and mobile terminal 2 (173
b23) is in a state of being able to communicate with the broadcast receiving apparatus 100, and mobile terminal 3 (173b24) and mobile terminal 4 (173b25) with dotted frame lines are not in a state of being able to communicate with the broadcast receiving apparatus 100. showing. In addition, mobile terminal 1 (173b2
2) and mobile terminal 3 (173b24) have the function of executing terminal application A, and mobile terminal 2 (173b23) and mobile terminal 4 (173b25), whose frame is gray, do not have the function of executing terminal application A. It is shown that. Furthermore, if the app is already running on the device, you may use an icon with a design that indicates that.

In addition, the icon is visually easier to understand if a pattern is used, so an example is shown below.

FIG. 19C is an example of a launcher screen (173b31) showing a list of broadcast cooperation applications. Icons are shown for each type of mobile information terminal 700 in addition to the broadcast receiving device 100 . 17
3b32 and 173b33 are icons indicating the broadcast receiving apparatus 100, and 173b34 and 1
73b35 is an icon indicating the smartphone type portable information terminal 700, and 173b36
is an icon indicating the head-mounted display type portable information terminal 700 . Each app is for the device indicated by the icon.

In FIG. 19C, when the application cannot be used, a mark (in this case, a circle with diagonal lines) is displayed superimposed on the image of the device to indicate that the application is not available. Also, regarding the broadcast receiving apparatus 100, if the application is already running, a mark indicating that fact (in this case, a circle with a dot) may be superimposed and displayed. With this display, it is possible to prevent the unnecessary operation of advancing the launcher procedure even though it has already been executed. In the case of the portable information terminal 700, it is also possible to display a mark indicating that the application is being executed when the application is being executed on all terminals that are capable of communicating with the broadcast receiver and that can execute the application.

FIG. 19D shows the screen (173
b41). The state of the portable information terminal 700 of the type corresponding to the application C is shown. On this screen, if the mobile information terminal 700 does not have the function of executing the broadcast-linked application, if it is not in a state capable of communicating with the broadcast receiving device 100, or if the broadcast-linked application is already being executed, it is displayed. A mark representing the object is superimposed on the icon. In this example, a circle is marked with a slash (173b44, 173b46) if it does not have an execution function, a triangle is marked with an exclamation mark (173b45, 173b46) if communication is not possible, and a circle is marked if it is already running. mark (173b43) is displayed.

Furthermore, it is desirable to have a display method that shows that there is a broadcast cooperation application when the situation changes without having to activate the launcher each time. For example, when the power is turned on, when the channel is changed, when the broadcast cooperation application is changed at the beginning of the program or during the program, there is a change in the communication state between the broadcast receiving device 100 and the portable information terminal 700. In this case, when the execution status of the application changes, the icon is displayed only for a predetermined time, and the status at that time is displayed.

FIG. 19E shows an example of such a case. When an icon indicating the type of each device is displayed, it indicates that there is a broadcast cooperation application corresponding to that type of device. in this case,
A circle with a slash indicates that there are no devices of that type that are enabled to run the app. A dot in a circle indicates that the app is running on all enabled devices of that type.

FIG. 19F is a display screen (10401) on the portable information terminal 700. FIG. Portable information terminal 70
When requesting terminal cooperation from 0, it is more convenient for use if a list shows which broadcast cooperation application can be used in which broadcast receiving device 100 . FIG. 19F shows an example of the list (104
02). This table shows which broadcast receiver 100 at home can use the broadcast cooperation application corresponding to the program to be checked. In addition, if the status of each broadcast receiving device 100 is also displayed, the convenience will be enhanced especially when the device is used from outside the home. In this example, while receiving the program,
Display examples of other program being received, empty, and other program reserved (when recording of another program is reserved from the middle of the program) are shown. It should be noted that if a plurality of tuners exist in the broadcast receiving apparatus 100, displaying the state for each of the plurality of tuners would further improve convenience. Table 102
02, branch numbers are used to distinguish tuners in the same device. For example, receiving device B
- 1 and receiver B- 2 are tuners in the same broadcast receiver 100 . In the case of terminal cooperation, if broadcast video and audio can be received as streaming data, the broadcast receiving device 10
It is not necessary to use the 0 video part, and if the tuner in the broadcast receiving apparatus 100 can be used, the broadcast can be used.

In addition, in order to perform the display described in this embodiment, information indicating whether the application corresponds to the broadcast receiving apparatus 100 or what type of portable information terminal 700 the application corresponds to is required for each broadcast-linked application. must be Also, broadcast receiving apparatus 100 and mobile information terminal 700 require information for executing corresponding applications. These pieces of information can be acquired by the information receiving device 100 by being described in the AIT, for example.

According to the portable information terminal cooperation technology according to the present embodiment described above, it is possible to use a more convenient broadcast cooperation service by displaying information about the broadcast cooperation application, the broadcast receiving device 100, and the portable information terminal 700. becomes.

Examples of embodiments of the present invention have been described above using Examples 1 to 5, but needless to say,
The configuration that implements the technology of the present invention is not limited to the above-described embodiment, and various modifications are conceivable. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. These all belong to the scope of the present invention. Numerical values, messages, and the like appearing in the sentences and drawings are merely examples, and the effects of the present invention are not impaired even if different ones are used.

Some or all of the above-described functions and the like of the present invention may be realized by hardware by designing them in an integrated circuit, for example. Alternatively, the functions may be realized by software, in which the microprocessor unit or the like interprets and executes an operation program for realizing each function. Hardware and software may be used together.

The software for controlling the broadcast receiving device 100 may be stored in advance in the ROM 103 and/or the storage unit 110 of the broadcast receiving device 100 at the time of product shipment. Other application servers 5 on the Internet 200 after product shipment
00 or the like via the LAN communication unit 121 . Also, the software stored in a memory card, an optical disc, or the like may be acquired via the expansion interface section 124 or the like. Similarly, the software for controlling the mobile information terminal 700 may be stored in the ROM 703 and/or the storage unit 710 of the mobile information terminal 700 in advance at the time of product shipment. LAN communication unit 721 or mobile telephone network communication unit 722 from other application servers 500 or the like on the Internet 200 after product shipment.
or the like. Also, the software stored in a memory card, an optical disc, or the like may be acquired via the expansion interface section 724 or the like.

Also, the control lines and information lines shown in the drawings are those considered necessary for explanation, and do not necessarily show all the control lines and information lines on the product. In fact, it may be considered that almost all configurations are interconnected.

100: broadcast receiver, 100a: antenna, 101: main control unit, 102: system bus, 103: ROM, 104: RAM, 110: storage unit, 121: LAN communication unit, 1
24: expansion interface section, 125: digital interface section, 131: tuner/
demodulation unit 132: first separation unit 133: first video decoding unit 134: first audio decoding unit 13
5: first caption decoding unit, 141: data broadcasting reception processing unit, 142: data broadcasting engine, 1
51: streaming reception processing unit, 152: second separation unit, 153: second video decoding unit, 15
4: second audio decoding unit, 155: second caption decoding unit, 161: application control unit, 16
2: application engine, 171: video superimposition unit, 172: audio selection unit, 173: video display unit, 174: speaker, 175: video output unit, 176: audio output unit, 181: presentation synchronization control unit, 191 terminal cooperation control part,
200: Internet, 210: Router device,
300t: radio tower, 300: broadcasting station server, 301: main control unit, 302: system bus,
304: RAM, 310: storage unit, 321: LAN communication unit,
400: service provider server, 401: main control unit, 402: system bus, 404: R
AM, 410: storage unit, 421: LAN communication unit,
500: Other Application Servers, 600: Mobile Telephony Server, 600b:
base station,
700: portable information terminal, 701: main control unit, 702: system bus, 703: ROM, 7
04: RAM, 710: Storage unit, 720: Communication processing unit, 721: LAN communication unit, 7
22: mobile phone network communication unit, 723: NFC communication unit, 724: expansion interface unit, 7
30: operation unit, 740: image processing unit, 741: display unit, 742: image signal processing unit, 743
: first image input unit, 744: second image input unit, 750: audio processing unit, 751: audio output unit, 752: audio signal processing unit, 753: audio input unit, 760: sensor unit, 761: GPS receiving unit , 762: gyro sensor, 763: geomagnetic sensor, 764: acceleration sensor, 765
: illumination sensor, 766: proximity sensor

Claims (1)

A display method in a broadcast receiving device capable of receiving, via broadcast waves, video information of a broadcast program and application-related information relating to an application that can be executed in conjunction with the broadcast program,
a receiving step of receiving broadcast waves;
a decoding step of decoding video information of a channel-selected broadcast program contained in the received broadcast wave to generate a video of the broadcast program;
Application-related information is obtained from the received broadcast wave, and if location information included in the application-related information indicates that the application exists on a server on a network, the application is obtained from the server and the location information is obtained. indicates that the application is transmitted by broadcast waves, an application acquisition step of acquiring the application via broadcast waves;
an application execution step of executing the acquired application in the broadcast receiving device;
a video acquisition step of acquiring a video transmitted via a network by the executed application;
a display step capable of displaying the decoded video of the broadcast program, or simultaneously displaying two videos of the video acquired via the network by the application and the decoded video of the broadcast program,
In the displaying step, from a first display state in which the decoded video of the broadcast program selected on the channel is displayed, two images of the video acquired via the network by the application and the decoded video of the broadcast program are displayed. It is possible to transition to a second display state in which the
In the second display state, the size of either the decoded image of the broadcast program or the image transmitted via the network can be changed,
The application-related information includes a URL as information on the boundary of the application for specifying the range of resources that the application can access;
limiting the range of transitions of HTML documents that can be referenced by the application and limiting the range of resources that can be accessed by the application, based on the URL as information about the boundary of the application;
Further, at the time of channel selection, if the acquired application-related information includes information indicating automatic activation of the application, the application is acquired in the application acquisition step, and the acquired application is launched in the application execution step. ,
application-related information indicating the automatic activation is repeatedly transmitted;
Display method.

Images