JP7428743B2 - Mobile information terminal and display method - Google Patents

Description

The present invention relates to a portable information terminal and a display method.

One of the expanded functions of digital broadcasting services is data broadcasting, which transmits digital data via broadcast waves and displays various information such as weather forecasts, news, and recommended programs. Many broadcast receiving apparatuses capable of receiving data broadcasting are already commercially available, and many techniques related to data broadcasting reception have been published, including Patent Document 1 listed below.

Japanese Patent Application Publication No. 2001-186486

A feature of data broadcasting is that a broadcast receiving device compatible with digital broadcasting services can receive data broadcasting by itself, and can acquire/display various information. On the other hand, with data broadcasting, the amount of data that can be transmitted is limited due to radio band restrictions, making it difficult to obtain high-definition screen displays and sophisticated effects. There was a problem in that it was difficult to implement on a broadcast receiving device.

An object of the present invention is to provide a portable information terminal and a display method that can perform functions with higher added value.

An example of a means for solving the above problem is a mobile information terminal capable of displaying information or images in a user's viewing direction in cooperation with an external video display device, and an imaging unit that takes an image in the viewing direction. a control unit that detects the position of a video display screen frame of the external video display device based on the imaging result of the imaging unit; and a display unit that displays information or video, the control unit further comprising: A portable information terminal is used, which uses the detected position of the video display screen frame of the external video display device to control the brightness of an area of the display section that corresponds to the outside of the video display screen frame.

By using the technology of the present invention, it is possible to provide a mobile information terminal and a display method that can perform functions with higher added value.

FIG. 1 is a system configuration diagram of a communication system according to an embodiment. FIG. 1 is a block diagram of a broadcast receiving device according to an embodiment. FIG. 2 is a software configuration diagram of a broadcast receiving device according to an embodiment. FIG. 2 is a block diagram of a broadcasting station server according to an embodiment. FIG. 2 is a block diagram of a service provider server according to an embodiment. FIG. 1 is a block diagram of a mobile information terminal according to an embodiment. FIG. 2 is a software configuration diagram of a mobile information terminal according to an embodiment. FIG. 3 is a data configuration diagram of application control information according to an embodiment. FIG. 2 is an operation sequence diagram of the broadcast receiving device according to the embodiment when an application is started. FIG. 2 is an operation sequence diagram of the broadcast receiving device according to the embodiment when an application is started. FIG. 2 is an operation sequence diagram of the broadcast receiving device according to the embodiment when an application is started. FIG. 3 is an operation sequence diagram when the mobile information terminals according to the embodiment cooperate. FIG. 3 is an operation sequence diagram when the mobile information terminals according to the embodiment cooperate. FIG. 3 is an operation sequence diagram when the mobile information terminals according to the embodiment cooperate. FIG. 2 is an operation sequence diagram of the broadcast receiving device and the mobile information terminal when starting an application according to the embodiment. FIG. 3 is a screen display diagram of a basic screen of a cooperative control application of a mobile information terminal according to an embodiment. FIG. 3 is a screen display diagram of a basic screen of a cooperative control application of a mobile information terminal according to an embodiment. FIG. 3 is a screen display diagram of a data broadcast screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a notification screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application launcher of a broadcast receiving device according to an embodiment. FIG. 3 is a screen display diagram of a broadcast collaboration application execution screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a broadcast collaboration application execution screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a broadcast collaboration application execution screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a broadcast collaboration application execution screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of an error display screen of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application execution screen of the mobile information terminal according to the embodiment. FIG. 3 is a screen display diagram of an EPG display screen of the broadcast receiving device according to the embodiment. FIG. 3 is a diagram of detailed information on an EPG display screen of the broadcast receiving device according to the embodiment. FIG. 3 is an operation sequence diagram of the broadcast receiving device according to the embodiment when acquiring a broadcast cooperation application. FIG. 3 is an operation sequence diagram when terminals cooperate according to the embodiment. FIG. 3 is an operation sequence diagram when terminals cooperate according to the embodiment. FIG. 3 is an operation sequence diagram when terminals cooperate according to the embodiment. FIG. 3 is an operation sequence diagram when terminals cooperate according to the embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application launcher of a broadcast receiving device according to an embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application launcher of a broadcast receiving device according to an embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application launcher of a broadcast receiving device according to an embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application launcher of a broadcast receiving device according to an embodiment. FIG. 3 is a screen display diagram of the broadcast receiving device according to the embodiment. FIG. 3 is a screen display diagram of a broadcast collaboration application launcher of a mobile information terminal according to an embodiment. FIG. 2 is an explanatory diagram showing an example of a case where a user wears a head-mounted display type mobile information terminal. FIG. 3 is an operation sequence diagram when the mobile information terminals according to the embodiment cooperate. FIG. 4 is a screen display diagram of a display position selection screen according to the embodiment. FIG. 3 is a screen display diagram of an out-of-frame display screen according to the embodiment. FIG. 3 is an operation sequence diagram when the mobile information terminals according to the embodiment cooperate. FIG. 3 is an operation sequence diagram when the mobile information terminals according to the embodiment cooperate. FIG. 3 is a screen display diagram of a mark display screen of the broadcast receiving device according to the embodiment. FIG. 2 is a software configuration diagram of a mobile information terminal according to an embodiment. FIG. 2 is an operation sequence diagram when an application is started on the mobile information terminal according to the embodiment. FIG. 3 is a screen display diagram of a data broadcasting screen on a mobile information terminal according to an embodiment. FIG. 3 is an operation sequence diagram when an application is started on the mobile information terminal according to the embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application launcher on a mobile information terminal according to an embodiment. FIG. 3 is a screen display diagram of a broadcast cooperation application execution screen on the mobile information terminal according to the embodiment.

Examples of embodiments of the present invention will be described below with reference to the drawings.

First, an example of a digital broadcast service that can be received by the broadcast receiving apparatus of this embodiment will be described.

For example, in an example of BS/digital terrestrial broadcasting that can be received by the broadcast receiving apparatus of this embodiment, a plurality of transport streams (TS) can be multiplexed and transmitted on one transponder (frequency channel). TS is a predetermined length obtained by dividing a data string such as a video/audio elementary stream (ES), program specific information (PSI)/service information (SI), etc. and adding a TS header. This is a series of TS packets.

PSI is a unique information table defined by the MPEG (Moving Picture Experts Group)-2 system standard for identifying which program each ES included in a TS belongs to. PSI is composed of PAT (Program Association Table), PMT (Program Map Table), CAT (Conditional Access Table), and the like. The PAT defines a list of programs included in the TS using the PID (Packet Identifier) of the PMT. The PMT defines the PID of each program component. CAT includes information regarding conditional access.

In addition, SI is an extension of PSI to include program information, etc., and is based on the Electronic Program Guide specified in ARIB STD-B10 by the Association of Radio Industries and Businesses (ARIB). e: EPG). SI includes BIT (Broadcaster Information Table), SDT (Service Description Table), EIT (Event Information Table), TOT (Time Offset Table), etc. Consists of. The BIT includes broadcasting station identification information, affiliated information, broadcasting station SI transmission information, and the like. The SDT includes information such as a network ID for identifying a network, a TS ID for identifying a TS, and a service ID (so-called channel number) for identifying individual services (so-called channels) within the network. The EIT includes a service ID for identifying each service within the network, and information regarding the event, such as the name, broadcast date and time, and broadcast content of each event (so-called program). TOT includes information regarding the current date and time.

The TS also includes PCR (Program Clock Reference) information, which serves as a reference for playback timing in the decoder, and BML documents that are subsetted based on the BML (Broadcast Markup Language) specifications defined in ARIB STD-B24. .

The broadcast receiving device of this embodiment receives and decodes the TS made up of the video/audio ES and various information, so that the user can receive broadcast programs, data broadcast screens, etc. produced using EPG, BML, etc. It is possible to provide

In addition, the broadcast receiving device of this embodiment links digital broadcasting services with functions using a broadband network, and acquires additional content via the broadband network, performs arithmetic processing in the server device, and performs presentation processing in cooperation with a mobile terminal device. It is possible to support broadcasting and communication cooperation systems that combine digital broadcasting services with digital broadcasting services. In order to realize the broadcast communication cooperation system, it is assumed that the broadcast receiving apparatus of this embodiment is capable of executing an application written in HTML (Hyper Text Markup Language) or the like. In addition, in the broadcast communication cooperation system that this broadcast receiving device supports, extended BML specifications, application control information (Application Information Table: AIT) in the broadcast communication cooperation system, and extended PSI/ Uses SI information. Note that the AIT is information for providing or disseminating various information necessary to start the application, such as where the application is obtained, and control information for controlling the start/termination of the application.

Although the above explanation is based on the digital broadcasting service in Japan, the application is not limited to only in Japan, including the broadcasting communication cooperation system to which the broadcasting receiving apparatus of this embodiment is compatible.

Next, a specific configuration example of the embodiment in this example will be explained.

[System configuration]
FIG. 1 is a system configuration diagram showing an example of a communication system of this embodiment that realizes a broadcast communication cooperation system. The communication system of this embodiment includes a broadcast receiving device 100, an antenna 100a, a broadband network 200 such as the Internet, a router device 210, a radio tower 300t of a broadcasting station, a broadcasting station server 300, a service provider server 400, and other application servers 500. , a mobile telephone communication server 600, a base station 600b of a mobile telephone communication network, and a mobile information terminal 700.

The broadcast receiving device 100 is a television receiver that has a function compatible with the broadcast communication cooperation system in addition to the existing digital broadcast reception function. Broadcast receiving device 100 receives broadcast waves transmitted from radio tower 300t via antenna 100a. Further, the broadcast receiving device 100 can be connected to the Internet 200 via the router device 210, and can send and receive data through communication with each server device on the Internet 200.

The router device 210 is connected to the Internet 200 via wireless or wired communication, to the broadcast receiving device 100 via wireless or wired communication, and to the mobile information terminal 700 via wireless communication. This allows each server device on the Internet 200, the broadcast receiving device 100, and the mobile information terminal 700 to mutually transmit and receive data via the router device 210. Note that the communication between the broadcast receiving device 100 and the mobile information terminal 700 may be performed directly using a method such as Bluetooth (registered trademark) or NFC (Near Field Communication) without going through the router device 210.

The radio tower 300t transmits broadcast waves containing digital broadcast signals, AIT, control information regarding application presentation, etc. from the broadcast equipment of the broadcast station. Note that the control information regarding application presentation is control information regarding overlapping of a broadcast program and an application on a television receiver, and whether or not an application can be presented. Further, it is assumed that the broadcast station includes a broadcast station server 300. The broadcasting station server 300 stores broadcast programs (video content, etc.) and metadata such as the program title, program ID, program outline, performers, broadcast date and time of each broadcast program, and stores the video content and each metadata. It shall be possible to provide the service to the service provider based on the contract. Note that the video content and each metadata may be provided to the service provider through an API (Application Programming Interface) provided in the broadcasting station server 300.

The service provider server 400 is a server device prepared by a service provider to provide services using the broadcasting and communication cooperation system. The service provider server 400 stores, manages, and distributes video content and metadata provided from the broadcasting station server 300, as well as content and applications created for the broadcasting and communication cooperation system. It also has the ability to search for and provide a list of available applications in response to inquiries from television receivers. Note that storage, management, and distribution of the content and metadata and storage, management, and distribution of the application may be performed by different server devices. The broadcast station and the service provider may be the same or different providers. A plurality of service provider servers 400 may be provided for different services. Furthermore, the functions of the service provider server 400 may also be provided by the broadcasting station server 300.

The other application server 500 is a known server device that stores, manages, and distributes general applications, operating programs, contents, and data other than those related to the broadcast communication cooperation system.

Mobile telephone communication server 600 is connected to the Internet 200 and, on the other hand, to mobile information terminal 700 via base station 600b. The mobile phone communication server 600 manages telephone communication (calls) and data transmission and reception via the mobile phone communication network of the mobile information terminal 700, and manages data transmission and reception between the mobile information terminal 700 and each server device on the Internet 200. Enables sending and receiving. Note that communication between the mobile information terminal 700 and the broadcast receiving device 100 may be performed via the base station 600b, the mobile telephone communication server 600, the Internet 200, and the router device 210.

[Hardware configuration of broadcast receiving device]
FIG. 2A is a block diagram showing an example of the internal configuration of broadcast receiving device 100. The broadcast receiving apparatus 100 includes a main control section 101, a system bus 102, a ROM 103, a RAM 104, a storage section 110, a LAN communication section 121, an expansion interface section 124, a digital interface section 125, a tuner/demodulation section 131, a first separation section 132, First video decoding section 133, first audio decoding section 134, first subtitle decoding section 135, data broadcasting reception processing section 141, data broadcasting engine 142, streaming reception processing section 151, second separation section 152, second video decoding section 153, second audio decoding unit 154, second subtitle decoding unit 155, application control unit 161, application engine 162, video superimposition unit 171, audio selection unit 172, video display unit 173, speaker 174, video output unit 175, audio output 176, a presentation synchronization control section 181, and a terminal cooperation control section 191.

The main control section 101 is a microprocessor unit that controls the entire broadcast receiving apparatus 100 according to a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving data between the main control unit 101 and each operational block within the broadcast receiving apparatus 100.

The ROM (Read Only Memory) 103 is a memory in which basic operating programs such as an operating system and other operating programs are stored. For example, a rewritable ROM such as an EEPROM (Electrically Erasable Programmable ROM) or a flash ROM is used. . A RAM (Random Access Memory) 104 serves as a work area when basic operation programs and other operation programs are executed. The ROM 103 and the RAM 104 may be integrated with the main control unit 101. Further, the ROM 103 may not have an independent configuration as shown in FIG. 2A, but may use a part of the storage area within the storage unit 110.

The storage unit 110 stores operating programs and operating settings of the broadcast receiving apparatus 100, personal information of the user of the broadcast receiving apparatus 100, and the like. Further, it is possible to store operating programs downloaded from the network and various data created using the operating programs. It is also possible to store content such as moving images, still images, audio, etc., obtained from broadcast waves or downloaded from a network. All or part of the functions of the ROM 103 may be replaced by a partial area of the storage unit 110. Further, the storage unit 110 needs to hold stored information even when power is not supplied to the broadcast receiving apparatus 100 from the outside. Therefore, for example, devices such as semiconductor element memories such as flash ROMs and SSDs (Solid State Drives), and magnetic disk drives such as HDDs (Hard Disc Drives) are used.

It is assumed that each of the operating programs stored in the ROM 103 and the storage unit 110 can be updated and functionally expanded by download processing from each server device on the Internet 200.

A LAN (Local Area Network) communication unit 121 is connected to the Internet 200 via a router device 210 and sends and receives data to and from each server device on the Internet 200. The connection with the router device 210 may be a wired connection or a wireless connection such as Wi-Fi (registered trademark). It is assumed that the LAN communication unit 121 includes an encoding circuit, a decoding circuit, and the like. Furthermore, the broadcast receiving device 100 may further include other communication units such as a BlueTooth (registered trademark) communication unit, an NFC communication unit, an infrared communication unit, and the like.

The tuner/demodulator 131 receives broadcast waves from the radio tower 300t via the antenna 100a, and tunes (selects) the channel of the service desired by the user based on the control of the main controller 101. Further, the tuner/demodulator 131 demodulates the received broadcast signal to obtain a TS. Note that although the example shown in FIG. 2A illustrates a configuration in which there is one tuner/demodulator, the broadcast receiving apparatus 100 may have a tuner/demodulator for the purpose of displaying multiple screens simultaneously, recording a different program, etc. It is also possible to have a configuration in which multiple devices are installed. Further, based on the control of the main control unit 101, control of access restriction to the demodulated TS, etc. may be performed.

The first separation unit 132 inputs the TS output from the tuner/demodulation unit 131, and receives each data such as a video data string, an audio data string, a subtitle data string, a program information data string, an AIT data string, a BML data string, etc. Separate and output into columns. These data strings may be in ES format, for example. The first video decoding unit 133 decodes the video data string input from the first separation unit 132 and outputs video information. The first audio decoding unit 134 decodes the audio data string input from the first separating unit 132 and outputs audio information. The first subtitle decoding unit 135 decodes the subtitle data string input from the first separating unit 132 and outputs subtitle information.

The data broadcast reception processing unit 141 decodes the BML data string input from the first separation unit 132 and reproduces a BML document. The data broadcast engine 142 is a BML browser that executes a BML document, executes the BML document reproduced by the data broadcast reception processing unit 141, and outputs data broadcast screen information.

Based on the control of the main control unit 101, the streaming reception processing unit 151 accesses video content etc. placed in each server device on the Internet 200 via the LAN communication unit 121, and receives a program stream ( Program Stream:PS). Further, based on the control of the main control unit 101, DRM (Digital Rights Management) processing for the acquired PS may be controlled.

The second separation section 152 receives the PS output from the streaming reception processing section 151, separates it into each data string such as a video data string, an audio data string, a subtitle data string, etc., and outputs the separated data strings. These data strings may be in ES format, for example. The second video decoding unit 153, second audio decoding unit 154, and second subtitle decoding unit 155 perform the same processing as the first video decoding unit 133, first audio decoding unit 134, and first subtitle decoding unit 135, respectively. Therefore, the explanation will be omitted.

Note that the first separation section 132 and the second separation section 152, the first video decoding section 133 and the second video decoding section 153, the first audio decoding section 134 and the second audio decoding section 154, the first subtitle decoding section 135 and the second The two subtitle decoding units 155 may be used in common.

The application control unit 161 operates on the application engine 162 regarding the application created for the broadcast communication cooperation system based on the AIT data string input from the first separation unit or the AIT file acquired from each server device on the Internet 200, Control and manage the lifecycle and events of each application. Further, depending on the state of the application and instructions from the AIT, the functional restrictions of the application are controlled as appropriate. The application engine 162 is an HTML browser that obtains and executes an application created for the broadcasting and communication cooperation system under the control of the application control unit 161.

The video superimposition unit 171 receives the video information output from the first video decoding unit 133, the subtitle information output from the first subtitle decoding unit 135, the data broadcasting screen information output from the data broadcasting engine 142, and the second video decoding unit. 153, subtitle information output from the second subtitle decoding unit 155, and application execution screen information output from the application engine 162, and performs processing such as selection and/or superimposition. The video superimposing section 171 includes a video RAM (not shown), and the video display section 173 and the like are driven based on video information input to the video RAM. Further, under the control of the main control unit 101, the video superimposition unit 171 performs scaling processing or superimposes EPG screen information created based on the program information data string output from the first separation unit 132, as necessary. Perform processing, etc.

The audio selection unit 172 inputs audio information output from the first audio decoding unit 134, audio information output from the second audio decoding unit 154, and application execution audio information output from the application engine 162, and performs main control. The audio information is appropriately selected and output under the control of the section 101.

The video display section 173 is, for example, a display device such as a liquid crystal panel, and provides the user of the broadcast receiving apparatus 100 with the video information selected and/or superimposed by the video superimposition section 171. The speaker 174 provides the user of the broadcast receiving apparatus 100 with the audio information output from the audio selection section 172. The video output unit 175 is a video output interface that outputs the video information that has been selected and/or superimposed by the video superimposition unit 171. The audio output section 176 is an audio output interface that outputs the audio information output from the audio selection section 172. Note that, as described above, when the broadcast display device 100 is a television receiver or the like, the video output section 175 and the audio output section 176 are not essential components of the present invention.

The presentation synchronization control unit 181 provides video information, audio information, etc. obtained by decoding TS obtained from broadcast waves, and video information obtained by decoding PS obtained from each server device on the Internet 200. control of presentation synchronization on the video display unit 173 and speaker 174, or on the video output unit 175 and audio output unit 176, as well as application execution screen information and application execution audio information output from the application engine 162; is performed based on, for example, PCR information.

When coordinating with an external mobile terminal device, the terminal cooperation control unit 191 discovers and authenticates the cooperating device (mobile terminal device), connects the broadcast receiving device 100 and the cooperating device, cooperates with applications, etc. Management and control.

The expansion interface unit 124 is a group of interfaces for expanding the functions of the broadcast receiving device 100, and in this embodiment, it is configured of an analog video/audio interface, a USB (Universal Serial Bus) interface, a memory interface, etc. do. The analog video/audio interface inputs analog video signals/audio signals from an external video/audio output device, outputs analog video signals/audio signals to the external video/audio input device, and so on. The USB interface is connected to a PC or the like to send and receive data. Broadcast programs and content may be recorded by connecting an HDD. Additionally, a keyboard or other USB devices may be connected. The memory interface connects a memory card or other memory medium to send and receive data.

The digital interface unit 125 is an interface that outputs or inputs encoded digital video data and/or digital audio data. It is assumed that the digital interface section 125 can directly output the TS acquired by the tuner/demodulation section 131 and the PS acquired by the streaming reception processing section 151. Further, control may be performed so that the TS and PS input from the digital interface section 125 are input to the first separation section 132 and the second separation section 152. The digital content stored in the storage unit 110 may be output or stored in the storage unit 110 via the digital interface unit 125. The digital interface unit 125 may be a DVI terminal, an HDMI terminal, or the like, and may output or input data in a format compliant with the DVI specifications, HDMI specifications, or the like. The data may be output or input in the form of serial data conforming to the IEEE1394 specification or the like.

The broadcast receiving device 100 may be a television receiver, an optical disk drive recorder such as a DVD (Digital Versatile Disc) recorder, a magnetic disk drive recorder such as an HDD recorder, an STB (Set Top Box), or the like. It may also be a PC (Personal Computer), a tablet terminal, a game machine, etc. that has a digital broadcast reception function and a broadcast communication cooperation function. If the broadcast receiving device 100 is a DVD recorder, HDD recorder, STB, etc., the video display section 173 and the speaker 174 may not be provided. By connecting an external monitor and an external speaker to the video output section 175 and the audio output section 176, the same operation as the broadcast receiving apparatus 100 of this embodiment is possible.

[Software configuration of broadcast receiving device]
FIG. 2B is a software configuration diagram of the broadcast receiving apparatus 100 of this embodiment, and shows the software configuration in the ROM 103, RAM 104, and storage unit 110. In this embodiment, a basic operating program 1001 and other operating programs are stored in the ROM 103, and a receiving function program 1002, a BML browser program 1003, an HTML browser program 1004, and other operating programs are stored in the storage unit 110. There is. The storage unit 110 also includes a content storage area 1011 that stores contents such as videos, still images, and audio, an authentication information storage area 1012 that stores authentication information, etc. used when linking with external mobile terminal devices, etc.; It is assumed that various information storage areas are provided to store various other information.

The basic operation program 1001 stored in the ROM 103 is expanded into the RAM 104, and the main control section 101 further executes the expanded basic operation program to constitute a basic operation execution section 1101. Further, the reception function program 1002, BML browser program 1003, and HTML browser program 1004 stored in the storage unit 110 are each expanded to the RAM 104, and the main control unit 101 further executes each of the expanded operation programs to perform reception. It includes a function execution unit 1102, a BML browser engine 1103, and an HTML browser engine 1104. Furthermore, the RAM 104 is provided with a temporary storage area that temporarily holds data created when each operating program is executed, as needed.

In the following, to simplify the explanation, the process in which the main control unit 101 controls each operation block by expanding the basic operation program 1001 stored in the ROM 103 into the RAM 104 and executing it will be referred to as basic operation execution. The description will be made assuming that the unit 1101 controls each operation block. Similar descriptions are made for other operating programs.

The reception function execution unit 1102 controls each operational block of the broadcast reception apparatus 100 in order to realize a broadcast reception function and a broadcast communication cooperation function. In particular, the broadcast program playback section 1102a includes a tuner/demodulation section 131, a first separation section 132, a first video decoding section 133, a first audio decoding section 134, a first subtitle decoding section 135, a data broadcast reception processing section 141, and a data broadcast reception processing section 141. It mainly controls the broadcast engine 142. Note that the data broadcasting engine 142 may be replaced by the BML browser engine 1103 developed on the RAM 104. Furthermore, the communication content playback section 1102b mainly controls the streaming reception processing section 151, the second separation section 152, the second video decoding section 153, the second audio decoding section 154, and the second subtitle decoding section 155. The cooperative application control unit 1102c mainly controls the application control unit 161 and the application engine 162. Note that the application engine 162 may be replaced by an HTML browser engine 1104 developed on the RAM 104. The terminal cooperation management section 1102d mainly controls the terminal cooperation control section 191.

Each of the operating programs may be stored in advance in the ROM 103 and/or the storage unit 110 at the time of product shipment. The information may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121 after the product is shipped. Further, each of the operating programs stored in a memory card, an optical disk, or the like may be acquired via the expansion interface unit 124 or the like.

[Broadcast station server configuration]
FIG. 3 is a block diagram showing an example of the internal configuration of the broadcast station server 300. The broadcasting station server 300 includes a main control section 301, a system bus 302, a RAM 304, a storage section 310, and a LAN communication section 321.

The main control section 301 is a microprocessor unit that controls the entire broadcasting station server 300 according to a predetermined operating program. The system bus 302 is a data communication path for transmitting and receiving data between the main control unit 301 and each operational block within the broadcast station server 300. The RAM 304 serves as a work area when each operating program is executed.

The storage unit 310 stores a basic operation program 3001 and a content management/distribution program 3002, and further includes a video content storage area 3011 and a metadata storage area 3012. A video content storage area 3011 stores video content and the like of each broadcast program broadcast by a broadcast station. The metadata storage area 3012 stores metadata such as the program title, program ID, program outline, performers, broadcast date and time of each of the broadcast programs.

Further, the basic operation program 3001 and content management/distribution program 3002 stored in the storage unit 310 are each expanded to the RAM 304, and the main control unit 301 further executes the expanded basic operation program and content management/distribution program. This constitutes a basic operation execution unit 3101 and a content management/distribution execution unit 3102.

In the following, to simplify the explanation, the process in which the main control unit 301 controls each operation block by expanding the basic operation program 3001 stored in the storage unit 310 into the RAM 304 and executing it will be described as a basic explanation. The description will be made assuming that the action execution unit 3101 controls each action block. Similar descriptions are made for other operating programs.

The content management/distribution execution unit 3102 manages the video content, etc. and each metadata stored in the video content storage area 3011 and the metadata storage area 3012, and provides services for the video content, etc. and each metadata based on a contract. control when providing information to persons. Furthermore, when providing the video content, etc. and each metadata to the service provider, the content management/distribution execution unit 3102 performs authentication of the service provider server 400 based on the contract, as necessary. We also carry out processing, etc.

The LAN communication unit 321 is connected to the Internet 200 and communicates with the service provider server 400 and the like on the Internet 200. It is assumed that the LAN communication section 321 includes an encoding circuit, a decoding circuit, and the like.

[Service provider server configuration]
FIG. 4 is a block diagram showing an example of the internal configuration of the service provider server 400. The service provider server 400 includes a main control section 401, a system bus 402, a RAM 404, a storage section 410, and a LAN communication section 421.

The main control unit 401 is a microprocessor unit that controls the entire service provider server 400 according to a predetermined operating program. The system bus 402 is a data communication path for transmitting and receiving data between the main control unit 401 and each operational block within the service provider server 400. The RAM 404 serves as a work area when each operating program is executed.

The storage unit 410 stores a basic operation program 4001, a content management/distribution program 4002, and an application management/distribution program 4003, and further includes a video content storage area 4011, a metadata storage area 4012, and an application storage area 4013. The video content storage area 4011 and the metadata storage area 4012 store the video content, etc. and each metadata provided from the broadcasting station server 300, content produced by the service provider, metadata related to the content, and the like. The application storage area 4013 stores applications necessary for realizing each service of the broadcasting and communication cooperation system to be distributed in response to requests from each television receiver.

In addition, the basic operation program 4001, content management/distribution program 4002, and application management/distribution program 4003 stored in the storage unit 410 are each expanded to the RAM 404, and the main control unit 401 is also loaded with the expanded basic operation program and content management program. By executing the /distribution program and the application management/distribution program, a basic operation execution unit 4101, a content management/distribution execution unit 4102, and an application management/distribution execution unit 4103 are configured.

In the following, to simplify the explanation, the process in which the main control unit 401 controls each operation block by expanding the basic operation program 4001 stored in the storage unit 410 into the RAM 404 and executing it will be described as a basic explanation. The description will be made assuming that the action execution unit 4101 controls each action block. Similar descriptions are made for other operating programs.

The content management/distribution execution unit 4102 acquires video content, etc. and each metadata from the broadcast station server 300, manages video content, etc. and each metadata stored in the video content storage area 4011 and the metadata storage area 4012, and controls distribution of the video content, etc. and each metadata to each television receiver. Further, the application management/distribution execution unit 4103 manages each application stored in the application storage area 4013 and controls the distribution of each application in response to a request from each television receiver. Furthermore, the application management/distribution execution unit 4103 also performs authentication processing for each of the television receivers as necessary when distributing each of the applications to each of the television receivers.

The LAN communication unit 421 is connected to the Internet 200 and communicates with the broadcast receiving device 100 and the mobile information terminal 700 via the broadcast station server 300 on the Internet 200 and the router device 210. It is assumed that the LAN communication section 421 includes an encoding circuit, a decoding circuit, and the like.

[Hardware configuration of mobile information terminal]
FIG. 5A is a block diagram showing an example of the internal configuration of mobile information terminal 700. The mobile information terminal 700 includes a main control section 701, a system bus 702, a ROM 703, a RAM 704, a storage section 710, a communication processing section 720, an expansion interface section 724, an operation section 730, an image processing section 740, an audio processing section 750, and a sensor section 760. , consists of.

The main control section 701 is a microprocessor unit that controls the entire mobile information terminal 700. The system bus 702 is a data communication path for transmitting and receiving data between the main control unit 701 and each operational block within the mobile information terminal 700.

The ROM 703 is a memory in which basic operating programs such as an operating system and other operating programs are stored, and a rewritable ROM such as an EEPROM or a flash ROM is used, for example. The RAM 704 serves as a work area when executing basic operation programs and other operation programs. The ROM 703 and the RAM 704 may be integrated with the main control unit 701. Further, the ROM 703 may not have an independent configuration as shown in FIG. 5A, but may use a part of the storage area within the storage unit 710.

The storage unit 710 stores the operating program and operation setting values of the portable information terminal 700, the personal information of the user of the portable information terminal 700, and the like. Further, it is possible to store operating programs downloaded from the network and various data created using the operating programs. It is also possible to store content downloaded from the network, such as videos, still images, and audio. All or part of the functions of the ROM 703 may be replaced by a partial area of the storage unit 710. Furthermore, the storage unit 710 needs to retain stored information even when power is not supplied to the portable information terminal 700 from the outside. Therefore, for example, a device such as a flash ROM, SSD, or HDD is used.

It is assumed that each of the operating programs stored in the ROM 703 and the storage section 710 can be updated and functionally expanded by download processing from each server device on the Internet 200.

The communication processing section 720 includes a LAN communication section 721, a mobile telephone network communication section 722, and an NFC communication section 723. The LAN communication unit 721 is connected to the Internet 200 via the router device 210 and performs data transmission and reception with each server device on the Internet 200. It is assumed that the connection with the router device 210 is made by a wireless connection such as Wi-Fi (registered trademark). The mobile telephone network communication unit 722 performs telephone communication (call) and data transmission/reception through wireless communication with the base station 600b of the mobile telephone communication network. The NFC communication unit 723 performs wireless communication when in close proximity to a corresponding reader/writer. It is assumed that the LAN communication section 721, the mobile telephone network communication section 722, and the NFC communication section 723 each include an encoding circuit, a decoding circuit, an antenna, and the like. Further, the communication processing unit 720 may further include other communication units such as a Bluetooth (registered trademark) communication unit and an infrared communication unit.

The expansion interface unit 724 is a group of interfaces for expanding the functions of the mobile information terminal 700, and in this embodiment, it is assumed to be composed of a video/audio interface, a USB interface, a memory interface, and the like. The video/audio interface inputs video signals/audio signals from an external video/audio output device, outputs video signals/audio signals to the external video/audio input device, and so on. The USB interface is connected to a PC or the like to send and receive data. Additionally, a keyboard or other USB devices may be connected. The memory interface connects a memory card or other memory medium to send and receive data.

The operation unit 730 is an instruction input unit for inputting operation instructions to the mobile information terminal 700, and in this embodiment, it is composed of a touch panel 730t arranged over a display unit 741 and an operation key 730k arranged with button switches. shall be taken as a thing. It may be only one of them. The portable information terminal 700 may be operated using a keyboard or the like connected to the expansion interface section 724. The portable information terminal 700 may be operated using a separate portable terminal device connected by wired communication or wireless communication. Further, the touch panel function may be provided in the display section 741.

The image processing section 740 includes a display section 741, an image signal processing section 742, a first image input section 743, and a second image input section 744. The display unit 741 is, for example, a display device such as a liquid crystal panel, and provides image data processed by the image signal processing unit 742 to the user of the mobile information terminal 700. The image signal processing section 742 includes a video RAM (not shown), and the display section 741 is driven based on image data input to the video RAM. Furthermore, the image signal processing unit 742 has a function of performing format conversion, menu and other OSD (On Screen Display) signal superimposition processing, etc., as necessary. The first image input unit 743 and the second image input unit 744 convert light input from a lens into an electrical signal using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. , a camera unit that inputs image data of surroundings and objects.

The audio processing section 750 includes an audio output section 751, an audio signal processing section 752, and an audio input section 753. The audio output unit 751 is a speaker, and provides the user of the mobile information terminal 700 with an audio signal processed by the audio signal processing unit 752. The voice input unit 753 is a microphone, and converts the user's voice into voice data and inputs the voice data.

The sensor unit 760 is a group of sensors for detecting the state of the mobile information terminal 700, and in this embodiment, it includes a GPS receiving unit 761, a gyro sensor 762, a geomagnetic sensor 763, an acceleration sensor 764, an illuminance sensor 765, and a proximity sensor 766. , consists of. These sensor groups make it possible to detect the position, inclination, direction, movement, surrounding brightness, proximity of surrounding objects, etc. of the mobile information terminal 700. Furthermore, the mobile information terminal 700 may further include other sensors such as an atmospheric pressure sensor.

The mobile information terminal 700 may be a mobile phone, a smart phone, a tablet terminal, or the like. It may be a PDA (Personal Digital Assistant) or a notebook PC. Further, it may be a digital still camera, a video camera capable of shooting moving images, a portable game machine, or other portable digital equipment.

Note that the configuration example of the mobile information terminal 700 shown in FIG. 5A includes many configurations that are not essential to this embodiment, such as a sensor section 760, but even if the configuration does not include these components, this embodiment does not impair its effectiveness. Furthermore, configurations not shown may be further added, such as a digital broadcast reception function and an electronic money payment function.

[Software configuration of mobile information terminal]
FIG. 5B is a software configuration diagram of the portable information terminal 700 of this embodiment, showing the software configuration in the ROM 703, RAM 704, and storage unit 710. In this embodiment, a basic operating program 7001 and other operating programs are stored in the ROM 703, and a cooperation control program 7002, an HTML browser program 7003, and other operating programs are stored in the storage unit 710. The storage unit 710 also includes a content storage area 7011 that stores contents such as videos, still images, and audio, an authentication information storage area 7012 that stores authentication information used in cooperation with a television receiver, and other storage areas. It is assumed that various information storage areas 7013 for storing various information are provided.

The basic operation program 7001 stored in the ROM 703 is expanded into the RAM 704, and the main control unit 701 further executes the expanded basic operation program to constitute a basic operation execution unit 7101. Further, the cooperation control program 7002 and the HTML browser program 7003 stored in the storage unit 710 are each expanded to the RAM 704, and the main control unit 701 further executes each of the expanded operation programs, so that the cooperation control execution unit 7102 and HTML browser engine 7103 is configured. Furthermore, the RAM 704 is provided with a temporary storage area that temporarily holds data created when each operating program is executed, as needed.

In the following, to simplify the explanation, the process in which the main control unit 701 controls each operation block by expanding the basic operation program 7001 stored in the ROM 703 into the RAM 704 and executing it will be referred to as basic operation execution. The description will be made assuming that the unit 7101 controls each operation block. Similar descriptions are made for other operating programs.

The cooperation control execution unit 7102 manages device authentication and connection, transmission and reception of various data, etc. when the mobile information terminal 700 performs a cooperation operation with the television receiver. The HTML browser engine 7103 is an HTML browser that executes an application created for the broadcast communication cooperation system on the mobile information terminal 700.

Each of the operating programs may be stored in advance in the ROM 703 and/or the storage unit 710 at the time of product shipment. It may be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722 after the product is shipped. Further, each of the operating programs stored in a memory card, an optical disk, or the like may be acquired via the expansion interface section 724 or the like.

[Overview of application control information (AIT)]
The application control information (AIT) of this embodiment is an application (AIT) that cooperates with a broadcast service for a television receiver, etc. (in this embodiment, the broadcast reception device 100) in the broadcast communication cooperation function supported by the broadcast reception device 100. The purpose of this information is to publicize the existence of the Broadcast Cooperation Application (hereinafter sometimes referred to as a broadcast cooperation application) and to instruct its control. The broadcast cooperation application is a broadcast managed application that (1) operates only in the broadcast reception state based on control signals such as start/stop included in the broadcast signal, and is permitted to access broadcast resources based on the control signals. (2) non-broadcasting managed applications whose operation modes such as startup/termination are not controlled by broadcast signals and whose access to broadcast resources is permitted based on means such as application authentication; It can be distinguished from other general applications to which access is not permitted.

AIT transmission methods include a method in which AIT in section format or XML (eXtensible Markup Language) format is transmitted via broadcast waves using a data carousel (DC) method, and a method in which AIT files in section format or XML format are transmitted over the Internet. Any method of distributing from a server device on 200 using HTTP (Hypertext Transfer Protocol) or https (Hypertext Transfer Protocol Secure) may be used. Other methods may also be adopted.

FIG. 6 is a data configuration diagram showing an example of the data configuration of the AIT. AIT mainly includes application type 901, application identifier 902, application control code 903, application profile 904, application acquisition source information 905, application boundary and access authority settings 906, startup priority 907, cache information 908, and server access distribution parameters 909. , etc. Furthermore, other information may be included.

The application type 901 defines the application description method. In this embodiment, it is assumed that the description method of the application is HTML. The application identifier 902 is identification information composed of an organization identification for identifying a business operator and an application identification numbered for each business operator to identify each application unit. Note that the application unit is a collection of HTML documents and their reference resources, whose entry documents are HTML documents existing at the location specified by the application acquisition location information 905. The application control code 903 specifies operation control for the target application, and describes one of (1) automatic startup, (2) operable, (3) termination, and (4) prefetch. . The application profile 904 is a value indicating the functions of the television receiver requested by the application, and indicates a combination of functions that the television receiver has as options. By referring to this value, it is determined whether the application can be used.

The application acquisition source information 905 is information that specifies the acquisition source of the application, and is location information for acquiring the HTML document that is first referred to when starting the application. Since it is assumed that an application may be transmitted via broadcasting or placed on a server device on a communication network, the location information specified in the application acquisition destination information 905 is compatible with both cases of broadcast acquisition and communication acquisition. Provisions are made. The application boundary and access restriction setting 906 is information that indicates the operable range as a broadcast managed application as a set of one or more areas (URL: Uniform Resource Locator). Furthermore, access restrictions to broadcast resources for each area are set for each function. The application boundary and access restriction settings 906 specify the range of document transitions to prevent transitions to unexpected documents or access to inappropriate broadcasting resources due to a chain of document transitions from the entry document at application startup. do. Further, it is possible to set access authority to a specific broadcasting resource in units of areas within the range of the document transition.

The activation priority 907 defines which one should be activated with priority when a data broadcast using a broadcast service and a broadcast managed application based on an HTML document exist at the same time. unconditionally specifying data broadcasting as the highest priority on the PMT, specifying the startup priority of a specific application type on the PMT, and specifying the startup priority of the target application in the startup priority 907; shall be possible. Cache information 908 is information used for cache control when holding application resources in preparation for application reuse. This information allows application resources to be cached for reuse even after the application ends. The server access distribution parameters 909 are a parameter set for distributing accesses for the purpose of reducing the load on servers where accesses are concentrated, such as at application acquisition destinations. The television receiver may operate to probabilistically delay application of the application control code according to the setting of this parameter.

Below, the operation of the broadcast receiving apparatus 100 of this embodiment will be explained.

[Operation sequence when starting the application]
First, a description will be given of a process for starting a broadcast collaboration application based on an AIT transmitted via broadcast waves in the broadcast receiving apparatus 100 of this embodiment. The broadcast receiving device 100 of this embodiment uses information on the PMT, application control code 903 of the AIT, startup priority 907, and other information to determine which one takes priority when data broadcasting by a broadcasting service and a broadcast cooperation application exist at the same time. It is possible to specify whether to start it.

FIG. 7A is an operation sequence diagram illustrating an example of the operation sequence of the broadcast cooperation application when it is specified that the broadcast cooperation application is started with priority. This figure shows a series of steps in which the broadcast receiving device 100 appropriately checks the PMT and AIT and starts a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiving device 100 performs tuning processing on the channel desired by the user and acquires the TS, the main controller 101 then acquires the PMT data string separated by the first separator 132. (S101), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S101 that the launch priority of the broadcast cooperation application is high (S102), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S103), and the acquired AIT The application control code 903 in the data string is confirmed (S104). In the process of S104, if the application control code 903 is "auto start", the application profile 904 of the acquired AIT data string is further checked (S105), and the execution of the broadcast collaboration application specified in the AIT is confirmed. If it is confirmed that it is possible, a request to send the broadcast collaboration application is sent to the predetermined service provider server 400 via the LAN communication unit 121 based on the information described in the application acquisition source information 905. (S106).

The service provider server 400 that has received the transmission request for the broadcast cooperation application performs authentication processing on the broadcast receiving device 100 as necessary under the control of the application management/distribution execution unit 4103, and then stores the data in the application storage area 4013. The stored predetermined broadcast collaboration application is distributed via the LAN communication unit 421 (S107). Note that a known method may be used for the authentication process, and detailed explanation will be omitted. Next, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast collaboration application received via the LAN communication unit 121 and distributed from the service provider server 400 based on the control of the application control unit 161. (S108).

FIG. 7B is an operation sequence diagram illustrating an example of the operation sequence of the broadcast cooperation application when it is specified that data broadcasting by the broadcasting service is started with priority. This figure shows a series of steps in which the broadcast receiving device 100 appropriately checks the PMT and AIT and starts a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiving device 100 performs tuning processing on the channel desired by the user and acquires the TS, the main controller 101 then acquires the PMT data string separated by the first separator 132. (S201), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S201 that the activation priority of data broadcasting by the broadcasting service is high (S202), the data broadcasting reception processing unit 141 acquires the BML data string separated by the first separation unit 132 and converts it into a BML document. Playback (S203). If the automatic start of data broadcasting is set by the BML document, and if the user requests the start of data broadcasting using an operation terminal (personal digital assistant 700, remote control, etc.) (S204), the data broadcasting engine 142 generates data broadcasting screen information by executing the reproduced BML document and displays it on the video display section 173 (S205).

After the process of S205 or simultaneously with the process of S205, the application control unit 161 acquires the AIT data string separated by the first separating unit 132 (S206), and checks the application profile 904 of the acquired AIT data string. (S207). In the process of S207, if it is confirmed that the broadcast cooperation application designated by the AIT is executable, an entry button for the executable broadcast cooperation application is displayed on the data broadcasting screen. The entry button may be always displayed, and the color scheme may be changed from an inactive color to an active color only when the broadcast cooperation application can be executed. The entry button may be switched between an inactive state and an active state by changing its shape.

When the user selects the entry button using the operating terminal (S208), the data broadcasting engine 142 finishes the process of executing the BML document and generating data broadcasting screen information (S209). Subsequently, the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S210), and checks the application acquisition destination information 905 of the acquired AIT data string. Further, based on the information written in the application acquisition source information 905 confirmed in S210, a request to send a broadcast cooperation application is sent to a predetermined service provider server 400 via the LAN communication unit 121 (S211).

The service provider server 400 that has received the transmission request for the broadcast cooperation application performs authentication processing on the broadcast receiving device 100 as necessary under the control of the application management/distribution execution unit 4103, and then stores the data in the application storage area 4013. The stored predetermined broadcast collaboration application is distributed via the LAN communication unit 421 (S212). Next, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast collaboration application received via the LAN communication unit 121 and distributed from the service provider server 400 based on the control of the application control unit 161. (S213).

FIG. 7C is an operation sequence diagram illustrating an example of the operation sequence of the broadcast cooperation application when no priority activation is specified. This figure shows a series of steps in which the broadcast receiving device 100 appropriately checks the PMT and AIT and starts a predetermined broadcast cooperation application.

When the tuner/demodulator 131 of the broadcast receiving device 100 performs tuning processing on the channel desired by the user and acquires the TS, the main controller 101 then acquires the PMT data string separated by the first separator 132. (S301), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S301 that the launch priority of the broadcast cooperation application is high (S302), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S303), and the acquired AIT The application control code 903 in the data string is confirmed (S304). In the process of S304, if the application control code 903 is "startable" instead of "automatic start", the display of the broadcast program is continued without starting either the data broadcast by the broadcast service or the broadcast cooperation application.

If the user uses the operation terminal to request the activation of data broadcasting after completing the process in S304 (S305), the acquisition of the BML data string and the BML Reproduction of documents, generation of data broadcasting screen information, etc. are performed (however, not shown). On the other hand, when the user uses the operating terminal to request the start-up of the broadcast cooperation application launcher after completing the process in S304 (S306), the application control unit 161 selects the AIT data separated by the first separation unit 132. A column is acquired (S307), and the application profile 904 of the acquired AIT data column is confirmed (S308). Further, the application control unit 161 displays a list of executable broadcast collaboration applications as a broadcast collaboration application launcher on the video display unit 173 (S309).

When the user uses the operation terminal to select a predetermined broadcast cooperation application from the broadcast cooperation application launcher displayed in S309 (S310), the application control unit 161 selects the AIT data string separated by the first separation unit 132. The AIT data string is acquired (S311), and the application acquisition destination information 905 of the acquired AIT data string is confirmed. Furthermore, based on the information written in the application acquisition source information 905 confirmed in S311, a request to send a broadcast collaboration application is sent to a predetermined service provider server 400 via the LAN communication unit 121 (S312).

The service provider server 400 that has received the transmission request for the broadcast cooperation application performs authentication processing on the broadcast receiving device 100 as necessary under the control of the application management/distribution execution unit 4103, and then stores the data in the application storage area 4013. The stored predetermined broadcast collaboration application is distributed via the LAN communication unit 421 (S313). Next, the application engine 162 of the broadcast receiving device 100 starts the predetermined broadcast collaboration application received via the LAN communication unit 121 and distributed from the service provider server 400 based on the control of the application control unit 161. (S314).

In addition, in the startup sequence of the broadcast cooperation application explained using FIGS. 7A to 7C, an example is explained in which AIT is obtained from broadcast waves. The AIT file may also be obtained from. Furthermore, the broadcast cooperation application may be obtained from broadcast waves instead of from the server device (service provider server 400) on the network. That is, when the location information written in the application acquisition source information 905 of the AIT indicates a broadcast wave, the application control unit 161 receives the HTML data string transmitted by the data carousel method or the like and separated and output by the first separation unit 132. The HTML document may be played back from , and the application engine 162 may execute the played back HTML document (broadcast cooperation application).

Note that if there is no information on the PMT that specifies the activation priority when data broadcasting by a broadcasting service and a broadcast cooperation application exist at the same time, the activation is performed based only on information such as the application control code 903 and activation priority 907 of the AIT. You may also check the priority. Similarly, even if acquisition of the information on the PMT fails, the activation priority may be checked only based on information such as the application control code 903 and activation priority 907 of the AIT. That is, regardless of the information on the PMT, the AIT is checked periodically, and if there is a broadcast cooperation application specified as "auto start" in the application control code 903 of the AIT, the broadcast cooperation application is If there is no broadcast cooperation application specified by "auto start" in the application control code 903 of the AIT, priority may be given to starting data broadcasting by the broadcasting service.

Additionally, if there is no response from the service provider server 400 for a predetermined period of time or more when a request for distribution of a broadcast collaboration application is made in S106, S211, or S312, a message such as "Please wait for a while" is displayed on the video display unit 173. It may also be displayed. Alternatively, in this case, a message may be displayed asking the user to cancel execution of the broadcast cooperation application.

Furthermore, it goes without saying that the starting sequence of the broadcast cooperation application is not limited to the three patterns described above, and that the starting sequence may be different.

[Operation sequence when linking mobile information terminals]
In the broadcast receiving apparatus 100 of this embodiment, it is assumed that the functions of the broadcast communication cooperation service can be expanded by cooperative operation between the broadcast receiving apparatus 100 and the mobile information terminal 700. For example, by installing an application (cooperative control application) prepared by a television receiver manufacturer, it becomes possible to use the mobile information terminal 700 as a high-performance remote control for the broadcast receiving apparatus 100. Furthermore, it is possible to execute a broadcast collaboration application on the mobile information terminal 700, and to display, for example, a service linked to the broadcast program being displayed on the broadcast receiving device 100 also on the mobile information terminal 700. Note that in order to expand functionality through cooperative operation between the broadcast receiving device 100 and the mobile information terminal 700, it is desirable that the cooperation control application is activated on the mobile information terminal 700, and It is assumed that the broadcast cooperation application that performs the broadcast operation is controlled by the cooperation control application.

FIG. 8A is an operation sequence diagram showing an example of an operation sequence when starting the cooperation control application on the mobile information terminal 700. This figure shows a series of steps (first time) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 until cooperative operation becomes possible. It is assumed that the cooperation control application is installed in the storage unit 710 of the mobile information terminal 700 in advance as a cooperation control program 7002.

When the user instructs to start the cooperative control application on the mobile information terminal 700 (S401), the cooperative control execution unit 7102 of the mobile information terminal 700 searches for a television receiver that can communicate (cooperatively operate) on the network ( S402), the search results are displayed on the display unit 741 as a list of television receivers. If a communicable television receiver cannot be found, a message to that effect is displayed and the process ends. When the user selects an arbitrary television receiver (the broadcast receiving apparatus 100 of this embodiment) from the list of television receivers, the cooperation control execution unit 7102 displays a login screen for connecting to the broadcast receiving apparatus 100 on the display unit 741. do. When the user inputs authentication information (login name and password specified by the broadcast receiving apparatus 100, etc.) on the login screen via the operation unit 730 (S403), the cooperative control execution unit 7102 inputs the input authentication information. is stored in the authentication information storage area 7012 and simultaneously transmitted to the broadcast receiving apparatus 100 (S404). Note that the process of transmitting the authentication information to the broadcast receiving apparatus 100 may be performed via the LAN communication section 721 and the router device 210, or may be performed directly to the broadcast receiving apparatus 100 via the NFC communication section 723. .

The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 checks whether the received authentication information is correct by referring to the authentication information storage area 1012. (S405). If the received authentication information is confirmed to be correct through the process of S405, the information of the mobile information terminal 700 is stored in the authentication information storage area 1012, and the mobile information terminal 700 is authenticated (S406). The mobile information terminal 700 that has been authenticated by the broadcast receiving device 100 displays a basic screen (for example, a high-performance remote control screen) of the cooperation control application on the display unit 741 (S407). In S405, if the received authentication information is not confirmed to be correct, the terminal cooperation control unit 191 of the broadcast receiving device 100 returns an error to the mobile information terminal 700. Through the above processing, the broadcast receiving device 100 and the mobile information terminal 700 become capable of cooperative operation.

FIG. 8B is an operation sequence diagram showing an example of an operation sequence when starting the cooperation control application on the mobile information terminal 700. This figure shows a series of steps (from the second time onwards) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 until cooperative operation becomes possible.

When the user instructs to start the cooperation control application on the mobile information terminal 700 (S501), the cooperation control execution unit 7102 of the mobile information terminal 700 searches for a communicable television receiver on the network, and displays the search results on the television. It is displayed on the display section 741 as a list of receivers. If a communicable television receiver cannot be found, a message to that effect is displayed and the process ends. The user selects an arbitrary television receiver (broadcast receiving apparatus 100 of the present embodiment) from the list of television receivers (S502), and if the selected broadcast receiving apparatus 100 has made a connection (cooperation operation) in the past. If it is a certain device, the cooperation control execution unit 7102 reads the authentication information of the broadcast receiving device 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving device 100 (S503).

The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 checks whether the received authentication information is correct by referring to the authentication information storage area 1012. (S504). If the received authentication information is confirmed to be correct through the process of S504, the mobile information terminal 700 is authenticated (S505). The mobile information terminal 700 that has been authenticated by the broadcast receiving device 100 displays the basic screen of the cooperation control application on the display unit 741 (S506). Through the above processing, the broadcast receiving device 100 and the mobile information terminal 700 become capable of cooperative operation.

Note that when starting a broadcast cooperation application in the broadcast receiving apparatus 100 subsequent to the processing in FIGS. 8A to 8B, the processing in FIGS. 7A to 7C may be performed after the processing in FIGS. 8A to 8B.

FIG. 8C is an operation sequence diagram showing an example of an operation sequence when starting the cooperation control application on the mobile information terminal 700. This figure shows a series of steps (from the second time onwards) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 until cooperative operation becomes possible. However, this figure shows an example in which the broadcast receiving apparatus 100 that executes the start sequence of the broadcast cooperation application requests the start-up of the cooperation control application on the mobile information terminal 700.

When the tuner/demodulator 131 of the broadcast receiving device 100 performs tuning processing on the channel desired by the user and acquires the TS, the main controller 101 then acquires the PMT data string separated by the first separator 132. (S601), the activation priority described in the PMT is confirmed. When it is confirmed in the process of S601 that the launch priority of the broadcast collaboration application is high (S602), the application control unit 161 acquires the AIT data string separated by the first separation unit 132 (S603), and the acquired AIT The application control code 903 in the data string is confirmed (S604). In the process of S604, if the application control code 903 is "auto start", the application profile 904 of the acquired AIT data string is further checked (S605). In the process of S605, if it is confirmed that the broadcast cooperation application specified by the AIT can be executed, and furthermore, it is determined that cooperation control of the mobile terminal device is necessary, the terminal cooperation control unit 191 performs authentication. By referring to the information storage area 1012, the mobile information terminal 700 is selected as the mobile terminal device, and a cooperation control application activation request is transmitted to the selected mobile information terminal 700 (S606).

Note that selection of the mobile information terminal 700 by referring to the authentication information storage area 1012 is performed based on the latest information in the authentication information storage area 1012 or based on the most frequently used information in the authentication information storage area 1012. All you have to do is make it so.

Further, in the process of S606, if the mobile terminal device to which the cooperative control application activation request should be sent cannot be found, a message indicating this fact may be displayed on the video display unit 173. Alternatively, in this case, a message may be displayed asking the user to cancel execution of the broadcast cooperation application.

The main control unit 701 of the mobile information terminal 700 starts the cooperation control application (the cooperation control execution unit 7102) in response to the cooperation control application activation request received via the LAN communication unit 721 (S607), and further performs the cooperation control. The execution unit 7102 reads the authentication information of the broadcast receiving apparatus 100 from the authentication information storage area 7012 and transmits it to the broadcast receiving apparatus 100 (S608).

The terminal cooperation control unit 191 of the broadcast receiving device 100 that has received the authentication information via the LAN communication unit 121 checks whether the received authentication information is correct by referring to the authentication information storage area 1012. (S609). If the received authentication information is confirmed to be correct through the process of S609, the mobile information terminal 700 is authenticated (S610). The mobile information terminal 700 that has been authenticated by the broadcast receiving device 100 displays the basic screen of the cooperation control application on the display unit 741 (S611). Through the above processing, the broadcast receiving device 100 and the mobile information terminal 700 become capable of cooperative operation.

Note that when the broadcast cooperation application is executed on both the broadcast receiving device 100 and the mobile information terminal 700 following the above-described processing, the processing shown in FIG. 9 may be performed. FIG. 9 is an operation sequence diagram showing an example of the startup sequence of the broadcast cooperation application of the broadcast receiving device 100 and the mobile information terminal 700.

That is, after the processing of S601 to S611 in FIG. 8C, the application control unit 161 of the broadcast receiving device 100 acquires the AIT data string separated by the first separation unit 132 (S612), and applies the application of the acquired AIT data string. Check the acquisition source information 905. Furthermore, based on the information described in the application acquisition source information 905 confirmed in S612, a request to send the broadcast cooperation application (TV side) is sent to the predetermined service provider server 400 via the LAN communication unit 121. (S613).

The service provider server 400 that has received the transmission request for the broadcast cooperation application (TV side) performs authentication processing on the broadcast receiving device 100 as necessary under the control of the application management/distribution execution unit 4103, and then transmits the application. The predetermined broadcast cooperation application (TV side) stored in the storage area 4013 is distributed via the LAN communication unit 421 (S614). The application engine 162 of the broadcast receiving device 100 executes the predetermined broadcast collaboration application (TV side) received via the LAN communication unit 121 and distributed from the service provider server 400 under the control of the application control unit 161. It is activated (S615).

Next, the terminal cooperation control unit 191 of the broadcast receiving device 100 determines the acquisition destination of the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700, obtained from the AIT or the broadcast cooperation application (TV side) executed in S615. The URL information and the like are transmitted to the mobile information terminal 700 (S616). The cooperation control execution unit 7102 of the mobile information terminal 700 executes a predetermined service project via the LAN communication unit 721 based on the acquisition destination URL information of the broadcast cooperation application (terminal side) received via the LAN communication unit 721. A transmission request for the broadcast cooperation application (terminal side) is transmitted to the user server 400 (S617).

The service provider server 400, which has received the transmission request for the broadcast cooperation application (terminal side), performs authentication processing for the mobile information terminal 700 as necessary under the control of the application management/distribution execution unit 4103, and then transmits the application. The predetermined broadcast cooperation application (terminal side) stored in the storage area 4013 is distributed via the LAN communication unit 421 (S618). The HTML browser engine 7103 of the mobile information terminal 700 starts the predetermined broadcast cooperation application (terminal side) received via the LAN communication unit 721 and distributed from the service provider server 400 (S619).

Note that the AIT file can be obtained from a predetermined server device, the broadcast cooperation application can be obtained from broadcast waves rather than from a server device on the network, etc., which are the same as the operation sequences shown in FIGS. 7A to 7C. be. Note that when acquiring a broadcast cooperation application from a broadcast wave, the broadcast reception device 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave, and ) may be transferred to the mobile information terminal 700 via the communication unit 121. Alternatively, the broadcast receiving device 100 acquires the broadcast cooperation application (terminal side) to be executed on the mobile information terminal 700 from the broadcast wave, stores it in the storage unit 110, and transmits it to the mobile information terminal 700 in the process of S616 in FIG. Location information of the storage unit 110 of the broadcast receiving device 100 may be transmitted as the URL information. The broadcast receiving device 100 may obtain the broadcast cooperation application (on the television side) from a broadcast wave, and the mobile information terminal 700 may obtain the broadcast cooperation application (on the terminal side) from a server device on the network. The digital broadcast reception function of the mobile information terminal 700 may be used to obtain the broadcast cooperation application (terminal side) directly from the broadcast waves.

Furthermore, each of the operation sequences shown in FIGS. 7A to 7C, FIGS. 8A to 8C, and FIG. , simultaneous operation, etc. are possible.

[Mobile information terminal cooperative control application basic screen]
FIG. 10A is a screen display diagram showing an example of the basic screen of the cooperative control application displayed by the process of S407 of FIG. 8A, the process of S506 of FIG. 8B, the process of S611 of FIG. 8C, and the like. In this embodiment, it is assumed that the basic screen 741a of the cooperative control application has a function as a high-performance remote control compatible with the broadcast receiving device 100.

As shown in FIG. 10A, the basic screen 741a of the cooperative control application includes a power key 741a1, a network selection key (terrestrial digital, BS, CS) 741a2, numeric keys (1 to 12) 741a3, a volume UP/DOWN key 741a4, Channel UP/DOWN key 741a5, input switching key 741a6, program guide key 741a7, data key 741a8, linked application key 741a9, menu key 741aa, back key 741ab, cursor key (up, down, left, right) 741ac, enter key 741ad , color keys (blue, red, green, yellow) 741ae. Other operation keys may also be displayed.

It is convenient to use each of the operation keys if the key arrangement/operation is similar to that of the dedicated remote control attached to the broadcast receiving apparatus 100. Further, the power key 741a1, network selection key 741a2, numeric key 741a3, etc. have the same functions as the operation keys of a known television remote controller, and detailed description thereof will be omitted. The cooperation application key 741a9 is an operation key prepared for the broadcast cooperation communication function of this embodiment.

In addition, in the processing of S204 in FIG. 7B and S305 in FIG. 7C, it is assumed that data broadcasting can be started/ended by selecting the data key 741a8. Furthermore, in the processing of S208 in FIG. 7B and S310 in FIG. 7C, it is assumed that the executable broadcast cooperation application can be selected by operating the cursor key 741ac and the enter key 741ad. In addition, in the process of S306 in FIG. 7C, it is assumed that a start request for the broadcast cooperation application launcher can be made by selecting the cooperation application key 741a9.

If the cooperation application key 741a9 or other operation keys with similar functions are prepared on the basic screen 741a of the cooperation control application, each broadcast cooperation application used in the broadcast cooperation system of this embodiment can be easily selected/selected. It becomes possible to start. Further, the dedicated remote control attached to the broadcast receiving device 100 may be provided with the cooperative application key 741a9 or other operation keys having a similar function.

FIG. 10B is a screen display diagram showing an example of the basic screen of the cooperation control application displayed by the process of S407 of FIG. 8A, the process of S506 of FIG. 8B, the process of S611 of FIG. 8C, etc. This is a different example.

The basic screen 741b of the cooperative control application includes a cooperative control message 741b1 and a cooperative control application operation screen 741b2. Other objects may also be displayed. The cooperative control message 741b1 is a message display for making the user aware that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. The cooperation control application operation screen 741b2 is an area where any screen display is performed by the cooperation control application, and detailed explanation will be omitted in this embodiment. For example, the configuration within the cooperative control application operation screen 741b2 may be the same as the basic screen 741a of the previously described cooperative control application. A sub-screen or the like of the broadcast program being displayed on the broadcast receiving device 100 may be displayed.

As shown in FIG. 10B, by displaying the cooperative control message 741b1, the user of the mobile information terminal 700 can easily understand that the mobile information terminal 700 is operating in cooperation with the broadcast receiving device 100. It becomes like this. Note that the cooperative control message 741b1 is not limited to a text display, and may be a symbol display, a graphic display, or the like. It may be used as a substitute for the cooperative control message 741b1 due to the difference in background color, etc.

[Data broadcast screen of broadcast receiving device]
FIG. 11 is a screen display diagram showing an example of the data broadcasting screen displayed by the process of S205 in FIG. 7B. In this embodiment, it is assumed that three broadcast cooperation applications, cooperation application A, cooperation application B, and cooperation application C, are executable on the broadcast receiving apparatus 100 according to the description of the AIT. In this case, an entry button 173a2 for cooperative application A, an entry button 173a3 for cooperative application B, and an entry button 173a4 for cooperative application C are displayed at any position on the data broadcasting screen 173a.

On the data broadcast screen 173a shown in FIG. 11, if you select the entry button 173a2, entry button 173a3, entry button 173a4, etc. using the cursor key 741ac and enter key 741ad on the basic screen 741a of the cooperation control application, the data broadcast When the display of the screen 173a ends, the cooperative application A, the cooperative application B, the cooperative application C, etc. are activated under the control of the application control unit 161 and the application engine 162.

Note that when displaying the data broadcasting screen 173a, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on the type of broadcasting cooperation application, security status, etc. You can also do it. For example, if the linked application A is a broadcast managed application, the frame color of the entry button 173a2 is set to blue, and if the linked application B is a non-broadcast managed application, the frame color of the entry button 173a3 is set to yellow, and the For example, if the cooperative application C is a general application, the frame color of the entry button 173a4 is set to red. Alternatively, if the cooperative application A is determined to be reliable from a security standpoint, the frame color of the entry button 173a2 may be set to blue, and if it is determined that the cooperative application B is not necessarily reliable from a security standpoint, the entry button 173a2 may be set to blue. For example, the frame color of the entry button 173a3 is made yellow, and if the cooperative application C is determined to be dangerous in terms of security, the frame color of the entry button 173a4 is made red.

In addition, the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may vary depending on the function or genre of the broadcast cooperation application, or the expiration date of each broadcast cooperation application. may be changed as appropriate. The frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate depending on whether the broadcast cooperation application has been obtained from the network or not. . For example, if the cooperation application A has already been acquired from the network (cached in the RAM 104 or storage 110), the frame color of the entry button 173a2 is set to blue, and if the cooperation application B is being acquired, the entry button 173a2 is set to blue. For example, the frame color of the button 173a3 is made yellow, and if the cooperative application C has not been acquired, the frame color of the entry button 173a4 is made red.

In this way, the user of the broadcast receiving device 100 can easily understand the types of broadcast cooperation applications that can be executed by the broadcast receiving device 100, the security status, etc.

[Broadcasting cooperation application launcher screen of broadcasting receiving device]
FIG. 12A is a screen display diagram showing an example of a notification screen for making the user aware that there is a broadcast cooperation application that can be started in the broadcast receiving apparatus 100 of this embodiment.

For example, in the operation sequence shown in FIG. 7C, after the processing in S304, the display of the broadcast program is continued without starting either the data broadcast by the broadcast service or the broadcast collaboration application. On the other hand, in this case, if an icon 173b0 as shown in FIG. 12A is displayed to make the user aware that there is a broadcast cooperation application that can be started, the usability of the broadcast receiving apparatus 100 will be improved. That is, by displaying the icon 173b0, it is possible to prevent the user from overlooking the existence of the broadcast cooperation application that can be activated.

Note that the icon 173b0 may be displayed at any position on the screen, but it is preferable that the icon 173b0 be displayed at a position that does not interfere with viewing the broadcast program. For example, the four corners of the screen. Moreover, the icon 173b0 may be a character display as shown in FIG. 12A, or may be a symbol, a figure, or the like. Further, the icon 173b0 may be displayed all the time, or may be displayed only for a predetermined time after the power is turned on or after channel switching. Alternatively, it may be displayed simultaneously when program information, channel numbers, etc. are displayed.

FIG. 12B is a screen display diagram showing an example of the broadcast cooperation application launcher displayed by the process of S306 in FIG. 7C. In this embodiment, it is assumed that three broadcast cooperation applications, cooperation application A, cooperation application B, and cooperation application C, are executable on the broadcast receiving apparatus 100 according to the description of the AIT. In this case, a broadcast cooperation application launcher 173b1 is displayed at an arbitrary position on the broadcast program screen 173b, and furthermore, within the broadcast cooperation application launcher 173b1, an entry button 173b2 for cooperation application A, an entry button 173b3 for cooperation application B, and an entry button 173b3 for cooperation application C are displayed. An entry button 173b4 and a return button 173b5 are displayed.

While the broadcast cooperation application launcher 173b1 as shown in FIG. 12B is displayed, use the cursor key 741ac and enter key 741ad on the basic screen 741a of the cooperation control application to select entry button 173b2, entry button 173b3, entry button 173b4, etc., cooperative application A, cooperative application B, cooperative application C, etc. are started under the control of the application control unit 161 and the application engine 162. When the return button 173b5 is selected, the display of the broadcast cooperation application launcher 173b1 ends.

Note that when displaying the broadcast cooperation application launcher 173b1 on the broadcast program screen 173b, depending on the type and security status of the broadcast cooperation application, the function and genre of the broadcast cooperation application, the acquisition status of the broadcast application from the network, etc. , the frame color, internal color, shape, font, size, blinking status, etc. of each entry button may be changed as appropriate. This is the same as when displaying .

Furthermore, if there is no broadcast cooperation application that can be executed by the broadcast receiving apparatus 100, the broadcast cooperation application launcher 173b1 may not be displayed. Alternatively, in this case, a message such as ``There are no usable applications'' may be displayed inside the broadcast cooperation application launcher 173b1.

[Broadcast cooperation application execution screen of broadcast receiving device]
FIG. 13A is a screen display diagram showing an example of a broadcast cooperation application execution screen displayed in the process of S108 of FIG. 7A, the process of S213 of FIG. 7B, the process of S314 of FIG. 7C, the process of S615 of FIG. 9, etc. be. It is assumed that the broadcast cooperation application of this embodiment has graphics performance, effect performance, etc. written in HTML, and can be displayed as an overlay with the broadcast program screen on the video display section 173. For example, as shown in FIG. 13A, a broadcast collaboration application section 173c1 that displays information such as weather forecasts and news is displayed as an overlay at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application section 173c1 includes a first main object 173c2, a second main object 173c3, a third main object 173c4, a background object 173c5, and the like. Other objects may also be displayed.

By selecting the data key 741a8 on the basic screen 741a of the cooperation control application while the broadcast cooperation application section 173c1 is displayed as an overlay on the broadcast program screen 173c, the execution of the broadcast cooperation application is ended and the data broadcasting screen is displayed. It shall be possible to migrate to Furthermore, by selecting the cooperation application key 741a9 on the basic screen 741a of the cooperation control application, it is possible to end the execution of the broadcast cooperation application and return to displaying only the broadcast program screen 173c. The processing may be realized using different operation keys.

In addition, the transparency of the broadcast cooperation application section 173c1 can be changed by operating each operation key on the basic screen 741a of the cooperation control application while the broadcast cooperation application section 173c1 is displayed as an overlay on the broadcast program screen 173c. It shall be possible to do so. The transparency change process may be performed for the entire broadcast cooperation application section 173c1 at once, or for each of the first main object 173c2, second main object 173c3, third main object 173c4, and background object 173c5. It may be performed alone. It may be performed for each predetermined group (for example, a plurality of objects existing in the same graphics layer).

When performing the transparency change process, for example, select an object using the cursor key 741ac on the basic screen 741a of the cooperation control application, increase the transparency of the object using the "blue" key of the color keys 741ae, Use the "yellow" key to decrease the transparency of objects. The transparency change process may be performed using different operation keys. If the entire broadcast cooperation application section 173c1 is set to have a transparency of 100%, the broadcast cooperation application section 173c1 can be temporarily hidden. For example, when an emergency broadcast is distributed via broadcast waves, it is also possible to set the transparency of the entire broadcast cooperation application section to 100% and display only the broadcast program screen of the emergency broadcast on the video display section 173. Alternatively, a CM detection unit (not shown) detects that the broadcast program has changed from the main video to a CM video, and collectively sets the entire broadcast cooperation application unit 173c1 to 100% transparency (or makes the video of the broadcast program clear). It may also be controlled so that the transparency can be checked.

By performing the above processing, if you want to check the broadcast program screen in the background while the broadcast cooperation application is running, you can check the broadcast program screen without terminating the broadcast cooperation application. Become.

FIG. 13B shows a different example from the above of the broadcast cooperation application execution screen displayed in the process of S108 in FIG. 7A, the process in S213 in FIG. 7B, the process in S314 in FIG. 7C, the process in S615 in FIG. 9, etc. FIG. In the example shown in FIG. 13B, a broadcast collaboration application section 173c6 that introduces recommended programs is displayed as an overlay at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application section 173c6 displays first recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, and the like. More recommended program information may be displayed by scrolling, page switching, or the like.

Each of the recommended program information may be information on a program recommended in relation to the broadcast program being displayed (broadcast program screen 173c), or may be information on a program recommended based on the user's viewing history. The information may also be information about a program that is a hot topic on the Internet or the like. The information may be information about a recommended program sent to the user by a friend of the user of the broadcast receiving device 100. Further, the recommended program may be a program transmitted via broadcast waves of a digital broadcasting service, or may be a VOD (Video On Demand) program distributed from each server device on the Internet 200. good. It may also be an information screen such as a home page prepared on a server device on the Internet 200.

With the broadcast cooperation application section 173c6 overlay displayed on the broadcast program screen 173c, use the cursor key 741ac and enter key 741ad on the basic screen 741a of the cooperation control application to select the first recommended program information 173c7 and the second recommended program information. By selecting information 173c8, third recommended program information 173c9, etc., each program video recommended by first recommended program information 173c7, second recommended program information 173c8, third recommended program information 173c9, etc. is displayed on display section 173. will be displayed.

FIG. 13C is a screen display diagram showing an example of a case where a program video recommended by the broadcast cooperation application section 173c6 that introduces the recommended program is displayed. For example, when the first recommended program information 173c7 of the broadcast cooperation application section 173c6 is selected using the cursor key 741ac and enter key 741ad of the basic screen 741a of the cooperation control application, the first recommended program information 173c7 is displayed on the display section 173. A program video 173ca of the program to be displayed is displayed. The program video 173ca may be able to be paused, jumped to a specified time, etc. by the user's operation on the operating terminal. Further, when displaying the program video 173ca, the original broadcast program screen 173c may be displayed at an arbitrary position in PIP (Picture In Picture) format. In this case, it may be possible to change which of the program video 173ca of the recommended program and the original broadcast program screen 173c is to be used as the main screen by the user's operation on the operating terminal. The size of the window on the original broadcast program screen 173c may be adjusted by the user's operation on the operating terminal.

Further, an icon display 173cb indicating that the program video 173ca of the recommended program is a video displayed by selecting one of the recommended program information displayed on the broadcast cooperation application section 173c6 is displayed at an arbitrary position on the screen. If the information is displayed on the screen, user convenience can be improved. Needless to say, the transparency of the broadcast cooperation application section 173c6 may also be changed on the broadcast cooperation application execution screen shown in FIG. 13B in the same manner as described above.

FIG. 13D shows a different example from the above of the broadcast cooperation application execution screen displayed in the process of S108 in FIG. 7A, the process in S213 in FIG. 7B, the process in S314 in FIG. 7C, the process in S615 in FIG. 9, etc. FIG. In the example shown in FIG. 13D, a broadcast cooperation application section 173cc serving as a portal for an SNS (Social Networking Service) service is displayed as an overlay at an arbitrary position on the broadcast program screen 173c. The broadcast cooperation application section 173cc displays a first SNS service entry button 173cd, a second SNS service entry button 173ce, a third SNS service entry button 173cf, and the like. Entry buttons for even more SNS services may be displayed by scrolling, page switching, etc.

With the broadcast cooperation application section 173cc overlay displayed on the broadcast program screen 173c, use the cursor key 741ac and enter key 741ad of the basic screen 741a of the cooperation control application to press the entry button 173cd of the first SNS service and the second SNS service entry button 173c. By selecting the entry button 173ce for the SNS service, the entry button 173cf for the third SNS service, etc., the functions assigned to each entry button, such as the chat function, bulletin board function, and Internet telephone function, are enabled. This makes it possible to enjoy the broadcast program being displayed (broadcast program screen 173c) while exchanging information with others. Furthermore, at the same time, the basic screen 741a of the cooperation control application on the mobile information terminal 700 may be changed to a character input screen such as a software keyboard or a voice input screen for chatting or posting on a bulletin board by voice input. good.

In addition to the above-mentioned example, the broadcast cooperation application that can be executed by the broadcast reception apparatus 100 of this embodiment includes synchronization with the broadcast timing of commercials using the cooperation function between the broadcast reception apparatus 100 and the mobile information terminal 700. Then, a related CM application may be presented to both the broadcast receiving device 100 and the mobile information terminal 700. Alternatively, in a paid service that can be used by the broadcast receiving device 100, the broadcast cooperation application checks whether the user of the broadcast receiving device 100 has subscribed to the paid service, and depending on the result, the broadcast receiving device 100 and/or the mobile information terminal 700 It may be something like changing the display of. In the broadcast receiving apparatus 100 of this embodiment, the effects described using FIGS. 13A, 13B, etc. can be enjoyed no matter which broadcast cooperation application is executed.

[Broadcast receiving device error display screen]
FIG. 14 shows broadcast cooperation by checking the application profile 904 of the acquired AIT data string in the process of S105 in FIG. 7A, the process in S207 in FIG. 7B, the process in S308 in FIG. 7C, the process in S605 in FIG. 8C, etc. FIG. 7 is a screen display diagram showing an example of an error display screen when it is determined that the application cannot be executed, when the AIT description is insufficient, or when AIT acquisition fails, etc.

In the broadcast receiving device 100 of the present embodiment, when it is determined that the broadcast cooperation application cannot be executed, the reason why the broadcast cooperation application cannot be executed, such as the confirmation result of the application profile 904, is determined. The error message 173d1 is displayed. For example, if the result of checking the application profile 904 is that a predetermined optional function is missing on the television receiver side, this fact is displayed in the error message 173d1. The error code and a guide (URL, etc.) of the television receiver manufacturer's home page containing an explanation of the error code may be displayed. Alternatively, when acquiring a broadcast cooperation application from a network, the network connection status is of course checked in advance, but at this time, for example, if the acquisition of the broadcast cooperation application is not possible due to a faulty LAN cable connection, etc. If it is not possible, an error message 173d1 is displayed to that effect. Furthermore, the error message 173d1 may be displayed even if the network connection has been established, but the broadcast cooperation application cannot be acquired correctly due to poor error conditions. An error message 173d1 may be displayed when the broadcast cooperation application is being acquired and the broadcast cooperation application is not yet in a state where it can be executed. In addition, error message 173d1 is also displayed when the reception status of broadcast waves is unstable and it becomes impossible to receive information such as AIT, etc. even though it was initially possible to receive information such as AIT. good. Note that in such a case, if the broadcast collaboration application acquired from each server device is cached as it is, it can be used as is after the broadcast wave reception status recovers.

Additionally, if the result of checking the application profile 904 is that the TV receiver lacks a predetermined optional function, an error message 173d1 is displayed to recommend checking or updating the latest TV receiver firmware. You can do it like this. Alternatively, the broadcast receiving apparatus 100 may automatically check or update the latest firmware. Alternatively, if the broadcast cooperation application can be made executable by adding paid optional hardware or software to the television receiver, a guide to the paid optional hardware or software may be displayed. good. Note that the error message 173d1 may be displayed on the mobile information terminal 700 instead of on the broadcast receiving device 100.

[Broadcast cooperation application execution screen on mobile information terminal]
FIG. 15 is a screen display diagram showing an example of the broadcast collaboration application (terminal side) execution screen displayed in the process of S619 in FIG. The broadcast cooperation application execution screen 741c shown in FIG. 15 includes a main window 741c1, a subwindow 741c2, a selection marker 741c3, cursor keys 741c4 and 741c5, an explanation display section 741c6, and an end button 741c7. Other objects may also be added.

In this embodiment, it is assumed that the broadcast cooperation application (terminal side) executed on the mobile information terminal 700 is an application for checking details of the broadcast program being displayed on the broadcast receiving device 100. Further, the main window 741c1 displays the same video as the broadcast program screen displayed on the broadcast receiving device 100, and the subwindow 741c2 displays an enlarged video at the position specified by the selection marker 741c3. It is assumed that the position of the selection marker 741c3 can be changed by selecting the cursor keys 741c4 and 741c5. It is assumed that the commentary display section 714c6 displays commentary subtitles regarding the broadcast program being displayed on the main window 741c1, comments posted by other users regarding the broadcast program, and the like. The end button 741c7 is a button for ending the operation of the broadcast cooperation application (terminal side).

By operating the broadcast cooperation application (terminal side) on the mobile information terminal 700, it becomes possible to expand the functionality of the broadcast communication cooperation service through the cooperation between the broadcast receiving device 100 and the mobile information terminal 700.

[EPG screen of broadcast receiving device]
FIG. 16A is a screen display diagram showing an example of an electronic program guide (EPG) display screen in the broadcast receiving apparatus 100 of this embodiment. The EPG display screen 173e is a distribution schedule of broadcast programs in the digital broadcast service of this embodiment, which is created by the main control unit 101 based on the program information data string output from the first separation unit 132. It is assumed that the EPG display screen 173e is displayed on the video display section 173 by selecting the program guide key 741a7 on the basic screen 741a of the cooperation control application.

In this embodiment, the EPG display screen 173e has a matrix shape in which the vertical axis represents time and the horizontal axis represents service ID (channel), and displays detailed information of each broadcast program broadcast on each channel in each time period. indicate. The detailed information 173e1 of each broadcast program is mainly composed of a title area 173e2 and a detailed explanation area 173e3, as shown in FIG. 16A.

The title area 173e2 displays the program title of each broadcast program and symbols representing attributes of each broadcast program. The symbols representing the attributes of each broadcast program include, for example, a mark symbolizing "New" meaning a new program, a symbol symbolizing "Replay" meaning a rebroadcast program, etc. Alternatively, it may be a mark symbolizing "data", which means that the service is compatible with data broadcasting by a broadcasting service. Furthermore, if the broadcast program has a broadcast cooperation application that can be executed by the broadcast receiving apparatus 100 of the present embodiment, a mark or the like symbolizing "Linkage" may be used to indicate this. The detailed explanation area 173e3 displays related information such as the program contents and performers of each broadcast program, the URL of a homepage introducing each broadcast program, and the like.

Note that even if a broadcast cooperation application is prepared for the broadcast program, the symbol of "Linkage" displayed in the title area 173e2 is displayed on the information display device as a result of checking the application profile 904. If execution at 100 is not possible, it may not be displayed. Furthermore, the symbol "Linkage" displayed in the title area 173e2, which indicates that the program is a broadcast program for which the executable broadcast cooperation application is prepared, further indicates that the linkage with a mobile terminal device is possible. The color, shape, font, etc. may be changed depending on whether or not it is. If a cooperative operation with a mobile terminal device is possible, a symbol symbolizing "Mobile" may be displayed together with a symbol symbolizing "Linkage".

The presence or absence of the symbol symbolizing "Linkage" and the symbol symbolizing "Mobile" is determined by the fact that each broadcast program is the original Whether or not the broadcast program is prepared with a broadcast collaboration application that can be executed by the broadcast receiving device 100 of the embodiment, and whether or not the executable broadcast collaboration application can operate in conjunction with a mobile terminal device. The control may be performed by acquiring information such as the following information. Alternatively, the information obtained from program distribution information of digital broadcast programs prepared in a predetermined server device on the Internet 200 may be added to an electronic program guide created based on a program information data string obtained from broadcast waves of a digital broadcast service. It may be added.

As mentioned above, on the EPG display screen 173e, there is a mark symbolizing "Linkage" indicating that the broadcast program has an executable broadcast cooperation application prepared, and that it is possible to operate in cooperation with a mobile terminal device. By displaying a mark symbolizing "Mobile" indicating "Mobile", the user can easily grasp the compatibility status of each broadcast program in the broadcast receiving apparatus 100 with the broadcast communication cooperation service. Needless to say, the mark symbolizing the predetermined characters representing the attributes of each broadcast program may be replaced with the characters themselves, sentences, or the like. By changing the background color of the detailed information 173e1 of each broadcast program, the compatibility status of each broadcast program with the broadcast communication cooperation service may be indicated. In addition, the symbol symbolizing "Linkage" and the symbol symbolizing "Mobile" are not normally displayed in the title area 173e2, but pop up only when each broadcast program is selected by the program selection cursor 173e4. It may be displayed.

The broadcast receiving apparatus 100 of this embodiment has a function of making viewing reservations and/or recording reservations for each broadcast program from the EPG display screen 173e. For example, while the EPG display screen 173e is displayed, use the cursor keys 741ac on the basic screen 741a of the cooperative control application to move the program selection cursor 173e4 on the EPG display screen 173e, and select any broadcast program using the enter key 741ad. By selecting , viewing and/or recording reservations are made for the selected broadcast program.

In the above-mentioned process, if the broadcast program for which the viewing reservation and/or recording reservation has been made is a broadcast program compatible with a broadcast communication cooperation service, the said viewing reservation and/or recording reservation is used as a trigger to perform the broadcast program. The acquisition of the broadcast cooperation application prepared for the broadcast program may be started without waiting for the broadcast start time of the program. That is, information (location information such as URL) specifying the acquisition destination of the broadcast cooperation application is written in the EIT information including detailed information of each broadcast program. In this way, the broadcast receiving device 100 can grasp the information on the acquisition source of the broadcast cooperation application prepared for each broadcast program at the time when the broadcast program is selected with the program selection cursor 173e4. Become. Therefore, the broadcast receiving device 100 can start acquiring the broadcast collaboration application before the broadcast start time of the broadcast program.

In addition, if the broadcast program for which the viewing reservation and/or recording reservation has been made is a broadcast program that supports broadcasting and communication cooperation services and is a broadcast program that can be operated in conjunction with a mobile terminal device, The broadcast coordination application (terminal side) prepared for the broadcast program may also start acquiring the program before the broadcast start time of the broadcast program, using the same process as described above. In addition, as shown in FIG. 16B, a two-dimensional barcode 173e5 or the like indicating the acquisition location information (location information such as URL) of the broadcast cooperation application (terminal side) prepared for the mobile terminal device is displayed on the EPG display screen 173e. may be displayed to prompt the user to download a broadcast cooperation application (terminal side) prepared for the mobile terminal device.

In this way, if the broadcast receiving device 100 refers to the acquisition destination information of the broadcast cooperation application included in the EPG information and starts the acquisition of the broadcast cooperation application before the broadcast start time of the broadcast program. , it becomes possible to distribute the load on the service provider server 400 that stores the broadcast cooperation application. Further, even if the communication speed of the network between the service provider server 400 and the information display terminal 100 is insufficient, the broadcast collaboration application can be effectively used immediately after the start of the broadcast of the broadcast program. become.

FIG. 17 is an operation sequence diagram illustrating an example of the acquisition sequence of the broadcast collaboration application when viewing and/or recording of a broadcast program is reserved from the EPG display screen 173e.

While viewing a digital broadcast service, the main control unit 101 of the broadcast receiving device 100 acquires the program information data string output from the first separation unit 132 (S701). When the user uses the operating terminal to request activation of the EPG screen (S702), the EPG display screen 173e is displayed on the video display section 173 (S703). When the user selects an arbitrary broadcast program on the EPG display screen 173e using the operation terminal and makes a viewing reservation and/or a recording reservation for the broadcast program (S704), the main control unit 101 controls the first separation. The program information data string acquired from the section 132 is confirmed (S705), and the location where the broadcast cooperation application linked to the broadcast program for which the viewing reservation and/or recording reservation has been made is acquired (S706).

After the processing in S706, the application control unit 161 transmits a request to transmit the broadcast collaboration application to the predetermined service provider server 400 via the LAN communication unit 121 based on the confirmed URL (S707). The service provider server 400 that has received the transmission request for the broadcast cooperation application performs authentication processing on the broadcast receiving device 100 as necessary under the control of the application management/distribution execution unit 4103, and then stores the data in the application storage area 4013. The stored predetermined broadcast collaboration application is distributed via the LAN communication unit 421 (S708). Subsequently, the application control unit 161 causes the predetermined broadcast cooperation application received via the LAN communication unit 121 and distributed from the service provider server 400 to be cached in the RAM 104 or the storage 110 (S709).

According to the transmitting/receiving device 100 of the present embodiment described above, it is possible to perform functions with higher added value.

Example 2 of the present invention will be described below. Note that the configuration, effects, etc. of this example are the same as those of Example 1 unless otherwise specified. Therefore, in the following, the differences between this embodiment and the first embodiment will be mainly explained, and the explanation of the common points will be omitted as much as possible to avoid duplication.

In the first embodiment, an embodiment in which mobile information terminal cooperation processing (hereinafter referred to as terminal cooperation) is performed has been described, but a more detailed embodiment will be described.

When performing mobile information terminal cooperation, there are cases where it is desired to restrict the use of terminal cooperation only to mobile information terminals 700 located in the same premises as broadcast receiving apparatus 100 (hereinafter, this restriction will be referred to as the same premises restriction). For example, in an application for using broadcast cooperation (hereinafter referred to as a broadcast cooperation application), the display screen of broadcast reception device 100 and the display screen of mobile information terminal 700 may be closely related, or This is the case, for example, when it is desired that the user of the mobile information terminal 700 views the displayed advertisement video.

The point that must be considered in the process is determining whether the broadcast-linked application in question imposes same-household restrictions. This judgment is not necessary if it is assumed that all broadcast cooperation applications are restricted to the same home; however, if there is no restriction, the broadcast receiving device 100 transmits control information regarding the presence or absence of the same home restriction. acquired and the operating procedures need to be changed. Control information regarding the presence or absence of this restriction may be obtained from the broadcast signal (for example, written as an item of AIT) or may be obtained from a server specified by the broadcast station.

In this embodiment, including the above procedure, a procedure for ensuring that the mobile information terminal 700 and the broadcast receiving apparatus 100 are present in the same house will be described.

Usually, devices existing in the same house exist on a local network connected to the same router device 210. Therefore, since the mobile information terminal 700 is connected to the same local network as the broadcast receiving apparatus 100, it can be determined that the mobile information terminal 700 and the broadcast receiving apparatus 100 are present in the same house. Note that a known method may be used to determine whether the target device is connected to the local network, and the description thereof will be omitted.

Furthermore, even if the mobile information terminal 700 is not on the local network, it can be determined that it exists in the same house by directly communicating with the broadcast receiving apparatus 100 using NFC, BlueTooth, infrared communication, or the like. In this case, the communication for acquiring the broadcast cooperation application etc. may be the above-mentioned direct communication or may be based on mobile phone communication.

As mentioned above, there can be multiple methods of confirming that the device exists in the same house, but which method to use is written in the AIT, for example, and the broadcast receiving device 100 reads it.

Furthermore, once it is confirmed that the mobile information terminal 700 exists in the same home, it may be assumed that the mobile information terminal 700 exists in the same home until the end of the program, or a certain valid time (for example, 10 minutes) can be set, and It is also possible to use a method in which the device is assumed to exist in the same residence, but if the validity period has passed, it is not considered to exist in the same residence unless it is confirmed again. This valid time is written in the AIT, for example, and read by the broadcast receiving device 100.

Further, for example, an event signal may be set in the broadcast signal at any point during the program, and each time this event signal is received, it is confirmed that the mobile information terminal 700 is present in the same residence. You can also do it.

Furthermore, it is also possible to use a combination of the first two methods.

Next, a specific procedure for permitting terminal cooperation only to the mobile information terminals 700 existing in the same house will be explained. In this embodiment, restrictions are set when the mobile information terminal 700 acquires a broadcast cooperation application or information used in the broadcast cooperation application (hereinafter, the information used in the broadcast cooperation application and the information used in the broadcast cooperation application, specific In particular, this includes HTML documents and streaming video, but these are collectively referred to as broadcast cooperation information). There are two types of methods for acquiring broadcast cooperation information: communication acquisition, which is acquired from the broadcast station server 300 or operator server 400, and broadcast acquisition, which is acquired from broadcast waves. In the case of communication acquisition, there are two methods: acquisition after the start of broadcast reception and method of acquisition before the start of broadcast reception. Furthermore, in the case of communication acquisition, there are cases where the broadcast receiving device 100 first obtains the information and then the mobile information terminal 700 obtains it from the broadcast receiving device 100, and cases where the mobile information terminal 700 directly obtains the information from the broadcast station server 300 or the operator server 400. There is. There are various methods, but from the perspective of the mobile information terminal 700, they can be roughly divided into two: acquisition from the broadcast receiving device 100 and acquisition from the broadcast station server 300 or the operator server 400.

In this embodiment, a case will be described in which the mobile information terminal 700 acquires broadcast cooperation information from the broadcast receiving apparatus 100, and a case in which it is acquired from a server will be explained in the next embodiment.

FIG. 18A shows the procedure of this example.

First, before performing terminal cooperation, a cooperation control application that is an application that controls terminal cooperation is activated on each of the mobile information terminal 700 and the broadcast receiving apparatus 100 (S10001, S10002). In this state, the mobile information terminal 700 issues a terminal cooperation request to the broadcast receiving apparatus 100 (S10003). Next, AIT is acquired from the broadcast signal (S10004). Based on this AIT information, it is determined whether the application for the target mobile information terminal has the same-household restriction (S10006), and if there is a restriction, the process proceeds to step S10008, and the first stage where the terminal cooperation request is made. The process then proceeds to step S10009, and it is determined whether the mobile information terminal 700 that has requested terminal cooperation is in the same house as the broadcast receiver 100 (S10009). As a result of the determination, if it is determined that the devices are not in the same house, a response is sent to the cooperation control application on the mobile information terminal side indicating that cooperation is not permitted, and the process ends (S10011).

Here, in the first place, if it is assumed that all terminal cooperation applications have the same home restriction, the determination in S10006 is not performed and is skipped. If it is possible that there are both apps with and without in-house restrictions, the determination in S10006 is made.

If it is determined that the mobile information terminal 700 is located in the same home, or if the application does not have the same home restriction, the process advances to S10012 and a broadcast cooperation application related service is performed. This service (S10012) processes a broadcast cooperation information distribution request (S10013) from the mobile information terminal 700, and distributes the broadcast cooperation information to the mobile information terminal 700 (S10018). This broadcast cooperation information includes information received by the broadcast receiving device 100 from the distribution server (S10014, S10015, S10016), information acquired from the broadcast signal (S10017), information stored in the broadcast receiving device 100, etc. be. The broadcasting cooperation information is received by the broadcasting receiving apparatus 100 (S10016, S10017) not only in response to a broadcasting cooperation information distribution request (S10013) from the mobile information terminal 700, but also by the broadcasting receiving apparatus 100 autonomously acquiring the information, The acquisition may be based on the occurrence of an event from a broadcast signal. The distribution of the broadcast collaboration information to the mobile information terminal 700 (S10018) may also be done spontaneously from the broadcast receiving device 100 side.

After receiving (obtaining) and distributing a series of broadcast-related information, the broadcast receiving device 100 determines whether or not the same program is being continued to be viewed (S10019), and if not, the mobile information terminal side A response indicating that cooperation is not permitted is sent to the cooperation control application, and the process ends (S10020).

If you are continuing to watch, the process returns to step S10005, and if there is a home restriction, it is checked whether the mobile information terminal 700 is in the same home (S10009), but the preset valid time has elapsed since the last check. or whether there has been a confirmation request (S10007) from a broadcast signal or distribution server since the last check (S10008). The confirmation (S10009) is not performed, and the process proceeds to the next broadcast cooperation application related service (S10012) via S10010. Here, it is described that the confirmation request from the broadcast signal (S10008) is obtained from the broadcast cooperation information, but the event message is also described here as being included in the broadcast cooperation information. Furthermore, this confirmation request may be written in the AIT.

Note that the procedure described above is a loop processing procedure for the broadcast signal, the broadcast receiving device 100, the mobile information terminal 700, and the distribution server as a whole in the section indicated by the arrow S10022. The confirmation request in S10007 may be made at any timing within the loop.

Furthermore, the authentication information written in the AIT may be incorporated into the authentication key used for authentication at the distribution server (S10015). This allows confirmation that the authentication request is valid. In addition, if the authentication information written in the AIT is changed as the program progresses, and the authentication server does not perform authentication unless the authentication key includes information that is synchronized with the progress of the program, it is possible to You can confirm that you are continuing to watch. In this case, the AIT information is read and updated as appropriate (S10021). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast cooperation information in addition to being described in the AIT. Furthermore, as a method that essentially changes the authentication information, it is also possible to use a method in which the URL of the distribution server itself is changed as the program progresses.

In this way, while executing the broadcast cooperation application related service (S10012), the mobile information terminal 700 receives the broadcast at every preset valid time, or every time there is a confirmation request from the broadcast signal or the distribution server. By checking whether the device 100 and the device 100 are located in the same home, it is possible to appropriately execute a broadcast-related application that has the same home restriction. Furthermore, by using the authentication information embedded in the broadcast signal for authentication on the distribution server, the validity of the distribution request can be ensured.If the authentication information of the broadcast signal is changed appropriately, the same program You can also confirm that you are continuing to watch.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to implement the same-house restriction for mobile information terminals that cooperate with a broadcast receiving device.

In this embodiment, a case will be described in which the mobile information terminal 700 acquires broadcast cooperation information from a distribution server.

FIG. 18B shows the procedure of this example.

First, before performing terminal cooperation, a cooperation control application, which is an application that controls terminal cooperation, is activated on each of the mobile information terminal 700 and the broadcast receiving device 100 (S10101, S10102). In this state, the mobile information terminal 700 issues a terminal cooperation request to the broadcast receiving apparatus 100 (S10103). Next, AIT is acquired from the broadcast signal (S10104). Information such as the URL regarding the distribution server is acquired from this AIT information, and the information is transmitted to the mobile information terminal 700 (S10105). Next, the broadcast receiving device 100 issues a time confirmation request to the distribution server (S10106), and based on this request, the distribution server transmits time information to the broadcast receiving device 100 (S10107). This allows the subsequent authentication key issuance (S10115) to be performed in accordance with the time of the distribution server, but it may be omitted if the time difference is not a problem.

Thereafter, loop control is entered as indicated by the arrow in S10127.

First, the portable information terminal 700 issues a request for issuing an authentication key or a request for broadcast cooperation information distribution to the broadcast receiving apparatus 100 (S10109). The authentication key is used in the broadcast cooperation information distribution request to the distribution server in the subsequent stage (S10125). The broadcast cooperative distribution request in S10109 is a request for distribution of information acquired from a broadcast signal, and corresponds to the subsequent step S10126.

In any case, when the request in S10109 is issued from a mobile information terminal, it is determined whether the broadcast cooperation application has a same-home restriction (S10111), and if there is a restriction, the process proceeds to the next step S10112; otherwise, the step S10112 is skipped. Skip and proceed to S10114. If all broadcast cooperation applications have the same home restriction, the determination in S10111 is not performed and the process advances to S10112. In S10112, it is determined whether the mobile information terminal that issued the request is in the same house, and if not, the terminal cooperation is terminated (S10113). If they are in the same house, the requested procedure is to obtain broadcast cooperation information from the distribution server (S10125) or to obtain broadcast cooperation information from the broadcast signal (S10126). The procedure of S10126 is also described because it is possible to obtain the information from the broadcast signal in addition to the acquisition from the distribution server.

First, the procedure for acquiring broadcast cooperation information from the distribution server (S10125) will be described.

First, the broadcast receiving device 100 issues the authentication key requested by the information cooperation terminal 700. At this time, it is assumed that the authentication key includes time information at the time of issue and is valid only for a predetermined period of time (for example, 10 minutes). The distribution server checks the authentication information, including whether the authentication key is within the validity period, and if the authentication is OK, allows distribution of the broadcast cooperation information. After that, distribution of information will be permitted within the valid time, but distribution will be stopped once the valid time has passed. For example, streaming video cannot be viewed after its validity period has passed.

The preset valid time may be held in the distribution server, or the broadcast receiving device 100 may acquire it from a broadcast signal (for example, AIT) and incorporate the valid time information into the authentication key. Information on the validity period is notified to the mobile information terminal 700 in advance, and the issuance of the authentication key is requested before the validity period expires. Alternatively, the valid time is managed by the broadcast receiving device 100, and after confirming that the mobile information terminal 700 is in the same house before the valid time expires, the broadcast receiving device 100 automatically transmits the message to the mobile information terminal 700. However, an authentication key may be issued to the recipient.

The valid time may be the same within one program, or may be changed as the program progresses. Furthermore, if no valid time is set, it may be handled such that once authentication is performed, the authentication is valid while the program is being viewed.

Furthermore, the authentication information written in the AIT may be incorporated into the authentication key used for authentication at the distribution server (S10117). This allows confirmation that the authentication request is valid. In addition, if the authentication information written in the AIT is changed as the program progresses, and the authentication server does not perform authentication unless the authentication key includes information that is synchronized with the progress of the program, it is possible to You can confirm that you are continuing to watch. In this case, the AIT information is read and updated as appropriate (S10124). Note that the authentication information to be incorporated into the broadcast signal may be incorporated as broadcast cooperation information in addition to being described in the AIT. Furthermore, as a method that essentially changes the authentication information, it is also possible to use a method in which the URL of the distribution server itself is changed as the program progresses. Note that in this case, the URL is changed when the distribution server is the same but the entrance is different, but it is also possible to change to a new distribution server due to changes in the broadcast cooperation application, etc. In this case, each time a change is made, the procedures of sending distribution server information (S10105), requesting time confirmation (S10106), and sending time information (S10107) are performed.

Next, a procedure for acquiring broadcast cooperation information from a broadcast signal (S10126) will be explained.

In this case, after confirming that the mobile information terminal 700 is in the same house, the broadcast receiving device 100 acquires broadcast cooperation information from the broadcast signal (S10119), and subsequently distributes the information to the mobile information terminal 700. (S10120).

Note that when changing the broadcast cooperation information as the program progresses, a notification of the change may be issued from the broadcast signal (S10110), and the broadcast cooperation information may be acquired using the notification as a trigger. In that case, if the authentication key is obtained from the distribution server, the broadcast receiving device 100 issues an authentication key to the mobile information terminal (S10115) and notifies the mobile information terminal that there has been a change notification. If it is within the validity period, the issuance of the authentication key may be omitted and only the change notification may be sent. In the case of acquisition from a broadcast signal, the broadcast receiving apparatus 100 acquires the information (S10120) and distributes it to the mobile information terminal (S10120). In addition, in the case of acquisition from a broadcast signal, it is possible to confirm that the mobile information terminal 700 is in the same house for each change notification, or as in the second embodiment, this confirmation is omitted if it is within the valid period. I don't mind if you do. Here, although it is described that the change notification from the broadcast signal (S10110) is obtained from the broadcast cooperation information, the event message is also described here as being included in the broadcast cooperation information. Furthermore, this change notification may be written in the AIT.

After receiving (obtaining) and distributing a series of broadcast-related information, the broadcast receiving device 100 determines whether or not the same program is being viewed continuously (S10121), and if not, the mobile information terminal side A response indicating that cooperation is not permitted is sent to the cooperation control application, and the process ends (S10123). If viewing continues, the process returns to S10108 and loop processing S10127 continues.

In this way, by including time information in the authentication key used to authenticate the distribution server and managing the valid time, it is possible to periodically confirm that the mobile information terminal 700 is in the same house as the broadcast receiving device 100. It is possible to execute broadcasting-related applications that have appropriate restrictions within the same home. Furthermore, by using the authentication information embedded in the broadcast signal for authentication on the distribution server, the legitimacy of the distribution request can be ensured.If the authentication information of the broadcast signal is changed appropriately, the same program You can also confirm that you are continuing to watch.

According to the mobile information terminal cooperation technology according to the present embodiment described above, even when a mobile information terminal that cooperates with a broadcast receiving device acquires broadcast cooperation information from a distribution server, it is possible to realize the same-house restriction. .

In the second and third embodiments, the procedure for realizing the same-house restriction in terminal cooperation has been described, but depending on the broadcast cooperation application, use from outside the home may also be permitted. In this embodiment, such a case will be explained. For example, if a program such as a TV shopping program itself is used for public relations or advertising, it would be desirable for broadcasters to be able to use a broadcast collaboration application regardless of whether the program is inside or outside the home. In the case of such a program, once it is registered in the broadcast receiving device 100, the use of the broadcast collaboration application may be permitted regardless of whether the mobile information terminal 700 is present in the home. In this case, it would be more convenient if there was a broadcast cooperation application that converts the broadcast video itself into streaming data and distributes it from the broadcast receiving device 100 to the mobile information terminal 700 via the Internet. The streaming data may be encrypted in the broadcast receiving device 100 for copyright protection. Whether or not the broadcast cooperation application allows use from outside the home, including the distribution of broadcast video outside the home, is written in the data within the broadcast signal (for example, AIT, etc.).

The specific procedure is shown in FIG. 18C. Since a part of the procedure is the same as in Examples 2 and 3, the explanation of the parts that overlap with Examples 2 and 3 will be omitted. When there is a terminal cooperation request from outside the home (S10203), if the application is allowed to be used outside the home, the broadcast receiving device 100 checks whether the request source is a registered mobile information terminal ( In step S10205), cooperation is permitted. Here, if necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving apparatus 100 in order to protect the copyright of the broadcast video and broadcast cooperation information (S10207). At this time, the authentication may be performed by an authentication server (S10207). Information about whether copyright protection is necessary or not and information about the authentication method for copyright protection are acquired from the broadcast signal (for example, as described in the AIT), and control is performed accordingly. If these pieces of information are not stored in the broadcast signal, a predetermined method predetermined in the broadcast receiving apparatus 100 is followed. For example, predetermined copyright protection processing may be performed. Furthermore, if such information is not stored in the broadcast signal, it may be determined in advance that the copyright protection process is not performed in the broadcast receiving apparatus 100. Specific examples (1) to (4) of authentication for copyright protection are shown below. Only one of each of the following authentications may be performed. Alternatively, a combination of a plurality of authentications illustrated below may be performed. Further, the authentication illustrated below may be performed in combination with other authentication processing not illustrated below.

(1) Authentication using ID and password When registering portable information terminal 700 with broadcast receiving device 100, an ID and password are issued, and broadcast receiving device 100 allows cooperation by confirming this ID and password.

(2) Use of encryption key In addition to the authentication using the ID and password described above, an encryption key for decoding encrypted video data, etc. is transmitted from broadcast receiving device 100 to a mobile information terminal. This encryption key may be obtained from a broadcast signal (for example, written in the AIT).

(3) Using an authentication server A method in which an authentication server issues an encryption key for decoding encrypted video data, etc. Mobile information terminal 700 transmits the ID and password to the authentication server and obtains the encryption key. In this case, by acquiring the location information (specifically, the URL) of the authentication server from the broadcast signal (for example, written in the AIT) and transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700, Greater safety. If the mobile information terminal 700 cannot obtain the encryption key, the video etc. cannot be decrypted, so the broadcast receiving device 100 may request authentication from the authentication server, which may be used as authentication for copyright protection, or the mobile information terminal The authentication may be completed by notifying the broadcast receiving apparatus 100 from 700 that the encryption key has been obtained. Note that billing may be performed by the authentication server.

(4) Mutual Authentication of Encryption Keys The encryption keys held by the broadcast receiving device 100 and the mobile information terminal 700 are mutually authenticated and confirmed, thereby providing authentication for copyright protection.

If the information stored in the broadcast signal indicates that copyright protection by a predetermined method is required, and the copyright protection cannot be authenticated by the predetermined method, terminal cooperation is not permitted. Further, even if there is no specification in the broadcast signal and authentication is performed using a predetermined method of the broadcast receiver 100, if copyright protection cannot be authenticated using the predetermined method, terminal cooperation is not permitted.

If terminal cooperation is permitted, from then on, it is not checked whether the mobile information terminal 700 exists in the same house, and requests from the mobile information terminal 700 (S10211), autonomous control of the broadcast receiving device 100, and broadcast signals are not confirmed. In accordance with the request from (S10210), broadcast cooperation information is distributed to the mobile information terminal 700 (S10217), and an authentication key for the distribution server is issued (S10212). Note that in this case, it is not necessary to perform control that sets the effective time. The portable information terminal 700 located outside the home acquires broadcast cooperation information from the broadcast receiving device 100 or the distribution server using the issued authentication key (S10215). Further, the authentication information acquired from the broadcast signal (for example, it is stated in the AIT) is incorporated into the authentication key issued by the broadcast receiving device 100, and the distribution server uses the authentication key in which the authentication information acquired from the broadcast signal is incorporated. If access is permitted, it is possible to optimize use outside the home.

Furthermore, there are cases where it is better not to allow unlimited use of broadcast-linked apps, such as when giving a discount as a premium for program viewing. It is preferable to do so and then allow use of the distribution server even if the distribution server is not in the same home. In this case, it does not matter if the mobile information terminal 700 is not registered in the broadcast receiving device 100.

The specific procedure in this case is shown in FIG. 18D. Since some of the steps in this procedure are the same as those in FIG. 18C, the explanation of the overlapping parts will be omitted. First, when the mobile information terminal 700 and the broadcast receiving apparatus 100 are in the same house, the mobile information terminal 700 makes a terminal cooperation request to the broadcast receiving apparatus 100, and the broadcast receiving apparatus 100 After confirming that it exists (S10305), cooperation is permitted. Here, if necessary, authentication may be performed between the mobile information terminal 700 and the broadcast receiving apparatus 100 in order to protect the copyright of the broadcast video and broadcast cooperation information (S10307). In this case, the authentication may be performed by an external authentication server. Information about whether copyright protection is necessary or not and information about the authentication method for copyright protection are acquired from the broadcast signal (for example, as described in the AIT), and control is performed accordingly. If this information is not stored in the broadcast signal, a predetermined method predetermined in the broadcast receiving apparatus 100 is followed. For example, predetermined copyright protection processing may be performed. Furthermore, if such information is not stored in the broadcast signal, it may be determined in advance that the copyright protection process is not performed in the broadcast receiving apparatus 100.

Specific examples (5) to (7) of authentication for copyright protection are shown below. Only one of each of the following authentications may be performed. Alternatively, a combination of a plurality of authentications illustrated below may be performed. Further, the authentication illustrated below may be performed in combination with other authentication processing not illustrated below.

(5) Use of Encryption Key While the portable information terminal 700 is in the same home, an encryption key for decoding encrypted video data, etc. is transmitted from the broadcast receiving device 100 to the portable information terminal. This encryption key may be obtained from a broadcast signal (for example, written in the AIT). Authentication is achieved by handing over this encryption key within the same household. Furthermore, if the encryption key can only be obtained from the broadcast signal at a certain point in the program, and if the transfer of the encryption key to the mobile information terminal 700 is limited to within the same home, then the user must be within the same home at that time. Restrictions can be set, and it can also be used to give premiums for viewing.

(6) Using an authentication server A method in which an authentication server issues an encryption key for decoding encrypted video data, etc. Mobile information terminal 700 transmits the ID and password to the authentication server and obtains the encryption key. In this case, by acquiring the location information (specifically, the URL) of the authentication server from the broadcast signal (for example, written in the AIT) and transmitting this location information from the broadcast receiving device 100 to the mobile information terminal 700, Greater safety. If the mobile information terminal 700 cannot obtain the encryption key, the video etc. cannot be decrypted, so the broadcast receiving device 100 may request authentication from the authentication server, which may be used as authentication for copyright protection, or the mobile information terminal The authentication may be completed by notifying the broadcast receiving apparatus 100 from 700 that the encryption key has been obtained. Although the authentication server can be accessed at home or outside the home, the location information of the authentication server can be obtained from the broadcast signal only at a certain point in the program, and the location information is transmitted to the mobile information terminal 700. If the delivery of videos is limited to within the same home, a restriction can be set that the user must be in the same home at the time, and this can also be used to give premiums for viewing. Note that billing may be performed by the authentication server.

(7) Mutual Authentication of Encryption Keys The encryption keys held by the broadcast receiving device 100 and the mobile information terminal 700 are mutually authenticated and confirmed, thereby providing authentication for copyright protection. This authentication may be performed at home or outside the home.

If the information stored in the broadcast signal indicates that copyright protection by a predetermined method is required, and the copyright protection cannot be authenticated by the predetermined method, terminal cooperation is not permitted. Further, even if there is no specification in the broadcast signal and authentication is performed using a predetermined method of the broadcast receiver 100, if copyright protection cannot be authenticated using the predetermined method, terminal cooperation is not permitted. The procedure after allowing terminal cooperation is the same as the procedure shown in FIG. 18C, so a description thereof will be omitted.

According to the mobile information terminal cooperation technology according to the present embodiment described above, it is possible to realize the use of a mobile information terminal that cooperates with a broadcast receiving device from outside the home while paying attention to copyright protection.

In actual usage situations, it is more desirable to easily know whether a program has a terminal cooperation application or not, and which terminal cooperation applications are available. In this embodiment, a method of displaying the availability status of a terminal cooperation application will be explained.

FIG. 19A is an example of a launcher screen (173b11) of a broadcast cooperation application when there is a terminal cooperation application. Broadcast cooperation apps are displayed as framed text icons. Broadcast cooperation applications (173b12 to 173b14) for the broadcast receiving device 100 and broadcast cooperation applications (173b15 to 173b17) for mobile information terminals that are linked to the program being viewed are displayed. In this example, the status of the app is indicated by the thickness of the border surrounding the string and the color within the border. Main body applications A and B (173b12, 173b13) and terminal applications A and B (173b15, 173b16) are in a usable state, and main body application C (173b14) and terminal application (173b17) are in an unusable state. The state in which a terminal application is unavailable means that none of the mobile information terminals 700 that are capable of communicating with the broadcast receiving apparatus 100 has the function of executing the application.

FIG. 19B shows a screen after terminal application A is selected in FIG. 19A. The status of each mobile information terminal 700 regarding terminal application A is shown. The mobile information terminal displayed on this screen is a terminal that has cooperated with or has been registered with the broadcast receiving apparatus 100 in the past.

Mobile terminal 1 (173b22) and mobile terminal 2 (173b23) whose icons have a solid border are in a state where they can communicate with the broadcast receiving device 100, and mobile terminal 3 (173b24) whose icon has a dotted border This indicates that the mobile terminal 4 (173b25) is not in a state where it can communicate with the broadcast receiving apparatus 100. In addition, mobile terminal 1 (173b22) and mobile terminal 3 (173b24) whose icons have white frames have the function of executing terminal application A, and mobile terminals 2 (173b23) and mobile terminals 4 whose icons have gray frames. (173b25) indicates that the terminal application A does not have the function of executing it. Furthermore, if the app is already running on the device, an icon with a design that represents this may be used.

Also, it is easier to visually understand icons by using pictures, so an example is shown below.

FIG. 19C is an example of a launcher screen (173b31) showing a list of broadcast cooperation applications. In addition to the broadcast receiving device 100, icons are shown for each type of mobile information terminal 700. 173b32 and 173b33 are icons indicating the broadcast receiving device 100, 173b34 and 173b35 are icons indicating the smartphone type portable information terminal 700, and 173b36 is an icon indicating the head mounted display type portable information terminal 700. Each app is for a device indicated by an icon.

In FIG. 19C, if the application cannot be used, a mark (in this case, a circle with diagonal lines) indicating that the application cannot be used is displayed superimposed on the image of the device. Further, regarding the broadcast receiving device 100, if the application is already being executed, a mark indicating this (in this case, a dot on a circle) may be displayed in an overlapping manner. With this display, it is possible to prevent the wasteful operation of proceeding with the launcher procedure even though it has already been executed. In the case of the mobile information terminal 700, it is also possible to display a mark indicating that the application is being executed when the application is being executed on all terminals that are capable of communicating with the broadcast receiving device and are capable of executing the application.

FIG. 19D is a screen (173b41) after selecting application C (173b34) in FIG. 19C. The state of a mobile information terminal 700 of a type compatible with application C is shown. On this screen, if the mobile information terminal 700 does not have the function to execute the broadcast cooperation application, is not in a state where it can communicate with the broadcast reception device 100, or is already running the broadcast cooperation application, it will be displayed. The mark that represents the icon is displayed over the icon. In this example, a circle with a diagonal line (173b44, 173b46) is marked if the execution function is not available, a triangle with an exclamation point (173b45, 173b46) is marked if the communication is not possible, and a dot is marked in a circle if it is already being executed. mark (173b43) is displayed.

Furthermore, it would be desirable to have a display method that allows the user to know that a broadcast cooperation application is available when the situation changes without having to start the launcher each time. For example, when the power is turned on, when the channel is changed, when there is a change in the broadcast cooperation application at the beginning of the program, or even during the program, there is a change in the communication status between the broadcast receiving device 100 and the mobile information terminal 700. In this case, if the execution status of the app changes, the icon will be displayed for a predetermined period of time to display the status at that time.

An example of this case is shown in FIG. 19E. If an icon indicating the type of each device is displayed, this indicates that there is a broadcast cooperation application compatible with that type of device. In this case, a circle with a diagonal line indicates that there are no available devices of that type that can run the app. A dot in a circle indicates that the app is running on all enabled devices of that type.

FIG. 19F is a display screen (10401) on the mobile information terminal 700. When requesting terminal cooperation from the mobile information terminal 700, it is more convenient to use a list if you can see which broadcast cooperation application can be used with which broadcast reception device 100. An example of the list is shown in FIG. 19F (10402). This table shows which broadcast receiving apparatus 100 in the home can use the broadcast cooperation application corresponding to the program that the user wants to check. Furthermore, if the status of each broadcast receiving device 100 is also displayed, convenience will be further enhanced, especially when using from outside the home. In this example, the following display examples are shown: the program is being received, another program is being received, the program is vacant, and another program is reserved (when recording of another program is reserved from the middle of the program). Note that if there are multiple tuners in the broadcast receiving apparatus 100, the convenience will be further improved if the status is displayed for each of the multiple tuners. In table 10202, branch numbers are used to distinguish tuners within the same device. For example, receiving device B-1 and receiving device B-2 are tuners within the same broadcast receiving device 100. In the case of terminal cooperation, if broadcast video and audio can be distributed as streaming data, there is no need to use the video section of the broadcast receiving device 100, and if the tuner in the broadcast receiving device 100 can be used, the broadcast can be used. Therefore, it is convenient to know the usage status of each tuner.

Note that in order to perform the display described in this embodiment, information regarding whether the application is compatible with the broadcast receiving device 100 or what type of mobile information terminal 700 is required for each broadcast cooperation application is required. There must be. Further, information for executing the corresponding application on the broadcast receiving device 100 and the mobile information terminal 700 is required. These pieces of information can be acquired by the information receiving device 100 by, for example, being written in the AIT.

According to the mobile information terminal cooperation technology according to the present embodiment described above, by displaying information regarding the broadcast cooperation application, the broadcast receiving device 100, and the mobile information terminal 700, it is possible to use the broadcast cooperation service with higher convenience. becomes.

Example 6 of the present invention will be described below. Note that the configuration, effects, etc. of this example are the same as those of Example 1 unless otherwise specified. Therefore, in the following, the differences between this embodiment and the first embodiment will be mainly explained, and the explanation of the common points will be omitted as much as possible to avoid duplication.

Embodiment 6 is an example in which a head-mounted display type portable information terminal as shown in FIG. 20 is used as the portable information terminal.

FIG. 20 is an explanatory diagram showing an example of a case where a head-mounted display type mobile information terminal 700 is worn by a user. 20001 schematically shows a user, 20002 schematically shows an area photographed by the first image input unit 743, and 20003 schematically shows a virtual image surface of information displayed as a virtual image in the user's viewing direction by the display unit 741. It is something that Note that the virtual image plane is not limited to the size or range of 20003, but may be one that covers a wide field of view. Furthermore, the portable information terminal 700 is mounted on the head and has a display section that can optically display information and images in the direction of the user's 20001 visual field, and an image input section that can take an image in the direction of the user's 20001 visual field. The shape is not limited to the one shown as an example in FIG. 20, and may be glasses-shaped, goggle-shaped, one that covers one eye, one that covers both eyes, etc., as long as the shape is suitable.

Examples of the display unit 741 include a method using a half mirror and a method of directly projecting a virtual image onto the retina of the user 20001. In the description of this embodiment, it is assumed that at least the head-mounted display is a transmissive type, and when a virtual image is not displayed, it is desirable that the field of view of the user 20001 is not obscured as much as possible.

Further, in this embodiment, the head-mounted display type portable information terminal shown in FIG. 20 will be described as having the configuration of the portable information terminal shown in FIG. 5A, for example, but the present invention is not limited to this. For example, a head-mounted display section including at least a first image input section 743 and a display section 741, and a terminal section (in a separate housing) that communicates with the head-mounted display section through a short-range wireless connection such as Bluetooth or a wired connection. The terminal unit may perform main processing such as communication with a broadcast receiving device or a provider server, and display information on a head-mounted display unit.

FIG. 21 is an operation sequence diagram showing an example of an operation sequence when starting the cooperation control application on the head-mounted display type mobile information terminal 700. This figure shows a series of steps (first time) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 until cooperative operation becomes possible. It is assumed that the cooperation control application is installed in the storage unit 710 of the mobile information terminal 700 in advance as a cooperation control program 7002.

In FIG. 21, first, the mobile information terminal 700 is authenticated as a terminal that cooperates with the broadcast receiving apparatus 100 through the processing of S401 to S406 in FIG. 8A. Next, the position of the virtual image on the cooperative control application screen displayed on the display unit 741 of the mobile information terminal 700 is always set in a predetermined relationship in conjunction with the position of the image displayed on the video display unit 173 of the broadcast receiving device 100. A screen for selecting whether to perform control (selection of interlocking mode/non-interlocking mode) is displayed (S408). After the user selects the linked mode/non-linked mode by input using the operation unit 730 or voice input using the voice input unit 753 (S409), branch processing S410 is performed according to the selection result.

If the non-linked mode is selected (No), the non-linked mode is set and stored as the linked screen display settings stored in the various information storage area 7013 of the storage unit (S417), and the basics of the linked control application are displayed on the display unit 741. The screen is displayed as a virtual image (S418).

If the linked mode is selected (Yes), the first image input unit 743 of the mobile information terminal 700 acquires the image of the video display unit 173 of the broadcast receiving device 100 (S411), and the image signal processing unit 742 displays the image. The screen frame of the unit 173 is recognized and the position is detected (S412). As a method for recognizing the screen frame, since the screen frame of the video display section 173 is usually a rectangle with a predetermined ratio of length and width (for example, height:width = 9:16), recognition is performed using, for example, a shape pattern. . Next, display a screen for selecting the position of the virtual image on the cooperative control application screen displayed on the display unit 741 of the mobile information terminal 700 in conjunction with the position of the image displayed on the video display unit 173 of the broadcast receiving device 100 ( S413), and the user selects the display position by operating input using the operating unit 730 or by voice input using the audio input unit 753 (S414). After selecting the display position, a screen is displayed for selecting whether to make the part outside the display screen frame of the video display unit 173 of the broadcast receiving apparatus 100 recognized in S412 transparent and visible, or non-transparent and invisible. It is displayed (S415), and the user selects it by operation input using the operation unit 730 or voice input using the voice input unit 753 (S416). After selection, the linkage mode, linkage screen display position, and transparency/non-transparency outside the display screen frame of the video display unit 173 are set and stored as linkage screen display settings to be stored in the various information storage area 7013 of the storage unit (S417), and displayed. The unit 741 displays the basic screen of the cooperative control application as a virtual image (S418).

Here, the description has been made using the expressions "transparent" and "non-transparent". However, when the display section of the mobile information terminal 700 is of a virtual image type, in a strict sense, this does not mean that the transmittance of light emitted from outside the display screen frame of the video display section 173 is changed. For example, if the video is displayed in black using a virtual image on the display unit of the mobile information terminal 700, the user can better recognize the background. This state is described as "transparent". Further, for example, if a high-intensity virtual image of white or gray is displayed on the display unit of the mobile information terminal 700, it becomes difficult for the user to recognize the background. This can be achieved by increasing the brightness of the virtual image projection image relative to light from the background among the light that enters the user's eyes. This state is described as "non-transparent". Further, in the "non-transparent" setting state, the ratio of the light amount of the virtual image to the light amount entering the user's eyes needs to be higher than in the "transparent" setting state. In other words, although it is described as a "non-transparent" setting, it is not necessary to make the background completely invisible.

Note that if the display unit of the mobile information terminal 700 is a goggle-type liquid crystal shutter type display unit that has a function of blocking external light, literally the display screen of the video display unit 173 is set to “transparent”. The transmittance of light emitted from outside the frame may be increased by the light shielding function. Similarly, in the case of the "non-transparent" setting, the transmittance of light emitted from outside the display screen frame of the video display section 173 may be reduced by the light shielding function. If this is to be achieved using a goggle-type liquid crystal shutter type video display, black display or low-luminance gray display may be performed in an area corresponding to the outside of the display screen frame of the video display section 173. Similarly, in this case, although it is explained as a "non-transparent" setting, it is not necessary to make the background completely invisible. For example, the contrast of the background in an area corresponding to the outside of the display screen frame in the user's visual field may be reduced as a result, thereby making the background difficult to see.

FIG. 22 is a display example of a screen for selecting the position of the virtual image on the cooperative control application screen in S413. On the virtual image surface 20003 of information displayed as a virtual image by the display unit 741, 20003a to 20003e are displayed as options for the display position of the virtual image on the cooperative control application screen, and the user can perform operation input from the operation unit 730 or voice input from the voice input unit 753. Select the display position by input. Here, if 20003d is selected, for example, the display unit 741 of the mobile information terminal 700 is controlled so that the virtual image on the cooperation control application screen is always at the same position with respect to the video display unit 173 of the broadcast receiving device 100. Note that the position of the virtual image on the cooperative control application screen is not limited to this example, and the position or size may be arbitrarily selected.

FIG. 23 is an example of a screen displayed when the display of the portion outside the screen frame of the video display section 173 is selected to be transparent or non-transparent in S415. FIG. 23(a) shows a display when transparency is selected, and the surroundings of the screen of the video display section 173 are also visible. FIG. 23(b) shows a case where non-transparent is selected, and only the screen of the video display section 173 and the cooperative control application screen 20003d (here, the subtitle application) are clearly visible. In other areas, the background is difficult to see due to white display, gray display, or black display. By selecting non-transparent, for example, when watching a movie, it is possible to create a state where it is difficult to see anything other than the video screen and subtitles, as in a movie theater, and it is possible to enhance the immersion in watching the movie.

Example 7 of the present invention will be described below. Note that the configuration, effects, etc. of this example are the same as those of Example 6 unless otherwise specified. Therefore, in the following, the differences between this embodiment and the sixth embodiment will be mainly explained, and the explanation of the common points will be omitted as much as possible to avoid duplication.

FIG. 24A is an operation sequence diagram showing an example of an operation sequence when starting the cooperation control application on the head-mounted display type mobile information terminal 700. This figure shows a series of steps (first time) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 until cooperative operation becomes possible. It is assumed that the cooperation control application is installed in the storage unit 710 of the mobile information terminal 700 in advance as a cooperation control program 7002.

In FIG. 24A, first, the mobile information terminal 700 is authenticated as a terminal that cooperates with the broadcast receiving apparatus 100 through the processes of S401 to S406 in FIG. 8A. Next, the position of the virtual image on the cooperative control application screen displayed on the display unit 741 of the mobile information terminal 700 is always set in a predetermined relationship in conjunction with the position of the image displayed on the video display unit 173 of the broadcast receiving device 100. A screen for selecting whether to perform control (selection of interlocking mode/non-interlocking mode) is displayed (S408). After the user selects the linked mode/non-linked mode by input using the operation unit 730 or voice input using the voice input unit 753 (S409), branch processing S410 is performed according to the selection result.

If the non-linked mode is selected (No), the non-linked mode is set and stored as the linked screen display settings stored in the various information storage area 7013 of the storage unit (S417), and the basics of the linked control application are displayed in the display unit 741. A screen is displayed (S418).

If the linked mode is selected (Yes), the mobile information terminal 700 requests the broadcast receiving apparatus 100 to display a mark for detecting the position of the screen frame of the video display section 173 (S419). The broadcast receiving apparatus 100 displays a predetermined mark at a predetermined position on the video display section 173 (S420), and notifies the portable information terminal 700 that the mark has been displayed (S421). In the mobile information terminal 700, the first image input unit 743 acquires an image of the video display unit 173 of the broadcast receiving device 100 (S422), and the image signal processing unit 742 recognizes the mark displayed on the video display unit 173. The position of the display screen frame is detected (S423). Thereafter, the processes from S413 to S418 in FIG. 21 are performed in the same manner.

FIG. 24B is an operation sequence diagram showing an example of an operation sequence when starting the cooperation control application on the head-mounted display type mobile information terminal 700. This figure shows a series of steps (from the second time onwards) from when the mobile information terminal 700 performs authentication processing with the broadcast receiving apparatus 100 until cooperative operation becomes possible.

In FIG. 24B, first, the mobile information terminal 700 is authenticated as a terminal that cooperates with the broadcast receiving apparatus 100 through the processing of S501 to S505 in FIG. 8B. Next, by referring to the link screen display settings in the various information storage area 7013 of the storage unit, branch processing S507 is performed according to the link mode/non-link mode setting.

If the non-linked mode is set (No), by referring to the linked screen display settings in the various information storage area 7013 of the storage unit, the linked screen display position can be set and the area outside the display screen frame of the video display unit 173 can be changed. The display unit 741 displays the basic screen of the cooperative control application as a virtual image according to the transparent/non-transparent settings (S506).

If the linked mode is set (Yes), the mobile information terminal 700 requests the broadcast receiving apparatus 100 to display a mark for detecting the frame of the video display section 173 (S508). The broadcast receiving apparatus 100 displays a predetermined mark at a predetermined position on the video display section 173 (S509), and notifies the portable information terminal that the mark has been displayed (S510). In the mobile information terminal 700, the first image input unit 743 acquires an image of the video display unit 173 of the broadcast receiving device 100 (S511), and the image signal processing unit 742 recognizes the mark displayed on the video display unit 173. The position of the display screen frame is detected (S512). Next, by referring to the cooperative screen display settings in the various information storage area 7013 of the storage section, the display section 741 performs cooperative control according to the setting of the cooperative screen display position and the setting of transparency/non-transparency outside the display screen frame of the video display section 173. The basic screen of the application is displayed as a virtual image (S506).

FIG. 25 is a display example of marks for detecting the display screen frame of the video display section 173 of the broadcast receiving apparatus 100 in S420. Marks 17301a to 17301d of predetermined shapes are displayed on the video display section 173, and the position of the display screen frame of the video display section 173 can be detected based on the positions of the marks. Further, a mark for detecting the display screen frame of the video display section 173 is transmitted from the broadcast station server 300 as a video signal, and the broadcast receiving device 100 receives the mark and displays the mark on the video display section 173. It's okay. Furthermore, the mark may be displayed all the time or at predetermined time intervals. For example, by displaying the mark once in multiple frames of the video display of the broadcast receiving device 100, the mark can be made almost invisible to the user. Note that, for example, if the mark is a monochromatic black mark, it will be difficult to recognize the mark if the original image on the image display section 173 is dark. Therefore, in order to make the mark recognizable regardless of the display of the original image on the image display section 173, it is preferable that the mark is at least not monochrome.

In the embodiments described above, by displaying marks for detecting the display screen frame, the position of the display screen frame can be easily detected and the detection accuracy can be improved.

Note that instead of displaying a mark on the video display section 173 of the broadcast receiving device 100, an infrared light emitting point is provided on the display screen frame of the broadcast receiving device 100, and the position of the display screen frame is detected based on the position of the light emitting point. It doesn't matter which method you use. Information on the positional relationship between the light emitting point and the display screen frame is obtained from the broadcast receiving device.

Example 8 of the present invention will be described below. The configuration, effects, etc. of this example are the same as those of Example 1 unless otherwise specified. Therefore, in the following, the differences between this embodiment and the first embodiment will be mainly explained, and the explanation of the common points will be omitted as much as possible to avoid duplication.

FIG. 26 is a software configuration diagram of the head-mounted display type portable information terminal 700 of this embodiment, and shows the software configuration in the ROM 703, RAM 704, and storage unit 710. In this embodiment, the BML browser program 7004 and the HTML browser program 7003 stored in the storage unit 710 are expanded to the RAM 704, and further, the main control unit 701 executes the expanded operation programs to create a BML browser program. An engine 7104 and an HTML browser engine 7103 are configured.

The operations of the broadcast receiving apparatus 100 and the head-mounted display type portable information terminal 700 of this embodiment will be described below.

[Operation sequence when starting the application]
Regarding the activation process of the broadcast cooperation application based on the AIT transmitted by broadcast waves in the broadcast receiving apparatus 100 and the mobile information terminal 700 of this embodiment, the information on the PMT, the application control code 903 of the AIT, the activation priority 907, etc. A case in which automatic startup is not specified by the information will be explained.

FIG. 27 is an operation sequence diagram showing an example of an operation sequence up to displaying data broadcasting on mobile information terminal 700. Here, it is assumed that the mobile information terminal 700 has been authenticated as a terminal that cooperates with the broadcast receiving apparatus 100.

In FIG. 27, first, through the processing of S301 to S304 in FIG. 7C, it is confirmed that the application control code 903 is "startable" rather than "automatic start" based on the PMT and AIT information, and data broadcasting and broadcasting by the broadcasting service are performed. The broadcast program continues to be displayed without starting any of the cooperative applications.

When the user uses the mobile information terminal 700 to select the display of data broadcasting on the mobile information terminal after completing the process of S304 (S320), the display on the video display unit 173 of the broadcast receiving apparatus 100 is An interlocking mode is set in which the position of the virtual image on the data broadcasting screen displayed on the display unit 741 of the mobile information terminal 700 is controlled so as to always have a predetermined relationship in conjunction with the position of the image displayed on the mobile information terminal 700 (S321). Next, the mobile information terminal 700 requests the broadcast receiving apparatus 100 to display a mark for detecting the video display frame of the video display section 173 (S322). The broadcast receiving apparatus 100 displays a predetermined mark at a predetermined position on the video display section 173 (S323), and notifies the portable information terminal that the mark has been displayed (S324). In the mobile information terminal 700, the first image input unit 743 acquires an image of the video display unit 173 of the broadcast receiving device 100 (S325), and the image signal processing unit 742 recognizes the mark displayed on the video display unit 173. The display screen frame is recognized (S326). Next, the mobile information terminal 700 requests the broadcast receiving apparatus 100 to obtain data broadcast information (S327). The broadcast receiver 100 acquires a BML data string from the broadcast signal (S328) and transmits it to the mobile information terminal 700 as data broadcast information (S329). In the mobile information terminal 700, the BML document is played back by the BML browser engine 7104 based on the acquired data broadcast information, and the display on the mobile information terminal 700 is linked to the position of the video displayed on the video display unit 173 of the broadcast receiving device 100. The data broadcasting screen is displayed as a virtual image at a predetermined position by the section 741 (S330).

FIG. 28 is a screen display diagram showing an example of a data broadcast screen displayed by the process of S330 in FIG. 27, and corresponds to the data broadcast display screen in the broadcast receiving apparatus in FIG. 11. FIG. 28A shows a broadcast screen displayed on the video display section 173 of the broadcast receiving apparatus 100, and marks 17301a to 17301d for detecting video display frames are displayed. FIG. 28(b) is a data broadcast screen 20003f displayed as a virtual image 20003 on the display unit 741 of the mobile information terminal 700. FIG. 28(c) shows the screen viewed by the user, and the data broadcast screen is displayed as a virtual image at a predetermined position that does not overlap with the broadcast screen displayed on the video display section 173. The data broadcast information acquired by the mobile information terminal 700 includes data on the display position when displaying the data broadcast on the broadcast receiving device 100, and this information and the video display section 173 of the broadcast receiving device 100 detected in S326 are included. The position of the data broadcasting screen to be displayed as the virtual image 20003 is determined based on the position of the video display frame. As a result, it appears to the user that the display screen is similar to the data broadcast display screen on the broadcast receiving apparatus 100 in FIG. 11.

Next, a case will be described in which a broadcast cooperation application is executed on the mobile information terminal 700.

FIG. 29 is an operation sequence diagram showing an example of an operation sequence up to execution of a broadcast-linked application on mobile information terminal 700. Here, it is assumed that the mobile information terminal 700 has been authenticated as a terminal that cooperates with the broadcast receiving apparatus 100.

In FIG. 29, first, through the processing of S301 to S304 in FIG. 7C, it is confirmed that the application control code 903 is "startable" rather than "automatic start" based on the PMT and AIT information, and data broadcasting by the broadcasting service is performed. The broadcast program continues to be displayed without starting any of the cooperative applications.

If the user uses the mobile information terminal 700 to request execution of the broadcast collaboration application on the mobile information terminal after completing the process in S304 (S340), the video display unit 173 of the broadcast receiving device 100 displays An interlocking mode is set in which the position of the virtual image on the broadcast collaboration application screen displayed on the display unit 741 of the mobile information terminal 700 is controlled so as to always have a predetermined relationship in conjunction with the position of the displayed image (S341). Next, the mobile information terminal 700 requests the broadcast receiving apparatus 100 to display a mark for detecting the video display frame of the video display section 173 (S342). The broadcast receiving apparatus 100 displays a predetermined mark at a predetermined position on the video display section 173 (S343), and notifies the portable information terminal 700 that the mark has been displayed (S344). In the mobile information terminal 700, the first image input unit 743 acquires an image of the video display unit 173 of the broadcast receiving device 100 (S345), and the image signal processing unit 742 recognizes the mark displayed on the video display unit 173. The position of the display screen frame is detected (S346). Next, the portable information terminal 700 requests the broadcast receiving apparatus 100 to obtain broadcast cooperation application information such as AIT (S347). The broadcast receiving device 100 acquires the AIT data string (S348) and transmits it to the mobile information terminal 700 as broadcast cooperation application information (S349). The mobile information terminal 700 checks the application profile 904 of the AIT data string based on the acquired data broadcast information (S350). Next, a list of executable broadcast cooperation applications is displayed on the display unit 741 as a broadcast cooperation application launcher (S351).

When the user selects a predetermined broadcast cooperation application from the broadcast cooperation application launcher displayed in S351 by input using the operation unit 730 or voice input from the voice input unit 753 (S352), the broadcast reception apparatus 100 is selected from the mobile information terminal 700. A request is made to obtain broadcast cooperation application information such as AIT (S353). The broadcast receiving device 100 acquires the AIT data string (S354) and transmits it to the mobile information terminal 700 as broadcast cooperation application information (S355). The mobile information terminal 700 checks the application acquisition destination information 905 of the AIT data string based on the acquired broadcast cooperation application information. Further, based on the information described in the application acquisition source information 905, a request to transmit the broadcast cooperation application is transmitted to a predetermined service provider server 400 via the LAN communication unit 721 (S356).

The service provider server 400 that has received the transmission request for the broadcast cooperation application performs authentication processing on the mobile information terminal 700 as necessary under the control of the application management/distribution execution unit 4103, and then stores it in the application storage area 4013. The predetermined broadcast collaboration application is distributed via the LAN communication unit 421 (S357). Next, the HTML browser engine 7103 of the mobile information terminal 700 starts the broadcast collaboration application distributed from the service provider server 400 (S358).

In addition, in the startup sequence of the broadcast cooperation application explained in FIG. 29, an example is explained in which AIT is acquired from broadcast waves, but it is also possible to acquire an AIT file from a predetermined server device specified by the information description of PMT, etc. You can also do it. FIG. 30 is a screen display diagram showing an example of a list of executable applications displayed by the process of S351 in FIG. 29, and corresponds to the display screen in FIG. 12B. FIG. 30(a) shows a broadcast screen displayed on the video display section 173 of the broadcast receiving apparatus 100, and marks 17301a to 17301d for detecting video display frames are displayed. FIG. 30(b) is a display screen 20003g of a list of executable applications displayed as a virtual image 20003 on the display unit 741 of the mobile information terminal 700. FIG. 30(c) shows the screen viewed by the user, and the application list display screen is displayed as a virtual image at a predetermined position superimposed on the broadcast screen displayed on the video display section 173. The broadcast cooperation application information acquired by the mobile information terminal 700 includes data on the display position when displaying the application list on the broadcast reception device 100, and this information and the video display section of the broadcast reception device 100 detected in S346 are included. The position of the application list display screen to be displayed as the virtual image 20003 is determined based on the position of the video display frame 173. As a result, it appears to the user that the screen is displayed in the same way as the application list display screen on the broadcast receiving device 100 in FIG. 12B.

FIG. 31 is a screen display diagram showing an example of the broadcast cooperation application execution screen activated by the process of S358 in FIG. 29, and corresponds to the display screen in FIG. 13A. FIG. 31(a) shows a broadcast screen displayed on the video display section 173 of the broadcast receiving apparatus 100, and marks 17301a to 17301d for detecting video display frames are displayed. FIG. 31(b) is a display screen 20003h of the broadcast collaboration application displayed as a virtual image 20003 on the display unit 741 of the mobile information terminal 700. FIG. 31(c) shows the screen viewed by the user, in which the broadcast cooperation application display screen is displayed as a virtual image at a predetermined position superimposed on the broadcast screen displayed on the video display unit 173. The broadcast cooperation application information acquired by the mobile information terminal 700 includes data on the display position when displaying the broadcast cooperation application on the broadcast reception device 100, and this information and the video display of the broadcast reception device 100 detected in S326 are included. Based on the position of the video display frame of section 173, the position of the broadcast cooperation application display screen to be displayed as virtual image 20003 is determined. As a result, it appears to the user that the screen is displayed in the same manner as the broadcast collaboration application display screen on the broadcast receiving apparatus 100 in FIG. 13A.

In the eighth embodiment described above, the display of the data broadcast or the broadcast cooperation application is displayed as a virtual image on the display unit 741 of the head-up display type mobile information terminal 700, and the display on the video display unit 173 of the broadcast receiving device 100 is the video of the broadcast program. is displayed. Therefore, only users who wish to view the data broadcast or broadcast cooperation application can view the display of the data broadcast or broadcast cooperation application by wearing a head-up display type mobile information terminal. On the other hand, users who do not like the display of data broadcasting or broadcast cooperation applications to be displayed superimposed on the video of the broadcast program may view the video of the broadcast program displayed on the video display section 173 of the broadcast receiving device 100 as is. can. In addition, by linking a broadcast receiving device with multiple head-up display type mobile information terminals, users can select different data broadcasts or broadcast cooperation applications for each mobile information terminal worn by the user, for example, subtitles for movies. Users can view data broadcasts or broadcast cooperation applications according to their preferences, such as selecting and viewing a display in a different language for each user.

As described in Examples 6 to 8 above, by using a head-mounted display type mobile information terminal, the user can watch the video displayed on the broadcast receiving device 100 and the video displayed on the mobile information terminal 700. can be viewed without changing the viewpoint significantly. In addition, the position of the virtual image on the cooperative control application screen displayed on the display unit 741 of the mobile information terminal 700 is always set in a predetermined relationship in conjunction with the position of the image displayed on the video display unit 173 of the broadcast receiving device 100. Through this control, even if the user moves a little, the video displayed on broadcast receiving device 100 and the video displayed on mobile information terminal 700 can always be displayed in an easy-to-see manner.

In addition, if you take your line of sight away from the broadcast receiving device while watching a program, when the frame of the screen moves out of your field of view and becomes unrecognizable, it will be assumed that you are looking at something else, and you should move your phone so that it does not obstruct your view. You may decide to turn off the image on the information terminal. In this case, the video of the mobile information terminal may be displayed when the user's line of sight returns to the broadcast receiving device and the frame of the screen can be recognized again.

In addition, in a head-mounted display type mobile information terminal, the display of the basic screen of the cooperative control application in S418 of FIGS. 21 and 24A and S506 of FIG. 24B is not limited to the example of FIG. 10A or 10B, but is Various changes can be made depending on the size of the display area of the display section 741, the display resolution, etc. For example, as shown in FIG. 10B, a cooperative control message and a cooperative control application operation screen may be displayed on the display unit 741. Alternatively, a cooperative control message may be displayed on the display section 741, and the remote control may be operated by voice input from the voice input section 753. Furthermore, in a mobile information terminal configured with a head-mounted display unit and a terminal unit in a separate housing connected wirelessly or by wire, a cooperative control message is displayed on the head-mounted display unit, and the remote control display and/or in FIG. 10A are displayed. Alternatively, the operation may be performed using a terminal unit in a separate casing.

In the seventh and eighth embodiments described above, a mode was described in which a mark for detecting a video display frame is displayed in a superimposed manner within the video display area for the broadcast screen. On the other hand, a configuration may be adopted in which a separate display section for displaying the mark is provided separately from the video display area for the broadcast screen. By providing the other display units around the four corners of the video display frame for the broadcast screen, the video display frame detection process described in Example 7 and Example 8 can be realized without blocking the broadcast screen. . Further, in this configuration, the mark displayed on the separate display unit may be displayed using normal visible light, but the separate display unit may be configured as an infrared display unit. When the other display section is configured as an infrared display section, the first image input section 743, which is a camera unit of the head-mounted display type portable information terminal shown in FIG. 20, may be configured to be capable of infrared imaging. For example, this can be achieved by mounting an image sensor having both RGB pixels capable of capturing visible light images and IR pixels capable of capturing infrared images. Furthermore, both a camera unit having an RGB pixel image sensor capable of capturing visible light images and a camera unit having an IR pixel image sensor capable of infrared image capturing may be installed in a head-mounted display type portable information terminal. In this way, when a mark for detecting a video display frame is displayed on the infrared display section of the broadcast receiving device 100, the user does not recognize the mark itself because the mark is displayed in infrared light. . This allows the user to more appropriately view the video being displayed on the broadcast receiving device 100 and the video being displayed on the mobile information terminal 700.

Examples of the embodiments of the present invention have been described above using Examples 1 to 8, but it goes without saying that the configuration for realizing the technology of the present invention is not limited to the above-mentioned examples, and various modifications may be made. Conceivable. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these belong to the scope of the present invention. Further, the numerical values, messages, etc. that appear in the text and figures are merely examples, and the effects of the present invention will not be impaired even if different values are used.

Some or all of the functions of the present invention described above may be realized by hardware, for example, by designing an integrated circuit. Alternatively, the functions may be realized by software by having a microprocessor unit or the like interpret and execute operating programs for realizing the respective functions. Hardware and software may be used together.

Note that the software for controlling the broadcast receiving apparatus 100 may be stored in advance in the ROM 103 and/or the storage unit 110 of the broadcast receiving apparatus 100 at the time of product shipment. It may also be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 121 after the product is shipped. Further, the software stored in a memory card, an optical disk, or the like may be acquired via the expansion interface unit 124 or the like. Similarly, the software for controlling the mobile information terminal 700 may be stored in advance in the ROM 703 and/or the storage unit 710 of the mobile information terminal 700 at the time of product shipment. It may also be acquired from another application server 500 or the like on the Internet 200 via the LAN communication unit 721 or the mobile telephone network communication unit 722 after the product is shipped. Further, the software stored in a memory card, an optical disk, or the like may be acquired via the expansion interface section 724 or the like.

Further, the control lines and information lines shown in the figures are those considered necessary for explanation, and do not necessarily show all control lines and information lines on the product. In reality, almost all components may be considered to be interconnected.

100: Broadcast receiving device, 100a: Antenna, 101: Main control unit, 102: System bus, 103: ROM, 104: RAM, 110: Storage unit, 121: LAN communication unit, 124: Expansion interface unit, 125: Digital interface section, 131: tuner/demodulation section, 132: first separation section, 133: first video decoding section, 134: first audio decoding section, 135: first subtitle decoding section, 141: data broadcast reception processing section, 142: Data broadcasting engine, 151: Streaming reception processing section, 152: Second separation section, 153: Second video decoding section, 154: Second audio decoding section, 155: Second subtitle decoding section, 161: Application control section, 162: Application engine, 171: video superimposition unit, 172: audio selection unit, 173: video display unit, 174: speaker, 175: video output unit, 176: audio output unit, 181: presentation synchronization control unit, 191 terminal cooperation control unit,
200: Internet, 210: Router device,
300t: radio tower, 300: broadcast station server, 301: main control unit, 302: system bus, 304: RAM, 310: storage unit, 321: LAN communication unit,
400: Service provider server, 401: Main control unit, 402: System bus, 404: RAM, 410: Storage unit, 421: LAN communication unit,
500: Other application servers, 600: Mobile telephone communication server, 600b: Base station,
700: Mobile information terminal, 701: Main control unit, 702: System bus, 703: ROM, 704: RAM, 710: Storage unit, 720: Communication processing unit, 721: LAN communication unit, 722: Mobile telephone network communication unit , 723: NFC communication section, 724: expansion interface section, 730: operation section, 740: image processing section, 741: display section, 742: image signal processing section, 743: first image input section, 744: second image input unit, 750: audio processing unit, 751: audio output unit, 752: audio signal processing unit, 753: audio input unit, 760: sensor unit, 761: GPS receiving unit, 762: gyro sensor, 763: geomagnetic sensor, 764: Acceleration sensor, 765: Illuminance sensor, 766: Proximity sensor

Claims (8)

A mobile information terminal capable of displaying information or images in a user's field of view in cooperation with an external image display device,
an imaging unit that captures an image in the viewing direction;
a control unit that detects the position of a video display screen frame of the external video display device based on the imaging result of the imaging unit;
a display section that displays information or images;
Equipped with
The control unit further causes a background image to be added to an area of the display unit that is outside an area corresponding to a video display screen frame of the detected external video display device and excludes an area where the information or video is displayed . controlling to display an image having a brightness that reduces recognition;
Mobile information terminal. A mobile information terminal capable of displaying information or images in a user's field of view in cooperation with an external image display device,
an imaging unit that captures an image in the viewing direction;
a control unit that detects the position of a video display screen frame of the external video display device based on the imaging result of the imaging unit;
a display section that displays information or images;
Equipped with
The control unit further causes a background image to be added to an area of the display unit that is outside the area corresponding to the video display screen frame of the detected external video display device and excludes the area where the information or video is displayed . control to display images that degrade recognition;
Mobile information terminal. In the portable information terminal according to claim 1 or claim 2,
The information or video displayed on the display unit is information or video based on a broadcast cooperation application that cooperates with the broadcast program displayed on the external video display device.
Mobile information terminal. The mobile information terminal according to claim 3,
The control unit displays information or video based on the broadcast cooperation application at a position within the display unit that is outside the video display screen frame and always has a predetermined positional relationship with the position of the video display screen frame. control to display,
Mobile information terminal. The mobile information terminal according to claim 3,
The control unit displays information or video based on the broadcast cooperation application at a position within the display unit that is inside the video display screen frame and always has a predetermined positional relationship with the position of the video display screen frame. control to display,
Mobile information terminal. The portable information terminal according to any one of claims 1 to 5 is a head mounted display configured to be mounted on a user's head.
Mobile information terminal. A display method for a mobile information terminal that displays information or images in a user's viewing direction in cooperation with an external image display device, the method comprising:
an imaging step of imaging the viewing direction using an imaging unit of the mobile information terminal;
a control step in which a control unit of the mobile information terminal detects a position of a video display screen frame of the external video display device based on the imaging result of the imaging step;
a display step of displaying information or images on a display unit of the mobile information terminal;
Equipped with
In the displaying step, further, an area of the display unit that is outside the area corresponding to the video display screen frame of the external video display device detected in the control step and excluding the area where the information or video is displayed is displayed. , controlling to display an image having a brightness that reduces background recognition;
Display method. A display method for a mobile information terminal that displays information or images in a user's viewing direction in cooperation with an external image display device, the method comprising:
an imaging step of imaging the viewing direction using an imaging unit of the mobile information terminal;
a control step in which a control unit of the mobile information terminal detects a position of a video display screen frame of the external video display device based on the imaging result of the imaging step;
a display step of displaying information or images on a display unit of the mobile information terminal;
Equipped with
In the displaying step, further, an area of the display unit that is outside the area corresponding to the video display screen frame of the external video display device detected in the control step and excluding the area where the information or video is displayed is displayed. , display images that reduce background recognition,
Display method.

Images