JP2013009359A - Broadcasting communication cooperation reception device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve convenience of a user of a device by adding a function relating to synchronization control which delays a broadcasting stream more than a communication stream inside the device.SOLUTION: A broadcasting communication cooperation reception device 6 which receives a digital broadcasting program as a broadcasting stream and receives an application operating in the device from a communication network N as a communication stream comprises: composite display means 614 for performing synchronization control of synchronizing the broadcasting stream and the communication stream inside the device, and outputting them to output means 630 for presenting video and voice; delay presentation control means 740 for starting delay presentation of the broadcasting stream when acquiring the application during normal presentation of the broadcasting stream; delay time amount acquisition means 750 for acquiring the difference between time of presenting the broadcasting stream during the delay presentation and presentation time during the normal presentation as a delay time amount; and communication transmission/reception means 606 for transmitting the acquired delay time amount to a server managed by a broadcasting station.

Description

  The present invention relates to a broadcasting / communication cooperation receiving apparatus that links broadcasting and communication to synchronize a communication stream and a broadcasting stream.

  In recent years, a broadcasting / communication cooperation type system for realizing a service that links broadcasting and communication has been proposed (see Non-Patent Document 1). In this broadcasting / communication cooperation type system, the broadcasting / communication cooperation receiving apparatus is a receiver that receives a digital broadcast, and is assumed to operate an application downloaded from a communication network on the apparatus.

  In addition, the broadcasting / communication cooperation receiving apparatus includes a broadcast content (broadcast stream) such as a program acquired by a broadcast wave, and a communication stream of content (communication content) such as video, audio, caption, or metadata acquired from a communication network. It is necessary to synchronize. In general, a broadcast wave is transmitted in a stable and accurate time, whereas in a transmission by communication such as an IP (Internet Protocol) network, the time of arrival at a receiving device varies due to packet delay or the like. For this reason, in a broadcasting / communication cooperation receiving apparatus, the communication stream is often delayed from the broadcasting stream. Therefore, in this case, by performing synchronization control that delays the broadcast stream inside the apparatus, the service is provided at the timing intended by the transmission side.

  The synchronization control for delaying the broadcast stream inside the broadcast communication cooperative receiving apparatus is called delay control. The delay control is described in Non-Patent Document 1, for example. In the method described in Non-Patent Document 1, for example, presentation time information PTS (Presentation Time) that refers to a broadcast clock reference clock (for example, a PCR (Program Clock Reference) of MPEG2-TS) in a network server that distributes communication content. Stamp) is added to the communication content. As a result, the broadcasting / communication cooperation receiving apparatus can delay the broadcasting content for a predetermined time by a sufficient time to absorb the delay variation of the communication content, and can present the content in synchronization with high accuracy.

Junji Matsumura and two others, “Examination of personalized system for broadcasting programs linked to Internet distribution information”, Proceedings of Annual Conference of the Institute of Image Information and Television Engineers, 2009, No. 3-8

  In a broadcasting / communication cooperation type system, assuming that the broadcasting / communication cooperation receiving device performs synchronization control, the related control is added to the synchronization control to enhance the function of the receiving device, and more services with rich contents are provided. It is desired to be able to provide it to viewers of For example, a digital broadcast program (broadcast stream) is a program that requires time management according to the program progress, such as a viewer-participation-type quiz program, and the communication content (communication stream) returns a quiz response. As an example, it is assumed that a service such as an answer pad for inputting is displayed on the screen in conjunction with a program only within the time limit for answering a quiz.

  In general, it is inevitable that the arrival times of communication contents (communication streams) acquired from a communication network are different in digital broadcast receivers installed in homes nationwide. Therefore, depending on the installation location of the broadcasting / communication cooperation receiving apparatus, as a result of executing the delay control of the synchronization control, for example, it may be possible that the answer pad is displayed for a significantly shorter time than the time assumed on the service provider side. . In this example, for example, if the delay time of the communication stream is sufficiently small with respect to the time limit for answering the quiz, the difference can be ignored, but if this is not the case, the viewer may feel uncomfortable or unfair. Become. Therefore, there is a demand for a mechanism that allows many viewers to welcome and use a service with synchronization control even for such a broadcast program that requires time management in accordance with the progress of the program.

  The present invention has been made in view of the above-described problems. In order to synchronize the communication stream and the broadcast stream, the synchronization control is performed when control is performed to delay the broadcast stream from the communication stream inside the apparatus. It is an object of the present invention to provide a broadcasting / communication cooperation receiving apparatus that can improve the convenience of the user of the apparatus by adding a function related to the above.

  In order to solve the above-mentioned problems, the broadcasting / communication cooperation receiving apparatus according to claim 1 of the present invention receives a digital broadcast and outputs it to an output means for presenting video and audio and operates on the apparatus. A broadcast communication cooperative receiving apparatus that acquires an application to be performed from a communication network, wherein the broadcast receiving means, application activation information storage means, communication receiving means, composite display means, delay presentation control means, and delay time amount acquisition means And a communication transmission means.

According to such a configuration, the broadcasting / communication cooperation receiving apparatus receives, as a broadcasting stream, the broadcasting program transmitted by the broadcasting wave of the digital broadcasting by the broadcasting receiving unit. The broadcasting / communication cooperation receiving apparatus stores application activation information for activating the application linked to the broadcast program in the application activation information storage unit. The broadcasting / communication cooperation receiving device receives the application as a communication stream from the communication network based on the application activation information by the communication receiving unit, and combines and displays the communication stream and the broadcast stream in the device by the composite display unit. The synchronous control to synchronize is performed and output to the output means. Then, the broadcast communication cooperative receiving device performs the synchronization control at a predetermined timing triggered by an external operation or an external control signal when the received broadcast stream is normally presented by the delay presentation control means. The broadcast stream is presented in a delayed manner by instructing the composite display means to start control for delaying the presentation time from the presentation time when the broadcast stream is normally presented in the device. Then, the broadcasting / communication cooperation receiving device uses the delay time amount acquisition unit to provide the presentation time of the broadcast stream during the delay presentation and the presentation time of the broadcast stream when the normal presentation is performed without performing the delay presentation. Is obtained as a delay time amount, and the obtained transmission delay amount is transmitted to a server managed by a broadcasting station via a communication network by a communication transmitting means.
According to this, in a plurality of broadcast communication cooperative receiving apparatuses, a broadcast stream that requires time management in accordance with the progress of the program, such as a viewer participation type quiz program, is presented in conjunction with such a program. By letting the broadcast station know in advance the amount of delay time when the communication stream is synchronized, each viewer can consider the amount of delay time that is different among the plurality of receiving devices on the broadcast station side. It is possible to multiplex a message or the like indicating that measures to prevent the disadvantage are taken with the control signal of the broadcast content and transmit it to each receiving device.

  Further, the broadcast communication cooperative reception device according to claim 2 is the broadcast communication cooperation reception device according to claim 1, further comprising an application activation information extraction unit.

  According to such a configuration, the broadcasting / communication cooperation receiving apparatus extracts the application activation information for the application linked to the broadcast program from the control signal multiplexed in the broadcast stream by the application activation information extraction unit, and Store in the application activation information storage means. Then, the broadcast communication cooperative receiving apparatus instructs the delay presentation control means to start control for delaying the broadcast stream after the communication receiving means acquires the application. According to this, since the acquired application can be automatically activated by the application activation information, the delay presentation can be started without the viewer performing a special operation with this configuration.

  Also, in the broadcast communication cooperative reception device according to claim 3, the broadcast communication cooperation reception device according to claim 2, wherein the communication reception unit further transmits a content linked to the application as a communication stream from a communication network. The delay presentation control means gives an instruction to start control of delaying the broadcast stream at the timing when the content is acquired by the communication receiving means.

  According to such a configuration, the broadcast communication cooperative receiving apparatus instructs the start of control for delaying the broadcast stream when acquiring the content linked to the application after acquiring the application. Even if it takes time for some reason before the content can be acquired from the communication network, the broadcast stream can usually be presented during that time.

  According to the first aspect of the present invention, the broadcasting / communication cooperation receiving apparatus acquires, as a delay time amount, a difference between the presentation time of the broadcast stream being delayed and the presentation time of the broadcast stream being normally presented. Since the function of notifying the station is provided, it is possible to take measures to improve the convenience of the user on the broadcast station side by notifying the broadcast station of the amount of delay time. Therefore, it is possible to improve the convenience of the user of the device by informing the broadcast station in advance of the amount of delay time and then receiving the broadcast stream for which the broadcast communication cooperation receiving device has taken measures. it can.

  According to the second aspect of the present invention, the broadcasting / communication cooperation receiving apparatus can automatically start the acquired application with the application activation information, so that the viewer can start the delayed presentation without performing a special operation. Therefore, the convenience of the user of the device can be improved.

  According to the third aspect of the present invention, the broadcast communication cooperative receiving apparatus normally presents a broadcast stream during the time it takes to obtain the content from the communication network after acquiring the application. Therefore, the convenience of the user of the device can be improved.

It is a figure which shows an example of a structure of the broadcast communication cooperation type system containing the broadcast communication cooperation receiving apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the application for broadcast communication cooperation displayed on the broadcast communication cooperation receiving apparatus which concerns on embodiment of this invention. It is a sequence diagram which shows an example of a flow when a recommendation service is provided to the broadcast communication cooperation receiving apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structural example of the broadcast communication cooperation receiving apparatus which concerns on embodiment of this invention. It is a timing chart of the comparative example which does not use the amount of delay time in a broadcast station, (a) is a broadcast content transmission timing, (b) is a reception timing when synchronization control is not performed, and (c) is when synchronization control is performed , (D) indicates the time. It is a timing chart in case the amount of delay time which the broadcast communication cooperation receiver which concerns on embodiment of this invention acquires is used in a broadcast station, Comprising: (a) shows the transmission timing of broadcast content, (b) shows time, respectively. Yes. It is a sequence diagram which shows the flow of the delay presentation process by the broadcast communication cooperation receiving apparatus which concerns on embodiment of this invention.

  Hereinafter, a mode for carrying out the broadcasting / communication cooperation receiving apparatus of the present invention will be described. Broadcast / communication cooperation system, 2. 2. Screen display example of a broadcasting / communication cooperation receiving apparatus; 3. Example of operation sequence between each server and broadcasting / communication cooperation receiving apparatus 4. Configuration of broadcasting / communication cooperation receiving apparatus; 5. Outline of broadcasting station processing using delay time amount, This will be described in detail with reference to the drawings in each chapter of the specific example of the flow of the delay presentation process.

[1. Broadcast / communication system]
A conceptual diagram of the configuration of the broadcasting / communication cooperation type system 1 is shown in FIG. As shown in FIG. 1, the broadcasting / communication cooperation type system 1 functionally includes a broadcasting station server group 4, a service provider server group 5, in addition to a broadcasting station 2 that performs current broadcasting using radio waves. And a broadcasting / communication cooperation receiving device 6. In FIG. 1, one broadcasting station 2, one broadcasting station server group 4, one service provider server group 5, and one broadcasting / communication cooperation receiving device 6 are illustrated, but there may be a plurality of each.

<Overview of users>
The main users of the broadcasting / communication cooperation type system 1 are, for example, broadcasting stations (broadcasting companies), service providers, and viewers.
The broadcasting station sends out a program accompanied by organization. Broadcast stations distribute programs to viewers by radio waves or the Internet. The broadcast station may provide the service provider with metadata related to the program in order to enhance the broadcast communication cooperation service described later.
A service provider is a person who provides a broadcasting / communication cooperation service, and is composed of an organization or an individual. A service provider is a person who produces or distributes content or an application (broadcast communication cooperation application, hereinafter also simply referred to as an application) for providing a service.
The viewer is a person who views the broadcast program by the broadcast communication cooperative receiving device 6 and enjoys the broadcast communication cooperative service. Hereinafter, the user refers to this viewer.

<Service>
Conventionally, a service refers to a series of programs that can be broadcast as part of a schedule organized by a broadcaster.
The broadcasting / communication cooperation service is an extension of the service concept in the conventional sense.
The broadcasting / communication cooperation service is apparently divided into a stream dependent service and an independent service.
The stream-dependent service includes an AV (Audio Video) stream transmitted by broadcasting or communication, and at least one application (broadcast communication cooperation application) that operates in conjunction therewith. In this stream-dependent service, an application can be started in conjunction with selection / reproduction of an AV stream to be transmitted by communication or channel selection of an AV stream to be transmitted by broadcast on the user side. In this case, in addition to activation and termination by the user, a provider of AV content such as a broadcaster can also control a life cycle such as automatic activation and termination of the application.

  The stand-alone service includes a real video / audio stream and includes at least one application (broadcast communication cooperation application). In this stand-alone service, an application is started by performing an operation selected by the user. Here, an application in an independent service (hereinafter referred to as an independent application) is, for example, an application created by a third party such as an individual who is not a broadcast station or a viewer regardless of a broadcast program, and a clock displayed on a display Etc. When the independent application is approved by the system administrator, it may be an authorized application (hereinafter simply referred to as A application) indicating that the independent application is approved. In this case, the A application is registered in the repository indicating the application accumulation location, and the repository position is known to the broadcasting / communication cooperation receiving apparatus 6.

  Even in the stand-alone service, when the broadcasting / communication cooperation receiving device 6 is powered on, the broadcasting / communication cooperation receiving device 6 is provided with a virtual channel for virtually receiving a virtual video / audio stream. When it is conceptually regarded as being, the broadcasting / communication cooperation service can be considered as a service (also referred to as a virtual service in this sense) that integrates a stream dependent service and an independent service.

<Broadcasting station>
The broadcast station 2 sends out broadcast content by broadcast waves, for example. The broadcasting station 2 can multiplex a signal for activating a broadcasting / communication cooperation service on a broadcasting wave.
In this embodiment, as an example, on the broadcast content transmission side, an application activation information file (hereinafter referred to as an APL activation information file) is transmitted by a specific module transmitted by the data carousel method. APL activation information is information necessary to activate an application. The APL activation information can be created based on, for example, an AIT (Application Information Table) defined by ARIB-J (ARIB STD-B23). For example, in the broadcasting / communication cooperation receiving apparatus 6 that has received the APL activation information described as “AUTO START”, the viewer can activate the application without performing a special operation for activating the application. When the APL activation information is filed as in this embodiment, it can be expressed in text format in XML format. In addition, when it is set as the form transmitted in the table | surface of SI (Service Information: Program arrangement | sequence information), APL starting information can be made into binary expression.

<Broadcasting station server group>
The broadcasting station (broadcasting company) configures and manages the broadcasting station server group 4 or both of the broadcasting station server group 4 and the service provider server group 5. That is, a broadcasting station (broadcasting company) may also serve as a service company.
As shown in FIG. 1, the broadcast station server group 4 includes a content management server 41, a user management server 42, a content distribution server 43, a broadcast station service server 44, a DB 45, and an API 46.

The content management server 41 manages programs and metadata. The program management function of the content management server 41 is a function for managing a program that has already been broadcast or a program that will be broadcast in the future. You may make it provide the program management server which performs only this program management.
The metadata management function of the content management server 41 is a function for managing metadata related to a program. You may make it provide the metadata management server which performs only this metadata management. Here, the metadata indicates, for example, a program title, a program ID, a program summary, performers, broadcast date and time, script, subtitles, commentary, and the like.

  The user management server 42 is a server that manages viewer data. The user management server 42 may be configured by a specific server such as a member information server for a specific viewer who has become a member such as a net club, or may be included in a part of the management function of the content management server 41. May be configured.

The content distribution server 43 is a server for distributing content (for example, programs and metadata).
The broadcast station service server 44 is a server used when a broadcast station (broadcaster) provides a service to a service provider. Examples of services provided by broadcast stations (broadcasters) to service providers include social network services operated by broadcast stations, blog services for each broadcast program, and the like.

  The DB 45 is a data storage unit, and includes a part for storing content and metadata owned by a broadcasting station, and a general database. Note that the data stored in the DB 45 can be accessed only by the managing company (broadcasting company) and cannot be accessed by others.

  An API (Application Programming Interface) 46 is an API for providing data in response to a request from the service provider server group 5. The API format is determined in advance by agreement between the broadcasting station and the service provider. Communication between the broadcast station server group 4 and the service provider server group 5 can be in a REST (Representational State Transfer) format, for example. The API 46 is commonly provided by the servers included in the broadcasting station server group 4, but the API provided by each server does not have to be completely the same.

<Service provider server group>
The service provider configures and manages the service provider server group 5. As shown in FIG. 1, the service provider server group 5 includes an application server 51, a service server 52, a content distribution server 53, a DB 54, and an API 55.

  The application server 51 is a server that manages and distributes an application (hereinafter also referred to as a receiver application) that operates on the broadcasting / communication cooperation receiving device 6.

  The service server 52 is a server for providing a service in response to a request from the receiver application. The service server 52 represents, for example, a multilingual subtitle server, a speech speed conversion voice server, a social TV server, a recommendation server, a program review server, a bookmark server, and the like.

The multilingual subtitle server provides a service for displaying a menu so that desired subtitles can be selected from multilinguals when video / audio content (hereinafter referred to as AV content) is presented to the broadcasting / communication cooperation receiving device 6. It is a server for.
The speech speed conversion voice server is a server for providing a service for converting the original speed of spoken language to low speed and outputting the voice when the AV content is presented to the broadcasting / communication cooperation receiving device 6.
The social TV server is a server for providing a service capable of displaying a viewer's post such as a tweet on the screen of the broadcasting / communication cooperation receiving device 6 by overlaying it.
The recommendation server is a server for providing a service that informs viewers of recommended VOD (Video On Demand) program information as a recommended program from a program library provided on the Internet.
The program review server is a server for providing a service capable of displaying on the broadcasting / communication cooperation receiving device 6 comments and impressions and review evaluation points written by viewers who actually viewed the program.
The bookmark server is a server for providing a service for registering information on recommended programs so that the viewer can view the recommended program instead of immediately viewing it when the viewer is notified of the recommended program.

The content distribution server 53 is a server for providing content in response to a request from the receiver application. The content distribution server 53 represents, for example, a VOD distribution server, a caption distribution server, a multi-view distribution server, or the like.
The VOD distribution server is a server for distributing AV contents of VOD programs recommended for viewers, for example.
The subtitle distribution server is a server for distributing subtitles that overlap the AV content when the AV content is presented to the broadcasting / communication cooperation receiving device 6.
The multi-view distribution server is a server for distributing a multi-view camera image that is displayed in an overlapping manner with the AV content presented to the broadcast communication cooperative receiving device 6. Multi-view camera images will be described later.

  The DB 54 is a data storage unit that stores content, metadata, data created by a service provider, user data, applications, and the like. Note that the data stored in the DB 54 can be accessed only by the managed service provider and cannot be accessed by others.

  The API 55 is an API for providing an application, content, and service in response to a request from the receiver application. The API 55 is different from the API 46 described above, and each server included in the service provider server group 5 is provided in common for each service provider. However, it goes without saying that the API may be different for each service provider and for each server.

<Broadcast communication cooperative receiver>
The broadcasting / communication cooperation receiving device 6 receives a digital broadcast and acquires an application operating on the device from a communication network, and includes, for example, a TV, a set top box, a PC (Personal computer), a portable terminal, and the like. Is done. The broadcasting / communication cooperation receiving device 6 includes a basic function 61, a broadcasting / communication cooperation function 62, and an API 63.

The basic function 61 includes a function of receiving and displaying current broadcasting such as terrestrial digital broadcasting, BS digital broadcasting, and data broadcasting, and a function of connecting to the Internet.
The broadcasting / communication cooperation function 62 operates based on the API 63. That is, an OS (Operating System) installed as an application execution environment in the broadcasting / communication cooperation receiving device 6 executes the predetermined API 63 to realize the broadcasting / communication cooperation function 62. The broadcast communication cooperation function 62 includes a broadcast communication cooperation basic function and an optional function.
The basic function for broadcasting / communication cooperation is a function necessary for realizing the broadcasting / communication cooperation service. The basic functions for broadcasting / communication cooperation include, for example, an application control function, a drawing function, a synchronization control function, a security function, and the like.

The application control function indicates a function as an application manager that controls a life cycle such as activation and termination of an application.
The drawing function indicates a function of drawing an application at a predetermined position on the screen of the broadcasting / communication cooperation receiving apparatus 6 presenting AV content.
The synchronization control function indicates a function of performing control to synchronize the presentation time of the AV content received in real time by broadcasting and the presentation time of the application and content acquired via the communication network N. That is, the synchronization control function compares the time stamp of the data input as the broadcast stream with the time stamp of the data input as the communication stream, and matches the predetermined point of the broadcast stream with the corresponding point of the communication stream. I do.

  The security function indicates a function for performing control to change a way of displaying an application screen according to a predetermined policy level. For example, when an application approved by the system administrator is an A application and a non-approved application is a general application other than the A application, if the application is an A application, the AV content presented to the broadcasting / communication cooperation receiving device 6 is displayed. Overlap is permitted, and if it is a general application, control is performed such that overlap is not permitted.

The optional function is implemented as necessary, and examples thereof include a function for realizing a mobile terminal cooperation service.
The mobile terminal cooperation service includes a service that simplifies the procedure for individual viewers to log in to an ASP (Application Service Provider) by linking a mobile terminal and a stationary TV for a program recommendation service, for example. Including.

  The application 64 is downloaded, for example, from the application server 51 to the broadcasting / communication cooperation receiving device 6 and uses the broadcasting / communication cooperation function 62 through the API 63. All the applications 64 cannot access functions unique to the broadcasting / communication cooperation receiving apparatus 6 without going through the API 63.

  The API 63 is defined in advance so that the operation of the application 64 is the same without depending on the broadcast communication cooperative reception device 6, and is an API common to the broadcast communication cooperative reception devices 6. Hereinafter, an example of an API used by the broadcasting / communication cooperation receiving device 6 as the API 63 other than the API defined in ARIB-J will be described.

(1) getRunningApplications (): Get information about running applications Return value:
apps []: List of running applications (each application)
application_id: Application ID (null for general applications)
running_level: Execution level (authentication result and user setting status)
(2) queryApplicationInfo (): Acquires information about the specified application (3) saveApplicationToCache (): Saves the application on the server in the cache (4) queryApplicationInCache (): Searches for the application in the cache Arguments:
application_id: Application ID issued by the certification body
(5) getCurrentSTC (): obtains the current STC value (6) getCurrentPositionInProgram (): obtains the elapsed time from the start of the program (7) delayStreamPresentation (): starts the delayed presentation of the broadcast stream being presented (8 ) GetCurrentDelay (): Get the amount of delay time (from the original presentation time) of the broadcast stream being presented

[2. Example of screen display of broadcasting / communication cooperation receiver]
Here, an example of the relationship between the broadcasting / communication cooperation service, the application, and the content, and an example of the broadcasting / communication cooperation function 62 in the broadcasting / communication cooperation receiving device 6 will be described through the screen display example shown in FIG. FIG. 2 is a diagram illustrating an example of an application displayed on the broadcasting / communication cooperation receiving device according to the embodiment of the present invention. As shown in FIG. 2A, when the viewer is watching the AV content (digital broadcast program) 100 on the broadcast / communication cooperation receiving device 6, for example, by performing a remote control operation, The main menu 101 is displayed on the screen.

In this example, a subtitle 102, a comment 103, a recommendation 104, and a bookmark 105 are displayed on the main menu 101 displayed in a horizontally long toolbar shape at the bottom of the screen.
The caption 102 is a button for selecting a service to be displayed on the menu so that a desired caption can be selected from multiple languages.
The comment 103 is a button for selecting, for example, a service for posting a tweet or a comment.
The recommendation 104 is a button for selecting a service for displaying recommended VOD program information.
The bookmark 105 is a button for selecting a service for registering recommended program information so that the recommended program can be viewed later, not immediately.

  By scrolling the main menu 101 displayed in FIG. 2A horizontally, it is possible to select other services other than the above services. Examples of other services include a multi-view service. In the multi-view service, when AV content is presented to the broadcasting / communication cooperation receiving device 6, a subject in the AV content is viewed from a plurality of camera images captured by a plurality of cameras respectively arranged at different positions. The camera image selected by the user is distributed as a multi-view camera image, and is displayed overlapping the AV content.

  FIG. 2B shows a screen display example when the multi-view service is selected by horizontally scrolling the main menu 101 displayed in FIG. Here, one multi-view service includes a multi-view button (application) (not shown) on the main menu 101, still images 106, 107, and 108, which are multi-viewer selection data, and a multi-view video 109 (FIG. 2 ( c)). Among these, still images and moving image content are distributed from a multi-view distribution server as the content distribution server 53.

  In the example shown in FIG. 2B, the AV content 100 represents a state around the soccer goal viewed from the attack side in the soccer game. Further, the still image 106 shows a state of an attack side supporter in the auditorium, the still image 107 shows a state of supervision of the attacking team, and the still image 108 shows a state of the front of the goalkeeper. Here, when the viewer selects, for example, the still image 108, the video in front of the corresponding goalkeeper overlaps with a part of the entire display screen of the AV content 100 as shown in FIG. Are displayed as a moving image 109 synchronized with the AV content 100 and reproduced.

  The synchronization of the video in front of the goalkeeper and the video (AV content 100) around the soccer goal viewed from the attacking side is due to the broadcast communication cooperation function 62 of the broadcast communication cooperation reception device 6. Specifically, this is based on the synchronization control function as the basic function for broadcasting / communication cooperation of the broadcasting / communication cooperation function 62. An application operating on the broadcasting / communication cooperation receiving device 6 can use the broadcasting / communication cooperation function 62 (see FIG. 1) by calling, for example, getCurrentSTC () or delayStreamPresentation () as an API.

[3. Example of operation sequence between each server and broadcasting / communication cooperation receiving apparatus]
Here, an example of the relationship between the broadcasting / communication cooperation service, the application, and the content, and an example of the broadcasting / communication cooperation function 62 in the broadcasting / communication cooperation receiving device 6 will be described through the operation sequence example shown in FIG. FIG. 3 is a sequence diagram illustrating an example of a flow when a recommendation service is provided to the broadcast communication cooperative reception device according to the embodiment of the present invention.

  When the recommendation 104 is selected by the viewer from the main menu 101 displayed in FIG. 2A, illustration is omitted, but as the type of recommendation, for example, “recommended program related to the program currently being viewed” , “Recommended programs for you”, “Topic programs on the net”, “Programs that are popular on the net” are displayed, and information on the corresponding programs can be selected by scrolling for each item. . In this state, when the viewer selects, for example, “recommended program related to the program currently being viewed”, the broadcasting / communication cooperation receiving apparatus 6 requests the service provider server group 5 to request the recommended program. (S1).

  Then, the service provider server group 5 requests the interface section (API 46: see FIG. 1) of the broadcast station server group 4 for a “recommended program related to the program currently being viewed” by the viewer (see FIG. 1). S2). Then, the broadcasting station server group 4 transmits the corresponding recommended program (recommended program) and the like to the service provider server group 5 (S3). Then, the service provider server group 5 transmits the requested data (recommended program) or the like to the broadcasting / communication cooperation receiving device 6 (S5). The service provider server group 5 can also transmit to the broadcasting / communication cooperation receiving device 6 as necessary when there is an application (linked application) linked to the requested data (recommended program) (S4). .

  The above flow is an example, and the present invention is not limited to operating in the order described above. Further, there may be a case in which communication is performed only between the broadcasting / communication cooperation receiving device 6 and the service provider server group 5. For example, the service provider server group 5 may acquire necessary content from the broadcast station server group 4 in advance.

  In addition, for example, when the broadcast communication cooperative reception device 6 acquires an application from communication each time the application is executed (when acquired on the fly), an application server based on information multiplexed on the received broadcast wave An application request is made to the service provider server group 5 such as 51 (S1). Then, in the service provider server group 5, in response to a request from the broadcast communication cooperative reception device 6, the application server 51 notifies the broadcast communication cooperative reception device 6 of the storage location of the application and transmits the application (S4). Then, when the application is downloaded, the broadcasting / communication cooperation receiving device 6 activates and executes the application, requests content from the service provider server group 5 such as the content distribution server 53 (S1), and acquires the content ( S5).

[4. Configuration of broadcast communication cooperative receiver]
In addition to the tuner, the broadcasting / communication cooperation receiving device 6 includes, for example, an arithmetic device such as a CPU (Central Processing Unit), a storage device such as a memory and a hard disk, and an interface device that transmits and receives various types of information to and from the outside. As shown in FIG. 4, broadcast receiving means 601, broadcast signal analyzing means 602, video / audio decoding means 603, data broadcast decoding means 604, APL activation information storage means 605, communication transmitting / receiving means 606, APL activation information acquisition means 607, list control means 608, application control means 609, application storage means 610, application acquisition means 611, application cache 612, application execution means 613, and composite display means 614 I have.

  Here, if each of the means 601 to 614 is classified into only one of the basic function 61 of the broadcasting / communication cooperation receiving device 6 and the broadcasting / communication cooperation function 62 shown in FIG. A broadcast receiving means 601, a broadcast signal analyzing means 602, a video / audio decoding means 603, a data broadcast decoding means 604, and a communication transmitting / receiving means 606 are provided, and the broadcast communication cooperation function 62 is an APL activation information storage means 605. APL activation information acquisition means 607, list control means 608, application control means 609, application storage means 610, application acquisition means 611, application cache 612, application execution means 613, and composite display means 614 . However, this is an example, and it cannot be simply separated.

  The broadcast receiving means 601 receives digital broadcast content (program data) transmitted by broadcast waves as a broadcast stream via an antenna ATN, and is a general digital broadcast tuner. The broadcast receiving unit 601 outputs the received / demodulated broadcast content to the broadcast signal analyzing unit 602.

  The broadcast signal analyzing unit 602 separates the video / audio stream, the SI (program arrangement information), and the data broadcast content multiplexed in the broadcast content received by the broadcast receiving unit 601, of which the video / audio stream is In addition to outputting to the video / audio decoding unit 603, the data broadcast content is output to the data broadcast decoding unit 604. Here, the SI is processed into a program table by a program table generating unit (not shown), and is presented to the output unit 630 via the composite display unit 614 when the user operates the operation input unit 620 such as a remote controller. . Note that the broadcast signal analysis unit 602 can switch the channel to be presented by a channel switching instruction from the operation input unit 620. Here, the output unit 630 presents video and audio, and includes a display monitor such as a liquid crystal display, a speaker, and the like.

  The video / audio decoding unit 603 decodes the video / audio stream separated by the broadcast signal analysis unit 602. When the video / audio is encoded by, for example, the MPEG2 encoding method, the video / audio decoding unit 603 outputs the video / audio data in an output format that can be decoded and displayed to the composite display unit 614. Output.

  The data broadcast decoding unit 604 decodes the data broadcast content separated by the broadcast signal analysis unit 602. The data broadcast decoding unit 604 has a function of extracting a file from a module transmitted by the data carousel method of data broadcasting, and the data broadcast content. And a BML browser function for browsing. The data broadcast decoding unit 604 outputs the decoded data broadcast content to the composite display unit 614.

  In the present embodiment, the data broadcast decoding unit 604 extracts the APL activation information file from the specific module transmitted by the data carousel method, and stores it in the APL activation information storage unit 605. In this sense, in this embodiment, the data broadcast decoding unit 604 functions as an application activation information extraction unit. That is, the data broadcast decoding unit 604 extracts APL activation information for an application linked to the broadcast program from the control signal multiplexed in the broadcast stream, and stores it in the APL activation information storage unit 605. Of course, the application activation information extraction means may be provided separately, or other means may also serve. In addition, when the APL activation information file is updated, the data broadcast decoding unit 604 notifies the application control unit 609 to that effect.

  The APL activation information storage unit 605 stores APL activation information, and includes, for example, a general memory such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and a storage device such as a hard disk. Here, the APL activation information is information for activating the application on the broadcasting / communication cooperation receiving device 6, and includes, for example, an application identifier (ID), an application location (location address such as a URL), and the like. Information for specifying the application and additional information for controlling the application. This APL activation information is extracted by the data broadcast decoding means 604 or acquired by the APL activation information acquisition means 607.

  In the present embodiment, the APL activation information storage unit 605 also stores a list of identification information (activation application identification information) of applications being activated on the broadcasting / communication cooperation receiving device 6. This activated application identification information is created by the application control means 609.

The communication transmitter / receiver 606 transmits / receives communication data to / from the service provider server group 5 via the communication network N, and is, for example, a communication control board.
The communication transmission / reception unit 606 receives an application as a communication stream from the communication network N based on the application activation information under the control of the application acquisition unit 611.
In the present embodiment, when there is content linked to the application acquired from the communication network N, the communication transmitting / receiving unit 606 further acquires the content from the communication network N as a communication stream.
In the present embodiment, the communication transmitting / receiving unit 606 transmits the delay time amount acquired by the delay time amount acquiring unit 750 described later to any server in the broadcast station server group 4 via the communication network N. It was. Details will be described later.

  The APL activation information acquisition unit 607 acquires APL activation information from a known URL via the communication transmitting / receiving unit 606 and the communication network N, and stores it in the APL activation information storage unit 605. In the present embodiment, when the user performs an operation of selecting an application, the APL activation information acquisition unit 607 transmits the APL activation information about the application to a known URL via the communication transmission / reception unit 606 and the communication network N. And stored in the APL activation information storage means 605.

  Further, when the APL activation information acquisition unit 607 receives an APL activation information rewrite instruction from the application acquisition unit 611, the APL activation information storage unit 605 stores the corresponding APL activation information (external The location address (URL) described in the APL activation information related to the application according to the operation is rewritten to the memory address in the application storage means 610 in the broadcast communication cooperative reception device 6. In this sense, in this embodiment, the APL activation information acquisition unit 607 functions as a location address rewriting unit. Of course, the location address rewriting means may be provided separately, or other means may also be used. The application storage unit 610 indicates a disk device such as a hard disk.

  Based on the APL activation information stored in the APL activation information storage unit 605, the list control unit 608 uses a list of applications that can be used in the broadcasting / communication cooperation receiving device 6 as an application list (hereinafter simply referred to as a list). Created and output to the composite display means 614. This list control means 608 can be realized by, for example, a resident application launcher. The list control unit 608 can display a list to be presented by a list display / selection instruction from the operation input unit 620 and can accept the selection operation. Here, an application that operates on the broadcasting / communication cooperation receiving apparatus 6 can use the function of the list control unit 608 (broadcasting / communication cooperation function 62: see FIG. 1) by calling, for example, getRunningApplications as an API.

  Note that the launcher is not a broadcast communication cooperation application acquired through communication. This launcher may be installed in advance in the application storage unit 610 or the like at the time of shipment, for example. In the present embodiment, the list control unit 608 excludes applications that are performing background processing from the list among applications that can be used in the broadcasting / communication cooperation receiving device 6.

  The application control unit 609 is an application manager that controls a life cycle such as activation and termination of an application. The activation control unit 710, the termination control unit 720, the accumulation management unit 730, the delay presentation control unit 740, and the delay Time amount acquisition means 750.

The activation control unit 710 controls the activation of the application.
The activation control means 710 is an application loaded in a memory when the application to be activated is a linked application linked to a digital broadcast program and “AUTO START” is described in the APL activation information. Start and start.
The activation control unit 710 activates the application according to the user's operation when “AUTO START” is not described in the APL activation information of the application to be activated.
When “PRESENT” is described in the APL activation information, the activation control unit 710 maintains the state (standby) loaded in the memory if the application is not activated, and pauses if the application is operating In a state of being loaded into the memory (standby).

The end control means 720 controls the end of the application.
When “DESTROY” is described in the APL activation information, the termination control means 720 performs post-processing necessary to terminate the application whose life cycle is controlled by the APL activation information, and then executes the application. finish.
When “KILL” is described in the APL activation information, the termination control unit 720 forcibly terminates the application whose life cycle is controlled by the APL activation information.
When “KILL ALL” is described in the APL activation information, the termination control means 720 is not limited to the application whose life cycle is controlled by the APL activation information, and is linked to broadcasting / communication regardless of linked / non-linked. All applications running on the receiving device 6 are forcibly terminated.
The termination control means 720 can terminate the application in accordance with the user operation.

The accumulation management unit 730 controls writing, reading, and erasing as processing related to application accumulation. The accumulation management unit 730 writes the conjunction application acquired by the application acquisition unit 611 in the application cache 612. Here, the application cache 612 indicates a cache memory.
Here, an application that operates on the broadcasting / communication cooperation receiving device 6 may use the function of the storage management unit 730 (broadcasting communication cooperation function 62: see FIG. 1) by calling, for example, saveApplicationToCache () as an API. it can.

  Further, the accumulation management unit 730 searches whether the application is stored in the application cache 612. Note that an application running on the broadcasting / communication cooperation receiving device 6 can use the function of the storage management means 730 (broadcasting communication cooperation function 62: see FIG. 1) by calling, for example, queryApplicationInCache () as an API. .

  Further, when the storage management unit 730 determines that no application is stored in the application cache 612, the storage management unit 730 controls the application acquisition unit 611 to acquire the application. The accumulation management unit 730 determines that the application is not stored when the cache hit does not occur, and determines that the application is stored when the cache hit occurs.

  The delay presentation control unit 740 performs synchronization control at a predetermined timing triggered by an external operation or an external control signal when the broadcast stream received by the broadcast receiving unit 601 is normally presented to the output unit 630. The start is instructed to the composite display means 614. Here, the synchronization control is so-called delay control, and refers to control for delaying the broadcast stream from the presentation time when the broadcast communication cooperative receiving apparatus 6 normally presents the broadcast stream. That is, the delay presentation control unit 740 instructs the composite display unit 614 to start the delay control, thereby causing the broadcast stream to be presented in a delayed manner.

  In the present embodiment, the delay presentation control unit 740 is triggered by a control signal multiplexed in the broadcast stream as an example of a predetermined timing for starting the synchronization control. In this case, the broadcasting / communication cooperation receiving device 6 acquires the APL activation information file (APL activation information) included in the control signal multiplexed in the broadcast stream, and acquires the application based on the acquired APL activation information. To do. Therefore, the delay presentation control means 740 gives an instruction to start control for delaying the broadcast stream after the application is acquired by the communication transmitting / receiving means 606. Here, after acquiring the application includes timing after the acquired application is automatically started. Note that an application that operates on the broadcasting / communication cooperation receiving device 6 can use the function of the delay presentation control unit 740 (broadcasting / communication cooperation function 62: see FIG. 1), for example, by calling an API of delayStreamPresentation (). it can.

  In addition, after the application is acquired, when there is content linked to the activated application after the acquired application is automatically activated, the timing at which the communication transmitting / receiving unit 606 acquires the content is also included. In this case, the delay presentation control unit 740 can instruct the start of control to delay the broadcast stream at the timing when the content is acquired by the communication transmitting / receiving unit 606. According to this, since the broadcasting / communication cooperation receiving device 6 can normally present the broadcasting stream during the period even if it takes time until the content can be acquired from the communication network after acquiring the application, The convenience of the user of the apparatus can be improved. An application that operates on the broadcasting / communication cooperation receiving device 6 can request content from the content distribution server 53.

  The delay time amount acquisition means 750 obtains a difference between the presentation time of the broadcast stream being presented for delay and the presentation time of the broadcast stream when the normal presentation is performed without performing the delay presentation (FIG. 5 ( It is acquired as Ds) shown in c). In the present embodiment, the delay time amount acquisition unit 750 acquires the delay time amount from the composite display unit 614. Also, an application that operates on the broadcast communication cooperative reception device 6 uses the function of the delay time amount acquisition unit 750 (broadcast communication cooperation function 62: see FIG. 1) by calling the API of getCurrentDelay (), for example. Can do. Note that Ds shown in FIG. 5C will be described later.

  The delay time amount acquired by the delay time amount acquisition unit 750 is transmitted to and used by any one of the broadcast station server group 4 via the communication network N by the communication transmission / reception unit 606. Therefore, the broadcast communication cooperative receiving apparatus 6 notifies the broadcast station of the amount of delay time in advance, so that it is possible to take measures to improve the convenience for the user on the broadcast station side. An outline of the processing of the broadcasting station using the delay time amount and a specific example of the flow of the delay presentation processing will be described later.

  When the application acquisition unit 611 acquires an application that operates on the broadcast communication cooperative reception device 6 in response to an operation from the outside, the application storage unit 610 stores an application corresponding to the operation. It consists of a general hard disk. The application storage unit 610 stores an unlinked application or an independent application that is not linked to a digital broadcast program. The non-linked application stored in the application storage unit 610 is a non-linked application from the beginning acquired by the application acquiring unit 611, and was originally a linked application acquired by the application acquiring unit 611. And those that have become non-linked applications as a result of being stored and stored by the user. When an unlinked application is accumulated in the application accumulation unit 610, the corresponding APL activation information stored in the APL activation information storage unit 605 is rewritten by the APL activation information acquisition unit 607 as described later.

  The application acquisition unit 611 acquires the application from the location address (URL) described in the APL activation information of the application via the communication transmission / reception unit 606 and the communication network N under the control of the application control unit 609. . In the present embodiment, the application acquisition unit 611 stores the conjunction application in the application cache 612 under the control of the application control unit 609 when acquiring the conjunction application linked to the digital broadcast program.

  When the application acquisition unit 611 acquires a non-linked application in response to an operation from the outside, the application acquisition unit 611 stores it in the application storage unit 610 under the control of the application control unit 609. In this case, if no special processing is performed, the application control unit 609 refers to the corresponding APL activation information stored in the APL activation information storage unit 605 in an attempt to activate the unlinked application stored in the application storage unit 610. Then, the storage location of the application described in the corresponding APL activation information indicates the URL ahead of the communication network N. In order to prevent such a situation, the application acquisition unit 611 outputs an APL activation information rewrite instruction to the APL activation information acquisition unit 607. As a result, the unlinked application stored in the application storage unit 610 can be activated.

  The application cache 612 is a cache that stores the application acquired by the application acquisition unit 611. Here, the cache is a means for realizing a storage hierarchy, and is constituted by a cache memory such as a semiconductor memory. For example, in the case of a linked application, after the APL activation information is stored in the APL activation information storage unit 605, the conjunction application that is activated with the APL activation information is stored in the application cache 612. At this time, it is not necessary to rewrite the APL activation information of the conjunction application. That is, unlike the application storage unit 610, the application cache 612 stores a location address (URL) described in the APL activation information of the application stored in the APL activation information storage unit 605 when the application is stored. ) Is not required to be rewritten.

  The application execution unit 613 executes an application, and broadcasts the linked application stored in the application cache 612 or the unlinked application stored in the application storage unit 610 under the control of the application control unit 609. Operate on the cooperative receiver 6. Data of an application operated by the application execution unit 613 is output to the composite display unit 614.

  Here, the application execution means 613 can execute a plurality of applications simultaneously. In this case, a plurality of applications belonging to the same service can be executed, or a plurality of applications belonging to different services can be executed. Further, when a plurality of applications are executed, at least one of the applications may perform background processing.

  Further, when data or content (moving image, audio, still image) is included in the service to which the application belongs as the application is executed, these are also executed in the service. These are called application data. Application data and the like are output to the composite display means 614. For example, when the application execution unit 613 executes the application and the application running on the apparatus requests the video / audio content from the content distribution server 53 or the like via the communication network N, the communication stream of the video / audio content is transmitted. It is acquired, reproduced, and output to the composite display means 614. Similarly, when an application running on the apparatus requests and obtains image data such as a still image or audio data, the data is output to the composite display unit 614. Note that application data and the like are also stored in the application cache 612.

The composite display unit 614 includes a broadcast content buffer (not shown) and a communication content buffer. The communication transmission / reception unit 606 generates a communication stream from the content distribution server 53 that distributes the content linked to the digital broadcast program. Synchronous control for synchronizing the received content (communication stream) and digital broadcast program (broadcast stream) in the broadcast communication cooperative reception apparatus 6 is performed and output to the output means 630.
In the present embodiment, in response to the inquiry from the delay time amount acquisition unit 750, the composite display unit 614 broadcasts the presentation time of the broadcast stream that is being delayed and the normal presentation without performing the delay presentation. The difference from the presentation time of the stream is notified as a delay time amount.
Here, the application that operates on the broadcasting / communication cooperation receiving device 6 uses the synchronization control function as the broadcasting / communication cooperation function 62 (see FIG. 1) by calling, for example, getCurrentSTC () or delayStreamPresentation () as an API. can do. STC represents a system time clock.

  The composite display unit 614 includes video / audio data notified from the video / audio decoding unit 603, a data broadcast screen (data broadcast content) notified from the data broadcast decoding unit 604, list data notified from the list control unit 608, The application data notified from the application execution unit 613 is combined and output to the output unit 630 as image data and audio data. Note that the synthesis of image data can be realized by, for example, a general GDC (Graphic Display Controller).

  Also, the synthesis of audio data is, for example, of the audio / video data notified from the audio / video decoding means 603 in the same manner as the actual situation of a general baseball broadcast program and the switching or synthesizing process of the sub audio service. It means that one of the audio data and the audio data included in the application data is output to the output unit 630 as being switchable or synthesizable by a user operation.

[5. Overview of broadcast station processing using delay time]
Here, the outline of the processing of the broadcasting station using the delay time amount will be described with reference to FIGS. 5 and 6 (refer to FIGS. 1 and 4 as appropriate). First, an example in which the delay time amount is not used in the broadcasting station will be described with reference to FIG. 5A is a time axis of the time when the broadcast content is actually transmitted from the broadcast station 2, and FIG. 5B is a time time when the broadcast content is presented without performing synchronization control in the broadcast communication cooperative receiver. FIG. 5C shows a time axis of time at which the broadcast content is presented by performing synchronous control in the broadcasting / communication cooperation receiving apparatus. FIG. 5D shows a common time (physical time) in the broadcasting station and the broadcasting / communication cooperation receiving apparatus by a broken line. For the sake of explanation, the time between the graduations is assumed to be equal as an example, but is not limited thereto.

Here, as shown in FIG. 5 (a), the broadcasting station 2, at a certain time t _0, a broadcast content frame (hereinafter, referred to as frame 1) sends a to another time t _2, the broadcast content Assume that another frame (hereinafter referred to as frame 2) is transmitted.

In general, since digital television has a slight time delay in presentation time, as shown in FIG. 5B, the broadcast content is actually presented with a slight delay in the broadcasting / communication cooperation receiving device 6. It is assumed that the general presentation delay time of this digital television is d and the delay time d continues. Assuming that the times obtained by adding the delay times d to the times t ₀ and t ₂ are the times t ₁ and t ₃ , the broadcast communication cooperative receiving device 6 presents the frame 1 at the time t ₁ and the frame 2 at the time t _3. Present.

In the broadcasting / communication cooperation receiving device 6, the communication content often comes later than the broadcasting content. Therefore, when performing synchronization control, it is necessary to delay the broadcasting content. For example, as illustrated in FIG. 5C, it is assumed that the broadcast communication cooperation receiving device 6 issues a command “start synchronization control” at time t ₁ . For example, the application that operates on the broadcasting / communication cooperation receiving device 6 calls the API of delayStreamPresentation (), so that the delay presentation control unit 740 executes processing. Then, a delay time of a result of performing synchronous control and D _S. For example, the delay time amount obtaining means 750 by calling an API application getCurrentDelay () can obtain the delay time amount of D _S. In FIG. 5 (c), it is assumed that the delay amount of time D _S is continuing. When the time _t 1, _{t 3} to time delay amount _{D S} time a time obtained by adding each _t 3, _{t 5} to, the network-linked digital terrestrial television broadcasting receiving device 6, the frame 1 presents a time _{t 3,} at time _{t 5} Frame 2 is presented.

Further, as shown in FIG. 5 (a), at the broadcasting station 2, quiz answers acceptance start time of a frame of audience participation quiz program at time t ₅₀ (hereinafter, referred to as frame S) sends a time t ₅₄ It is assumed that a quiz response acceptance end time frame (hereinafter referred to as frame G) is sent to. For example, when the moderator of the program is frame S, it announces that “response acceptance is now started”, and when it is frame G, it announces that “response acceptance is over here”. Note that the broadcast station 2 can multiplex a broadcast signal into a broadcast stream after inserting a trigger signal indicating completion of answer acceptance into the control signal at frame G.

In this case, as shown in FIG. 5 (b), when not to perform network-linked digital terrestrial television broadcasting receiving device 6 if the synchronization control, the frame S presented at time t _51, since presenting the frame G at time t _55, When the frame G is presented, the answer acceptance end time (time t ₅₄ ) is slightly past (delay time d). Note that this is a slight time lag from the general presentation time of digital television, so it is actually a very short time width.

On the other hand, as shown in FIG. 5 (c), if the network-linked digital terrestrial television broadcasting receiving device 6 performs synchronous control, delays presented by an amount broadcast stream delay time amount D _S of a result of performing synchronous control. As a result, the frame S is presented at time t ₅₃ and the frame G is presented at time t ₅₇ . Therefore, when the frame G is presented it would become too answer reception end time (time t ₅₄₎ a predetermined time (delay time d + delay amount D _S).

Therefore, in this embodiment, the network-linked digital terrestrial television broadcasting receiving device 6, it was decided to keep notified in advance a program provider information of the delay time amount of D _S. Thereby, the broadcasting station can widen the answer reception width. An example of expanding the answer acceptance width at this time, that is, an example of using a delay time amount in a broadcasting station will be described with reference to FIG. FIG. 6A shows the time axis of the time when the broadcast content is actually transmitted from the broadcast station 2 using the delay time amount, and FIG. 6B shows the time.

As shown in FIG. 6 (a), the broadcasting station 2 determines, after presenting the frame G at time t _54, the answers received from the network-linked digital terrestrial television broadcasting receiving device 6 until the extended time Ex be effective be able to. Broadcaster, while emphasizing information of the delay time amount D _S, also the delay time d and other factors such as determining the extension time Ex considered. Here, for the sake of simplicity, the determination is made in consideration of only one broadcasting / communication cooperation receiving device 6.

[6. Specific example of delayed presentation process flow]
Here, a specific example of the flow of the delay presentation process will be described with reference to FIG. 7 (refer to FIG. 4 as appropriate). FIG. 7 is a sequence diagram showing a flow of delay presentation processing by the broadcast communication cooperative reception device according to the embodiment of the present invention. Here, it is assumed that the broadcast content is a live broadcast viewer participation type quiz program.

  First, the broadcast station (digital broadcast transmission apparatus) 2 sends out broadcast content using broadcast waves (step S11). The broadcast station 2 inserts a trigger signal into the broadcast stream control signal in accordance with, for example, a predetermined timing in accordance with the progress of the program, and multiplexes it with the broadcast content. In the case of a viewer participation type quiz program, for example, a trigger indicating a response start timing and a trigger indicating a response end timing correspond to this.

  Then, the broadcasting / communication cooperation receiving device 6 receives the broadcasting content via the antenna ATN by the broadcasting receiving means 601 (step S12). At this time, it is assumed that the state is before the quiz answer acceptance start time. Then, the broadcasting / communication cooperation receiving device 6 starts delay presentation by the delay presentation control means 740 at a predetermined timing (step S13). For example, at the start of the program, an application for participation registration that prompts participation registration of the quiz in conjunction with the program and an application of an answer pad having a participation registration function and an answer transmission function are automatically started and presented on the screen. It is assumed that a delayed presentation start API is called.

  In addition, at a predetermined timing, the broadcasting / communication cooperation receiving device 6 acquires the delay time amount by the delay time amount acquisition means 750 (step S14). For example, when an answer pad application is automatically activated, an API for acquiring a delay time amount is called together with an API for starting delay presentation.

  And, for example, the program moderator says, “If you want to participate in the quiz you are going to do, please use the remote control to select“ Entry ”on the answer pad right now. It will be about 2 seconds, but please be forewarned that it will be closed as soon as it reaches the capacity on the first arrival even within the time limit. ” Here, the reason that the deadline may be raised is that the application has started delay presentation, and the amount of delay time varies depending on the viewing environment for each viewer. A viewer who responds to such a call performs an operation of selecting “entry” with the remote controller. Then, using the remote control operation as a trigger, the broadcasting / communication cooperation receiving device 6 transmits information on the delay time amount to the broadcasting station server group 4 via the communication network N (step S15). In addition, the service provider server group 5 may be interposed to indirectly transmit to the broadcast station server group 4. Moreover, when transmitting directly to the broadcasting station server group 4, you may make it send to the user management server 42, such as a member information server.

  The broadcast station server group 4 receives the delay time information from each broadcast communication cooperative receiver 6 (step S16), determines the extension time (step S17), and transmits the determined extension time information to the communication network N or It transmits to the broadcasting station (digital broadcast transmitting apparatus) 2 via a dedicated line (step S18). Here, any one of the servers included in the broadcast station server group 4 bridges the broadcast station and each viewer, and individually acquires them from a plurality of broadcast communication cooperative receivers 6 within a predetermined period, for example, 30 seconds. The maximum value or the average value of the amount of delay time thus determined is determined as an extension time common to the plurality of broadcast communication cooperative reception devices 6.

  This extended time can be used, for example, as an extended time with respect to the response time limit of a viewer participation type quiz program. In this case, unfairness among a large number of participants who have notified the amount of delay time can be reduced. Here, when the maximum value of the delay time amount is determined as the extension time, it is possible to reduce the number of participants who are not satisfied with the response time limit to the maximum. In addition, when the average amount of delay time is determined as the extension time, as soon as information from each participant is gathered, the average value of the delay time collected so far can be tentatively easily determined. Even when there are a large number of persons, the extension time can be determined quickly, and programs such as live broadcasting can be advanced promptly.

  The broadcast station (digital broadcast transmitter) 2 receives the extended time information via the communication network N or the dedicated line (step S19), adds the acquired extended time information to the control signal (step S20), and sends the control signal to the control signal. Multiplex (step S21), and broadcast contents are transmitted by broadcast waves (step S22). Specifically, when the broadcast station 2 inserts, for example, a trigger indicating a response start timing into the control signal of the broadcast stream, the extended time information is also inserted into the control signal. Thus, it is possible to notify the broadcasting / communication cooperation receiving device 6 that measures are taken to extend the answer window by extending the answer end timing.

  Here, in the broadcasting / communication cooperation receiving device 6, as the answer pad application approaches, for example, the end of the answer is approaching, the count is reduced by a synthesized voice, a pop-up display, or the like, such as “the remaining is 5 seconds, 4 seconds, 3 seconds,. Assume that you can. In the case of a receiver that has not acquired the extended time information, if the delay of the communication stream is large, when receiving broadcast content multiplexed with a control signal in which a trigger indicating the timing of response completion is received, But it will be forcibly terminated. However, in the case of the broadcasting / communication cooperation receiving device 6 that has acquired the extended time information, even if the broadcast content in which the control signal in which the trigger indicating the answer end timing is inserted is multiplexed is received in advance According to the extended time information, the answer pad application can continue to count up to the end while finely adjusting the count interval.

The broadcast station 2 may send the extended time information acquired from the broadcast station server group 4 as a message format for the viewer. For example, in the example shown in FIG. 6A, when the broadcasting station 2 presents the frame S (the frame of the quiz answer reception start time) at time t ₅₀ , In consideration of the circumstances, the response window may be added such that the response window is expanded by the extension time Ex from the response deadline during broadcasting.

  Subsequent to step S22, the broadcasting / communication cooperation receiving device 6 receives broadcast content via the antenna ATN by the broadcast receiving means 601 (step S23). For example, on the screen, a video of a scene in which a quiz is given by the presenter on broadcast content (AV content) is displayed, and answer candidates are displayed in three choices on an answer pad (application) presented on the screen. The viewer (quiz participant) selects an answer with the remote control within the answer time of the quiz. Thereby, the broadcasting / communication cooperation receiving device 6 transmits the information of the answer selected from the options to the broadcasting station server group 4 via the communication network N (step S24).

  The broadcasting station server group 4 receives the answer from the broadcasting / communication cooperation receiving device 6 via the communication network N (step S25). In addition, the service provider server group 5 may be interposed to indirectly transmit to the broadcast station server group 4. Then, when the broadcast station server group 4 receives a quiz answer from the broadcasting / communication cooperation receiving device 6, whether or not the reception time in real time is within the extended time Ex (see FIG. 6A). Is determined (step S26). When it is within the extension time (step S26: Yes), the broadcasting station server group 4 determines that the answer received from the broadcasting / communication cooperation receiving device 6 is valid (step S27), and executes the process when valid (step S28). . When the extension time has passed (step S26: No), the broadcasting station server group 4 determines that the received answer is invalid (step S29), and executes invalid time processing (step S30).

Here, in the valid process, at least a process of determining whether or not the answer is correct is performed. In addition, a process of statistically analyzing the answer result by each participant, a process related to the right to acquire a prize, or the like may be performed.
Further, the invalid time process includes nothing. In addition, necessary processing related to the right to acquire a prize may be performed.
When various notification processes are required for the broadcast communication cooperative reception device 6, the broadcasting station server group 4 performs a valid time process or an invalid time process for the broadcast communication cooperative reception device 6 via the communication network N. Is notified (step S31).
In this example, the broadcasting station server group 4 receives the delay time amount and the quiz answer, but the service provider server group 5 may receive the answer.

  As described above, according to the broadcasting / communication cooperative receiving device 6 of the present embodiment, the delay time amount acquisition unit 750 causes the original presentation time (presentation time of the broadcast stream being normally presented) for the presentation time of the broadcast stream being delayed to be presented. Since the delay time amount from the communication stream is delayed in the apparatus 6 and synchronized with the broadcast stream can be prevented, the user of the apparatus 6 can be prevented. Convenience can be improved.

  In addition, since the broadcasting / communication cooperation receiving device 6 can notify the broadcast station of the amount of delay time in advance, the broadcast station needs time management in accordance with the progress of the program, such as a viewer-participation-type quiz program. When a program to be provided is provided, it is possible to take measures so that each viewer does not suffer a disadvantage in consideration of the amount of delay time that differs between the plurality of broadcast communication cooperative receiving apparatuses 6. As a result, the convenience of the user of the broadcasting / communication cooperation receiving device 6 can be improved.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to this. For example, the broadcasting / communication cooperation receiving device 6 can be realized by operating a general computer including a tuner according to a program that functions as each of the above-described units. This program (program execution control program of the broadcasting / communication cooperation receiving apparatus) can be distributed via a communication line, or can be distributed by writing on a recording medium such as a DVD or CD-ROM. .

In the broadcasting / communication cooperation receiving device 6 of the present embodiment, it is described that the application is automatically started when the viewer receives the APL start information described as “AUTO START” while viewing the digital broadcast program. However, the following functions (1) and (2) may be added.
(1) While presenting a digital broadcast, the user presses an H button (broadcast / communication cooperation service screen transition button) provided in advance on the remote controller, thereby transitioning to the broadcast / communication cooperation service screen.
(2) A broadcasting / communication cooperation service screen transition-dedicated API for changing from BML to the broadcasting / communication cooperation service screen is newly provided and prepared. While presenting digital broadcast, the user presses the D button (data broadcast transition button) provided on the remote control to transition to the data broadcast screen, and then, on the data broadcast screen, the broadcast communication cooperation service screen transition dedicated When the user performs an operation of selecting a dedicated button provided corresponding to the API, the screen changes to the broadcast communication cooperation service screen.

  In the present embodiment, the broadcast content transmission side has been described as transmitting the APL activation information file by the specific module transmitted by the data carousel method. However, when the APL activation information is transmitted by broadcasting, the event information table A descriptor for APL activation information may be added to (EIT: Event Information Table) and transmitted, or a dedicated elementary stream (ES: Elementary Stream) for APL activation information is broadcasted TS (Transport Stream) may be multiplexed, or only information indicating the location address of the APL activation information may be transmitted. Furthermore, the APL activation information file may be transmitted from a communication network instead of broadcasting.

1 Broadcasting / communication cooperation type system 2 Broadcasting station (digital broadcasting transmitter)
4 broadcast station server group 41 content management server 42 user management server 43 content distribution server 44 broadcast station service server 45 DB
46 API
5 Service Provider Server Group 51 Application Server 52 Service Server 53 Content Distribution Server 54 DB
55 API
6 Broadcast / communication cooperation receiving device 61 Basic function 62 Broadcast / communication cooperation function 63 API
64 applications (broadcast communication cooperation applications)
601 Broadcast receiving means 602 Broadcast signal analyzing means 603 Video / audio decoding means 604 Data broadcast decoding means (application activation information extracting means)
605 APL activation information storage means 606 communication transmission / reception means (communication transmission means, communication reception means)
607 APL activation information acquisition means 608 list control means 609 application control means 610 application storage means 611 application acquisition means 612 application cache 613 application execution means 614 composite display means (delay time output means)
620 Operation input means 630 Output means 710 Start control means 720 Termination control means 730 Storage management means 740 Delay presentation control means 750 Delay time amount acquisition means ATN Antenna N Communication network

Claims (3)

A broadcasting / communication cooperation receiving device that receives a digital broadcast and outputs it to an output means for presenting video and audio, and acquires an application operating on the device from a communication network,
Broadcast receiving means for receiving a broadcast program transmitted by a broadcast wave of digital broadcasting as a broadcast stream;
Application activation information storage means for storing application activation information for activating the application linked to the broadcast program;
Communication receiving means for receiving the application as a communication stream from a communication network based on the application activation information;
Synthetic display means for performing synchronization control to synchronize the communication stream and the broadcast stream within the apparatus and outputting the same to the output means,
When the broadcast stream is normally presented in the device as the synchronization control at a predetermined timing triggered by an external operation or an external control signal when the received broadcast stream is normally presented A delay presentation control unit that delay-presents the broadcast stream by instructing the composite display unit to start control that is delayed from the presentation time;
A delay time amount acquisition means for acquiring a difference between a presentation time of the broadcast stream during the delay presentation and a presentation time of the broadcast stream when the normal presentation is performed without performing the delay presentation;
Communication transmission means for transmitting the acquired delay time amount to a server managed by a broadcasting station via a communication network;
A broadcasting / communication cooperative receiving apparatus comprising: Further comprising application activation information extracting means for extracting the application activation information for an application linked to the broadcast program from the control signal multiplexed in the broadcast stream and storing it in the application activation information storage means;
The broadcast communication cooperative reception apparatus according to claim 1, wherein the delay presentation control unit instructs the start of control for delaying the broadcast stream after the application is acquired by the communication reception unit. The communication receiving means further acquires content linked to the application as a communication stream from a communication network,
The broadcast communication cooperative reception apparatus according to claim 2, wherein the delay presentation control unit instructs the start of control to delay the broadcast stream at a timing when the content is acquired by the communication reception unit.

Images