JPWO2015146683A1 - Broadcast receiver and control program - Google Patents

Abstract

The application image is displayed together with the broadcast video object without executing the application on its own device. The broadcast receiver (1) receives the application execution control unit (5) that causes the application processing device (100) to execute the application, and the application image generated by the application processing device (100) executing the application, A presentation control unit (6) for displaying the application image together with the broadcast video object.

Description

  The present invention relates to a broadcast receiver that can use broadcast content and communication content in combination.

  Recently, provision of services that integrate broadcasting and communication has been started. For example, in a service called hybrid cast (registered trademark), an application image generated by execution of application software (hereinafter, abbreviated as an application) acquired via the Internet is displayed superimposed on broadcast content. Accordingly, the user can obtain information on the Internet related to the broadcast content or use a social network service while viewing the broadcast content. Examples of documents related to hybrid casting include the following Patent Document 1, Non-Patent Document 1, and Non-Patent Document 2.

Japanese Patent Publication “JP 2012-257235 A” (released on December 27, 2012)

IPTV Standard Broadcast Communication System Specification IPTVFJ STD-0010 Version 1.0, IPTV Forum, March 22, 2013 IPTV specification HTML5 browser specification IPTVFJ STD-0011 1.0 version, IPTV Forum, published on March 22, 2013

  As described above, since an application needs to be executed in a hybrid cast, in order to use a hybrid cast service in a television receiver (hereinafter abbreviated as a TV), the TV has an app execution function. It is necessary to have it. More specifically, since an application using HTML5 is used in the hybrid cast, it is necessary to install an HTML5-compatible browser in order to make the television compatible with the hybrid cast.

  On the other hand, a television is also required to reduce necessary hardware resources. In other words, there is a situation where it is desired to use a service that links broadcasting and communication, such as hybrid cast, but to avoid providing an application execution function in a broadcast receiver such as a television.

  The present invention has been made in view of the above problems, and an object thereof is to display an application image generated by execution of the application together with a broadcast video object without executing the application by itself. It is to provide a broadcast receiver and the like that can be used.

  In order to solve the above problems, a broadcast receiver according to one aspect of the present invention receives communication content generated by executing application software acquired via a communication network via the broadcast network. A broadcast receiver for displaying together with broadcast content, an application execution control unit for causing an external device to execute the application software, and a display for receiving the communication content from the external device and displaying the communication content together with the broadcast content And a control unit.

  According to one aspect of the present invention, there is an effect that communication content generated by executing an application can be displayed together with the broadcast content without executing the application in the broadcast receiver.

It is a block diagram which shows the principal part structure of the broadcast receiver which concerns on Embodiment 1 of this invention. It is a sequence diagram which shows an example of the process which starts an application, synthesize | combines and outputs an application image and the image | video of a broadcast content. It is a figure which shows an example of the layout of an application image and a broadcast video object. It is a sequence diagram which shows an example of the process performed during the execution period of an application. It is a sequence diagram which shows an example of the process performed when complete | finishing execution of an application. It is a figure which shows the example of the HTML description and screen display of the application which displays a text and a logo on a broadcast video object. It is a figure which shows the example of the HTML description and screen display of the application which displays a broadcast video object, a text, and a logo on a background image. It is a flowchart which shows an example of the process in which the said broadcast receiver displays a broadcast video object with an application image. It is a block diagram which shows the principal part structure of the broadcast receiver which concerns on Embodiment 2 of this invention. It is a sequence diagram which shows an example of the process which receives and displays the image which combined the application image and the broadcast video object from the application processing apparatus. It is a sequence diagram which shows an example of the process performed when HC extended API is called during the execution period of an application. It is a sequence diagram which shows an example of the process performed when complete | finishing execution of an application. It is a flowchart which shows an example of the process in which the said broadcast receiver displays a broadcast video object with an application image.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail. First, the configuration of the broadcast receiver according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of the broadcast receiver 1. In the figure, the configuration of an application processing apparatus (external device) 100 that can communicate with the broadcast receiver 1 is also shown.

  The broadcast receiver 1 is a device that receives and outputs a broadcast. As shown in the figure, the broadcast receiver 2, the separation unit 3, the video decoder 4, and an application execution control unit (authentication information transmission unit, process execution unit) 5. , A presentation control unit (display control unit, process execution unit) 6, an external device I / F 7, and a display unit 8.

  The broadcast receiver 2 receives a broadcast wave stream signal (hereinafter referred to as a broadcast stream). Then, the separating unit 3 separates the video stream from the broadcast stream received by the broadcast receiving unit 2 and outputs it to the video decoder 4. When the broadcast receiving unit 2 receives a broadcast stream of hybrid cast broadcast, the broadcast stream includes data other than the video stream (data relating to an application, etc.). In this case, the separation unit 3 separates such data from the broadcast stream and outputs it to the application execution control unit 5.

  The video decoder 4 decodes the video stream output from the separation unit 3 and outputs the decoded video stream to the presentation control unit 6. Hereinafter, the video obtained by the video decoder 4 decoding the video stream is referred to as a broadcast video object or broadcast content.

  The application execution control unit 5 causes the application processing device 100 to execute the application based on the data related to the application (application software) output from the separation unit 3. Then, the application execution control unit 5 receives an image generated by executing the application (hereinafter referred to as an application image) from the application processing device 100 and outputs the image to the presentation control unit 6. Here, the application is described in HTML, which is obtained by accessing a URL (Uniform Resource Locator) described in an AIT (Application Information Table) associated (associated) with the broadcast content. An example of an app that is an app that is permitted to access broadcast resources will be described. Needless to say, the application is an application that is permitted to be used in combination with broadcast content and may be acquired through a communication network, and is not limited to this example.

  Further, the application execution control unit 5 generates an access key (authentication information) for authenticating an external device (here, the application processing apparatus 100) that executes the application, and transmits the access key (authentication information) to the external device. In addition to this, the application execution control unit 5 also has a function of performing processing in accordance with the request when receiving an execution request for processing related to the application from the external device. Note that control for causing an external device to execute an application, access key generation, access key transmission control, and response to a process execution request may be realized by individual blocks.

  The presentation control unit 6 displays the application image received from the external device together with the broadcast content. Specifically, the presentation control unit 6 receives the broadcast video object output from the video decoder 4 and the application received from the application processing apparatus 100 via the external device I / F 7 when the authentication with the access key is successful. The images are combined and an image (combination image) obtained by the combining is displayed on the display unit 8. However, the presentation control unit 6 collates the access key transmitted by the application execution control unit 5 with the access key received together with the application image, and when the transmission source of the application is authenticated as the application processing device 100. The above composition and display are performed. Thereby, it is possible to prevent the broadcast content from being illegally used by a device that is not permitted to execute the application.

  The external device I / F 7 is an interface for the broadcast receiver 1 to communicate with the external device. The broadcast receiver 1 communicates with the application processing apparatus 100 via the external device I / F 7. This communication may be wired communication or wireless communication, and the external device I / F 7 may be configured according to the communication mode to be used. Here, an example in which the external device I / F 7 is an interface for wired communication compliant with HDMI (registered trademark) (High-Definition Multimedia Interface) will be described. In the case of communication via HDMI, a command or the like for controlling the operation of the device can be transmitted and received. When communication with the application processing apparatus 100 is performed based on DLNA (registered trademark) (Digital Living Network Alliance), UPnP (Universal Plug and Play), Miracast (registered trademark), etc., device authentication for communication is performed. Do it in advance.

  The display unit 8 is a device that displays an image. For example, a broadcast image or an image generated by an application is displayed on the display unit 8. In the illustrated example, the broadcast receiver 1 includes the display unit 8, but the display unit 8 may be an external device externally connected to the broadcast receiver 1.

  On the other hand, the application processing apparatus 100 includes a communication I / F 101, an external device I / F 102, an input device 103, and an application execution unit 104. The application processing apparatus 100 only needs to have a function of executing an application in accordance with a request from the broadcast receiver 1 and transmitting an application image as a result of the execution to the broadcast receiver 1. It may also be provided with other functions. For example, the application processing device 100 may be a dedicated device that is connected to the broadcast receiver 1 so that the broadcast receiver 1 can use a hybrid cast service, or a game machine or a tablet terminal. A device having other functions such as a smartphone may be used.

  The communication I / F 101 is an interface for the application processing apparatus 100 to connect to an external communication network. The application processing apparatus 100 is connected to a communication network such as the Internet via the communication I / F 101, and acquires application resources (applications) on the communication network.

  The external device I / F 102 is an interface for the application processing device 100 to communicate with the external device, and the application processing device 100 communicates with the broadcast receiver 1 via the external device I / F 102. Here, since it is assumed that the broadcast receiver 1 includes an interface (external device I / F 7) compliant with HDMI, the external device I / F 102 is also an interface compliant with HDMI.

  The input device 103 is a device for the application processing device 100 to accept a user input operation. The user can perform operation control of the application by performing an input operation on the input device 103. Note that the input device 103 may be an external device externally attached to the application processing device 100.

  The application execution unit 104 executes the application according to the control of the broadcast receiver 1 (more specifically, the application execution control unit 5). Specifically, by accessing the URL specified by the application execution control unit 5, the application stored in the storage location specified by the URL is acquired and executed. And the application image produced | generated by execution of an application is transmitted to the broadcast receiver 1 via external apparatus I / F102.

[App startup sequence]
Next, processing performed when the application is activated will be described with reference to FIG. FIG. 2 is a sequence diagram illustrating an example of processing for starting an application, synthesizing and outputting the application image and the broadcast content video.

  When the application execution control unit 5 of the broadcast receiver 1 determines to execute the application, the application execution control unit 5 generates an access key and notifies the presentation control unit 6 of the generated access key. In addition, the application execution control unit 5 transmits a request for starting an application to be executed to the application processing apparatus 100 together with the generated access key. Note that the application activation request only needs to include information that allows the application processing apparatus 100 to identify the application to be activated, and may include a URL indicating the storage location of the application, for example, as illustrated. .

  When the application execution unit 104 of the application processing apparatus 100 confirms reception of the application activation request, the application execution unit 104 activates the application according to the request. Then, a layout change request for displaying the application image generated by the application together with the broadcast video object is transmitted to the broadcast receiver 1 together with the received access key. Although not shown, the application execution unit 104 also transmits application images to the broadcast receiver 1.

  More specifically, the application execution unit 104 (1) an application image in which the display area of the broadcast video object is drawn in a transparent color, (2) position information indicating the display position of the broadcast video object, (3) the broadcast video object The size information indicating the size and (4) the access key received together with the application activation request are transmitted. The data (1) is continuously transmitted until the execution of the application is terminated. For example, when the broadcast video object is a rectangle, the position information may be coordinates indicating the position of the upper left corner of the rectangle. The size information may be information indicating the width and height of the broadcast video object.

  Next, in the broadcast receiver 1 that has received the data (1) to (4), the presentation control unit 6 obtains the received access key and the access key previously notified from the application execution control unit 5. Check to see if they match. That is, the broadcast receiver 1 confirms whether or not the communication partner device is the application processing apparatus 100 that has executed the application by authentication using the access key. When the matching is confirmed, the presentation control unit 6 resizes and moves the broadcast video object output from the video decoder 4 in accordance with the received layout change request, combines it with the received application image, and displays it. Output to unit 8.

  In the above example, the broadcast video object and the application image are synthesized by using the application image in which the display area of the broadcast video object is drawn with a transparent color. However, the synthesis method is not particularly limited. For example, chroma key composition may be applied. In this case, the color key used for composition is transmitted as a parameter for the layout change request. Note that the color key is determined by the application execution unit 104 by checking a color that is not used in the application image or an application image superimposed on the display area of the broadcast video object, and using a dynamically set color key. Also good. In addition, what is set in advance (described in an HTML file) as a parameter of a broadcast video object when an HTML application is created may be used. In this case, the application execution unit 104 does not need to check a color that can be used as a color key.

[About layout]
Here, the above layout will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of the layout of application images and broadcast video objects. In the illustrated example, the outermost rectangle indicates the outer edge of the display screen, the inner rectangle indicates the display area of the broadcast video object, and the triangle partially overlapped with the broadcast video object indicates the display area of the application image. Show.

  In the case of a rectangular broadcast video object as shown in the figure, the coordinates (X, Y) of the upper left corner are the position information (2) described above, and the width (W) and height (H) are the size information (3) described above. ), The display mode of the broadcast video object on the screen can be specified. Note that a predetermined background image or an application image may be displayed on the background of the broadcast video object. Further, the information for designating the layout may include information for designating the superimposition relationship between the broadcast video object and the application image (such as displaying the application image superimposed on the broadcast video object). By including such information, an application image is displayed on the broadcast video object, a broadcast video object is displayed on the application image, or an application image is displayed on the background and foreground of the broadcast video object, etc. Is also possible.

[Application running sequence]
Next, processing performed during the application execution period will be described with reference to FIG. FIG. 4 is a sequence diagram illustrating an example of processing performed during an application execution period.

  The application execution unit 104 transmits a layout change request to the broadcast receiver 1 when the layout, that is, at least one of the display position and size of the broadcast video object is changed by the application being executed. Also at this time, in addition to the data (1) that is always transmitted, the data (2) to (4) are transmitted. The transmission of these data is performed every time the layout is changed.

  Next, in the broadcast receiver 1 that has received the data (2) to (4), the presentation control unit 6 obtains the received access key and the access key previously notified from the application execution control unit 5. Check to see if they match. When it is confirmed that they match, the presentation control unit 6 resizes and moves the broadcast video object output from the video decoder 4 in accordance with the received layout change request, and synthesizes it with the received application image to display the display unit. 8 is output.

  In this way, by performing authentication using an access key at the time of a layout change request, a layout change request is made from another device that does not execute the application, and the broadcast content provider does not intend the broadcast content provider. It is possible to prevent video from being output.

  In addition, when the application execution unit 104 calls an HC extension API (API extended for hybrid casting) in the application being executed, the application execution unit 104 sends an HC extension API execution request together with the previously received access key to the broadcast receiver. 1 to send. This process is performed every time the HC extension API is called.

  Next, in the broadcast receiver 1 that has received the HC extended API execution request and the access key, the application execution control unit 5 compares the received access key with the previously generated access key and checks whether they match. Then, when it is confirmed that they match, the application execution control unit 5 executes the extended API received by the hybrid cast in accordance with the received HC extended API execution request, and transmits the execution result to the application processing apparatus 100. Thereby, the application execution unit 104 receives the execution result of the requested HC extension API.

  Note that the above-described processing may be performed at the time of calling an API that cannot be executed by the application processing apparatus 100 alone (which requires an inquiry to the broadcast receiver 1). An example of such an API is an interface (see 3.1.6.2.1 of Non-Patent Document 2) that acquires a receiver unique identifier (an identifier unique to the broadcast receiver 1 that identifies the broadcast receiver 1). . In addition to this, a channel selection interface (refer to 3.1.6.2.2 of Non-Patent Document 2), an interface necessary for sharing functions with a data broadcasting browser (refer to 3.1.13 of Non-Patent Document 2), etc. Is mentioned. Of course, the authentication using the access key is not limited to when the interface is called as described above, but may be performed when an arbitrary process execution request for requesting execution of a process related to an application is received.

  In the above example, the access key is transmitted together with the layout change request or the HC extended API execution request. However, only the layout change request or the HC extended API execution request may be transmitted first. In this case, the access key may be acquired by requesting transmission from the broadcast receiver 1 side (for example, the application execution control unit 5 or the presentation control unit 6) to the application processing apparatus 100. That is, authentication of the request source for layout change or HC extension API execution may be performed before layout change or HC extension API execution, and the transmission timing of the access key is not particularly limited.

  In the above example, authentication is performed using an access key for each request. However, a plurality of requests may be collectively authenticated using one access key. For example, when it is necessary to send a plurality of layout change requests (or HC extended API execution requests) in a short time, a plurality of layout change requests (or HC extended API execution requests) are sent together and the access key is set to 1. It is good also as a structure which gives only one and transmits. Note that different types of requests may be transmitted together, such as a combination of a layout change request and an HC extended API execution request. Thereby, the number of times of authentication can be reduced and the processing can be simplified.

[App end sequence]
Next, a process when the execution of the application is terminated will be described with reference to FIG. FIG. 5 is a sequence diagram illustrating an example of processing performed when the execution of the application is terminated.

  When the application execution control unit 5 determines to end the execution of the application, the application execution control unit 5 requests the presentation control unit 6 to discard the access key. Next, the presentation control unit 6 discards the access key notified in the application activation sequence according to the request, and then returns to the output of the broadcast video object. That is, the presentation control unit 6 stops the composite output of the broadcast video object and the application image, and returns to a state in which only the broadcast video object is output.

  Further, the application execution control unit 5 transmits an application end request to the application processing apparatus 100. Then, in the application processing apparatus 100 that has received the request, the application execution unit 104 ends the execution of the application, and thereby ends the transmission of the application image to the broadcast receiver 1.

  The trigger for the end of execution of the application may be information included in a broadcast wave (broadcast stream) or a user operation, for example. In the former case, for example, when the application control information (for example, AIT: Application Information Table) in which the application control code field of the application being executed is set to “end” is received on the broadcast wave, the execution of the application is determined to be ended. May be. In the latter case, for example, when channel switching is performed by a user operation, it may be determined that the execution of the application is to be ended.

[Example of HTML description and screen display of application]
Next, an HTML description of the application and an example of screen display based on the description will be described with reference to FIGS. FIG. 6 is a diagram illustrating an example of an HTML description and screen display of an application that displays text and a logo on a broadcast video object. FIG. 7 is a diagram illustrating an example of HTML description and screen display of an application that displays a broadcast video object, text, and logo on a background image.

  In the screen display example of FIG. 6A, “video” (broadcast video object) is displayed (full screen display), and “text” and “logo” (both application images) are superimposed on “video”. Has been. Note that “text” is a text generated by executing the application, and “logo” is a logo (image) generated by executing the application.

  In the example of (b) in the figure, the objects to be displayed in “video”, “text”, and “logo” in the screen display example are described in HTML. A display position and display size of “video”, “text”, and “logo” are described in a CSS (Cascading Style Sheet) shown in FIG. Also, information (z-index) indicating the superimposition relationship of these display objects is described. When the display areas overlap for a plurality of display objects, a display object having a large z-index value is displayed in the front.

  That is, by displaying the object shown in the HTML description shown in (b) of the figure in the position, size, and superposition relationship shown in (c) of the figure, a screen like (a) of the figure is displayed. Is displayed. By transmitting information as shown in (c) of the figure to the broadcast receiver 1 as the above-described position information (2) and size information (3), the broadcast video object and the application image are displayed in a predetermined layout. Can be displayed in combination. In the example of FIG. 5C, the display size and the display position are indicated by the ratio (%) to the display width and height of the screen, but may be indicated by the number of pixels, coordinates, and the like.

  On the other hand, in the screen display example of FIG. 7A, “video” (broadcast video object) is not displayed on the full screen but is displayed on the background image. Similarly, “text” (application image) is displayed on the background image, and “logo” (application image) is displayed superimposed on “video”.

  In the example of (b) in the figure, objects to be displayed are described in “video”, “text”, and “logo”. The CSS in (c) of FIG. 6 describes information indicating the display positions and display sizes of “video”, “text”, and “logo”, and their superposition relationship. That is, by displaying the object shown in the HTML description shown in (b) of the figure in the position, size, and superposition relationship shown in (c) of the figure, the image of (a) of the figure is displayed. Is done.

  Thus, by using the HTML description and CSS, it is possible to display the broadcast video object and the application image in combination in a desired manner. Of course, the information regarding the layout is not limited to the combination of the HTML description and the CSS as long as it indicates the size and arrangement of the broadcast video object and the application image.

[Flow of processing executed by broadcast receiver]
Next, the flow of processing (image display method) executed by the broadcast receiver 1 will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of a process in which the broadcast receiver 1 displays a broadcast video object together with an application image.

  The broadcast receiver 2 of the broadcast receiver 1 receives the broadcast stream and outputs it to the separator 3, and the separator 3 separates the video stream from the broadcast stream and outputs it to the video decoder 4 to execute the application-related data as an application. Output to the control unit 5. Then, the video decoder 4 decodes the video stream to generate a broadcast video object, and the presentation control unit 6 displays it on the display unit 8 (S1).

  Subsequently, the application execution control unit 5 that has received the data related to the application determines whether to start the application (S2). Whether or not to start the application may be determined based on, for example, information included in the broadcast stream, or may be determined based on a user operation. In the former case, for example, when application control information (for example, AIT) in which the application control code field of the application is set to “automatic activation” is received by broadcast waves, it may be determined that the application is activated. In the latter case, for example, when a user performs a data broadcast menu operation to execute a BML (Broadcast Markup Language) extension function (startAITControlledApp), it may be determined to start the application.

  If it is determined that the application is not activated (NO in S2), the application execution control unit 5 ends the process without activating the application. In this case, only the broadcast video object continues to be displayed on the display unit 8.

  On the other hand, when it is determined that the application is to be activated (YES in S2), the application execution control unit 5 generates an access key (S3). Then, together with the generated access key, an application activation request determined to be activated in S2 is transmitted to the application processing apparatus 100 (S4). Although not shown in the figure, the application execution control unit 5 notifies the presentation control unit 6 of the generated access key.

  Here, as described with reference to FIG. 2, when the application execution unit 104 of the application processing apparatus 100 confirms reception of the application activation request, the application is activated according to the request. Then, the application image generated by the application and the layout change request are transmitted to the broadcast receiver 1 together with the received access key. Therefore, the presentation control unit 6 receives these data from the application processing device 100 (S5).

  Next, the presentation control unit 6 confirms whether the access key (the access key transmitted to the application processing device 100) previously notified from the application execution control unit 5 matches the access key received from the application processing device 100. (S6). Here, when it is confirmed that they do not match (NO in S6), the presentation control unit 6 ends the process without combining the application image and the broadcast video object. In this case, only the broadcast video object continues to be displayed on the display unit 8.

  On the other hand, when it is confirmed that they match (YES in S6), the presentation control unit 6 starts outputting a video including the application image (S7). Specifically, the presentation control unit 6 resizes and moves the broadcast video object output from the video decoder 4 and the received application image according to the received layout change request, combines them, and outputs them to the display unit 8.

  As described above, the image display method executed by the broadcast receiver 1 includes the application execution control step (S4) for causing the external device to execute the application, the application image received from the external device, and the application image being broadcast video. And a display control step (S7) for displaying with the object. Therefore, the broadcast video object can be displayed together with the application image without executing the application in the broadcast receiver 1.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. In addition, about the member which has the same function as the member demonstrated in the said embodiment, the same code | symbol is attached and the description is abbreviate | omitted.

  In the above-described embodiment, an example in which the broadcast receiver 1 synthesizes an application image transmitted from the external device (the application processing apparatus 100) with a broadcast video object has been described. Received video is output.

  First, the structure of the broadcast receiver of this embodiment is demonstrated based on FIG. FIG. 9 is a block diagram showing a main configuration of the broadcast receiver 50. In the figure, the configuration of an application processing apparatus (external device) 150 that can communicate with the broadcast receiver 50 is also shown.

  As shown in the figure, the broadcast receiver 50 includes a broadcast reception unit 2, a separation unit 3, a video decoder 4, an external device I / F 7, a display unit 8, a video switching unit (display control unit) 51, an application execution control unit (authentication). An information transmission unit, a transfer control unit, a processing execution unit) 52, and a communication I / F 53.

  The video switching unit 51 switches between a state where the broadcast video object output from the video decoder 4 is output to the display unit 8 and a state where the external input image received via the external device I / F 7 is output to the display unit 8. Although details will be described later, the external input image is an image (combination image) in which an application image and a broadcast video object are combined. That is, the video switching unit 51 displays the application image received from the external device together with the broadcast content by the above switching.

  The application execution control unit 52 causes an external device (the application processing device 150 here) to execute the application based on the data related to the application output from the separation unit 3. In addition, the application execution control unit 52 transfers the broadcast content (more specifically, the broadcast stream received by the broadcast receiving unit 2 including the broadcast content) to the external device that has executed the application. Further, the application execution control unit 52 generates an access key (authentication information) for authenticating the external device that executes the application, and transmits the generated access key to the external device.

  In addition to this, the application execution control unit 52 also has a function of performing processing according to a request when an execution request for processing related to the application is received from an external device. Note that control for causing an external device to execute an application, access key generation, access key transmission control, broadcast stream transfer control, and response to a process execution request may be realized by individual blocks.

  The communication I / F 53 is an interface for the broadcast receiver 50 to connect to an external communication network. The broadcast receiver 50 is connected to a communication network such as the Internet via the communication I / F 53 and communicates with the application processing apparatus 150 via the communication network. Specifically, the broadcast receiver 50 transfers the broadcast stream to the application processing device 150 via the communication I / F 53. In addition, when communication with the application processing apparatus 150 is performed based on DLNA, authentication for communication is performed in advance.

  On the other hand, the application processing device 150 includes a communication I / F 101, an external device I / F 102, an input device 103, a separation unit 151, a video decoder 152, and an application execution unit 153.

  The separation unit 151 separates the video stream and the data related to the application from the broadcast stream transferred by the broadcast receiver 50. Then, the video stream is output to the video decoder 152, and the data related to the application is output to the application execution unit 153.

  The video decoder 152 decodes the video stream output from the separation unit 151 and outputs a broadcast video object (broadcast content) obtained by the decoding to the application execution unit 153.

  The application execution unit 153 executes the application according to the control of the broadcast receiver 50 (more specifically, the application execution control unit 52). Then, the application execution unit 153 generates an image in which the application image generated by the executed application and the broadcast video object output from the video decoder 152 are combined, and the broadcast receiver 50 via the external device I / F 102. Send to. Therefore, the video switching unit 51 of the broadcast receiver 50 switches the output target of the display unit 8 to the external input video, whereby the application image is displayed on the display unit 8 together with the broadcast video object.

[App startup sequence]
Next, processing performed when the application is activated will be described with reference to FIG. FIG. 10 is a sequence diagram illustrating an example of processing for receiving and outputting an image obtained by combining the application image and the broadcast content video from the application processing apparatus 150.

  When the application execution control unit 52 of the broadcast receiver 50 determines to execute the application, the application execution control unit 52 generates an access key. Further, the application execution control unit 52 requests the broadcast receiving unit 2 to transfer the broadcast stream to the application processing device 150. Then, the broadcast receiving unit 2 starts transferring the broadcast stream to the application processing device 150 in accordance with this request. Here, the broadcast stream is transferred via the communication I / F 53.

  Further, the application execution control unit 52 transmits a request for starting an application to be executed to the application processing apparatus 150 together with the generated access key. When the application execution unit 153 of the application processing apparatus 150 confirms reception of the application activation request, the application execution unit 153 activates the application according to the request, and transmits an activation completion notification to the broadcast receiver 50 together with the received access key. This communication is assumed to be performed via the external device I / F 7, but may be performed via the communication I / F 53.

  Here, although not shown, the broadcast stream transmitted by the broadcast receiver 50 is input to the separation unit 151 via the communication I / F 101. Then, the separation unit 151 separates the video stream from the broadcast stream and outputs the video stream to the video decoder 152, and the video decoder 152 decodes the video stream and outputs the decoded video stream to the application execution unit 153. Next, the application execution unit 153 generates an image that combines the broadcast video object generated by the decoding and the application image generated by the executed application, and starts transmitting the image to the broadcast receiver 50. .

  On the other hand, in the broadcast receiver 50 that has received the activation completion notification, the application execution control unit 52 compares the access key received together with the activation completion notification with the previously generated access key and checks whether they match. When it is confirmed that the images match, the application execution control unit 52 sends a video switching request to the video switching unit 51 to switch the video output to the display unit 8 to the video received via the external device I / F 7. Send. The video switching unit 51 that has received this video switching request switches the output video according to the request, whereby the display unit 8 combines the image generated by the application execution unit 153, that is, the broadcast video object and the application image. Start displaying the selected image.

[Application running sequence]
Next, processing performed during the application execution period will be described with reference to FIG. FIG. 11 is a sequence diagram illustrating an example of processing performed when the HC extension API is called during the application execution period.

  When there is a call to the HC extension API in the application being executed, the application execution unit 153 transmits an HC extension API execution request to the broadcast receiver 50 together with the access key received together with the application activation request. This process is performed every time the HC extension API is called.

  Next, in the broadcast receiver 50 that has received the HC extended API execution request and the access key, the application execution control unit 52 checks the received access key against the previously generated access key to check whether they match. When it is confirmed that they match, the application execution control unit 52 executes the extended API received by hybrid casting in accordance with the received HC extended API execution request, and transmits the execution result to the application processing device 150. Thereby, the application execution unit 153 receives the execution result of the requested HC extension API.

[App end sequence]
Next, processing when the execution of the application is terminated will be described with reference to FIG. FIG. 12 is a sequence diagram illustrating an example of processing performed when the execution of the application is terminated.

  When the application execution control unit 52 determines to end the execution of the application, the application execution control unit 52 transmits an application end request to the application processing device 150. Then, in the application processing apparatus 150 that has received the request, the application execution unit 153 ends the execution of the application and ends the image transmission to the broadcast receiver 50.

  The application execution control unit 52 requests the video switching unit 51 to switch output, and the video switching unit 51 switches the video output to the display unit 8 to the broadcast video object output from the video decoder 4 in accordance with this request. .

  Further, the application execution control unit 52 requests the broadcast receiving unit 2 to end the transfer of the broadcast stream, and the broadcast receiving unit 2 transmits the broadcast stream to the external device (here, the application processing device 150) in accordance with this request. End transfer of.

[Flow of processing executed by broadcast receiver]
Next, the flow of processing (image display method) executed by the broadcast receiver 50 will be described with reference to FIG. FIG. 13 is a flowchart illustrating an example of a process in which the broadcast receiver 50 displays a broadcast video object together with an application image. Note that the same processes as those in FIG. 8 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  When the broadcast receiving unit 2 of the broadcast receiver 50 receives the broadcast content, the broadcast video object generated by the video decoder 4 decoding the video stream included in the broadcast content is displayed on the display unit 8 via the video switching unit 51. It is displayed (S1). Further, the data related to the application separated by the separation unit 3 from the broadcast content is output to the application execution control unit 52.

  Subsequently, the application execution control unit 52 that has received the data related to the application determines whether to start the application (S2). If it is determined that the application is not activated (NO in S2), the application execution control unit 52 ends the process without activating the application. On the other hand, if it is determined that the application is to be activated (YES in S2), the application execution control unit 52 generates an access key (S3), and sends the application activation request determined to be activated in S2 together with the generated access key to the application. The data is transmitted to the processing device 150 (S4). Further, the application execution control unit 52 requests the broadcast receiving unit 2 to transfer the broadcast stream to the application processing device 150 (S10).

  Here, as described with reference to FIG. 10, when the application execution unit 153 of the application processing device 150 confirms reception of the application activation request, the application execution unit 153 activates the application according to the request and transmits an access key together with the activation completion notification. . For this reason, the application execution control unit 52 receives the activation completion notification and the access key from the application processing device 150 (S11).

  Next, the application execution control unit 52 confirms whether the access key generated in S3 (the access key transmitted to the application processing apparatus 150 in S4) matches the access key received from the application processing apparatus 150 in S11 ( S12). Here, when it is confirmed that they do not match (NO in S12), the application execution control unit 52 ends the process. In this case, only the video of the broadcast content is continuously displayed on the display unit 8.

  On the other hand, when it is confirmed that they match (YES in S12), the application execution control unit 52 requests the video switching unit 51 to switch the output video, and the video switching unit 51 switches the output in accordance with this request ( S13). As a result, the display unit 8 starts outputting an image including the application image data (an image in which the broadcast video object and the application image are combined) (S14). At the time of switching, the user may be notified by displaying on the display unit 8 that the output has been switched. If the authentication in S12 is successful (YES in S12), the output is seamlessly switched without such notification, and if the authentication in S12 has failed (NO in S12). Such notification may be performed. In this case, the notification allows the user to recognize that an image has been transmitted from a device other than the application processing device 150.

  As described above, the image display method executed by the broadcast receiver 50 includes the application execution control step (S4) for causing the external device to execute the application, the application image received from the external device, and the application image being broadcast video. And a display control step (S13) for displaying with the object. Therefore, the broadcast video object can be displayed together with the application image without executing the application in the broadcast receiver 50.

[About content]
The broadcast receivers 1 and 50 of the above embodiment both display the broadcast video object being broadcast together with the application image, but may display the broadcast video object of the recorded content together with the application image.

  Further, in the above embodiment, the description has been given by taking the hybrid cast as an example, but the present invention can also be applied to services other than the hybrid cast. That is, the present invention can be applied to any service that uses a combination of communication content generated by executing an application acquired via a communication network and broadcast content received via a broadcast network. Is possible.

[Installation of application engine in broadcast receiver]
The broadcast receivers 1 and 50 of the above embodiment have a configuration that does not include an application execution function (no application engine), but may include an application execution function.

  In this case, according to the application to be executed, the state of the broadcast receiver 1 or 50, or the like, it may be determined whether to execute the application on its own device or to be executed by the application processing device 100 or 150. For example, the application is normally executed by itself, but if the execution target is an application that exceeds the processing capability of the broadcast receiver 1 or 50, the application processing apparatus 100 or 150 may execute the application.

  Accordingly, it is possible to promptly display the application image together with the broadcast video object without using the application processing apparatus 100 or 150. Further, even for an application that exceeds the processing capability of the own device, an application image generated by executing the application by the application processing apparatus 100 or 150 can be displayed together with the broadcast video object.

  Note that whether or not the application exceeds the processing capability includes, for example, whether or not the application has failed to start (for example, if the memory is insufficient, the application fails to start), or the application engine included in the broadcast receiver 1 or 50 It may be determined whether or not the load exceeds a predetermined upper limit value. In addition, it is also possible to determine whether or not the application exceeds the processing capability by referring to the application profile described in the AIT.

[User interface]
A user interface in an application execution period (period in which an application image is displayed together with a broadcast video object) will be described.

  In the broadcast receiver 1 or 50, first, viewing of the broadcast content is started, and then the application is executed, and the application image is displayed together with the broadcast video object. And in the execution period of an application, operation with respect to an application can be performed.

  As described above, since the broadcast content is viewed before the application is executed, the input device (hereinafter referred to as a receiver input device) for operating the broadcast receiver 1 or 50 such as a remote controller is used. An operation for the application may be accepted. In this case, when the application execution control unit 5 of the broadcast receiver 1 or the application execution control unit 52 of the broadcast receiver 50 determines that the received input operation is an operation on the application, the content of the operation is displayed on the application processing device. Notify 100 or 150.

  In addition, an operation for an application may be received on the application processing apparatus 100 or 150 side. In this case, for example, the user operation may be received by the input device 103 included in the application processing device 100 or 150.

  Furthermore, an operation for an application may be received by both the receiver input device and the input device 103 included in the application processing device 100 or 150. In this case, it is preferable that the input device 103 can accept an input operation similar to that of the receiver input device.

  For example, when the broadcast receiver 1 is a television, the receiver input device is a remote controller, and the input device 103 is a touch panel, a software remote controller may be displayed on the input device 103. The software remote controller displays an image corresponding to each operation button of the receiver input device. The input device 103 determines that the touch operation on the operation button portion of the image is the operation on the operation button. Accordingly, the user can easily execute control executed by an operation of pressing a button (d button or four color keys) unique to the television remote controller using the input device 103.

  Note that the software remote controller may always be displayed while the app is running, or the app may perform operations specific to the receiver input device (for example, pressing the above-described d button or four color keys). It may be displayed only during the acceptance period. Whether or not it is such a period is, for example, the HC extended API, and can be determined by a set value when the application calls KeySet.setValue () for assigning processing to the operation key. In addition, it may be displayed at a predetermined opportunity, such as when an operation is performed on the input device 103.

  Further, instead of displaying the software remote controller, a process assigned to a button unique to the remote controller may be assigned to another button, and a guide display indicating that the process has been assigned to another button. Even with this configuration, the user can easily execute control executed by an operation of pressing a button unique to the remote controller using the input device 103.

[Video output method]
In each of the above embodiments, the application image is displayed together with the broadcast video object on the broadcast receiver 1 or 50. However, this image may be displayed on the application processing device 100 or 150 as well. And when displaying on the application processing apparatus 100 or 150, it is preferable to also accept the operation with respect to an application also in the application processing apparatus 100 or 150. Accordingly, the user can perform an operation on the application while confirming the image displayed on the application processing apparatus 100 or 150. The user can look at the display unit 8 of the broadcast receiver 1 or 50 in order to confirm the image. There is no need to move the.

  The application processing apparatus 100 does not receive the broadcast video object, but can accept an operation on the application if an application image is displayed. As described above, the video displayed by the application processing apparatus 100 may be different from the video displayed by the broadcast receiver 1. The same applies to the broadcast receiver 50 and the application processing device 150.

  In addition, with regard to audio output, when audio is output from both the broadcast receiver 1 or 50 and the application processing apparatus 100 or 150, it may be difficult to hear the audio. For this reason, audio output may be performed only from the broadcast receiver 1 or 50, and the application processing apparatus 100 or 150 may display video without outputting audio.

[Embodiment 3]
The control blocks of broadcast receivers 1 and 50 (particularly, application execution control units 5, 52, presentation control unit 6, and video switching unit 51) are made up of logic circuits (hardware) formed in an integrated circuit (IC chip) or the like. It may be realized or may be realized by software using a CPU (Central Processing Unit).

  In the latter case, the broadcast receivers 1 and 50 include a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only) in which the program and various data are recorded so as to be readable by the computer (or CPU). Memory) or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The broadcast receiver (1, 50) according to the aspect 1 of the present invention broadcasts communication content (application image) generated by executing application software (application) acquired via a communication network (Internet). An application execution control unit (5, 52) that is a broadcast receiver that displays together with broadcast content (broadcast video object) received via a network, and causes an external device (application processing apparatus 100, 150) to execute the application software. A display control unit (presentation control unit 6, video switching unit 51) that receives the communication content from the external device and displays the communication content together with the broadcast content.

  According to the above configuration, the external device executes the application, receives the communication content from the external device, and displays the communication content together with the broadcast content. Therefore, the communication content can be displayed together with the broadcast content without executing the application in the broadcast receiver. The data received from the external device only needs to include communication content, and may be an image (combination image) including communication content and broadcast content, for example.

  The broadcast receiver according to aspect 2 of the present invention includes the authentication information transmission unit (application execution control units 5 and 52) that transmits authentication information (access key) to the external device in the aspect 1, and the display control unit. Is configured to display the communication content received from the external device together with the broadcast content when the other device communicating with the broadcast receiver is authenticated by the authentication information. Also good.

  According to said structure, authentication information is transmitted to the external apparatus which performs an application. When the communication partner device is authenticated by the authentication information, the communication content received from the external device is displayed together with the broadcast content. Therefore, it is possible to prevent the communication content transmitted from a device different from the external device that has executed the application from being displayed together with the broadcast content. That is, according to the above configuration, unauthorized use of broadcast content can be prevented.

  When the broadcast receiver according to aspect 3 of the present invention receives a process execution request (layout change request, HC extended API execution request) requesting execution of a process related to the communication content in the above aspect 2, the process execution is performed. A process execution unit (application execution control unit 5, 52, presentation control unit 6) that performs processing according to the process execution request when the request source is the external device is authenticated by the authentication information. It may be a configuration.

  According to the above configuration, when it is authenticated that the transmission source of the process execution request is an external device that has executed the application, the process is performed according to the process execution request. Therefore, it is possible to prevent processing related to the application from being performed due to a request from a device different from the external device that has executed the application. As a result of the unauthorized processing related to the application, it is possible to prevent the broadcast content from being illegally used.

  In the broadcast receiver according to aspect 4 of the present invention, in the aspect 3, the process execution request is a layout change request for requesting a layout change when the communication content is displayed together with the broadcast content. The unit (presentation control unit 6) displays the communication content together with the broadcast content according to the layout change request when it is authenticated by the authentication information that the transmission source of the layout change request is the external device. It may be configured to perform a process of changing the layout to be performed.

  According to the above configuration, when it is authenticated that the transmission source of the layout change request is the external device, the layout for displaying the communication content together with the broadcast content is changed according to the layout change request. Therefore, the layout can be prevented from being illegally changed by a device different from the external device that has executed the application, and broadcast content can be prevented from being illegally used due to the unauthorized change of the layout.

  In the broadcast receiver according to aspect 5 of the present invention, in any of the aspects 2 to 4, the display control unit (presentation control unit 6) is configured such that the transmission source of the communication content is the external device. When authenticated by the authentication information received from a transmission source, a combined image is generated by combining the communication content and the broadcast content received by the broadcast receiver, and the combined image is displayed. Also good.

  According to the above configuration, when it is authenticated that the transmission source of the communication content is the external device, the combination image is generated and displayed. Therefore, the communication content received from the external device is displayed together with the broadcast content. be able to. Further, it is possible to prevent display of a combination of communication content and broadcast content received from a device different from the external device that executed the application.

  The broadcast receiver according to aspect 6 of the present invention includes a transfer control unit (application execution control unit 52) that transfers the broadcast content to the external device in any of the above aspects 2 to 4, and the external device includes: A combination image obtained by combining the broadcast content transferred by the transfer control unit and the communication content generated by executing the application software according to the control of the application execution control unit is transmitted to the broadcast receiver; The display control unit (video switching unit 51) is configured to display the combination image when the transmission source of the combination image is authenticated by the authentication information received from the transmission source that the transmission source of the combination image is the external device. There may be.

  According to the above configuration, when a combination image is received and it is authenticated that the transmission source of the combination image is the external device, the image is displayed, so that the communication content can be displayed together with the broadcast content. it can. Further, it is possible to prevent an image received from a device different from the external device that has executed the application from being displayed as a combined image. And since it is not necessary to perform the process which produces | generates a combined image with a broadcast receiver, compared with the structure of the said aspect 5, the load of the process of a broadcast receiver can be reduced.

  The broadcast receiver according to each aspect of the present invention may be realized by a computer, and in this case, the broadcast is realized by the computer by causing the computer to operate as each unit included in the broadcast receiver. A control program for the receiver and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The present invention can be applied to each device constituting a system that uses broadcast content together with communication content.

1 broadcast receiver 5 application execution control unit (authentication information transmission unit, process execution unit)
6 presentation control unit (display control unit, processing execution unit)
100 Application processing device (external device)
50 Broadcast receiver 51 Video switching unit (display control unit)
52 Application execution control unit (authentication information transmission unit, transfer control unit, process execution unit)
150 Application processing device (external device)

Claims (7)

A broadcast receiver for displaying communication content generated by executing application software acquired via a communication network together with broadcast content received via the broadcast network,
An application execution control unit for causing the external device to execute the application software;
A broadcast receiver, comprising: a display control unit that receives the communication content from the external device and displays the communication content together with the broadcast content. An authentication information transmitting unit for transmitting authentication information to the external device;
The display control unit displays the communication content received from the external device together with the broadcast content when it is authenticated by the authentication information that the counterpart device communicating with the broadcast receiver is the external device. The broadcast receiver according to claim 1.   When a process execution request for requesting execution of a process related to the communication content is received, if the transmission source of the process execution request is authenticated by the authentication information, according to the process execution request The broadcast receiver according to claim 2, further comprising a processing execution unit that performs processing. The process execution request is a layout change request for requesting a change in layout when displaying the communication content together with the broadcast content.
The processing execution unit is configured to display a layout for displaying the communication content together with the broadcast content according to the layout change request when the authentication information is authenticated that the transmission source of the layout change request is the external device. The broadcast receiver according to claim 3, wherein a changing process is performed.   When the transmission source of the communication content is authenticated by the authentication information received from the transmission source, the display control unit receives the communication content and the broadcast receiver. The broadcast receiver according to any one of claims 2 to 4, wherein a combined image combining broadcast contents is generated and the combined image is displayed. A transfer control unit for transferring the broadcast content to the external device;
The external device transmits a combined image obtained by combining the broadcast content transferred by the transfer control unit and the communication content generated by executing the application software according to the control of the application execution control unit to the broadcast receiver. To
The display control unit displays the combination image when it is authenticated by the authentication information received from the transmission source that the transmission source of the combination image is the external device. The broadcast receiver according to any one of 2 to 4.   A control program for causing a computer to function as the broadcast receiver according to any one of claims 1 to 6, wherein the control program causes the computer to function as each unit.

Images