JP2015037264A - Reception device, transmission device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To output an object desired by a user that is related to a broadcast program in a manner highly accurately linked with the broadcast program.SOLUTION: A reception device 7 acquires an application program for executing output of objects from an application distribution device 4 by communication. The reception device 7 detects output timings of objects by executing the acquired application program to receive broadcast signals in which specification information of output target objects is set from a broadcast transmission device 2 or to refer to the output timings of objects in a program described in advance in the application program. The reception device 7 acquires data of the objects of which output timings are detected from a content distribution device 5, combines the acquired data with an image and sound of the program acquired from the broadcast signals, and output the composite.

Description

  The present invention relates to a receiving device, a sending device, and a program.

  In the current digital broadcasting, there is a subtitle broadcasting function for displaying characters as the program progresses on the screen of the broadcast program displayed by the television receiver. In data broadcasting, an object such as an image file distributed by broadcasting can be displayed at an arbitrary position on the screen displayed by the television receiver. On the other hand, there is a technique for receiving broadcast radio waves to acquire broadcast content, acquiring communication content via a communication network, synchronizing the broadcast content and communication content, and outputting them in synchronization (for example, Patent Documents 1 and 2). reference.).

JP 2013-9332 A JP2013-9342A

  With the function of caption broadcasting in digital broadcasting, the number of caption languages is one, and captions selected from a plurality of languages cannot be displayed as objects. Also, in data broadcasting, since the data capacity that can be distributed by broadcasting is small, large-capacity objects and various objects cannot be distributed and displayed on the television receiver. Therefore, it is conceivable to use the techniques of Patent Documents 1 and 2 to distribute an application program for displaying an object desired by the user through communication and display it in conjunction with a broadcast program. However, for example, when objects to be displayed by an application program are switched one after another in a short time, it is difficult to display the broadcast program display screen and the display timing of each object in a highly linked manner.

  The present invention has been made in view of such circumstances, and includes a receiving device, a sending device, and a program that can output a user-desired object related to a broadcast program in a highly linked manner with the broadcast program. provide.

[1] According to one aspect of the present invention, a broadcast receiving unit that receives a broadcast signal, an application management unit that acquires an application program that executes output of an object by communication, and the application program that executes the application program, When the broadcast receiving unit receives a broadcast signal in which specific information is set, or by referring to the output timing of the object described in advance in the application program, the output timing of the object When this is detected, the application execution unit that outputs the object data and the content data of the program acquired from the broadcast signal are combined with the object data output from the application execution unit and output. And a combining unit.
According to this invention, the receiving device acquires an application program for executing output of an object synchronized with a program by communication. The receiving device executes the acquired application program and receives a broadcast signal in which the specific information of the object to be output is set, or refers to the output timing in the program of the object described in advance in the application program By doing so, it is detected that it is the output timing of the object. The receiving device synthesizes the data of the object whose output timing is detected with the video data and audio data of the program acquired from the broadcast signal, and outputs it.
As a result, the receiving apparatus can output a user-desired object related to the broadcast program in a highly linked manner with the broadcast program.

[2] One aspect of the present invention is the above-described receiving device, wherein the application execution unit is described in advance in the object output method set in the broadcast signal or in the application program. The object data is output according to the object output method.
According to the present invention, the receiving device adds, to the program content data acquired from the broadcast signal, the output method received by the broadcast signal or the object data output in accordance with the output method described in advance in the application program. Combine and output.
As a result, the receiving apparatus can display the object linked with the broadcast program with rich expression.

[3] One embodiment of the present invention is the above-described receiving device, wherein the output method includes any one or more of display position, display size, transparency, color, animation operation, display effect, and volume. It is specified.
According to this invention, if the data of the object to be combined with the content data of the program acquired from the broadcast signal is data to be displayed by video, the receiving device is designated as the display position, the display size, the transparency, It is displayed by color, animation operation, and display effect, and if it is audio data, it is output at a specified volume.
Thus, if the object linked with the broadcast program is a video, the receiving device outputs the display position, the display size, the transparency, the color, the animation operation, and the display effect effect intended by the application producer. Audio can be output at the intended volume.

[4] One aspect of the present invention is the receiving device described above, further including an input control unit that receives an input of an output method change instruction by a user, wherein the application execution unit includes the input method. The change is made according to the change instruction received by the input unit, and the data of the object is output according to the output method after the change.
According to the present invention, the receiving device changes the output method designated in advance by the output method designated by the user, and outputs the object data.
Thereby, the receiving apparatus can display an object by the output method customized by the user.

[5] One aspect of the present invention is the receiving device described above, further including an input control unit that receives an input of an object output stop instruction and an output instruction by a user, and the application execution unit includes the input control unit. The output of the object data is stopped until the output instruction is received after the output stop instruction is input.
According to this invention, the receiving apparatus stops the output of the object after the user instructs the output stop of the object until the output is instructed.
As a result, the receiving apparatus can control whether or not to output the object in accordance with a user instruction.

[6] One aspect of the present invention is the above-described receiving device, wherein the output method includes information on whether to allow user control for the output of the object, and the application execution unit includes Until the input control unit receives the output stop instruction and receives the output instruction, the corresponding output method is set to not allow user control, and the object data is output. The output of the data of the object, which is set to allow user control in the method, is stopped.
According to the present invention, the receiving device outputs the object data for which the user control is set to be permitted in advance from when the user instructs the output stop of the object until the permission of the output is instructed. The data of the object set to stop and not to allow user control is combined with the program content data and output.
As a result, even when the user instructs the output of the object to be stopped, the receiving device can synthesize and output the object determined to be output by the application producer as content data of the program. it can.

[7] One aspect of the present invention is the above-described receiving device, wherein the application program includes component information for specifying data of the object for each mode, and the application execution unit includes the object When the output timing is detected, the object data specified by the component information corresponding to the mode specified by the user is output.
According to the present invention, the receiving apparatus synthesizes the object data corresponding to the mode designated by the user with the program content data and outputs it.
Thus, the receiving apparatus can synthesize and output the object selected by the user with the video and audio of the program by one application program.

[8] According to one aspect of the present invention, a broadcast transmission device that transmits a broadcast signal in which content data of a program is set, an application distribution device that distributes an application program that executes output of an object by communication, and a program within the program of the object Output control information generating device for generating output control information indicating the output timing in the case, the broadcast sending device responds to the output timing when detecting that it is the output timing described in the output control information The object specifying information is set as a broadcast signal and transmitted, or the application distribution apparatus distributes the application program including the output control information.
According to the present invention, the transmission device transmits a broadcast signal including content data of a broadcast program, and distributes an application program for executing display of an object to the reception device by communication. The sending device sets output control information for adjusting the output timing of the object to the program progress in the receiving device in the broadcast signal or embeds it in the application program and distributes it to the receiving device.
Thereby, the output device can output a user-desired object related to the broadcast program to the reception device in a highly linked manner with the broadcast program.

[9] One embodiment of the present invention is an application management unit that acquires, by communication, an application program that causes a computer used in a reception device including a broadcast reception unit that receives a broadcast signal to execute output of an object. When the broadcast receiving unit receives the broadcast signal in which the specific information of the object to be output is set, or by referring to the output timing of the object described in advance in the application program The application execution unit that outputs the data of the object when it is detected that the output timing of the object is detected, and the content data of the program acquired from the broadcast signal is output from the application execution unit Is a program for causing to function as a combining unit, for combining and outputting the data of the object.

  According to the present invention, an object desired by a user related to a broadcast program can be output in conjunction with the broadcast program at a high level.

1 is an overall configuration diagram of a broadcasting / communication cooperation system according to an embodiment of the present invention. It is a block diagram which shows the internal structure of the receiver by the same embodiment. The example of a display of the object superimposed on the image | video of the broadcast program by the embodiment is shown. It is a figure which shows the example of the output control information by the same embodiment. The sequence diagram of the object control of the broadcast communication cooperation system by the embodiment is shown. The other sequence figure of the object control of the broadcast communication cooperation system by the embodiment is shown.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is an overall configuration diagram of a broadcasting / communication cooperation system according to an embodiment of the present invention. As shown in the figure, the broadcasting / communication cooperation system includes a sending device 1 and a receiving device 7, and the sending device 1 further includes a broadcasting sending device 2, an output control information generating device 3, and an application distribution device 4. And the content distribution device 5. The application distribution device 4 and the content distribution device 5 are connected to the reception device 7 via a communication network 9 such as the Internet. In the figure, only one broadcast transmission device 2, output control information generation device 3, application distribution device 4, content distribution device 5, and reception device 7 are shown, but in reality, a plurality of devices are provided.

  The broadcasting / communication cooperation system of the present embodiment realizes a broadcasting / communication cooperation service in which a digital broadcasting service and a communication service using the Internet or the like are linked in the receiving device 7. The receiving device 7 executes an application program distributed from the application distribution device 4 via the communication network 9 by communication. The receiving device 7 outputs an object described as an output target in the application program in synchronization with the video and audio of the broadcast program in accordance with an object output instruction distributed by broadcasting or an output time described in the application program. .

  In the application program, an object output command is described, and object components (object data) constituting the object are described for each mode. The object component is, for example, data such as image data (image file), moving image data (moving image file), text data, hypertext data, audio data (audio file). If the object component is hypertext data, data described in a CANVAS tag of HTML (Hypertext Markup Language) can be used. When the receiving device 7 executes an object output command described in the application program, the receiving device 7 acquires and outputs an object component corresponding to the mode specified by the user. The object component is provided by the content distribution device 5 on the communication network 9 or is described in advance in the application program. Note that, in any mode, when the object components are the same, the description of the mode can be omitted.

  The application program is described in, for example, a web content description language, and includes an HTML file and files such as Java (registered trademark) Script and CSS (Cascading Style Sheets) linked to the HTML file. The output method of the object can be set by the CSS file.

  A broadcast transmission apparatus 2 that transmits a broadcast signal is a broadcasting facility of a broadcaster and provides a television broadcast service. There are a plurality of types of television broadcast services. In this embodiment, a case where a digital television broadcast service based on an ISDB (Integrated Services Digital Broadcasting) method is used will be described. The broadcast transmission device 2 multiplexes and modulates video, audio, data broadcast, etc., and transmits it as a broadcast wave using a broadcast signal. The broadcast signal is the same as the broadcast signal of the conventional digital broadcast service, and is defined by ARIB (Association of Radio Industries and Broadcast) standard.

  The output control information generation device 3 is a computer device that generates output control information of an object and provides it to the broadcast transmission device 2 and the application distribution device 4. The output control information includes information indicating the output timing of each object to be output as video or audio by the application program, and information indicating the output method of these objects. The output method is set for each object or each object component. The output method includes, for example, display position, display size, color, animation operation, display effect, volume, user control permission information, and the like. The user control permission information indicates whether to permit output control of an object or an object component by a user operation. For example, when the application creator always wants to display an object by the designated output method for rendering the object, the user control permission information is set to “not controllable”. The output method is distributed to the receiving device 7 by a broadcast signal or described in an application program.

The application distribution device 4 is a computer server that distributes an application program executed on the reception device 7 via the communication network 9.
The content distribution device 5 is a computer server that distributes object components used by applications executed on the reception device 7 to the reception device 7 via the communication network 9.

  Any two or more of the output control information generation device 3, the application distribution device 4, and the content distribution device 5 may be realized by the same computer server.

  The receiving device 7 is a user receiver that can use the broadcasting / communication cooperation service, and is, for example, a device such as a television, a set-top box, a personal computer, or a portable terminal. The receiving device 7 receives a broadcast wave transmitted from the broadcast transmitting device 2 and transmits / receives data to / from the application distribution device 4 and the content distribution device 5 connected via the communication network 9.

  FIG. 2 is a block diagram showing an internal configuration of the receiving device 7. The receiving apparatus 7 shown in the figure includes a broadcast receiving unit 701, a separating unit 702, a video decoding unit 703, an audio decoding unit 704, a communication input / output unit 710, an application management unit 711, an application execution unit 713, an input control unit 714, a broadcast. The communication link unit 721, the video synthesis unit 722 (synthesis unit), the voice synthesis unit 723 (synthesis unit), the video display unit 731, the audio output unit 732, and the clock 741 are configured.

  The broadcast receiving unit 701, the separating unit 702, the video decoding unit 703, and the audio decoding unit 704 constitute a module that processes broadcast signals. The broadcast receiving unit 701 is a general tuner, and receives and demodulates a digital broadcast broadcast signal sent from the broadcast sending device 2. The separation unit 702 is a general demultiplexer, and separates the broadcast signal received and demodulated by the broadcast reception unit 701 into content data such as video data and audio data, and data other than the content data. The data other than the content includes, for example, SI (Service Information) in which a reception channel and program information are described, an event message for sending a trigger, and the like. The video decoding unit 703 decodes the video data, and the audio decoding unit 704 decodes the audio data.

The communication input / output unit 710 is an interface for connecting to the communication network 9.
The communication input / output unit 710 transmits / receives data to / from the application distribution device 4 and the content distribution device 5 via the communication network 9.

  The application management unit 711, the application execution unit 713, and the input control unit 714 constitute a module that processes an application program distributed from the application distribution device 4 via the communication network 9. The application management unit 711 acquires and manages application programs. An application storage unit 712 included in the application management unit 711 stores an application program.

  The application execution unit 713 reads and executes an application program stored in the application storage unit 712. When the application program is described in a web content description language, the application execution unit 713 is realized by a web browser. The application execution unit 713 can be an arbitrary OS (Operation System) or platform such as Android (registered trademark) or iOS (registered trademark), and the application program can be a program that can be executed by the OS or platform. . The input control unit 714 controls the operation of the application according to an instruction input from the user. The input control unit 714 receives an instruction input by the user from an operation device such as a tablet terminal, a smartphone, a personal computer, or a remote controller.

The broadcast communication cooperation unit 721, the video synthesis unit 722, and the voice synthesis unit 723 constitute a module that performs a cooperative operation between a broadcast program and an application acquired through communication. The broadcasting / communication cooperation unit 721 processes data itself transmitted by SI, an event message, and a carousel, and provides information to the application execution unit 713. The video synthesis unit 722 synthesizes the video data of the broadcast program decoded by the video decoding unit 703 and the video data of the object component output from the application execution unit 713, and outputs the synthesized video data to the video display unit 731. The video display unit 731 is a general display, and displays a video of the video data synthesized by the video synthesis unit 722. The voice synthesis unit 723 synthesizes the voice data decoded by the voice decoding unit 704 and the voice data of the object component output from the application execution unit 713 and outputs the synthesized voice data to the voice output unit 732. The voice output unit 732 is a general speaker, and outputs the voice data synthesized by the voice synthesis unit 723 by voice.
When the receiving device 7 is a set top box, for example, the video display unit 731 and the audio output unit 732 may be external devices connected to the receiving device 7.

  FIG. 3 shows a display example of an object superimposed on a broadcast program video. FIG. 3A shows a display example in the Japanese mode, and FIG. 3B shows a display example in the English mode. The object shown in the figure has an image file of a balloon part and text data in the balloon as object components. An image file that displays a balloon including a character display image may be used as one object component. Since the text data can be displayed only in a language for which a font is prepared in the receiving device 7, the object component is an image file including a character display image, thereby limiting the font to be implemented by the receiving device 7. In other words, multilingual display is possible.

  If the object component is an image file, the shape of the object can be changed by changing the image file itself. In addition, the position, size, transparency, and color when displaying object components in video can be specified arbitrarily by using elements such as position, width, height, opacity, and color in the CSS file that specifies the object. it can. Further, by using elements such as animation and transition of the CSS file, an animation operation and a display effect can be added to the object constituent elements. The same applies to objects described in the CANVAS tag of HTML.

  FIG. 4 is a diagram illustrating an example of output control information. In the output control information, an object output time, an object name that is information for specifying the object, a mode, component information, and output method designation information are described in association with each other. The component element information is information that identifies an object component element. In the figure, the file name of the object component element is set in the component element information, but the acquisition destination and storage location of the object component element such as a URL (Universal Resource Locator) may be set. In addition, a plurality of object constituent elements may be acquired from one acquisition destination indicated by the constituent element information.

  The mode is an output mode instructed by the user. In the figure, modes “1”, “2”, and “3” are used, and “all” indicates all modes. When executing the object output command specified by the object name, the receiving device 7 selects an object component to be output according to the object name and the output mode, and acquires output method specifying information of the selected object component.

For example, the receiving device 7 executes an output command for the object with the object name “A01” described in the application program. In this case, if the output mode is “1” representing the Japanese mode, the object component “01-jp.png” (the image data of the balloon in FIG. 3A) and “Text-jp.txt” (FIG. 3 (a) Japanese text data in a speech balloon) is an output target. On the other hand, if the output mode is “2” representing the English mode, the object component “01-en.png” (the image data of the balloon in FIG. 3B) and “Text-en.txt” (FIG. 3 ( The English text data in the balloon in b) is the output target.
When the output command for the object with the object name “A02” is executed in the receiving device 7, the object component “02.png” is output regardless of the output mode “1”, “2”, or “3”. Is the output target.
Also, for example, the receiving device 7 executes an output command for the object with the object name “A03”. In this case, if the output mode is “1”, the object components “03.png” and “Sound1-jp.mp3” are output targets, and if the output mode is “2”, the object component “03. “png” and “Sound1-en.mp3” are output targets.

  The output method designation information includes a display position (x coordinate, y coordinate), size (width, height), transparency, color, effect, layer, and object configuration when the object component is displayed as a video. When an element is output by voice, items such as volume and user control permission information are included. In the figure, output method designation information is set for each object component, but it may be designated for each object. Also, a part of the output method designation information item may be designated for each object, and the other output method designation information item may be designated for each object component.

  The effect indicates, for example, an animation operation or display effect such as moving display of an image or erasing an image by a dissolve. The layer is a video display layer, and specifies, for example, an overlap when two or more object components are displayed. In the case of the setting shown in the figure, when the object components “01-jp.png” and “Text-jp.txt” are displayed at the same time, “Text-jp.txt” on the upper layer is “01-jp.png”. "Is displayed above. When a layer is not set, a predetermined layer such as the uppermost layer can be used. The user control permission information indicates user control permission in the case of “permit”, and indicates that user control is not possible in the case of “force”. The user control permission information may be information that specifies whether user control is possible or not for each of the display position, display size, transparency, color, effect, and volume.

Next, the operation of the broadcasting / communication cooperation system will be described.
The output of the object may be performed based on an instruction by broadcasting, or may be performed based on an output time described in the application program. First, a case where an object is output based on a broadcast instruction will be described.

  FIG. 5 shows a sequence diagram of object control of the broadcasting / communication cooperation system. In the sequence shown in the figure, the application program is distributed from the application distribution device 4 to the reception device 7 by communication. The broadcast transmission device 2 uses the event message to instruct the reception device 7 by broadcasting the object to be output in accordance with the progress of the program. The receiving device 7 acquires the object component of the specified object from the application program or from the content distribution device 5 by communication, and outputs it in conjunction with the program.

  First, in performing display control of an object, a broadcaster or an application provider refers to a broadcast program and an application program, and generates output control information such as the example shown in FIG. The output control information generation device 3 outputs the generated output control information to the broadcast transmission device 2 (step S105). In the application program, an output command that associates an object name to be output with an object component for each mode is described, and output control information (output method designation information of an object or object component) other than the output time is described. Yes.

  When the broadcast transmission device 2 reaches the start time of the program linked with the application, the broadcast transmission device 2 outputs a broadcast signal in which the content data of the program is set (step S110). The content data is encoded video data and audio data, and a PTS (Presentation Time Stamp) is added to the content data.

  When the broadcast receiving unit 701 of the receiving device 7 receives the broadcast signal broadcast by the broadcast sending device 2, the received broadcast signal is demodulated and output to the separating unit 702. The separating unit 702 outputs the demodulated broadcast signal, The data is separated into data other than video data, audio data, and content data (hereinafter referred to as “other data”). The separation unit 702 outputs video data to the video decoding unit 703, outputs audio data to the audio decoding unit 704, and outputs other data to the broadcast communication cooperation unit 721. The video decoding unit 703 decodes video data corresponding to the time when the added PTS is output from the clock 741 and outputs the decoded video data to the video synthesis unit 722. Since the video data is not input from the application execution unit 713, the video composition unit 722 outputs only the video data of the program to the video display unit 731. The video display unit 731 displays the program video based on the input video data. Is displayed. Similarly, the speech decoding unit 704 decodes speech data corresponding to the time when the added PTS is output from the clock 741, and outputs the decoded speech data to the speech synthesis unit 723. Since no audio data is input from the application execution unit 713, the audio synthesis unit 723 outputs only the audio data of the program to the audio output unit 732, and the audio output unit 732 outputs the program audio based on the input audio data. Is output.

  After the start of the program, the broadcast transmission device 2 outputs a broadcast signal in which location information indicating the acquisition destination of the application program is set (step S115). For example, the location information is indicated by a URL and set in an AIT (Application Information Table).

  The broadcast receiving unit 701 of the receiving device 7 demodulates the broadcast signal, and the separation unit 702 converts the video data, audio data, and other data separated from the demodulated broadcast signal into a video decoding unit 703, an audio decoding unit 704, It outputs to the broadcast communication cooperation part 721. Similarly to the above, the video synthesis unit 722 causes the video decoding unit 703 to select and decode the decoded video data on the video display unit 731, and the audio synthesis unit 723 includes the audio decoding unit 704 based on the PTS. The selected audio data is decoded and output from the audio output unit 732.

  When the broadcast communication cooperation unit 721 acquires the location information from other data, the broadcast communication cooperation unit 721 outputs the location information to the application management unit 711 and instructs acquisition of the application program. The application management unit 711 accesses the application distribution apparatus 4 with the acquisition destination indicated by the location information as a destination, and transmits an application program acquisition request (step S120). The application distribution device 4 distributes the application program corresponding to the destination used for access to the reception device 7 (step S125). The application management unit 711 of the receiving device 7 writes the distributed application program in the application storage unit 712. The application management unit 711 instructs the application execution unit 713 to execute the distributed application program. The application execution unit 713 reads the application program from the application storage unit 712 and starts execution.

  The broadcast transmission apparatus 2 sets the object name of the object to be output as a broadcast signal according to the program progress timing and transmits it (step S130). Specifically, when the broadcast transmission device 2 detects that the elapsed time from the start of the program has reached the output time described in the output control information, the broadcast transmission device 2 reads out the object name corresponding to the output time and reads the broadcast signal. Is set as output instruction information in the event message and output.

  The receiving device 7 receives the broadcast signal in which the output control information is set (Step S135). The broadcast receiving unit 701 demodulates the received broadcast signal, and the separation unit 702 converts the video data, audio data, and other data separated from the demodulated broadcast signal into a video decoding unit 703, an audio decoding unit 704, and a broadcast, respectively. The data is output to the communication cooperation unit 721. When the broadcast communication cooperation unit 721 detects that the output instruction information is set in the event message, the broadcast communication cooperation unit 721 outputs the object name set in the output instruction information to the application execution unit 713, and instructs execution of the object output command. (Step S140).

  The application execution unit 713 executes an output command for the specified object, and from the application program being executed, the object name set in the output command information and the mode in which the input control unit 714 has received an input, or the default The component information corresponding to the mode is read out. When the component information indicates the acquisition destination, the application execution unit 713 accesses the acquisition destination content distribution apparatus 5 via the communication network 9 (step S145). The content distribution device 5 distributes the object components corresponding to the acquisition destination to the reception device 7 (step S150). If the component information indicates a file name, the application execution unit 713 acquires an object component from the application program.

  The application execution unit 713 outputs the acquired object component according to the output control information of the object component described in the application program. When the output method designation information is described corresponding to the object name, the output method designation information is applied to all the component element information corresponding to the designated object name. As a result, the application execution unit 713 outputs video data for displaying the object component according to the output method designation information to the video synthesis unit 722, and audio data for outputting the object component according to the output method designation information to the voice synthesis unit 723. Output.

  On the other hand, the video decoding unit 703 decodes video data corresponding to the time when the added PTS is output from the clock 741, and outputs the video data to the video synthesis unit 722. The video synthesizing unit 722 generates video data for outputting a video in which the video data input from the application execution unit 713 is superimposed on the video data input from the video decoding unit 703, and the video display unit 731 displays the video data. Display. Similarly, the speech decoding unit 704 decodes speech data corresponding to the time when the added PTS is output from the clock 741, and outputs the decoded speech data to the speech synthesis unit 723. The voice synthesizer 723 generates voice data that outputs a voice obtained by synthesizing the voice of the voice data input from the voice decoder 704 and the voice of the voice data input from the application execution unit 713, and the voice output unit 732. Is output as voice (step S155).

  The broadcast transmission device 2 continues to transmit a broadcast signal including program content data. When the elapsed time from the start of the program becomes the next output time described in the output control information, the process from step S130 is repeated, and the broadcast transmission device 2 reads the object name corresponding to the output time. And set it as an event message of the broadcast signal.

  In the above, the broadcast transmission apparatus 2 sets the object name corresponding to the output time in the output time described in the output control information, and outputs the broadcast signal. A broadcast signal may be set and transmitted. In this case, in the application program, an output command in which the object name to be output is associated with the component information for each mode is described. Differences from the above sequence are shown below.

  In step S130, when the broadcast transmission apparatus 2 detects that the elapsed time from the start of the program has reached the output time described in the output control information, the broadcast name is set to the object name corresponding to the output time and the object name. Read the corresponding output method specification information. The broadcast sending device 2 sets the read object name and output method designation information as output instruction information in the event message of the broadcast signal and sends it. The output method designation information corresponding to the object name is output method designation information applied to the entire object or output method designation information applied to each object component constituting the object.

  In step S140, the separation unit 702 outputs other data separated from the demodulated broadcast signal to the broadcast communication cooperation unit 721. When the broadcast communication cooperation unit 721 detects that the output instruction information is set in the event message, the broadcast communication cooperation unit 721 outputs the object name and output method designation information set in the output instruction information to the application execution unit 713, and outputs the object. Instructs execution of the instruction. In steps S <b> 145 to S <b> 155, when the application execution unit 713 executes the object output command and acquires the object component based on the component information corresponding to the object name, the acquired object component is instructed by the output instruction information. Video data and audio data to be output are output according to the output method designation information. For example, the application execution unit 713 controls the output of the object component on the assumption that the output method designation information is set in the CSS file.

The broadcast sending apparatus 2 sets the output method designation information of each object as a broadcast signal at the beginning of the program start, etc., instead of setting the output method designation information in the event message every time the object is output. Also good. The broadcast communication cooperation unit 721 of the broadcast transmission device 2 outputs the received output control information to the application management unit 711 and stores it in the application storage unit 712. The application execution unit 713 stores an object component corresponding to the object name in the application management unit 711 when executing an output command for the object having the object name specified by the output instruction information set in the broadcast signal. Video data and audio data to be output are output according to the output method designation information.
Or you may make it the broadcast communication cooperation part 721 hold | maintain output method designation | designated information. When the broadcast communication cooperation unit 721 detects that the output instruction information is set in the event message, the application execution unit 713 displays the object name set in the output instruction information and the output method designation information corresponding to the object name. Output to.

Next, the operation of the broadcasting / communication cooperation system when an object is output based on an output time described in an application program will be described.
FIG. 6 shows a sequence diagram of object control of the broadcasting / communication cooperation system when an object is output based on an output time described in the application program. In the sequence shown in the figure, the application program in which the output control information is set is distributed from the application distribution device 4 to the receiving device 7 by communication, and the receiving device 7 is described in the time from the start of the program and the output control information. The output command of the object is executed by collating with the output time. The receiving device 7 acquires the object component of the object to be executed from the application program or from the content distribution device 5 through communication, and outputs it in conjunction with the program.

  First, when performing display control of an object, a broadcaster or an application provider generates output control information like the example shown in FIG. The output control information generation device 3 outputs the generated output control information to the application distribution device 4 (step S205). The application creator creates an application program that includes all output control information. In the application program, an output command in which an object name to be output is associated with an object component for each mode is described. The output method designation information is described in, for example, a CSS file. The created application program is registered in the application distribution device 4 (step S210).

  When the broadcast transmission device 2 reaches the start time of the program linked with the application, the broadcast transmission device 2 outputs a broadcast signal in which the content data of the program is set (step S215). The broadcast receiving unit 701 of the receiving device 7 demodulates the broadcast signal, and the separation unit 702 converts the video data, audio data, and other data separated from the demodulated broadcast signal into a video decoding unit 703 and an audio decoding unit 704, respectively. And output to the broadcasting / communication cooperation unit 721. The video synthesis unit 722 causes the video decoding unit 703 to select and decode the decoded video data on the video display unit 731, and the audio synthesis unit 723 selects and decodes the audio decoding unit 704 based on the PTS. The voice output unit 732 outputs the voice that has been played.

  After the program starts, the broadcast transmission device 2 outputs a broadcast signal in which location information indicating the application program acquisition destination is set (step S220). The receiving device 7 performs the same processing as steps S120 to S125 in FIG. Thereby, the receiving device 7 accesses the application distribution device 4 to transmit an application program acquisition request (step S225), and stores the application program distributed from the application distribution device 4 (step S230).

  When the broadcast communication cooperation unit 721 detects the start of the application-linked program based on other data set in the broadcast signal received from the broadcast transmission device 2, the broadcast communication cooperation unit 721 instructs the application execution unit 713 to execute the application program (step S1). S235). For example, the broadcast communication cooperation unit 721 acquires the broadcast start time of the application-linked program from the SI, and detects the start of the program based on the coincidence of the time output by the clock 741 and the broadcast start time. The application execution unit 713 reads the application program from the application storage unit 712 and starts execution.

  When the application execution unit 713 refers to the output control information described in the application program and detects that the elapsed time from the start of the program is the output time described in the output control information, the application execution unit 713 responds to the output time. Read the object name. The application execution unit 713 executes an output command of the object with the read object name, and displays the component name corresponding to the object name from the application program and the mode received by the input control unit 714 or the default mode. read out. When the component information indicates the acquisition destination, the application execution unit 713 acquires the object component corresponding to the acquisition destination from the content distribution device 5, and when the component information indicates the file name, Get the object component.

  The application execution unit 713 reads output method designation information of each component information from the output control information. When the output method designation information is described corresponding to the object name, the output method designation information is set as the output method designation information of all the component element information corresponding to the object name. The application execution unit 713 outputs video data for displaying the acquired object component according to the output method designation information to the video synthesis unit 722, and outputs audio data for outputting the object component according to the output method designation information to the voice synthesis unit 723. To do.

  On the other hand, the video decoding unit 703 decodes video data corresponding to the time when the added PTS is output from the clock 741 and outputs the decoded video data to the video synthesis unit 722. The video synthesizing unit 722 generates video data for outputting a video in which the video data input from the application execution unit 713 is superimposed on the video data input from the video decoding unit 703, and the video display unit 731 displays the video data. Display. Similarly, the speech decoding unit 704 decodes speech data corresponding to the time when the added PTS is output from the clock 741, and outputs the decoded speech data to the speech synthesis unit 723. The voice synthesizer 723 generates voice data that outputs a voice obtained by synthesizing the voice of the voice data input from the voice decoder 704 and the voice of the voice data input from the application execution unit 713, and the voice output unit 732. Is output as voice (step S240).

  When detecting that the elapsed time from the start of the program is the next output time described in the output control information, the application execution unit 713 repeats the process of step S240.

Next, object output control by the user will be described.
The input control unit 714 of the reception device 7 notifies the application execution unit 713 of output stop when an application output stop instruction is input from the operation device by the user. The application execution unit 713 continues to execute the application program even when the output stop is received. After receiving the output stop, the application execution unit 713 stops the output of the video data and audio data of the object component in which “permit” is set in the user control permission information until the output permission is received. However, the application execution unit 713 outputs the video data and audio data of the object component for which “force” is set in the user control permission information.

  The input control unit 714 notifies the application execution unit 713 of output permission when the user outputs an application output instruction from the operation device. Upon receiving the output permission, the application execution unit 713 outputs the video data and audio data of the object constituent element, which is the execution result of the application program, regardless of the setting of the user control permission information.

  As a result, even when the user instructs to stop the output of the application, the receiving device 7 continues the output synthesized with the video and audio of the program for objects and object components that are not permitted to be controlled by the user. Only output objects and object components that are not allowed to be Therefore, while giving the user the right to determine whether or not to output an object, the application producer can output the object that is deemed necessary for production or the like.

In the above description, the case where the user control permission information indicates whether or not the user control is permitted for each object or each object component has been described. However, the display position, the display size, the transparency, the color, the effect, It may be information specifying whether or not to allow user control for each volume. In this case, when the application execution unit 713 receives an output stop notification from the input control unit 714, the output method of the item in which “force” is set among the output method designation information set in the user control permission information Video data and audio data of the object component to which is applied.
As a result, even when the user instructs the output stop of the object, the receiving device 7 can output the object that is considered necessary for the production of the application by the expression that seems necessary.

  When the input control unit 714 of the receiving device 7 receives an input of an output method change instruction from the operation device, the output method change instruction is output to the application execution unit 713. The output method change instruction is, for example, a change instruction that designates one or more items among the display position, display size, transparency, color, and volume. For the output method change instruction, specify the specific value (width and height values for display size) and setting values (for example, “blue” for color) after changing the items to be changed. It may be specified, or it may be specified by a change ratio with respect to the current setting (such as “1.5 times” if the display size).

  The application execution unit 713 changes the output method designation information of the object component based on the output method change instruction, and each of the video data and the audio data to be output by the output method designation information with the changed object component 722 and output to the speech synthesis unit 723. However, the application execution unit 713 does not change the output method designation information of the object or object component for which “force” is set in the user control permission information. In addition, when the user control permission information is information that specifies whether or not to allow user control for each of the display position, display size, transparency, color, effect, and volume, it is set not to allow user control. The output method specification information is not changed for the specified items.

  As a result, while allowing the user to customize the object output method, the object that the application producer seems to need for production or the like can be output in the output method intended by the producer.

In the above-described embodiment, the application program is distributed from the application distribution device 4 to the reception device 7. However, the application program is distributed by broadcast before the application execution start time by the broadcast wave from the broadcast transmission device 2. Also good.
Alternatively, the input control unit 714 of the reception device 7 may receive an instruction to acquire a user-specified application program from the operation device, and the application management unit 711 may acquire the specified application program from the application distribution device 4. Good.
When there are a plurality of application programs that can be linked with a program, the broadcast transmission apparatus 2 further sets information (for example, application name) for identifying the application program in addition to the object name in the broadcast signal.

  In the above embodiment, the broadcasting / communication cooperation unit 721 of the receiving device 7 detects the start of the program and instructs the execution of the application program. However, the input control unit 714 receives the application program from the operation device by the user. The execution instruction may be received. The input control unit 714 notifies the application execution unit 713 of the received execution instruction, and the application execution unit 713 reads the application program instructed to be executed by the execution instruction from the application storage unit 712 and executes it.

Further, the application execution unit 713 of the reception device 7 may acquire the object component before executing the object output command. When the object execution command is executed, the application execution unit 713 outputs video data and audio data of the object component selected according to the mode at that time.
The object component may be a caption or data broadcast object included in the broadcast signal.

  According to the embodiment described above, broadcasting and communication are linked, and the user's desired object is converted into video and audio of the program by an arbitrary output method set by the application producer while being highly linked with the progress of the program. The signals can be superimposed and output to the receiving device 7. As a result, it is possible to provide information with a high production effect, which has not been possible with conventional digital broadcasting.

Further, by providing the receiving device 7 with a function for the user to select a mode and a function for customizing the output of the object, an object that matches the user's preference is superimposed on the program by an output method that matches the user's preference. Can be output. For example, as an object to be used by an application program for displaying lines in a program, subtitle texts of the lines in the program and image files in which texts are written are prepared for a plurality of languages. When the user selects a mode, the receiving device 7 acquires a text or an image file corresponding to the language that the user wants to display, and displays the text or image file superimposed on the program. Thereby, information corresponding to multiple languages can be provided. In addition, the receiving device 7 can display the text in large characters or display it in a color that is easy to read.
In addition, the receiving device 7 can switch whether or not to display the object at any timing of the user. Also, even if the user instructs to stop the output of the object, the object necessary for the production etc. The output can be continued.

  The broadcast transmission device 2, the output control information generation device 3, the application distribution device 4, the content distribution device 5, and the reception device 7 described above have a computer system therein. The operation processes of the broadcast transmission device 2, the output control information generation device 3, the application distribution device 4, the content distribution device 5, and the reception device 7 are stored in a computer-readable recording medium in the form of a program. The above processing is performed by the computer system reading and executing this program. The computer system here includes a CPU, various memories, an OS, and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

DESCRIPTION OF SYMBOLS 1 Transmission apparatus 2 Broadcast transmission apparatus 3 Output control information generation apparatus 4 Application distribution apparatus 5 Content distribution apparatus 7 Reception apparatus 9 Communication network 701 Broadcast reception part 702 Separation part 703 Video decoding part 704 Audio decoding part 710 Communication input / output part 711 Application management Unit 712 application storage unit 713 application execution unit 714 input control unit 721 broadcast communication cooperation unit 722 video synthesis unit 723 audio synthesis unit 731 video display unit 732 audio output unit 741 clock

Claims (9)

A broadcast receiver for receiving broadcast signals;
An application management unit for acquiring an application program for executing output of an object by communication;
When the broadcast receiving unit receives the broadcast signal in which the application program is executed and the specific information of the object to be output is set, or the output timing of the object described in advance in the application program is set in the program By referring to the application execution unit that outputs the data of the object when it is detected that it is the output timing of the object,
A synthesizing unit that synthesizes and outputs the data of the object output from the application execution unit to the content data of the program acquired from the broadcast signal;
A receiving apparatus comprising: The application execution unit outputs the object data in accordance with the object output method set in the broadcast signal or the object output method described in advance in the application program.
The receiving apparatus according to claim 1. The output method is designation of one or more of display position, display size, transparency, color, animation operation, display effect, and volume.
The receiving device according to claim 2. An input control unit for receiving an instruction to change the output method by the user;
The application execution unit changes the output method according to the change instruction received by the input control unit, and outputs the object data according to the changed output method.
The receiving device according to claim 2, wherein the receiving device is a receiving device. An input control unit that receives an input of an output stop instruction and an output instruction of an object by a user;
The application execution unit stops outputting the data of the object until the input control unit receives the output instruction after receiving the output stop instruction.
The receiving device according to any one of claims 2 to 4, wherein the receiving device is configured as described above. The output method includes information on whether to allow user control for the output of the object,
The application execution unit is set to not allow user control to the corresponding output method until the input control unit receives the output instruction after the input stop instruction is input. To stop the output of the object data set to allow user control to the corresponding output method,
The receiving apparatus according to claim 5. In the application program, component information for specifying data of the object is described for each mode.
When the application execution unit detects that it is the output timing of the object, it outputs the data of the object specified by the component information corresponding to the mode specified by the user.
The receiving device according to claim 1, wherein the receiving device is a receiving device.
A broadcast sending device for sending a broadcast signal in which content data of a program is set;
An application distribution apparatus for distributing an application program for executing output of an object by communication;
An output control information generating device that generates output control information indicating the output timing of the object in the program,
When the broadcast sending device detects that the output timing is described in the output control information, the broadcast sending device sets the specific information of the object corresponding to the output timing to the broadcast signal and sends the broadcast signal.
Or
The application distribution device distributes the application program including the output control information.
A delivery device characterized by that. A computer used in a receiving device having a broadcast receiving unit for receiving a broadcast signal,
An application management unit for acquiring an application program for executing output of an object by communication;
When the broadcast receiving unit receives the broadcast signal in which the application program is executed and the specific information of the object to be output is set, or the output timing of the object described in advance in the application program is set in the program An application execution unit that outputs data of the object when it is detected that the output timing of the object is detected,
A synthesizing unit that synthesizes and outputs the object data output from the application execution unit to the content data of the program acquired from the broadcast signal;
A program characterized by functioning as

Images