JP2007116669A - Sub-content reproducing device and content-related service providing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a sub-content reproducing device by which some kind of processing in association with contents can be performed, while preventing unfairness among users at the time reliability is high. <P>SOLUTION: The sub-content reproducing device 52 includes: a sub-content accumulation section 162 which acquires and stores sub-contents, a related data receiving section 166 which acquires sub-content control information prepared for broadcast contents at the time of reproduction of the broadcast contents and a sub-content reproduction control section 170 which performs reproduction control corresponding to the sub-content control information with respect to the sub-contents stored in the sub-content accumulation section 162 in response to the acquisition of the sub-content control information by the related data receiving section 166. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a service providing system that provides a service linked to content such as broadcasting, and in particular, sub-content reproduction that reproduces sub-content related to the content in conjunction with the content to be reproduced when the content is reproduced. The present invention relates to an apparatus and a service providing system.

  Currently, TV (television) broadcasting is shifting from analog broadcasting to digital broadcasting. The main feature of digital broadcasting is that it can broadcast data other than broadcast contents in addition to the number of channels, high image quality, and high sound quality. This data broadcasting is hereinafter referred to as “data broadcasting”.

  In data broadcasting, data such as characters or programs is distributed to an unspecified number of terminals (TV receivers). The medium is a radio wave of satellite TV broadcast or terrestrial TV broadcast. Therefore, data broadcasting is performed by a broadcaster. By using the data broadcast and the information input function and communication function of the terminal, it is possible to realize a bidirectional (interactive) service in which the viewer makes an action on the TV broadcast.

  In the conventional interactive service, AV (audio visual) content and sub data associated with the AV content are transmitted to the terminal. The sub data includes BML data described in BML (Broadcast Markup Language). When this sub data is received, the terminal interprets and executes the sub data, and as a result, the broadcast content or information accompanying it is laid out and displayed by the terminal. The interaction by input at the terminal is realized by an ECMA script included in the BML data. Data including input contents is transmitted to a BML response server or the like via a telephone line, the Internet, or the like according to control by an ECMA script and processed.

  There is also an interactive service in which sub-contents intended to be linked to broadcasting are deployed on the terminal. In this case, it is necessary to use the sub-content at the terminal so as to link with the broadcast content in an intended manner.

  An interactive advertising device that provides such a service is disclosed in Patent Document 1. This interactive advertising apparatus delivers a message including information presented to the user in synchronization with the TV advertisement in advance to the user. This message includes the scheduled advertisement delivery time. The terminal has a timer and starts processing according to the message when the broadcast time of the advertisement in the distributed message comes.

Patent Document 2 discloses an interactive text broadcasting system used for a quiz program for competing for the elapsed time until answering. In this system, a broadcast station broadcasts a predetermined code included in broadcast information. When a terminal (for example, a remote controller of a TV receiver) receives this code, a counter in the terminal starts counting elapsed time. The terminal measures the elapsed time until the user presses a predetermined button. The terminal transmits the measured elapsed time to a predetermined destination. Patent Document 2 states that the predetermined code may be distributed separately from the broadcast information or distributed in the broadcast information.
JP 2003-308035 A (released on October 31, 2003) Japanese Patent Laid-Open No. 9-93551 (published April 4, 1997)

  In the device described in Patent Document 1, when the timer function in the terminal is falsified, the time that triggers the processing according to the message may be different from the intended time. Therefore, the reliability of interactive advertisement distribution by this device is low. In the apparatus of Patent Document 1, as described in Patent Document 2, the design may be changed so that a predetermined code included in broadcast information is used as a trigger. In this case, starting the message at a predetermined time can be realized. However, when processing such as measuring the elapsed time from activation with a timer in the terminal is performed, the reliability of time information to be aggregated is low due to the processing capability of the terminal or a delay in the distribution route.

  Furthermore, in the apparatus described in Patent Document 1, time information is embedded in a message. On the other hand, there is a one-to-one correspondence between messages and broadcasts. If there are a plurality of interactive advertisement services in one broadcast, the user needs to have a plurality of messages in the terminal at hand, which causes a problem that the resources of the terminal are greatly impaired.

  On the other hand, the system described in Patent Document 2 activates a counter in the terminal in response to a predetermined code, and acquires an elapsed time until a user operation based on the value of the counter. This elapsed time is transmitted to a predetermined destination. Therefore, there is no unfairness among users due to a delay in the distribution route. However, when the counter function in the terminal is tampered, there is a problem that the reliability cannot be obtained as in the apparatus described in Patent Document 1.

  Therefore, an object of the present invention is to perform execution of some processing by a sub-content to be provided to a user between users in a system that provides sub-content related to the main content as provided by a broadcast service. An object is to provide a sub-content playback apparatus and a content-related service providing system capable of preventing unfairness and performing at a highly reliable timing.

  A sub-contents playback device according to a first aspect of the present invention is a sub-contents playback device that plays back predetermined sub-contents related to first content in cooperation with the main first content, Sub-content control information for designating reproduction control related to sub-content associated with a predetermined timing at the time of reproduction of the first content is prepared in advance for one content. Storage means for acquiring and storing content, acquisition means for acquiring sub-content control information prepared in advance for the first content at the time of reproduction of the first content, and the acquisition means for sub-content control In response to the acquisition of information, the playback control corresponding to the acquired sub-contents control information is sub-contented. And a sub-contents control means for performing the sub-content stored in the storage means.

  The storage means of the sub-content reproduction apparatus acquires and stores the sub-content related to the first content at the same time as or before the distribution of the sub-content control information. When the first content is reproduced, the sub content control information associated with the predetermined timing is acquired by the acquisition means. When the acquisition unit acquires the sub content control information, the sub content control unit performs reproduction control on the sub content control information for the sub content stored in the storage unit. Although the sub-content is related to the first content but is different data, the corresponding reproduction control is performed by the sub-content control information at the timing when the sub-content control information is given. The processing determined by the provider of the sub-content control information for the sub-content can be executed at a timing determined by the provider of the sub-content control information, not by an arbitrary operation of the user of the sub-content playback apparatus. The timing is determined by the sub-content control information, and there is little risk of unfairness among users. Further, the combination of the sub content and the sub content control information can be freely performed. Therefore, the execution of sub-contents can be controlled in various ways. As a result, it is possible to provide a sub-contents reproducing apparatus capable of preventing unfairness among users and performing a certain process by the sub-content to be provided to the users at a highly reliable timing. .

  Preferably, the sub-content control information specifies either a sub-content data item to be controlled and a sub-content stored in the sub-content stored in the sub-content storage means, and the sub-content control means In response to the acquisition of the sub-content control information by the acquisition unit, the sub-content data item specified by the sub-content control information or the reproduction control corresponding to the acquired sub-content control information Means for performing.

  The means for executing the reproduction control can execute the reproduction control corresponding to the acquired sub content control information for the sub content data item specified by the sub content control information or the sub content. That is, an appropriate one of the sub content data item and the sub content can be reproduced based on the sub content control information. Therefore, execution of appropriate sub-contents can be controlled in various forms. As a result, it is possible to provide a sub-contents reproducing apparatus capable of preventing unfairness among users and performing a certain process by the sub-content to be provided to the users at a highly reliable timing. .

  Preferably, the first content is distributed by broadcasting.

  Preferably, the acquisition unit includes a unit for receiving the sub content and the sub content control information from the same route as the route for acquiring the first content.

  The acquisition unit can receive the sub content and the sub content control information from the same route as the route for acquiring the first content, for example, the broadcast route. A set of sub-content and sub-content control information corresponding to the first content can be received together with the first content, or can be received at another timing when the broadcast path is vacant. That is, related data can be received efficiently. As a result, there is provided a sub-contents reproduction device capable of performing some processing by the sub-content to be provided to the user while preventing unfairness among the users and efficiently at a highly reliable timing. Can be provided.

  Preferably, the acquisition unit includes a unit for receiving the sub content and the sub content control information from a route different from the route for acquiring the first content.

  The acquisition unit receives the sub content and the sub content control information from a route different from the route for acquiring the first content. Since the sub-content and the sub-content control information are received through a route different from the route for acquiring the first content, the sub-content and the sub-content control information are caused by a problem that has occurred in the route for acquiring the first content. Adverse effects on the reception of. As a result, there is provided a sub-contents reproducing apparatus capable of preventing unfairness among users and surely performing a certain process with sub-contents to be provided to users at a reliable timing. Can be provided.

  Preferably, the first content is delivered with the sub-contents control information superimposed thereon, and the acquisition means receives the first content and receives for separating the sub-contents control information from the received first content. Including means.

  The acquisition unit receives and separates the sub-contents control information distributed on the first content. That is, the first content and the sub content control information are simultaneously delivered together, and the corresponding sub content control information can always be used when the first content is reproduced. As a result, it is possible to provide a sub-contents reproducing apparatus capable of preventing unfairness among users and performing a certain process by the sub-content to be provided to the users at a highly reliable timing. .

  Preferably, the first content is distributed without superimposing the sub-contents control information, and the acquisition unit includes a receiving unit for separately receiving the first content and the sub-contents control information.

  The obtaining means receives the first content and the sub-contents control information separately without superimposing them. If one of them experiences a data loss during distribution, the loss is not as good as the other. As a result, there is provided a sub-contents reproducing apparatus capable of preventing unfairness among users and surely performing a certain process with sub-contents to be provided to users at a reliable timing. Can be provided.

  More preferably, the sub-content includes one or more sub-content data items. Each of the one or more sub-content data items includes process specifying information for specifying a process for the sub-content data item, and trigger specifying information for specifying sub-content control information that triggers execution of the process. Are included in association. A sub-contents control unit, a determination unit for determining whether the acquired sub-contents control information matches any of the trigger specifying information included in one or a plurality of sub-contents data items; In response to determining that the received sub-contents control information matches any of the trigger identification information, the process identification information is determined by the process identification information corresponding to the trigger identification information. The process execution means for performing with respect to the sub content data item containing is included.

  When any of the trigger identification information included in any of the sub-content data items matches the acquired sub-content control information, the process identified by the process identification information corresponding to the trigger identification information in the sub-content data item Is performed on the sub-content data item. By creating and distributing sub-contents having such a structure in advance, the service provider executes a desired process among the intended various processes at a desired timing with respect to the desired sub-content data item. In this way, the sub-content playback device can be controlled. As a result, the service provider's intended service can be provided to a large number of sub-contents playback device users at a timing that reliably matches the service provider's intended timing while preventing unfairness among the users. It is possible to provide a sub-content playback device that can be provided.

  More preferably, the determining means includes means for determining whether or not the sub content control information acquired by the acquiring means matches a predetermined data string specified by any of the trigger specifying information.

  The determination is made based on whether or not the predetermined data string specified by the trigger specifying information matches the sub content control information. Therefore, a simple determination process in the sub-contents playback device provides the service intended by the service provider at a timing that reliably matches the timing intended by the service provider while preventing unfairness among users. It is possible to provide a sub-content playback apparatus that can perform the above-described process.

  The determining means includes means for specifying, among each of one or a plurality of sub-content data items, that the trigger specifying information of the sub-content data item matches the sub-content control information acquired by the acquiring means. The process execution means, for each of the sub-content data items specified by the specifying means, among the trigger specification information included in the sub-content data items, matches with the acquired sub-content control information And a means for executing a process specified by the process specifying information associated with.

  For each of the sub content data items having the trigger specifying information specified by the specifying means, processing corresponding to the trigger specifying information is executed. Since multiple processes can be executed with a single trigger identification information, the intention of the service provider is achieved at a timing that matches the service provider's intended timing with high reliability while preventing unfairness among users. It is possible to provide a sub-content playback device that can provide a variety of services.

  Preferably, the process specifying information includes sub-content activation information for instructing activation of the corresponding sub-content data item, and sub-content end information for instructing the end of the corresponding sub-content data item.

  The start and end of sub-content can be controlled from the outside.

  More preferably, the process specifying information further includes message transmission information for instructing generation of a message including data generated by the corresponding sub-content data item and transmission to a predetermined transmission destination.

  In the sub-contents reproducing apparatus that has received the message transmission information, a predetermined message is created and transmitted to a predetermined transmission destination. Interactive processing can be realized instead of one-way processing.

  Preferably, each of the one or more sub-content data items is unique information of the sub-contents playback device for designating execution control of the process specified by the process specifying information for the corresponding sub-content data item Contains verification information to be verified. The sub-content control means is a means for determining whether or not the collation information included in any one or a plurality of sub-content data items matches the unique information of the sub-contents playback device. In response to the determination that the collation information included in one or more of the sub-content data items matches the unique information of the sub-contents playback device, the processing by the processing execution unit is permitted. Or means for discontinuing.

  The means for determining permits or cancels the process by the process executing means when it is determined that the collation information included in the sub-content data item matches the unique information possessed by the sub-content reproduction apparatus. Depending on the determination using the collation information, the processing by the processing execution means can be executed or stopped. As a result, it is possible to provide a sub-contents reproduction device that can change processing by the sub-contents reproduction device.

  The process specifying information may further include data acquisition information for instructing acquisition of a document specified by the corresponding sub content data item.

  The document specified by the sub-content data item can be changed in real time based on various information, for example, even during provision of the first content. By giving the data acquisition information to the sub-contents reproducing device at a predetermined timing, the sub-contents reproducing device can be operated so as to acquire this document at a timing determined by the service provider. As a result, for example, the messages transmitted from the sub-contents playback device are aggregated, and the documents from the sub-contents playback device are reflected in real time by dynamically creating documents according to the results. Services can be provided.

  More preferably, the means for executing the processing includes sub-content data items specified by the specifying means that include the trigger specifying information that matches the acquired sub-content activation processing, as another sub-data item. Means for starting independently from the content data item, and includes trigger specifying information that matches the acquired sub-content end processing among the sub-content data items specified by the specifying means, and for starting Means for terminating the one activated by the means independently of the other sub-content data items.

  A plurality of sub-content data items are activated independently and terminated independently. As a result, in the sub-content playback apparatus, a plurality of sub-content data items may be executed in parallel. By preparing the sub-content data in advance on the premise of parallel operation, one or a plurality of sub-content data can be provided to the user individually or in parallel in various forms along the time axis.

  The receiving means may include means for receiving the first content by broadcasting, and the sub-content playback device may further include content playback means for playing back the first content received by the broadcasting.

  The first content and the sub-content are received by one route called broadcasting, and are simultaneously reproduced by one sub-content reproducing device. As a result, the user of the sub-content playback apparatus can use a service combining the main content and the sub-content as long as the sub-content playback apparatus is present.

  A mobile terminal according to a second aspect of the present invention receives a first content, reproduces the received first content, any of the above-described sub-content reproduction devices, and content reproduction A sub-content reproduction device that acquires the sub-content linked to the first content received by the content reproduction device, and the obtaining means obtains the first content. In accordance with the sub-content control information acquired in relation to the sub-contents, the sub-content playback apparatus executes a predetermined process for the sub-contents.

  The portable terminal executes a predetermined process on the acquired sub-content according to the sub-content control information acquired by the acquisition means in relation to the first content. Therefore, it is possible to perform appropriate processing on the acquired sub-content based on the transmitted sub-content control information. As a result, it is possible to provide a portable terminal that can perform appropriate processing on the acquired sub-content.

  A content-related service providing system according to a third aspect of the present invention is a content providing apparatus that provides first main content, and content reproduction for receiving and reproducing the first content from the content providing apparatus. Including the device. The content-related service providing system further includes a sub-content providing apparatus that provides sub-content related to the first content, and a sub-content that triggers a predetermined process for the sub-content at a predetermined timing when the first content is reproduced. A sub-contents control information providing device that provides control information to the content reproduction device. The content playback apparatus acquires storage means for acquiring and storing sub-contents from the sub-content providing apparatus, and acquires sub-content control information for the first content from the sub-content control information providing apparatus when the first content is played back In response to the acquisition of the sub-contents control information acquired by the acquisition means and the sub-contents stored in the sub-content storage means in response to the acquisition of the sub-contents control information. Sub-content control means for performing.

  The storage means of the sub-content playback apparatus acquires and stores the sub-content related to the first content at the same time as or before the acquisition of the sub-content control information. When the first content is reproduced, the sub content control information associated with the predetermined timing is acquired by the acquisition means. When the acquisition unit acquires the sub content control information, the sub content control unit performs reproduction control on the sub content control information for the sub content stored in the storage unit. Although the sub-content is related to the first content but is different data, the corresponding reproduction control is performed by the sub-content control information at the timing when the sub-content control information is given. The processing determined by the provider of the sub-content control information for the sub-content can be executed at a timing determined by the provider of the sub-content control information, not by an arbitrary operation of the user of the sub-content playback apparatus. The timing is determined by the sub-content control information, and there is little risk of unfairness among users. As a result, it is possible to provide a content-related service providing system that can provide any service based on the sub-content to be provided to the user while preventing unfairness among the users and at a highly reliable timing. .

  According to the sub-content playback apparatus and the content-related service providing system according to the present invention, the sub-content related to the first content is prepared in advance, and the sub-content control information is provided to the sub-content playback apparatus at a predetermined timing. By this mechanism, the sub-content held by the sub-content playback device is controlled. Therefore, the operation intended by the sub-content provider is performed on the sub-content at the timing as intended by the sub-content provider. Since the sub-content is controlled by the sub-content control information, unlike the processing by the user, the sub-content is not controlled at an inappropriate timing, and unfairness between users does not occur.

  Hereinafter, broadcast content cooperation service systems according to first and second embodiments of the present invention and modifications thereof will be described with reference to the drawings. In the drawings, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated. In the following description of the embodiments, the following terms are used in the following meanings.

  First, the first content is distributed by broadcasting, and is referred to as “broadcast content” in the following description. Broadcast content refers to a combination of program AV data corresponding to the contents of a television broadcast and broadcast content sub-data described below. The program AV data may include CM (Commercial Message) AV data.

  In the embodiments described below, broadcast content is data that is reproduced in real time when received. In the embodiment described below, the broadcast content is limited to the case where the broadcast content is reproduced in real time. However, the broadcast content may not be data reproduced in real time. For example, the broadcast content may assume a case where the received data is stored in a recording medium, and then the data is called and reproduced and viewed.

  “Broadcast content sub-data” is a generic term for sub-content control information and message usage information described below.

  “Sub-content control information” is data for controlling the start, playback, and termination of sub-content described below. This information may be included in the broadcast content and distributed to the terminal, or may be distributed to the terminal at a predetermined timing through a route different from the route where the broadcast content is distributed. Further, this information may be delivered to the terminal at the same timing as the broadcast content or at a different timing, even when the same route as the route through which the broadcast content is delivered. The sub content control information is distributed via various media. For example, distribution by Bluetooth (registered trademark) and infrared communication is also possible.

  When the sub content control information is transmitted together with the broadcast content, the sub content control information is included in the broadcast content and transmitted. In this case, the sub content control information may be superimposed on the broadcast content. In addition, characters and image information possessed by the broadcast content itself may be used as the sub content control information.

  Even when the sub content control information is not superimposed on the broadcast content, the sub content control information can be transmitted. The route for delivering the sub-content control information is the same as the route for delivering the broadcast content, and delivery is also possible by a method of delivering using a vacant band.

  “Message usage information” is data used when a sub-content forms a message. The message usage information is distributed to the mobile terminal along with the broadcast content. This message usage information includes, for example, time.

  “Sub-content” refers to information necessary for providing a predetermined service in a terminal in cooperation with broadcast content. The sub-content is received together with data specifying the display layout when displaying information related to the service on the terminal (layout specifying data), data indicating the structure and destination of the message transmitted from the terminal to a predetermined destination, and broadcast content The sub-content control information to be interpreted is included, and any of the information for executing activation / playback / termination of the sub-content, or any combination thereof is included. In the following embodiment, the sub-content is distributed via broadcasting or a communication network.

  When sub-content is distributed from a broadcast route, the sub-content is included in the broadcast content and distributed. At this time, the sub-content may be delivered to the terminal at the same timing as the broadcast content or at a different timing through the same route as the broadcast content delivery route. However, it may be distributed via other media. For example, distribution by Bluetooth (registered trademark) and infrared communication is also possible. The sub-content includes a plurality of sub-content data items that can be activated and terminated independently. Sub-content data items can also be nested within each other.

  There may be one or a plurality of sub contents linked to one broadcast content. One or more broadcast contents may be linked to one sub-content.

  In the present embodiment, the sub-content is created in an XML (eXtensible Markup Language) format. However, the present invention is not limited to this, and any content that can be linked to broadcasting such as clip data including image and moving image information, EPG (Electric Program Guide), and content on the Web may be used.

  As the cooperation between the broadcast content and the sub-content in the first embodiment, the cooperation with the quiz program is assumed. However, content that can be linked with broadcasting is not limited to such close linkage. For example, when the sub-content is an EPG indicating a program guide, cooperation is possible even in the case of sparse cooperation in which a character string in the program guide is transmitted as message usage information.

  Accordingly, as described above, the sub-content is not limited to one-to-one correspondence with the main broadcast content. The sub-content may be dense sub-content provided by the service provider with respect to the main broadcast content or sparse EPG data. Moreover, both of these may cooperate with broadcast content at the same time.

  The sub-content may be a template that operates on the terminal. A template is content composed of a script file describing information and operation of a terminal, and one or a plurality of media data. If this template is used, the user can ensure an operation to be requested only by an operation according to a displayed UI (user interface).

  “Sub-content control determination information” is a part of sub-content, and is information used for condition determination when interpreting the received sub-content control information and executing start / play / end of the sub-content. Say.

[First Embodiment]
Hereinafter, the broadcast content cooperation service system according to the first embodiment of the present invention will be described with reference to FIGS.

<Configuration>
FIG. 1 shows a schematic configuration of a broadcast content cooperation service system 40 according to the present embodiment. In the first embodiment, an example is a service in which the broadcast content is a quiz program and the viewer answers the quiz from a mobile terminal (for example, a mobile phone). In system 40 according to the present embodiment, it is assumed that sub-contents related to broadcast content are acquired by a mobile terminal prior to broadcast or simultaneously via broadcast or a network.

  In this quiz program, when a quiz question screen is displayed by broadcasting, an answer screen for a quiz defined by sub-contents is displayed in a predetermined layout together with the question screen. A plurality of choices are displayed on the answer screen. When the user selects one of the options, the result is temporarily stored in the terminal. At a timing determined by the sub-contents control information, information indicating an answer is transmitted to the service provider's server related to the quiz program via the network. The server aggregates responses from a plurality of terminals, creates new contents, and distributes them to the terminals via the network. The terminal receives and stores this content. Then, at the timing when the terminal receives another sub-content control information, the broadcast content and the sub-content screen are displayed in a layout designated in advance by the sub-content.

  Referring to FIG. 1, a broadcast content cooperation service system 40 receives a program producer 42 for creating broadcast content (program) and a broadcast content produced by the program producer 42 via a network 46 and is designated. A broadcaster 44 that broadcasts at a certain time, and one or a plurality of portable terminals 48 for playing back broadcast content and sub-contents broadcast by the broadcaster 44. The portable terminal 48 can communicate with the equipment of the program producer 42 via the network 46.

  The program producer 42 has a broadcast content creation device 60 for creating content to be broadcast (broadcast content) and a sub-content creation device 62 for creating sub-contents related to the broadcast content. These broadcast content and sub-content are combined as will be described later to form content broadcast by the broadcaster 44. The program producer 42 further has a broadcast content related service providing apparatus 64 for providing a service related to the broadcast content to the user of the portable terminal 48. All of the devices 60, 62, and 64 can communicate with other devices via the network 46.

  The broadcaster 44 can communicate with the devices 60 and 62 owned by the program producer 42 and synthesizes and broadcasts the broadcast content received from the broadcast content creation device 60 and the sub-content received from the sub-content creation device 62. Content synthesizing device 70 having a function of creating content for the purpose of performing, and a relay station 72 for broadcasting the content synthesized by the content synthesizing device 70 by digital broadcasting.

  The mobile terminal 48 separates broadcast content and other data from the content broadcast from the relay station 72, reproduces the broadcast content, and outputs data other than the broadcast content. , For holding sub-contents given from the broadcast content playback device 50 and playing back the sub-contents by executing processing according to the sub-contents in response to the sub-content control information given from the broadcast content playback device 50 And a sub-content playback device 52.

  This system takes a form in which a broadcaster distributing broadcast contents is divided into a program producer and a broadcaster. Therefore, the two traders are connected by the communication network 46. However, in other system configurations, it is not always necessary to transmit / receive broadcast content and sub-contents via the communication network 46. For example, the broadcaster may play the role of a program producer, or the program producer may play the role of a broadcaster at the same time. In such a case, the communication network 46 is not necessary.

  Referring to FIG. 2, broadcast content creation device 60 is designed and prepared in advance according to AV data storage unit 80 for storing AV data for broadcast programs, and the contents of AV data and sub-contents. Broadcast content sub-data storage unit 82 for storing broadcast content sub-data, AV data stored in AV data storage unit 80 and broadcast content sub-data stored in broadcast content sub-data storage unit 82 are combined. A broadcast content creation unit 84 for creating broadcast content, and a broadcast content transmission unit 86 for transmitting the broadcast content created by the broadcast content creation unit 84 to the content composition device 70 via the network 46 are included. The AV data storage unit 80 and the broadcast content sub data storage unit 82 are configured by a storage device such as an HDD (hard disk drive). In the present embodiment, the broadcast content creation unit 84 includes a storage device such as a RAM (Random Access Memory) or a flash memory, a CPU (Central Processing Unit), and a program stored in the storage device. This is realized by the CPU executing.

  Referring to FIG. 3, sub-content creating apparatus 62 receives a message storage unit 90 for storing a message created in advance by a service provider to cooperate with broadcasting, and what sub-content control information is received. A sub-contents control determination information storage unit 92 for storing sub-contents control determination information for specifying what kind of processing is to be executed, a template storage unit 98 for storing a template that is a prototype of the sub-contents, An operation unit 100 for receiving an operation instruction by a user, and a message stored in the message storage unit 90 for a template stored in the template storage unit 98 according to an instruction received from the operator via the operation unit 100 Sub-contents control determination information stored in the sub-contents control determination information storage unit 92 By combining appropriate of, and a sub content creation unit 94 for creating a sub-content.

  The message storage unit 90 and the sub content control determination information storage unit 92 are configured by a storage device such as an HDD. The sub-content creating unit 94 is realized by the CPU executing a program stored in a storage device such as a RAM or a flash memory.

  The sub-content creation device 62 is further connected to the sub-content storage unit 102 for storing the sub-contents created by the sub-content creation unit 94 and the network 46, and receives a sub-content transmission request via the network 46. A sub-content distribution unit 104 for reading out the designated sub-content from the sub-content storage unit 102 and sending it back, or transmitting it to the mobile terminal 48 registered in advance at a predetermined time, and a content composition device 70 ( When the transmission request from FIG. 1 is received, the sub content is read from the sub content storage unit 102 and transmitted to the content composition apparatus 70 via the network 46.

  In the present embodiment, the sub content is created in the XML format.

  Referring to FIG. 4, content synthesizing device 70 includes broadcast content receiving unit 110 for receiving broadcast content from broadcast content creating device 60 and sub-content receiving unit for receiving sub-content from sub-content creating device 62. 112, and the broadcast content and sub-content received by the broadcast content receiver 110 and the sub-content receiver 112 are combined to produce a TV program video and audio, and content that is reproduced as data accompanying the TV program. A content composition unit 114 for creating and a content transmission unit 116 for transmitting the content of the TV program synthesized by the content composition unit 114 to the broadcaster 44 via the network 46 are included. The broadcaster 44 broadcasts the content of the received TV program from the relay station 72 at a predetermined broadcast time.

  The synthesizing by the broadcast content synthesizing unit 114 means that the sub-content is not included in the data of the broadcast content and the portable terminal 48 can receive the format. Accordingly, both broadcast content and sub-content are distributed via the relay station, but the data is transmitted separately.

  The timing at which the broadcast content and the sub-content are transmitted may be simultaneous or different. In the case of different timings, it is assumed that the sub-content is linked with the broadcast content. Therefore, in this case, it is desirable that the sub content is distributed at a time before the time when the corresponding broadcast content is distributed.

  The broadcast content composition unit 114 may include sub-contents in the broadcast content data.

  Referring to FIG. 5, broadcast content reproduction apparatus 50 shown in FIG. 1 includes a broadcast receiving unit 130 for receiving TV program content broadcast by relay station 72, an input unit 140 that accepts user operations, A content accumulating unit 132 for accumulating content received by the broadcast receiving unit 130 and outputting content specified by the user in accordance with an instruction from the input unit 140, and a first input for receiving an output from the broadcast receiving unit 130 A selection unit 133 having a second input for receiving the output of the content storage unit 132, and selecting and outputting a signal input to either the first input or the second input according to the setting; The content output by the unit 133 is analyzed, and the broadcast content and accompanying data other than the broadcast content (broadcast content sub-data or sub-content) The same shall apply hereinafter.) Content analysis unit 134 for outputting separately, AV data reproduction unit 136 for reproducing broadcast content output from content analysis unit 134 and outputting video and audio signals, AV data An output unit 142 including a liquid crystal display device and a speaker for outputting video and audio signals output from the playback unit 136, and broadcast content sub-data and sub-content output from the content analysis unit 134 to the sub-content playback device 52. And an accompanying data transmission unit 138 for transmission. Note that the accompanying data transmission unit 138 and the sub-content reproduction device 52 are directly connected in the present embodiment.

  Referring to FIG. 6, sub-content playback apparatus 52 is connected to network 46, and receives sub-content receiving section 160 for receiving sub-contents transmitted from sub-content creating apparatus via network 46. FIG. The accompanying data receiving unit 166 for receiving the accompanying data transmitted from the accompanying data transmitting unit 138 shown and separating the accompanying data into broadcast content sub-data and sub-content, and the sub received by the sub-content receiving unit 160 And a sub-content storage unit 162 for storing the sub-contents received by the content and accompanying data reception unit 166. The sub-content receiving unit 160 is used when receiving sub-contents from a sub-content creating apparatus or the like via a network. However, in the present embodiment, the sub-content playback apparatus 52 only includes sub-contents included in broadcast waves. Is assumed to be used. Therefore, sub-content receiving unit 160 is not used in sub-content playback apparatus 52 according to the present embodiment.

  The sub-content reproduction device 52 further analyzes the broadcast content sub-data output from the associated data receiving unit 166, identifies the sub-content control information and the message usage information from the broadcast content sub-data, separates them, and outputs them. Data analysis unit 168 and sub-content analysis for analyzing sub-content stored in sub-content storage unit 162 and identifying and outputting layout information, message transmission destination, message structure, and sub-content control determination information from the sub-content Unit 164, sub-content control information output from broadcast content sub-data analysis unit 168, and sub-content control determination information output from sub-content analysis unit 164, it is determined in what form the sub-content is to be reproduced. , Layout required for playback And a sub-contents reproduction control unit 170 for outputting the broadcast and sub-contents to be displayed. The sub content reproduction control unit 170 also has a function of outputting the message usage information output from the sub content analysis unit 164 separately.

  Further, the sub-content playback device 52 further performs a process of acquiring data specified by the sub-content playback control unit 170 from the broadcast content-related service providing device 64 in accordance with an instruction from the sub-content playback control unit 170. A sub-content layout for determining the display layout on the output unit 142 based on the data acquired by the message acquisition unit 180, the layout information output by the sub-content reproduction control unit 170, and the sub-contents, and giving the display layout to the output unit 142 Part 172. The sub contents laid out by the sub content layout unit 172 may include a screen for inputting a message by the user. This screen is, for example, an answer screen for a quiz.

  The sub-content playback device 52 further receives data input by the user using the terminal-specific information storage unit 182 for storing the specific information of the sub-contents playback device 52 and the message input screen output from the sub-content layout unit 172. Message input unit 174, data input by the user output from message input unit 174, message usage information output from broadcast content sub-data analysis unit 168, and terminal specific information stored in terminal specific information storage unit 182 The message shaping unit 176 for creating a message to be transmitted to the destination designated by the sub content in a predetermined format and at the timing designated by the sub content reproduction control unit 170, and the message shaping unit 176 Message And a message transmission unit 178 for transmitting via network 46.

  Referring to FIG. 7, broadcast content related service providing apparatus 64 owned by program producer 42 shown in FIG. 1 includes message receiving unit 200 for receiving a message from a terminal via network 46, and message receiving unit 200. The received message is analyzed, message determination information indicating which service the message corresponds to in the message content, and elapsed time information and answer information included in the message until the answer to the quiz Message analysis unit 202 for separating and outputting, and message determination information output from message analysis unit 202, and posting information for determining which service the message received by message reception unit 200 corresponds to Progress output from the determination unit 206 and the message analysis unit 202 The time information and reply information, and an input content storage unit 208 for storing in association with the specific information of the service that has been determined by the post information determination unit 206. The reason why the post information determination unit 206 determines the correspondence between the message and the service is that there can be a plurality of services for one broadcast content.

  For example, in the quiz program shown in this embodiment, the first question and the second question are considered as different services. However, the contents posted for these questions commonly include the answer of the problem and the elapsed time information from the question assignment to the answer selection. If the received message contains information to distinguish the problem, the user can answer multiple problems (enjoy multiple services) using the same sub-content and the same message format. become. By storing the posting contents and the services to which they correspond in association with each other in the input content storage unit 208, the program producer can distinguish which problem the posting is for the broadcast program, and for each problem Can be easily counted.

  The broadcast content related service providing apparatus 64 further causes the sub-contents reproducing apparatus 52 to display information that changes in real time during the service based on the elapsed time information and answer information for each service stored in the input content storage unit 208. A response message creating unit 212 for creating a message for receiving the message, and a message response unit 210 for returning the message created by the response message creating unit 212 to the transmission source of the message received by the message receiving unit 200.

  The message created by the response message creation unit 212 is specifically as follows. In the present embodiment, in the quiz program service provided by the program producer 42, the result of counting the quizzes posted by the viewer via the mobile terminal 48 (accuracy rate, etc.) or the response rank of each viewer in the quiz And create messages that change dynamically during the service. The input content storage unit 208 includes a storage device such as a flash memory or an HDD. The response message creation unit 212 includes a program created in a predetermined format.

  FIG. 8 shows the configuration of the sub content. Referring to FIG. 8, sub-content 230 includes layout information 240 that is information relating to the display layout of the screen including the sub-content, message information 241 necessary for creating a message created by message shaping unit 176, And sub-contents control determination information 246 including conditions for controlling the start and end of the sub-contents.

  The layout information 240 includes layout designation information 250 that designates the display layout of the screen and display content designation information 252 that designates the display contents. The layout information 240 is interpreted by the sub content layout unit 172 of the sub content reproduction device 52 shown in FIG. The output unit 142 reproduces the designated sub-content with the designated layout in accordance with the layout information 240.

  The message information 241 includes a plurality of message templates for each problem type. Each template includes message transmission destination information 242 that is information indicating the transmission destination of the message, and message structure information 244 that is information indicating the structure of the created message.

  The message structure information 244 includes message determination information 260 that is information for specifying a correspondence between a message to be transmitted and a service related to the message. The posted information determination unit 206 shown in FIG. 7 determines which service the received message corresponds to based on the message determination information 260.

  The sub-contents control determination information 246 includes sub-content activation determination information 270 that serves as a reference for determining whether or not the sub-content should be activated, and sub-content end determination information that serves as a reference for determining whether or not the sub-content should be terminated. 272. The sub content control determination information 246 is an analysis target in the sub content analysis unit 164 of the sub content reproduction device 52. In this way, a group of descriptions in the sub-content that can be determined for activation and / or termination and can be activated or terminated according to the determination is called “sub-content data item”. These can be activated and terminated independently of each other.

  Note that the description order of each piece of information of the sub-content 230 may be fixed in a predetermined format, or may be freely defined in the form of a tag and its contents as in the XML format. In the present embodiment, it is assumed that the sub content 230 is in the XML format.

  9 and 10 show specific examples of the sub content 230 in the XML format. FIG. 9 shows the first half of the sub-content 230, and FIG. 10 shows the second half thereof.

  Referring to FIGS. 9 and 10, sub-content 230 includes layout information 250, sub-content activation determination information 290, display content designation information 252, first message transmission destination information 242, and first message structure. Information 244, second message destination information 246, and second message structure information 248 are included.

  In the present embodiment, layout information 250 is described in a <layout> tag. As layout information, it is assumed that the screen size is 640 pixels wide × 480 pixels high, the entire region (id = video_full), a region 320 pixels wide × 240 pixels high (id = video), and 320 pixels wide. The upper right region (id = right_top) having a height of 140 pixels, the lower right region having a width of 320 pixels × 100 pixels in height (id = right_bottom), the lower region having a width of 320 pixels × height 100 (id = bottom), and the like It is specified.

  Referring to FIG. 9, sub-contents activation determination information 290 that starts with a seq tag is displayed in a series according to display content designation information 252 described between the seq tag and the seq end tag (</ seq>). Sub-contents activation determination, which is information for determining which sub-contents control information is received and which series of display starts when it is received and which sub-contents control information is ended Information 270 and sub-content end determination information 272.

  The sub-content activation determination information 270 indicates that a series of display indicated by the display content designation information 252 should be started when the sub-content control information “iq_200506101900_start” is received. The sub-content end determination information 272 indicates that this series of display should be ended when the sub-content control information “iq_200506101900_end” is received.

  Display content designation information 252 receives display content designation information 292 on the main screen indicating that the TV screen is initially displayed on the entire output screen, and predetermined sub-content control information after display content designation information 292 on the main screen. Quiz screen display content designation information 294 for designating that a plurality of screens for sub-contents (the screen of the first question of the quiz in this embodiment) should be displayed in parallel, and the display content of the quiz screen After the display by the designation information 294 is finished, when the display content designation information 303 on the main screen indicating that the TV screen is displayed on the entire output screen and the predetermined sub-content control information after the main screen is displayed are received. The quiz screen display content designation information 304 for designating that the second question screen should be displayed in parallel, and the last main screen display content designation information 316 Including the.

  In the example illustrated in FIG. 9, a word (“region” attribute) described after the keyword “region =” indicates an area where the screen is to be displayed. For example, “region = video_full” as in the display content designation information 292 on the main screen indicates that the designated content should be displayed using the entire screen (for example, width 640 pixels × height 480 pixels). In the present embodiment, the areas specified by “region =” include “right_top”, “right_bottom_1”, “bottom”, “right_bottom”, and the like, which are defined in advance. It is desirable that the name of this area specifically indicates the position of the actual area.

  The “video” tag of the display content designation information 292 on the main screen indicates that AV data of broadcast content should be displayed on this screen.

  In the example shown in FIG. 9, the display content designation information 294 of the quiz screen is represented by a <par> tag, and when the sub-contents control information “problem_1” is received, the display of this quiz screen should be started. When sub-contents control information “problem_1_end” is received, the display of this quiz screen is to be terminated.

  The display contents and the sequence of the quiz screen are indicated by the screen sequence information 296 described between the par tag and the par end tag (</ par>. When the display contents are specified by the par tag, each screen is displayed. The start and end of display are specified by the sub-content control information, and when a plurality of screens are in the display state, they are displayed on the screen simultaneously in parallel with each other.

  In the example shown in FIG. 9, the screen sequence information 296 includes sub-contents activation determination information 295 on the main screen, sub-contents activation determination information 298 corresponding to the question display screen for the first question of the quiz, and answers to the first question. It includes sub-contents activation determination information 300 corresponding to an answer screen that displays options, and sub-contents activation determination information 302 corresponding to a screen that displays the total results of responses to the first question. Each of these sub-content activation determination information includes a description (draw_begin =) that specifies sub-content control information that specifies display start timing, that is, information that specifies sub-content control information that triggers the activation of sub-content, It includes a description (src =) that specifies the target sub-content and a description (region =) that specifies the display area. In the case of sub-content that receives an input, such as the sub-content activation determination information 300 corresponding to the answer screen, it further includes a description (message =) that specifies a message to be transmitted when there is an input. The corresponding sub-contents control information, sub-content name, or variable name is described after “=” in these descriptions.

  For example, in the case of the sub-content activation determination information 298, when the sub-content control information “start” is received, the display of the sub-content “program — 1.html” stored locally in an area called “right_top” on the screen is displayed. Is started. The same applies to other examples. Hereinafter, the XML format keywords and the like will not be described in detail unless they are important.

  The quiz screen display content designation information 304 includes quiz screen display content designation information 305 and a series of sub-contents display screen sequence information 306 based on the quiz screen display content designation information 305. Similar to the screen sequence information 296, the sub-content display screen sequence information 306 includes sub-content activation determination information 308 for the main screen, sub-content activation determination information 310 for the second question of the quiz, and an answer for the second question. Sub-contents activation determination information 312 corresponding to the answer screen for, and sub-contents activation determination information 314 for the screen displaying the result of counting the answers of the second question.

  Referring to FIG. 10, sub-content 230 further includes first message information 241A and second message information 241B as a message structure model. The first message information 241A and the second message information 241B have the same structure. Therefore, only the first message information 241A will be described below.

  The first message information 241A includes a <message> tag line describing message transmission destination information 242 (an e-mail address of the broadcast content related service providing apparatus 64), and a transmission described after the <message> tag line. Message structure information 244 indicating the structure of the message to be included. In the present embodiment, the message structure information 244 is basically described in accordance with the same rules as in HTML. The template specifying information indicated by the <program> tag, the service determination information indicated by the <voting_service> tag, , Three <input> tags each indicating a problem number, answer information, and an elapsed time until the answer, a <name> tag, an <address> tag, and a <tvid> tag that should describe unique information of the sub-contents playback device 52, including.

  In the present embodiment, values are set in advance in the <program> attribute and the <voting_service> attribute. Also, an input tag having the name “problem number” (“name” attribute) is preliminarily described with “1” as a problem number. This is because it is decided that this template will be used as an answer to the first question. On the other hand, a value “0” is written in advance in the “value” attribute of the input tag having the “name” attribute “answer”. When this value is “0”, it indicates that the answer has not yet been selected by the user. When an answer is selected by the user, the selected value is written here.

  The message information 241B differs from the message information 241A in that it does not include the last tag among the <input> tags.

  The value of each tag is inserted at the time of message creation, if necessary.

  Information for specifying a TV program is described in the <program> tag, and information for specifying a question number of a quiz is described in a <voting_service> tag. The information specifying the program and the information specifying the quiz problem number correspond to the message determination information 260 determined by the posted information determination unit 206 of the broadcast content related service providing apparatus 64.

  FIG. 11 shows an example of the main screen. The main screen 330 is a screen corresponding to the display content designation information 292 shown in FIG. On the main screen 330, AV data included in the broadcast content is displayed. This screen is designated by <region = full>, and is displayed when sub-content control information “iq — 200506101900” is received.

  FIG. 12 shows an example of dividing the display area of the quiz screen indicated by the screen sequence information 296. Referring to FIG. 12, quiz screen 340 is divided into areas 350, 352, 354, and 356. These are specified, for example, by “region” attributes “left_top”, “right_top_1”, “right_top_2”, and “bottom”, respectively.

  In the present embodiment, a button corresponding to an answer option is displayed in area 354, and a button 355 for designating sending an answer is also displayed. Also, in area 356, the correct answer of problem 1, the answer rank 358 of the user of the sub-contents reproduction device 52 obtained as a result of counting the answers, and a button 360 for notifying an acquaintance of this service are displayed.

  FIG. 13 shows a configuration example of broadcast content and broadcast content sub-data. Referring to FIG. 13, broadcast content 370 in the present embodiment is obtained by arranging the contents of a quiz program in time series. The broadcast content 370 includes an opening part 372 of a quiz program, a first question quiz part 374 following the opening part 372, a correct answer display part 376 for displaying a correct answer to the first question quiz, and an answer display part. A portion titled “Mini Corner” (hereinafter referred to as “mini corner portion”) 378, a quiz question portion 380 for the second question, and a correct answer display portion for the second question, which are displayed after 376 is completed. 382 and an end roll portion 384 of the program.

  Broadcast content 370 further defines sub-contents control information 390 that is broadcast in combination with AV data at the beginning of opening portion 372 and a posting area that matches quiz first question portion 374, from the start to the end. In order to define the sub-contents control information 392 that is broadcast in combination with the AV data and the result distribution area 394 from the end of the posting area to the end of the correct display part 376, the end of the correct display part 376 Sub-contents control information 426 that is sometimes distributed, sub-contents control information 396 that defines a posting area corresponding to the quiz second question part 380, and a result distribution area that matches the answer display part 382 of the second question To define, the sub-contents control information 398 broadcast at the end of the answer display portion 382 and the end of the broadcast content 370 And a sub-content control information 400 is broadcast.

  The sub-contents control information 392 is immediately after the sub-contents control information 420 and the sub-contents control information 420 transmitted to instruct the start of the display of the quiz screen at the start of the first question quiz part 374. Sub-contents control information 421 for designating a message template used for processing of the first question, sub-contents control information 422 transmitted to start the screen display of the quiz for the first question, and sub-contents control information 422 After that, the message usage information 412 that is continuously broadcast from the time when the problem is displayed to the time when the problem display is ended, and the sub-content control information 424 that is transmitted to instruct the end of the display of the problem 1 are included.

  In the present embodiment, the message usage information 412 includes a number of sub-content control information each including time information measured in units of 1/100 seconds, which is timed with the counter at the start of the first quiz question being set to 0 seconds. . Based on such message usage information 412, during actual usage, the sub-contents playback device 52 acquires elapsed time information from the sub-contents control information at the timing when one of the option buttons shown in FIG. 12 is pressed. Further, the sub-contents reproducing device 52 transmits a message having the structure shown by the message information 241A in FIG. 10 including the acquired elapsed time information to the broadcast content-related service providing device 64 at the timing when the button 355 is pressed.

  FIG. 14 shows how the screen display on the portable terminal 48 changes due to the broadcast content 370 shown in FIG.

  Referring to FIG. 14, broadcast content screen 440 is displayed while opening portion 372 is being reproduced.

  Subsequently, when the reproduction of the quiz question portion 374 is started, a sub-content activation screen 442 is displayed. The sub-content start-up screen 442 includes a broadcast content screen, a problem screen, and an answer selection screen displaying options for the problem.

  When the display of the correct answer display portion 376 is started, a correct answer display screen 444 is displayed. When the correct answer display part 376 ends, the reproduction of the mini-corner part 378 starts and the broadcast content screen 446 is displayed.

  Subsequently, when the second question quiz part 380 is started, a question display screen 448 is displayed. When reproduction of the answer display portion 382 is started, a screen 450 including a correct answer display for the second question quiz is displayed in addition to the broadcast content screen, the question display screen, and the answer selection screen. When the answer-answering period for this question ends, playback of the end roll portion 384 is started and a broadcast content screen 452 is displayed. When the sub content control information that defines the broadcast end timing of the broadcast content 370 is received, the display of the end roll portion 384 is also ended.

  FIG. 15 shows a sequence diagram between the devices in the present embodiment. Referring to FIG. 15, program producer 42 creates broadcast content and sub-contents linked to the program (460, 462, 464). The sub-content 480 is transmitted to the sub-content reproduction device 52 via the communication network 46 before the program starts to be broadcast, and is acquired by the sub-content reproduction device 52 (step 466). Here, it is assumed that the sub-content is acquired by the sub-content reproduction device 52 via the relay station 72 together with the start of the program.

  When the broadcast start time of the program comes, the broadcaster 44 broadcasts the broadcast content 482 via the relay station 72. Broadcast content includes broadcast content sub-data associated therewith. The broadcast content reproduction device 50 that has received this broadcast reproduces AV data included in the broadcast content (step 468).

  When the broadcast content sub-data is included in the broadcast content 482, the broadcast content reproduction device 50 separates this sub-content control information and transmits it to the sub-content reproduction device 52 as broadcast content sub-data 484. When receiving the broadcast content sub-data, the sub-content reproduction device 52 determines whether or not there is a process to be executed based on the sub-content control information based on the sub-content control determination information, and if so, performs a corresponding process (470). ).

  For example, if the received sub content control information is the sub content control information 420 (“problem_1”) shown in FIG. 13, display according to the display content designation information 294 on the quiz screen shown in FIG. 9 is started. If the sub content control information is the sub content control information 422 (“start”) shown in FIG. 13, the display shown by the sub content activation determination information 298 and 300 shown in FIG. 9 is started.

  Further, as shown in the sub-content activation determination information 302 shown in FIG. 9, when a process indicated to display information indicated by a URL (Uniform Resource Locator) on the web is activated, FIG. 15 As shown, a display data request 486 indicated by the URL is transmitted to the broadcast content related service providing apparatus 64. The broadcast content related service providing apparatus 64 prepares the content in response to the request (472) and transmits it to the sub-content reproduction apparatus 52 (step 488). The data indicated by the sub-contents activation determination information 300 corresponding to the answer screen in FIG. 9 is local data, but when an external URL is specified by this “src” attribute, the processing as described here is executed. Is done.

  Further, when the sub-content that creates the message is activated, the sub-content playback device 52 creates a message (step 474) and transmits the message 490 to the broadcast content-related service providing device 64. The broadcast content related service providing apparatus 64 executes processing corresponding to this message (step 476). That is, the device 64 determines which service the message is for based on the service determination information included in the received message, and stores the response information and elapsed time information included in the message in association with each other.

  The above is a series of flows in the present embodiment.

<Realization by computer program>
The broadcast content reproduction device 50 and the sub-content reproduction device 52 described above can be substantially realized by hardware having the same function unit as a computer and a computer program executed by the computer.

  FIG. 16 shows a flow of a computer program for realizing the broadcast content reproduction apparatus 50. Referring to FIG. 16, when broadcast content reproduction apparatus 50 is instructed to reproduce broadcast content, the broadcast content is received in step (hereinafter simply referred to as “S”) 500.

  Subsequently, in S502, reproduction of the received broadcast content is started. At the start of the broadcast content, there may be sub-content control information such as the sub-content control information 390 in FIG. In S502, such sub-content control information included in the broadcast content is separated from the AV data and transmitted to the sub-content playback device 52.

  In step S504, the broadcast content is analyzed. In S506, it is determined whether or not the reproduction of the broadcast content should be terminated. When the reproduction is finished, the process proceeds to S512. If not, the process proceeds to S508.

  In S508, it is determined whether broadcast content sub-data exists in the broadcast content. If broadcast content sub-data exists, the process proceeds to S510. If not, the process returns to S504 and the broadcast content is continuously analyzed.

  In S510, the broadcast content sub-data is transmitted to the sub-content playback device 52, and the process returns to S504.

  On the other hand, if it is determined in S506 that the reproduction of the broadcast content is finished, in S512, the last subcontent control information (for example, the subcontent control information 400 in FIG. 13) of the program included in the broadcast content is transmitted to the subcontent reproduction device 52. Send.

  In S514, the reproduction of the broadcast content is terminated.

  FIG. 17 illustrates a processing flow of the sub-content playback device 52. When the reproduction of the sub content is started, the sub content reproduction device 52 receives the broadcast content sub data from the broadcast content reproduction device 50 in S520.

  In S522, it is determined whether or not the broadcast content sub-data received in S520 is information instructing the end of the broadcast content, that is, whether or not it is designated as end information in any of the sub-content control determination information. When the broadcast content ends, the operation of the sub content playback device 52 ends. If they are different, the process proceeds to S524.

  In S524, the broadcast content sub-data received from the broadcast content reproduction device is analyzed.

  In subsequent S526, it is determined whether or not the broadcast content sub-data is message usage information as a result of the analysis in S524. In the case of message usage information, the process proceeds to S528, and in the case of sub-content control information, the process proceeds to S530.

  In S528, using the received message use information, necessary information is set in the message part in the sub-content. In the case of information message usage information indicating the elapsed time like the message usage information 412 shown in FIG. 13, a variable for storing the message usage information is set in advance as a variable “time”, for example (or in the message usage information 412). Specify the variable name) and store the received message usage information in that variable. Each time message usage information is newly received, the value of the corresponding variable is updated with the value of the newly received message usage information. In this way, the value of the message usage information received immediately before can be referred from any module in the system.

  In S530, it is determined whether or not the received sub content control information is control information related to the end of the sub content (sub content end information). That is, it is determined whether or not the received sub content control information matches that described in any of the sub content end determination information 272 of the sub content. If the sub content control information is sub content end information, the process proceeds to S532. Otherwise, the process proceeds to S536.

  In S532, the reproduction of the sub content having the sub content end determination information that matches the received sub content end information is ended, and the process returns to S520.

  In S536, it is determined whether there is any sub-content having sub-content activation determination information that matches the received sub-content control information. If a determination result is YES, it will progress to S534, otherwise it will progress to S538.

  In S534, reproduction of sub-content having sub-content activation determination information that matches the received sub-content activation information is started. After starting the sub-contents, the process returns to S520.

  In S538, since the received sub-contents control information includes information for designating the message template, the designated template is read from the sub-content and given to the message shaping unit 176. Thereafter, the process returns to S520.

  18 shows an HTML document (designated by the “src” attribute of the sub-content activation determination information 300 in FIG. 9) answer. An html document 540 which is an example of html is shown. In this example, an answer form indicated by the html document 540 is displayed in the area 354, and when one of the option buttons is pressed, a message is transmitted from the broadcast content sub-data received from the broadcast content reproduction device 50 at that time. Usage information 412 is acquired and reflected in the sub-content message. In such a case, the sub-contents activation determination information 300 (see FIG. 9) has a “message” attribute (“message =”), and a variable or file indicated by this attribute is used for data transfer. Below, it demonstrates based on the specific example shown by FIG.

  An html document 540 shown in FIG. 18 includes an <input> tag 542. An <input> tag 542 indicates a hidden field, and “time” is designated as the “get_avdata” attribute, and “time.txt” is designated as the “value” attribute. As described above, when the message usage information 412 is received, the variable time is sequentially updated according to the value. When one of the option buttons displayed on the answer screen is pressed, the current value of the variable time specified by the “get_avdata” attribute is temporarily stored in a document “time.txt”. The name of this document is determined in advance as variable name + “. Txt”.

  With this configuration, the form specified by the html document 540 is displayed in the area 354 shown in FIG. 12, and when the user presses one of the option buttons, the time information determined by the message usage information received at that time is displayed. Variable time and document time. It is passed to html document 540 via txt. Further, when the user presses the button 355, the message is shaped into a predetermined format in the message shaping unit 176 shown in FIG. 6 and transmitted to the broadcast content related service providing apparatus 64.

  FIG. 19 shows the structure of a message created by the message shaping unit 176 in the sub-contents reproduction device 52 shown in FIG. 6 and an example of the message. This original message structure is also acquired in advance by the sub-contents reproducing device 52 as sub-content data like the message information 241A shown in FIG.

  Referring to the left column of FIG. 19, message 560 includes broadcast content specifying data 570 for specifying broadcast content, message determination data 572 indicating which service the message corresponds to, and user input content. 574, terminal user personal information 576, and terminal ID 578.

  A specific message corresponding to this is shown in the right column of FIG. The message 560 includes the value (“3”) input as the “value” attribute of the input tag having the “name” attribute “answer” in addition to the value described in the template indicated by the message information 241A in FIG. Is written, and the “value” attribute of the <input> tag 574 having the “name” attribute of “time” describes the elapsed time information acquired by the tag 542 in FIG. In FIG. 19, the file name is described as the “value” attribute, but the value in this file is described here when an actual message is transmitted. The message 560 created in this way is transmitted from the message shaping unit 176 shown in FIG. 6 to the broadcast content related service providing apparatus 64 via the message transmission unit 178.

  With the above configuration, it is possible to realize a broadcast content and sub-contents cooperation service system.

<Operation>
This broadcast content cooperation service system 40 operates as follows. It is assumed that broadcast content subdata and AV data are created in advance by the broadcast content creation device 60 and synthesized by the broadcast content creation unit 84 to create broadcast content, and the subcontent is created by the subcontent creation device 62. It shall be. Further, the content composition device 70 composes the content by combining the sub-content received from the sub-content creation device 62 by the sub-content reception unit 112 and the broadcast content received from the broadcast content creation device 60 by the broadcast content reception unit 110. It is assumed that the transmission has already been made to the broadcast content reproduction apparatus 50. Also, the content synthesizing apparatus 70 shown in FIG. 4 synthesizes the sub-content received by the sub-content receiving unit 112 and the broadcast content received by the broadcast content receiving unit 110 to create and store the content that is actually broadcast. It shall be.

  The sub-content creation device 62 distributes the sub-content via the network 46 and the broadcaster 44. Therefore, even if the mobile terminal 48 according to the present embodiment directly receives the subcontent directly from the subcontent creation device 62 via the network 46, the subcontent is transmitted via the broadcast broadcast by the broadcaster 44. May be received. The received sub-content is stored in the sub-content storage unit 162 shown in FIG.

  When the predetermined broadcast time corresponding to the program comes, the content transmission unit 116 reads out the content from the content synthesis unit 114, gives it to the relay station 72, and broadcasts it. The broadcast content reproduction apparatus 50 receives this broadcast.

  Referring to FIG. 5, broadcast receiving unit 130 of broadcast content reproduction apparatus 50 provides the received content to first input of selection unit 133 and content storage unit 132. The selection unit 133 gives the content from the broadcast receiving unit 130 to the content analysis unit 134 when the content to be broadcast is reproduced immediately according to the setting. If the setting is to accumulate content, the selection unit 133 does not give the content from the broadcast reception unit 130 to the content analysis unit 134. The content storage unit 132 stores the content from the broadcast receiving unit 130.

  The stored content is reproduced by being specified using the input unit 140 and is given to the content analysis unit 134. Hereinafter, a case where the content selected by the selection unit 133 is given to the content analysis unit 134 will be described.

  The content analysis unit 134 separates AV data and accompanying data from the content, and provides the AV data to the AV data reproducing unit 136 and the accompanying data to the accompanying data transmitting unit 138, respectively. The AV data reproducing unit 136 reproduces this AV data and provides video and audio signals to the output unit 142.

  When the accompanying data transmission unit 138 receives the accompanying data from the content analysis unit 134, the accompanying data transmission unit 138 transmits the accompanying data to the sub-contents reproducing device 52.

  Referring to FIG. 6, when the accompanying data receiving unit 166 receives the accompanying data, the accompanying data receiving unit 166 separates the broadcast content sub data into the broadcast content sub data and the sub content data to the broadcast content sub data analyzing unit 168. Each is given to the sub-content storage unit 162.

  The sub-content storage unit 162 discards the sub-content provided from the accompanying data reception unit 166 if it has already been stored. If not, the sub-content storage unit 162 stores it so that it can be read later.

  When the broadcast content sub-data analyzing unit 168 receives the broadcast content sub-data from the accompanying data receiving unit 166, the broadcast content sub-data analyzing unit 168 separates the broadcast content sub-data into sub-content control information and message usage information, and sub-content reproduction control unit 170 and message shaping unit 176, respectively. And give to. The message shaping unit 176 stores this message usage information and prepares for the subsequent message transmission. For example, if the message usage information is time information associated with a variable “time”, the value of the variable is updated with the message usage information.

  When the sub content control information is given from the broadcast content sub data analysis unit 168, the sub content reproduction control unit 170 causes the sub content storage unit 162 to output the sub content corresponding to the sub content control information. . The sub-content analysis unit 164 analyzes the sub-content and gives the analysis result to the sub-content reproduction control unit 170. The sub-content reproduction control unit 170 controls the message acquisition unit 180, the sub-content layout unit 172, and the message shaping unit 176 according to the analysis result to execute necessary processing.

  For example, if the sub content control information indicates the start of a program, the sub content reproduction control unit 170 displays the specified content on the output unit 142 in the specified layout according to the sub content control information. The content layout unit 172 is controlled. If the sub-content control information indicates the display of the URL page, the sub-content reproduction control unit 170 controls the message acquisition unit 180 to acquire the specified URL information and give it to the sub-content layout unit 172. Display in the specified layout. If the sub-content control information indicates the message transmission timing, the sub-content reproduction control unit 170 controls the message shaping unit 176 to store a message template, message usage information, and sub-content that have already been stored. A message is created from the input contents of the user input from the layout unit 172 via the message input unit 174, and the message is transmitted via the message transmission unit 178. If the sub-content control information is information specifying a message template, the corresponding template is read from the sub-content storage unit 162 shown in FIG. 6 and given to the message shaping unit 176.

  Thus, every time the broadcast content sub-data analysis unit 168 receives the message usage information, the stored content of the message shaping unit 176 is updated, and the display of the sub-content is controlled each time the sub-content control information is received.

  If the received sub-content control information indicates the end of the program, the sub-content playback control unit 170 controls the entire sub-content playback device 52 to end the playback of the sub-content.

  Thus, according to the example described above, the mobile terminal 48 displays the quiz screen and the broadcast screen based on the display layout specified by the sub content corresponding to the sub content control information, and performs sub content control of the broadcast content. Switch the display layout based on the information.

  When the viewer (user of the portable terminal 48) presses the answer selection button for the quiz during the period of the quiz question portion 374 shown in FIG. 13, information necessary for creating a message from the message use information is acquired and selected. The value corresponding to the selected option button is set in the “value” attribute in the input tag having the “answer” attribute of the message template, and the value of the variable time at that time is obtained to obtain the file time. Save to txt. When the user presses the transmission button (button 355 shown in FIG. 12), the portable terminal 48 shapes the message based on the message template and transmits it to the broadcast content related service providing apparatus 64. As described above, this message includes the answer information of the problem selected by the user and the elapsed time information from the question assignment to the answer selection (pressing the option button).

  The broadcast content related service providing apparatus 64 determines whether the problem is correct based on the reply information in the message received from the mobile terminal 48. Further, the broadcast content related service providing apparatus 64 can further quickly rank each user from the elapsed time information included in the received message. The broadcast content related service providing apparatus 64 can aggregate these results, provide a message indicating the results to the portable terminal 48, and create a page accessible by an appropriate URL. Thus, the viewer can easily know the result of his / her vote while watching the broadcast.

  The sub-content created by the sub-content creating device 62 includes transmission destination data indicating the broadcast content related service providing device 64, and a message indicating the user input result is transmitted to the transmission destination. The message from the user includes service determination information for determining the corresponding service. Therefore, the message from the portable terminal 48 can be received and stored for each service by the service providing apparatus desired by the program producer. As a result, the program producer can directly collect the viewer's reaction to the program and provide various services based on the content of the message directly to the viewer.

  In this embodiment, a program producer creates each content and service and provides a broadcast content related service providing apparatus 64. However, the present invention is not limited to such an embodiment. For example, a broadcaster and a program producer may create services separately. In this case, the broadcaster and the program producer can use (provide) the service freely by preparing sub-content data in which destination data that satisfies each request is set. it can. Broadcasters Broadcasters may create and distribute all content. Alternatively, even if the program producer owns only the broadcast content creation device, and another service provider owns the sub-content creation device and the broadcast content related service provision device, the service provider is created by the program producer. We can provide services according to the content.

  In the present embodiment, the sub-content 230 is described in the XML format. However, the HTML (Hyper Text Markup Language) format, the XHTML (eXtensible Hyper Text Markup Language) format, the SMIL (Synchronized Multimedia Integration Language) format, etc. It can be described in any description format or a combination thereof.

  In the above embodiment, the mobile terminal 48 is a mobile phone terminal. However, the present invention is not limited to such an embodiment, and an information terminal that can be connected to a network, such as a notebook PC (Personal Computer) or PDA (Personal Digital Assistant), may be used as a portable terminal. Moreover, what can be used as a terminal is not restricted to a portable terminal. As long as it has the same function as the portable terminal 48 described above, it may not be portable. For example, a TV receiver or a desktop PC may be used as the terminal. However, in the present embodiment, it is desirable to use a mobile phone terminal as the terminal 48. As the communication network 46, a known communication network such as a mobile communication network, a telephone line network, the Internet, or a LAN (Local Area Network) can be used. In the present embodiment, the broadcast content playback apparatus 50 and the sub-content playback apparatus 52 are provided on one mobile terminal, but these may be arranged on different terminals.

  In the above embodiment, the sub-content includes any one of reproduction data reproduced in association with the broadcast content and reproduction data reproduced independently of the broadcast content. However, the present invention is not limited to such an embodiment, and may be a form that does not include any of them. One broadcast content may include one type or a plurality of types of sub-contents.

  In the above embodiment, although the broadcast content and the sub-content are synthesized, the data is separate. However, of course, the present invention is not limited to such an embodiment, and sub-contents may be included in the broadcast content data for transmission. In that case, the broadcast content reproduction device 50 needs to have a function of analyzing the received data and separating the broadcast content and the sub-content.

  Further, in the above embodiment, the sub-content is transmitted from the sub-content creating device 62 to the content synthesizing device 70 and further broadcast by the broadcaster 44, and at the same time, the portable terminal 48 directly from the sub-content creating device 62. Can also be delivered to. However, the present invention is not limited to such an embodiment, and only one of them may be possible and the other may not be possible.

  Furthermore, in the first embodiment, the display layout is completely automatically switched by the sub content control information. However, the present invention is not limited to such an embodiment, and switching of the display layout by manual input by the user may be permitted.

  In the above embodiment, the message transmitted from the sub-content playback device 52 to the broadcast content-related service providing device 64 includes personal information and a mail address preset in the mobile terminal 48. However, in some cases, these may not be included. Further, as the message use information, any information desired by the program producer, for example, a character string or graphic information can be used.

  In the present embodiment, the start of the program is also determined by the sub-content activation information. Therefore, it is necessary to take a form in which the sub-content is distributed before the start of the program. However, as described above, the sub-content may be distributed via the relay station 72 or the communication network 46 together with the start of the program. In this case, the start of the program is not determined by the sub-content activation information.

[First Modification of First Embodiment]
Next, a broadcast content cooperation service system according to a first modification of the first embodiment will be described with reference to FIGS.

  In the first embodiment, the sub-content includes sub-content control determination information, the sub-content control determination information or the sub-content control information is analyzed in detail, and the reproduction of the sub-content is controlled according to the result. However, in the present modification, the reproduction of the sub content is controlled only by the sub content control information. Therefore, in this modification, it is not necessary to include the sub content control determination information on the sub content side, and the system of FIG. 1 can be realized only by the control by the broadcast content.

  FIG. 20 is a block diagram showing a schematic configuration of the sub-content creating apparatus 63 in the broadcast content cooperation service system according to this modification. The sub-content creating device 63 is used in place of the sub-content creating device 62 shown in FIGS. Referring to FIG. 20, sub-content creating apparatus 63 differs from sub-content creating apparatus 62 shown in FIG. 3 in the following points. That is, in the present modification, the sub-contents control determination information is not provided on the sub-contents side. Therefore, the sub-content creating apparatus 63 includes components other than the sub-content control determination information storage unit 92 (see FIG. 3) among the functional blocks of the sub-content creating apparatus 62 shown in FIG.

  FIG. 21 shows the data structure of the sub-content 231 used in the broadcast content cooperation service system according to this modification. This sub-content 231 is the same as the sub-content 230 used in the first embodiment shown in FIG. 8, but as shown in FIG. 21, among the sub-contents 230 shown in FIG. 4 includes information other than the sub content control determination information 246 (see FIG. 8).

  FIG. 22 shows the first half of an XML document according to an example of the sub content 231. The XML document shown in FIG. 22 corresponds to the document shown in FIG. 9 in the first embodiment, but differs from that shown in FIG. 9 in the following points. That is, in the present modification, the sub content control determination information is deleted from the sub content 231. For example, the sub content control determination information 270 and 272 (see FIG. 9) included in the <seq> tag 291 in FIG. 9 is deleted in FIG.

  FIG. 23 shows the second half of the XML document according to an example of the sub-content 231 used in the system according to the present modification. This corresponds to the document shown in FIG. 10, but differs from that shown in FIG. 10 in the following points. That is, referring to FIG. 23, in this XML document, the sub-contents control determination information is deleted unlike that shown in FIG. For example, in FIG. 10, the sub content control determination information 242 (see FIG. 10) included in the <message> tag is deleted in FIG. In the present modification, the sub-contents reproduction control unit 170 in FIG. 6 performs a control of automatically transmitting sub-contents having a <message> tag at the end of reproduction, which is the same as that of the first embodiment. Processing becomes possible.

  FIG. 24 shows the configuration of AV data included in the broadcast content used in the system according to this modification and details of the broadcast content sub-data. This broadcast content sub-data corresponds to that shown in FIG. 13, but differs from FIG. 13 in the following points. That is, in the present modification, the sub content control information is either the sub content activation information or the sub content end information. Specifically, the broadcast content sub-data shown in FIG. 24 includes sub-content control information 391, 397, and 399.

  The sub content control information 391 includes iq_200506101900. This is sub-content activation information for starting reproduction of xml. The sub content control unit 170 (see FIG. 6) acquires the sub content control information 391, and executes reproduction of the corresponding file. The sub content control information 399 is iq_200506101900. This is sub-content end information for executing the end of reproduction of xml. The sub content control unit 170 acquires the sub content control information 391 and ends the reproduction of the corresponding file.

  The sub content control information 397 is sub content end information. message. Since xml (see FIG. 23) is sub-content having a <message> tag, the sub-content control unit 170 (see FIG. 6) acquires the sub-content control information 397. When it is determined that there is a message to be transmitted in the corresponding file, the message is transmitted.

  FIG. 25 shows a flowchart of a control structure of a computer program that realizes a sub-contents reproducing apparatus (corresponding to sub-contents reproducing apparatus 52 in the first embodiment) according to this modification. This flowchart is a modification of the flowchart for the sub-content reproduction device 52 shown in FIG. 25, in S520, S522, S524, S526, and S528, the same processing as that in the step of the same reference number in FIG. 17 is performed.

  In S530, processing for determining whether or not the received sub-contents control information is sub-contents end information is performed. If the sub content control information is the sub content end information, the process proceeds to S540. Otherwise, the process proceeds to S536.

  In S540, processing for determining whether or not <message> exists in the corresponding sub-content is performed. If <message> exists, the process proceeds to S542. If not, the process proceeds to S532.

  In S542, since there is a message to be transmitted on the service side in the sub-content, processing for transmitting the message is performed.

  In S532, processing for executing the sub-content reproduction end is performed.

  When determining the sub-content control information in the flowchart shown in FIG. 25, it is based on whether the sub-content activation information or the sub-content end information is different from the first embodiment shown in FIG. Judgment is made. As a result of the determination, if it is sub-content end information and a <message> tag is included, message transmission is also executed.

  Differences between the respective units of the sub content reproduction device 52 according to the first embodiment shown in FIG. 6 and the respective units of the sub content reproduction device according to the present modification will be described.

  In the sub content playback apparatus according to this modification, the sub content does not include sub content control determination information. Therefore, in this modification, the information that is identified and output by the processing unit corresponding to the sub-content analysis unit 164 shown in FIG. 6 is only the layout information, the message transmission destination, and the message structure.

  The sub content control unit 170 (FIG. 6) according to the first embodiment is different from the sub content reproduction control unit according to the present modification in the following points. In this modification, the sub content control information includes the file name of the sub content and the reproduction start and end information. Therefore, the sub-contents reproduction control unit according to this modification receives the sub-contents control information output from the broadcast content sub-data analysis unit, and which file in the sub-contents is reproduced based on the sub-contents control information, Or, determine whether to end. Then, layout information necessary for reproduction and sub-contents to be displayed are output. In addition, when the sub-contents reproduction control unit according to this modification receives the sub-content end information of the sub-content having the <message> tag, the message included in the corresponding sub-content is shaped into a predetermined message format, Send to the appropriate destination.

  According to the above modification, it is possible to ensure the same operation as in the first embodiment without having sub-content control determination information on the sub-content side.

[Second Modification of First Embodiment]
Next, a broadcast content cooperation service system according to a second modification of the first embodiment will be described with reference to FIGS.

  In this modification, the sub content control information includes terminal specific information. The terminal-specific information is information for determining whether or not the mobile terminal subscribes to a service provided by the broadcast content related service providing apparatus 64, for example. In addition to this, for example, the terminal-specific information may include a mail address and a terminal ID that the mobile terminal itself has. However, in the modification described below, the mail address and the terminal ID are not used. The sub-content further includes terminal-specific information determination information used for determining whether or not the terminal subscribes to the service by checking with the terminal-specific information held by the terminal.

  FIG. 26 is a block diagram showing a schematic configuration of the broadcast content cooperation service system 41 according to this modification. The configuration of the system is the same as that of the broadcast content cooperation service system 40 (see FIG. 1) according to the first embodiment. However, in the first embodiment, the mobile terminal 48 (see FIG. 1) has been described on the premise that the mobile terminal 48 subscribes to the service provided by the broadcast content related service providing apparatus 64. It is assumed that there are mobile terminals that are subscribed to and mobile terminals that are not subscribed to the service.

  In this modification, the broadcast content is a quiz program, and a service subscriber who is a viewer can answer the quiz from a mobile terminal (for example, a mobile phone) as in the first embodiment. Content such as quiz questions is displayed on mobile phones of non-service subscribers, but content for answering the quiz is not displayed, but instead content for prompting subscription to the service is displayed .

  Referring to FIG. 26, the broadcast content cooperation service system 41 according to the present modification includes a plurality of mobile terminals 47 and mobile terminals 49 in place of the mobile terminal 48 shown in FIG. The portable terminals 47 and 49 have the same configuration, but the portable terminal 47 is subscribed to a service provided by the broadcast content related service providing apparatus 64, and the portable terminal 49 is not subscribed.

  The mobile terminal 47 has a configuration similar to that of the mobile terminal 48 shown in FIG. 1, but has the same function as the sub-content playback device 52 instead of the sub-content playback device 52 shown in FIG. A sub-content playback device 54 having a function of controlling the playback layout configuration of sub-contents is used as sub-content control information. The portable terminal 49 has the same configuration as the portable terminal 47.

  FIG. 27 is a block diagram showing a schematic configuration of the sub-content playback device 54. Referring to FIG. 27, sub-content playback apparatus 54 has different functions from sub-content playback apparatus 52 (see FIG. 6) according to the first embodiment in the following points.

  In the following description, the terminal-specific information is one piece of sub-content control information and is considered to be information held by the terminal itself. Specifically, the terminal-specific information in the present modification is information used to determine whether or not the service provided by the broadcast content related service providing apparatus 64 shown in FIG. 26 is subscribed. Personal information such as a telephone number and an e-mail address, and ID information for identifying a terminal are also included in the terminal-specific information. However, since they are not used in this modification, they are not mentioned in this modification.

  Referring to FIG. 27, sub-contents playback device 54 replaces sub-contents playback control unit 170 included in sub-contents playback device 52 shown in FIG. Sub-contents connected to storage unit 182 and having a function of determining screen layout display using terminal-specific information stored in terminal-specific information storage unit 182 and terminal-specific information determination information in the received sub-contents The sub-content stored in the sub-content storage unit 162 is analyzed instead of the sub-content analysis unit 164 shown in FIG. 6 in that the control unit 171 is included, and the layout information, message transmission destination, and message structure are analyzed from the sub-content. Support for identifying and outputting sub-content control determination information and terminal-specific information determination information It is different from the sub-content reproducing apparatus 52 shown in FIG. 6 in a point that includes a content analyzing unit 165.

  Specifically, the terminal specific information is output to the sub-contents reproduction control unit 171. The sub-content reproduction control unit 171 should output to the sub-content layout unit 172 by using the terminal-specific information determination information held by the sub-content and collating with the terminal-specific information stored in the terminal-specific information storage unit 182. Specify the screen layout. In this modification, only the screen layout configuration of the sub-content is controlled by the terminal specific information. However, what is controlled by the terminal specific information is not limited to this.

  FIG. 28 shows the data structure of the sub-contents 233 used in the broadcast content cooperation service system 41. Referring to FIG. 28, sub-content 233 is similar to sub-content 230 (see FIG. 8) used in the first embodiment, but differs in the following points. The sub-contents control determination information 247 is used in place of the sub-contents control determination information 246 shown in FIG. 8 to determine conditions for controlling activation and termination of sub-contents and whether or not the terminal has subscribed to the service. Sub-contents control determination information 247 consisting of the above information and the like. The sub-content control determination information 247 includes the terminal-specific information determination information 274 described above in addition to the sub-content activation determination information 270 and the sub-content end determination information 272 similar to those shown in FIG.

  The sub-content analysis unit 165 in FIG. 27 analyzes the sub-content stored in the sub-content storage unit 162, and determines layout information, message transmission destination, message structure, sub-content control determination information, and terminal-specific information determination information from the sub-content. 274 is identified and given to the sub-content control unit 171. The sub-content reproduction control unit 171 designates the screen layout based on the terminal specific information acquired from the terminal specific information storage unit 182 and the terminal specific information determination information 274.

  FIG. 29 shows the first half of an XML document according to an example of sub-contents. With reference to FIG. 29, a description will be given of differences in the sub-content description example in the XML document from the first half (see FIG. 9) of the XML document according to the example of the sub-content according to the first embodiment. In this modification, terminal specific information determination information is included in the part for specifying the screen layout. For example, terminal-specific information determination information 293 and 307 are included in the <par> tag. Further, after the terminal unique information determination information 293 and 307, screen sequences 296 and 297 that are executed when the respective conditions are satisfied are described. According to the terminal specific information determination information 293 and 307, the document iq_200506101900_auth. In txt, information indicating whether or not the mobile terminal is subscribed to the service provided is described as “true” or “false” as terminal-specific information. When the terminal-specific information determination information is read, the document iq_200506101900_auth. txt is referred to, and a screen sequence that matches the content (true or false) of the document is executed in the <par> tag.

  In this modification, the document iq_200506101900_auth. If the content of txt is true, the screen shown in FIG. 12 in the first embodiment is displayed according to the screen sequence information 296. On the other hand, the document iq_200506101900_auth. If the content of txt is false, a screen 340 as shown in FIG. 31 is displayed according to the screen sequence information 297. That is, an image as shown in FIG. 31 is displayed on the screen of the mobile terminal 49 that is not subscribed to the service. This is because the mobile terminal subscribed to the service has the answer_1... In the area 354 of FIG. On the other hand, in the case of a mobile terminal that has not subscribed to the service, commerce.com as shown in the area 353 in FIG. html is displayed. In the present embodiment, on a mobile terminal that has not subscribed to the service, content 357 indicating the number of participants in the quiz shown in FIG. 31 is displayed instead of the user's answer rank 358 shown in FIG.

  FIG. 30 shows a structure of message data and an example of a message used when performing a message transmission process based on the sub-content. With reference to FIG. 30, the difference between the transmission message structure and the transmission message structure according to the first embodiment (see FIG. 19) will be described. In the present modification, the message 562 is a message about the answer to the quiz, which is transmitted from the mobile terminal 47 that subscribes to the service, as in the first embodiment. The message 564 is a message regarding the subscription application for the service transmitted by the mobile terminal 49 not subscribed to the service.

  The message 562 has a structure similar to the message 560 shown in FIG. 19, but includes a <iq> tag 577 in addition to the information shown in FIG. 19 in the column for recording the personal information of the terminal user. In this tag portion, user_id, that is, personal identification information of the user of the portable terminal is recorded.

  The message 564 has a structure similar to the message 560 shown in FIG. 19, but the name attribute value of the <input> tag 565 in the input content column is “subscription”. This message 564 is transmitted to the service providing apparatus as an application message.

  The original application includes various personal information such as the name and address of the subscriber, but since it is not used in this modification, a detailed description will not be given here. However, of course, the name, telephone number, and address information held by the mobile phone can be acquired as message use information and quoted in the message 564.

  FIG. 32 shows the configuration of AV data included in broadcast content and details of broadcast content sub-data. Referring to FIG. 32, the broadcast content sub-data used in this modification is different from the details (see FIG. 13) of the broadcast content sub-data according to the first embodiment while being compared with broadcast content 370. Explain the point.

  The broadcast content sub-data includes sub-contents control information 425 urging use of terminal-specific information that is transmitted in accordance with the sub-contents control information 420 to 422 used at the start of the first question quiz part 374. . When the sub-content control information 425 is received, the terminal specific information storage unit 182 (see FIG. 27) performs iq_200506101900_auth. The corresponding terminal unique information is quoted during txt, and the sub-content reproduction control unit 171 determines the terminal unique information determination information. In the mobile terminal 47 subscribing to the service, the screen layout in the screen sequence information 296 of FIG. 29 is executed. As a result, a screen as shown in FIG. 12 is displayed on the screen of the portable terminal 47. In the mobile terminal 49 not subscribed to the service, the screen sequence in the screen sequence information 297 in FIG. 29 is executed. As a result, a screen as shown in FIG. 31 is displayed on the screen of the portable terminal 49.

  FIG. 33 is a flowchart showing the control structure of a computer program that implements the sub-content playback apparatus.

  The processing shown in FIG. 33 is different from that shown in FIG. 17 in that, when it is determined in S526 that the sub content control information is determined, the processing of S527 is executed before the processing proceeds to S530.

  In S527, processing for determining whether or not the terminal-specific information is necessary when selecting the display layout of the sub-content is performed depending on whether or not the terminal-specific information determination information is included in the sub-content. If terminal-specific information is necessary, the process proceeds to S529. If not necessary, the process proceeds to S530.

  In S529, processing for selecting the display layout of the sub-content is performed by comparing the terminal-specific information determination information with the terminal-specific information.

  With the configuration of the above modification, the sub-content is controlled according to the terminal-specific information, and the same operation as that of the first embodiment can be ensured.

  Of course, as in the first modification of the first embodiment, even if the sub-content side does not have terminal-specific information determination information, the sub-content control information clearly indicates the part to be controlled. A similar operation can be ensured.

[Second Embodiment]
Next, a broadcast content cooperation service system according to a second embodiment of the present invention will be described with reference to FIGS. Referring to FIG. 34, broadcast content cooperation service system 600 according to the present embodiment enjoys the same web service as a program performer using a service provided from the web while a user watches a TV program. Make things possible. More specifically, in the broadcast content linkage service system 600 according to the present embodiment, the contestant is provided with a very small but surprising knowledge that the program presenter presents to the contestant in the studio. This is an improvement related to a program in which a button called “Fee” button is pushed by a number corresponding to the unexpectedness, and the unexpectedness of the trivial knowledge is evaluated by the total. That is, in the broadcast content linkage service system 600 according to the present embodiment, not only the participants in the studio but also the viewers watching the TV receiver are as many times as they think appropriate depending on the unexpectedness of the presented knowledge. Click (push) the “Fee” button displayed on the portable terminal 622 at hand. The number of times is summed up by the audience from all over the country, and the unexpectedness of the knowledge is evaluated by the value. This format provides a mechanism that allows not only those in the studio but also viewers across the country to participate in the program and share the results with all viewers.

<Configuration>
Referring to FIG. 34, broadcast content cooperation service system 600 is a system provided by program producer 602 and broadcaster 604. In addition to the broadcast content creation device 60, the program producer 602 is similar to the sub-content creation device 62 in the first embodiment, but has a slightly different function. The broadcast content related service providing apparatus 64 is similar to the broadcast content related service providing apparatus 64 in the form, but has a broadcast content related service providing apparatus 614 having a function of providing a service different from the quiz service such as the broadcast content related service providing apparatus 64. ing. Similarly, in addition to the relay station 72 in the first embodiment, the broadcaster 604 includes a content composition device 610 that is similar to the content composition device 70 in the first embodiment but has a slightly different function. I own it. The sub-content creation device 612 and the content composition device 610 will be described later.

  The broadcast content cooperation service system 600 further includes one or more broadcast content playback apparatuses 620 that can be connected to the network 46 and one or more portable terminals 622 that can also be connected to the network 46.

  The broadcast content reproduction device 620 has a function of receiving and reproducing broadcast content from the broadcast content composition / transmission device 610 via the relay station 72. In the present embodiment, broadcast content reproduction apparatus 620 is typically a TV receiver. Functionally, the broadcast content playback apparatus 620 is the same as the broadcast content playback apparatus 50 in the first embodiment.

  On the other hand, the mobile terminal 622 includes a sub-content playback device 630. The sub-content playback device 630 is functionally similar to the sub-content playback device 52 in the first embodiment, and receives and plays back the sub-content from the broadcast content synthesis / transmission device 610 via the relay station 72. It has a function.

  In the present embodiment, the broadcast content playback device 620 and the sub-content playback device 630 are not in the same device (for example, the portable terminal 48 in the first embodiment), but are separate devices, The second embodiment is different from the first embodiment in that it can communicate with each other via 46. Also, since the broadcast content playback device 620 and the sub content playback device 630 are separate, the sub content playback device 630 directly receives the sub content from the sub content creation device 612, not from the broadcast transmitted from the broadcaster 604. Receive. When the received broadcast content includes broadcast content sub data, the broadcast content reproduction device 620 transmits the broadcast content sub data to the sub content reproduction device 630 via the network 46.

  Also in the present embodiment, the sub-contents playback device 630 receives and stores the sub-contents in advance in the same manner as the sub-contents playback device 52 in the first embodiment, and creates a message template existing in the sub-contents. Based on this, a message reflecting the input by the user can be created and transmitted to a predetermined destination.

  Mobile terminal 622 in the present embodiment receives sub-content from sub-content creation apparatus 612 and stores it beforehand. When receiving the sub content control information from the broadcast content playback device 620, the portable terminal 622 reads the display layout information specified by the sub content control information from the sub content, and displays based on the sub content based on the display layout information. Do. Therefore, in the broadcast content cooperation service system 600, the sub-content playback device 630 can display appropriate information related to the broadcast content based on the sub-content at an appropriate time in conjunction with the broadcast content being broadcast. For this purpose, in the present embodiment, a predetermined message is transmitted from the sub-content playback device 630 to the broadcast content-related service providing device 614 by the sub-content control information, or a predetermined message is transmitted to the broadcast content-related service providing device 614. Perform processing to request a message.

  Correspondingly, the control information in the broadcast content sub-data uses message transmission determination information 670 and message request determination information 672 as shown in FIG. 36 in addition to the information used in the first embodiment. Control information for determining the timing of message transmission and message request according to the determination is included. These are hereinafter referred to as message transmission information and message request information, respectively.

  Next, details of each component in the broadcast content cooperation service system 600 of this embodiment will be described. The sub-content creation device 612 and the broadcast content playback device 620 can be realized with very slight changes from the sub-content creation device 62 and the content composition device 70 in the first embodiment, respectively. Also, the broadcast content related service providing apparatus 614 is different from the broadcast content related service providing apparatus 64 in the first embodiment, but referring to the configuration of the broadcast content related service providing apparatus 64 and appropriately depending on the service to be provided. Can design. Accordingly, they will not be described here.

  FIG. 35 shows a schematic configuration of the sub-content playback device 630. Referring to FIG. 35, sub-content playback device 630 has the same configuration as that in the first embodiment. The difference is that a sub-content reproduction control unit 640 is included instead of the sub-content reproduction control unit 170 in the first embodiment, and a message transmission unit 642 is included instead of the message transmission unit 178. . Hereinafter, details of the sub-content reproduction control unit 640 and the message transmission unit 642 will be described.

  The sub content playback control unit 640 compares the sub content control information received from the broadcast content sub data analysis unit 168 with the sub content control determination information included in the sub content, and controls the sub content control that matches the sub content control determination information. If it is information, it has a function of creating corresponding control information based on the sub-content and transmitting it to each unit in the sub-content playback device 630. This function itself is the same as the function of the sub content reproduction control unit 170 in the first embodiment. However, the sub-content reproduction control unit 640 gives the message transmission information to the message transmission unit 642 when the message transmission information is received, and receives the message request information when receiving the message request information. It has the function to give to.

  In addition to the function of the message transmission unit 178 in the first embodiment, the message transmission unit 642 has the message transmission information received from the sub-contents reproduction control unit 640 matching the determination condition based on the message transmission determination information 670 (FIG. 36). In this case, the broadcast content related service providing apparatus 614 has a function of transmitting a corresponding message.

  On the other hand, when the message request information matches the determination condition based on the message request determination information 672 (FIG. 36), the message transmission unit 642 has a function of requesting the broadcast content related service providing apparatus 614 for the latest data of the corresponding sub content. .

  FIG. 36 shows the configuration of sub-contents used in this embodiment. Referring to FIG. 36, this sub-content 650 includes layout information 240 and message information 241 similar to those in the first embodiment. The sub content 650 further includes sub content control determination information 660 instead of the sub content control determination information 246 in the first embodiment.

  The configuration of the sub-content control determination information 660 includes a predetermined message to the broadcast content related service providing apparatus 614 in addition to the sub-content activation determination information 270 and the sub-content end determination information 272 similar to the sub-content control determination information 246. Message transmission determination information 670 that is information for determining whether or not it is time to transmit a message, and information for determining whether or not it is time to request a predetermined message to the broadcast content related service providing apparatus 614 Some message request determination information 672 is included.

  FIG. 37 shows an example of the sub-content 650 more specifically. The description example shown in FIG. 37 is simplified for easier understanding of the description of the present embodiment.

  The inside of the <layout> tag is the same as in the first embodiment.

  Display content designation information is described in the <seq> tag and the <par> tag. The meanings of descriptions in these tags are the same as those in the first embodiment. In the example shown in FIG. 37, each of trivial_1... Between <par> tag 680 and </ par>. html, personal. html, subknowledge_1. html, and total. Display content designation information 682, 684, 686, and 688 for designating html are designated together with a “region” attribute for designating an area in which to display them.

  In the present embodiment, the “get” attribute is described in the sub-contents activation determination information 690. The value of this attribute is message request determination information. In the example shown in the figure, when “fe_total” is received as message request information, it matches the message transmission determination information of the sub-contents activation determination information 690, so that a message requesting a message is transmitted. In the present embodiment, since the values of the “draw_begin” attribute and the “get” attribute 690 of the display content designation information 688 are the same (“fe_total”), when this sub-content control information (message request information) is acquired, The content designated by the display content designation information 688 is activated and a message request is transmitted. Since both are determined independently, the content activation and the message request transmission can be set at different timings if they are set to different values.

  The sub-contents control determination information 660 further includes message structure information that starts with a <message> tag 692. In the <message> tag 692, information specifying sub-content control information that determines the timing for transmitting a message is described as a “send” attribute together with a “sendto” attribute indicating the transmission destination address of the message. The value of the “send” attribute is message determination information. In the example shown in FIG. 37, the value of the “send” attribute is “send_fe”. That is, when the sub-contents control information (message transmission information) “send_fe” is received, the information matches the condition indicated by the message transmission determination information, so the message is transmitted to the destination indicated by the “sendto” attribute.

  In the example shown in FIG. 37, message structure information starting with a <message> tag includes a <program> tag, a <voting_service> tag, an <input> tag, a <name> tag, an <address> tag, and a <tvid> tag. is described. The meanings of these descriptions are almost the same as in the first embodiment.

  The details of the broadcast content sub-data possessed by the broadcast content will be described with reference to FIG. Referring to FIG. 38, the broadcast content 700 arranges the contents of the viewer participation posted program on a time series. The broadcast content 700 includes an opening portion 710 of the program, a first trivial knowledge portion 712, a mini-corner portion 714 following the first trivial knowledge portion 712, and a second trivial knowledge portion following the mini-corner portion 714. A portion 716 and an end roll portion 718 displayed after the second trivial knowledge portion 716 are included.

  There is sub-contents control information 730 “trial_1” at the start of the broadcast content. After this, the first trivial knowledge part 712 is started. The arrangement of the sub content control information in the sub content reproduction area 732 corresponding to the first trivial knowledge portion 712 will be described below.

  Sub-contents control information 752 “trivial” is arranged after a predetermined time after the sub-contents control information 730, and sub-contents control information 754 “fe_start” is arranged immediately thereafter. The sub content control information 752 is sub content control information for starting reproduction of the sub content based on the display content designation information 682 shown in FIG. The sub content control information 754 is sub content control information for starting reproduction of the sub content by the display content designation information 684 shown in FIG.

  After this, the viewer is given time to press the “Fee” button displayed on the screen for a certain period of time. Sub-contents control information 755 “knowledge” is arranged at a predetermined position during this time. This is sub-contents control information for displaying knowledge related to the broadcasted knowledge as sub-contents.

  Thereafter, sub-contents control information 756 “send_fe” is arranged. The sub-contents control information 756 is sent from the sub-contents playback device 630 to the broadcast content-related service providing device in order to count the number of times viewers nationwide have pressed the “Fee” button in the broadcast content-related service providing device 614. The timing for transmitting the number of button presses to 614 is determined. Thereafter, sub-content control information 758 of “fe_total” is arranged. The sub-contents control information 758 indicates the timing for requesting the broadcast content-related service providing apparatus 614 a message indicating the result of counting the number of times the viewer has pressed the “Fee” button.

  Thereafter, a time for further pressing the button is secured, and the sub-contents control information 760 “send_fe” is again arranged at the end position. The function of the sub content control information 760 is the same as that of the sub content control information 754. Further thereafter, the sub-contents control information 762 “fe_total” is arranged again. The function of the sub content control information 762 is the same as that of the sub content control information 758. However, in this case, the message obtained from the broadcast content related service providing apparatus 614 is the final count result of the number of times the viewer presses the “Fee” button.

  Thereafter, the sub-contents control information 764 “trial_1_end” is arranged after a predetermined time. When this sub content control information is received, the reproduction of the sub content in the sub content reproduction area 732 ends.

  Similar arrangement of the sub-content control information is also prepared in advance in the sub-content reproduction area 734 for the second trivial knowledge portion 716. Then, sub-contents control information 736 “trial — 200506101900_end” is arranged at the end of the end roll portion 718. When the sub content control information 736 is received, the reproduction of the broadcast content 700 is finished.

  Hereinafter, transition of the sub content playback screen in the sub content playback area 732 will be described with reference to FIGS. 38 to 40. FIG. 39 shows a screen 780 of the sub content playback device 630. Screen 780 is divided into four regions 790, 791, 792 and 794. In the area 790, trivial_ 1. html is displayed. In the area 791, the personal. html is displayed. In the area 792, subtitle. html is displayed. In area 794, total. html is displayed.

  When the sub content control information 730 is received, the reproduction (display) of the program is started. That is, the display of the opening portion 710 is started. In the opening portion 710, no sub-content is displayed. At the end of the opening portion 710, sub-content control information (sub-content start information 750) is broadcast. By receiving this sub-content start information 750, display of the first trivial knowledge portion 712 is started. This part is the first viewer participation part.

  Of the first trivial knowledge portion 712, only the VTR video is broadcast in the first portion. The video is played back by the broadcast content playback device 620. In the sub-contents control determination information 660 shown in FIG. 36, even if the sub-contents control information 750 “trial_1” is received, there is no sub-contents activation information that matches the sub-contents control information 750. Not done.

  Subsequently, when the sub content control information 752 “trial” is received, the sub content corresponding to the display content designation information 682 is reproduced by the sub content control determination information 660 shown in FIG. In other words, the locally accumulated sub-content “trial_1.html” is displayed (area 790 in FIG. 39). Thereafter, when sub-content control information 754 “fe_start” is further received, reproduction of the sub-content by the display content designation information 684 in FIG. 37 is started. That is, reproduction of sub-content information “personal.html” is started (area 791 in FIG. 39). As shown in FIG. 39, a “Fee” button and the number of times the user has pressed this “Fee” button so far are displayed on this screen. This period is provided as a period during which the user presses the “Fee” button.

  If the sub-contents control information 755 “knowledge” is received during this period, the “draw_begin” attribute of the display content designation information 686 of the sub-content 650 matches the sub-contents control information. Therefore, the document “subknowledge_1.html” in the locally stored sub-content described in the “src” attribute of the display content designation information 686 is displayed in the area 792.

  If the sub-contents control information 756 (FIG. 38) “send_fe” is transmitted during this period, the “send” attribute of the message transmission determination information 692 and the sub-contents control information in the sub-contents 650 shown in FIG. Since 756 matches 756, message transmission is executed. At this point, the screen display does not change.

  Subsequently, when the sub-contents control information 758 “fe_total” is received, the “draw_begin” attribute in the display content designation information 688 in the sub-contents 650 shown in FIG. 37 matches the sub-contents control information 758 “fe_total”. . Therefore, a document for the corresponding display (total display “http://www.trivial.jp/total.html” specified by the “src” attribute of the display content specifying information 688) is acquired, and FIG. Is displayed in the area 794 shown.

  At the end of this posting period, the sub-contents control information 756 “send_fe” and the sub-contents control information 758 “fe_total” are received again. In response to the sub-content control information, the above-described message transmission and total display are repeated.

  When sub-contents control information 764 “trivial_1.end” is received at the end of the first trivial knowledge portion 712, it matches the “draw_end” attribute in the <par> tag 680 of FIG. Accordingly, the display of the first trivial knowledge portion 712 by the <par> tag 680 is completed.

  In this way, the screen 780 is divided and each time sub-content control information is received, sub-content control determination information that matches the sub-content control information is checked. Sub-content display / termination control is executed in accordance with the description of the matching sub-content control determination information.

  FIG. 40 shows the relationship between the broadcast content 700 and the transition of the display screen of the sub-content playback device 630. Here, in order to simplify the description, the description of the transmitted sub content control information will not be repeated. Referring to FIG. 40, the screen 781 of the sub-contents playback device 630 is blank during the opening portion 710 and during the beginning portion 770 of the first trivial knowledge portion 712.

  Subsequently, the screen 782 of the posting period 772 includes a display of trivial knowledge and a display of a “Fee” button. Screen 782 includes displays of areas 790 and 791 shown in FIG. Further, since the bean knowledge display 810 is displayed on the way, the display of the sub-contents playback device 630 is a screen 783. Screen 783 includes a display of areas 790, 791 and 792 of FIG.

  Further, in the middle of the posting period 772, transmission 812 of the progress of the number of times the user presses the “Fee” button is performed. Here, the display does not change. Thereafter, an intermediate progress acquisition 814 is performed, and an area 794 in FIG. 39 is displayed. Accordingly, the display of the sub-content playback device 630 is as shown on a screen 784 in FIG. On the screen 784, sub-contents are displayed in any of the four divided areas.

  Further, in the last period 774 of the posting period 772, the same process as that of the intermediate progress transmission 812 is executed. In the subsequent counting result reception period 776, the same processing as that for the intermediate progress acquisition 814 is executed. The display on the screen 784 is updated with the result, and a screen 785 is obtained. In the lowermost area of the screen 785, the final total number of times “Fee” is pressed by all viewers participating in the program is displayed.

  Thereafter, when the first trivial knowledge portion 712 is completed, the display of the sub-contents reproduction device 630 is terminated, and the screen becomes a blank display 786.

  FIG. 41 is a sequence diagram between devices in the present embodiment. Referring to FIG. 41, program producer 602 creates broadcast content (step 460), and creates sub-content linked to the broadcast content (step 462). The sub-content 480 is transmitted to the sub-content reproduction device 630 via the communication network 46 before the program starts to be broadcast (step 466).

  When the broadcast start time of the program comes, the broadcaster 604 transmits the broadcast content 482 to the broadcast content reproduction device 620 via the relay station 72. The broadcast content reproduction device 620 reproduces the broadcast content (step 468), and separates the broadcast content sub-data from the broadcast content and transmits it to the sub-content reproduction device 630 as needed (steps 484, 822, 828, 836). This broadcast content sub-data includes sub-content control information (sub-content activation information, sub-content end information, message transmission information, and message request information).

  When receiving the sub-content control information, the sub-content playback device 630 determines what processing is to be performed on which sub-content based on the sub-content control determination information. For example, as shown in steps 470 and 820, reproduction of the sub-content is started in response to the broadcast content sub-data, and a message is created together. If the broadcast content sub-data transmitted in step 822 is message transmission information, a corresponding message is created and transmitted to the broadcast content-related service providing apparatus 614 in step 824. In response to this message, the broadcast content related service providing apparatus 614 counts the number of times the “Fee” button is pressed (step 826).

  If the broadcast content sub-data transmitted in step 828 is message request information, a message requesting content is transmitted to the broadcast content related service providing apparatus 614 in accordance with display content designation information that matches the message request information (step 830). ). In the present embodiment, the broadcast content related service providing device 614 creates corresponding content (total result) in response to this request (step 832) and transmits it to the sub-content playback device 630 (step 834).

  Further, in response to the next message transmission information transmitted in step 836, the message is transmitted to the broadcast content related service providing apparatus 614 (step 838).

  The above is a series of flows in the present embodiment.

  FIG. 42 shows a flow of control of the computer program when the sub-content playback device 630 according to the present embodiment is realized by computer hardware and a computer program.

  Referring to FIG. 42, when sub-content reproduction by 630 is started, broadcast content sub-data is received from broadcast content reproduction device 620 in S840.

  In step S842, it is determined whether the broadcast content sub-data received in step S840 is broadcast content end information. When the broadcast content sub-data instructs the end of the reproduction of the broadcast content, the operation of the sub-content reproduction device 630 is ended. If they are different, the process proceeds to S844.

  In step S844, the sub content control information received from the broadcast content reproduction apparatus is analyzed.

  S846 branches to the following four processes depending on the type of the sub content control information based on the analysis result regarding the sub content control information. That is, if the sub content control information is sub content activation information, the process proceeds to S850. If it is sub-content end information, the process proceeds to S848. In the case of message communication information (message request information and message transmission information), the process proceeds to S852. In the case of control information for terminating reproduction of sub-contents, the process proceeds to S854.

  In S850, based on the received sub-content activation information and the sub-content activation determination information possessed by the sub-content, it is determined whether or not the sub-content can be displayed, and reproduction of the corresponding content is started. After starting the sub-contents, the process returns to S840.

  In S848, it is determined whether or not the sub-content can be ended from the received sub-content end information and the sub-content end determination information of the sub-content, and the corresponding content is ended. After finishing the sub-contents, the process returns to S840.

  In S852, a determination is made regarding the type of communication information. If the communication information is message request information, the process proceeds to S854. If it is message transmission information, the process proceeds to S856.

  In S854, the requested sub-content is selected from the received message request information and the message request determination information of the sub-content, and a message is requested to the corresponding service. After requesting the message, the process returns to S840.

  In S856, a message to be transmitted by the sub-content is selected from the received message transmission information and the message request determination information possessed by the sub-content, and after the message is shaped, this message is transmitted to the corresponding service. After transmitting the message, the process returns to S840.

  FIG. 43 shows a program example (html document) in the case where the information operated on the sub-content is reflected in the message and transmitted to the service. Here, the display of area 791 in FIG. 39 is taken as an example. It can be seen that the document name of the html document displayed as the sub-content is “personal.html” from the “src” attribute of the display content designation information 684 in FIG. The html text shown in FIG. 43 is the contents of this document.

  In personal.html shown in FIG. 43, there is a “count” attribute (count = “count_fe”) in an <input> tag that defines a “Fee” button (button 793 in FIG. 39). In this case, when the button 793 is clicked, the number of clicks is counted from 0, and the value is stored as a numerical value in count_fe which is a variable designated by the “count” attribute. This value is transmitted to the broadcast content related service providing apparatus 614 as the content of the message.

  That is, returning to FIG. 37, the sub-content activation determination information 692 in the sub-content 650 includes an input tag having the above-described variable “count_fe” as a “value” attribute. In this case, when “send_fe” which is sub-content control information (message transmission information) designated by the “send” attribute is received, the value of this variable count_fe is acquired from personal.html having the variable count_fe.

  In the example shown in FIG. 43, there is a max attribute in <input>. The “max” attribute indicates the maximum value that can be input by this input. That is, in the case of the present embodiment, the maximum value of the number of button clicks is designated by the “max” attribute. In this embodiment, the value of the variable count_fe is limited to 20 even if 20 or more buttons are clicked.

  With the above configuration, the broadcast content and sub-contents cooperation service system is realized.

<Operation>
With reference to FIGS. 34 to 43, the broadcast content linkage service system 600 according to the second embodiment described above operates as follows.

  The broadcast content creation device 60 creates broadcast content including program AV data and broadcast content sub-data, and broadcasts the created broadcast content via the relay station 72 in a predetermined time zone.

  The sub content creation device 612 transmits the sub content to the mobile terminal 622 through the communication network 46.

  The broadcast content playback device 620 receives the broadcast from the relay station 72 and plays back the content. When the received broadcast content includes broadcast content subdata, the broadcast content reproduction device 620 transfers this data to the subcontent reproduction device 630 of the portable terminal 622 via the network 46 (wireless LAN or the like). The sub-content reproduction device 630 reproduces the sub-content using the transferred broadcast content sub-data and the sub-content received from the sub-content creation device 612 and stored in advance.

  At this time, when the viewer (user of the portable terminal 622) clicks the button based on the display content, the number of clicks is recorded in the variable “count_fe” in the sub-contents playback device 630. When a pre-designed point in time is reached in the broadcast, message transmission information is given to the sub-contents playback device 630 via the relay station 72 and the broadcast content playback device 620. In response to the message transmission information, the sub-content reproduction device 630 creates a message based on the message structure data included in the sub-content and the value of the variable count_fe, and transmits the message to the broadcast content-related service providing device 614. . This message includes the number of times the button is clicked (count_fe), personal information preset in the portable terminal 622, and information preset in the sub-content (such as transmission destination information).

  As a result, the program producer 602 having the broadcast content creation device 60, the sub-content creation device 612, and the broadcast content-related service providing device 614 receives information related to the TV program from the viewer during or immediately after the TV program is broadcast. It can be collected and aggregated or aggregated and the results can be provided to the viewer.

  The user of the portable terminal 622 does not need to input a message transmission destination. Therefore, it becomes easy for the user to use the service. Further, it is possible to prevent erroneous message transmission due to an input error. In addition, the transmission destination of the message is prepared in advance in the sub-content in cooperation with the broadcast content, and is transmitted at a timing determined by the sub-content control information (message transmission information or message request information) via the broadcast. Therefore, it is possible to prevent duplicate transmission of messages and transmission at an undesired timing.

[Modification of Second Embodiment]
Next, a broadcast content cooperation service system according to a modification of the second embodiment will be described with reference to FIGS.

  This modification is a case where sub-contents control information is not included in the broadcast content. That is, of the broadcast content sub data, the sub content control information is distributed to the mobile terminal via the communication path. Of the broadcast content sub-data, message usage information is included in the broadcast content and distributed. Accordingly, the broadcast content sub-data includes only message usage information.

  FIG. 44 is a block diagram showing a schematic configuration of a broadcast content cooperation service system 890 according to this modification. This broadcast content cooperation service system 890 is the same system as the broadcast content cooperation service system 600 (see FIG. 34) according to the second embodiment, but instead of the program producer 602 shown in FIG. Of the sub-data, only the message usage information is included in the broadcast content and transmitted to the broadcaster 604, and the sub-content control information is transmitted to the terminal device 622 via the network 46 by the program producer 892 that provides the service. It is different from the broadcast content cooperation service system 600 in that it is included.

  Referring to FIG. 44, program producer 892 differs from program producer 602 shown in FIG. 34 in the following points. That is, the program producer 892 includes a broadcast content creation device 900 that includes only message usage information in the broadcast content and transmits the broadcast content to the broadcaster 604, instead of the broadcast content creation device 60 shown in FIG. In addition to the same sub-content creating device 612 and broadcast content-related service providing device 614, the sub-content control information is created, and the sub-content control information is transmitted via the network 46, not via the broadcaster 604, to the terminal device. The program producer 892 is different from the program producer 602 in that it has a sub-contents control information creating / synthesizing device 902 for distribution to 622.

  In this modification, the broadcast content creation apparatus 900 does not transmit sub content control information. Therefore, only the broadcast content not including the sub content control information is transmitted from the relay station 72 to the broadcast content reproduction device 620.

  FIG. 45 is a block diagram showing a schematic configuration of a sub-contents control information creation / combination device 902 according to this modification. Referring to FIG. 45, sub-contents control information creating / combining apparatus 902 includes sub-contents control information transmission specifying information acquisition unit 924 for acquiring information that is the basis for determining the timing for transmitting sub-contents. The information for specifying the sub content control information transmitted from the sub content control information creating / combining device 902 to the terminal device 622 (see FIG. 44) is recorded together with the information for specifying the transmission timing of the sub content control information. Based on the sub-contents control information correspondence table 922 and the information acquired by the sub-contents control information transmission identification information acquisition unit 924, the sub-contents control information correspondence table 922 is searched and the sub-contents control information that is the timing to transmit is searched. If so, send the sub-contents control information For the includes information identifying the sub-content control information to be transmitted, and a sub-content control information transmission determination section 926 for outputting a transmission instruction signal for instructing the transmission.

  The sub-contents control information creating / synthesizing device 902 further acquires and accumulates sub-contents control information prepared in advance by some means, specifies the sub-contents control information from the sub-contents control information transmission determination unit 926 Upon receiving the information, a sub-contents control information storage unit 920 for outputting the sub-contents control information, and a sub-contents control information storage unit in response to the transmission instruction signal given from the sub-contents control information transmission determination unit 926 A sub-contents control information transmission unit 928 for transmitting the sub-contents control information output from 920 to the terminal device 622 via the network 46 (see FIG. 44).

  In the present embodiment, it is assumed that the timing for transmitting the sub content control information is determined by the time. Therefore, the sub-contents control information correspondence table 922 stores many sets of time and sub-contents control information to be transmitted at that time, as shown in the lower right of FIG. In the example shown in FIG. 46, the sub-contents control information “trivial_200506101900_start” is transmitted at 19:00, and three sub-contents control information of sub-contents control information “trivial_1”, “trivial”, and “fe_start” are transmitted at 19:10. The same applies hereinafter. Therefore, the sub-contents control information transmission specifying information acquisition unit 924 according to the present embodiment reads the timer to specify the time and performs a process of giving the value to the sub-contents control information transmission determining unit 926.

  The broadcast content cooperation service system 890 according to the present modification is different from the second embodiment only in the operation of the broadcast content creation device 900 and the operation of the sub content control information creation / combination device 902. Therefore, in this modification, only these operations will be described.

  Of these, the broadcast content creation device 900 does not include the sub content control information in the broadcast content sub-data and broadcasts only the message usage information, as compared with the broadcast content creation device 60 of the second embodiment. Different operations are performed only in transmission to the business operator 604. Therefore, no further details will be given on the details of the operation.

  One sub-contents control information creation / synthesis apparatus 902 operates as follows. Referring to FIG. 45, sub-contents control information storage unit 920 receives externally generated sub-contents control information from the outside in advance and stores it together with information for identifying each.

  The sub-contents control information correspondence table 922 receives in advance the time at which sub-contents are transmitted for the sub-contents control information held by the sub-contents control information storage unit 920, along with information for specifying the sub-contents control information, in the lower right of FIG. Remember it as shown.

  The sub-contents control information transmission specific information acquisition unit 924 periodically reads the timer and gives the value to the sub-contents control information transmission determination unit 926. The sub-contents control information transmission determination unit 926 searches the sub-contents control information correspondence table 922 to check whether there is sub-contents control information that is to be transmitted at a time that matches this time. If there is such sub-content control information, the sub-content control information transmission determination unit 926 sends information specifying the sub-content control information to the sub-content control information storage unit 920 and sends a sub-content transmission instruction signal to the sub-content control information storage unit 920. The content control information is sent to the content control information transmission unit 928. Sub-contents control information storage unit 920 provides sub-contents control information specified by the information provided from sub-contents control information transmission determination unit 926 to sub-contents control information transmission unit 928. Receiving this, the sub-contents control information transmitting unit 928 transmits the sub-contents control information via the network 46 (see FIG. 44) in response to the transmission instruction signal from the sub-contents control information transmission determining unit 926 (see FIG. 44). (See FIG. 44). The sub-contents control information creating / synthesizing device 902 repeatedly executes this process for all the sub-contents control information that is the transmission timing.

  FIG. 46 shows the configuration of AV data included in broadcast content and details of broadcast content sub-data. This broadcast content sub-data corresponds to that shown in FIG. However, it differs from that shown in FIG. 24 in that it does not have sub-content control information. The broadcast content 700 corresponds to the content of the viewer participation post program described with reference to FIG.

  As indicated by reference numerals 950 and 956 in FIG. 46, time information is inserted into the broadcast content 700. This time information corresponds to the time at which the sub content control information in the sub content control information correspondence table 922 should be transmitted. However, the time information indicated by reference numerals 950 and 956 is not used by the sub-contents control information creation / synthesis apparatus 902.

  Referring to FIG. 45, when receiving the time data from sub-contents control information transmission identification information acquisition unit 924, sub-contents control information transmission determining unit 926 searches sub-contents control information correspondence table 922 and transmits it. It is checked whether there is sub-content control information. If there is corresponding sub content control information, the sub content control information storage unit 920 and the sub content control information transmission unit 928 are controlled to transmit the sub content control information.

  For example, it is assumed that the time when the sub content control information transmission specific information acquisition unit 924 reads from the timer is 19:10. In this case, in the sub-contents control information correspondence table 922 shown in FIG. 46, the three sub-contents control information of trivial_1, trivial, and fe_start are specified to be transmitted and transmitted to the mobile terminal 622 (see FIG. 44).

  In the present modification, unlike the second embodiment, the route through which the sub content control information is transmitted is not a broadcast route but a communication route. However, there is no change in the processing in the sub content playback device 630 in the terminal device 622. That is, the difference between the flowchart for realizing the sub-content playback device 630 according to the present modification and the flowchart of the second embodiment shown in FIG. 42 is that the sub-content control is performed in the process in S840 (see FIG. 42). The only point is whether information is received from the broadcast path or from the communication path. Other processing flows remain unchanged.

  In this modification, time information is adopted as the sub-contents control information transmission specifying information, but this information is not limited to time information. For example, information extracted from the broadcast content such as graphic information of the broadcast content, the performer's face, and the appearance of the building may be used. Moreover, the character information displayed during broadcasting may be used, and the character information such as “first fee” displayed on the broadcast content may be used. In this case, the sub-contents control information transmission specific information acquisition unit 924 needs to be configured to receive broadcast content.

  With the configuration of the above modification, it is possible to ensure the same operation as in the second embodiment in the system in which the sub content control information is transmitted to the mobile terminal via the communication network.

[Third Embodiment]
Next, a broadcast content cooperation service system 970 according to the third embodiment of the present invention will be described with reference to FIG.

  47, broadcast content cooperation service system 970 according to the present embodiment is the same as broadcast content cooperation service systems 40, 41, 600, and 890 shown in FIG. 1, FIG. 26, FIG. 34, and FIG. , A program producer 972 and a broadcaster 974, and further includes a portable terminal 48 having the same configuration as that of the first embodiment.

  In the broadcast content cooperation service system 970 according to the present embodiment, the user uses the mobile terminal 48 to use the sub-content associated with the TV program provided from the Web while watching the TV program on the mobile terminal 48. The service provided by the program producer 972 can be enjoyed. At this time, in the present embodiment, the TV program is provided to the portable terminal 48 via the relay station 72 provided by the broadcaster 974, and the sub-content associated with the TV program is mainly transmitted via the communication network 46. Provided to the portable terminal 48. In the present embodiment, the sub-content may be provided to the portable terminal 48 via the broadcaster 974. As described in relation to the first embodiment, since the sub-content playback device 52 has a function of receiving sub-contents via the network 46 and broadcast, the sub-contents in such a plurality of routes are used. Can be transmitted (see FIG. 6 and the related description).

  In the present embodiment, the portable terminal 48 includes a broadcast content reproduction device 50 and a sub-content reproduction device 52 as in the first embodiment. However, in this embodiment, unlike the first embodiment, there are two communication paths for receiving sub-contents: via the network 46 and via the broadcaster 974.

  The method of the first embodiment or the method of the second embodiment may be used as to how the broadcast content sub-data is transmitted to the sub-content reproduction device 52. In the following description, it is assumed that the broadcast content sub-data is transmitted to the sub-content playback device 52 via the broadcaster 974.

  Hereinafter, a route for distributing data to the portable terminal 48 via the broadcast by the broadcaster 974 is referred to as a broadcast route, and a route for directly distributing data to the portable terminal 48 via the communication network 46 is referred to as a communication route. .

  The broadcaster 974 has the same relay station 72 as in the first embodiment, and in addition to the content synthesizing apparatus 70 (see FIG. 1) of the first embodiment, It is communicable with the device to be described later and is capable of broadcasting the broadcast content received from the program producer 972, and when receiving the sub-content from the program producer 972, the broadcast content and the sub-content are combined and broadcast. Content synthesizing device 990 having a function of creating content to be performed.

  In addition to the broadcast content creation device 60 and the broadcast content related service providing device 614 having the same configuration as in the second embodiment, the program producer 972 performs the first implementation. Is similar to the sub-content creating apparatus 62 according to the embodiment, but normally, the sub-content is transmitted to the portable terminal 48 via the network 46, and if the network 46 is in a bad state, the sub-content is created via the broadcaster 974. And a sub-content creating apparatus 992 having a function of transmitting the sub-content to the portable terminal 48.

  The broadcast content reproduction device 50 in the portable terminal 48 is the same as the broadcast content reproduction device 50 in the first embodiment, and has a function of receiving and reproducing broadcast content via the relay station 72. The sub-content playback device 52 in the portable terminal 48 has the same configuration as the sub-content playback device 52 according to the first embodiment, and receives and plays back the sub-content from the sub-content creation device 992 via the communication network 46. And a function of receiving and playing back the sub-content transmitted to the broadcast content playback device 50 via the broadcaster 974.

  In the present embodiment, broadcast content is distributed from the broadcast route, sub-content is distributed mainly from the communication route, and distribution is performed via the broadcast route when the communication route is in a poor state.

  As described above, the sub-content creating apparatus 992 transmits the sub-content to the portable terminal 48 via the communication path. However, if normal distribution is not possible for some reason, such as a load on the communication network 46, the sub-content is distributed to the portable terminal 48 via the broadcast path. In this case, a functional block for controlling whether the sub-content held in the sub-content creating apparatus 992 is distributed to the communication path or the broadcast path is necessary. With this control, even when the network 46 cannot be used, the sub-content data can be normally distributed.

  The distribution route determination unit designates a distribution route to the sub-content storage unit 102 (see FIG. 3).

  FIG. 48 is a block diagram showing a schematic configuration of a sub-content creating apparatus 992 according to the third embodiment of the present invention. Referring to FIG. 48, sub-content creation apparatus 992 has message storage unit 90, sub-content control determination information storage unit 92, sub-content creation unit 94, sub-content transmission unit 96, and template storage similar to those shown in FIG. Unit 98, operation unit 100, and distribution unit 104.

  The sub-content creation device 992 further stores the sub-content created by the sub-content creation path 94 and the sub-content transmission path judgment section 1002 for judging whether to transmit the sub-content to the broadcast path or the communication path. At a predetermined time, normally, the sub content is transmitted to the mobile terminal 48 (see FIG. 47) registered in advance via the distribution unit 104, and the load on the network 46 is determined by the determination result of the sub content transmission path determination unit 1002. A sub-content storage unit 1004 for transmitting sub-contents to the content synthesizing device 990 via the sub-content transmission unit 96 when it is determined to be high.

  When the sub-content transmission path determination unit 1002 determines the transmission path, some determination information is required. For example, consider a case where the sub-content data acquired by the portable terminal 48 (see FIG. 47) from the content synthesizing device 990 via the network 46 is defective and inconsistent, and it is necessary to re-acquire the sub-content data. At this time, the portable terminal 48 transmits a sub-content reacquisition request to the content composition device 990. When receiving a sub-content reacquisition request from the portable terminal 48, the sub-content transmission path determination unit 1002 performs control for transmitting the sub-content through a path different from the previously transmitted path. In this way, the sub-content transmission path determination unit 1002 monitors the communication state of the network 46 by some means and determines a path for transmitting sub-data. However, in this embodiment, the main route of data is a communication route, and the broadcast route is used only when the state of the network 46 is bad.

  According to the above method, it is theoretically possible to distribute broadcast content via a communication path. However, since the broadcast content has a larger data amount than the sub-content and the load on the communication network is too large, at present, this method is not realistic.

  In the present embodiment, the sub content control information may be included in the broadcast content in the same manner as the sub content control information according to the first embodiment. However, the sub content control information according to the present embodiment does not necessarily have to be superimposed on the broadcast content, and may be distributed using a band remaining in the broadcast route through which the broadcast content passes. In this case, it is possible to control the sub content before and after the start of the program by distributing the sub content control information not directly related to the broadcast content. Specifically, a system may be considered in which a questionnaire displayed after a program is distributed as sub-contents, and questionnaire data is automatically started after the program ends.

  It is also conceivable that the sub-content control information is distributed from the communication path as in the modification of the second embodiment. The sub-contents control information may be distributed using either the broadcast route or the communication route. According to this distribution method, even if it is difficult to distribute due to a load on the communication network, the sub-content can be distributed through the broadcast path so that the time error is reduced as much as possible.

  In addition, when the sub-content and the sub-content control information are distributed via the broadcast path, for example, the missing part of the sub-content that has failed to be distributed via the communication path can be distributed again from the broadcast path.

  The above method is particularly effective when the sub-content is EPG. EPG has already been distributed from the broadcast route. If sub-contents can be replenished from both paths as in the present embodiment, data loss can be prevented.

  The above is the description of the third embodiment. As a result, the system realized in the first embodiment and the second embodiment can be realized on a special distribution route and a limited device.

[Modification of Third Embodiment]
Next, a broadcast content cooperation service system according to a modification of the third embodiment of the present invention will be described with reference to FIG.

  This modification basically has the same configuration as the system of the third embodiment. The only difference is that the main route for delivering the sub-content is a communication route in the third embodiment, whereas it is a broadcast route in the present modification. Also in this modification, the sub-content can be distributed to the mobile terminal not only through the broadcast path but also via the communication path depending on the case.

  FIG. 49 is a block diagram showing a schematic configuration of a broadcast content cooperation service system 1100 according to this modification. Referring to FIG. 49, this broadcast content linkage service system 1100 is similar to broadcast provider 974, portable terminal 48, and program producer 972 shown in FIG. 7, like broadcast content linkage service system 970 shown in FIG. However, normally, sub-contents are distributed to the mobile terminal 48 via the broadcaster 974 (broadcast route), and if distribution by the broadcaster 974 is difficult for some reason, it is via the network 46 (via the communication route). ) The third embodiment is different from the third embodiment in that it includes a program producer 1102 that performs processing for distributing sub-contents to the portable terminal 48.

  Like the program producer 972, the program producer 1102 includes the broadcast content creation device 60 and the broadcast content related service providing device 614, and further has the same function as the sub-content creation device 992 of the program producer 972 shown in FIG. However, usually, the sub-content is distributed via the broadcaster 974 (broadcast route), and if the distribution via the communication route is difficult for some reason, the sub-content is automatically transmitted via the network 46 (via the communication route). A sub-content creating apparatus 1110 having a function of distributing

  As described above, the sub-content creating apparatus 1110 normally transmits the sub-content to the portable terminal 48 via the broadcast path. However, the sub-content may be distributed to the mobile terminal 48 via a communication path separately from the broadcast path. Therefore, as in the third embodiment, the sub-content creating apparatus 1110 includes a sub-content transmission path determination unit that controls whether the sub-content is distributed to the communication path or the broadcast path. The determination unit in the present modification normally operates to select a broadcast route, and to select a communication route when the broadcast route cannot be used for some reason.

  The sub-content reproduction device 52 used in the broadcast content cooperation service system 1100 according to this modification is the same as that used in the first embodiment. Therefore, the sub-contents reproducing device 52 in this modification can also be realized by the flowchart shown in FIG. However, the difference is that the transmission path of the sub-content may be a broadcast path or a communication path. Other than that, the processing in the sub-content playback device 52 is not changed. Therefore, the processing flow of the sub-content playback device 52 may be the same as that in FIG.

  The above is the description of the modification of the third embodiment. As a result, the system realized in the first embodiment and the second embodiment allows broadcast contents, sub-contents, and sub-contents via a special distribution path on limited devices. It is possible to distribute control information.

[Derived]
In the first and second embodiments described above, like the button 360 in FIG. 12 or the button 796 in FIG. 39, a “tell a friend” button can be prepared in the sub-contents. By clicking these buttons, a mechanism for transmitting sub-contents currently being used to a different mobile terminal owned by a user or a mobile phone terminal owned by another user is also constructed using the method described above. it can.

  In the second embodiment described above, the sub-content is directly transmitted to the user's portable terminal 622. However, as in the first embodiment, the created message is transmitted to the broadcaster, and the user receives the broadcast content. You may make it possible to receive together.

  In the first and second embodiments described above, it is assumed that a viewer views a broadcast when the broadcast is actually distributed. However, the present invention is not limited to such an embodiment. For example, the above-described mechanism can be used even when a broadcast is stored in a storage medium such as an HDD and viewed in a time zone different from the broadcast distribution time.

  In the second embodiment, a message is automatically transmitted in response to message transmission information distributed from a broadcast. This prevents a message from being transmitted at an inappropriate time in the program or a message at an arbitrary time after the end of the program, as compared with the case where the viewer decides the transmission timing. Therefore, it is possible to prevent a message that is undesirable for the program producer (broadcaster). Moreover, what can be used as a terminal is not restricted to a portable terminal. As long as it has the same function as the portable terminal 48 described above, it may not be portable. For example, a TV receiver or a desktop PC may be used as the terminal. However, in the present embodiment, it is desirable to use a mobile phone terminal as the terminal 48.

  In the first and second embodiments described above, the sub content control information is data different from the broadcast content, and is text data. However, the sub content control information is not limited to text data, and may be audio information or image information. Further, the sub-content control information can be realized not only as sub-data that can be distinguished from broadcast data, but also data held by the broadcast content itself. For example, text data displayed in the AV data, audio information held by the AV data itself, or image information can be used as the sub-content control information. When the sub content control information is audio information or image information, the sub content control determination information must also be able to determine whether it matches the audio information or image information. The same applies to message usage information. The same applies to information embedded as a digital watermark in broadcast content as sub-content control information.

  In the first and second embodiments, the broadcast content sub-data is distributed to viewers in a format associated with the broadcast. Thereby, on the playback device held by the viewer, the cooperation between the broadcast content and the sub-content is temporally coincident. That is, appropriate sub-contents are reproduced in a scene where the broadcast content is actually reproduced. However, the present invention is not limited to such a format. Even when data corresponding to the broadcast content sub-data is not attached to the broadcast content, it can be realized by taking the following format.

  For example, a method that does not combine broadcast content sub-data and broadcast content is also conceivable. In this case, a provider that provides a service using the broadcast content related service providing device 64 determines in advance when and what sub-content control information should be provided to the playback device in order to cooperate with the broadcast content. deep. Broadcast contents are broadcast by broadcasters as usual. When the broadcast content is actually broadcasted, the service provider distributes appropriate sub-contents control information at an appropriate timing via some means such as a network. Of course, it is necessary to distribute sub-contents corresponding to certain sub-contents control information before distributing the sub-contents control information.

  With such a configuration, when the viewer is viewing the broadcast content, the sub content control information is acquired through a route different from the broadcast content, and the same effects as those of the first and second embodiments described above are obtained. I can do things. In this case, the broadcast content is recorded on a storage medium and cannot be viewed in real time. However, in the following manner, linked sub-contents can be provided in synchronization with the reproduction of the content from the storage medium.

  In this case, it is the same as the above embodiment that the sub-content is distributed to the viewer in advance. In addition, it is determined in advance at what time the sub-contents control information is to be distributed at a relative time starting from the start of content reproduction, and the information is arranged in the broadcast content-related service providing apparatus 614 or the like. When the viewer starts playing the content from the storage medium, the viewer transmits information about the time at that time to the service provider via the network. The device of the service provider starts from this time, and distributes the sub-contents control information scheduled at a predetermined time as a relative time from there. By doing so, it is possible to ensure synchronization between the content and the sub-content control information, as in the case of transmitting the sub-content control information together with the broadcast content in real time by broadcasting. As a result, an effect equivalent to that of the above-described three embodiments can be obtained.

  In the above embodiment, the sub content control information is data for controlling the start, reproduction, and termination of the sub content. However, the items controlled by the sub content control information are not limited to those described above. The sub-content control information can also control, for example, message transmission / reception.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim in the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are intended. Including.

It is a block diagram which shows schematic structure of the broadcast content cooperation service system 40 which concerns on the 1st Embodiment of this invention. 3 is a block diagram showing a schematic configuration of a broadcast content creation device 60 in the broadcast content cooperation service system 40. FIG. It is a block diagram which shows schematic structure of the sub content production apparatus 62 in the broadcast content cooperation service system 40. FIG. 2 is a block diagram showing a schematic configuration of a content composition device 70 in a broadcast content cooperation service system 40. FIG. FIG. 3 is a block diagram showing a schematic configuration of a broadcast content reproduction apparatus 50 existing in a mobile terminal 48 in the broadcast content cooperation service system 40. FIG. 3 is a block diagram showing a schematic configuration of a sub-content reproduction device 52 existing in a mobile terminal 48 in the broadcast content cooperation service system 40. It is a block diagram which shows schematic structure of the broadcast content related service provision apparatus 64 in the broadcast content cooperation service system 40. FIG. It is a figure which shows the data structure of the sub content utilized in the broadcast content cooperation service system. It is a figure which shows the first half of the XML document which concerns on an example of a sub content. It is a figure which shows the second half of the XML document which concerns on an example of a subcontent. It is a figure which shows the main screen which is an example of the display based on broadcast content. It is a figure which shows the subcontent output screen which is an example of the display screen based on broadcast content. It is a figure explaining the structure of AV data contained in broadcast content, and the broadcast content subdata details. It is a timing chart which shows the timing of the screen output of AV data and subcontent contained in broadcast content. It is a process sequence diagram which shows the process in each apparatus contained in the broadcast content cooperation service system 40, and the flow of the data between apparatuses. 3 is a flowchart showing a control structure of a computer program that realizes a broadcast content reproduction apparatus 50. 4 is a flowchart showing a control structure of a computer program that realizes a sub-contents reproducing apparatus 52. It is a figure which shows typically an example of the HTML document contained in a subcontent. It is a figure which shows the structure of the message data utilized when a sub content performs a transmission process, and the example of a message. It is a block diagram which shows schematic structure of the sub content production apparatus 63 in the broadcast content cooperation service system 40. FIG. It is a figure which shows the data structure of the sub content utilized in the broadcast content cooperation service system. It is a figure which shows the first half of the XML document which concerns on an example of a sub content. It is a figure which shows the second half of the XML document which concerns on an example of a subcontent. It is a figure explaining the structure of AV data contained in broadcast content, and the broadcast content subdata details. 4 is a flowchart showing a control structure of a computer program that realizes a sub-contents reproducing apparatus 52. It is a block diagram which shows schematic structure of the broadcast content cooperation service system 41 which concerns on this modification. FIG. 3 is a block diagram showing a schematic configuration of a sub-content reproduction device 54 existing in a mobile terminal 48 in a broadcast content cooperation service system 41. It is a figure which shows the data structure of the sub content utilized in the broadcast content cooperation service system 41. FIG. It is a figure which shows the first half of the XML document which concerns on an example of a sub content. It is a figure which shows the structure of the message data utilized when a sub content performs a transmission process, and the example of a message. It is a figure which shows the subcontent output screen which is an example of the display screen based on broadcast content. It is a figure explaining the structure of AV data contained in broadcast content, and the broadcast content subdata details. It is a flowchart which shows the control structure of the computer program which implement | achieves a subcontent reproduction | regeneration apparatus. It is a block diagram which shows schematic structure of the broadcast content cooperation service system 600 which concerns on the 2nd Embodiment of this invention. 6 is a block diagram showing a schematic configuration of a sub-content creation device 612 in the broadcast content cooperation service system 600. FIG. 6 is a diagram showing a data structure of sub-contents used in a broadcast content cooperation service system 600. FIG. It is a figure which shows an example of the sub content contained in broadcast content in an XML format. It is a figure explaining the detail of the structure of AV data contained in broadcast content, and broadcast content subdata. It is a figure which shows an example of the display screen based on broadcast content. It is a timing chart which shows the timing of the screen output of AV data and subcontent contained in broadcast content. It is a processing sequence figure which shows the process in each apparatus contained in the broadcast content cooperation service system 600, and the flow of the data between apparatuses. 10 is a flowchart showing a control structure of a computer program that realizes a sub-contents playback device 630 existing in portable terminal 622. It is a figure which shows an example of the HTML document contained in a subcontent. It is a block diagram which shows schematic structure of the broadcast content cooperation service system 890 which concerns on the modification of 2nd Embodiment. It is a block diagram which shows schematic structure of the sub content control information creation / synthesis apparatus 902 which concerns on the modification of 2nd Embodiment. It is a figure explaining the detail of the structure of AV data contained in broadcast content, and broadcast content subdata. It is a block diagram which shows schematic structure of the broadcast content cooperation service system 970 which concerns on the 3rd Embodiment of this invention. It is a block diagram which shows schematic structure of the sub content production apparatus 992 which concerns on the 3rd Embodiment of this invention. It is a block diagram which shows schematic structure of the broadcast content cooperation service system 1100 which concerns on the modification of 3rd Embodiment.

Explanation of symbols

  40, 41, 600, 890, 970, 1100 Broadcast content linkage service system, 42, 602, 892, 972, 1102 Program producer, 44, 604, 974 Broadcaster, 46 Network, 47, 48, 49, 622 Mobile Terminal, 50, 620 broadcast content playback device, 52, 54, 630 sub content playback device, 60, 900 broadcast content creation device, 62, 612, 992, 1110 sub content creation device, 64, 614 broadcast content related service providing device, 70, 610, 770, 820 Content composition device, 72 relay stations, 230, 231, 233, 650 Sub-content, 240 Layout information, 241 Message information, 246, 247, 660 Sub-content control determination information, 390, 39 , 397, 398, 399, 400, 420, 421, 422, 424, 425, 426, 730, 736, 750, 752, 754, 755, 756, 758, 760, 762, 764, 781, 782, 783, 784 785,786 Sub-contents control information

Claims (18)

A sub-contents playback device that plays back predetermined sub-contents related to the first content in cooperation with the main first content,
Sub-content control information for designating reproduction control related to the sub-content associated with a predetermined timing at the time of reproduction of the first content is prepared in advance for the first content,
The sub-contents playback device
Storage means for acquiring and storing the sub-content;
Acquisition means for acquiring sub-contents control information prepared in advance for the first content at the time of reproduction of the first content;
Sub-content for performing reproduction control corresponding to the acquired sub-content control information on the sub-content stored in the sub-content storage in response to the acquisition unit acquiring the sub-content control information A sub-contents reproducing apparatus including a control means. The sub-content control information specifies either a sub-content data item to be controlled and a sub-content stored in the sub-content stored in the sub-content storage unit,
In response to the acquisition of the sub-contents control information by the acquisition unit, the sub-contents control unit applies the acquired sub-content to the sub-content data item specified by the sub-contents control information or the sub-content. The sub-contents reproducing apparatus according to claim 1, comprising means for executing reproduction control corresponding to the content control information.   The sub-contents playback apparatus according to claim 2, wherein the first content is distributed by broadcasting.   The sub-contents playback apparatus according to claim 1, wherein the acquisition unit includes a unit for receiving the sub-content and the sub-content control information from the same route as the route for acquiring the first content.   The sub-contents playback apparatus according to claim 1, wherein the acquisition unit includes a unit for receiving the sub-content and the sub-content control information from a route different from a route for acquiring the first content. The first content is distributed with the sub-content control information superimposed,
The sub-contents playback apparatus according to claim 4, wherein the acquisition unit includes a reception unit that receives the first content and separates the sub-content control information from the received first content. The sub-content control information is distributed without being superimposed on the first content,
The sub-contents playback apparatus according to claim 4, wherein the acquisition unit includes a reception unit for separately receiving the first content and the sub-content control information. The sub-content may include one or more sub-content data items,
Each of the one or more sub-content data items includes process specifying information for specifying a process for the sub-content data item and trigger specifying information for specifying sub-content control information that triggers execution of the process. And
The sub-content control means includes
A determination unit for determining whether the acquired sub-content control information matches any of the trigger specifying information included in any of the one or a plurality of sub-content data items;
In response to determining that the received sub-contents control information matches any of the trigger specification information by the determination means, a process specified by the process specification information corresponding to the trigger specification information, The sub content reproduction apparatus according to claim 1, further comprising: a process execution unit for executing the sub content data item including the process specifying information.   The determination means includes means for determining whether or not the sub content control information acquired by the acquisition means matches a predetermined data string specified by any of the trigger specifying information. 9. The sub-content playback device according to 8. The determination means is for specifying, among each of the one or a plurality of sub-content data items, that the trigger specifying information of the sub-content data item matches the sub-content control information acquired by the acquiring means. Including means,
The process execution means matches each of the sub-content data items specified by the specifying means with the acquired sub-content control information among the trigger specification information included in the sub-content data items. The sub-contents playback device according to claim 8, comprising means for executing a process specified by the process specifying information associated with an item to be processed. The processing specific information is
Sub-content activation information instructing activation of the corresponding sub-content data item;
The sub-contents playback apparatus according to any one of claims 8 to 10, comprising sub-contents end information for instructing the end of the corresponding sub-content data item.   12. The sub-content according to claim 11, wherein the processing specifying information further includes message transmission information for instructing to generate a message including data generated by the corresponding sub-content data item and to transmit the message to a predetermined transmission destination. Playback device. Each of the one or more sub-content data items includes unique information included in the sub-content playback device for designating control of execution of the process specified by the process-specific information for the corresponding sub-content data item. Contains verification information to be verified,
The sub-content control means includes
Means for determining whether or not the collation information included in any one of the one or more sub-content data items matches unique information of the sub-contents playback device;
In response to determining by the means for determining that the collation information included in any of the one or more sub-content data items matches unique information possessed by the sub-contents playback device, The sub-contents reproducing apparatus according to any one of claims 8 to 10, further comprising means for permitting or canceling processing by the process executing means.   The sub-contents reproducing apparatus according to any one of claims 11 to 13, wherein the process specifying information further includes data acquisition information for instructing acquisition of a document specified by a corresponding sub-content data item. The means for executing the process is:
Among the sub-content data items specified by the specifying means, means for starting up the one containing trigger specifying information that matches the acquired sub-content starting process independently from the other sub-content data items; ,
Among the sub-content data items specified by the specifying means, the sub-content data items that contain trigger specifying information that matches the acquired sub-content end processing, and that have been started by the starting means, 12. The sub-contents reproducing apparatus according to claim 11, further comprising means for terminating the content data items independently. The receiving means includes means for receiving the first content by broadcasting,
The sub-contents reproduction device according to claim 6, further comprising content reproduction means for reproducing the first content received by the broadcast. A content reproduction device for receiving first content and reproducing the received first content;
A sub-contents playback device according to any one of claims 1 to 15,
A housing that holds the content playback device and the sub-content playback device inside;
The sub-contents playback device acquires sub-contents that cooperate with the first content received by the content playback device;
A portable terminal in which the sub-contents playback device executes predetermined processing on the sub-contents according to the sub-contents control information acquired in association with the first content by the acquisition means. A content providing apparatus that provides first content as a main body;
A content reproduction service providing system including a content reproduction device for receiving and reproducing the first content from the content provision device;
A sub-content providing device for providing sub-content related to the first content;
A sub-contents control information providing device that supplies sub-contents control information that triggers a predetermined process for the sub-contents to the content reproduction device at a predetermined timing when the first content is reproduced,
The content playback device
Storage means for acquiring and storing the sub-content from the sub-content providing device;
An acquisition means for acquiring sub-contents control information for the first content from the sub-contents control information providing device when reproducing the first content;
Sub-content for performing reproduction control corresponding to the acquired sub-content control information on the sub-content stored in the sub-content storage in response to the acquisition unit acquiring the sub-content control information A content-related service providing system including a control unit.

Images