JP2007116718A - Method, system, and apparatus for acquiring information related to broadcast information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain a related information providing service related to broadcast information without executing special processing such as adding information required for providing related information to the broadcast information. <P>SOLUTION: In the related information providing method for acquiring related information as information related to the broadcast information and providing the information to a viewer, the broadcast information is stored in a broadcast information database in advance, information related to each broadcast information is stored in a related information database in advance, broadcast information being viewed by the viewer or broadcast information corresponding to partial broadcast information as feature amount information obtained by converting the broadcast information is searched from the broadcast information database, and the related information database is further searched based on the above broadcast information. In this way, the related information of the broadcast information is acquired and provided to the viewer. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique in which a viewer acquires information related to broadcast information or recorded information from a server or the like connected to a network.

  Digital satellite broadcasting and data broadcasting have also begun, and they are highly expected as new mass media in addition to various broadcasting services. In the field of communications, many access systems such as ISDN, DSL, FTTL, IMT-2000, etc. have been established. Popularization is expected. The Internet is also showing great potential as a mass media. In the near future, digital broadcasting and broadband communication will be closely integrated, and it is expected that more diverse services will bloom with interactive as a keyword.

  The greatest benefit for viewers that interactive brings is the personalized enjoyment of personalized information (information that suits the person). Tools (terminals) for enjoying information are also becoming increasingly diverse and widespread that are suitable for the type and amount of information received, the purpose and environment of use, the ease of operation of information, etc. Yes.

Against this background, the prior art and its problems in the above technical field will be described from the following three viewpoints.
(1) Information given unilaterally from one direction, such as a television or radio, does not feel annoying because it does not involve a strong positive operation for obtaining the information. There is a limit to the information that can be put there. There is no problem if viewers are satisfied with the information selected and produced by the information provider, but each viewer can provide information such as dissatisfaction with the amount of information from each preference, broadcast time, broadcast area, etc. If you feel dissatisfied with the method, you cannot solve the dissatisfaction with analog media such as analog TV and analog radio. Even if the broadcast media is digitized from analog and the information that can be physically put on it is increased, or even if the viewer is given pseudo-interactiveness by the information distribution by the carousel method, the dissatisfaction is essentially solved. It is not.

  Services that distribute information that could not be put on broadcast media and related information using the Internet have also been started, but because they are simply providing information through multiple media (multimedia), the usage scene of viewers In view of the user interface, the linkage and linkage between information distributed in different media (multimedia) is not solved from the viewpoint of the user interface.

  The inventions of JP-A-9-160852 (Patent Document 1) and JP-A-2000-183835 (Patent Document 2) provide an apparatus for easily obtaining music and video broadcast on radio and television from a network. . This solves the problem related to the troublesomeness of obtaining broadcasted music and video after viewing. Additional information (related information) for identifying them together with music and video is placed on the media and distributed to the viewer, and when the music and video desired by the viewer are distributed, the request is input to the receiving device. The additional information is recorded. This is a mechanism for identifying and obtaining desired music or video via a network using the recorded additional information as a key.

  However, on the premise of the current wide variety of communication access systems and terminals, responding to a wide variety of services that provide related content that individual viewers want from their preferences, linked and linked to broadcast content, In principle, the content provider cannot provide the service in a fair manner.

That is, the following problems are not solved by the conventional technology. It is not configured in a distribution device that can provide a wide variety of services. Distribution of related content in consideration of the receiving environment (terminal specifications, etc.) of the viewer is not possible. The status of the access system during distribution cannot be grasped. In addition, the conventional technology is configured such that a service can be received only when a request for a service to be provided (recording of related information necessary for receiving the service) is input when a song or video desired by the viewer is distributed. . Therefore, it is not possible to make reservations and notifications for services linked to and linked to broadcasting. When a viewer wants to receive a desired service without omission, the conventional apparatus configuration forces the viewer to constantly record related information.
(2) On the other hand, in digital broadcasting such as BS digital broadcasting and CS digital broadcasting, various related information is provided together with video and audio, and it is possible for the viewer to refer to the related information while viewing the video. Yes.

  However, in a television receiver that is generally used as a digital broadcast receiver, when browsing related information, the related information is displayed on a part of the video display unit, or the related information is displayed on the entire video display unit. Therefore, when browsing related information, it is necessary to reduce the size of the video, hide a part of the video, or temporarily stop viewing the video. In addition, when the amount of related information is large, it is difficult for the viewer to fully understand the content of the related information while watching the video, and when the viewer wants only the related information after the program ends. It is desirable to be able to watch slowly. In the conventional digital broadcast receiving apparatus, when browsing related information, the received related information is uniformly displayed on the screen, so that related information that is not of interest to the viewer is displayed. .

  In addition, the digital broadcast receiver automatically uses the related information and EPG (Electric Program Guide) information to automatically display the broadcast program and related information that the viewer is interested in while the viewer is not watching the TV broadcast. It has been studied to select and store them in the apparatus. At this time, it becomes a problem to acquire information indicating the viewer's interest. Conventionally, a method has been proposed in which interest information is acquired by directly inputting a keyword in which the viewer is interested, or the interest information is estimated from related information of a program viewed by the viewer.

  Here, a method of automatically selecting broadcast programs that are of interest to viewers is described in the following document, for example. [Non-patent Document 1]: Yuichi Yagawa, Hiromi Tsukai, Tetsuo Tanaka, Masahiro Shibata, Ms. Kim, “Examination of an agent that automatically organizes a TV program that suits individual preferences”, IEICE Technical Report, AI 98-55, PP. 9-16, December 1998.

  Further, a method for estimating the interest information from the related information of the program viewed by the viewer is described in Japanese Patent Application Laid-Open No. 11-134345 “Preference Information Selection Device” (Patent Document 3).

However, it is not always easy for the viewer to consciously input keywords of interest. In addition, the method of estimating the interest information from the related information of the program leaves essentially the same problem as displaying the related information that is not of interest.
(3) As described above, in digital broadcasting, it is possible to multiplex and broadcast data signals as arbitrary related information to television broadcasting or radio broadcasting. Therefore, in a digital broadcast receiving apparatus or a terminal connected to the receiving apparatus, processing synchronized with broadcast content can be performed by using a data signal multiplexed in the broadcast. For example, it is possible to distribute related information regarding a broadcast television program or radio program simultaneously with the program.

  Similarly, in analog television broadcasting, an arbitrary data signal is multiplexed on a television video signal by a method defined by ARIB STD-B5 “standard television data broadcasting of transmission method using vertical blanking interval”. It is possible. In particular, in a system called “Bit Cast” (reference: Nikkei Multimedia, No. 28, 1997.10, P.52-P.57) (Non-Patent Document 2), the signal is multiplexed with an analog TV video signal. The function of presenting related information synchronized with the broadcast content is realized by using the data signal.

  In WWW (World Wide Web), content on a predetermined home page is sequentially updated in synchronization with broadcast content such as television and radio. A client connected to the Internet can enjoy information presentation and the like synchronized to some extent with broadcast content by accessing the predetermined home page.

  However, in order to perform processing synchronized with broadcast content using a data signal multiplexed in broadcasting, it is necessary for a terminal that performs the processing to acquire a data signal multiplexed in broadcasting. That is, there is a problem that the terminal itself must have a function of receiving a broadcast, or a function of acquiring a data signal that is connected to the broadcast receiving apparatus and multiplexed from the broadcast receiving apparatus.

  In addition, when a terminal acquires a data signal multiplexed in broadcasting via a network without having such a function, a delay time of the data signal in the network occurs from the event occurrence to the execution of the corresponding action. There is a problem.

  Further, when providing information related to video and audio to be broadcast, in a method of transmitting a URL or the like simultaneously with the video and audio, it is necessary to add the information such as URL to the broadcast information and broadcast it. For example, for broadcast information that is repeatedly broadcast such as CM, it is necessary to sequentially perform processing for adding information such as URL corresponding to each broadcast.

  Furthermore, even when the broadcast video / audio is stored and used, the above-described method can be stored unless information such as a URL broadcast simultaneously with the broadcast video / audio is stored by associating with some means. However, there is a problem that related information cannot be obtained during playback / viewing of video / audio.

  Similarly, in the method of acquiring related information using time and CH number as keys as in Japanese Patent Laid-Open No. 9-160852 “Information Providing Device” (Patent Document 1), when viewing broadcast information once stored, Since the viewing time is different from the broadcast time, it cannot be associated with the related information, and there is a problem that the related information cannot be acquired.

  Further, the conventional technique has a problem that it is impossible to grasp the switching of the image frame of the broadcast program video being viewed very accurately.

As described above, in the related art, there is a problem that it is not easy for a viewer of broadcast information or recorded information to acquire information or content related to broadcast information or recorded information from a server or the like connected to the network. .
JP-A-9-160852 JP 2000-183835 A JP-A-11-134345 Yuichi Yagawa, Hiromi Ukai, Tetsuo Tanaka, Masahiro Shibata, Maki Kim, “Examination of Agents that Automatically Organize TV Programs that Fit Individual Preference”, IEICE Technical Report, AI 98-55, PP. 9-16, December 1998 “Bit Cast” Nikkei Multimedia, No. 28, 1997.10. 52-P. 57

  The present invention has been made in view of the above points, and a viewer of broadcast information or recorded information can easily acquire information or content related to broadcast information or recorded information from a server or the like connected to a network. The purpose is to be able to. More specifically, the present invention achieves the above object by achieving the following first to fifth objects.

  The first object of the present invention is to solve the problem of the prior art (1) above, and a variety of related information that could not be put on a broadcast medium that unilaterally provides information from one direction. Assuming a new communication access system and terminal, the content provider can provide a wide variety of services in a fair manner to individual viewers in a style according to the viewer's wishes, linked and linked to the broadcast content. It is another object of the present invention to provide an environment in which a service desired by a viewer can be received without omission, and an annoyance related to the troublesomeness of receiving a service for obtaining related content after viewing during viewing.

  The second object of the present invention is to solve the problem of the prior art (2) above, and information related to the subject that the viewer is interested in while viewing the video information is limited in time. To make it easy to browse without receiving broadcasts, to automatically select broadcast information that matches the dynamically changing interest information of the viewer, and to make it available to one viewer. It is possible to refer to related information and to enable automatic selection of detailed video information.

  The third to fifth objects of the present invention are intended to solve the problems of the prior art (3) above. More specifically, the third object of the present invention is to enable the viewer apparatus to broadcast. It is to provide a technique for quickly executing a process for an event synchronized with broadcast content of a predetermined channel to be broadcast without acquiring a multiplexed data signal. The fourth object of the present invention is that there is no need to perform special processing such as adding information necessary for providing related information to broadcast information, and broadcast information is temporarily stored and reproduced. It is also possible to provide a related information providing service regarding the broadcast information through the network even when viewing. Furthermore, a fifth object of the present invention is that a viewer apparatus that is independent of the broadcast receiving apparatus, that is, has no communication means such as a communication line for performing digital signal communication with the broadcast receiving apparatus, is being viewed by the user. The broadcast program content can be individually identified with an extremely short time resolution of 1/30 seconds (corresponding to one image frame unit of a television broadcast video) or more, and it is possible to provide a service that is accurately synchronized with the broadcast content It is to be.

  In order to achieve the first object, the present invention can be configured as follows.

  The present invention is a method for a viewer apparatus to receive provision of the service in a system in which a viewer apparatus and a content providing server that provides a service related to video or audio are connected via a network, When the viewer apparatus requests service provision, the viewer apparatus transmits necessary service provision request information to the related information provision server to request information on services that can be provided related to video, and the related information provision server sends the service provision request information. Information on the service that can be provided is transmitted to the viewer device based on the information, the viewer device receives the information on the service that can be provided, and the viewer device provides the service selected from the services that can be provided Is requested from the content providing server, and service is provided from the content providing server.

  In the method, the viewer apparatus may further include a step of storing and holding viewer information, and the service provision request information may include the viewer information.

  In addition, the present invention is a system in which a viewer device for a viewer who views a broadcast and a content providing server that provides content related to the broadcast are connected via a network, Means for transmitting information necessary for requesting service provision to the content providing server in conjunction with or cooperating with the content and requesting information on a service that can be provided related to the broadcast content; and the content providing server Means for visualizing and displaying the information of the service that can be provided received from the server in a selectable form; and means for requesting the service from the content providing server by selecting a service from the information of the service displayed by visualization. Receiving and using a service provided by the content providing server in response to the service request The content providing server selects a service that can be provided based on the information of the viewer device in response to a request for information on the service that can be provided received from the viewer device; And a means for transmitting service information to the viewer apparatus, and a means for receiving a service request from the viewer apparatus and transmitting the service to the requesting viewer apparatus.

  In the system, the viewer apparatus further includes means for receiving event information, and the means for requesting service information in the viewer apparatus is automatically set at a timing preset by the viewer based on the event information. A request may be issued.

  In addition, when the content providing server receives a service request from the viewer device, the content providing server estimates or detects the state of the access system between the content providing server and the viewer device, and the estimated or detected access system And a means for converting and optimizing the content related to the service to be transmitted to the viewer device based on the state and the information of the viewer device.

The present invention is also a viewer device for a viewer who watches a broadcast connected to a content providing server of a provider who provides content related to the broadcast via a network, and is linked or linked to the broadcast content. Then, information necessary for providing a service provision is transmitted to the content providing server, and information on a service that can be provided related to the broadcast content is automatically input by a viewer or at a preset timing. Requesting means, and means for visualizing and displaying information of a service that can be provided received from the content providing server in a selectable form;
Means for selecting a service from the visualized service information and requesting the service from the content providing server; and means for receiving and using the service provided by the content providing server in response to the service request; It comprises so that it may be provided.

  In addition, the present invention is a content providing server of a provider that provides content related to broadcasting, which is connected to a viewer device of a viewer who views a broadcast via a network, received from the viewer device In response to a request for information on services that can be provided, means for selecting services that can be provided based on information on the viewer device; means for transmitting information on the services that can be provided to the viewer device; Means for estimating or detecting the status of the access system between the content providing server and the viewer device when receiving a service request from the viewer device, and the viewing based on the status of the access system estimated or detected Means for converting and optimizing content related to the service to be transmitted to the viewer device, and providing the service by transmitting the optimized content to the requesting viewer device Configured to include and.

  In order to achieve the object of the present invention, the present invention can be configured as follows.

  The present invention is a method for a viewer apparatus to acquire the content information in a system in which the viewer apparatus and a content providing server that provides content information related to video or audio are connected via a network. The viewer apparatus obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and is transmitted from the content providing server. Configure to obtain content information.

  In particular, in order to achieve the second object, in the above-mentioned configuration, the present invention provides the viewer device with related information broadcast together with video or related information recorded with video, and The related information is obtained by separating from at least one information resource identification information corresponding to each of a plurality of subjects included in the video, and subject attribute information describing the subject It can comprise so that it may contain.

  In order to achieve the second object, the present invention can be configured as follows.

  The present invention is a viewer apparatus that receives broadcast information including at least video information including video and related information related to the video information, and the related information includes a plurality of pieces of the related information included in the video information. Corresponding to each of the subjects, including at least one information resource identification information and subject attribute information describing the subject, wherein the viewer device includes a broadcast receiving unit that receives the broadcast information, a video display unit, A video display control unit, a first pointing unit, a subject related information display unit, a related information display control unit, a second pointing unit, a subject attribute information storage unit, a related information access unit, and related information A storage unit, wherein the video display control unit displays video information in the broadcast information received by the broadcast receiving unit on the video display unit, and a plurality of subjects displayed on the video display unit A subject pointed by the first pointing means, and the related information display control unit displays characters, symbols or figures representing the subject identified by the video display control unit in the subject related information display unit. And displaying information resource identification information corresponding to the subject represented by the character, symbol, or figure pointed by the second pointing means in the subject related information display unit, and displaying the information resource identification information as the related information The related information access unit accesses the information source connected to the related information storage unit or the communication network corresponding to the information resource identification information to obtain content information, and displays the related information display The control unit displays the content information obtained by the related information access unit in the subject related information table. Configured to display the part.

  The viewer apparatus further includes an interest information extraction unit, and the related information display control unit is information resource identification information corresponding to a subject represented by a character, symbol, or figure pointed by the second pointing means. Any one or more of the subject attribute information, the content information obtained from the information source, and the display time information related to the time when the content information is displayed on the subject-related information display unit. The interest information extraction unit refers to any or all of the information resource identification information, the subject attribute information, the content information, and the display time information, creates and holds the interest information, and Broadcast information received from the broadcast receiving unit at a time different from the time at which the broadcast information is received is determined based on the interest information. It may be selected to have.

  The viewer apparatus may further include a video storage unit, and the broadcast information selected by the interest information extraction unit may be stored in the video storage unit.

  In the viewer apparatus, the related information display control unit moves a character, a symbol, or a graphic representing the subject displayed on the subject related information display unit by the second pointing unit or another input unit. Or when there is an operation for moving or deleting a character, symbol, or figure representing the subject, operation information indicating the content of the operation is transmitted to the interest information extraction unit, and the interest information The extraction unit may update the interest information based on the operation information.

  Further, in the viewer apparatus, the related information is associated with each of a plurality of subjects included in the video information and includes subject coordinate values when displayed on the video display unit. The subject may be identified by the first pointing means pointing to a region including the coordinate value point.

  In order to achieve the third object of the present invention, the present invention can be configured as follows.

  In a system in which a viewer device and a content providing server that provides content information related to video or audio are connected via a network, the viewer device obtains the content information, the viewer device comprising: Obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and acquires the content information transmitted from the content providing server In this configuration, the system includes a related information providing server, and the related information providing server includes an event identifier indicating a valid event and an operation corresponding to the event identifier for each valid period designated in synchronization with the broadcast time of the video. Configure the specified action table, and the related information providing server will take action to the viewer device. The viewer device receives an action table from the related information providing server, derives an event identifier from the event generated by the viewer device, and uses the received action table to operate corresponding to the event identifier The related information necessary for acquiring the content information is obtained.

  In addition, the present invention processes an event synchronized with broadcast content including a server that collects information related to broadcast content transmitted from a broadcast station or a broadcast information storage server, and a viewer device that communicates with the server via a network. The server includes an event identifier indicating a valid event and action content information indicating a process executed correspondingly for each valid period specified in synchronization with a broadcast time of the broadcast content. Action table configuring means for configuring an action table for designating and an action table providing means for transmitting the action table to the viewer apparatus, wherein the viewer apparatus derives an event identifier from the event that has occurred. Management means and the action table received from the server Referring only that lifetime, configured to have the action table managing means for deriving the action content information corresponding to the event identifier with reference to the table, and action execution means for executing said action contents information.

  In the system, the action table management unit of the viewer device transmits the event identifier derived by the event management unit to the server, and the server receives the event identifier received from the viewer device. And further comprising viewer device information management means for managing each viewer device, wherein the action table configuration means of the server is configured for each viewer device based on the event identifier managed for each viewer device. The action table may be configured as follows. As a result, different action contents appropriate for each client are executed for the same event.

  In the above system, the action table managing means of the viewer apparatus can refer to the action table corresponding to the next effective period while the effective period of the currently referred action table ends. In addition, an action table for the previous valid period may be requested to the server in advance. Thereby, it becomes possible to request when an action table is required for the convenience of the viewer apparatus (client), and it is possible to prevent useless distribution of the action table.

  Further, in the above system, the action table providing means of the server actively distributes the new action table to the plurality of viewer devices as soon as the action table forming means forms a new action table. Also good. Thereby, the viewer apparatus does not need to request | require an action table, and can simplify the procedure.

  The present invention can also be configured as follows.

  The present invention relates to an event synchronized with broadcast content used in a system including a server that collects information about broadcast content transmitted from a broadcast station or a broadcast information storage server, and a viewer apparatus that communicates with the server via a network. For each valid period specified in synchronization with the broadcast time of the broadcast content, and an action indicating a process executed corresponding to the event identifier. A first stage constituting an action table for specifying content information; a second stage in which the server transmits the action table to the viewer apparatus; and the viewer apparatus determines an event identifier from the event that has occurred. A third stage of deriving and the action table received by the viewer device from the server And a fourth stage of deriving action content information corresponding to the event identifier, and a fifth stage in which the viewer device executes the action content information. The viewer device includes the server The action table received from is referred to only during its validity period.

  In the above method, in the third step, the event identifier derived by the viewer device is transmitted to the server, and the server manages the event identifier received from the viewer device for each viewer device. The method further comprises a sixth step, wherein the server configures the action table for each viewer device based on the event identifier managed for each viewer device. May be.

  Further, in the above method, the viewer apparatus previously refers to the previous valid period so that the valid period of the currently referred action table ends and the action table corresponding to the next valid period can be referred to. The method may further include a step of requesting the server for the action table.

  In the above method, the server may include a step of actively distributing the new action table to the plurality of viewer devices as soon as the server forms a new action table in the first step.

  Further, the present invention is a server that collects information related to broadcast content transmitted from a broadcast station or a broadcast information storage server and processes an event synchronized with the broadcast content, and is specified in synchronization with the broadcast time of the broadcast content. Action table configuring means for configuring an action table for designating an event identifier indicating a valid event and action content information indicating processing executed corresponding to the event identifier for each valid period, and the action table to the viewer device. And an action table providing means for transmitting.

  The server further includes viewer device information management means for managing the event identifier received from the viewer device for each viewer device, wherein the action table configuration means is managed for each viewer device. The action table may be configured for each viewer apparatus based on the event identifier.

  In the server, the action table providing unit may actively distribute the new action table to the plurality of viewer devices as soon as the action table configuring unit configures a new action table. Good.

  Further, the present invention is a viewer device in a system having a server that collects information about broadcast content transmitted from a broadcast station or a broadcast information storage server, and a viewer device that communicates with the server via a network, For each effective period specified in synchronization with the broadcast time of the broadcast content, an action table specifying an event identifier indicating a valid event and action content information indicating processing executed correspondingly is received from the server. Means for deriving an event identifier from an event that has occurred, action table management means for referring to the action table only during its validity period and deriving action content information corresponding to the event identifier using the table And an action for executing the action content information And line unit, the event identifier configured to have a means for transmitting the document transfer requests.

  In the viewer apparatus, the action table management means may be configured so that the valid period of the currently referred action table ends and the previous valid period can be referred to so that the action table corresponding to the next valid period can be referred to. You may make it have a means to request | require the action table of a period from the said server.

  In order to achieve the fourth and fifth objects of the present invention, the present invention can be configured as follows.

  The present invention provides a viewer device for acquiring the related information in a system in which a viewer device and a related information providing server that provides related information that is information related to broadcast information are connected via a network. The viewer device transmits predetermined information extracted from the broadcast information to a related information providing server, and the related information providing server uses the predetermined information to extract related information related to the broadcast information. Acquire and transmit to the viewer device.

  In the above method, the related information providing server further stores viewer information indicating characteristics of a viewer that can be a target for providing the related information, and viewer apparatus information indicating characteristics of a terminal that is a target for providing the related information, The viewer device transmits viewer information unique to the viewer device or viewer device information to the related information providing server in addition to the predetermined information, and the related information providing server acquires the related information, The related information may be selected based on the viewer information unique to the viewer device or the viewer device information, and transmitted to the viewer device.

  In particular, in order to achieve the fourth object of the present invention, the present invention can be configured as follows.

  The present invention is a method for a viewer apparatus to acquire the content information in a system in which the viewer apparatus and a content providing server that provides content information related to video or audio are connected via a network. The viewer apparatus obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and is transmitted from the content providing server. In the configuration for acquiring content information, the system includes a related information providing server, records the video and the related information in a database of the related information providing server, and is obtained by converting the video or the video by the viewer apparatus. Video that is sent to the related information providing server and received by the related information providing server. Searches the database by the partial video information, the results obtained related information transmitted to the viewer apparatus is configured such that the viewer apparatus obtains related information necessary for obtaining the content information.

  In the above method, further, viewer information indicating the characteristics of a viewer who can be a target for providing the related information and viewer apparatus information indicating the characteristics of a terminal for which the related information is provided are recorded in the database of the related information, The viewer device transmits viewer information specific to the viewer device or viewer device information to the related information providing server in addition to the partial video information, and the related information providing server acquires the related information, The related information may be selected based on the viewer information unique to the viewer device or the viewer device information, and transmitted to the viewer device.

  The present invention also relates to a related information providing method for acquiring related information, which is information related to broadcast information, and providing the information to a viewer, storing the broadcast information in a broadcast information database, Information is stored in a related information database, and broadcast information corresponding to partial broadcast information, which is feature information obtained by converting broadcast information being viewed or viewed by the viewer, is searched from the broadcast information database. Further, by searching the related information database with the broadcast information, the related information of the broadcast information can be acquired and provided to the viewer.

  Further, the present invention acquires related information, which is information related to accumulated broadcast information, and stores the broadcast information in a broadcast information database in a related information providing method provided to a viewer. The related information is stored in the related information database, and the broadcast information stored in the broadcast information storage device being reproduced and viewed by the viewer or the partial broadcast information that is the feature amount information obtained by converting the broadcast information is stored. The corresponding broadcast information can be searched from the broadcast information database, and the related information database can be searched using the broadcast information, whereby the related information of the broadcast information can be acquired and provided to the viewer.

  In the above method, the partial broadcast information may be broadcast information viewed for a certain period including a point in time when a related information acquisition instruction by a viewer is input, or feature amount information obtained by converting the broadcast information. Good.

  In the above method, the broadcast information database manages each piece of broadcast information with broadcast information identification information that is information for identifying the broadcast information, and the related information database includes the broadcast identification information and the broadcast information. Corresponding related information is managed in correspondence, the broadcast information identification information of the broadcast information corresponding to the partial broadcast information is specified by searching the broadcast information database, and the broadcast information identification information is referred to the related information database It is also possible to obtain related information corresponding to and provide it to the viewer.

  In the above method, the related information database includes viewer information indicating characteristics of a viewer who can be provided in addition to the related information, and viewer apparatus information indicating characteristics of a terminal as a target for providing related information. May be managed and the related information may be specified, and then the related information may be selected based on the viewer information unique to the viewer or the viewer device information and provided to the viewer.

  The present invention also provides means for receiving broadcast information including video and audio and providing it to the viewer, and broadcast information being viewed by the viewer at the time when the instruction is input by the viewer's related information acquisition instruction or One or more units having means for transmitting partial broadcast information, which is characteristic amount information obtained by converting the broadcast information, via a predetermined network and acquiring related information transmitted via the network A viewer apparatus, a broadcast information database that is connected to the network and manages each piece of broadcast information in association with broadcast information identification information that is information for identifying the broadcast information, and stored in the broadcast information database Corresponding to the broadcast information identification information, the related information database managing the related information corresponding to the broadcast information, and the partial broadcast information transmitted by the viewer device Means for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching for broadcast information in the broadcast information database, and by referring to the related information database, the identified broadcast information identification information Can be configured as a system having a related information providing server including means for acquiring related information corresponding to the above and transmitting the information to the viewer apparatus.

  In addition, the viewer apparatus of the present invention provides broadcast receiving means for receiving broadcast information, broadcast information demodulating / decoding means for demodulating and decoding broadcast information received by the broadcast receiving means, and various instructions including related information acquisition instructions. An input means for a viewer to input, a network communication means for communicating with a related information providing server that stores related information corresponding to each broadcast information via a predetermined network, and more related to the input means When an information acquisition instruction is input, the broadcast information output from the broadcast information demodulation / decoding means at the time when the instruction is input, or the partial broadcast information that is the feature amount information obtained by converting the broadcast information is Corresponding to the partial broadcast information transmitted to the network via the network communication means and then transmitted from the related information providing server via the network Related information acquisition means for receiving continuous information via the network communication means; and display reproduction means for displaying and reproducing the broadcast information output from the broadcast information demodulation and decoding means and the related information received by the related information acquisition means. It can be configured to have.

  The viewer apparatus further includes broadcast information storage means for storing the broadcast information output from the broadcast information demodulation / decoding means, and the related information acquisition means has the viewer stored in the broadcast information storage means. When a related information acquisition instruction is input from the input means during reproduction / viewing of broadcast information, broadcast information being reproduced / viewed at the time the instruction is input or feature amount information obtained by converting the broadcast information The partial broadcast information may be transmitted to the network via the network communication means.

  Further, the viewer device further includes a bookmark button, the partial broadcast information when the viewer operates the bookmark button and bookmarks is stored in a memory, and the related information acquisition means is When the related information acquisition instruction is input, the related information providing server may be accessed to notify the related information providing server of the partial broadcast information stored in the memory.

  The related information providing server of the present invention is connected to a predetermined network, and manages each broadcast information in association with broadcast information identification information that is information for identifying the broadcast information, Corresponding to the broadcast information identification information stored in the broadcast information database, the related information database for managing the related information corresponding to the broadcast information, and the partial broadcast information transmitted from the viewer apparatus via the network. Means for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching for broadcast information in the broadcast information database; and referring to the related information database; Means for obtaining corresponding related information and transmitting it to the viewer device, and the partial broadcast information is stored at any time by the viewer; May be configured such that broadcast information or playing view, the characteristic amount information obtained by converting the broadcast information, or their broadcast information stored in the broadcast information storing apparatus being viewed in.

  In order to achieve the fifth object of the present invention, the present invention can be configured as follows.

  The present invention is a method for a viewer apparatus to acquire the content information in a system in which the viewer apparatus and a content providing server that provides content information related to video or audio are connected via a network. The viewer apparatus obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and is transmitted from the content providing server. In a configuration for acquiring content information, a broadcast station or a broadcast information storage server transmits a predetermined data signal superimposed on audio, a broadcast receiving device outputs broadcast audio from a speaker, and a viewer device outputs the broadcast audio. Sound is collected by a microphone and converted into an electrical signal, and the data signal superimposed on the electrical signal is sequentially and continuously extracted. Te, so as to obtain related information by using the data signal.

  Further, in the above method, the system includes a related information providing server, the viewer apparatus transmits the data signal to the related information providing server, and acquires the related information using the data signal received by the related information providing server. Then, the related information may be transmitted to the viewer apparatus so that the viewer apparatus obtains the related information.

  Further, in the above method, the related information providing server further stores viewer information indicating characteristics of a viewer who can be provided with the related information, and viewer apparatus information indicating characteristics of a terminal as a target for providing the related information. Then, the viewer device transmits viewer information unique to the viewer device or viewer device information to the related information providing server in addition to the data signal, and the related information providing server specifies the related information, The related information may be selected based on the viewer information unique to the viewer device or the viewer device information, and transmitted to the viewer device.

  In the present invention, the broadcast station or the broadcast information storage server side that transmits audio or audio and video has a channel identifier uniquely assigned to the audio for each broadcast channel and an image frame in the video. A data signal including a uniquely assigned image frame identifier or a voice frame identifier uniquely assigned to each voice frame in the voice is superimposed and transmitted. On the receiving side, the viewer apparatus receives the broadcast. Broadcast audio output from a speaker of the apparatus is collected by a microphone and converted into an electrical signal, and the data signal superimposed on the electrical signal is sequentially and continuously extracted from the data signal, and a channel identifier and Extract image frame identifier or audio frame identifier and correspond to these channel identifier and image frame identifier or audio frame identifier That the related information can be configured as a broadcast synchronization type service providing method and obtaining through a network.

  In the above method, the broadcast station or the broadcast information storage server side transmits the image frame identifier or the audio frame identifier as a time-series consecutive number, and the viewer apparatus receives the person from the sound output from the speaker of the broadcast receiving apparatus. When the data signal superimposed on the voice is sequentially and continuously extracted, when the data signal is correctly extracted from the sound and the image frame identifier or the sound frame identifier is confirmed, the image frame identifier or When an audio frame identifier is used as an image frame identifier or an audio frame identifier of an image that is currently reproduced in the broadcast receiving apparatus, and the data signal is not correctly extracted from the audio, and the image frame identifier or the audio frame identifier is not confirmed. The most recently confirmed image frame identifier or audio frame identifier value and the latest Based on the difference between the confirmed image frame identifier or the voice frame identifier is confirmed the time and the current time in, may be used to generate an image frame identifier or the voice frame identifier.

  In the above method, the related information acquired from the network by the viewer apparatus is associated with the channel identifier and the image frame identifier or the audio frame identifier in the broadcast information database managed by the related information providing server connected to the network. The related information held in this way may be obtained via the related information providing server.

  In addition, the present invention provides a channel identifier uniquely assigned to each broadcast channel to the broadcast station or broadcast information storage server side that transmits audio or audio and video, and each image frame in the video. Means for superimposing and transmitting a data signal including an image frame identifier uniquely assigned to each voice frame or a voice frame identifier uniquely assigned to each voice frame in the voice; A microphone that collects broadcast sound output from a speaker of the broadcast receiving apparatus and converts it into an electrical signal; and the data signal superimposed on the electrical signal is sequentially and continuously extracted, and the data signal A data signal extracting means for extracting a channel identifier and an image frame identifier or an audio frame identifier from the channel identifier and an image frame It is possible to configure the related information corresponding to the identifier or the voice frame identifier as a broadcast synchronization type service providing system characterized in that a means to get through the network.

  The present invention is also a viewer device that receives audio transmitted from a broadcast station or a broadcast information storage server, or audio output from a broadcast receiving device that receives audio and video. A channel identifier uniquely assigned to a channel, an image frame identifier uniquely assigned to each image frame in the video, or an audio frame identifier uniquely assigned to each audio frame in audio The viewer device collects the broadcast sound output from the speaker of the broadcast receiving device and converts it into an electrical signal, and the data signal superimposed on the electrical signal. And a data signal for extracting a channel identifier and an image frame identifier or an audio frame identifier from the data signal, sequentially and continuously. Means out, extracted channel identifier and to the related information corresponding to the image frame identifier or the voice frame identifier may be constructed by providing a means to get through the network.

  In the viewer apparatus, the viewer apparatus transmits to the related information providing server connected to the network, viewer information or viewing unique to the viewer apparatus in addition to the channel identifier and the image frame identifier or the audio frame identifier. And the related information providing server selects the viewer information unique to the viewer device or the related information that matches the viewer device information, and the viewer device transmits the related information via the network. You may make it acquire.

  According to the present invention, a viewer of broadcast information or recorded information can easily acquire information or content related to the broadcast information or recorded information from a server or the like connected to the network.

  Hereinafter, first to fifth embodiments corresponding to the first to fifth objects will be described. In addition, according to each of the inventions according to the first to fifth embodiments, broadcast information or recorded information viewers can easily acquire information or contents related to the broadcast information or recorded information from a server or the like connected to the network. And the object of the present invention is achieved. Next, the outline of each embodiment will be described.

  In the first embodiment, a viewer device in which a broadcast receiving device for viewing a broadcast distributed from a broadcasting station and a device for obtaining related information related to the broadcast are integrated into the related information and the related information. Related information that provides corresponding content Requests a service from a content providing server to acquire related information. Also, the event information is acquired by the viewer device, and the viewer device requests a service based on the event information.

  In the second embodiment, broadcast information including information (URL or the like) corresponding to the related information provided by the related information content providing server is sent from the broadcast station to the viewer apparatus. The information is added for each frame on a subject basis, and related information is acquired by pointing a subject that the viewer is interested in. In addition, based on the viewer's pointing, interest information is acquired, and content that matches the viewer's interest is automatically acquired. As a result, as in the first embodiment, information related to broadcast information and the like can be easily acquired.

  Regarding the third to fifth embodiments, the basic configuration is the same as that of the first embodiment, and it is intended to make it easy to obtain information related to broadcast information and the like. There is a difference in the configuration for acquiring related information.

  That is, in the third embodiment, the related information providing server provides the viewer device with an action table related to the broadcast content, and the viewer viewing the broadcast generates an event shown in the action table. Thus, an action corresponding to the event is executed, and related information is acquired.

  In the fourth embodiment, the viewer device transmits partial broadcast information to the related information providing server, and the related information providing server transmits related information related to broadcasting to the viewer device based on the partial broadcast information.

  In the fifth embodiment, a frame ID or the like is superimposed on the audio in the broadcast, the viewer device extracts the frame ID or the like, and requests related information from the related information content providing server using the frame ID or the like. To do.

  In each of the above-described embodiments, the viewer apparatus can acquire related information related to viewer information such as a viewer profile and terminal information. Further, in each embodiment, not only the related information is acquired while receiving broadcast information from the broadcast station, but also, for example, as shown in FIG. While receiving broadcast information via a network, the viewer apparatus can acquire related information related to the broadcast information.

  Hereinafter, each embodiment will be described in detail.

[First Embodiment]
Hereinafter, the first embodiment corresponding to the first object will be described in detail.

  FIG. 1 is a diagram showing a basic configuration example of the first embodiment of the present invention. In the figure, reference numeral 1001 denotes a viewer apparatus for a viewer who views a broadcast, 1002 a provider-related information providing server for providing information related to the broadcast and contents corresponding to the information, and 1003 unilaterally from one direction. A broadcasting station 1004 that transmits broadcast contents represents an event information providing server that provides event information.

  When the viewer is watching a broadcast from the broadcasting station 1003, the available service request unit 1011 of the viewer device 1001 requests the related information content providing server 1002 to provide a service according to an instruction from the viewer. At this time, necessary viewer information, terminal information, or the ID of the viewer device 1001 is transmitted to request information on a service that can be provided related to the broadcast content.

  The available service selection unit 1021 of the related information content providing server 1002 selects a service that can be provided based on the information of the viewer apparatus 1001 in response to a request for information on the service that can be provided received from the viewer apparatus 1001. . Provideable service information transmission means 1022 transmits information on the selectable services that can be provided to the viewer apparatus 1001.

  The provideable service information visualization display unit 1012 of the viewer apparatus 1001 displays the information of the available service received from the related information content providing server 1002 as an icon, and the service selection / request unit 1013 has one of the icons pointing. When selected by the device, the related information content providing server 1002 is requested for the service indicated by the icon.

  When the service request receiving unit 1023 of the related information content providing server 1002 receives the service request, the service request receiving unit 1023 activates the access system state detecting unit 1024. The access system state detection unit 1024 sends a predetermined amount of information packets from the related information content providing server 1002 to the viewer apparatus 1001 and measures the time taken to return from the viewer apparatus 1001 to thereby determine the related information content. The state of the access system between the providing server 1002 and the viewer apparatus 1001 is estimated.

  The service content optimization unit 1025 converts and optimizes the screen size, resolution, etc. of the content related to the service to be transmitted to the viewer apparatus 1001 based on the information of the viewer apparatus 1001 and the state of the access system. The service providing unit 1026 sends the optimized content to the viewer apparatus 1001 and provides the requested service.

  The service using unit 1014 of the viewer apparatus 1001 receives the content of the service provided by the related information content providing server 1002 and accumulates, displays, and outputs the content, thereby using the requested service.

FIG. 2 is a block diagram of a system for realizing the functions of the present invention shown in FIG.
The viewer apparatus 1001 and the related information content providing server 1002 are connected via a network 1005. The viewer apparatus 1001 includes an input unit 1110, a display unit 1120, a control unit 1130, a processing unit 1140, a sensor unit 1150, an accumulation / management unit 1160, and a communication unit 1170. The related information content providing server 1002 includes an input unit 1210, a display unit 1220, a control unit 1230, a processing unit 1240, a storage / management unit 1250, and a communication unit 1260.

  FIG. 3 is a diagram illustrating a configuration example of the viewer apparatus 1001. The input unit 1110 of the viewer apparatus 1001 includes operation input means 1111, audio input means 1112, image / video input means 1113, icon operation input means 1114, setting operation input means 1115, and content operation means 1116. The display unit 1120 includes reception information visualization means 1121, service information display means 1122, event information display means 1123, setting screen display means 1124, and content display means 1125.

  The processing unit 1140 includes an audio information recognition unit 1141, an image / video recognition unit 1142, a distribution event information condition match determination unit 1143, and an icon operation unit 1144. The storage / management unit 1160 includes viewer information storage / management means 1161 and terminal information storage / management means 1162. The sensor unit 1150 includes user environment sensing means 1151. The communication unit 1170 includes an information transmission unit 1171, an information reception unit 1172, and an event information reception unit 1173. The viewer apparatus 1001 has a memory unit 1180, and the memory unit 1180 is provided with information temporary storage means 1181.

  FIG. 4 shows a configuration example of the related information content providing server 1002. The input unit 1210 of the related information content providing server 1002 includes an information input unit 1211, and the display unit 1220 includes an information display unit 1221. The processing unit 1240 includes an available service selection unit 1241, an inter-content link unit 1242, a content conversion unit 1243, and an access system state detection unit 1244. The storage / management unit 1250 includes viewer information storage / management means 1251, terminal information storage / management means 1252, viewer environment information storage / management means 1253, content event information storage / management means 1254, broadcast information storage / management means 1255. , Content storage / management means 1256. The communication unit 1260 includes an information receiving unit 1261, a broadcast information receiving unit 1262, and an information transmitting unit 1263. The related information content providing server 1002 has a memory unit 1270, and the memory unit 1270 is provided with information temporary storage means 1271.

FIG. 5 shows a flow of information between the viewer apparatus 1001 and the related information content providing server 1002. Hereinafter, the operation of the apparatus shown in FIGS. 2 to 4 will be described in detail with reference to FIG. Broadcast information such as program information is sent from the broadcaster to the related information content providing server 1002 in advance, and event information is sent from the event information provider to the viewer apparatus 1001 in advance or during broadcasting.
(1) Service provision request input First, in the viewer apparatus 1001, the viewer is watching broadcast content distributed in one direction and wants to receive a service related to related content related to the content being broadcast. At that time, the request is input through the input unit 1110. As means for inputting the viewer's request, there are operation input means 1111 using buttons, voice input means 1112 using a microphone, etc., and image / video input means 1113 such as a gesture photographed by a camera or the like.

Information (on / off information) input by the operation input unit 1111 is stored in the memory unit 1180 via the control unit 1130. The audio information input by the audio input unit 1112 and the image / video information input by the image / video input unit 1113 are transmitted to the audio information recognition unit 1141 of the processing unit 1140 via the control unit 1130, respectively. It is sent to the recognition means 1142. Thus, it is recognized that the viewer has input the request, and the result (on / off information) is stored in the memory unit 1180 via the control unit 1130.
(2) Service provision request information In the control unit 1130, when request input information is stored in the memory unit 1180, the viewer information stored and managed by the viewer information storage / management unit 1161 of the storage / management unit 1160 ( (Viewer profile) is requested to the storage / management unit 1160, and the acquired viewer information is stored in the memory unit 1180. Similarly, terminal information (manufacturer name, model number, specification, etc.) stored and managed by the terminal information storage / management unit 1162 of the storage / management unit 1160 is requested to the storage / management unit 1160, and the acquired terminal information is stored in the memory. Stored in the unit 1180.

  The control unit 1130 requests the viewer unit 1150 for the viewer environment information sensed by the user environment sensing unit 1151 of the sensor unit 1150, and stores the acquired viewer environment information in the memory unit 1180.

  The above viewer information is information about the viewer, for example, name, gender, age, occupation, address, zip code, family structure, housing information (apartment, detached house, etc.), hobby, and information of interest. Genre (politics, economy, news, computer, books, sports, travel, etc.), annual income, information on whether or not you are a member of various services, membership number or credit card ID, possession of various qualifications (driving license, etc.) Information on presence / absence, body shape (weight, height, clothing size, etc.), information on ability (sight, hearing, etc.), etc. are included.

  The terminal information is the resolution of the display device of the viewer device, the number of displayable colors, the performance of the WWW information browsing means (whether the Java function can be used, the presence / absence of a video / audio content playback function, encoded format information that can be played back by video / audio content, Etc.).

  The viewer environment information is information representing the environmental state and the viewer state when the viewer is viewing the broadcast content distributed in one direction. What is the environmental state information when viewing the viewer environment information? , Where you are viewing (location information obtained by GPS [Global Positioning System], etc.), when you are viewing (time information obtained by in-device timer, GPS, etc.), what you are viewing (TV operation remote control Information on broadcast channels and programs obtained by monitoring infrared communication such as

  Information indicating the viewer state is information on the viewer's viewing posture (sitting or standing, etc.) and mental state at the time of viewing (whether it is throbbing, calm, fun, sad, etc.) is there. The viewing posture can be determined from the height information from the floor of the terminal. The mental state can be determined from the heart rate, the state of sweating, and the movement information. Height information, heart rate, state of sweating, movement information, and the like are information that can be sensed by a sensor. It is assumed that not all information regarding the viewer information, the terminal information, and the viewer environment information need be collected.

  Regarding viewer information, when the information has already been sent to the related information content providing server 1002 and stored and managed by the viewer information storage / management means 1251 of the storage / management unit 1250 of the related information content providing server 1002 The related information content providing server 1002 may be information that can specify viewer information. This information is an ID (identifier) or the like that is registered in advance in the related information content providing server 1002 and paid out from the related information content providing server 1002.

  That is, the viewer device information when the viewer device requests a service that can be provided may be registered in the related information content providing server 1002 in advance, and only the viewer device ID may be sent. The information may be sent every time it is requested.

Viewer information, terminal information, and viewer environment information stored in the memory unit 1180 via the control unit 1130 are transmitted to the related information content providing server 1002 by the information transmitting unit 1171 of the communication unit 1170 as service provision request information. . The control unit 1130 sends information that is transmitted simultaneously with the transmission to the display unit 1120 and displays the information by means of visualizing the information, thereby indicating a reaction to the input operation (action) of the viewer.
(3) Selection of Available Service The related information content providing server 1002 receives the viewer information, terminal information, and viewer environment information transmitted from the viewer device 1001 by the information receiving unit 1261 of the communication unit 1260, and the control unit It is stored in the memory unit 1270 via 1230, and at the same time, viewer information is stored and managed by the viewer information storage / management means 1251 of the storage / management unit 1250. Similarly, terminal information is stored and managed by the terminal information storage / management unit 1252 and viewer environment information is stored and managed by the viewer environment information storage / management unit 1253, respectively.

  The control unit 1230 issues a request to the accumulation / management unit 1250 and stores the event information managed by the content event information accumulation / management unit 1254 in the memory unit 1270. Similarly, the broadcast information managed by the broadcast information accumulation / management means 1255 is stored in the memory unit 1270. The related content of the broadcast content (at least one of video, audio, and data) distributed in one direction is stored and managed by the content storage / management means 1256.

  The event information includes information for identifying individual related content (content ID and the like), service type information related to the related content, link information with broadcast content, content security information, and the like. Broadcast information is content broadcast schedule information and event information related to broadcast content. As a method of acquiring this information, there are a method of directly receiving information provided by a broadcaster and a method of extracting from broadcast content when it is embedded in the broadcast content.

  When broadcast information is embedded in broadcast content (at least one of video, audio, and data), the broadcast information is received by the broadcast information receiving means 1262 and sent to the storage / management unit 1250 via the control unit 1230 to store the broadcast information. It is managed live by the management means 1255. When broadcast information is not embedded in broadcast content (at least one of video, audio, and data), the contents of the broadcast are linked to related content stored and managed by the storage / management unit 1250. Therefore, broadcast content (at least one of video, audio, and data) itself is received by the broadcast information receiving unit 1262 and sent to the processing unit 1240 via the control unit 1230.

  The processing unit 1240 links the broadcast content and related content automatically or semi-automatically by the inter-content link unit 1242, calculates information corresponding to the broadcast information, and sends it to the storage / management unit 1250 via the control unit 1230. send. Thus, the broadcast information is stored and managed by the management unit 1255.

  The inter-content link means 1242 uses a method of performing stepwise from a link using a physical quantity distance to a link using a semantic quantity distance using an image / video recognition technique and a voice recognition technique. The viewer information, terminal information, viewer environment information, content event information, and broadcast information stored in the memory unit 1270 are transferred to the processing unit 1240. Based on the transferred information, the available service selection unit 1241 of the processing unit 1240 selects an available service adapted to the viewer.

  FIG. 6 is a conceptual diagram showing the relationship between event information, broadcast information, and services. For example, content A is selected from services A, D, F, and I according to viewer information, terminal information, and viewer environment information. , C, and F are selected. Services that can be provided may differ depending on the broadcast time even for the same content.

  How the service and the related content are selected according to the received viewer information, terminal information, and viewer environment information will be described in accordance with the procedure. FIG. 7 shows the procedure. When viewer information, terminal information, and viewer environment information are input, first, in step S1, the broadcast content (at least one of video, audio, and data) is transmitted using the broadcast time and broadcast station information included in the viewer environment information. The related content that is related is searched based on the broadcast information. When the related content is not searched, information indicating that there is no related content or service that can be provided is returned, and the selection process ends.

  When the related content is searched, the process proceeds to step S2 to determine whether the content can be provided to the viewer based on the viewer information and the viewer environment information. In this determination, for example, when the viewer is a minor or is limited to a region, it is determined whether or not the retrieved related content can be provided by checking whether there is an age limitation rule. Further, when the viewer is in a place such as a kitchen and desires to provide related content, it is determined whether the searched related content has restrictions or recommendations according to the location of the viewer. When it is determined that there is no content that can be provided, information indicating that there is no related content or service that can be provided is returned, and the selection process ends.

  If there is related content determined to be content that can be provided, the process proceeds to step S3, and a service linked to the related content is searched based on the content event information. If the service is not searched, information indicating that there is no related content or service that can be provided is returned, and the selection process ends.

When the service is searched, the process proceeds to step S4, and it is determined whether the service can be provided based on the terminal information. This is because some services cannot be received depending on the specifications of the terminal. If it is determined that the service can be provided, the related content and information about the service are returned, and the selection process ends.
(4) Provideable Service Information Information related to the selected related content and service is stored in the memory unit 1270 via the control unit 1230. The information related to the related content and service is information such as the related content, the name of the service, the location where the related content exists, the location where the tool necessary for the service exists, the expiration date, and an icon representing the related content and the service. The information stored in the memory unit 1270 is transmitted to the viewer apparatus 1001 by the information transmission unit 1263 of the communication unit 1260 as service information that can be provided.
(5) Display of Available Service In the viewer apparatus 1001, the information transmitted from the related information content providing server 1002 is stored in the memory unit 1180 via the control unit 1130 and sent to the display unit 1120. The sent information is visualized by the service information display means 1122. An example of this display is shown in FIG. In FIG. 8, 1050 is a program object, 1051 is a program icon image, 1052 is a service icon image, 1053 is a service object, 1054 is an application icon, 1055 is a condition setting screen for notification settings, etc. 1056 is a trash can icon. The application icon 1054 and the condition setting screen 1055 will be described later.

  The sent icon information includes information related to broadcast contents such as the program object 1050 and information related to services such as the service object 1053. These are respectively displayed as image icons of a predetermined size (program icon image 1051 and service icon image 1052). The program icon has a structure in which a child has a service icon, and the service icon has a function of starting a service tool based on information other than icon information. Services include, for example, content purchase, content viewing, content processing, and the like, and the service tool is an application program that executes these.

  The service tool is activated by selecting the service icon, and the viewer is provided with a desired service. What is represented as an image on the service icon is the content of the service together with the contents of the related content. It is expressed so that the viewer can understand what kind of content can be received by what service at a glance. Further, since the icon is managed by the memory unit 1180 as an object of one unit, the information input by the icon operation input unit 1114 of the input unit 1110 is sent to the control unit 1130 and the icon operation of the processing unit 1140 is performed. By means 1144, it is possible to move on the screen of the display to a position desired by the viewer, and to delete it (moving to the trash can 1056).

  Changing the icon position is changing an icon display position parameter sent to the display unit 1120, and deleting the icon is deleting target object data in the memory unit 1180. It is also possible to hide the service icon as required by the viewer. Naturally, it is also possible to search for an icon by giving a key using information held by the icon object as an index. For example, it is possible to search by program name or by service name.

  In the above explanation, when a viewer is watching broadcast content distributed in one direction and wants to receive a service related to related content related to the broadcast content, the viewer makes positive the request. The example in the case of inputting to the apparatus has been described.

  Even if the viewer does not positively input the request to the apparatus, the request can be automatically issued by the application at a timing preset by the viewer. Next, an example will be described. That is, when viewing broadcast content distributed in one direction, a service related to related content related to the content being broadcast is set in the device in advance, and it is time to reserve the service or receive the service. The procedure for realizing the notification function will be described.

  First, in the viewer apparatus 1001, an application having a function for displaying event information of broadcast content, a service reservation, and a function for notifying the viewer when it is time to receive the service is operated. This application may be activated when the viewer wants to make a reservation or the like in advance, or the viewer apparatus 1001 may be automatically activated in accordance with a broadcast channel. This application is transmitted from the related information content providing server 1002 to the viewer apparatus 1001, and the viewer apparatus 1001 receives and starts it.

  When this application operates in the viewer apparatus 1001, the application icon 1054 shown in FIG. 8 is displayed on the screen to notify the viewer that the application is operating. The application icon 1054 has a function for visualizing event information of the received broadcast content and displaying it in the icon, and a function for calling a condition setting screen 1055 such as a reservation screen or a notification setting screen.

  FIG. 9 shows an example of a notification setting screen that is one of the condition setting screens 1055. By clicking the “notification setting” button in the application icon 1054, the condition setting screen 1055 of FIG. 9 can be displayed. This screen is a screen for setting notification to the viewer when the event information matches the set condition during broadcast viewing.

  As a notification method to the viewer when the notification timing comes, it is possible to select blinking or sound of the display screen. It is also possible to set the activation so that the video is automatically displayed. The example in FIG. 9 is a screen for setting notification regarding the baseball broadcast. For example, this screen is used to notify the viewer when a score is entered, when the score is three times, or when the batter has a batting order, etc. Can be set in advance.

  In the reservation setting screen, as with the notification setting screen, the timing for issuing a request is set, such as when a certain reserved time is reached, or when a specific talent appears on the screen, and the set timing The service provision request can be automatically issued.

  The application displays the event information of the broadcast content distributed from the event information provider on the application icon 1054 on the display unit 1120, and is automatically viewed at the timing set on the condition setting screen such as the reservation setting screen or the notification setting screen. The user's request to the device. In the case of a reservation, when the set timing is reached, a service provision request is issued without confirming to the viewer. In the case of notification setting, the viewer sets the timing set by flashing icons or sounds. Inform the viewer according to the prior designation and issue a service provision request.

  Next, a series of procedures such as reservation and notification setting will be described in detail. Assume that event information of broadcast content is distributed from an event information provider. The event information is received by the event information receiving unit 1173 of the communication unit 1170 and is sequentially stored in the memory unit 1180 in the order of being sent via the control unit 1130. At the same time, the information is sent to the processing unit 1140 and the display unit 1120, and the event information display means 1123 displays the event information of the broadcast content as an icon (application icon 1054). As a function of this icon, there is a function that can set a service condition desired by the viewer as described above.

  Display of the setting screen is performed by the setting screen display unit 1124 of the display unit 1120 based on the input request sent to the control unit 1130 by inputting a display request using the setting operation input unit 1115 of the input unit 1110. In the condition setting input, setting information is input by the setting operation input unit 1115 of the input unit 1110 and stored in the memory unit 1180 via the control unit 1130.

  Thereafter, the condition stored in the memory unit 1180 is sent to the processing unit 1140, and the distribution event information condition match determination unit 1143 matches the condition with the distributed event information. The distribution event information condition match determination unit 1143 calculates a semantic distance between the condition and the event information, sets the similarity as a similarity, and determines that the condition matches a value closer than a predetermined threshold value. If it is determined that the conditions match, the control unit 1130 is notified of the matching. The coincidence information is stored in the memory unit 1180 via the control unit 1130, and the flow thereafter is viewing the broadcast content distributed in one direction and receiving a service related to the related content related to the broadcasted content. When a request is made, the request is input positively, and when the request input information is stored in the memory unit 1180, the flow is the same as the subsequent flow.

  Here, transition of information displayed on the display unit 1120 regarding channeling when receiving the broadcast content of the viewer and each operation when issuing a service request will be described.

When viewing a certain broadcast content and issuing a service request, the icon shown in FIG. 8 is displayed. When a service request is issued while changing the channel and viewing different broadcast content, the service icon related to the previous broadcast content is not displayed, and only the program icon is displayed. Subsequently, information newly transmitted from the related information content providing server 1002 is received, and a new program icon and service icon are displayed. Subsequently, when the channel is changed to the broadcast content that was previously viewed and a service request is issued, the service icon that has been hidden is displayed, and the newly requested service icon is additionally displayed.
(6) Service Selection, (7) Service Request Next, a procedure for selecting a service icon displayed on the display unit 1120 and receiving service provision will be described. The service icon selection input is performed by the icon operation input unit 1114 of the input unit 1110 of the viewer apparatus 1001. Based on this selection input information, the service information that can be provided corresponding to the selected icon stored in the memory unit 1180 via the control unit 1130 (the location of the related content, the location of the tool required for the service, the expiration date) And the like are transmitted to the related information content providing server 1002 by the information transmitting unit 1171 of the communication unit 1170.
(8) Optimization of service content The related information content providing server 1002 receives information on the service and content sent from the viewer apparatus 1001 by the information receiving unit 1261 of the communication unit 1260, and stores it in the memory via the control unit 1230. Stored in the unit 1270. The information receiving unit 1261 determines which viewer device 1001 has received the transmission information, and sends the determined viewer device information together with the previous information to the control unit 1230.

  When the information regarding the service and the content and the viewer apparatus information are stored in the memory unit 1270 via the control unit 1230, the control unit 1230 detects the access system state by the access system state detection unit 1244 in the processing unit 1240. The access system state detected here is a network state, for example, a communication speed. The communication speed changes dynamically according to the degree of network congestion (the amount of data flowing). The access system state detection unit 1244 sends a predetermined amount of information packets to the viewer apparatus 1001 based on the viewer apparatus information, and estimates the state of the access system based on the time it takes to return from the viewer apparatus 1001. When receiving this information packet, the communication unit 1170 of the viewer apparatus 1001 directly transfers the information packet from the information receiving unit 1172 to the information transmitting unit 1171 and sends it back to the related information content providing server 1002 that transmitted the information packet. I do. The estimated access state information is stored in the memory unit 1270 via the control unit 1230.

  Based on the information related to the service and content stored in the memory unit 1270 via the control unit 1230, the related content and service tools stored and managed by the content storage / management unit 1256 of the storage / management unit 1250 are searched, Related content and service tools are stored in the memory unit 1270. At the same time, the terminal information managed by the storage / management unit 1250 is also retrieved based on the viewer device information and stored in the memory unit 1270 via the control unit 1230. The related content, access status information, and terminal information stored in the memory unit 1270 are transferred to the processing unit 1240.

  The content conversion means 1243 converts the related content into the optimum content based on the access status information and terminal information (terminal specifications). This conversion is performed in the following cases.

  1) When the related content is created for a high-spec terminal and a high-rich access state, when the terminal spec and the access state do not match, the content is converted to the optimum content.

  2) Also, even when one content is used for a plurality of services, it is converted to the optimum content according to the service.

  The content conversion means 1243 in the case of 1) reduces the amount of data. We perform everything from reducing the amount of physical data using data compression technology to reducing the amount of data considering the meaning of summaries. Text information is summarized by semantic level using morphological analysis, dictionary, and corpus. The compression rate of images and videos such as MPEG1 and MPEG2 is changed, and video that is object-encoded with MPEG4 is selectively encoded on an object basis. The video described in MPEG7 summarizes the semantic level by processing the text description. For content with hyperlinks, etc., a weight based on the viewer profile is given to the information hanging on the link, and the link information is selectively reduced according to the weight.

In the case of the above 2), the content conversion means 1243 performs translation into a language desired by the viewer. Conversion processing between expression media such as conversion from image to text, conversion from video to image, conversion from audio to text, conversion from image to audio, conversion from video to audio, etc. is also performed.
(9) Service Provision The content optimally converted by the content conversion unit 1243 is stored in the memory unit 1270, and is transmitted to the viewer apparatus 1001 by the information transmission unit 1263 of the communication unit 1260 together with the already stored service tool. The In the viewer apparatus 1001, the service tool and the related content transmitted from the related information content providing server 1002 are stored in the memory unit 1180. The service tool uses the content operation input unit 1116 of the input unit 1110 and the content display unit 1125 of the display unit 1120 to provide a service related to related content on the viewer apparatus 1001. The related content purchase service or the like is performed by transmitting the viewer's transaction related to purchase to the transaction processing center (not shown) by the information transmission unit 1171 of the communication unit 1170.
(effect)
As described above, according to the present embodiment, on the premise of various communication access systems and terminals, individual viewers can interact with and cooperate with broadcast content distributed in one direction from their respective preferences. It will be possible to respond to a wide variety of services that provide the desired related content, and to provide the services fairly. In addition, it is possible to provide an environment in which a viewer can receive a desired service without catching it, and an environment that solves a problem related to annoyance when receiving a service for obtaining related content during viewing after viewing. .

  For this reason, viewers can receive and receive a wide variety of services with the most suitable content for their own terminals, linked to and linked to broadcast content distributed in one direction, and without being caught. There is a merit that there is no trouble when receiving a service for obtaining related contents. For content providers, there is a merit that individual viewers can respond to a wide variety of services that provide related content that each viewer desires according to their preferences, linked and linked to broadcast content distributed in one direction. .

[Second Embodiment]
Next, a second embodiment will be described using Example 2-1 to Example 2-4. In the second embodiment, when a pointing operation is performed on a subject in which the viewer is interested in the video information, the pointing operation is performed based on information added in relation to the subject. It is possible for viewers to obtain related information related to the subject that has been dismissed, and to accumulate information on the subject that the viewer is interested in, and to receive broadcasts based on this accumulated information. Select information and store selected broadcast information.

[Example 2-1]
FIG. 10 is a system configuration diagram showing Example 2-1 of the viewer apparatus according to the second embodiment of the present invention. In FIG. 10, 2010 is broadcast information including video information 2011 and related information 2012 added thereto. The video information 2011 includes at least a video and corresponds to a video program in a normal meaning including audio in addition to the video.

  In digital broadcasting, additional information related to video can be broadcast as program arrangement information in a video broadcasting channel. Alternatively, in a data channel that broadcasts only data such as text and still images, it is possible to broadcast related information of video broadcast on other broadcast channels. As additional information, for example, the title and genre of the program in the video, the broadcast date and time, and the like are considered.

  In the present invention, the additional information includes at least information on the subject as a display unit appearing in the video information 2011, and the additional information on the subject (hereinafter referred to as related information) describes at least the subject. It includes subject attribute information, subject coordinate values, and URI (Uniform Resource Identifier) information defined by at least one RFC 2396 as address identification information of related information corresponding to the subject. In this case, the URI includes the IP address and URL of the information providing apparatus connected to the communication network 2003.

  The subject coordinate value is a coordinate value that represents a region where the subject exists on the display screen. The subject appears or leaves with the time, and moves within the screen while it appears. For this reason, the subject coordinate values must be defined for each frame of the video information 2011 or in units of time.

  The related information 2012 is defined for each of one or more subjects. FIG. 11 shows an example of related information in the present invention. The related information 2012 includes a frame number 2121, subject coordinate values 2122, subject attribute information 2123, and URI information 2124. In the related information 2012 shown in FIG. 11, when the frame number 2121 is N, subjects whose subject attribute information 2123 is OB-A, OB-B, etc. have subject coordinate values 2122 (XA, YA), ( XB, YB) and the like, and URI information 2124 such as URI-A and URI-B is defined correspondingly. Such information is also added to frames with frame numbers other than N, and the subject defined by the frame is different, and different URIs can be defined even for the same subject. A plurality of URIs may be defined for one subject.

  The configuration of broadcast information including the related information and video information described above will be described below.

  As a first configuration method, there is a case where related information as shown in FIG. 11 is inserted as header information at the head of each video frame information in the video information. For example, in the case of an MPEG2 video stream, it is conceivable to insert related information into the header of the picture hierarchy, that is, the user data area of the picture header.

  Further, as a second configuration method, there is a case where video information and related information are configured separately, and the related information includes a frame number for identifying a corresponding video frame as shown in FIG. is there.

  In the case of the second configuration method, the video information can be transmitted on the video broadcast channel, and the related information can be transmitted on the data channel. Alternatively, in systems such as BS digital broadcasting and CS digital broadcasting, MPEG2 System (ITU-T H.222.) Is used as a part of program arrangement information defined by ARIB STD-B10 “program arrangement information used for digital broadcasting”. 0, ISO / IEC 13818-1) may be used to transmit related information using a data structure in a section format defined by ISO / IEC 13818-1.

  In the case of the second configuration method, the broadcast information is configured so that the related information is input to the viewer apparatus at the same time as or before the corresponding video frame.

  In FIG. 10, 2002 is a viewer apparatus according to the present embodiment, and is composed of the elements described below.

  The broadcast receiving unit 2201 receives the broadcast information 2010 including the video information 2011 and the related information 2012 described above, and transmits the broadcast information 2010 to the video display control unit 2202.

  The video display control unit 2202 transmits a display control signal for displaying the video information 2011 received from the broadcast receiving unit 2201 to the video display unit 2203. The video display control unit 2202 receives the coordinate value in the screen on which the viewer has pointed in the video display unit 2203, collates it with the subject coordinate value 2122 in the related information 2012, and performs pointing. The URI information 2124 and the subject attribute information 2123 corresponding to the subject having the subject coordinate value 2122 that matches the in-screen coordinate value are transmitted to the related information display control unit 2205.

  The video display unit 2203 displays video on the display screen based on the display control signal received from the video display control unit 2202. In the case shown in FIG. 10, a car appears as a subject. Further, the coordinate value pointed by the first pointing device 2204 is detected, and the value is transmitted to the video display control unit 2202.

  The first pointing device 2204 is connected to, for example, the video display control unit 2202 and is used to move a cursor displayed on the screen of the video display unit 2203 and perform a pointing operation at a desired cursor position. A general-purpose device such as a mouse can be used.

  The related information display control unit 2205 is a subject related information display unit which will be described later with characters, symbols, graphics, etc. (hereinafter referred to as subject representative graphics etc.) representing the subject attribute information 2123 received from the video display control unit 2202. A control signal for display on 2206 is transmitted to the subject related information display unit 2206, and subject attribute information 2123 is transmitted to the subject attribute information storage unit 2209. The related information display control unit 2205 also receives the subject representative graphic pointed by the second pointing device 2207 in the subject related information display unit 2206, and URI information 2124 corresponding to the subject represented thereby will be described later. Based on this, the related information access unit 2210 accesses a related information storage unit 2211 or a communication network 2003 described later, and displays the acquired related information on the subject related information display unit 2206.

  The related information access unit 2210 accesses the related information storage unit 2211 if the URI information 2124 received from the related information display control unit 2205 corresponds to the later-described related information storage unit 2211, and a communication network 2003 such as the Internet. If the information source corresponds to the information source connected to, the information source is accessed via the communication network 2003, and related information is obtained and returned to the related information display control unit 2205.

  The subject related information display unit 2206 receives the control signal for displaying the subject representative figure or the like or the related information of the subject from the related information display control unit 2205 and displays them. The subject-related information display unit 2206 includes the second pointing device 2207 as described above, and its operation is connected to the related information display control unit 2205, for example, in the same manner as the first pointing device 2204. In order to move a cursor displayed on the screen of the video display unit 2203 and perform a pointing operation at a desired cursor position, a general-purpose device such as a so-called touch panel or mouse can be used.

  An input device 2208 is a keyboard or other input device for operating the system. The subject attribute information accumulation unit 2209 receives and accumulates the subject attribute information 2123 transmitted from the related information display control unit 2205.

  The related information storage unit 2211 stores information related to the subject, and this information can be obtained by accessing the related information access unit 2210. Further, the stored information can be added, updated, or deleted as necessary using a device (not shown).

  The operation of the system according to Example 2-1 having the above configuration will be described below. Broadcast information 2010 including the video information 2011 and the related information 2012 shown in FIG. 11 is broadcast from the broadcast station, received by the broadcast receiving unit 2201, demodulated, and sent to the video display control unit 2202. The video display control unit 2202 generates a control signal for displaying the video information 2011 out of the video information 2011 and the related information 2012 received from the broadcast receiving unit 2201, and sends this to the video display unit 2203. The related information 2012 is temporarily stored in the video display control unit 2202.

  When the subject is pointed on the video display unit 2203, the video display control unit 2202 receives the coordinate value of the pointing from the video display unit 2203, and collates the received coordinate value with the subject coordinate value 2122 shown in FIG. And a subject having a subject coordinate value 2122 that matches the pointing coordinate value is found. Then, the subject attribute information 2123 and the URI information 2124 corresponding to the subject found in this way are sent to the related information display control unit 2205.

  The related information display control unit 2205 performs processing based on the subject attribute information 2123 and the URI information 2124 received from the video display control unit 2202. First, the subject attribute information 2123 is transmitted to the subject attribute information storage unit 2209 and stored. Further, the related information display control unit 2205 generates a control signal for displaying a subject representative graphic representing the received subject attribute information 2123 and sends it to the subject related information display unit 2206.

  FIG. 12 illustrates an example in which the subject representative graphic 2042 of the subject 2041 is displayed on the subject related information display unit 2206 corresponding to the subject 2041 pointed by the first pointing device 2204 in the video display unit 2203. Yes.

  Note that it is preferable to use different display devices for the video display unit 2203 and the subject-related information display unit 2206. For example, the video display unit 2203 may be configured using a CRT display device, and the subject-related information display unit 2206 may be configured using a liquid crystal display device. In this case, use of a mouse as the first pointing device 2204 and a touch panel as the second pointing device 2207 is also conceivable. However, the video display unit 2203 and the subject-related information display unit 2206 can be configured using a single display device. When a single display device is shared, different windows or screens are divided. A video display unit 2203 and a subject-related information display unit 2206 are provided in each display area. In this case, the first pointing device 2204 and the second pointing device 2207 can also be realized by the same hardware, and one mouse or the like can be shared.

  FIG. 13 shows a more detailed example related to the subject related information display unit 2206. In this example, the subject related information display unit 2206 includes a subject display area 2261 for displaying the subject representative graphic 2042 and the subject related information. A related information display area 2262 for displaying information and an operation panel unit 2263 are provided. The operation panel unit 2263 can be used instead of the input device 2208 when, for example, a touch panel is used.

  In the subject display area 2261, a plurality of subject representative figures 2042 are displayed. In this example, characters such as OB-A, OB-B, OB-C, and OB-D are the respective subject representative figures 2042. These show the result that the subject attribute information 2123 and the URI information 2124 corresponding to the subject 2041 are sequentially sent to the related information display control unit 2205 when the subject 2041 is pointed one after another as the video progresses. Yes.

  Next, when the viewer points the subject representative graphic etc. 2042 displayed on the subject related information display unit 2206 with the second pointing device 2207, information for identifying the pointed subject representative graphic etc. 2042 is displayed on the subject related information display unit. In response to this, the related information display control unit 2205 extracts URI information 2124 corresponding to the subject 2041 indicated by the information for identifying the subject representative graphic 2042. The extracted URI information 2124 is transmitted to the related information access unit 2210. The related information access unit 2210 accesses the related information storage unit 2211 if the transmitted URI information 2124 corresponds to the related information storage unit 2211. The related information is obtained and returned to the related information display control unit 2205.

  If the transmitted URI information 2124 is for an information source connected to the communication network 2003, the related information access unit 2210 obtains the related information from the information source through the communication network 2003, and displays the related information. It returns to the control unit 2205.

  The related information display control unit 2205 displays the returned information in the related information display area 2262 of the subject related information display unit 2206 after receiving the returned information.

  In the above operation, the timing at which the viewer points to the subject representative graphic 2042 is arbitrary during the broadcast reception or after the broadcast reception. Therefore, when there is a lot of information to be referred to, it is possible to refer to the related information sequentially at a convenient time after receiving the broadcast.

[Example 2-2]
Next, a viewer apparatus having a video filtering accumulation function will be described as Example 2-2. FIG. 14 is a system configuration diagram illustrating Example 2-2. The system configuration according to the embodiment 2-2 adds an interest information extraction unit 2212 to the system configuration of the embodiment 2-1 shown in FIG. 10, and automatically selects the broadcast information 2010 using the function. Will be described in detail below.

  In FIG. 14, in addition to the functions described in the embodiment 2-1, the related information display control unit 2205 includes at least the subject for which the viewer points the subject representative graphic 2042 in the subject related information display unit 2206. Any one of the URI information 2124, the subject attribute information 2123, the related information obtained from the information source, and the display time information about the time when the related information is displayed on the subject related information display unit 2206. It has a function of transmitting to the extraction unit 2212.

  Further, the interest information extraction unit 2212 refers to any or all of the URI information 2124, the subject attribute information 2123, the related information, and the display time information, and serves as information indicating the viewer's interest in the related information. Interest information is extracted and stored. Further, the interest information extraction unit 2212 receives the broadcast information 2010 including the video information 2011 and the related information 2012 from the broadcast receiving unit 2201, and at least the subject attribute information 2123 or the URI information 2124 in the related information 2012 is obtained. The broadcast information 2010 determined to be suitable for the viewer's interest information is preferentially selected in light of the accumulated interest information. The selected broadcast information 2010 can be stored in the broadcast information storage unit 2213 as necessary.

  Note that the present invention includes a function that can move or delete the subject representative graphic or the like 2042 displayed by the viewer in the subject related information display unit 2206, and the interest information extraction unit 2212 when these operations are performed. It is possible to reduce the interest information accumulated in. As a result, for example, the fact that the viewer's interest in the subject attribute information 2123 represented by the deleted subject representative graphic 2042 or the URI information 2124 corresponding to the subject attribute information 2123 has decreased is reflected in the extraction of interest information.

  Next, the operation of this system in Example 2-2 will be described. Broadcast information 2010 including video information 2011 and related information 2012 broadcast from the broadcast station is received by the broadcast receiving unit 2201, demodulated, and then sent to the video display control unit 2202. The related information 2012 is configured as shown in FIG. 11, for example, in the same manner as in Example 2-1. Since Example 2-1 has been described with reference to FIG. 11, description thereof is omitted here.

  The video display control unit 2202 generates a control signal for displaying the video information 2011 out of the video information 2011 and the related information 2012 received from the broadcast receiving unit 2201, and sends this to the video display unit 2203. The related information 2012 is temporarily stored in the video display control unit 2202.

  When the subject 2041 is pointed at the video display unit 2203, the video display control unit 2202 receives the coordinate value of the pointing from the video display unit 2203, and collates the received coordinate value with the subject coordinate value 2122 shown in FIG. And a subject in which a subject coordinate value 2122 that matches the pointing coordinate value is defined is found. Then, the subject attribute information 2123 and the URI information 2124 of the subject 2041 found in this way are sent to the related information display control unit 2205.

  The related information display control unit 2205 performs processing based on the subject attribute information 2123 and the URI information 2124 received from the video display control unit 2202. First, subject attribute information 2123 is sent to the subject attribute information storage unit 2209 and stored therein. For the received subject attribute information 2123, a control signal for displaying a subject representative graphic 2042 representing the generated subject attribute information 2123 is generated and sent to the subject related information display unit 2206. The display of the subject related information display unit 2206 in this case is as described with reference to FIG. 12 or FIG.

  When the viewer points the subject representative graphic etc. 2042 displayed on the subject related information display unit 2206 with the second pointing device 2207, the relevant information corresponding to the subject attribute information 2123 represented by the pointed subject representative graphic etc. 2042 is displayed. Is acquired, and the acquired related information is displayed in the related information display area 2262 of the subject related information display unit 2206. Since this point is the same as in Example 2-1, further description is omitted.

  Below, it demonstrates centering on the point from which the operation | movement of this system in Example 2-2 differs from that of Example 2-1.

  In Example 2-2, in addition to the functions described in Example 2-1, the related information display control unit 2205 displays the subject on which the subject representative graphic 2042 is pointed in the subject related information display unit 2206. Any of the URI information 2124 related to the subject 2041, the subject attribute information 2123, the related information obtained from the information source, and the display time information related to the time when the related information is displayed on the subject related information display unit 2206. Or a plurality of them are transmitted to the interest information extraction unit 2212.

  The displayed time is based on the display start time and end time when the related information is displayed on the subject related information display unit 2206, and these are the second times by the viewer who refers to the subject related information display unit 2206. It is also related to the operation time information of the pointing device 2207, and as the start time, the time when the subject representative figure 2042 is pointed and the related information obtained thereafter displayed on the subject related information display unit 2206 is displayed. The end time may be a time when an operation for ending the display is performed by the viewer, or a time when the next subject representative figure 2042 is pointed.

  The interest information extraction unit 2212 refers to any or all of the URI information 2124, the subject attribute information 2123, the related information, and the display time information received from the related information display control unit 2205, extracts the interest information, accumulate. The interest information is information indicating what kind of information the viewer is interested in. Generally, the interest information can be generated by statistically processing the display time information and the number of times of pointing. For example, it is the number of times of pointing by subject attribute information or URI information, or the display time by subject attribute information, by URI information, or by related information, or an integrated value thereof. Further, the number of times of pointing, the display time, or an integrated value thereof can be set for each combination of at least two of the subject attribute information 2123, the URI information 2124, and the related information.

  Furthermore, the text included in the subject attribute information 2123 and the related information is decomposed into keywords, and the subject attribute information 2123 including the keyword for each keyword, the keyword is displayed when the related information is viewed many times or the display time is long. It is also possible to extract a group of keywords indicating interest and use it as interest information.

  Further, even when the viewer moves or deletes the subject representative graphic or the like 2042 displayed on the subject related information display unit 2206, the information is sent from the related information display control unit 2205 to the interest information extraction unit 2212. In this way, it can be reflected in the interest information extraction process. For example, when the viewer deletes the subject representative graphic etc. 2042, the viewer's interest in the subject attribute information 2123 represented by the deleted subject representative graphic etc. 2042 or the URI information 2124 corresponding thereto is reduced. As a result, processing such as subtraction from the interest information is performed and reflected in the interest information extraction processing.

  Further, the interest information extraction unit 2212 receives the broadcast information 2010 including the related information 2012 from the broadcast receiving unit 2201, matches the URI information 2124 in the related information 2012 with the above interest information, and matches the interest of the viewer. Filtering processing for selecting the broadcast information 2010 being performed is performed. The broadcast information 2010 filtered in this way is stored in the broadcast information storage unit 2213 as necessary. In this case, the related information includes the subject attribute information 2123, the URI information 2124, or related information, or a combination thereof, which indicates the value of the number of times of pointing, or the display time or the integrated value thereof. It is decided by whether or not. Instead of using the subject attribute information 2123 or the URI information 2124 itself, the information converted into the number of times or the reference time for each genre by classifying them in advance may be used.

  Next, a specific example of the interest information extraction unit will be described.

  In the following description, it is assumed that the related information in this embodiment includes a URI and a keyword group indicating the content content of the URI. For example, related information related to a car appearing in a video as a subject is given the appearance position in the video of the car, the URL address of the specification information homepage of the car, and {car} as keywords. Yes. A specific description example of such related information is shown below.

<Frame no = "N">
<Object>
<Location> (XA, YA)-(XB, YB) <// location>
<Uri> url: www.automobile.com/car_A/spec.html <uri>
<Keyword> car </ keyword>
</ Object>
</ Frame>
The above example corresponds to the case where only the automobile is present as the subject in the video frame with the frame number “N”. Information related to the video frame with frame number “N” is described between <frame no = “N”>. Information related to one subject is described between <object> ... </ object>. In this case, {automobile} is described as the appearance position in the video of the automobile, the URL address of the specification information homepage of the automobile, and the keyword. If there are a plurality of subjects, there are a plurality of <object> ... </ object> between <frame no = "N"> ... </ frame>. The related information need not be in the XML format as described above, and may have a table type configuration as shown in FIG.

  The interest information extraction unit in this example holds a user profile including a keyword group and the weight of each keyword as viewer interest information. An example of a user profile is shown below.

{Automobile: 1, Panda: 2, Steco: 1, Namako: 1}
In the above example, the user profile is described as a set having a plurality of combinations of “keyword: weight of the keyword”.

  Here, when the viewer points to a car that has appeared as a subject of the video being viewed, the interest information extraction unit increments the weight of the keyword “car” by one. If the keyword “car” does not exist in the user profile when the car is pointed, the keyword “car” is added to the user profile and the weight is set to 1.

Therefore, when a car appears 10 times as the subject of the video being viewed, and the viewer points to all the automated persons, the user profile is
{Automobile: 11, Panda: 2, Steteco: 1, Namako: 1}
become.

When the viewer deletes the subject representative graphic 2042 displayed on the subject related information display unit 2206, the weight of the keyword included in the related information corresponding to the subject is reduced by 1, and the user profile is changed. Update. For example, if the user profile is
{Automobile: 11, Panda: 2, Steteco: 1, Namako: 1}
When the viewer deletes from the subject related information display unit 2206 one of the subject representative figures 2042 of the subject associated with the related information including the keyword {automatic person}, the user profile is
{Automobile: 10, Panda: 2, Steteco: 1, Namako: 1}
Updated to

When the viewer points to the subject representative graphic 2042 displayed on the subject related information display unit 2206 and refers to the related information, the subject representative graphic 2042 is determined according to the reference time of the related information. The weight of the keyword included in the related information corresponding to is increased, and the user profile is updated. For example, each time the related information is referred to for 1 minute, the weight of the keyword included in the related information of the corresponding subject is increased by 1. User profile is
{Automobile: 10, Panda: 2, Steteco: 1, Namako: 1}
When the viewer points to the subject representative figure 2042 of the subject associated with the related information including the keyword {car} and refers to the related information for 10 minutes, the user profile is
{Automobile: 20, Panda: 2, Steteco: 1, Namako: 1}
Updated to

  Furthermore, the interest information extraction unit performs processing according to the following rules when filtering broadcast information.

When a keyword included in related information associated with a subject in the received video is included in the user profile, the weight of the keyword is set as the degree of interest in the subject. When there are a plurality of keywords included in the user profile, the sum of the weights of the keywords is set as the degree of interest in the subject. If the degree of interest is greater than or equal to a certain value K, it is assumed that the viewer is interested in the subject, and processing equivalent to that for automatically pointing the subject is performed. For example, K = 10 and the user profile is {Automobile: 20, Panda: 2, Steteco: 1, Namako: 1}
If the related information including the keyword {car} is received, the degree of interest in the corresponding subject is 20 and satisfies K = 10 or more, so that the viewer automatically selects the corresponding subject. Executes the same processing as pointing. That is, processing such as displaying a subject representative figure corresponding to the subject on the subject related information display unit is performed.

  Note that what has been described above is an example of processing of the interest information extraction unit, and in addition to the above, rules such as weighting of various keywords, rules for using keywords, and the like can be used.

[Example 2-3]
Next, Example 2-3 will be described.

  FIG. 15 is a system configuration diagram showing Embodiment 2-3 of the present invention. The embodiment 2-3 is a broadcast information transmission / reception system in which a broadcast station 2004 is added to the viewer apparatus 2002 described above. The broadcast station 2004 includes a broadcast including the related information 2012 as shown in FIG. It has a function to broadcast information 2010.

  The broadcast station is a broadcast station connected to a satellite broadcast system or a terrestrial broadcast system such as BS digital broadcast, CS digital broadcast, terrestrial digital broadcast, and the like, and performing broadcast via the broadcast infrastructure. As shown in FIG. 16, this is a broadcasting station that uses a server connected to a predetermined network such as the Internet or a broadcasting cable, and performs network broadcasting such as so-called Internet broadcasting or cable television broadcasting via the predetermined network. There is a case.

[Example 2-4]
Next, Example 2-4 will be described.

  FIG. 17 is a system configuration diagram showing Embodiment 2-4 of the present invention. Example 2-4 is a broadcast information transmission / reception system in which a video storage medium playback device 2006 is added to the viewer device described above. The video storage medium is a DVD, D-VHS video tape, or the like, on which broadcast information 2010 including the related information shown in FIG. 11 is recorded. The video storage medium playback device 2006 is a DVD player, a VCR, or the like, and generally has a function of recording and storing broadcast information mainly including video received by broadcasting in the video storage medium. Furthermore, it has a function of reproducing the recorded broadcast information. The video storage medium to be used is the one in which broadcast information acquired from the broadcast infrastructure is recorded in advance, or the broadcast information including video information such as movies and dramas is recorded in advance. In some cases, the user obtains the information from a retail store or a rental shop of the medium.

  In Example 2-4, broadcast information 2010 including the related information shown in FIG. 11 is input to the viewer apparatus 2002 from the video storage medium playback apparatus 2006 that plays back a predetermined video storage medium.

  Also in the second embodiment, it is possible to acquire related information related to the viewer information and the terminal information. For example, together with video information, a plurality of URIs corresponding to viewer information and terminal information are transmitted as related information to the viewer apparatus, and the viewer apparatus receives the viewer information or the like previously input to the viewer apparatus. A URI that matches the terminal information is selected. As the related information to be added, for example, formats such as related information examples 1 to 5 in the fourth embodiment described later can be used.

(effect)
In the viewer apparatus and the broadcast information transmission / reception system according to the present embodiment, for each subject as a display unit appearing in the video, broadcast information to which related information in which URI information indicating the location of the related information is defined is added is received. Then, when the viewer points to the subject displayed on the video display screen, characters, figures, etc. representing the subject are displayed on the screen, and then corresponding to the pointing operation on these characters, figures, etc. The related information is read from the corresponding URI information and displayed on the screen. Thereby, the viewer can obtain and refer to information related to the subject that is interested while viewing the video information from an information source other than the broadcast information.

  In addition, when the viewer points to a plurality of subjects one after another, characters, figures, etc. representing each of them are sequentially added and displayed on the screen. As a result, even when there is a lot of related information that the viewer wants to refer to, it can be referred to without being restricted by time after viewing the broadcast information.

  In addition, interest information that takes into account the number of times the subject is pointed to by the viewer and the display time information of related information referenced in relation to the number of points of interest is extracted and retained, and broadcasted during times when the user is not viewing Broadcast information that matches interest information can be automatically selected from the information and stored. As a result, the viewer can obtain broadcast information suitable for the genre of related information that he / she referred to in the past without time restrictions.

  In particular, in the present invention, when the viewer deletes the displayed subject representative figure or the like, it is assumed that the interest in the URI information has been lost, and the interest information that has been accumulated is reduced so that the interest information is extracted. Since it is reflected, after the viewer sufficiently refers to the related information, the acquisition of the information of the genre can be stopped according to the dynamic change of the viewer's interest.

  In addition, since related information can be obtained in units of subjects, it is possible to define related information for subjects appearing in various scenes, and as a result, it is more detailed than in units of conventional video programs. It is possible to refer to related information. For example, even if it is the same subject, its meaning will generally change depending on the scene in which it appears, but by defining related information for each frame, it is possible to refer to diverse and accurate related information. In addition, more detailed video information can be automatically selected.

  For example, even if it is the same subject, its meaning will generally change depending on the scene in which it appears, but by defining related information for each frame, it is possible to refer to diverse and accurate related information. In addition, more detailed video information can be automatically selected. In addition, since characters / graphics with respect to the pointed subject are additionally displayed on the screen, the viewer can refer to related information without being restricted by time.

  In addition, since the viewer can point to the subject of interest, only relevant information of interest can be viewed accurately, so that the viewer is interested in what information the user is pointing to. It is possible to obtain information that suggests whether or not there is.

[Third Embodiment]
Next, a third embodiment of the present invention will be described. In the present embodiment, related information is acquired by processing an event from a terminal such as a personal computer in synchronization with broadcast content such as television and radio. Here, the event processing synchronized with the broadcast content means that when an event such as a button pressing operation occurs in the viewer device, the content of the action executed in response to the event corresponds to the broadcast content as needed. It is a process to change. As a specific example, when CM1, CM2, and CM3 are continuously broadcast on a predetermined TV broadcast channel, when the user presses the button on the viewer device when CM1 is broadcast, There is a process in which a link to information on CM1 is presented on a display device connected to the viewer device. Similarly, when the user presses the button on the viewer device when CM2 is broadcast, a link to information on CM2 is presented, and when the CM3 is broadcast, the button on the viewer device is used. When the user presses, a link to information on CM3 is presented.

  FIG. 18 is a configuration diagram of a system according to the third embodiment of the present invention. 18 includes a related information providing server 3001 (hereinafter referred to as “server 3001”), a viewer apparatus 3002 (client) that communicates with the server 3001 via a network 3006, and a broadcasting station 3003 that broadcasts broadcast content. And an input / output device 3004 connected to the viewer device 3002. Broadcast content broadcast from the broadcast station 3003 can be received by the broadcast receiving device 3005. Various actions are executed in the viewer apparatus 3002 in synchronization with the broadcast content. Further, the content of the action executed in response to the event that occurs in the viewer apparatus 3002 changes in synchronization with the broadcast content.

  In addition, the broadcast receiving device 3005 receives broadcast content from the broadcast station 3003, and even when the broadcast receiving device 3005 receives broadcast content from a broadcast information storage server 3003 ′ connected to a network such as the Internet. It is possible to realize the synchronization processing in the form.

  Here, the events that occur in the viewer device 3002 are various user operations on the input / output device 4. For example, when the viewer apparatus 3002 has a keyboard, it is a signal that a predetermined button on the keyboard has been pressed. Further, when the viewer apparatus 3002 has a pointing device such as a mouse, it is a signal that a predetermined position on the screen displayed on the display device connected to the viewer apparatus 3002 has been clicked by the pointing device. Furthermore, an event is a time-out event that a predetermined time has passed since a certain action occurred or that the time has reached a predetermined time.

  What operation or occurrence of an event is an event depends on what application is realized using the system of the present invention. For example, when a viewer is interested in a subject or BGM in a drama video while watching a drama video on a television, when the user presses a so-called bookmark button on the viewer device 3002, the related information is accessed. In an application in which an icon is added to the screen on the display device, the event is that the viewer (user) presses the bookmark button, and when the bookmark button is pressed, The action of adding an icon is executed. For example, in an application in which an information page related to the content of the educational program is displayed on the display device screen of the viewer device 3002 as the program progresses while the educational program is being viewed on a television, Corresponds to the fact that it is a predetermined time, that is, the time when the program content is switched, and when the event occurs, an action of updating to a new information page is executed.

  The actions executed by the viewer device 3002 are various processes by application programs that can be executed by the viewer device 3002, and vary depending on the service application realized using the system of the present invention. In the above-described example, processing such as “add an icon for accessing related information” or “update to a new information page” corresponds to this.

  Further, when the viewer apparatus 3002 of the system of the present invention is mounted on a personal computer equipped with an MS-Windows OS, the action is processing by a software program that can be executed on Windows.

  Further, the server 3001 acquires action table resource data, which is information to be referred to when configuring an action table, from an organization that manages broadcast content, for example, a broadcast station.

  FIG. 19 is a configuration diagram of the server 3001 and the viewer apparatus 3002 according to the present invention.

  The server 3001 has already occurred for each viewer device 3002, a communication unit 3013 for communicating with a plurality of viewer devices 3002 via the network 3006, a client identifying unit 3014 for identifying the viewer device 3002 accessing the server 3001, and the viewer device 3002. The client information management means 3015 that holds a client occurrence event list that is a list of event identifiers of events, action table resource data 3012 that is referred to when configuring the action table, and the action table are synchronized with the event to be synchronized. In addition to updating the configuration sequentially, the action table configuration means 3011 for determining the validity period of each action table to be configured and assigning it to the action table, and the action table via the network 3006 are provided. And a action table providing means 3010 for.

  The viewer device 3002 communicates with the server 3001, acquires an action table from the server 3001, and holds an action table management unit 3022, monitors the occurrence of an event, and sets the event identifier of the generated event as an action Event management means 3021 for notifying the table management means 3022, action execution means 3023 for immediately executing the action described in the action content information notified from the action table management means 3022, an input interface 3026, and an output interface 3025 And have.

  FIG. 20 is a sequence diagram of the method according to the present embodiment. The server action table resource data 3012 collects broadcast information broadcast by the broadcast station 3003. First, for each valid period XX to XX designated in synchronization with the broadcast time of the broadcast content, the server 3001 includes an event identifier indicating a valid event, and action content information indicating a process executed corresponding to the event identifier. Is configured (step S1). Next, the server 3001 transmits the action table to the viewer apparatus 3002 (step S2). Next, the viewer apparatus 3002 holds the received action table, and derives an event that has occurred, for example, an event identifier YY that the user has pressed the push button (step S3). Next, the viewer apparatus 3002 derives the action content information ZZ corresponding to the event identifier YY using the action table received from the server 3001 (step S4). Finally, the viewer apparatus 3002 executes the action content information ZZ (step S5). At this time, the viewer apparatus 3002 may transmit the event identifier YY to the server 3001 (step S6). As a result, the server 3001 can generate an occurrence event list in the client information management unit 3015 and configure an action table suitable for the viewer apparatus 3002.

  FIG. 21 shows an example of an action table according to the present invention, and FIG. 22 shows an example of a client occurrence event list according to the present invention.

  The specific operation according to the present embodiment will be described below.

  When the viewer apparatus 3002 is activated, the action table management unit 3022 acquires an action table from the server 3001. The action table management unit 3022 confirms the effective period described in the acquired action table, and refers to the acquired action table as a reference target while the effective period is within the effective period.

  The action table management unit 3022 acquires a new action table from the server 3001 before the valid period of the action table currently being referenced ends. Simultaneously with the expiration of the valid period of the action table being referenced, the new action table is targeted for reference.

  Thereafter, the action table management unit 3022 repeats the above-described operation while checking the validity period of the action table currently being referred to, and sequentially updates the action table.

  Further, when an event occurs in response to a client operation or action execution, the event management unit 3021 transmits an event identifier of the generated event to the action table management unit 3022. The action table management unit 3022 refers to the action table currently being referenced, and transmits action content information corresponding to the event identifier to the action execution unit 3023. Furthermore, the action execution unit 3023 executes the action according to the action content information.

  Further, the action table management unit 3022 of the viewer apparatus 3002 transmits the event identifier received from the event management unit 3021 to the server 3001. When the server 3001 receives an event identifier from the viewer device 3002, first, the client identification unit 3014 identifies the viewer device 3002, and then the client information management unit 3015 corresponds to the client (viewer device). The event identifier is added to the client occurrence event list.

  Further, in the server 3001, when an action table is requested from the viewer device 3002, the client identifying unit 3014 identifies the viewer device 3002, and the action table configuring unit 3011 corresponds to the identified viewer device 3002. The action table is configured with reference to the client occurrence event list, and the action table providing unit 3010 transmits the action table to the viewer apparatus 3002.

  Further, the server 3001 actively distributes the new action table to the viewer apparatus 3002 by the action table providing unit 3010 when the action table configuring unit 3011 configures a new action table.

  The viewer apparatus 3002 retains the new action table received by the action table management unit 3022, and when the valid period of the currently referenced action table ends, the currently referenced action table becomes the new action table. Change.

(Example 3-1)
Next, a specific example in which the system according to the present invention is applied to television broadcasting will be described as Example 3-1.

  In Example 3-1, when a viewer is interested in a subject, background, BGM or the like in a drama video sound while watching a drama video on a television, a button for a so-called bookmark of the viewer device 3002 is provided. When pressed, an application (or URL or the like) for accessing the related information is added to the screen on the display device. It is assumed that the viewer apparatus 3002 has three bookmark buttons as input devices. Assume that the identifiers of each button in the system are (0, 0), (1, 0), and (2, 0). These three bookmark buttons, for example, indicate that the first button was interested in the subject, the second button was interested in the background, and the third button was interested in BGM. It is conceivable to have a function sharing such as indicating the above. Further, depending on the case, what each bookmark button indicates that the user is interested in may be dynamically changed. That is, at some point, button (1, 0) indicates that it is interested in the subject, button (2, 0) indicates that it is interested in the background, and button (3, 0) further indicates BGM. At another point in time, there are two subjects (eg, talents), etc., so the button (1, 0) was interested in the first subject. The button (2, 0) indicates that it is interested in the second subject, and further indicates that the button (3, 0) is interested in BGM. Moreover, in each viewer apparatus 3002, the meaning of button operation may differ, ie, the action which generate | occur | produces according to button operation may differ.

  FIG. 23 is an example of an action table according to the present invention. This action table has a valid period from time 0 to time 999. The input device is composed of three buttons, and identifiers of each button in the system are (0, 0), (1, 0), and (2, 0). The event identifier is composed of time information and a button identifier. The event identifier [(0, 499), (0, 0)] means an event that the button with the identifier (0, 0) is pressed between time 0 and time 499. Corresponding to the event identifier, an action “add icon_A” for additionally displaying the icon A on the screen is described.

  According to the action table of FIG. 23, if the button of the identifier (0, 0) is pressed between time 0 and time 499, “add icon_A” is executed. Similarly, if the button of the identifier (1, 0) is pressed between time 0 and time 499, “add icon_B” is executed, and the button of identifier (2, 0) between time 0 and time 499 is executed. Is pressed, “add icon_C” is executed. If the button of the identifier (0, 0) is pressed between time 500 and time 999, “add icon_D” is executed, and between time 500 and time 999 is executed. If the identifier (1, 0) button is pressed, “add icon-E” is executed. If the identifier (2, 0) button is pressed between time 500 and time 999, “add icon_F” is executed. To do.

  The viewer apparatus 3002 refers to the action table in FIG. 23 from time 0 to time 999. Then, when an event occurs when any button of the viewer device 3002 is pressed between time 0 and time 999, an action determined based on the action table is immediately executed.

  FIG. 24 is an example of the action table acquired next. In order to acquire the action table for the next valid period, the viewer apparatus 3002 accesses the server 3001 between time 0 and time 999. In the effective period 1000 to 1999, processing is performed with reference to the action table of FIG. The action table acquired from the server 3001 next is the same in all the viewer apparatuses 3002 regardless of which event occurs during the validity period 0 to 999.

  Each client (viewer device) is also characterized in that the content of the action table for the valid period 1000 to 1999 acquired differs depending on the type of event that occurred in the valid period 0 to 999 and whether or not an event has occurred.

  25 and 26 are examples of action tables having different contents. When there are a plurality of viewer devices 3002 in the system according to the present invention, no event occurs at time 0 to 999 in the first viewer device, and at time 0 in the viewer device B. Suppose that the button with the identifier (0, 0) is pressed between “-499” and “add icon_A” is executed. In this case, the first viewer apparatus acquires the table of FIG. 25 from the server 3001 as a new action table. On the other hand, when the button with the identifier (0, 0) is not pressed between time 0 and 499, the first viewer apparatus acquires the table in FIG. 26 from the server 3001 as a new action table.

  As described above, the content of the action table to be acquired differs depending on whether or not an event has occurred in each viewer device 3002 or the type of event that has occurred. As a result, the action executed in accordance with the button operation can be changed in each viewer device depending on the button operation performed previously.

(Example 3-2)
Next, Example 3-2 in which the system according to the present invention is applied to television broadcasting will be described.

  In Example 3-2, while viewing an educational program or the like on a television, a predetermined information page related to the contents of the program, that is, the Internet, is displayed on the screen of the display device 3004 of the viewer device 3002 as the program progresses. This is an application that displays the predetermined homepage above. In this application, an event corresponds to a predetermined time, that is, a time when the program content is switched, and an action of updating to a new information page is executed when the event occurs.

  FIG. 27 is an example of an action table in Example 3-2. According to FIG. 27, the action of additionally displaying a homepage whose URL is http: // page1 on the screen is described as “open http: // page1”. When the viewer apparatus is mounted on a personal computer on which an OS of MS-Windows is installed, the execution of the action “open http: // page1” is executed on the Internet browser program “iexplore.exe” on MS-Windows. The homepage specified by the URL is opened using a function such as.

  In this operation, first, the viewer apparatus 3002 is activated prior to the broadcast of the program to be synchronized, and acquires the action table shown in FIG. Next, in the viewer apparatus 3002, when the time reaches 00/09/04/19: 00: 00: 00, an event with the event identifier [00/09/04/19: 00: 00: 00] occurs. As a result, the corresponding action “open http: // page1” is executed, and the homepage indicated by http: // page1 is displayed. Next, when the time reaches 00/09/04/19: 04: 00, it is considered that an event with the event identifier [00/09/04/19: 04: 00] has occurred, and the corresponding action “open http: // page2” is executed. Next, when the time reaches 00/09/04/19: 09: 15, it is considered that an event with the event identifier [00/09/04/19: 09: 15] has occurred, and the corresponding action “Open http: // page3” is executed. Similarly, when the time specified by the event identifier is reached, it is considered that the event has occurred, and the corresponding action is executed.

  Furthermore, since the expiration date of the action table shown in FIG. 27 is 00/09/04/19: 15: 00, when it becomes 00/09/04/19: 15: 00, FIG. The action table is updated to the newly acquired action table, and thereafter, the action is executed every time specified by the event identifier of the updated action table.

(Example 3-3)
Next, Example 3-3 in which the system according to the present invention is applied to television video broadcasting will be described.

  In Example 3-3, as shown in FIG. 28, the output device 3006 of the viewer device 3002 is integrated with a broadcast receiving device that receives broadcast video. Or both are connected. The viewer apparatus 3002 includes a pointing device such as a mouse as an input device. A touch panel display may be used as the pointing device. In this case, it is possible to point the subject in each video frame of the broadcast video displayed on the broadcast receiving apparatus which is an output device, using the pointing device.

  When the broadcast receiving apparatus that receives the broadcast video and the output device of the viewer apparatus are integrated, the information display area (display screen) of the broadcast receiving apparatus and the output device integrated apparatus is as shown in FIG. Configuration can be taken.

  In the present embodiment, in the above-described environment, when a viewer points to a subject in each video frame of a broadcast video with a pointing device connected to the viewer device, an action corresponding to the pointed subject is executed. To do. As the action to be executed, various processes such as presenting a homepage related to the pointed subject and adding a homepage related to the pointed subject to the bookmark can be considered. In the present embodiment, a case will be described in which an action of additionally displaying an icon image corresponding to the pointed subject on the screen is executed.

  In this case, an example of the action table provided from the related information providing server 3001 is shown in FIG. The action table shown in FIG. 30 has an effective time from time 0 to time 999. The event identifier includes time information (t1, t2), coordinates (xa, ya) of the upper left corner of the rectangular area corresponding to the subject existing area in the broadcast video display area, and coordinates (xb, yb) of the upper right corner. ) And is described as [(t1, t2), (xa, ya)-(xb, yb)]. As shown in FIG. 31, when the broadcast video display area has a resolution of 640 × 480 (VGA), the event identifier [(0, 299), (100, 100)-(200, 200)] is from time 0. It means an event that during the time 299, the rectangular region having the coordinates (100, 100) and (200, 200) as diagonal lines is pointed with the upper left corner coordinate being (0, 0). Here, normally, a subject A to be pointed exists from time 0 to time 299 in the rectangular area. In the action table shown in FIG. 30, the action “add icon_A” for additionally displaying the icon A on the screen in correspondence with the event identifier [(0, 299), (100, 100) − (200, 200)]. Is described.

  According to the action table of FIG. 30, when the inside of a rectangular area having coordinates (100, 100) and (200, 200) as a diagonal line is pointed between time 0 and time 299, “add icon_A” is executed. The Similarly, the action “add” is performed to additionally display the icon B on the screen when the rectangular area having the coordinates (300, 300) and (400, 400) as a diagonal line is pointed between time 0 and time 299. icon_B "is executed. If the inside of the rectangular area having the coordinates (200, 100) and (300, 200) as a diagonal line is pointed between the time 300 and the time 599, “add icon_A” is executed. If the inside of the rectangular region having the coordinates (200, 300) and (300, 400) as a diagonal line is pointed between the time 300 and the time 599, “add icon_B” is executed. If a rectangular area having diagonal lines with coordinates (300, 100) and (400, 200) is pointed between time 600 and time 999, “add icon_A” is executed. If a rectangular area having diagonal lines with coordinates (100, 300) and (200, 400) is pointed between time 600 and time 999, “add icon_B” is executed.

  Usually, a subject to be pointed exists in a rectangular area to be a pointing target in the broadcast video display area. For example, from time 0 to time 299, subject A and subject B exist in the broadcast video area as shown in FIG. Therefore, in the above-described example, when the viewer is pointing to the subject A between time 0 and time 299 while the viewer is watching the broadcast video, the icon A corresponding to the subject A is displayed in the viewer apparatus output information display as shown in FIG. Appears in the area.

  In the description of each embodiment, the action described by “add icon_X” can be further expanded and described as “add icon_X URL”. Specifically, the description is “add icon_A www.ntt.co.jp”. In this example, the action additionally displays the icon A, and when the icon A is selected by the viewer at an arbitrary time, information on the URL address “www.ntt.co.jp” is displayed. It corresponds to the process of presenting.

  As described above, according to the present embodiment, it is possible to define events in the viewer apparatus in various forms. For example, when various button operations occur, when an operation with a pointing device such as a mouse occurs, or when voice is input from a microphone connected to the viewer apparatus. When the viewer apparatus has a system for speech recognition, a predetermined word may be input from the microphone. Furthermore, when the absolute time reaches a predetermined time, when a predetermined time elapses after an arbitrary event occurs, or when a plurality of these events occur simultaneously.

  Further, according to the present embodiment, the event identifier for identifying the event as described above is defined in advance. The event identifier may have a different definition for each service to be applied. Accordingly, as described above as a specific embodiment, an information providing service linked to television broadcasting can be provided in various forms.

  Also in the present embodiment, it is possible to acquire related information related to viewer information and terminal information. For example, when viewer information and terminal information are transmitted in advance from the viewer device to the related information providing server, and the related information providing server creates an action table for each viewer device, the viewer information and terminal information To take into account.

(effect)
As described above, according to the recording medium in which the system, method, and control program according to the present embodiment are recorded, the viewer apparatus can synchronize with the broadcast content of the predetermined channel to be broadcast without acquiring the data signal multiplexed in the broadcast. It is possible to quickly execute the processing for the event. Therefore, it is not necessary for the viewer apparatus to have a function of acquiring the data signal multiplexed in the broadcast from the broadcast receiving apparatus. In addition, when the viewer device performs a button operation or the like, the action table corresponding to the event that has occurred immediately is executed with reference to the action table already held in the action table management unit 30. Is extremely short, and it is possible to prevent a decrease in operability due to a slow response to client operations. Furthermore, in the present invention, since the validity period is specified for each table describing the correspondence between event identifiers and actions, it is possible to cope with dynamic changes in the broadcast time and program structure of the broadcast content to be synchronized. For example, the present invention can be applied to a live program whose program structure is constantly changing. The effective period of the action table can be set according to the intention of the provider of the broadcast content to be synchronized. By using the effective period effectively, event processing synchronized with a live broadcast program or the like can be realized to some extent.

  In addition, according to the present embodiment, since the event identifier for each viewer device is managed in the server, appropriate different action contents are executed for each viewer device for the same event.

[Fourth Embodiment]
Next, the 4th Embodiment of this invention is described using Example 4-1 and Example 4-2. In the present embodiment, the partial broadcast information is transmitted from the viewer device to the related information providing server, and the related information providing server searches for the related information based on the partial broadcast information and transmits it to the viewer device.

(Example 4-1)
Referring to FIG. 33, the broadcast receiving system with a related information providing function in the fourth embodiment of the present invention receives broadcast information including video and audio from the broadcast station 4006 and also relates the viewer from the input unit 4012. A related information acquisition unit that transmits broadcast information that is being viewed by the viewer or partial broadcast information that is feature amount information obtained by converting the broadcast information, acquires related information, and provides the viewer with information acquisition instructions The viewer apparatus 4001 having 4011 is connected to a network 4005 such as the Internet, stores broadcast information and related information of the broadcast information, and stores related information corresponding to the partial broadcast information from the viewer apparatus 4001. Broadcast information storage device 400 such as a VTR that stores the broadcast information received by the viewer device 4001 and the related information providing server 4002 that transmits to the viewer. When, and a content providing server 4004 to transmit the related information home page to the viewer apparatus 4001 to the access from the viewer apparatus 4001. Although only one viewer device 4001 is shown for convenience, there are actually many viewer devices 4001.

  The viewer device 4001 receives broadcast signals such as BS digital broadcast, CS digital broadcast, terrestrial digital broadcast, cable television broadcast, and network broadcast via the IP network (Internet), and decodes broadcast information such as audio-video, It is a device having a function of reproducing and presenting to a viewer. In the case of television broadcasting, it is a device composed of a broadcast receiving antenna device, a tuner device, an STB (Set Top Box), a television, or the like. In FIG. 33, the viewer apparatus 4001 is illustrated as an apparatus in which the above-described devices are integrated. However, the viewer apparatus 4001 has a broadcast receiving antenna, a process of decoding broadcast information such as video and audio from a broadcast signal, and the like. In other words, a device for performing the above and a device for displaying and reproducing video and audio may be separated, and the necessary devices may be connected by a wired communication path or a wireless communication path. Further, the viewer apparatus 4001 includes a communication apparatus such as a modem for performing communication by connecting to the Internet or the like via ISDN, analog telephone, or other communication lines. Furthermore, as shown in FIG. 33, the viewer device 4001 includes a broadcast information storage device 4003 for storing received broadcast information, such as a VTR, and reproduces and views the stored broadcast information in a timely manner. Has a function for. Note that the internal configuration of the viewer apparatus 4001 will be described later.

  The related information is information related to specific broadcast information, and is multimedia information composed of text, images, sound, music, video, and the like. For example, when a movie is provided as broadcast information, the related information is profile information of characters in the movie described in HTML, BGM title, composer information, and the like. In the case of a video, it is detailed information on the product promoted by the CM, information on the BGM of the CM, and the like. Alternatively, the related information may be address information for accessing the multimedia information content, that is, URL (Uniform Resource Locators) to the content.

  When the related information is a URL to multimedia information content related to arbitrary broadcast information, the viewer apparatus 4001 accesses the related information providing server 4002 and is related information corresponding to the notified broadcast information identification information. After acquiring the URL, the URL is accessed via the Internet 4005, information content such as a home page is acquired from the content providing server 4004, and this is presented to the viewer. The viewer device 4001 includes a content information browsing unit 4013 as means for performing this process.

  The related information providing server 4002 includes a broadcast information database 4021, a related information database 4022, a broadcast information matching unit 4023, and a related information providing unit 4024. The related information providing server 4002 may be realized as a WWW server connected to the Internet 4005.

  The broadcast information database 4021 manages each piece of broadcast information in association with broadcast information identification information that is information for identifying the broadcast information. That is, as shown in FIG. 33, the broadcast program video / audio group, which is the broadcast information to be stored, is managed as, for example, files named Video 01, Video 02, Video 03,. In this case, the file name corresponds to broadcast information identification information. Furthermore, it is possible to specify up to one video frame in each video / audio file by designating a video frame number in each video / audio file. In this case, the file name and the video frame number correspond to the broadcast information identification information. Further, in the broadcast information database 4021, it is obtained by performing media conversion or feature amount extraction processing necessary for search processing in order to speed up processing when the broadcast information matching unit 4023 performs matching search for broadcast information. Information (for example, feature vector information extracted from an audio signal) may be held. The related information database 4022 includes a table as shown in FIG. 34 in which broadcast information identification information stored in the broadcast information database 4021 is associated with related information corresponding to the broadcast information. In the example shown in FIG. 34, the related information is a URL of a home page including related information.

  The broadcast information matching unit 4023 specifies broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching the broadcast information database 4021 for broadcast information corresponding to the partial broadcast information received from the viewer device 4001. . The related information providing unit 4024 refers to the related information database 4022, acquires related information corresponding to the specified broadcast information identification information, and transmits the related information to the viewer apparatus 4001.

  As shown in FIG. 35, the viewer apparatus 4001 includes a related information acquisition unit 4011, an input unit 4012, a content information browsing unit 4013, a broadcast reception unit 4014, a broadcast information demodulation / decoding unit 4015, a display reproduction unit 4016, and a network communication unit 4017. And a partial broadcast information buffer 4019.

  The broadcast receiving unit 4014 is an antenna and receives broadcast information from the broadcast station 4006. The broadcast information demodulating / decoding unit 4015 demodulates and decodes the broadcast information received by the broadcast receiving unit 4014, and in the display / playback unit 4016, the related information acquisition unit 4011, and further stores the broadcast information in the broadcast information storage device 4003. The broadcast information stored in the broadcast information storage device 4003 is input and reproduced. The input unit 4012 includes a related information acquisition instruction button 18 and other various buttons (not shown). As described above, when the viewer operates the related information acquisition instruction button 4018, the related information acquisition unit 4011 generates partial broadcast information from the broadcast information being viewed by the viewer, and the network communication unit 4017 sets the network 4005. Then, the information is transmitted to the related information providing server 4002, the related information transmitted from the related information providing server 4002 and received by the network communication unit 4017 through the network 4005 is acquired, and the URL contained therein is output to the content information browsing unit 4013. The content information browsing unit 4013 accesses the content providing server 4004 via the network communication unit 4017 and the network 4005 by URL, receives the related information homepage transmitted from the content providing server 4004 via the network communication unit 4017, and displays and reproduces Output to 4016. The display / playback unit 4016 includes display means such as a CRT or LCD and a display circuit, and displays video / audio as broadcast information, a related information homepage, and the like. The partial broadcast information buffer 4019 temporarily stores the viewed video and audio.

  Next, the operation of the broadcast receiving system with a related information providing function of this embodiment will be described.

  When the viewer operates the related information acquisition instruction button 4018 while viewing the broadcast information, the related information acquisition unit 4011 uses the broadcast information being viewed or the feature amount information obtained by converting the broadcast information as the partial broadcast information. It transmits to the related information provision server 4002. In addition, when acquiring the relevant information corresponding to the broadcast information stored in the broadcast information storage device 4003 that the viewer is playing back and watching at an arbitrary time, the broadcast information storage device that is playing back and watching at the arbitrary time The broadcast information stored in 4003 or the feature amount information obtained by converting the broadcast information stored in the broadcast information storage device 4003 being reproduced and viewed at any time is transmitted to the related information providing server 4002 as partial broadcast information. To do. Here, the related information is assumed to be a URL to a home page or the like that provides information related to the broadcast information. In the related information providing server 4002, when the partial broadcast information is notified from the viewer apparatus 4001, the broadcast information matching unit 4023 searches the broadcast information database 4021 to search for broadcast information identification information of broadcast information corresponding to the partial broadcast information. The related information providing unit 4024 acquires a related information (ie, URL) group associated with the broadcast information identification information with reference to a table as shown in FIG. 34, and sends this to the viewer apparatus 4001. Notice. The related information acquisition unit 4011 of the viewer device 4001 presents the acquired related information to the viewer.

  Here, as an implementation example of the related information acquisition unit 4011, related information is provided when an input unit such as a related information acquisition instruction button 4018 provided in the viewer apparatus 4001 is operated by the viewer and the related information acquisition is instructed. The server 4002 is accessed, the partial broadcast information is notified to the related information providing server 4002, the related information associated with the broadcast information identification information corresponding to the partial broadcast information is acquired from the related information database 4022, and presented to the viewer. (1) The related information providing server 4002 is sequentially and continuously accessed, and all the related information regarding the broadcast information that the viewer is currently viewing or reproducing / viewing is sequentially acquired from the related information management database 4022 to the viewer. (2) The viewer apparatus 4001 presents a so-called bookmark button and a related information acquisition instruction button 401. And the memory (storage device), the partial broadcast information at the time when the viewer operates the bookmark button and bookmarks is stored in the memory, and the viewer operates the related information acquisition instruction button 4018 to store the related information. When the acquisition is instructed, the related information providing server 4002 is accessed, the partial broadcast information stored in the memory is notified to the related information providing server 4002, and the broadcast information identification information group corresponding to the partial information from the related information database 4022 It is conceivable to obtain a related information group associated with the URL and present it to the viewer.

  In addition, the broadcast information matching unit 4023 searches the broadcast information database 4021 for broadcast information corresponding to the partial broadcast information received from the viewer device 4001, thereby obtaining broadcast information identification information of the broadcast information corresponding to the partial broadcast information. In specifying, K. Kashino, G. et al. Smith and H.M. Murase: “Time-Series active search for quick retrieval of audio and video”, Proc. of ICASSP-99, Vol. 6, PP. 2993-2996, Mar. 1999, or Kunio Kanno and Hiroshi Murase, “Time-Series Active Search Method for Instantly Searching for Sound and Video”, NTTR & D, Vol. 49, no. 7, 2000, PP. The method described in 407-413 is used. The above-mentioned method is a method of detecting the presence or absence and corresponding position of a target sound or video, such as a specific program title or CM, from a long-time sound such as broadcast or during broadcast, and when searching for sound, The search is performed based on the entire speech to be searched and the histogram of the feature vectors of the speech to be searched. When these methods are used, the partial broadcast information corresponds to audio data in video / audio that has been viewed for a certain period of time including the time at which related information is acquired, or a feature vector extracted from the audio signal. To do. When the related information acquisition unit 4011 included in the viewer device 4001 transmits the feature vector as the partial broadcast information to the related information providing server 4002, the related information acquisition unit 4011 has a function of extracting the feature vector from the audio signal. Also have.

  As the partial broadcast information, in addition to the above-described audio signal or feature vector extracted from the audio signal, various features extracted from the video signal such as video frame data, video sequence data (a series of continuous frame data), and a color histogram. The amount is considered.

  Next, in this embodiment, a specific operation of the system when the viewer acquires information related to broadcasting during viewing will be described.

  First, the related information acquisition unit 4011 always performs partial broadcasting while the viewer device 4001 is using the viewer device 4001 to reproduce and view the broadcast video / audio being broadcast or the broadcast video / audio stored in the broadcast information storage device 4003. In the information buffer 4019, the viewed video and audio up to an hour ago are buffered. Here, it is assumed that the viewer is interested in the contents of the video and audio being viewed and operates the related information acquisition instruction button 4018. As a result, the related information acquisition unit 4011 broadcasts viewed during a period from time a to time t after the time t when the related information acquisition instruction button 4018 is operated, that is, from time ta to time t. A video / audio audio signal is transmitted as partial broadcast information to the related information management server 4002 via the network communication unit 4017.

  The related information providing unit 4024 of the related information providing server 4002 transmits the received partial broadcast information to the broadcast information matching unit 4023. The broadcast information matching unit 4023 searches for broadcast information corresponding to the partial broadcast information from the broadcast information database 4021 using the received partial broadcast information, that is, an audio signal. As a result of the search, for example, it is assumed that the video sequence from frame 1 to frame 3 of the video file Video 01 matches the received partial broadcast information. Here, the received partial broadcast information is viewed in the period from time a to time t before the time t when the viewer operates the related information acquisition instruction button 4018, that is, from time ta to time t. Therefore, the video frame corresponding to the last time in the adapted video sequence becomes the video frame being viewed at the time t when the viewer operates the related information acquisition instruction button 4018. Equivalent to. The broadcast information matching unit 4023 performs the above-described determination, and as a result, notifies the related information providing unit 4024 of information “file name: Video 01, frame number: 002” as broadcast information identification information. The related information providing unit 4024 refers to the related information database 4022 shown in FIG. 34, and uses http: // www as related information corresponding to the received broadcast information identification information “fill name: Video 01, frame number: 002”. . aaa. co. jp. / Program information. A URL “html” is returned as related information to the viewer apparatus 4001.

  The viewer apparatus 4001 sends the received URL to the content information browsing unit 4013, and the content information browsing unit 4013 accesses the content providing server 4004 specified by the URL address, acquires the related information homepage, It is provided to the viewer by the display / playback unit 4016.

(Example 4-2)
In the examples described above, basically, the related information provided when the viewer designates arbitrary broadcast information does not depend on the attributes of the viewer, and corresponds to the same broadcast information, The same related information was provided to all viewers.

  Also in this embodiment, similar to each of the above-described embodiments, it is possible to provide different related information for each viewer and viewer device based on the viewer information and the terminal information of the viewer device. is there. In the present embodiment, a configuration for providing different related information for each viewer and viewer device will be described in detail as Example 4-2.

  As in the first embodiment, the viewer information is information about the viewer, such as name, gender, age, occupation, address, zip code, family structure, residence information (apartment, detached house, etc.), hobby Interest genre (politics, economy, news, computer, books, sports, travel, etc.), annual income, information on whether or not you are a member of various services, membership number or credit card ID, various qualifications (driver's license ), Etc., including information on presence / absence, information on body shape (weight, height, clothing size, etc.), information on ability (sight, hearing, etc.), and the like.

  The terminal information is the resolution of the display device of the viewer device, the number of displayable colors, the performance of the WWW information browsing means (whether the Java function can be used, the presence / absence of the video / audio content playback function, the encoded format information that can be played back by the video / audio content, Etc.).

  In the following, with respect to the case of providing different related information for each viewer and viewer apparatus based on the viewer information and the terminal information of the viewer apparatus, the differences from the embodiment 4-1 will be described with reference to FIGS. Will be described with reference to FIG.

  In the present embodiment, as shown in FIG. 37, the viewer apparatus includes a storage unit 4030 for storing and holding viewer information and terminal information. The input unit 4012 provides a viewer with a function for inputting viewer information. The viewer inputs various pieces of viewer information in advance via the input unit 4012, and the input viewer information is stored in the storage unit 4030.

  The terminal information is stored in the storage unit 4030 at the time of manufacturing the terminal, or is notified to and stored in the storage unit 4030 from the display / playback unit 4016 when the display / playback unit 4016 is connected.

  In the present embodiment, the related information held in the related information database 4022 includes a related information body such as a URL and its attribute information. Attribute information refers to the characteristics of viewers that can be provided with relevant information, that is, gender, age, body shape characteristics, ability characteristics, occupation, district, zip code group, family composition characteristics, housing characteristics, annual income, and Information genre to which related information belongs, information on service use rights and qualifications necessary for using the related information, and characteristics of terminals to be provided, that is, display device resolution characteristics, number of displayable colors, content information browsing The performance of the unit 4013, and the like.

The related information when the related information body is a URL is, for example,
Related information example 1: “URL1, (for women), (target age 20 and above), (1024x800 and above), (256 colors and above)”
Related information example 2: “URL2, (clothing size M), (Java function required)”
Related Information Example 3: “URL3, (Occupation: Housewife), (Tokyo)”
Related information example 4: “URL4, (for women), (sight below 0.8)”
Related information example 5: “URL5, (genre: sports)”
It becomes something like that.

  In this example, the actual related information is advertisement information of cigarettes for women in the related information example 1, and corresponds to a case where the content is less than 20 years old or unsuitable for men. The related information example 2 may be clothing advertisement information, the related information example 3 may be product information of a supermarket in Tokyo, the related information example 4 may be advertising information for female glasses, and the like. The related information 5 may be a sporting goods advertisement or the like.

  As shown in FIG. 36, the 4001 related information acquisition unit 4011 of the viewer apparatus, when transmitting the partial broadcast information to the related information providing server 4002 in the embodiment described so far, Alternatively, any one of the information is transmitted together with the partial broadcast information.

  The related information providing unit 4024 of the related information providing server 4002 specifies broadcast information identification information from the partial broadcast information according to the procedure described in the above embodiment, and further specifies corresponding related information. Thereafter, the viewer information and the terminal information given to the corresponding related information are referred to, and based on these, the related information is selected and transmitted to the viewer apparatus.

  Specifically, the related information associated with the broadcast information identification information identified from the partial broadcast information received by the related information providing server 4002 from the viewer device 4001 is shown in the related information examples 1 to 4 described above. If the viewer information is (female) and the terminal information is (resolution 800x600) or (unavailable for Java), the related information providing unit 4024 needs to have a resolution of 1024x800 or more. The related information example 1 that is a condition and the related information example 2 that is a condition that requires the Java function are excluded, and the remaining URL 3, URL 4, and URL 5 are transmitted to the viewer apparatus 4001.

  The viewer information is (female), (Kyoto), (sight 1.5) (interesting genre: book), and the terminal information is (resolution 1024x800), (Java available). In this case, the related information providing unit 4024 specifies the related information example 3 in which the target district is Tokyo, the related information example 4 in which the target viewer has a visual acuity of 0.8 or less, the genre is specified, and The related information example 5 whose genre is other than books is excluded, and the remaining URL 1 and URL 2 are transmitted to the viewer apparatus 4001.

  In addition to the above-described example, when the related information includes the information (available only to A service members) as the attribute information and the A service member number is included as the viewer information, the related information is used as the viewer device. 4001 may be transmitted. Also, when the attribute information includes information (requires a car license) is included in the related information, and the viewer information includes (car licensed), the related information is transmitted to the viewer apparatus 4001, etc. There is.

  In addition, when the information (mpeg2 format) is added to the related information as the attribute information and the terminal information includes (reproducible encoding method: mpeg2), the related information is transmitted to the viewer apparatus. Etc.

  As described above, in the above Example 4-2, by using the viewer information and the terminal information, related information that is unnecessary for the viewer and related information that cannot be used in the viewer device used by the viewer. Is not transmitted, and only the information considered necessary or available to the viewer is provided to the viewer.

(effect)
As described above, according to this embodiment, it is not necessary to perform special processing such as adding information necessary for providing related information to broadcast video and audio, and broadcast video and audio Even when temporarily accumulating and reproducing and viewing, it is possible to provide related information related to broadcast video and audio via the network.

[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described. In the present embodiment, a service that is accurately synchronized with a broadcast image frame is realized by using a frame ID or the like superimposed on the broadcast audio.

  As such a service, for example, when a user presses a button on the viewer device at hand while watching a television broadcast, the service is related to the content of the video displayed on the TV at the time the button is pressed. There is a service in which relevant information is acquired via a network and can be used in a viewer apparatus.

  In addition, while viewing an educational program or the like, a text book or the like used for explanation in the educational incense group is displayed on the display device of the viewer device, and a page is turned as the program progresses, and an underline is drawn. A service in which an action such as displaying a pointer indicating a part to be explained is also possible.

  In order to realize the service described above, it is necessary for the viewer apparatus to be able to grasp the content of the broadcast being viewed by the user at an arbitrary time. In other words, in the present embodiment, the viewer apparatus always superimposes information such as which channel the user is watching on the TV, what video is currently displayed on the TV, and the like on the audio. Grasp using frame ID etc. Thus, for example, when a button is pressed on the viewer device, in a service that acquires related information related to the video being viewed, when the video scene shown on the television is switched and the content changes, The relevant information to be acquired can be switched instantaneously.

  The term “related information” in the present embodiment is used when referring to information for acquiring content related to broadcast information, and also used when referring to content itself related to broadcast information.

  FIG. 38 is a diagram showing an example of the configuration of the entire broadcast synchronous service providing system according to the fifth embodiment of the present invention, where numeral numeral 5001 is a broadcasting station, 5002 is a transmission means, 5003 is a signal addition means, and 5004. Is a video, 5005 is a sound, 5006 is a broadcast, 5007 is a broadcast receiving device, 5008 is a video / audio recording device, 5009 is a viewer device, 5010 is a microphone (MIC), 5011 is a data signal extracting means, 5012 is an output means, Reference numeral 5013 denotes input means, and 5014 denotes a connection line to the network.

  In the broadcast synchronization type service providing system shown in the figure, a digital data signal including at least a channel ID and an image frame ID or an audio frame ID is converted into an analog audio wave of a broadcast wave on the broadcast station side that broadcasts audio and video. Superimposing signal adding means 5003 is provided.

  For example, when the frame rate of the video to be broadcast is 30 frames / second, the data signal can be superimposed on the audio wave by sequentially superimposing the data signal every 1/30 seconds. As a method for superimposing the data signal on the voice, the signal adding means uses, for example, a data hiding technique (see Nikkei Electronics, No. 683 (1997), pp. 99 to 125, 149 to 162). Can do.

  As an example of a method of superimposing a data signal on an audio signal, transmission is performed by deleting a specific frequency component (band) of the audio signal in correspondence with “0” and “1” of the binarized data signal on the transmission side. On the receiving side, the frequency component deleted from the audio signal is detected and the binary data string is reproduced. On the transmitting side, the binary data signal "0" or "1" is supported. There is a method of transmitting the specified frequency component outside the audio signal band and reproducing the binary data sequence by detecting the frequency component added outside the audio signal band on the receiving side.

  In FIG. 38, the broadcast receiving side includes a broadcast receiving apparatus that reproduces broadcast audio and video, and a viewer apparatus 5009 that does not have communication means such as the broadcast receiving apparatus 5007 and a communication line.

  FIG. 39 is a diagram illustrating an example of a configuration of a viewer apparatus. The viewer device 5009 extracts the microphone 10 for collecting the sound of the broadcast information reproduced from the speaker of the broadcast receiving device, the signal superimposed from the sound input from the microphone, and extracts the channel ID and the image. Data signal extracting means 5011 for confirming the frame ID and communication means 5015 for communicating with the related information content providing server on the network.

  Further, storage means 5016 for storing data necessary for each process, output means 5012 such as a display for displaying related information provided from a server on the network at the time of use to the user, It has input means 5013 such as a mouse and a keyboard for inputting information necessary for operating the terminal, and a control means 5017 for controlling them.

  In the broadcast-synchronized service providing system in the present embodiment, as shown in FIG. 39, on the broadcast station side, the data signal is superimposed on the audio of the broadcast information as described above, and broadcast together with the video of the broadcast information. On the other hand, the viewer apparatus extracts the data signal superimposed on the analog audio wave of the broadcast information by the data signal extraction means (channel ID and image frame identification means) shown in FIG. It is possible to accurately grasp the state of broadcast information that the user is viewing, that is, what kind of scene of which broadcast channel is being viewed.

  Therefore, the viewer apparatus can provide a broadcast synchronous service to the user by communicating with a server that provides related information related to the broadcast information existing on a network or the like. Here, as described above, the broadcast-synchronized service refers to, for example, sequentially providing related information that changes in synchronization with the progress of a program being watched (actually, changes in audio and image frames) to the user, or A service such as marking related information in the scene by pressing a button or the like in a scene in which the user is interested, and browsing the information later can be provided.

  Furthermore, by connecting and using means capable of recording and reproducing broadcast information to the broadcast receiving apparatus in the above-mentioned system, the user can not only broadcast the currently broadcast program but also the once recorded broadcast program. You can use the services as described above at any time. The operation of the broadcast synchronization service providing system will be described below.

  FIG. 40 shows a configuration diagram of an example in the fifth embodiment. In the figure, reference numeral 5001 is a broadcasting station, 5007 is a broadcast receiving device, 5008 is a video / audio recording device, 5009 is a viewer device, 5010 is a microphone (MIC), 5011 is a data signal extraction means, 5018 is an output device, 5019. Is an input device, 5014 is a connection line to the network, 5020 is a broadcast information database, 5021 is a broadcast information related information adding device, 5022 is a broadcast information database construction device, and 5023a to 5023d are related information content providing servers (a) to (d). ).

  In the broadcast synchronization service providing system of the present invention, the produced broadcast information is broadcast as a program by a broadcasting means on the broadcast station side for general users. At this time, a data signal including a channel ID capable of uniquely identifying a broadcast channel and an image frame ID capable of uniquely identifying an image frame is superimposed on the sound of the broadcast information by a signal adding unit.

  The above processing is performed for all broadcast information targeted for the broadcast synchronous service. As a result, the broadcast channel currently being viewed and the image frame can be uniquely identified by extracting the data signal superimposed on all the broadcast information to be serviced.

  On the other hand, on the broadcast receiving side, broadcast information broadcast by using a broadcast receiving device 5007 such as a television can be viewed as usual. The user can receive a broadcast synchronization service by activating the viewer device 5009. When the viewer apparatus 5009 is activated, the microphone 10 collects sound output from the speaker of the broadcast receiving apparatus 5007.

  The channel ID and the image frame ID are confirmed from the collected sound by the data signal extracting means. At this time, based on the confirmed channel ID, the viewer apparatus relates to the broadcast information of the currently viewed broadcast channel from the related information content providing server related to each broadcast information of each broadcast channel scattered on the network. After the related information content providing server is identified, the related information content providing server is accessed via the network and the image frame ID is transmitted.

  The related information content providing server manages a broadcast information database constructed by a broadcast information database construction device 5022, a related information addition device 5021, and the like. In the broadcast information database, a table is prepared in which each image frame ID is associated with various related information such as voice, video, text, and an execution instruction to the service terminal. By specifying the image frame ID, the broadcast information database is prepared. You can easily specify related information sets.

  Therefore, the related information content providing server can accurately grasp the scene currently being viewed by the user by receiving the information of the image frame ID transmitted from the viewer apparatus on the user side corresponding to the client. The related information according to the scene can be transmitted to the viewer apparatus. By sequentially repeating the above-described operation, the user can be provided with related information accurately synchronized with the broadcast information currently being viewed. Thereby, a broadcast synchronous service can be realized.

  In the broadcast synchronization service providing method of the present invention, the broadcast synchronization service providing system is based on the operation of the broadcast synchronization service providing system described above, and the broadcast information that the user is currently viewing by specifying the format of the image frame ID. To improve the reliability when the viewer apparatus grasps the above.

  FIG. 41 shows a data structure including a channel ID and an image frame ID. As described above, the channel ID and the image frame ID are such that the broadcast channel and the image frame can be uniquely identified. In particular, the image frame ID is a continuous number in time series. In the viewer apparatus, as described above, the sound reproduced from the speaker of the broadcast receiving apparatus is collected by the microphone, and the channel ID and the image frame ID are sequentially identified by the data signal extracting means.

  FIG. 42 shows an actual processing flow when the two IDs are confirmed. When the viewer apparatus is activated, the viewer apparatus sets two values of “last channel ID” and “last image frame ID” as initial values. If the initial value set at this time is, for example, the value of the “last channel ID”, the channel ID that was viewed immediately before the last viewing and ending, or a predetermined channel ID, or the like can be considered. If the value is “image frame ID”, a value such as “0” can be considered.

  The viewer apparatus sequentially extracts a data signal from the sound and identifies the channel ID and the image frame ID (step S1). The viewer apparatus follows the following process based on whether or not the two IDs are correctly confirmed. First, when the channel ID is confirmed correctly, the channel ID is used as the channel ID of the currently reproduced broadcast channel (step S2), and the data signal is not correctly extracted from the sound, and the channel ID is confirmed. If not, the value of “last channel ID” is used as the channel ID of the currently reproduced broadcast channel (step S3). Then, the current channel frame ID is recorded (step S4).

  On the other hand, regarding the recognition of the image frame ID (step S5), when the image frame ID is correctly confirmed, the image frame ID is used as the image frame ID of the currently reproduced image in the same manner as the channel ID ( Step S6). On the other hand, if the image frame ID is not confirmed, the image frame ID is a continuous number in time series as described above, so that a value obtained by adding 1 to the value of the “last image frame ID” is currently reproduced. It is used as an image frame ID of the existing image (step S7). Then, the existing image frame ID is recorded (step S8).

  After both the channel ID and the image frame ID are used as the current values, the “last channel ID” value and the “last image frame ID” value are set (step S9), respectively. And a data signal is extracted from the audio | voice of the following area (step S10). In this way, it is possible to always hold and use the most recently used value in the processing flow sequentially performed. By determining the image frame ID as described above and following the processing flow, it is possible to interpolate the image frame ID even when the data signal is not correctly extracted from the sound during viewing of the same program, so that service provision is maintained. it can.

  A specific example of a case where the present broadcast synchronous service providing method is applied to a television broadcast will be described by taking a certain television program as an example. It is assumed that a broadcasting station that broadcasts this television program is previously provided with means for superimposing a data signal on sound, and “a” is given as the channel ID of the broadcasting station, and the image frame D is “ It starts with 1 ".

  Also, here, the confirmation result of the channel ID and the image frame ID as a result of the data signal extraction means after starting the viewer apparatus is assumed as shown in FIG. 43, and the variable for storing the value of “last channel ID” is set to “LAST”. -CH-ID ", a variable storing the value of" last image frame ID "is" LAST-FRAME-ID ", a variable storing the value of" current channel ID "is" CH-ID ", and" current A variable for storing “image frame ID” is assumed to be “FRAME-ID”.

  First, when the viewer apparatus is activated while watching this TV program, for example, “z” is set to “LAST-CH-ID” and “0” is set to “LAST-FRAME-ID”. Is set. Next, for the first time, the result of identification by the service terminal using the data signal extracting means is that the channel ID is “a” and the image frame ID is “1000” accurately confirmed from FIG. 43 (step 1). “A” is set to “CH-ID”, “1000” is set to “FRAME-ID”, “a” is set to “LAST-CH-ID”, and “1000” is set to “LAST-FRAME-ID”. Is done.

  However, in the result of the next data signal extraction means, the channel ID and the image frame ID are both “unknown” from FIG. 43 (step 2). Therefore, in accordance with the processing flow of FIG. 42 described above, “CH-ID” refers to “LAST-CH-ID” and “FRAME-ID” refers to “LAST-FRAME-ID”. By adding 1, “1001” is set, and the respective values are set as new “LAST-CH-ID” and “LAST-FRAME-ID” values.

  FIG. 44 shows the values of the variables obtained for the data signal extraction processing result of FIG. 43 according to such a procedure. On the other hand, the viewer apparatus accesses the related information content providing server related to the broadcast contents via the network based on the value of “CH-ID” obtained as a result of the processing flow, and sequentially transmits “FRAME-ID”. .

  The related information content providing server transmits the character data, voice data, image data, or the URL where the related information exists, associated with the received “FRAME-ID” in advance to the service terminal. Is displayed, reproduced, drawn, or the URL is opened in a browser.

  For example, if the content of the program is English conversation, a change in related information such as text data is displayed as text in accordance with a sentence pronounced by a person in broadcast information, and more important text is underlined. be able to.

  In the above description, the case where video and audio are broadcast at the same time as in television broadcasting is described. However, the present invention is not limited to the case where audio and video are broadcast at the same time. It is also effective for broadcasting only. In this case, since there is no image frame, an audio frame ID is used instead of the image frame ID. The voice frame ID is an identifier uniquely assigned to each section of the voice divided by a certain time interval.

  In the description so far, the audio output from the speaker of the broadcast receiving apparatus such as a television receiver is received by the viewer apparatus with a microphone and converted into an electric signal, and the image frame ID and the audio frame ID are converted from the electric signal. Although the configuration for extracting as a data signal is described, when an audio electrical signal can be directly extracted from a broadcast receiver such as a television receiver, the data signal directly superimposed from the audio electrical signal without interposing a microphone It can also be set as the structure which extracts.

  Also in the present embodiment, it is possible to provide different related information for each viewer and viewer device based on the viewer information and the terminal information of the viewer device. For example, in the same manner as the method described in the embodiment 4-2, when the viewer apparatus requests related information from the related information content providing server, the viewer information and the terminal information are transmitted together with the frame ID and the like. The content providing server may select related information related to the viewer information or terminal information and provide it to the viewer apparatus.

(effect)
According to the invention according to the present embodiment, even in a broadcast receiver such as a television receiver and a radio and a viewer apparatus that does not have a communication means such as a communication line for performing digital signal communication, the audio of the broadcast information By extracting the data signal superimposed on and confirming the channel ID, the image frame ID, and the audio frame ID, it is possible to recognize the currently viewed broadcast channel and image frame, and the broadcast contents and network It is possible to realize a service that needs to be accurately synchronized with related information contents.

  Further, by connecting means capable of recording and reproducing broadcast information, when not viewing in real time, that is, in a system configured to record broadcast audio-video in advance and view it when desired. By reproducing the video and audio by the means, it becomes possible to recognize the broadcast channel, the image frame, and the audio frame ID, and to receive the same service as when viewing in real time.

  Also, in the viewer device, when the sound reproduced from the broadcast receiving device is collected from the microphone, the data signal cannot be correctly extracted from the sound due to the influence of noise or the like, and the image frame ID is temporarily confirmed. Even if it is not possible, it is possible to interpolate the missing image frame ID and audio frame ID, so during the viewing of the same broadcast program, provision of a service that requires accurate synchronization between the broadcast information and the related information is in progress. Can continue to maintain without interruption.

  That is, as described above, according to the present embodiment, in the viewer apparatus that is provided separately from the broadcast video viewing apparatus and does not have a function that can directly acquire a data signal or the like multiplexed in the broadcast from the broadcast receiving apparatus, Currently, it is possible to provide a service of related information that is accurately synchronized with changes in the contents of a broadcast program being viewed. That is, even if the user does not operate according to the broadcast video, the related information can be updated automatically and in a timely manner, and the operability of the broadcast synchronous service can be improved.

  Furthermore, according to the broadcast synchronization type service providing method of the present embodiment, by setting the image frame ID as a continuous number, even if the viewer device fails to extract the image frame ID from the sound, the time The image frame ID can be interpolated from the difference and used. Further, even if the recorded video once accumulated by the recording device is used, it is possible to receive the broadcast synchronous service at the user's preferred time by utilizing the fact that the audio is simultaneously recorded.

  Note that the viewer apparatus and related information providing server of the present invention in each of the above embodiments can each be configured using a computer having a CPU, memory, hard disk, CD-ROM, etc. Functions in each of the information providing servers and the like can be realized by programs installed in each device or server. The program can be installed in a computer from a recording medium such as a CD-ROM, or can be downloaded to the computer via a network.

  The present invention is not limited to the above-described embodiments, and various modifications and applications can be made within the scope of the claims.

It is a figure which shows the basic structural example in the 1st Embodiment of this invention. It is a block diagram of the system in 1st Embodiment. It is a figure which shows the structural example of a viewer apparatus. It is a figure which shows the structural example of a related information content provision server. It is a figure which shows the flow of the information between a viewer apparatus and a related information content provision server. It is a conceptual diagram showing the relationship between event information, broadcast information, and a service. It is a figure which shows the procedure which selects a service and related content. It is a figure which shows the example of the display screen of service information. It is a figure which shows the example of a notification setting (condition setting) screen. It is a system block diagram in the 2nd Embodiment of this invention (Example 2-1). It is a figure which shows the example of the relevant information in 2nd Embodiment. It is a figure for demonstrating the relationship between the to-be-photographed object figure of the to-be-photographed object subject and the subject related information display part. It is a figure which shows the example of a display in a to-be-related information display part. It is a system configuration figure in a 2nd embodiment of the present invention (Example 2-2). It is a system block diagram in the 2nd Embodiment of this invention (Example 2-3). It is a figure which shows the other example in Example 2-3. It is a system block diagram in the 2nd Embodiment of this invention (Example 2-4). It is a system block diagram in the 3rd Embodiment of this invention. It is a block diagram of the related information provision server and viewer apparatus of FIG. It is a sequence diagram of the method in 3rd Embodiment. It is an example of the action table in 3rd Embodiment. It is an example of the client generation | occurrence | production event list | wrist in 3rd Embodiment. It is an example of the action table acquired initially in Example 3-1. It is an example of the action table acquired after FIG. It is an example of the action table in Example 3-1. It is an example of the action table from which the action content information differs from the action table of FIG. It is an action table in Example 3-2. It is a system configuration figure in Example 3-3. It is an example of an information display area when a broadcast receiving apparatus that receives broadcast video and an output device of a viewer apparatus are integrated. It is a figure which shows an example of the action table in Example 3-3. It is a figure which shows a broadcast video display area. It is a figure for demonstrating that the icon A is additionally displayed on the viewer apparatus output information display area. It is a figure which shows the example of the whole structure of the system in the 4th Embodiment of this invention (Example 4-1). It is a figure which shows the example of the table which the related information database 4022 has. It is a figure which shows the example of 1 structure of the viewer apparatus in Example 4-1. It is a figure which shows the example of the whole structure of the system in the 4th Embodiment of this invention (Example 4-2). It is a figure which shows the example of 1 structure of the viewer apparatus in Example 4-2. It is a figure which shows the example of a whole structure of the broadcast synchronous service provision system in the 5th Embodiment of this invention. It is a figure which shows the example of a structure of the viewer apparatus in 5th Embodiment. It is a figure which shows the detailed example of a structure of the whole broadcast synchronous service provision system in the 5th Embodiment of this invention. It is a figure which shows the example of a structure of the data signal and audio | voice data superimposed on an audio | voice. It is a flowchart which shows the process from the data signal extracted from the sound to channel ID and image frame ID determination actually used. It is an example of a confirmation result of a channel ID and an image frame ID based on the result of the data signal extraction means after the viewer apparatus is activated. It is the value of each variable obtained for the data signal extraction processing result of FIG.

Explanation of symbols

1001 Viewer apparatus 1002 Related information content providing server 1003 Broadcast station 1004 Event information providing server 1011 Provideable service request means 1012 Available service information visualization display means 1013 Service selection / request means 1014 Service use means 1021 Provideable service selection means 1022 Provided Possible service information transmitting means 1023 Service request receiving means 1024 Access system state detecting means 1025 Service content optimizing means 1026 Service providing means 2010 Broadcast information 2011 Video information 2012 Related information 2002 Viewer device 2201 Broadcast receiving section 2202 Video display control section 2203 Video Display unit 2204 First pointing device 2205 Related information display control unit 2206 Subject related information display unit 2207 Second pointing Device 2208 input device 2209 subject attribute information storage unit 2210 related information access unit 2211 related information storage unit 2212 interest information extraction unit 2213 broadcast information storage unit 2003 communication network 2004 broadcast station 3001 related information providing server 3002 viewer device 3003 broadcast station 3003 'Broadcast information storage server 3004 Input / output device 3005 Broadcast receiving device 3006 Network 3010 Action table providing means 3011 Action table configuring means 3012 Action table resource data 3013 Communication means 3014 Client identifying means 3015 Client information management means 3021 Event management means 3022 Action table management Means 3023 Action execution means 3024 Communication means 3025 Output interface 3026 Input in Interface 4001 Viewer device 4002 Related information providing server 4003 Broadcast information storage device 4004 Content providing server 4005 Network (Internet)
4006 Broadcasting station 4011 Related information acquisition unit 4012 Input unit 4013 Content information browsing unit 4014 Broadcast receiving unit 4015 Broadcast information modulation / decoding unit 4016 Display reproduction unit 4017 Network communication unit 4018 Related information acquisition instruction button 4019 Partial broadcast information buffer 4021 Broadcast information database 4022 Related information database 4023 Broadcast information matching unit 4024 Related information providing unit 4030 Storage unit 5001 Broadcast station 5002 Transmission unit 5003 Signal addition unit 5004 Video 5005 Audio 5006 Broadcast 5007 Broadcast reception device 5008 Video / audio recording device 5009 Viewer device 5010 Microphone (MIC) )
5011 Data signal extraction means 5012 Output means 5013 Input means 5014 Connection line 5015 to network 5015 Communication means 5016 Storage means 5017 Control means 5018 Output device 5019 Input device 5020 Broadcast information database 5021 Broadcast information related information assignment apparatus 5022 Broadcast information database construction apparatus 5023 (A)-(d) Related information content providing server

Claims (30)

A related information providing method for acquiring related information, which is information related to broadcast information, and providing the information to a viewer,
Broadcast information is stored in the broadcast information database, related information of each broadcast information is stored in the related information database,
Broadcast information corresponding to partial broadcast information, which is broadcast information being viewed by a viewer or converted from the broadcast information, is searched from the broadcast information database, and the related information database is searched using the broadcast information. The related information providing method of acquiring related information of the broadcast information by searching for and providing it to the viewer. A related information providing method for acquiring related information, which is information related to accumulated broadcast information, and providing it to a viewer,
Broadcast information is stored in the broadcast information database, related information of each broadcast information is stored in the related information database,
Broadcast information corresponding to partial broadcast information, which is feature information obtained by converting broadcast information stored in the broadcast information storage device or converted from the broadcast information, which is being viewed by a viewer, is searched from the broadcast information database. Further, a related information providing method of acquiring related information of the broadcast information by searching the related information database with the broadcast information and providing it to a viewer. 3. The partial broadcast information is broadcast information viewed for a certain period including a time point when a viewer receives a related information acquisition instruction, or feature amount information obtained by converting the broadcast information. The related information provision method of description. The broadcast information database manages each piece of broadcast information with broadcast information identification information that is information for identifying the broadcast information, and the related information database corresponds to the broadcast identification information and related information corresponding to the broadcast information. The broadcast information identification information of the broadcast information corresponding to the partial broadcast information is specified by searching the broadcast information database, and the related information corresponding to the broadcast information identification information is referred to the related information database. The related information providing method according to claim 1, wherein the related information providing method is provided to a viewer. In addition to the related information, the related information database manages viewer information indicating the characteristics of a viewer that can be provided, and viewer device information indicating characteristics of a terminal that is provided with related information,
The related information according to any one of claims 1 to 4, wherein after the related information is specified, the related information is selected based on the viewer-specific viewer information or the viewer device information and provided to the viewer. Information provision method. Means for receiving broadcast information including video and audio and providing it to the viewer, and converting the broadcast information being viewed by the viewer or the broadcast information at the time when the instruction is input according to the related information acquisition instruction of the viewer One or more viewer apparatuses having means for transmitting the partial broadcast information which is the feature amount information obtained through a predetermined network and acquiring the related information transmitted through the network;
A broadcast information database connected to the network and managing each piece of broadcast information in association with broadcast information identification information that is information for identifying the broadcast information, and broadcast information identification information stored in the broadcast information database And the related information database for managing the related information corresponding to the broadcast information and the broadcast information corresponding to the partial broadcast information transmitted by the viewer apparatus from the broadcast information database. Means for specifying broadcast information identification information of broadcast information corresponding to broadcast information, means for obtaining related information corresponding to the specified broadcast information identification information with reference to the related information database, and transmitting the information to the viewer apparatus A broadcast receiving system with a related information providing function. The viewer device includes means for accumulating the broadcast information, means for reproducing and viewing the stored broadcast information, and a viewer's related information acquisition instruction.
Transmitting, via the network, the stored broadcast information being reproduced and viewed at the time when the instruction is input, or partial broadcast information that is characteristic amount information obtained by converting the broadcast information, and the network The system according to claim 6, further comprising means for acquiring related information transmitted via the Internet. 8. The partial broadcast information is broadcast information viewed during a certain period including a point in time when the related information acquisition instruction is input, or feature amount information obtained by converting the broadcast information. system. In addition to the related information, the related information database manages viewer information indicating the characteristics of a viewer that can be provided, and viewer device information indicating characteristics of a terminal that is provided with related information,
The related information providing server further includes means for selecting related information based on the viewer information unique to the viewer device or the viewer device information after specifying the related information, and providing the selected information to the viewer. The system according to claim 1. Broadcast receiving means for receiving broadcast information;
Broadcast information demodulation and decoding means for demodulating and decoding broadcast information received by the broadcast receiving means;
An input means for the viewer to input various instructions including a related information acquisition instruction;
Network communication means for communicating with a related information providing server that stores related information corresponding to each broadcast information via a predetermined network;
When a related information acquisition instruction is input from the input means, the broadcast information output from the broadcast information demodulation / decoding means at the time when the instruction is input, or feature amount information obtained by converting the broadcast information Partial broadcast information is transmitted to the network via the network communication means, and then related information corresponding to the partial broadcast information transmitted from the related information providing server via the network is transmitted via the network communication means. Related information acquisition means
A viewer apparatus comprising: display reproduction means for displaying and reproducing broadcast information output from the broadcast information demodulation and decoding means and related information received by the related information acquisition means. Broadcast information storage means for storing broadcast information output from the broadcast information demodulation and decoding means;
When the related information acquisition instruction is input from the input means while the viewer is reproducing and viewing the broadcast information stored in the broadcast information storage means, the related information acquisition means The viewer apparatus according to claim 10, wherein broadcast information being reproduced / viewed or partial broadcast information which is characteristic amount information obtained by converting the broadcast information is transmitted to the network via the network communication unit. The viewer device according to claim 10 or 11, further comprising means for transmitting viewer information unique to the viewer device or viewer device information to the related information providing server in addition to the partial video information. . The related information specifies information related to broadcast information, includes address information necessary to access the information, acquires the address information from the related information acquisition means, and is designated by the address information The viewer apparatus according to claim 10 or 11, further comprising an information access / browsing unit that accesses a providing server, acquires related information, and displays the information by the display / playback unit. The apparatus further includes a bookmark button, the partial broadcast information at the time when the viewer operates the bookmark button and bookmarks is stored in a memory, and the related information acquisition means receives the related information acquisition instruction from the viewer The viewer apparatus according to any one of claims 10 to 13, wherein the viewer accesses the related information providing server at a time point and notifies the related information providing server of the partial broadcast information stored in the memory. Connected to a given network,
A broadcast information database for managing each broadcast information in correspondence with broadcast information identification information that is information for identifying the broadcast information;
Broadcast information identification information stored in the broadcast information database, and a related information database for managing related information corresponding to the broadcast information,
Means for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching the broadcast information database for broadcast information corresponding to the partial broadcast information transmitted by the viewer device via the network;
Means for referring to the related information database, obtaining related information corresponding to the specified broadcast information identification information, and transmitting to the viewer device;
The partial broadcast information is broadcast information that is being viewed by a viewer at an arbitrary time point, broadcast information that is being reproduced and viewed, stored in a broadcast information storage device, or feature amount information obtained by converting these broadcast information. Related information providing server. In addition to the related information, the related information database manages viewer information indicating the characteristics of a viewer that can be provided, and viewer device information indicating characteristics of a terminal that is provided with related information,
The related information providing server further includes means for selecting related information based on the viewer information unique to the viewer apparatus or the viewer apparatus information after specifying the related information, and providing the selected information to the viewer. The related information providing server described. A computer-readable recording medium recording a program for causing a computer to execute processing for acquiring related information related to broadcast information,
Broadcast reception procedure for receiving broadcast information;
Broadcast information demodulation and decoding procedure for demodulating and decoding broadcast information received by the broadcast reception procedure;
Input procedures for viewers to input various instructions including related information acquisition instructions,
A network communication procedure for communicating with a related information providing server storing related information corresponding to each broadcast information via a predetermined network;
When a related information acquisition instruction is input by the input procedure, it is broadcast information output by the broadcast information demodulation / decoding procedure at the time when the instruction is input, or feature amount information obtained by converting the broadcast information Partial broadcast information is transmitted to the network using the network communication procedure, and then related information corresponding to the partial broadcast information transmitted from the related information providing server via the network is used for the network communication procedure. Related information acquisition procedure received,
A computer-readable recording medium on which a program for executing broadcast information output by the broadcast information demodulation / decoding procedure and display / reproduction procedure for displaying and reproducing related information received by the related information acquisition procedure is recorded. Further executing a broadcast information storage procedure for storing the broadcast information output by the broadcast information demodulation and decoding procedure,
When a related information acquisition instruction is input using the input procedure while the viewer is reproducing and viewing the broadcast information stored by the broadcast information storage procedure by the related information acquisition procedure, the instruction is input. 18. The program according to claim 17, wherein broadcast information being reproduced / viewed at a point in time or partial broadcast information which is characteristic amount information obtained by converting the broadcast information is transmitted to the network using the network communication procedure. Computer-readable recording medium 19. A computer-readable recording having recorded thereon the program according to claim 17 or 18, further causing the computer to further execute a procedure of transmitting viewer information or viewer apparatus information to the related information providing server in addition to the partial video information. Medium. The related information specifies information related to broadcast information, includes address information necessary to access the information, acquires the address information by the related information acquisition procedure, and is specified by the address information. The computer-readable recording medium which recorded the program of Claim 17 or 18 which accesses an information provision server, acquires related information, and performs further the information access and browsing procedure displayed by the said display reproduction | regeneration procedure. The procedure for displaying the bookmark button is further executed, the partial broadcast information at the time when the viewer operates the bookmark button and bookmarks is stored in the memory, and the related information acquisition procedure is performed by the viewer. 21. The procedure according to any one of claims 17 to 20, wherein a procedure for accessing the related information providing server at the time of inputting an instruction and notifying the related information providing server of the partial broadcast information stored in the memory is executed. A computer-readable recording medium on which the program is recorded. A computer-readable recording medium recorded with a program for causing a computer to execute processing for providing related information related to broadcast information,
A procedure for managing each broadcast information in correspondence with broadcast information identification information that is information for identifying the broadcast information;
A procedure for managing the broadcast information identification information and related information corresponding to the broadcast information in association with each other;
A procedure for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching the broadcast information database for broadcast information corresponding to the partial broadcast information transmitted by the viewer device via the network;
Referring to the related information database, obtaining related information corresponding to the specified broadcast information identification information, and transmitting to the viewer device;
The partial broadcast information is broadcast information that is being viewed by a viewer at an arbitrary time point, broadcast information that is being reproduced and viewed, stored in a broadcast information storage device, or feature amount information obtained by converting these broadcast information. A computer-readable recording medium on which a program is recorded. In the related information database, in addition to the related information, a procedure for managing viewer information indicating the characteristics of a viewer that can be provided, and viewer apparatus information indicating characteristics of a terminal that is a target for providing related information;
23. The program according to claim 22, wherein after identifying the related information, the viewer information specific to the viewer apparatus or the related information is selected based on the viewer apparatus information, and a procedure for providing the viewer information is further executed. Computer-readable recording medium. A program for causing a computer to execute processing for acquiring related information related to broadcast information,
Broadcast reception procedure for receiving broadcast information;
A broadcast information demodulation decoding procedure for demodulating and decoding broadcast information received in the broadcast reception procedure;
Input procedures for viewers to input various instructions including related information acquisition instructions,
A network communication procedure for communicating with a related information providing server storing related information corresponding to each broadcast information via a predetermined network;
When a related information acquisition instruction is input by the input procedure, it is broadcast information output by the broadcast information demodulation / decoding procedure at the time when the instruction is input, or feature amount information obtained by converting the broadcast information Partial broadcast information is transmitted to the network using the network communication procedure, and then related information corresponding to the partial broadcast information transmitted from the related information providing server via the network is used for the network communication procedure. Related information acquisition procedure received,
A display reproduction procedure for displaying and reproducing broadcast information output by the broadcast information demodulation and decoding procedure and related information received by the related information acquisition procedure. Further executing a broadcast information storage procedure for storing the broadcast information output by the broadcast information demodulation and decoding procedure,
When the related information acquisition instruction is input by the input procedure while the viewer is reproducing and viewing the broadcast information stored by the broadcast information storage procedure by the related information acquisition procedure, when the instruction is input 25. The program according to claim 24, wherein broadcast information being reproduced / viewed or partial broadcast information which is characteristic amount information obtained by converting the broadcast information is transmitted to the network using the network communication procedure. 26. The program according to claim 24 or 25, further causing the computer to execute a procedure of transmitting viewer information or viewer device information to the related information providing server in addition to the partial video information. The related information specifies information related to broadcast information, includes address information necessary to access the information, acquires the address information by the related information acquisition procedure, and is designated by the address information 26. The program according to claim 24 or 25, further comprising executing an information access / browsing procedure for accessing a providing server, acquiring related information, and displaying the information by the display reproduction procedure. The procedure for displaying the bookmark button is further executed, the partial broadcast information at the time when the viewer operates the bookmark button and bookmarks is stored in the memory, and the related information acquisition procedure is performed by the viewer. 28. The process according to any one of claims 24 to 27, wherein a procedure for accessing the related information providing server at the time of inputting an instruction and notifying the related information providing server of the partial broadcast information stored in the memory is executed. Program. A program for causing a computer to execute processing for providing related information related to broadcast information,
A procedure for managing each broadcast information in correspondence with broadcast information identification information that is information for identifying the broadcast information;
A procedure for managing the broadcast information identification information and related information corresponding to the broadcast information in association with each other;
A procedure for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching the broadcast information database for broadcast information corresponding to the partial broadcast information transmitted by the viewer device via the network;
Referring to the related information database, obtaining related information corresponding to the specified broadcast information identification information, and transmitting to the viewer device;
The partial broadcast information is broadcast information that is being viewed by a viewer at an arbitrary time point, broadcast information that is being reproduced and viewed, stored in a broadcast information storage device, or feature amount information obtained by converting these broadcast information. program. In the related information database, in addition to the related information, a procedure for managing viewer information indicating the characteristics of a viewer that can be provided, and viewer apparatus information indicating characteristics of a terminal that is a target for providing related information;
30. The program according to claim 29, further comprising the step of selecting related information based on the viewer information unique to the viewer device or the viewer device information after specifying the related information, and providing the viewer to the viewer.

Images