JP3994682B2 - Broadcast information transmission / reception system - Google Patents

Broadcast information transmission / reception system Download PDF

Info

Publication number
JP3994682B2
JP3994682B2 JP2001115997A JP2001115997A JP3994682B2 JP 3994682 B2 JP3994682 B2 JP 3994682B2 JP 2001115997 A JP2001115997 A JP 2001115997A JP 2001115997 A JP2001115997 A JP 2001115997A JP 3994682 B2 JP3994682 B2 JP 3994682B2
Authority
JP
Japan
Prior art keywords
information
broadcast
viewer
related information
related
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2001115997A
Other languages
Japanese (ja)
Other versions
JP2002209204A (en
Inventor
佳伸 外村
健人 宮奥
清 田中
宏樹 重吉
明人 阿久津
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2000112805 priority Critical
Priority to JP2000-112805 priority
Priority to JP2000-298179 priority
Priority to JP2000299714 priority
Priority to JP2000-297846 priority
Priority to JP2000298179 priority
Priority to JP2000-299714 priority
Priority to JP2000297846 priority
Priority to JP2000-342032 priority
Priority to JP2000342032 priority
Priority to JP2001115997A priority patent/JP3994682B2/en
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Publication of JP2002209204A publication Critical patent/JP2002209204A/en
Application granted granted Critical
Publication of JP3994682B2 publication Critical patent/JP3994682B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a technique in which a viewer acquires information related to broadcast information or recorded information from a server or the like connected to a network.
[0002]
[Prior art]
Digital satellite broadcasting and data broadcasting have also begun, and they are highly expected as new mass media in addition to various broadcasting services. In the field of communications, many access systems such as ISDN, DSL, FTTL, IMT-2000, etc. have been established. Popularization is expected. The Internet is also showing great potential as a mass media. In the near future, digital broadcasting and broadband communication will be closely integrated, and it is expected that more diverse services will bloom with interactive as a keyword.
[0003]
The greatest benefit for viewers that interactive brings is the personalized enjoyment of personalized information (information that suits the person). Tools (terminals) for enjoying information are also becoming increasingly diverse and widespread that are suitable for the type and amount of information received, the purpose and environment of use, the ease of operation of information, etc. Yes.
[0004]
Against this background, the prior art and its problems in the above technical field will be described from the following three viewpoints.
(1) Information given unilaterally from one direction, such as a television or radio, does not feel annoying because it does not involve a strong positive operation for obtaining the information. There is a limit to the information that can be put there. There is no problem if viewers are satisfied with the information selected and produced by the information provider, but each viewer can provide information such as dissatisfaction with the amount of information from each preference, broadcast time, broadcast area, etc. If you feel dissatisfied with the method, you cannot solve the dissatisfaction with analog media such as analog TV and analog radio. Even if the broadcast media is digitized from analog and the information that can be physically put on it is increased, or even if the viewer is given pseudo-interactiveness by the information distribution by the carousel method, the dissatisfaction is essentially solved. It is not.
[0005]
Services that distribute information that could not be put on broadcast media and related information using the Internet have also been started, but because they are simply providing information through multiple media (multimedia), the usage scene of viewers In view of the user interface, the linkage and linkage between information distributed in different media (multimedia) is not solved from the viewpoint of the user interface.
[0006]
The inventions of JP-A-9-160852 and JP-A-2000-183835 provide an apparatus for easily obtaining music and video broadcast on radio and television from a network. This solves the problem related to the troublesomeness of obtaining broadcasted music and video after viewing. Additional information (related information) for identifying them together with music and video is placed on the media and distributed to the viewer, and when the music and video desired by the viewer are distributed, the request is input to the receiving device. The additional information is recorded. This is a mechanism for identifying and obtaining desired music or video via a network using the recorded additional information as a key.
[0007]
However, on the premise of the current wide variety of communication access systems and terminals, responding to a wide variety of services that provide related content that individual viewers want from their preferences, linked and linked to broadcast content, In principle, the content provider cannot provide the service in a fair manner.
[0008]
That is, the following problems are not solved by the conventional technology. It is not configured in a distribution device that can provide a wide variety of services. Distribution of related content in consideration of the receiving environment (terminal specifications, etc.) of the viewer is not possible. The status of the access system during distribution cannot be grasped. In addition, the conventional technology is configured such that a service can be received only when a request for a service to be provided (recording of related information necessary for receiving the service) is input when a song or video desired by the viewer is distributed. . Therefore, it is not possible to make reservations and notifications for services linked to and linked to broadcasting. When a viewer wants to receive a desired service without omission, the conventional apparatus configuration forces the viewer to constantly record related information.
(2) On the other hand, in digital broadcasting such as BS digital broadcasting and CS digital broadcasting, various related information is provided together with video and audio, and it is possible for the viewer to refer to the related information while viewing the video. Yes.
[0009]
However, in a television receiver that is generally used as a digital broadcast receiver, when browsing related information, the related information is displayed on a part of the video display unit, or the related information is displayed on the entire video display unit. Therefore, when browsing related information, it is necessary to reduce the size of the video, hide a part of the video, or temporarily stop viewing the video. In addition, when the amount of related information is large, it is difficult for the viewer to fully understand the content of the related information while watching the video, and when the viewer wants only the related information after the program ends. It is desirable to be able to watch slowly. In the conventional digital broadcast receiving apparatus, when browsing related information, the received related information is uniformly displayed on the screen, so that related information that is not of interest to the viewer is displayed. .
[0010]
In addition, the digital broadcast receiver automatically uses the related information and EPG (Electric Program Guide) information to automatically display the broadcast program and related information that the viewer is interested in while the viewer is not watching the TV broadcast. It has been studied to select and store them in the apparatus. At this time, it becomes a problem to acquire information indicating the viewer's interest. Conventionally, a method has been proposed in which interest information is acquired by directly inputting a keyword in which the viewer is interested, or the interest information is estimated from related information of a program viewed by the viewer.
[0011]
Here, a method of automatically selecting broadcast programs that are of interest to viewers is described in the following document, for example. [References]: Yuichi Yagawa, Hiromi Ukai, Tetsuo Tanaka, Masahiro Shibata, Maki Kinjo, “Examination of an agent that automatically organizes TV programs that suit individual tastes”, IEICE Technical Report, AI 98-55, PP. 9-16, December 1998.
[0012]
Further, a method for estimating the interest information from the related information of the program viewed by the viewer is described in Japanese Patent Application Laid-Open No. 11-134345 “Preference Information Selection Device”.
[0013]
However, it is not always easy for the viewer to consciously input keywords of interest. In addition, the method of estimating the interest information from the related information of the program leaves essentially the same problem as displaying the related information that is not of interest.
(3) As described above, in digital broadcasting, it is possible to multiplex and broadcast data signals as arbitrary related information to television broadcasting or radio broadcasting. Therefore, in a digital broadcast receiving apparatus or a terminal connected to the receiving apparatus, processing synchronized with broadcast content can be performed by using a data signal multiplexed in the broadcast. For example, it is possible to distribute related information regarding a broadcast television program or radio program simultaneously with the program.
[0014]
Similarly, in analog television broadcasting, an arbitrary data signal is multiplexed on a television video signal by a method defined by ARIB STD-B5 “standard television data broadcasting of transmission method using vertical blanking interval”. It is possible. In particular, a system called “Bit Cast” (reference: Nikkei Multimedia, No. 28, 1997.10, P.52-P.57) uses a data signal multiplexed with an analog TV video signal. Thus, functions such as related information presentation synchronized with broadcast contents are realized.
[0015]
In WWW (World Wide Web), content on a predetermined home page is sequentially updated in synchronization with broadcast content such as television and radio. A client connected to the Internet can enjoy information presentation and the like synchronized to some extent with broadcast content by accessing the predetermined home page.
[0016]
However, in order to perform processing synchronized with broadcast content using a data signal multiplexed in broadcasting, it is necessary for a terminal that performs the processing to acquire a data signal multiplexed in broadcasting. That is, there is a problem that the terminal itself must have a function of receiving a broadcast, or a function of acquiring a data signal that is connected to the broadcast receiving apparatus and multiplexed from the broadcast receiving apparatus.
[0017]
In addition, when a terminal acquires a data signal multiplexed in broadcasting via a network without having such a function, a delay time of the data signal in the network occurs from the event occurrence to the execution of the corresponding action. There is a problem.
[0018]
Further, when providing information related to video and audio to be broadcast, in a method of transmitting a URL or the like simultaneously with the video and audio, it is necessary to add the information such as URL to the broadcast information and broadcast it. For example, for broadcast information that is repeatedly broadcast such as CM, it is necessary to sequentially perform processing for adding information such as URL corresponding to each broadcast.
[0019]
Furthermore, even when the broadcast video / audio is stored and used, the above-described method can be stored unless information such as a URL broadcast simultaneously with the broadcast video / audio is stored by associating with some means. However, there is a problem that related information cannot be obtained during playback / viewing of video / audio.
[0020]
Similarly, in the method of acquiring related information using time and CH number as keys as in Japanese Patent Laid-Open No. 9-160852 “Information Providing Device”, when viewing broadcast information once stored, the viewing time is the broadcast time. Therefore, there is a problem that the related information cannot be acquired because it cannot be associated with the related information.
[0021]
Further, the conventional technique has a problem that it is impossible to grasp the switching of the image frame of the broadcast program video being viewed very accurately.
[0022]
As described above, in the related art, there is a problem that it is not easy for a viewer of broadcast information or recorded information to acquire information or content related to broadcast information or recorded information from a server or the like connected to the network. .
[Problems to be solved by the invention]
The present invention has been made in view of the above points, and a viewer of broadcast information or recorded information can easily acquire information or content related to broadcast information or recorded information from a server or the like connected to a network. The purpose is to be able to. More specifically, the present invention achieves the above object by achieving the following first to fifth objects.
[0023]
The first object of the present invention is to solve the problem of the prior art (1) above, and a variety of related information that could not be put on a broadcast medium that unilaterally provides information from one direction. Assuming a new communication access system and terminal, the content provider can provide a wide variety of services in a fair manner to individual viewers in a style according to the viewer's wishes, linked and linked to the broadcast content. It is another object of the present invention to provide an environment in which a service desired by a viewer can be received without omission, and an annoyance related to the troublesomeness of receiving a service for obtaining related content after viewing during viewing.
[0024]
The second object of the present invention is to solve the problem of the prior art (2) above, and information related to the subject that the viewer is interested in while viewing the video information is limited in time. To make it easy to browse without receiving broadcasts, to automatically select broadcast information that matches the dynamically changing interest information of the viewer, and to make it available to one viewer. It is possible to refer to related information and to enable automatic selection of detailed video information.
[0025]
The third to fifth objects of the present invention are intended to solve the problems of the prior art (3) above. More specifically, the third object of the present invention is to enable the viewer apparatus to broadcast. It is to provide a technique for quickly executing a process for an event synchronized with broadcast content of a predetermined channel to be broadcast without acquiring a multiplexed data signal. The fourth object of the present invention is that there is no need to perform special processing such as adding information necessary for providing related information to broadcast information, and broadcast information is temporarily stored and reproduced. It is also possible to provide a related information providing service regarding the broadcast information through the network even when viewing. Furthermore, a fifth object of the present invention is that a viewer apparatus that is independent of the broadcast receiving apparatus, that is, has no communication means such as a communication line for performing digital signal communication with the broadcast receiving apparatus, is being viewed by the user. The broadcast program content can be individually identified with an extremely short time resolution of 1/30 seconds (corresponding to one image frame unit of a television broadcast video) or more, and it is possible to provide a service that is accurately synchronized with the broadcast content It is to be.
[0026]
[Means for Solving the Problems]
In order to achieve the first object, the present invention can be configured as follows.
[0027]
The present invention is a method for a viewer apparatus to receive provision of the service in a system in which a viewer apparatus and a content providing server that provides a service related to video or audio are connected via a network, When the viewer apparatus requests service provision, the viewer apparatus transmits necessary service provision request information to the related information provision server to request information on services that can be provided related to video, and the related information provision server sends the service provision request information. Information on the service that can be provided is transmitted to the viewer device based on the information, the viewer device receives the information on the service that can be provided, and the viewer device provides the service selected from the services that can be provided Is requested from the content providing server, and service is provided from the content providing server.
[0028]
In the method, the viewer apparatus may further include a step of storing and holding viewer information, and the service provision request information may include the viewer information.
[0029]
In addition, the present invention is a system in which a viewer device for a viewer who views a broadcast and a content providing server that provides content related to the broadcast are connected via a network, Means for transmitting information necessary for requesting service provision to the content providing server in conjunction with or cooperating with the content and requesting information on a service that can be provided related to the broadcast content; and the content providing server Means for visualizing and displaying the information of the service that can be provided received from the server in a selectable form; and means for requesting the service from the content providing server by selecting a service from the information of the service displayed by visualization. Receiving and using a service provided by the content providing server in response to the service request The content providing server selects a service that can be provided based on the information of the viewer device in response to a request for information on the service that can be provided received from the viewer device; And a means for transmitting service information to the viewer apparatus, and a means for receiving a service request from the viewer apparatus and transmitting the service to the requesting viewer apparatus.
[0030]
In the system, the viewer apparatus further includes means for receiving event information, and the means for requesting service information in the viewer apparatus is automatically set at a timing preset by the viewer based on the event information. A request may be issued.
[0031]
In addition, when the content providing server receives a service request from the viewer device, the content providing server estimates or detects the state of the access system between the content providing server and the viewer device, and the estimated or detected access system And a means for converting and optimizing the content related to the service to be transmitted to the viewer device based on the state and the information of the viewer device.
[0032]
The present invention is also a viewer device for a viewer who watches a broadcast connected to a content providing server of a provider who provides content related to the broadcast via a network, and is linked or linked to the broadcast content. Then, information necessary for providing a service provision is transmitted to the content providing server, and information on a service that can be provided related to the broadcast content is automatically input by a viewer or at a preset timing. Requesting means, means for visualizing and displaying the information of the service that can be provided received from the content providing server in a selectable form, and selecting the service from the information of the service displayed by visualization Means for requesting a service from the content providing server; and the content providing server provides a request for the service. To be configured to and a means for utilizing receiving the service.
[0033]
In addition, the present invention is a content providing server of a provider that provides content related to broadcasting, which is connected to a viewer device of a viewer who views a broadcast via a network, received from the viewer device In response to a request for information on services that can be provided, means for selecting services that can be provided based on information on the viewer device; means for transmitting information on the services that can be provided to the viewer device; Means for estimating or detecting the status of the access system between the content providing server and the viewer device when receiving a service request from the viewer device, and the viewing based on the status of the access system estimated or detected Means for converting and optimizing content related to the service to be transmitted to the viewer device, and providing the service by transmitting the optimized content to the requesting viewer device Configured to include and.
[0034]
In order to achieve the object of the present invention, the present invention can be configured as follows.
[0035]
The present invention is a method for a viewer apparatus to acquire the content information in a system in which the viewer apparatus and a content providing server that provides content information related to video or audio are connected via a network. The viewer apparatus obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and is transmitted from the content providing server. Configure to obtain content information.
[0036]
In particular, in order to achieve the second object, in the above-mentioned configuration, the present invention provides the viewer device with related information broadcast together with video or related information recorded with video, and The related information is obtained by separating from at least one information resource identification information corresponding to each of a plurality of subjects included in the video, and subject attribute information describing the subject It can comprise so that it may contain.
[0037]
In order to achieve the second object, the present invention can be configured as follows.
[0038]
The present invention is a viewer apparatus that receives broadcast information including at least video information including video and related information related to the video information, and the related information includes a plurality of pieces of the related information included in the video information. Corresponding to each of the subjects, including at least one information resource identification information and subject attribute information describing the subject, wherein the viewer device includes a broadcast receiving unit that receives the broadcast information, a video display unit, A video display control unit, a first pointing unit, a subject related information display unit, a related information display control unit, a second pointing unit, a subject attribute information storage unit, a related information access unit, and related information A storage unit, wherein the video display control unit displays video information in the broadcast information received by the broadcast receiving unit on the video display unit, and a plurality of subjects displayed on the video display unit A subject pointed by the first pointing means, and the related information display control unit displays characters, symbols or figures representing the subject identified by the video display control unit in the subject related information display unit. And displaying information resource identification information corresponding to the subject represented by the character, symbol, or figure pointed by the second pointing means in the subject related information display unit, and displaying the information resource identification information as the related information The related information access unit accesses the information source connected to the related information storage unit or the communication network corresponding to the information resource identification information to obtain content information, and displays the related information display The control unit displays the content information obtained by the related information access unit in the subject related information table. Configured to display the part.
[0039]
The viewer apparatus further includes an interest information extraction unit, and the related information display control unit is information resource identification information corresponding to a subject represented by a character, symbol, or figure pointed by the second pointing means. Any one or more of the subject attribute information, the content information obtained from the information source, and the display time information related to the time when the content information is displayed on the subject-related information display unit. The interest information extraction unit refers to any or all of the information resource identification information, the subject attribute information, the content information, and the display time information, creates and holds the interest information, and Broadcast information received from the broadcast receiving unit at a time different from the time at which the broadcast information is received is determined based on the interest information. It may be selected to have.
[0040]
The viewer apparatus may further include a video storage unit, and the broadcast information selected by the interest information extraction unit may be stored in the video storage unit.
[0041]
In the viewer apparatus, the related information display control unit moves a character, a symbol, or a graphic representing the subject displayed on the subject related information display unit by the second pointing unit or another input unit. Or when there is an operation for moving or deleting a character, symbol, or figure representing the subject, operation information indicating the content of the operation is transmitted to the interest information extraction unit, and the interest information The extraction unit may update the interest information based on the operation information.
[0042]
Further, in the viewer apparatus, the related information is associated with each of a plurality of subjects included in the video information and includes subject coordinate values when displayed on the video display unit. The subject may be identified by the first pointing means pointing to a region including the coordinate value point.
[0043]
In order to achieve the third object of the present invention, the present invention can be configured as follows.
[0044]
In a system in which a viewer device and a content providing server that provides content information related to video or audio are connected via a network, the viewer device obtains the content information, the viewer device comprising: Obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and acquires the content information transmitted from the content providing server In this configuration, the system includes a related information providing server, and the related information providing server includes an event identifier indicating a valid event and an operation corresponding to the event identifier for each valid period designated in synchronization with the broadcast time of the video. Configure the specified action table, and the related information providing server will take action The viewer device receives an action table from the related information providing server, derives an event identifier from the event generated by the viewer device, and uses the received action table to operate corresponding to the event identifier The related information necessary for acquiring the content information is obtained.
[0045]
In addition, the present invention processes an event synchronized with broadcast content including a server that collects information related to broadcast content transmitted from a broadcast station or a broadcast information storage server, and a viewer device that communicates with the server via a network. The server includes an event identifier indicating a valid event and action content information indicating a process executed correspondingly for each valid period specified in synchronization with a broadcast time of the broadcast content. Action table configuring means for configuring an action table for designating and an action table providing means for transmitting the action table to the viewer apparatus, wherein the viewer apparatus derives an event identifier from the event that has occurred. Management means and the action table received from the server Referring only that lifetime, configured to have the action table managing means for deriving the action content information corresponding to the event identifier with reference to the table, and action execution means for executing said action contents information.
[0046]
In the system, the action table management unit of the viewer device transmits the event identifier derived by the event management unit to the server, and the server receives the event identifier received from the viewer device. And further comprising viewer device information management means for managing each viewer device, wherein the action table configuration means of the server is configured for each viewer device based on the event identifier managed for each viewer device. The action table may be configured as follows. As a result, different action contents appropriate for each client are executed for the same event.
[0047]
In the above system, the action table managing means of the viewer apparatus can refer to the action table corresponding to the next effective period while the effective period of the currently referred action table ends. In addition, an action table for the previous valid period may be requested to the server in advance. Thereby, it becomes possible to request when an action table is required for the convenience of the viewer apparatus (client), and it is possible to prevent useless distribution of the action table.
[0048]
Further, in the above system, the action table providing means of the server actively distributes the new action table to the plurality of viewer devices as soon as the action table forming means forms a new action table. Also good. Thereby, the viewer apparatus does not need to request | require an action table, and can simplify the procedure.
[0049]
The present invention can also be configured as follows.
[0050]
The present invention relates to an event synchronized with broadcast content used in a system including a server that collects information about broadcast content transmitted from a broadcast station or a broadcast information storage server, and a viewer apparatus that communicates with the server via a network. For each valid period specified in synchronization with the broadcast time of the broadcast content, and an action indicating a process executed corresponding to the event identifier. A first stage constituting an action table for specifying content information; a second stage in which the server transmits the action table to the viewer apparatus; and the viewer apparatus determines an event identifier from the event that has occurred. A third stage of deriving and the action table received by the viewer device from the server And a fourth stage of deriving action content information corresponding to the event identifier, and a fifth stage in which the viewer device executes the action content information. The viewer device includes the server The action table received from is referred to only during its validity period.
[0051]
In the above method, in the third step, the event identifier derived by the viewer device is transmitted to the server, and the server manages the event identifier received from the viewer device for each viewer device. The method further comprises a sixth step, wherein the server configures the action table for each viewer device based on the event identifier managed for each viewer device. May be.
[0052]
Further, in the above method, the viewer apparatus previously refers to the previous valid period so that the valid period of the currently referred action table ends and the action table corresponding to the next valid period can be referred to. The method may further include a step of requesting the server for the action table.
[0053]
In the above method, the server may include a step of actively distributing the new action table to the plurality of viewer devices as soon as the server forms a new action table in the first step.
[0054]
Further, the present invention is a server that collects information related to broadcast content transmitted from a broadcast station or a broadcast information storage server and processes an event synchronized with the broadcast content, and is specified in synchronization with the broadcast time of the broadcast content. Action table configuring means for configuring an action table for designating an event identifier indicating a valid event and action content information indicating processing executed corresponding to the event identifier for each valid period, and the action table to the viewer device. And an action table providing means for transmitting.
[0055]
The server further includes viewer device information management means for managing the event identifier received from the viewer device for each viewer device, wherein the action table configuration means is managed for each viewer device. The action table may be configured for each viewer apparatus based on the event identifier.
[0056]
In the server, the action table providing unit may actively distribute the new action table to the plurality of viewer devices as soon as the action table configuring unit configures a new action table. Good.
[0057]
Further, the present invention is a viewer device in a system having a server that collects information about broadcast content transmitted from a broadcast station or a broadcast information storage server, and a viewer device that communicates with the server via a network, For each effective period specified in synchronization with the broadcast time of the broadcast content, an action table specifying an event identifier indicating a valid event and action content information indicating processing executed correspondingly is received from the server. Means for deriving an event identifier from an event that has occurred, action table management means for referring to the action table only during its validity period and deriving action content information corresponding to the event identifier using the table And an action for executing the action content information And line unit, the event identifier configured to have a means for transmitting the document transfer requests.
[0058]
In the viewer apparatus, the action table management means may be configured so that the valid period of the currently referred action table ends and the previous valid period can be referred to so that the action table corresponding to the next valid period can be referred to. You may make it have a means to request | require the action table of a period from the said server.
[0059]
In order to achieve the fourth and fifth objects of the present invention, the present invention can be configured as follows.
[0060]
The present invention provides a viewer device for acquiring the related information in a system in which a viewer device and a related information providing server that provides related information that is information related to broadcast information are connected via a network. The viewer device transmits predetermined information extracted from the broadcast information to a related information providing server, and the related information providing server uses the predetermined information to extract related information related to the broadcast information. Acquire and transmit to the viewer device.
[0061]
In the above method, the related information providing server further stores viewer information indicating characteristics of a viewer that can be a target for providing the related information, and viewer apparatus information indicating characteristics of a terminal that is a target for providing the related information, The viewer device transmits viewer information unique to the viewer device or viewer device information to the related information providing server in addition to the predetermined information, and the related information providing server acquires the related information, The related information may be selected based on the viewer information unique to the viewer device or the viewer device information, and transmitted to the viewer device.
[0062]
In particular, in order to achieve the fourth object of the present invention, the present invention can be configured as follows.
[0063]
The present invention is a method for a viewer apparatus to acquire the content information in a system in which the viewer apparatus and a content providing server that provides content information related to video or audio are connected via a network. The viewer apparatus obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and is transmitted from the content providing server. In the configuration for acquiring content information, the system includes a related information providing server, records the video and the related information in a database of the related information providing server, and is obtained by converting the video or the video by the viewer apparatus. Video that is sent to the related information providing server and received by the related information providing server. Searches the database by the partial video information, the results obtained related information transmitted to the viewer apparatus is configured such that the viewer apparatus obtains related information necessary for obtaining the content information.
[0064]
In the above method, further, viewer information indicating the characteristics of a viewer who can be a target for providing the related information and viewer apparatus information indicating the characteristics of a terminal for which the related information is provided are recorded in the database of the related information, The viewer device transmits viewer information specific to the viewer device or viewer device information to the related information providing server in addition to the partial video information, and the related information providing server acquires the related information, The related information may be selected based on the viewer information unique to the viewer device or the viewer device information, and transmitted to the viewer device.
[0065]
The present invention also relates to a related information providing method for acquiring related information, which is information related to broadcast information, and providing the information to a viewer, storing the broadcast information in a broadcast information database, Information is stored in a related information database, and broadcast information corresponding to partial broadcast information, which is feature information obtained by converting broadcast information being viewed or viewed by the viewer, is searched from the broadcast information database. Further, by searching the related information database with the broadcast information, the related information of the broadcast information can be acquired and provided to the viewer.
[0066]
Further, the present invention acquires related information, which is information related to accumulated broadcast information, and stores the broadcast information in a broadcast information database in a related information providing method provided to a viewer. The related information is stored in the related information database, and the broadcast information stored in the broadcast information storage device being reproduced and viewed by the viewer or the partial broadcast information that is the feature amount information obtained by converting the broadcast information is stored. The corresponding broadcast information can be searched from the broadcast information database, and the related information database can be searched using the broadcast information, whereby the related information of the broadcast information can be acquired and provided to the viewer.
[0067]
In the above method, the partial broadcast information may be broadcast information viewed for a certain period including a point in time when a related information acquisition instruction by a viewer is input, or feature amount information obtained by converting the broadcast information. Good.
[0068]
In the above method, the broadcast information database manages each piece of broadcast information with broadcast information identification information that is information for identifying the broadcast information, and the related information database includes the broadcast identification information and the broadcast information. Corresponding related information is managed in correspondence, the broadcast information identification information of the broadcast information corresponding to the partial broadcast information is specified by searching the broadcast information database, and the broadcast information identification information is referred to the related information database It is also possible to obtain related information corresponding to and provide it to the viewer.
[0069]
In the above method, the related information database includes viewer information indicating characteristics of a viewer who can be provided in addition to the related information, and viewer apparatus information indicating characteristics of a terminal as a target for providing related information. May be managed and the related information may be specified, and then the related information may be selected based on the viewer information unique to the viewer or the viewer device information and provided to the viewer.
[0070]
The present invention also provides means for receiving broadcast information including video and audio and providing it to the viewer, and broadcast information being viewed by the viewer at the time when the instruction is input by the viewer's related information acquisition instruction or One or more units having means for transmitting partial broadcast information, which is characteristic amount information obtained by converting the broadcast information, via a predetermined network and acquiring related information transmitted via the network A viewer apparatus, a broadcast information database that is connected to the network and manages each piece of broadcast information in association with broadcast information identification information that is information for identifying the broadcast information, and stored in the broadcast information database Corresponding to the broadcast information identification information, the related information database managing the related information corresponding to the broadcast information, and the partial broadcast information transmitted by the viewer device Means for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching for broadcast information in the broadcast information database, and by referring to the related information database, the identified broadcast information identification information Can be configured as a system having a related information providing server including means for acquiring related information corresponding to the above and transmitting the information to the viewer apparatus.
[0071]
In addition, the viewer apparatus of the present invention provides broadcast receiving means for receiving broadcast information, broadcast information demodulating / decoding means for demodulating and decoding broadcast information received by the broadcast receiving means, and various instructions including related information acquisition instructions. An input means for a viewer to input, a network communication means for communicating with a related information providing server that stores related information corresponding to each broadcast information via a predetermined network, and more related to the input means When an information acquisition instruction is input, the broadcast information output from the broadcast information demodulation / decoding means at the time when the instruction is input, or the partial broadcast information that is the feature amount information obtained by converting the broadcast information is Corresponding to the partial broadcast information transmitted to the network via the network communication means and then transmitted from the related information providing server via the network Related information acquisition means for receiving continuous information via the network communication means; and display reproduction means for displaying and reproducing the broadcast information output from the broadcast information demodulation and decoding means and the related information received by the related information acquisition means. It can be configured to have.
[0072]
The viewer apparatus further includes broadcast information storage means for storing the broadcast information output from the broadcast information demodulation / decoding means, and the related information acquisition means has the viewer stored in the broadcast information storage means. When a related information acquisition instruction is input from the input means during reproduction / viewing of broadcast information, broadcast information being reproduced / viewed at the time the instruction is input or feature amount information obtained by converting the broadcast information The partial broadcast information may be transmitted to the network via the network communication means.
[0073]
Further, the viewer device further includes a bookmark button, the partial broadcast information when the viewer operates the bookmark button and bookmarks is stored in a memory, and the related information acquisition means is When the related information acquisition instruction is input, the related information providing server may be accessed to notify the related information providing server of the partial broadcast information stored in the memory.
[0074]
The related information providing server of the present invention is connected to a predetermined network, and manages each broadcast information in association with broadcast information identification information that is information for identifying the broadcast information, Corresponding to the broadcast information identification information stored in the broadcast information database, the related information database for managing the related information corresponding to the broadcast information, and the partial broadcast information transmitted from the viewer apparatus via the network. Means for identifying broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching for broadcast information in the broadcast information database; and referring to the related information database; Means for obtaining corresponding related information and transmitting it to the viewer device, and the partial broadcast information is stored at any time by the viewer; May be configured such that broadcast information or playing view, the characteristic amount information obtained by converting the broadcast information, or their broadcast information stored in the broadcast information storing apparatus being viewed in.
[0075]
In order to achieve the fifth object of the present invention, the present invention can be configured as follows.
[0076]
The present invention is a method for a viewer apparatus to acquire the content information in a system in which the viewer apparatus and a content providing server that provides content information related to video or audio are connected via a network. The viewer apparatus obtains related information necessary for acquiring the content information, transmits the related information to the content providing server, requests transmission of the content information, and is transmitted from the content providing server. In a configuration for acquiring content information, a broadcast station or a broadcast information storage server transmits a predetermined data signal superimposed on audio, a broadcast receiving device outputs broadcast audio from a speaker, and a viewer device outputs the broadcast audio. Sound is collected by a microphone and converted into an electrical signal, and the data signal superimposed on the electrical signal is sequentially and continuously extracted. Te, so as to obtain related information by using the data signal.
[0077]
Further, in the above method, the system includes a related information providing server, the viewer apparatus transmits the data signal to the related information providing server, and acquires the related information using the data signal received by the related information providing server. Then, the related information may be transmitted to the viewer apparatus so that the viewer apparatus obtains the related information.
[0078]
Further, in the above method, the related information providing server further stores viewer information indicating characteristics of a viewer who can be provided with the related information, and viewer apparatus information indicating characteristics of a terminal as a target for providing the related information. Then, the viewer device transmits viewer information unique to the viewer device or viewer device information to the related information providing server in addition to the data signal, and the related information providing server specifies the related information, The related information may be selected based on the viewer information unique to the viewer device or the viewer device information, and transmitted to the viewer device.
[0079]
In the present invention, the broadcast station or the broadcast information storage server side that transmits audio or audio and video has a channel identifier uniquely assigned to the audio for each broadcast channel and an image frame in the video. A data signal including a uniquely assigned image frame identifier or a voice frame identifier uniquely assigned to each voice frame in the voice is superimposed and transmitted. On the receiving side, the viewer apparatus receives the broadcast. Broadcast audio output from a speaker of the apparatus is collected by a microphone and converted into an electrical signal, and the data signal superimposed on the electrical signal is sequentially and continuously extracted from the data signal, and a channel identifier and Extract image frame identifier or audio frame identifier and correspond to these channel identifier and image frame identifier or audio frame identifier That the related information can be configured as a broadcast synchronization type service providing method and obtaining through a network.
[0080]
In the above method, the broadcast station or the broadcast information storage server side transmits the image frame identifier or the audio frame identifier as a time-series consecutive number, and the viewer apparatus receives the person from the sound output from the speaker of the broadcast receiving apparatus. When the data signal superimposed on the voice is sequentially and continuously extracted, when the data signal is correctly extracted from the sound and the image frame identifier or the sound frame identifier is confirmed, the image frame identifier or When an audio frame identifier is used as an image frame identifier or an audio frame identifier of an image that is currently reproduced in the broadcast receiving apparatus, and the data signal is not correctly extracted from the audio, and the image frame identifier or the audio frame identifier is not confirmed. The most recently confirmed image frame identifier or audio frame identifier value and the latest Based on the difference between the confirmed image frame identifier or the voice frame identifier is confirmed the time and the current time in, it may be used to generate an image frame identifier or the voice frame identifier.
[0081]
In the above method, the related information acquired from the network by the viewer apparatus is associated with the channel identifier and the image frame identifier or the audio frame identifier in the broadcast information database managed by the related information providing server connected to the network. The related information held in this way may be obtained via the related information providing server.
[0082]
In addition, the present invention provides a channel identifier uniquely assigned to each broadcast channel to the broadcast station or broadcast information storage server side that transmits audio or audio and video, and each image frame in the video. Means for superimposing and transmitting a data signal including an image frame identifier uniquely assigned to each voice frame or a voice frame identifier uniquely assigned to each voice frame in the voice; A microphone that collects broadcast sound output from a speaker of the broadcast receiving apparatus and converts it into an electrical signal; and the data signal superimposed on the electrical signal is sequentially and continuously extracted, and the data signal A data signal extracting means for extracting a channel identifier and an image frame identifier or an audio frame identifier from the channel identifier and an image frame It is possible to configure the related information corresponding to the identifier or the voice frame identifier as a broadcast synchronization type service providing system characterized in that a means to get through the network.
[0083]
The present invention is also a viewer device that receives audio transmitted from a broadcast station or a broadcast information storage server, or audio output from a broadcast receiving device that receives audio and video. A channel identifier uniquely assigned to a channel, an image frame identifier uniquely assigned to each image frame in the video, or an audio frame identifier uniquely assigned to each audio frame in audio The viewer device collects the broadcast sound output from the speaker of the broadcast receiving device and converts it into an electrical signal, and the data signal superimposed on the electrical signal. And a data signal for extracting a channel identifier and an image frame identifier or an audio frame identifier from the data signal, sequentially and continuously. Means out, extracted channel identifier and to the related information corresponding to the image frame identifier or the voice frame identifier may be constructed by providing a means to get through the network.
[0084]
In the viewer apparatus, the viewer apparatus transmits to the related information providing server connected to the network, viewer information or viewing unique to the viewer apparatus in addition to the channel identifier and the image frame identifier or the audio frame identifier. And the related information providing server selects the viewer information unique to the viewer device or the related information that matches the viewer device information, and the viewer device transmits the related information via the network. You may make it acquire.
[0085]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, first to fifth embodiments corresponding to the first to fifth objects will be described. In addition, according to each of the inventions according to the first to fifth embodiments, broadcast information or recorded information viewers can easily acquire information or contents related to the broadcast information or recorded information from a server or the like connected to the network. And the object of the present invention is achieved. Next, the outline of each embodiment will be described.
[0086]
In the first embodiment, a viewer device in which a broadcast receiving device for viewing a broadcast distributed from a broadcasting station and a device for obtaining related information related to the broadcast are integrated into the related information and the related information. Related information that provides corresponding content Requests a service from a content providing server to acquire related information. Also, the event information is acquired by the viewer device, and the viewer device requests a service based on the event information.
[0087]
In the second embodiment, broadcast information including information (URL or the like) corresponding to the related information provided by the related information content providing server is sent from the broadcast station to the viewer apparatus. The information is added for each frame on a subject basis, and related information is acquired by pointing a subject that the viewer is interested in. In addition, based on the viewer's pointing, interest information is acquired, and content that matches the viewer's interest is automatically acquired. As a result, as in the first embodiment, information related to broadcast information and the like can be easily acquired.
[0088]
Regarding the third to fifth embodiments, the basic configuration is the same as that of the first embodiment, and it is intended to make it easy to obtain information related to broadcast information and the like. There is a difference in the configuration for acquiring related information.
[0089]
That is, in the third embodiment, the related information providing server provides the viewer device with an action table related to the broadcast content, and the viewer viewing the broadcast generates an event shown in the action table. Thus, an action corresponding to the event is executed, and related information is acquired.
[0090]
In the fourth embodiment, the viewer device transmits partial broadcast information to the related information providing server, and the related information providing server transmits related information related to broadcasting to the viewer device based on the partial broadcast information.
[0091]
In the fifth embodiment, a frame ID or the like is superimposed on the audio in the broadcast, the viewer device extracts the frame ID or the like, and requests related information from the related information content providing server using the frame ID or the like. To do.
[0092]
In each of the above-described embodiments, the viewer apparatus can acquire related information related to viewer information such as a viewer profile and terminal information. Further, in each embodiment, not only the related information is acquired while receiving broadcast information from the broadcast station, but also, for example, as shown in FIG. While receiving broadcast information via a network, the viewer apparatus can acquire related information related to the broadcast information.
[0093]
Hereinafter, each embodiment will be described in detail.
[0094]
[First Embodiment]
Hereinafter, the first embodiment corresponding to the first object will be described in detail.
[0095]
FIG. 1 is a diagram showing a basic configuration example of the first embodiment of the present invention. In the figure, reference numeral 1001 denotes a viewer apparatus for a viewer who views a broadcast, 1002 a provider-related information providing server for providing information related to the broadcast and contents corresponding to the information, and 1003 unilaterally from one direction. A broadcasting station 1004 that transmits broadcast contents represents an event information providing server that provides event information.
[0096]
When the viewer is watching a broadcast from the broadcasting station 1003, the available service request unit 1011 of the viewer device 1001 requests the related information content providing server 1002 to provide a service according to an instruction from the viewer. At this time, necessary viewer information, terminal information, or the ID of the viewer device 1001 is transmitted to request information on a service that can be provided related to the broadcast content.
[0097]
The available service selection unit 1021 of the related information content providing server 1002 selects a service that can be provided based on the information of the viewer apparatus 1001 in response to a request for information on the service that can be provided received from the viewer apparatus 1001. . Provideable service information transmission means 1022 transmits information on the selectable services that can be provided to the viewer apparatus 1001.
[0098]
The provideable service information visualization display unit 1012 of the viewer apparatus 1001 displays the information of the available service received from the related information content providing server 1002 as an icon, and the service selection / request unit 1013 has one of the icons pointing. When selected by the device, the related information content providing server 1002 is requested for the service indicated by the icon.
[0099]
When the service request receiving unit 1023 of the related information content providing server 1002 receives the service request, the service request receiving unit 1023 activates the access system state detecting unit 1024. The access system state detection unit 1024 sends a predetermined amount of information packets from the related information content providing server 1002 to the viewer apparatus 1001 and measures the time taken to return from the viewer apparatus 1001 to thereby determine the related information content. The state of the access system between the providing server 1002 and the viewer apparatus 1001 is estimated.
[0100]
The service content optimization unit 1025 converts and optimizes the screen size, resolution, etc. of the content related to the service to be transmitted to the viewer apparatus 1001 based on the information of the viewer apparatus 1001 and the state of the access system. The service providing unit 1026 sends the optimized content to the viewer apparatus 1001 and provides the requested service.
[0101]
The service using unit 1014 of the viewer apparatus 1001 receives the content of the service provided by the related information content providing server 1002 and accumulates, displays, and outputs the content, thereby using the requested service.
[0102]
FIG. 2 is a block diagram of a system for realizing the functions of the present invention shown in FIG. The viewer apparatus 1001 and the related information content providing server 1002 are connected via a network 1005. The viewer apparatus 1001 includes an input unit 1110, a display unit 1120, a control unit 1130, a processing unit 1140, a sensor unit 1150, an accumulation / management unit 1160, and a communication unit 1170. The related information content providing server 1002 includes an input unit 1210, a display unit 1220, a control unit 1230, a processing unit 1240, a storage / management unit 1250, and a communication unit 1260.
[0103]
FIG. 3 is a diagram illustrating a configuration example of the viewer apparatus 1001. The input unit 1110 of the viewer apparatus 1001 includes operation input means 1111, audio input means 1112, image / video input means 1113, icon operation input means 1114, setting operation input means 1115, and content operation means 1116. The display unit 1120 includes reception information visualization means 1121, service information display means 1122, event information display means 1123, setting screen display means 1124, and content display means 1125.
[0104]
The processing unit 1140 includes an audio information recognition unit 1141, an image / video recognition unit 1142, a distribution event information condition match determination unit 1143, and an icon operation unit 1144. The storage / management unit 1160 includes viewer information storage / management means 1161 and terminal information storage / management means 1162. The sensor unit 1150 includes user environment sensing means 1151. The communication unit 1170 includes an information transmission unit 1171, an information reception unit 1172, and an event information reception unit 1173. The viewer apparatus 1001 has a memory unit 1180, and the memory unit 1180 is provided with information temporary storage means 1181.
[0105]
FIG. 4 shows a configuration example of the related information content providing server 1002. The input unit 1210 of the related information content providing server 1002 includes an information input unit 1211, and the display unit 1220 includes an information display unit 1221. The processing unit 1240 includes an available service selection unit 1241, an inter-content link unit 1242, a content conversion unit 1243, and an access system state detection unit 1244. The storage / management unit 1250 includes viewer information storage / management means 1251, terminal information storage / management means 1252, viewer environment information storage / management means 1253, content event information storage / management means 1254, broadcast information storage / management means 1255. , Content storage / management means 1256. The communication unit 1260 includes an information receiving unit 1261, a broadcast information receiving unit 1262, and an information transmitting unit 1263. The related information content providing server 1002 has a memory unit 1270, and the memory unit 1270 is provided with information temporary storage means 1271.
[0106]
FIG. 5 shows a flow of information between the viewer apparatus 1001 and the related information content providing server 1002. Hereinafter, the operation of the apparatus shown in FIGS. 2 to 4 will be described in detail with reference to FIG. Broadcast information such as program information is sent from the broadcaster to the related information content providing server 1002 in advance, and event information is sent from the event information provider to the viewer apparatus 1001 in advance or during broadcasting.
(1) Service provision request input
First, in the viewer apparatus 1001, when a viewer is watching broadcast content distributed in one direction and wants to receive a service related to related content related to the broadcast content, the request is input to the input unit. Input at 1110. As means for inputting the viewer's request, there are operation input means 1111 using buttons, voice input means 1112 using a microphone, etc., and image / video input means 1113 such as a gesture photographed by a camera or the like.
[0107]
Information (on / off information) input by the operation input unit 1111 is stored in the memory unit 1180 via the control unit 1130. The audio information input by the audio input unit 1112 and the image / video information input by the image / video input unit 1113 are transmitted to the audio information recognition unit 1141 of the processing unit 1140 via the control unit 1130, respectively. It is sent to the recognition means 1142. Thus, it is recognized that the viewer has input the request, and the result (on / off information) is stored in the memory unit 1180 via the control unit 1130.
(2) Service provision request information
When the request input information is stored in the memory unit 1180, the control unit 1130 stores / manages the viewer information (viewer profile) stored and managed by the viewer information storage / management unit 1161 of the storage / management unit 1160. The management unit 1160 is requested and the acquired viewer information is stored in the memory unit 1180. Similarly, terminal information (manufacturer name, model number, specification, etc.) stored and managed by the terminal information storage / management unit 1162 of the storage / management unit 1160 is requested to the storage / management unit 1160, and the acquired terminal information is stored in the memory. Stored in the unit 1180.
[0108]
The control unit 1130 requests the viewer unit 1150 for the viewer environment information sensed by the user environment sensing unit 1151 of the sensor unit 1150, and stores the acquired viewer environment information in the memory unit 1180.
[0109]
The above viewer information is information about the viewer, for example, name, gender, age, occupation, address, postal code, family structure, housing information (apartment, detached house, etc.), hobby, and information of interest. Genre (politics, economy, news, computer, books, sports, travel, etc.), annual income, information on whether or not you are a member of various services, membership number or credit card ID, possession of various qualifications (driving license, etc.) Information on presence / absence, body shape (weight, height, clothing size, etc.), information on ability (sight, hearing, etc.), etc. are included.
[0110]
The terminal information is the resolution of the display device of the viewer device, the number of displayable colors, the performance of the WWW information browsing means (whether the Java function can be used, the presence / absence of the video / audio content playback function, the encoded format information that can be played back by the video / audio content, Etc.).
[0111]
The viewer environment information is information representing the environmental state and the viewer state when the viewer is viewing the broadcast content distributed in one direction. What is the environmental state information when viewing the viewer environment information? , Where you are viewing (location information obtained by GPS [Global Positioning System], etc.), when you are viewing (time information obtained by in-device timer, GPS, etc.), what you are viewing (TV operation remote control Information on broadcast channels and programs obtained by monitoring infrared communication such as
[0112]
Information indicating the viewer state is information on the viewer's viewing posture (sitting or standing, etc.) and mental state at the time of viewing (whether it is pounding, cool, fun, sad, etc.) is there. The viewing posture can be determined from the height information from the floor of the terminal. The mental state can be determined from the heart rate, the state of sweating, and the movement information. Height information, heart rate, state of sweating, movement information, and the like are information that can be sensed by a sensor. It is assumed that not all information regarding the viewer information, the terminal information, and the viewer environment information need be collected.
[0113]
Regarding viewer information, when the information has already been sent to the related information content providing server 1002 and stored and managed by the viewer information storage / management means 1251 of the storage / management unit 1250 of the related information content providing server 1002 The related information content providing server 1002 may be information that can specify viewer information. This information is an ID (identifier) or the like that is registered in advance in the related information content providing server 1002 and paid out from the related information content providing server 1002.
[0114]
That is, the viewer device information when the viewer device requests a service that can be provided may be registered in the related information content providing server 1002 in advance, and only the viewer device ID may be sent. The information may be sent every time it is requested.
[0115]
Viewer information, terminal information, and viewer environment information stored in the memory unit 1180 via the control unit 1130 are transmitted to the related information content providing server 1002 by the information transmitting unit 1171 of the communication unit 1170 as service provision request information. . The control unit 1130 sends information that is transmitted simultaneously with the transmission to the display unit 1120 and displays the information by means of visualizing the information, thereby indicating a reaction to the input operation (action) of the viewer.
(3) Selection of available services
The related information content providing server 1002 receives the viewer information, terminal information, and viewer environment information transmitted from the viewer device 1001 by the information receiving unit 1261 of the communication unit 1260, and stores the information in the memory unit 1270 via the control unit 1230. At the same time, the viewer information is stored and managed by the viewer information storage / management means 1251 of the storage / management unit 1250. Similarly, terminal information is stored and managed by the terminal information storage / management unit 1252 and viewer environment information is stored and managed by the viewer environment information storage / management unit 1253, respectively.
[0116]
The control unit 1230 issues a request to the accumulation / management unit 1250 and stores the event information managed by the content event information accumulation / management unit 1254 in the memory unit 1270. Similarly, the broadcast information managed by the broadcast information accumulation / management means 1255 is stored in the memory unit 1270. The related content of the broadcast content (at least one of video, audio, and data) distributed in one direction is stored and managed by the content storage / management means 1256.
[0117]
The event information includes information for identifying individual related content (content ID and the like), service type information related to the related content, link information with broadcast content, content security information, and the like. Broadcast information is content broadcast schedule information and event information related to broadcast content. As a method of acquiring this information, there are a method of directly receiving information provided by a broadcaster and a method of extracting from broadcast content when it is embedded in the broadcast content.
[0118]
When broadcast information is embedded in broadcast content (at least one of video, audio, and data), the broadcast information is received by the broadcast information receiving means 1262 and sent to the storage / management unit 1250 via the control unit 1230 to store the broadcast information. It is managed live by the management means 1255. When broadcast information is not embedded in broadcast content (at least one of video, audio, and data), the contents of the broadcast are linked to related content stored and managed by the storage / management unit 1250. Therefore, broadcast content (at least one of video, audio, and data) itself is received by the broadcast information receiving unit 1262 and sent to the processing unit 1240 via the control unit 1230.
[0119]
The processing unit 1240 links the broadcast content and related content automatically or semi-automatically by the inter-content link unit 1242, calculates information corresponding to the broadcast information, and sends it to the storage / management unit 1250 via the control unit 1230. send. Thus, the broadcast information is stored and managed by the management unit 1255.
[0120]
The inter-content link means 1242 uses a method of performing stepwise from a link using a physical quantity distance to a link using a semantic quantity distance using an image / video recognition technique and a voice recognition technique. The viewer information, terminal information, viewer environment information, content event information, and broadcast information stored in the memory unit 1270 are transferred to the processing unit 1240. Based on the transferred information, the available service selection unit 1241 of the processing unit 1240 selects an available service adapted to the viewer.
[0121]
FIG. 6 is a conceptual diagram showing the relationship between event information, broadcast information, and services. For example, content A is selected from services A, D, F, and I according to viewer information, terminal information, and viewer environment information. , C, and F are selected. Services that can be provided may differ depending on the broadcast time even for the same content.
[0122]
How the service and the related content are selected according to the received viewer information, terminal information, and viewer environment information will be described in accordance with the procedure. FIG. 7 shows the procedure. When viewer information, terminal information, and viewer environment information are input, first, in step S1, the broadcast content (at least one of video, audio, and data) is transmitted with broadcast time and broadcast station information included in the viewer environment information. The related content that is related is searched based on the broadcast information. When the related content is not searched, information indicating that there is no related content or service that can be provided is returned, and the selection process ends.
[0123]
When the related content is searched, the process proceeds to step S2 to determine whether the content can be provided to the viewer based on the viewer information and the viewer environment information. In this determination, for example, when the viewer is a minor or is limited to a region, it is determined whether or not the retrieved related content can be provided by checking whether there is an age limitation rule. Further, when the viewer is in a place such as a kitchen and desires to provide related content, it is determined whether the searched related content has restrictions or recommendations according to the location of the viewer. When it is determined that there is no content that can be provided, information indicating that there is no related content or service that can be provided is returned, and the selection process ends.
[0124]
If there is related content determined to be content that can be provided, the process proceeds to step S3, and a service linked to the related content is searched based on the content event information. If the service is not searched, information indicating that there is no related content or service that can be provided is returned, and the selection process ends.
[0125]
When the service is searched, the process proceeds to step S4, and it is determined whether the service can be provided based on the terminal information. This is because some services cannot be received depending on the specifications of the terminal. If it is determined that the service can be provided, the related content and information about the service are returned, and the selection process ends.
(4) Available service information
Information related to the selected related content and service is stored in the memory unit 1270 via the control unit 1230. The information related to the related content and service is information such as the related content, the name of the service, the location where the related content exists, the location where the tool necessary for the service exists, the expiration date, and an icon representing the related content and the service. The information stored in the memory unit 1270 is transmitted to the viewer apparatus 1001 by the information transmission unit 1263 of the communication unit 1260 as service information that can be provided.
(5) Display of available services
In the viewer apparatus 1001, information transmitted from the related information content providing server 1002 is stored in the memory unit 1180 via the control unit 1130 and is sent to the display unit 1120. The sent information is visualized by the service information display means 1122. An example of this display is shown in FIG. In FIG. 8, 1050 is a program object, 1051 is a program icon image, 1052 is a service icon image, 1053 is a service object, 1054 is an application icon, 1055 is a condition setting screen for notification settings, etc. 1056 is a trash can icon. The application icon 1054 and the condition setting screen 1055 will be described later.
[0126]
The sent icon information includes information related to broadcast contents such as the program object 1050 and information related to services such as the service object 1053. These are respectively displayed as image icons of a predetermined size (program icon image 1051 and service icon image 1052). The program icon has a structure in which a child has a service icon, and the service icon has a function of starting a service tool based on information other than icon information. Services include, for example, content purchase, content viewing, content processing, and the like, and the service tool is an application program that executes these.
[0127]
The service tool is activated by selecting the service icon, and the viewer is provided with a desired service. What is represented as an image on the service icon is the content of the service together with the contents of the related content. It is expressed so that the viewer can understand what kind of content can be received with what service at a glance. Further, since the icon itself is managed by the memory unit 1180 as an object of one unit, the information input by the icon operation input unit 1114 of the input unit 1110 is sent to the control unit 1130 and the icon operation of the processing unit 1140 is performed. By means 1144, it is possible to move on the screen of the display to a position desired by the viewer, and to delete it (moving to the trash can 1056).
[0128]
Changing the icon position is changing an icon display position parameter sent to the display unit 1120, and deleting the icon is deleting target object data in the memory unit 1180. It is also possible to hide the service icon as required by the viewer. Naturally, it is also possible to search for an icon by giving a key using information held by the icon object as an index. For example, it is possible to search by program name or by service name.
[0129]
In the above explanation, when a viewer is watching broadcast content distributed in one direction and wants to receive a service related to related content related to the broadcast content, the viewer makes positive the request. The example in the case of inputting to the apparatus has been described.
[0130]
Even if the viewer does not positively input the request to the apparatus, the request can be automatically issued by the application at a timing preset by the viewer. Next, an example will be described. That is, when viewing broadcast content distributed in one direction, a service related to related content related to the content being broadcast is set in the device in advance, and it is time to reserve the service or receive the service. The procedure for realizing the notification function will be described.
[0131]
First, in the viewer apparatus 1001, an application having a function for displaying event information of broadcast content, a service reservation, and a function for notifying the viewer when it is time to receive the service is operated. This application may be activated when the viewer wants to make a reservation or the like in advance, or the viewer apparatus 1001 may be automatically activated in accordance with a broadcast channel. This application is transmitted from the related information content providing server 1002 to the viewer apparatus 1001, and the viewer apparatus 1001 receives and starts it.
[0132]
When this application operates in the viewer apparatus 1001, the application icon 1054 shown in FIG. 8 is displayed on the screen to notify the viewer that the application is operating. The application icon 1054 has a function for visualizing event information of the received broadcast content and displaying it in the icon, and a function for calling a condition setting screen 1055 such as a reservation screen or a notification setting screen.
[0133]
FIG. 9 shows an example of a notification setting screen that is one of the condition setting screens 1055. By clicking the “notification setting” button in the application icon 1054, the condition setting screen 1055 of FIG. 9 can be displayed. This screen is a screen for setting notification to the viewer when the event information matches the set condition during broadcast viewing.
[0134]
As a notification method to the viewer when the notification timing comes, it is possible to select blinking or sound of the display screen. It is also possible to set the activation so that the video is automatically displayed. The example in FIG. 9 is a screen for setting notification regarding the baseball broadcast. For example, this screen is used to notify the viewer when a score is entered, when the score is three times, or when the batter has a batting order, etc. Can be set in advance.
[0135]
In the reservation setting screen, as with the notification setting screen, the timing for issuing a request is set, such as when a certain reserved time is reached, or when a specific talent appears on the screen, and the set timing The service provision request can be automatically issued.
[0136]
The application displays the event information of the broadcast content distributed from the event information provider on the application icon 1054 on the display unit 1120, and is automatically viewed at the timing set on the condition setting screen such as the reservation setting screen or the notification setting screen. The user's request to the device. In the case of a reservation, when the set timing is reached, a service provision request is issued without confirming to the viewer. In the case of notification setting, the viewer sets the timing set by flashing icons or sounds. Inform the viewer according to the prior designation and issue a service provision request.
[0137]
Next, a series of procedures such as reservation and notification setting will be described in detail. Assume that event information of broadcast content is distributed from an event information provider. The event information is received by the event information receiving unit 1173 of the communication unit 1170 and is sequentially stored in the memory unit 1180 in the order of being sent via the control unit 1130. At the same time, the information is sent to the processing unit 1140 and the display unit 1120, and the event information display means 1123 displays the event information of the broadcast content as an icon (application icon 1054). As a function of this icon, there is a function that can set a service condition desired by the viewer as described above.
[0138]
Display of the setting screen is performed by the setting screen display unit 1124 of the display unit 1120 based on the input request sent to the control unit 1130 by inputting a display request using the setting operation input unit 1115 of the input unit 1110. In the condition setting input, setting information is input by the setting operation input unit 1115 of the input unit 1110 and stored in the memory unit 1180 via the control unit 1130.
[0139]
Thereafter, the condition stored in the memory unit 1180 is sent to the processing unit 1140, and the distribution event information condition match determination unit 1143 matches the condition with the distributed event information. The distribution event information condition match determination unit 1143 calculates a semantic distance between the condition and the event information, sets the similarity as a similarity, and determines that the condition matches a value closer than a predetermined threshold value. If it is determined that the conditions match, the control unit 1130 is notified of the matching. The coincidence information is stored in the memory unit 1180 via the control unit 1130, and the flow thereafter is viewing the broadcast content distributed in one direction and receiving a service related to the related content related to the broadcasted content. When a request is made, the request is input positively, and when the request input information is stored in the memory unit 1180, the flow is the same as the subsequent flow.
[0140]
Here, transition of information displayed on the display unit 1120 regarding channeling when receiving the broadcast content of the viewer and each operation when issuing a service request will be described.
[0141]
When viewing a certain broadcast content and issuing a service request, the icon shown in FIG. 8 is displayed. When a service request is issued while changing the channel and viewing different broadcast content, the service icon related to the previous broadcast content is not displayed, and only the program icon is displayed. Subsequently, information newly transmitted from the related information content providing server 1002 is received, and a new program icon and service icon are displayed. Subsequently, when the channel is changed to the broadcast content that was previously viewed and a service request is issued, the service icon that has been hidden is displayed, and the newly requested service icon is additionally displayed.
(6) Service selection, (7) Service request
Next, a procedure for selecting a service icon displayed on the display unit 1120 and receiving service provision will be described. The service icon selection input is performed by the icon operation input unit 1114 of the input unit 1110 of the viewer apparatus 1001. Based on this selection input information, the service information that can be provided corresponding to the selected icon stored in the memory unit 1180 via the control unit 1130 (the location of the related content, the location of the tool required for the service, the expiration date) And the like are transmitted to the related information content providing server 1002 by the information transmitting unit 1171 of the communication unit 1170.
(8) Service content optimization
In the related information content providing server 1002, information on the service and content transmitted from the viewer apparatus 1001 is received by the information receiving unit 1261 of the communication unit 1260 and stored in the memory unit 1270 via the control unit 1230. The information receiving unit 1261 determines which viewer device 1001 has received the transmission information, and sends the determined viewer device information together with the previous information to the control unit 1230.
[0142]
When the information regarding the service and the content and the viewer apparatus information are stored in the memory unit 1270 via the control unit 1230, the control unit 1230 detects the access system state by the access system state detection unit 1244 in the processing unit 1240. The access system state detected here is a network state, for example, a communication speed. The communication speed changes dynamically according to the degree of network congestion (the amount of data flowing). The access system state detection unit 1244 sends a predetermined amount of information packets to the viewer apparatus 1001 based on the viewer apparatus information, and estimates the state of the access system based on the time it takes to return from the viewer apparatus 1001. When receiving this information packet, the communication unit 1170 of the viewer apparatus 1001 directly transfers the information packet from the information receiving unit 1172 to the information transmitting unit 1171 and sends it back to the related information content providing server 1002 that transmitted the information packet. I do. The estimated access state information is stored in the memory unit 1270 via the control unit 1230.
[0143]
Based on the information related to the service and content stored in the memory unit 1270 via the control unit 1230, the related content and service tools stored and managed by the content storage / management unit 1256 of the storage / management unit 1250 are searched, Related content and service tools are stored in the memory unit 1270. At the same time, the terminal information managed by the storage / management unit 1250 is also retrieved based on the viewer device information and stored in the memory unit 1270 via the control unit 1230. The related content, access status information, and terminal information stored in the memory unit 1270 are transferred to the processing unit 1240.
[0144]
The content conversion means 1243 converts the related content into the optimum content based on the access status information and terminal information (terminal specifications). This conversion is performed in the following cases.
[0145]
1) When the related content is created for a high-spec terminal and a high-rich access state, when the terminal spec and the access state do not match, the content is converted to the optimum content.
[0146]
2) Also, even when one content is used for a plurality of services, it is converted to the optimum content according to the service.
[0147]
The content conversion means 1243 in the case of 1) reduces the amount of data. We perform everything from reducing the amount of physical data using data compression technology to reducing the amount of data considering the meaning of summaries. Text information is summarized by semantic level using morphological analysis, dictionary, and corpus. The compression rate of images and videos such as MPEG1 and MPEG2 is changed, and video that is object-encoded with MPEG4 is selectively encoded on an object basis. The video described in MPEG7 summarizes the semantic level by processing the text description. For content with hyperlinks, etc., a weight based on the viewer profile is given to the information hanging on the link, and the link information is selectively reduced according to the weight.
[0148]
In the case of the above 2), the content conversion means 1243 performs translation into a language desired by the viewer. Conversion processing between expression media such as conversion from image to text, conversion from video to image, conversion from audio to text, conversion from image to audio, conversion from video to audio, etc. is also performed.
(9) Service provision
The content optimally converted by the content conversion unit 1243 is stored in the memory unit 1270, and is transmitted to the viewer apparatus 1001 by the information transmission unit 1263 of the communication unit 1260 together with the already stored service tool. In the viewer apparatus 1001, the service tool and the related content transmitted from the related information content providing server 1002 are stored in the memory unit 1180. The service tool uses the content operation input unit 1116 of the input unit 1110 and the content display unit 1125 of the display unit 1120 to provide a service related to related content on the viewer apparatus 1001. The related content purchase service or the like is performed by transmitting the viewer's transaction related to purchase to the transaction processing center (not shown) by the information transmission unit 1171 of the communication unit 1170.
(effect)
As described above, according to the present embodiment, on the premise of various communication access systems and terminals, individual viewers can interact with and cooperate with broadcast content distributed in one direction from their respective preferences. It will be possible to respond to a wide variety of services that provide the desired related content, and to provide the services fairly. In addition, it is possible to provide an environment in which a viewer can receive a desired service without catching it, and an environment that solves a problem related to annoyance when receiving a service for obtaining related content during viewing after viewing. .
[0149]
For this reason, viewers can receive and receive a wide variety of services with the most suitable content for their own terminals, linked to and linked to broadcast content distributed in one direction, and without being caught. There is a merit that there is no trouble when receiving a service for obtaining related contents. For content providers, there is a merit that individual viewers can respond to a wide variety of services that provide related content that each viewer desires according to their preferences, linked and linked to broadcast content distributed in one direction. .
[0150]
[Second Embodiment]
Next, a second embodiment will be described using Example 2-1 to Example 2-4. In the second embodiment, when a pointing operation is performed on a subject in which the viewer is interested in the video information, the pointing operation is performed based on information added in relation to the subject. It is possible for viewers to obtain related information related to the subject that has been dismissed, and to accumulate information on the subject that the viewer is interested in, and to receive broadcasts based on this accumulated information. Select information and store selected broadcast information.
[0151]
[Example 2-1]
FIG. 10 is a system configuration diagram showing Example 2-1 of the viewer apparatus according to the second embodiment of the present invention. In FIG. 10, 2010 is broadcast information including video information 2011 and related information 2012 added thereto. The video information 2011 includes at least a video and corresponds to a video program in a normal meaning including audio in addition to the video.
[0152]
In digital broadcasting, additional information related to video can be broadcast as program arrangement information in a video broadcasting channel. Alternatively, in a data channel that broadcasts only data such as text and still images, it is possible to broadcast related information of video broadcast on other broadcast channels. As additional information, for example, the title and genre of the program in the video, the broadcast date and time, and the like are considered.
[0153]
In the present invention, the additional information includes at least information on the subject as a display unit appearing in the video information 2011, and the additional information on the subject (hereinafter referred to as related information) describes at least the subject. It includes subject attribute information, subject coordinate values, and URI (Uniform Resource Identifier) information defined by at least one RFC 2396 as address identification information of related information corresponding to the subject. In this case, the URI includes the IP address and URL of the information providing apparatus connected to the communication network 2003.
[0154]
The subject coordinate value is a coordinate value that represents a region where the subject exists on the display screen. The subject appears or leaves with the time, and moves within the screen while it appears. For this reason, the subject coordinate values must be defined for each frame of the video information 2011 or in units of time.
[0155]
The related information 2012 is defined for each of one or more subjects. FIG. 11 shows an example of related information in the present invention. The related information 2012 includes a frame number 2121, subject coordinate values 2122, subject attribute information 2123, and URI information 2124. In the related information 2012 shown in FIG. 11, when the frame number 2121 is N, subjects whose subject attribute information 2123 is OB-A, OB-B, etc. have subject coordinate values 2122 (XA, YA), ( XB, YB) and the like, and URI information 2124 such as URI-A and URI-B is defined correspondingly. Such information is also added to frames with frame numbers other than N, and the subject defined by the frame is different, and different URIs can be defined even for the same subject. A plurality of URIs may be defined for one subject.
[0156]
The configuration of broadcast information including the related information and video information described above will be described below.
[0157]
As a first configuration method, there is a case where related information as shown in FIG. 11 is inserted as header information at the head of each video frame information in the video information. For example, in the case of an MPEG2 video stream, it is conceivable to insert related information into the header of the picture hierarchy, that is, the user data area of the picture header.
[0158]
Further, as a second configuration method, there is a case where video information and related information are configured separately, and the related information includes a frame number for identifying a corresponding video frame as shown in FIG. is there.
[0159]
In the case of the second configuration method, the video information can be transmitted on the video broadcast channel, and the related information can be transmitted on the data channel. Alternatively, in systems such as BS digital broadcasting and CS digital broadcasting, MPEG2 System (ITU-T H.222.) Is used as a part of program arrangement information defined by ARIB STD-B10 “program arrangement information used for digital broadcasting”. 0, ISO / IEC 13818-1) may be used to transmit related information using a data structure in a section format defined by ISO / IEC 13818-1.
[0160]
In the case of the second configuration method, the broadcast information is configured so that the related information is input to the viewer apparatus at the same time as or before the corresponding video frame.
[0161]
In FIG. 10, 2002 is a viewer apparatus according to the present embodiment, and is composed of the elements described below.
[0162]
The broadcast receiving unit 2201 receives the broadcast information 2010 including the video information 2011 and the related information 2012 described above, and transmits the broadcast information 2010 to the video display control unit 2202.
[0163]
The video display control unit 2202 transmits a display control signal for displaying the video information 2011 received from the broadcast receiving unit 2201 to the video display unit 2203. The video display control unit 2202 receives the coordinate value in the screen on which the viewer has pointed in the video display unit 2203, collates it with the subject coordinate value 2122 in the related information 2012, and performs pointing. The URI information 2124 and the subject attribute information 2123 corresponding to the subject having the subject coordinate value 2122 that matches the in-screen coordinate value are transmitted to the related information display control unit 2205.
[0164]
The video display unit 2203 displays video on the display screen based on the display control signal received from the video display control unit 2202. In the case shown in FIG. 10, a car appears as a subject. Further, the coordinate value pointed by the first pointing device 2204 is detected, and the value is transmitted to the video display control unit 2202.
[0165]
The first pointing device 2204 is connected to, for example, the video display control unit 2202 and is used to move a cursor displayed on the screen of the video display unit 2203 and perform a pointing operation at a desired cursor position. A general-purpose device such as a mouse can be used.
[0166]
The related information display control unit 2205 is a subject related information display unit which will be described later with characters, symbols, graphics, etc. (hereinafter referred to as subject representative graphics etc.) representing the subject attribute information 2123 received from the video display control unit 2202. A control signal for display on 2206 is transmitted to the subject related information display unit 2206, and subject attribute information 2123 is transmitted to the subject attribute information storage unit 2209. The related information display control unit 2205 also receives the subject representative graphic pointed by the second pointing device 2207 in the subject related information display unit 2206, and URI information 2124 corresponding to the subject represented thereby will be described later. Based on this, the related information access unit 2210 accesses a related information storage unit 2211 or a communication network 2003 described later, and displays the acquired related information on the subject related information display unit 2206.
[0167]
The related information access unit 2210 accesses the related information storage unit 2211 if the URI information 2124 received from the related information display control unit 2205 corresponds to the later-described related information storage unit 2211, and a communication network 2003 such as the Internet. If the information source corresponds to the information source connected to, the information source is accessed via the communication network 2003, the related information is obtained and returned to the related information display control unit 2205.
[0168]
The subject related information display unit 2206 receives the control signal for displaying the subject representative figure or the like or the related information of the subject from the related information display control unit 2205 and displays them. The subject-related information display unit 2206 includes the second pointing device 2207 as described above, and its operation is connected to the related information display control unit 2205, for example, in the same manner as the first pointing device 2204. In order to move the cursor displayed on the screen of the video display unit 2203 and perform a pointing operation at a desired cursor position, a general-purpose device such as a so-called touch panel or mouse can be used.
[0169]
An input device 2208 is a keyboard or other input device for operating the system. The subject attribute information accumulation unit 2209 receives and accumulates the subject attribute information 2123 transmitted from the related information display control unit 2205.
[0170]
The related information storage unit 2211 stores information related to the subject, and this information can be obtained by accessing the related information access unit 2210. Further, the stored information can be added, updated, or deleted as necessary using a device (not shown).
[0171]
The operation of the system according to Example 2-1 having the above configuration will be described below. Broadcast information 2010 including the video information 2011 and the related information 2012 shown in FIG. 11 is broadcast from the broadcast station, received by the broadcast receiving unit 2201, demodulated, and sent to the video display control unit 2202. The video display control unit 2202 generates a control signal for displaying the video information 2011 out of the video information 2011 and the related information 2012 received from the broadcast receiving unit 2201, and sends this to the video display unit 2203. The related information 2012 is temporarily stored in the video display control unit 2202.
[0172]
When the subject is pointed on the video display unit 2203, the video display control unit 2202 receives the coordinate value of the pointing from the video display unit 2203, and collates the received coordinate value with the subject coordinate value 2122 shown in FIG. And a subject having a subject coordinate value 2122 that matches the pointing coordinate value is found. Then, the subject attribute information 2123 and the URI information 2124 corresponding to the subject found in this way are sent to the related information display control unit 2205.
[0173]
The related information display control unit 2205 performs processing based on the subject attribute information 2123 and the URI information 2124 received from the video display control unit 2202. First, the subject attribute information 2123 is transmitted to the subject attribute information storage unit 2209 and stored. Also, the related information display control unit 2205 generates a control signal for displaying a subject representative graphic representing the received subject attribute information 2123 and sends it to the subject related information display unit 2206.
[0174]
FIG. 12 illustrates an example in which the subject representative graphic 2042 of the subject 2041 is displayed on the subject related information display unit 2206 corresponding to the subject 2041 pointed by the first pointing device 2204 in the video display unit 2203. Yes.
[0175]
Note that it is preferable to use different display devices for the video display unit 2203 and the subject-related information display unit 2206. For example, the video display unit 2203 may be configured using a CRT display device and the subject-related information display unit 2206 may be configured using a liquid crystal display device. In this case, use of a mouse as the first pointing device 2204 and use of a touch panel as the second pointing device 2207 can be considered. However, the video display unit 2203 and the subject-related information display unit 2206 can be configured using a single display device. When a single display device is shared, different windows or screens are divided. A video display unit 2203 and a subject-related information display unit 2206 are provided in each display area. In this case, the first pointing device 2204 and the second pointing device 2207 can also be realized by the same hardware, and one mouse or the like can be shared.
[0176]
FIG. 13 shows a more detailed example related to the subject related information display unit 2206. In this example, the subject related information display unit 2206 includes a subject display area 2261 for displaying the subject representative graphic 2042 and the subject related information. A related information display area 2262 for displaying information and an operation panel unit 2263 are provided. The operation panel unit 2263 can be used instead of the input device 2208 when, for example, a touch panel is used.
[0177]
In the subject display area 2261, a plurality of subject representative figures 2042 are displayed. In this example, characters such as OB-A, OB-B, OB-C, and OB-D are the respective subject representative figures 2042. These show the result that the subject attribute information 2123 and the URI information 2124 corresponding to the subject 2041 are sequentially sent to the related information display control unit 2205 when the subject 2041 is pointed one after another as the video progresses. Yes.
[0178]
Next, when the viewer points the subject representative graphic etc. 2042 displayed on the subject related information display unit 2206 with the second pointing device 2207, information for identifying the pointed subject representative graphic etc. 2042 is displayed on the subject related information display unit. In response to this, the related information display control unit 2205 extracts URI information 2124 corresponding to the subject 2041 indicated by the information for identifying the subject representative graphic 2042. The extracted URI information 2124 is transmitted to the related information access unit 2210. The related information access unit 2210 accesses the related information storage unit 2211 if the transmitted URI information 2124 corresponds to the related information storage unit 2211. The related information is obtained and returned to the related information display control unit 2205.
[0179]
If the transmitted URI information 2124 is for an information source connected to the communication network 2003, the related information access unit 2210 obtains the related information from the information source through the communication network 2003, and displays the related information. It returns to the control unit 2205.
[0180]
The related information display control unit 2205 displays the returned information in the related information display area 2262 of the subject related information display unit 2206 after receiving the returned information.
[0181]
In the above operation, the timing at which the viewer points to the subject representative graphic 2042 is arbitrary during the broadcast reception or after the broadcast reception. Therefore, when there is a lot of information to be referred to, it is possible to refer to the related information sequentially at a convenient time after receiving the broadcast.
[0182]
[Example 2-2]
Next, a viewer apparatus having a video filtering accumulation function will be described as Example 2-2. FIG. 14 is a system configuration diagram illustrating Example 2-2. The system configuration according to the embodiment 2-2 adds an interest information extraction unit 2212 to the system configuration of the embodiment 2-1 shown in FIG. 10, and automatically selects the broadcast information 2010 using the function. Will be described in detail below.
[0183]
In FIG. 14, in addition to the functions described in the embodiment 2-1, the related information display control unit 2205 includes at least the subject for which the viewer points the subject representative graphic 2042 in the subject related information display unit 2206. Any one of the URI information 2124, the subject attribute information 2123, the related information obtained from the information source, and the display time information about the time when the related information is displayed on the subject related information display unit 2206. It has a function of transmitting to the extraction unit 2212.
[0184]
Further, the interest information extraction unit 2212 refers to any or all of the URI information 2124, the subject attribute information 2123, the related information, and the display time information, and serves as information indicating the viewer's interest in the related information. Interest information is extracted and stored. Further, the interest information extraction unit 2212 receives the broadcast information 2010 including the video information 2011 and the related information 2012 from the broadcast receiving unit 2201, and at least the subject attribute information 2123 or the URI information 2124 in the related information 2012 is obtained. The broadcast information 2010 determined to be suitable for the viewer's interest information is preferentially selected in light of the accumulated interest information. The selected broadcast information 2010 can be stored in the broadcast information storage unit 2213 as necessary.
[0185]
Note that the present invention includes a function that can move or delete the subject representative graphic or the like 2042 displayed by the viewer in the subject related information display unit 2206, and the interest information extraction unit 2212 when these operations are performed. It is possible to reduce the interest information accumulated in. As a result, for example, the fact that the viewer's interest in the subject attribute information 2123 represented by the deleted subject representative graphic 2042 or the URI information 2124 corresponding to the subject attribute information 2123 has decreased is reflected in the extraction of interest information.
[0186]
Next, the operation of this system in Example 2-2 will be described. Broadcast information 2010 including video information 2011 and related information 2012 broadcast from the broadcast station is received by the broadcast receiving unit 2201, demodulated, and then sent to the video display control unit 2202. The related information 2012 is configured as shown in FIG. 11, for example, in the same manner as in Example 2-1. Since Example 2-1 has been described with reference to FIG. 11, description thereof is omitted here.
[0187]
The video display control unit 2202 generates a control signal for displaying the video information 2011 out of the video information 2011 and the related information 2012 received from the broadcast receiving unit 2201, and sends this to the video display unit 2203. The related information 2012 is temporarily stored in the video display control unit 2202.
[0188]
When the subject 2041 is pointed at the video display unit 2203, the video display control unit 2202 receives the coordinate value of the pointing from the video display unit 2203, and collates the received coordinate value with the subject coordinate value 2122 shown in FIG. And a subject in which a subject coordinate value 2122 that matches the pointing coordinate value is defined is found. Then, the subject attribute information 2123 and the URI information 2124 of the subject 2041 found in this way are sent to the related information display control unit 2205.
[0189]
The related information display control unit 2205 performs processing based on the subject attribute information 2123 and the URI information 2124 received from the video display control unit 2202. First, subject attribute information 2123 is sent to the subject attribute information storage unit 2209 and stored therein. For the received subject attribute information 2123, a control signal for displaying a subject representative graphic 2042 representing the generated subject attribute information 2123 is generated and sent to the subject related information display unit 2206. The display of the subject related information display unit 2206 in this case is as described with reference to FIG. 12 or FIG.
[0190]
When the viewer points the subject representative graphic etc. 2042 displayed on the subject related information display unit 2206 with the second pointing device 2207, the relevant information corresponding to the subject attribute information 2123 represented by the pointed subject representative graphic etc. 2042 is displayed. Is acquired, and the acquired related information is displayed in the related information display area 2262 of the subject related information display unit 2206. Since this point is the same as in Example 2-1, further description is omitted.
[0191]
Below, it demonstrates centering on the point from which the operation | movement of this system in Example 2-2 differs from that of Example 2-1.
[0192]
In Example 2-2, in addition to the functions described in Example 2-1, the related information display control unit 2205 displays the subject on which the subject representative graphic 2042 is pointed in the subject related information display unit 2206. Any of the URI information 2124 related to the subject 2041, the subject attribute information 2123, the related information obtained from the information source, and the display time information related to the time when the related information is displayed on the subject related information display unit 2206. Or a plurality of them are transmitted to the interest information extraction unit 2212.
[0193]
The displayed time is based on the display start time and end time when the related information is displayed on the subject related information display unit 2206, and these are the second times by the viewer who refers to the subject related information display unit 2206. It is also related to the operation time information of the pointing device 2207, and as the start time, the time when the subject representative figure 2042 is pointed and the related information obtained thereafter displayed on the subject related information display unit 2206 is displayed. The end time may be a time when an operation for ending the display is performed by the viewer, or a time when the next subject representative figure 2042 is pointed.
[0194]
The interest information extraction unit 2212 refers to any or all of the URI information 2124, the subject attribute information 2123, the related information, and the display time information received from the related information display control unit 2205, and extracts the interest information. accumulate. The interest information is information indicating what kind of information the viewer is interested in. Generally, the interest information can be generated by statistically processing the display time information and the number of times of pointing. For example, it is the number of times of pointing by subject attribute information or URI information, or the display time by subject attribute information, by URI information, or by related information, or an integrated value thereof. Further, the number of times of pointing, the display time, or an integrated value thereof can be set for each combination of at least two of the subject attribute information 2123, the URI information 2124, and the related information.
[0195]
Furthermore, the text included in the subject attribute information 2123 and the related information is decomposed into keywords, and the subject attribute information 2123 including the keyword for each keyword, the keyword is displayed when the related information is viewed many times or the display time is long. It is also possible to extract a group of keywords indicating interest and use it as interest information.
[0196]
Further, even when the viewer moves or deletes the subject representative graphic or the like 2042 displayed on the subject related information display unit 2206, the information is sent from the related information display control unit 2205 to the interest information extraction unit 2212. In this way, it can be reflected in the interest information extraction process. For example, when the viewer deletes the subject representative graphic etc. 2042, the viewer's interest in the subject attribute information 2123 represented by the deleted subject representative graphic etc. 2042 or the URI information 2124 corresponding thereto is reduced. As a result, processing such as subtraction from the interest information is performed and reflected in the interest information extraction processing.
[0197]
Further, the interest information extraction unit 2212 receives the broadcast information 2010 including the related information 2012 from the broadcast receiving unit 2201, matches the URI information 2124 in the related information 2012 with the above interest information, and matches the interest of the viewer. Filtering processing for selecting the broadcast information 2010 being performed is performed. The broadcast information 2010 filtered in this way is stored in the broadcast information storage unit 2213 as necessary. In this case, the related information includes the subject attribute information 2123, the URI information 2124, or related information, or a combination thereof, which indicates the value of the number of times of pointing, or the display time or the integrated value thereof. It is decided by whether or not. Instead of using the subject attribute information 2123 or the URI information 2124 itself, the information converted into the number of times or the reference time for each genre by classifying them in advance may be used.
[0198]
Next, a specific example of the interest information extraction unit will be described.
[0199]
In the following description, it is assumed that the related information in this embodiment includes a URI and a keyword group indicating the content content of the URI. For example, related information related to a car appearing in a video as a subject is given the appearance position in the video of the car, the URL address of the specification information homepage of the car, and {car} as keywords. Yes. A specific description example of such related information is shown below.
[0200]
<frame no = "N">
<object>
<location> (XA, YA)-(XB, YB) </ location>
<uri> url: www.automobile.com/car_A/spec.html <uri>
<keyword> Auto </ keyword>
</ object>
</ frame>
The above example corresponds to the case where only the automobile is present as the subject in the video frame with the frame number “N”. <frame no = "N"> ... Between the </ frame>, information about the video frame with the frame number “N” is described. <object> ... Information about one subject is described between </ object>. In this case, {automobile} is described as the appearance position in the video of the automobile, the URL address of the specification information homepage of the automobile, and the keyword. If there are multiple subjects, <frame no = "N"> ... </ frame><object> ... </ object> exists. The related information need not be in the XML format as described above, and may have a table type configuration as shown in FIG.
[0201]
The interest information extraction unit in this example holds a user profile including a keyword group and the weight of each keyword as viewer interest information. An example of a user profile is shown below.
[0202]
{Automobile: 1, Panda: 2, Steco: 1, Namako: 1}
In the above example, the user profile is described as a set having a plurality of combinations of “keyword: weight of the keyword”.
[0203]
Here, when the viewer points to a car that has appeared as the subject of the video being viewed, the interest information extraction unit increments the weight of the keyword “car” by one. If the keyword “car” does not exist in the user profile when the car is pointed, the keyword “car” is added to the user profile and the weight is set to 1.
[0204]
Therefore, when a car appears 10 times as the subject of the video being viewed, and the viewer points to all the automated persons, the user profile is
{Automobile: 11, Panda: 2, Steteco: 1, Namako: 1}
become.
[0205]
When the viewer deletes the subject representative graphic 2042 displayed on the subject related information display unit 2206, the weight of the keyword included in the related information corresponding to the subject is reduced by 1, and the user profile is changed. Update. For example, if the user profile is
{Automobile: 11, Panda: 2, Steteco: 1, Namako: 1}
When the viewer deletes from the subject related information display unit 2206 one of the subject representative figures 2042 of the subject associated with the related information including the keyword {automatic person}, the user profile is
{Automobile: 10, Panda: 2, Steteco: 1, Namako: 1}
Updated to
[0206]
When the viewer points to the subject representative graphic 2042 displayed on the subject related information display unit 2206 and refers to the related information, the subject representative graphic 2042 is determined according to the reference time of the related information. The weight of the keyword included in the related information corresponding to is increased, and the user profile is updated. For example, each time the related information is referred to for 1 minute, the weight of the keyword included in the related information of the corresponding subject is increased by 1. User profile is
{Automobile: 10, Panda: 2, Steteco: 1, Namako: 1}
When the viewer points to the subject representative figure 2042 of the subject associated with the related information including the keyword {car} and refers to the related information for 10 minutes, the user profile is
{Automobile: 20, Panda: 2, Steteco: 1, Namako: 1}
Updated to
[0207]
Furthermore, the interest information extraction unit performs processing according to the following rules when filtering broadcast information.
[0208]
When a keyword included in related information associated with a subject in the received video is included in the user profile, the weight of the keyword is set as the degree of interest in the subject. When there are a plurality of keywords included in the user profile, the sum of the weights of the keywords is set as the degree of interest in the subject. If the degree of interest is greater than or equal to a certain value K, it is assumed that the viewer is interested in the subject, and processing equivalent to that for automatically pointing the subject is performed. For example, if K = 10, the user profile is
{Automobile: 20, Panda: 2, Steteco: 1, Namako: 1}
If the related information including the keyword {car} is received, the degree of interest in the corresponding subject is 20 and satisfies K = 10 or more, so that the viewer automatically selects the corresponding subject. Executes the same processing as pointing. That is, processing such as displaying a subject representative figure corresponding to the subject on the subject related information display unit is performed.
[0209]
Note that what has been described above is an example of processing of the interest information extraction unit, and in addition to the above, rules such as weighting of various keywords, rules for using keywords, and the like can be used.
[0210]
[Example 2-3]
Next, Example 2-3 will be described.
[0211]
FIG. 15 is a system configuration diagram showing Embodiment 2-3 of the present invention. The embodiment 2-3 is a broadcast information transmission / reception system in which a broadcast station 2004 is added to the viewer apparatus 2002 described above. The broadcast station 2004 includes a broadcast including the related information 2012 as shown in FIG. It has a function to broadcast information 2010.
[0212]
The broadcast station is a broadcast station connected to a satellite broadcast system or a terrestrial broadcast system such as BS digital broadcast, CS digital broadcast, terrestrial digital broadcast, and the like, and performing broadcast via the broadcast infrastructure. As shown in FIG. 16, this is a broadcasting station that uses a server connected to a predetermined network such as the Internet or a broadcasting cable, and performs network broadcasting such as so-called Internet broadcasting or cable television broadcasting via the predetermined network. There is a case.
[0213]
[Example 2-4]
Next, Example 2-4 will be described.
[0214]
FIG. 17 is a system configuration diagram showing Embodiment 2-4 of the present invention. Example 2-4 is a broadcast information transmission / reception system in which a video storage medium playback device 2006 is added to the viewer device described above. The video storage medium is a DVD, D-VHS video tape, or the like, on which broadcast information 2010 including the related information shown in FIG. 11 is recorded. The video storage medium playback device 2006 is a DVD player, a VCR, or the like, and generally has a function of recording and storing broadcast information mainly including video received by broadcasting in the video storage medium. Furthermore, it has a function of reproducing the recorded broadcast information. The video storage medium to be used is the one in which broadcast information acquired from the broadcast infrastructure is recorded in advance, or the broadcast information including video information such as movies and dramas is recorded in advance. In some cases, the user obtains the information from a retail store or rental shop of the medium.
[0215]
In Example 2-4, broadcast information 2010 including the related information shown in FIG. 11 is input to the viewer apparatus 2002 from the video storage medium playback apparatus 2006 that plays back a predetermined video storage medium.
[0216]
Also in the second embodiment, it is possible to acquire related information related to the viewer information and the terminal information. For example, together with video information, a plurality of URIs corresponding to viewer information and terminal information are transmitted as related information to the viewer apparatus, and the viewer apparatus receives the viewer information or the like previously input to the viewer apparatus. A URI that matches the terminal information is selected. As the related information to be added, for example, formats such as related information examples 1 to 5 in the fourth embodiment described later can be used.
[0217]
(effect)
In the viewer apparatus and the broadcast information transmission / reception system according to the present embodiment, for each subject as a display unit appearing in the video, broadcast information to which related information in which URI information indicating the location of the related information is defined is added is received. Then, when the viewer points to the subject displayed on the video display screen, characters, figures, etc. representing the subject are displayed on the screen, and then corresponding to the pointing operation on these characters, figures, etc. The related information is read from the corresponding URI information and displayed on the screen. Thereby, the viewer can obtain and refer to information related to the subject that is interested while viewing the video information from an information source other than the broadcast information.
[0218]
In addition, when the viewer points to a plurality of subjects one after another, characters, figures, etc. representing each of them are sequentially added and displayed on the screen. As a result, even when there is a lot of related information that the viewer wants to refer to, it can be referred to without being restricted by time after viewing the broadcast information.
[0219]
In addition, interest information that takes into account the number of times the subject is pointed to by the viewer and the display time information of related information referenced in relation to the number of points of interest is extracted and retained, and broadcasted during times when the user is not viewing Broadcast information that matches interest information is automatically selected from the information and can be stored. As a result, the viewer can obtain broadcast information suitable for the genre of related information that he / she referred to in the past without time restrictions.
[0220]
In particular, in the present invention, when the viewer deletes the displayed subject representative graphic or the like, it is assumed that the interest in the URI information has been lost, and the interest information that has been accumulated is reduced so that the interest information is extracted. Since it is reflected, after the viewer sufficiently refers to the related information, the acquisition of the information of the genre can be stopped according to the dynamic change of the viewer's interest.
[0221]
In addition, since related information can be obtained in units of subjects, it is possible to define related information for subjects appearing in various scenes, and as a result, it is more detailed than in units of conventional video programs. It is possible to refer to related information. For example, even if it is the same subject, its meaning will generally change depending on the scene in which it appears, but by defining related information for each frame, it is possible to refer to diverse and accurate related information. In addition, more detailed video information can be automatically selected.
[0222]
For example, even if it is the same subject, its meaning will generally change depending on the scene in which it appears, but by defining related information for each frame, it is possible to refer to diverse and accurate related information. In addition, more detailed video information can be automatically selected. In addition, since characters / graphics with respect to the pointed subject are additionally displayed on the screen, the viewer can refer to related information without being restricted by time.
[0223]
In addition, since the viewer can point to the subject of interest, only relevant information of interest can be browsed accurately, so that the viewer is interested in what kind of information from the pointing operation of the subject. It is possible to obtain information that suggests whether or not there is.
[0224]
[Third Embodiment]
Next, a third embodiment of the present invention will be described. In the present embodiment, related information is acquired by processing an event from a terminal such as a personal computer in synchronization with broadcast content such as television and radio. Here, the event processing synchronized with the broadcast content means that when an event such as a button pressing operation occurs in the viewer device, the content of the action executed in response to the event corresponds to the broadcast content as needed. It is a process to change. As a specific example, when CM1, CM2, and CM3 are continuously broadcast on a predetermined TV broadcast channel, when the user presses the button on the viewer device when CM1 is broadcast, There is a process in which a link to information on CM1 is presented on a display device connected to the viewer device. Similarly, when the user presses the button on the viewer device when CM2 is broadcast, a link to information on CM2 is presented, and when the CM3 is broadcast, the button on the viewer device is used. When the user presses, a link to information on CM3 is presented.
[0225]
FIG. 18 is a configuration diagram of a system according to the third embodiment of the present invention. 18 includes a related information providing server 3001 (hereinafter referred to as “server 3001”), a viewer apparatus 3002 (client) that communicates with the server 3001 via a network 3006, and a broadcasting station 3003 that broadcasts broadcast content. And an input / output device 3004 connected to the viewer device 3002. Broadcast content broadcast from the broadcast station 3003 can be received by the broadcast receiving device 3005. Various actions are executed in the viewer apparatus 3002 in synchronization with the broadcast content. Further, the content of the action executed in response to the event that occurs in the viewer apparatus 3002 changes in synchronization with the broadcast content.
[0226]
In addition, the broadcast receiving device 3005 receives broadcast content from the broadcast station 3003, and even when the broadcast receiving device 3005 receives broadcast content from a broadcast information storage server 3003 ′ connected to a network such as the Internet. It is possible to realize the synchronization processing in the form.
[0227]
Here, the events that occur in the viewer device 3002 are various user operations on the input / output device 4. For example, when the viewer apparatus 3002 has a keyboard, it is a signal that a predetermined button on the keyboard has been pressed. Further, when the viewer apparatus 3002 has a pointing device such as a mouse, it is a signal that a predetermined position on the screen displayed on the display device connected to the viewer apparatus 3002 has been clicked by the pointing device. Furthermore, an event is a time-out event that a predetermined time has passed since a certain action occurred or that the time has reached a predetermined time.
[0228]
What operation or occurrence of an event is an event depends on what application is realized using the system of the present invention. For example, when a viewer is interested in a subject or BGM in a drama video while watching a drama video on a television, when the user presses a so-called bookmark button on the viewer device 3002, the related information is accessed. In an application in which an icon is added to the screen on the display device, the event is that the viewer (user) presses the bookmark button, and when the bookmark button is pressed, The action of adding an icon is executed. For example, in an application in which an information page related to the content of the educational program is displayed on the display device screen of the viewer device 3002 as the program progresses while the educational program is being viewed on a television, Corresponds to the fact that it is a predetermined time, that is, the time when the program content is switched, and when the event occurs, an action of updating to a new information page is executed.
[0229]
The actions executed by the viewer device 3002 are various processes by application programs that can be executed by the viewer device 3002, and vary depending on the service application realized using the system of the present invention. In the above-described example, processing such as “adding an icon for accessing related information” or “update to a new information page” corresponds to this.
[0230]
Further, when the viewer apparatus 3002 of the system of the present invention is mounted on a personal computer equipped with an MS-Windows OS, the action is processing by a software program that can be executed on Windows.
[0231]
Further, the server 3001 acquires action table resource data, which is information to be referred to when configuring an action table, from an organization that manages broadcast content, for example, a broadcast station.
[0232]
FIG. 19 is a configuration diagram of the server 3001 and the viewer apparatus 3002 according to the present invention.
[0233]
The server 3001 has already occurred for each viewer device 3002, a communication unit 3013 for communicating with a plurality of viewer devices 3002 via the network 3006, a client identifying unit 3014 for identifying the viewer device 3002 accessing the server 3001, and the viewer device 3002. The client information management means 3015 that holds a client occurrence event list that is a list of event identifiers of events, action table resource data 3012 that is referred to when configuring the action table, and the action table are synchronized with the event to be synchronized. In addition to updating the configuration sequentially, the action table configuration means 3011 for determining the validity period of each action table to be configured and assigning it to the action table, and the action table via the network 3006 are provided. And a action table providing means 3010 for.
[0234]
The viewer device 3002 communicates with the server 3001, acquires an action table from the server 3001, and holds an action table management unit 3022, monitors the occurrence of an event, and sets the event identifier of the generated event as an action Event management means 3021 for notifying the table management means 3022, action execution means 3023 for immediately executing the action described in the action content information notified from the action table management means 3022, an input interface 3026, and an output interface 3025 And have.
[0235]
FIG. 20 is a sequence diagram of the method according to the present embodiment. The server action table resource data 3012 collects broadcast information broadcast by the broadcast station 3003. First, for each valid period XX to XX designated in synchronization with the broadcast time of the broadcast content, the server 3001 includes an event identifier indicating a valid event, and action content information indicating a process executed corresponding to the event identifier. Is configured (step S1). Next, the server 3001 transmits the action table to the viewer apparatus 3002 (step S2). Next, the viewer apparatus 3002 holds the received action table, and derives an event that has occurred, for example, an event identifier YY that the user has pressed the push button (step S3). Next, the viewer apparatus 3002 derives the action content information ZZ corresponding to the event identifier YY using the action table received from the server 3001 (step S4). Finally, the viewer apparatus 3002 executes the action content information ZZ (step S5). At this time, the viewer apparatus 3002 may transmit the event identifier YY to the server 3001 (step S6). As a result, the server 3001 can generate an occurrence event list in the client information management unit 3015 and configure an action table suitable for the viewer apparatus 3002.
[0236]
FIG. 21 shows an example of an action table according to the present invention, and FIG. 22 shows an example of a client occurrence event list according to the present invention.
[0237]
The specific operation according to the present embodiment will be described below.
[0238]
When the viewer apparatus 3002 is activated, the action table management unit 3022 acquires an action table from the server 3001. The action table management unit 3022 confirms the effective period described in the acquired action table, and refers to the acquired action table as a reference target while the effective period is within the effective period.
[0239]
The action table management unit 3022 acquires a new action table from the server 3001 before the valid period of the action table currently being referenced ends. Simultaneously with the expiration of the valid period of the action table being referenced, the new action table is targeted for reference.
[0240]
Thereafter, the action table management unit 3022 repeats the above-described operation while checking the validity period of the action table currently being referred to, and sequentially updates the action table.
[0241]
Further, when an event occurs in response to a client operation or action execution, the event management unit 3021 transmits an event identifier of the generated event to the action table management unit 3022. The action table management unit 3022 refers to the action table currently being referenced, and transmits action content information corresponding to the event identifier to the action execution unit 3023. Furthermore, the action execution unit 3023 executes the action according to the action content information.
[0242]
Further, the action table management unit 3022 of the viewer apparatus 3002 transmits the event identifier received from the event management unit 3021 to the server 3001. When the server 3001 receives an event identifier from the viewer device 3002, first, the client identification unit 3014 identifies the viewer device 3002, and then the client information management unit 3015 corresponds to the client (viewer device). The event identifier is added to the client occurrence event list.
[0243]
Further, in the server 3001, when an action table is requested from the viewer device 3002, the client identification unit 3014 identifies the viewer device 3002, and the action table configuration unit 3011 corresponds to the identified viewer device 3002. The action table is configured with reference to the client occurrence event list, and the action table providing unit 3010 transmits the action table to the viewer apparatus 3002.
[0244]
Further, the server 3001 actively distributes the new action table to the viewer apparatus 3002 by the action table providing unit 3010 when the action table configuring unit 3011 configures a new action table.
[0245]
The viewer apparatus 3002 retains the new action table received by the action table management unit 3022, and when the valid period of the currently referenced action table ends, the currently referenced action table becomes the new action table. Change.
[0246]
(Example 3-1)
Next, a specific example in which the system according to the present invention is applied to television broadcasting will be described as Example 3-1.
[0247]
In Example 3-1, when a viewer is interested in a subject, background, BGM or the like in a drama video sound while watching a drama video on a television, a button for a so-called bookmark of the viewer device 3002 is provided. When pressed, an application (or URL or the like) for accessing the related information is added to the screen on the display device. It is assumed that the viewer apparatus 3002 has three bookmark buttons as input devices. Assume that the identifiers of each button in the system are (0, 0), (1, 0), and (2, 0). These three bookmark buttons, for example, indicate that the first button was interested in the subject, the second button was interested in the background, and the third button was interested in BGM. It is conceivable to have a function sharing such as indicating the above. Further, depending on the case, what each bookmark button indicates that the user is interested in may be dynamically changed. That is, at some point, button (1, 0) indicates that it is interested in the subject, button (2, 0) indicates that it is interested in the background, and button (3, 0) further indicates BGM. At another point in time, there are two subjects (eg, talents), etc., so the button (1, 0) was interested in the first subject. The button (2, 0) indicates that it is interested in the second subject, and further indicates that the button (3, 0) is interested in BGM. Moreover, in each viewer apparatus 3002, the meaning of button operation may differ, ie, the action which generate | occur | produces according to button operation may differ.
[0248]
FIG. 23 is an example of an action table according to the present invention. This action table has a valid period from time 0 to time 999. The input device is composed of three buttons, and identifiers of each button in the system are (0, 0), (1, 0), and (2, 0). The event identifier is composed of time information and a button identifier. The event identifier [(0, 499), (0, 0)] means an event that the button with the identifier (0, 0) is pressed between time 0 and time 499. Corresponding to the event identifier, an action “add icon_A” for additionally displaying the icon A on the screen is described.
[0249]
According to the action table of FIG. 23, if the button of the identifier (0, 0) is pressed between time 0 and time 499, “add icon_A” is executed. Similarly, if the button of the identifier (1, 0) is pressed between time 0 and time 499, “add icon_B” is executed, and the button of identifier (2, 0) between time 0 and time 499 is executed. Is pressed, “add icon_C” is executed. If the button of the identifier (0, 0) is pressed between time 500 and time 999, “add icon_D” is executed, and between time 500 and time 999 is executed. If the identifier (1, 0) button is pressed, “add icon-E” is executed. If the identifier (2, 0) button is pressed between time 500 and time 999, “add icon_F” is executed. To do.
[0250]
The viewer apparatus 3002 refers to the action table in FIG. 23 from time 0 to time 999. Then, when an event occurs when any button of the viewer device 3002 is pressed between time 0 and time 999, an action determined based on the action table is immediately executed.
[0251]
FIG. 24 is an example of the action table acquired next. In order to acquire the action table for the next valid period, the viewer apparatus 3002 accesses the server 3001 between time 0 and time 999. In the effective period 1000 to 1999, processing is performed with reference to the action table of FIG. The action table acquired from the server 3001 next is the same in all the viewer apparatuses 3002 regardless of which event occurs during the validity period 0 to 999.
[0252]
Each client (viewer device) is also characterized in that the content of the action table for the valid period 1000 to 1999 acquired differs depending on the type of event that occurred in the valid period 0 to 999 and whether or not an event has occurred.
[0253]
25 and 26 are examples of action tables having different contents. When there are a plurality of viewer devices 3002 in the system according to the present invention, no event occurs at time 0 to 999 in the first viewer device, and at time 0 in the viewer device B. Suppose that the button of the identifier (0, 0) is pressed between “-499” and “addicon_A” is executed. In this case, the first viewer apparatus acquires the table of FIG. 25 from the server 3001 as a new action table. On the other hand, when the button with the identifier (0, 0) is not pressed between time 0 and 499, the first viewer apparatus acquires the table in FIG. 26 from the server 3001 as a new action table.
[0254]
Thus, the content of the action table to be acquired differs depending on whether or not an event has occurred in each viewer device 3002 or the type of event that has occurred. As a result, the action executed in accordance with the button operation can be changed in each viewer device depending on the button operation performed previously.
[0255]
(Example 3-2)
Next, Example 3-2 in which the system according to the present invention is applied to television broadcasting will be described.
[0256]
In Example 3-2, while viewing an educational program or the like on a television, a predetermined information page related to the contents of the program, that is, the Internet, is displayed in accordance with the progress of the program on the screen of the display device 3004 of the viewer device 3002. This is an application that displays the predetermined homepage above. In this application, an event corresponds to a predetermined time, that is, a time when the program content is switched, and an action of updating to a new information page is executed when the event occurs.
[0257]
FIG. 27 is an example of an action table in Example 3-2. According to FIG. 27, the action of additionally displaying a homepage whose URL is http: // page1 on the screen is described as “open http: // page1”. When the viewer apparatus is mounted on a personal computer on which an OS of MS-Windows is installed, the execution of the action “open http: // page1” is executed on the Internet browser program “iexplore.exe” on MS-Windows. The homepage specified by the URL is opened using a function such as.
[0258]
In this operation, first, the viewer apparatus 3002 is activated prior to the broadcast of the program to be synchronized, and acquires the action table shown in FIG. Next, in the viewer apparatus 3002, when the time reaches 00/09/04/19: 00: 00: 00, an event with the event identifier [00/09/04/19: 00: 00: 00] occurs. As a result, the corresponding action “open http: // page1” is executed, and the homepage indicated by http: // page1 is displayed. Next, when the time reaches 00/09/04/19: 04: 00, it is considered that an event with the event identifier [00/09/04/19: 04: 00] has occurred, and the corresponding action “Open http: // page2” is executed. Next, when the time reaches 00/09/04/19: 09: 15, it is considered that an event with the event identifier [00/09/04/19: 09: 15] has occurred, and the corresponding action “Open http: // page3” is executed. Similarly, when the time specified by the event identifier is reached, it is considered that the event has occurred, and the corresponding action is executed.
[0259]
Furthermore, since the expiration date of the action table shown in FIG. 27 is 00/09/04/19: 15: 00, when it becomes 00/09/04/19: 15: 00, FIG. The action table is updated to the newly acquired action table, and thereafter, the action is executed every time specified by the event identifier of the updated action table.
[0260]
(Example 3-3)
Next, Example 3-3 in which the system according to the present invention is applied to television video broadcasting will be described.
[0261]
In Example 3-3, as shown in FIG. 28, the output device 3006 of the viewer device 3002 is integrated with a broadcast receiving device that receives broadcast video. Or both are connected. The viewer apparatus 3002 includes a pointing device such as a mouse as an input device. A touch panel display may be used as the pointing device. In this case, it is possible to point the subject in each video frame of the broadcast video displayed on the broadcast receiving apparatus which is an output device, using the pointing device.
[0262]
When the broadcast receiving apparatus that receives the broadcast video and the output device of the viewer apparatus are integrated, the information display area (display screen) of the broadcast receiving apparatus and the output device integrated apparatus is as shown in FIG. Configuration can be taken.
[0263]
In the present embodiment, in the above-described environment, when a viewer points to a subject in each video frame of a broadcast video with a pointing device connected to the viewer device, an action corresponding to the pointed subject is executed. To do. As the action to be executed, various processes such as presenting a homepage related to the pointed subject and adding a homepage related to the pointed subject to the bookmark can be considered. In the present embodiment, a case will be described in which an action of additionally displaying an icon image corresponding to the pointed subject on the screen is executed.
[0264]
In this case, an example of the action table provided from the related information providing server 3001 is shown in FIG. The action table shown in FIG. 30 has an effective time from time 0 to time 999. The event identifier includes time information (t1, t2), coordinates (xa, ya) of the upper left corner of the rectangular area corresponding to the subject existing area in the broadcast video display area, and coordinates (xb, yb) of the upper right corner. ) And is described as [(t1, t2), (xa, ya)-(xb, yb)]. As shown in FIG. 31, when the broadcast video display area has a resolution of 640 × 480 (VGA), the event identifier [(0, 299), (100, 100)-(200, 200)] is from time 0. It means an event that during the time 299, the rectangular region having the coordinates (100, 100) and (200, 200) as diagonal lines is pointed with the upper left corner coordinate being (0, 0). Here, normally, a subject A to be pointed exists from time 0 to time 299 in the rectangular area. In the action table shown in FIG. 30, the action “add icon_A” for additionally displaying the icon A on the screen in correspondence with the event identifier [(0, 299), (100, 100) − (200, 200)]. Is described.
[0265]
According to the action table of FIG. 30, when the inside of a rectangular area having coordinates (100, 100) and (200, 200) as a diagonal line is pointed between time 0 and time 299, “add icon_A” is executed. The Similarly, the action “add” is performed to additionally display the icon B on the screen when the rectangular area having the coordinates (300, 300) and (400, 400) as a diagonal line is pointed between time 0 and time 299. icon_B "is executed. If the inside of the rectangular area having the coordinates (200, 100) and (300, 200) as a diagonal line is pointed between the time 300 and the time 599, “add icon_A” is executed. If the inside of the rectangular region having the coordinates (200, 300) and (300, 400) as a diagonal line is pointed between the time 300 and the time 599, “add icon_B” is executed. If a rectangular area having diagonal lines with coordinates (300, 100) and (400, 200) is pointed between time 600 and time 999, “add icon_A” is executed. If a rectangular area having diagonal lines with coordinates (100, 300) and (200, 400) is pointed between time 600 and time 999, “add icon_B” is executed.
[0266]
Usually, a subject to be pointed exists in a rectangular area to be a pointing target in the broadcast video display area. For example, from time 0 to time 299, subject A and subject B exist in the broadcast video area as shown in FIG. Therefore, in the above-described example, when the viewer is pointing to the subject A between time 0 and time 299 while the viewer is watching the broadcast video, the icon A corresponding to the subject A is displayed in the viewer apparatus output information display as shown in FIG. Appears in the area.
[0267]
In the description of each embodiment, the action described by “add icon_X” can be further expanded and described as “add icon_X URL”. Specifically, the description is “add icon_A www.ntt.co.jp”. In this example, the action additionally displays the icon A, and when the icon A is selected by the viewer at an arbitrary time, information on the URL address “www.ntt.co.jp” is displayed. It corresponds to the process of presenting.
[0268]
As described above, according to the present embodiment, it is possible to define events in the viewer apparatus in various forms. For example, when various button operations occur, when an operation with a pointing device such as a mouse occurs, or when voice is input from a microphone connected to the viewer apparatus. When the viewer apparatus has a system for speech recognition, a predetermined word may be input from the microphone. Furthermore, when the absolute time reaches a predetermined time, when a predetermined time elapses after an arbitrary event occurs, or when a plurality of these events occur simultaneously.
[0269]
Further, according to the present embodiment, the event identifier for identifying the event as described above is defined in advance. The event identifier may have a different definition for each service to be applied. Accordingly, as described above as a specific embodiment, an information providing service linked to television broadcasting can be provided in various forms.
[0270]
Also in the present embodiment, it is possible to acquire related information related to viewer information and terminal information. For example, when viewer information and terminal information are transmitted in advance from the viewer device to the related information providing server, and the related information providing server creates an action table for each viewer device, the viewer information and terminal information To take into account.
[0271]
(effect)
As described above, according to the recording medium in which the system, method, and control program according to the present embodiment are recorded, the viewer apparatus can synchronize with the broadcast content of the predetermined channel to be broadcast without acquiring the data signal multiplexed in the broadcast. It is possible to quickly execute the processing for the event. Therefore, it is not necessary for the viewer apparatus to have a function of acquiring the data signal multiplexed in the broadcast from the broadcast receiving apparatus. In addition, when the viewer device performs a button operation or the like, the action table corresponding to the event that has occurred immediately is executed with reference to the action table already held in the action table management unit 30. Is extremely short, and it is possible to prevent a decrease in operability due to a slow response to client operations. Furthermore, in the present invention, since the validity period is specified for each table describing the correspondence between event identifiers and actions, it is possible to cope with dynamic changes in the broadcast time and program structure of the broadcast content to be synchronized. For example, the present invention can be applied to a live program whose program structure is constantly changing. The effective period of the action table can be set according to the intention of the provider of the broadcast content to be synchronized. By using the effective period effectively, event processing synchronized with a live broadcast program or the like can be realized to some extent.
[0272]
In addition, according to the present embodiment, since the event identifier for each viewer device is managed in the server, appropriate different action contents are executed for each viewer device for the same event.
[0273]
[Fourth Embodiment]
Next, the 4th Embodiment of this invention is described using Example 4-1 and Example 4-2. In the present embodiment, the partial broadcast information is transmitted from the viewer device to the related information providing server, and the related information providing server searches for the related information based on the partial broadcast information and transmits it to the viewer device.
[0274]
(Example 4-1)
Referring to FIG. 33, the broadcast receiving system with a related information providing function in the fourth embodiment of the present invention receives broadcast information including video and audio from the broadcast station 4006 and also relates the viewer from the input unit 4012. A related information acquisition unit that transmits broadcast information that is being viewed by the viewer or partial broadcast information that is feature amount information obtained by converting the broadcast information, acquires related information, and provides the viewer with information acquisition instructions The viewer apparatus 4001 having 4011 is connected to a network 4005 such as the Internet, stores broadcast information and related information of the broadcast information, and stores related information corresponding to the partial broadcast information from the viewer apparatus 4001. Broadcast information storage device 400 such as a VTR that stores broadcast information received by viewer device 4001 and related information providing server 4002 that transmits to When, and a content providing server 4004 to transmit the related information home page to the viewer apparatus 4001 to the access from the viewer apparatus 4001. Although only one viewer device 4001 is shown for convenience, there are actually many viewer devices 4001.
[0275]
The viewer device 4001 receives broadcast signals such as BS digital broadcast, CS digital broadcast, terrestrial digital broadcast, cable television broadcast, and network broadcast via the IP network (Internet), and decodes broadcast information such as audio-video, It is a device having a function of reproducing and presenting to a viewer. In the case of television broadcasting, it is a device composed of a broadcast receiving antenna device, a tuner device, an STB (Set Top Box), a television, or the like. In FIG. 33, the viewer apparatus 4001 is illustrated as an apparatus in which the above-described devices are integrated. However, the viewer apparatus 4001 has a broadcast receiving antenna, a process of decoding broadcast information such as video and audio from a broadcast signal, and the like. In other words, a device for performing the above and a device for displaying and reproducing video and audio may be separated, and the necessary devices may be connected by a wired communication path or a wireless communication path. Further, the viewer apparatus 4001 includes a communication apparatus such as a modem for performing communication by connecting to the Internet or the like via ISDN, analog telephone, or other communication lines. Furthermore, as shown in FIG. 33, the viewer device 4001 includes a broadcast information storage device 4003 for storing received broadcast information, such as a VTR, and reproduces and views the stored broadcast information in a timely manner. Has a function for. Note that the internal configuration of the viewer apparatus 4001 will be described later.
[0276]
The related information is information related to specific broadcast information, and is multimedia information composed of text, images, sound, music, video, and the like. For example, when a movie is provided as broadcast information, the related information is profile information of characters in the movie described in HTML, BGM title, composer information, and the like. In the case of a video, it is detailed information on a product advertised by the CM, information on the BGM of the CM, and the like. Alternatively, the related information may be address information for accessing the multimedia information content, that is, URL (Uniform Resource Locators) to the content.
[0277]
When the related information is a URL to multimedia information content related to arbitrary broadcast information, the viewer apparatus 4001 accesses the related information providing server 4002 and is related information corresponding to the notified broadcast information identification information. After acquiring the URL, the URL is accessed via the Internet 4005, information content such as a home page is acquired from the content providing server 4004, and this is presented to the viewer. The viewer device 4001 includes a content information browsing unit 4013 as means for performing this process.
[0278]
The related information providing server 4002 includes a broadcast information database 4021, a related information database 4022, a broadcast information matching unit 4023, and a related information providing unit 4024. The related information providing server 4002 may be realized as a WWW server connected to the Internet 4005.
[0279]
The broadcast information database 4021 manages each piece of broadcast information in association with broadcast information identification information that is information for identifying the broadcast information. That is, as shown in FIG. 33, the broadcast program video / audio group, which is the broadcast information to be stored, is managed as, for example, files named Video 01, Video 02, Video 03,. In this case, the file name corresponds to broadcast information identification information. Furthermore, it is possible to specify up to one video frame in each video / audio file by designating a video frame number in each video / audio file. In this case, the file name and the video frame number correspond to the broadcast information identification information. Further, in the broadcast information database 4021, it is obtained by performing media conversion or feature amount extraction processing necessary for search processing in order to speed up processing when the broadcast information matching unit 4023 performs matching search for broadcast information. Information (for example, feature vector information extracted from an audio signal) may be held. The related information database 4022 includes a table as shown in FIG. 34 in which broadcast information identification information stored in the broadcast information database 4021 is associated with related information corresponding to the broadcast information. In the example shown in FIG. 34, the related information is a URL of a home page including related information.
[0280]
The broadcast information matching unit 4023 specifies broadcast information identification information of broadcast information corresponding to the partial broadcast information by searching the broadcast information database 4021 for broadcast information corresponding to the partial broadcast information received from the viewer device 4001. . The related information providing unit 4024 refers to the related information database 4022, acquires related information corresponding to the specified broadcast information identification information, and transmits the related information to the viewer apparatus 4001.
[0281]
As shown in FIG. 35, the viewer apparatus 4001 includes a related information acquisition unit 4011, an input unit 4012, a content information browsing unit 4013, a broadcast reception unit 4014, a broadcast information demodulation / decoding unit 4015, a display reproduction unit 4016, and a network communication unit 4017. And a partial broadcast information buffer 4019.
[0282]
The broadcast receiving unit 4014 is an antenna and receives broadcast information from the broadcast station 4006. The broadcast information demodulating / decoding unit 4015 demodulates and decodes the broadcast information received by the broadcast receiving unit 4014, and in the display / playback unit 4016, the related information acquisition unit 4011, and further stores the broadcast information in the broadcast information storage device 4003. The broadcast information stored in the broadcast information storage device 4003 is input and reproduced. The input unit 4012 includes a related information acquisition instruction button 18 and other various buttons (not shown). As described above, when the viewer operates the related information acquisition instruction button 4018, the related information acquisition unit 4011 generates partial broadcast information from the broadcast information being viewed by the viewer, and the network communication unit 4017 sets the network 4005. Then, the information is transmitted to the related information providing server 4002, the related information transmitted from the related information providing server 4002 and received by the network communication unit 4017 through the network 4005 is acquired, and the URL included therein is output to the content information browsing unit 4013. The content information browsing unit 4013 accesses the content providing server 4004 via the network communication unit 4017 and the network 4005 by URL, receives the related information home page transmitted from the content providing server 4004 via the network communication unit 4017, and displays and reproduces Output to 4016. The display / playback unit 4016 includes display means such as a CRT or LCD and a display circuit, and displays video / audio as broadcast information, a related information homepage, and the like. The partial broadcast information buffer 4019 temporarily stores the viewed video and audio.
[0283]
Next, the operation of the broadcast receiving system with a related information providing function of this embodiment will be described.
[0284]
When the viewer operates the related information acquisition instruction button 4018 while viewing the broadcast information, the related information acquisition unit 4011 uses the broadcast information being viewed or the feature amount information obtained by converting the broadcast information as the partial broadcast information. It transmits to the related information provision server 4002. In addition, when acquiring the relevant information corresponding to the broadcast information stored in the broadcast information storage device 4003 that the viewer is playing back and watching at an arbitrary time, the broadcast information storage device that is playing back and watching at the arbitrary time The broadcast information stored in 4003 or the feature amount information obtained by converting the broadcast information stored in the broadcast information storage device 4003 being reproduced and viewed at any time is transmitted to the related information providing server 4002 as partial broadcast information. To do. Here, the related information is assumed to be a URL to a home page or the like that provides information related to the broadcast information. In the related information providing server 4002, when the partial broadcast information is notified from the viewer apparatus 4001, the broadcast information matching unit 4023 searches the broadcast information database 4021 to search for broadcast information identification information of broadcast information corresponding to the partial broadcast information. The related information providing unit 4024 acquires a related information (ie, URL) group associated with the broadcast information identification information with reference to a table as shown in FIG. 34, and sends this to the viewer apparatus 4001. Notice. The related information acquisition unit 4011 of the viewer device 4001 presents the acquired related information to the viewer.
[0285]
Here, as an implementation example of the related information acquisition unit 4011, related information is provided when an input unit such as a related information acquisition instruction button 4018 provided in the viewer apparatus 4001 is operated by the viewer and the related information acquisition is instructed. The server 4002 is accessed, the partial broadcast information is notified to the related information providing server 4002, the related information associated with the broadcast information identification information corresponding to the partial broadcast information is acquired from the related information database 4022, and presented to the viewer. (1) The related information providing server 4002 is sequentially and continuously accessed, and all the related information regarding the broadcast information that the viewer is currently viewing or reproducing / viewing is sequentially acquired from the related information management database 4022 to the viewer. (2) The viewer apparatus 4001 presents a so-called bookmark button and a related information acquisition instruction button 401. And the memory (storage device), the partial broadcast information at the time when the viewer operates the bookmark button and bookmarks is stored in the memory, and the viewer operates the related information acquisition instruction button 4018 to store the related information. When the acquisition is instructed, the related information providing server 4002 is accessed, the partial broadcast information stored in the memory is notified to the related information providing server 4002, and the broadcast information identification information group corresponding to the partial information from the related information database 4022 It is conceivable to obtain a related information group associated with the URL and present it to the viewer.
[0286]
In addition, the broadcast information matching unit 4023 searches the broadcast information database 4021 for broadcast information corresponding to the partial broadcast information received from the viewer device 4001, thereby obtaining broadcast information identification information of the broadcast information corresponding to the partial broadcast information. In specifying, K. Kashino, G. et al. Smith and H.M. Murase: “Time-Series active search for quick retrieval of audio and video”, Proc. ofICACASSP-99, Vol. 6, PP. 2993-2996, Mar. 1999, or Kunio Kanno and Hiroshi Murase, “Time-Series Active Search Method for Instantly Searching for Sound and Video”, NTTR & D, Vol. 49, no. 7, 2000, PP. The method described in 407-413 is used. The above-mentioned method is a method of detecting the presence or absence and corresponding position of a target sound or video, such as a specific program title or CM, from a long-time sound such as broadcast or during broadcast, and when searching for sound, The search is performed based on the entire speech to be searched and the histogram of the feature vectors of the speech to be searched. When these methods are used, the partial broadcast information corresponds to audio data in video / audio that has been viewed for a certain period of time including the time at which related information is acquired, or a feature vector extracted from the audio signal. To do. When the related information acquisition unit 4011 included in the viewer device 4001 transmits the feature vector as the partial broadcast information to the related information providing server 4002, the related information acquisition unit 4011 has a function of extracting the feature vector from the audio signal. Also have.
[0287]
As the partial broadcast information, in addition to the above-described audio signal or feature vector extracted from the audio signal, various features extracted from the video signal such as video frame data, video sequence data (a series of continuous frame data), and a color histogram. The amount is considered.
[0288]
Next, in this embodiment, a specific operation of the system when the viewer acquires information related to broadcasting during viewing will be described.
[0289]
First, the related information acquisition unit 4011 always performs partial broadcasting while the viewer device 4001 is using the viewer device 4001 to reproduce and view the broadcast video / audio being broadcast or the broadcast video / audio stored in the broadcast information storage device 4003. In the information buffer 4019, the viewed video and audio up to an hour ago are buffered. Here, it is assumed that the viewer is interested in the contents of the video and audio being viewed and operates the related information acquisition instruction button 4018. As a result, the related information acquisition unit 4011 broadcasts viewed during a period from time a to time t after the time t when the related information acquisition instruction button 4018 is operated, that is, from time ta to time t. A video / audio audio signal is transmitted as partial broadcast information to the related information management server 4002 via the network communication unit 4017.
[0290]
The related information providing unit 4024 of the related information providing server 4002 transmits the received partial broadcast information to the broadcast information matching unit 4023. The broadcast information matching unit 4023 searches for broadcast information corresponding to the partial broadcast information from the broadcast information database 4021 using the received partial broadcast information, that is, an audio signal. As a result of the search, for example, it is assumed that the video sequence from frame 1 to frame 3 of the video file Video 01 matches the received partial broadcast information. Here, the received partial broadcast information is viewed in the period from time a to time t before the time t when the viewer operates the related information acquisition instruction button 4018, that is, from time ta to time t. Therefore, the video frame corresponding to the last time in the adapted video sequence becomes the video frame being viewed at the time t when the viewer operates the related information acquisition instruction button 4018. Equivalent to. The broadcast information matching unit 4023 makes the above-described determination, and as a result, notifies the related information providing unit 4024 of the information “file name: Video 01, frame number: 002” as broadcast information identification information. The related information providing unit 4024 refers to the related information database 4022 shown in FIG. 34, and uses http: // www as related information corresponding to the received broadcast information identification information “fill name: Video 01, frame number: 002”. . aaa. co. jp. / Program information. A URL “html” is returned as related information to the viewer apparatus 4001.
[0291]
The viewer apparatus 4001 sends the received URL to the content information browsing unit 4013, and the content information browsing unit 4013 accesses the content providing server 4004 specified by the URL address, acquires the related information homepage, It is provided to the viewer by the display / playback unit 4016.
[0292]
(Example 4-2)
In the examples described above, basically, the related information provided when the viewer designates arbitrary broadcast information does not depend on the attributes of the viewer, and corresponds to the same broadcast information, The same related information was provided to all viewers.
[0293]
Also in this embodiment, similar to each of the above-described embodiments, it is possible to provide different related information for each viewer and viewer device based on the viewer information and the terminal information of the viewer device. is there. In the present embodiment, a configuration for providing different related information for each viewer and viewer device will be described in detail as Example 4-2.
[0294]
As in the first embodiment, the viewer information is information about the viewer, such as name, gender, age, occupation, address, zip code, family structure, residence information (apartment, detached house, etc.), hobby Interest genre (politics, economy, news, computer, books, sports, travel, etc.), annual income, information on whether or not you are a member of various services, membership number or credit card ID, various qualifications (driver's license ), Etc., including information on presence / absence, information on body shape (weight, height, clothing size, etc.), information on ability (sight, hearing, etc.), and the like.
[0295]
The terminal information is the resolution of the display device of the viewer device, the number of displayable colors, the performance of the WWW information browsing means (whether the Java function can be used, the presence / absence of the video / audio content playback function, the encoded format information that can be played back by the video / audio content, Etc.).
[0296]
In the following, with respect to the case of providing different related information for each viewer and viewer apparatus based on the viewer information and the terminal information of the viewer apparatus, the differences from the embodiment 4-1 will be described with reference to FIGS. Will be described with reference to FIG.
[0297]
In the present embodiment, as shown in FIG. 37, the viewer apparatus includes a storage unit 4030 for storing and holding viewer information and terminal information. The input unit 4012 provides a viewer with a function for inputting viewer information. The viewer inputs various pieces of viewer information in advance via the input unit 4012, and the input viewer information is stored in the storage unit 4030.
[0298]
The terminal information is stored in the storage unit 4030 at the time of manufacturing the terminal, or is notified to and stored in the storage unit 4030 from the display / playback unit 4016 when the display / playback unit 4016 is connected.
[0299]
In the present embodiment, the related information held in the related information database 4022 includes a related information body such as a URL and its attribute information. Attribute information refers to the characteristics of viewers that can be provided with relevant information, that is, gender, age, body shape characteristics, ability characteristics, occupation, district, zip code group, family composition characteristics, housing characteristics, annual income, and Information genre to which related information belongs, information on service use rights and qualifications necessary for using the related information, and characteristics of terminals to be provided, that is, display device resolution characteristics, number of displayable colors, content information browsing The performance of the unit 4013, and the like.
[0300]
The related information when the related information body is a URL is, for example,
Related information example 1: “URL1, (for women), (target age 20 and above), (1024x800 and above), (256 colors and above)”
Related information example 2: “URL2, (clothing size M), (Java function required)”
Related Information Example 3: “URL3, (Occupation: Housewife), (Tokyo)”
Related information example 4: “URL4, (for women), (sight below 0.8)”
Related information example 5: “URL5, (genre: sports)”
It becomes something like that.
[0301]
In this example, the actual related information is advertisement information of cigarettes for women in the related information example 1, and corresponds to a case where the content is less than 20 years old or unsuitable for men. The related information example 2 may be clothing advertisement information, the related information example 3 may be product information of a supermarket in Tokyo, the related information example 4 may be advertising information for female glasses, and the like. The related information 5 may be a sporting goods advertisement or the like.
[0302]
As shown in FIG. 36, the 4001 related information acquisition unit 4011 of the viewer apparatus, when transmitting the partial broadcast information to the related information providing server 4002 in the embodiment described so far, Alternatively, any one of the information is transmitted together with the partial broadcast information.
[0303]
The related information providing unit 4024 of the related information providing server 4002 specifies broadcast information identification information from the partial broadcast information according to the procedure described in the above embodiment, and further specifies corresponding related information. Thereafter, the viewer information and the terminal information given to the corresponding related information are referred to, and based on these, the related information is selected and transmitted to the viewer apparatus.
[0304]
Specifically, the related information associated with the broadcast information identification information identified from the partial broadcast information received by the related information providing server 4002 from the viewer device 4001 is shown in the related information examples 1 to 4 described above. If the viewer information is (female) and the terminal information is (resolution 800x600) or (unavailable for Java), the related information providing unit 4024 needs to have a resolution of 1024x800 or more. The related information example 1 that is a condition and the related information example 2 that is a condition that requires the Java function are excluded, and the remaining URL 3, URL 4, and URL 5 are transmitted to the viewer apparatus 4001.
[0305]
The viewer information is (female), (Kyoto), (sight 1.5) (interesting genre: book), and the terminal information is (resolution 1024x800), (Java available). In this case, the related information providing unit 4024 specifies the related information example 3 in which the target district is Tokyo, the related information example 4 in which the target viewer has a visual acuity of 0.8 or less, the genre is specified, and The related information example 5 whose genre is other than books is excluded, and the remaining URL 1 and URL 2 are transmitted to the viewer apparatus 4001.
[0306]
In addition to the above-described example, when the related information includes the information (available only to A service members) as the attribute information and the A service member number is included as the viewer information, the related information is used as the viewer device. 4001 may be transmitted. Also, when the attribute information includes information (requires a car license) is included in the related information, and the viewer information includes (car licensed), the related information is transmitted to the viewer apparatus 4001, etc. There is.
[0307]
In addition, when the information (mpeg2 format) is added to the related information as the attribute information and the terminal information includes (reproducible encoding method: mpeg2), the related information is transmitted to the viewer apparatus. Etc.
[0308]
As described above, in the above Example 4-2, by using the viewer information and the terminal information, related information that is unnecessary for the viewer and related information that cannot be used in the viewer device used by the viewer. Is not transmitted, and only the information considered necessary or available to the viewer is provided to the viewer.
[0309]
(effect)
As described above, according to this embodiment, it is not necessary to perform special processing such as adding information necessary for providing related information to broadcast video and audio, and broadcast video and audio Even when temporarily accumulating and reproducing and viewing, it is possible to provide related information related to broadcast video and audio via the network.
[0310]
[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described. In the present embodiment, a service that is accurately synchronized with a broadcast image frame is realized by using a frame ID or the like superimposed on the broadcast audio.
[0311]
As such a service, for example, when a user presses a button on the viewer device at hand while watching a television broadcast, the service is related to the content of the video displayed on the TV at the time the button is pressed. There is a service in which relevant information is acquired via a network and can be used in a viewer apparatus.
[0312]
In addition, while viewing an educational program or the like, a text book or the like used for explanation in the educational incense group is displayed on the display device of the viewer device, and a page is turned as the program progresses, and an underline is drawn. A service in which an action such as displaying a pointer indicating a part to be explained is also possible.
[0313]
In order to realize the service described above, it is necessary for the viewer apparatus to be able to grasp the content of the broadcast being viewed by the user at an arbitrary time. In other words, in the present embodiment, the viewer apparatus always superimposes information such as which channel the user is watching on the TV, what video is currently displayed on the TV, and the like on the audio. Grasp using frame ID etc. Thus, for example, when a button is pressed on the viewer device, in a service that acquires related information related to the video being viewed, when the video scene shown on the television is switched and the content changes, The relevant information to be acquired can be switched instantaneously.
[0314]
The term “related information” in the present embodiment is used when referring to information for acquiring content related to broadcast information, and also when referring to content itself related to broadcast information.
[0315]
FIG. 38 is a diagram showing an example of the configuration of the entire broadcast synchronous service providing system according to the fifth embodiment of the present invention, where numeral numeral 5001 is a broadcasting station, 5002 is a transmission means, 5003 is a signal addition means, and 5004. Is a video, 5005 is a sound, 5006 is a broadcast, 5007 is a broadcast receiving device, 5008 is a video / audio recording device, 5009 is a viewer device, 5010 is a microphone (MIC), 5011 is a data signal extracting means, 5012 is an output means, Reference numeral 5013 denotes input means, and 5014 denotes a connection line to the network.
[0316]
In the broadcast synchronization type service providing system shown in the figure, a digital data signal including at least a channel ID and an image frame ID or an audio frame ID is converted into an analog audio wave of a broadcast wave on the broadcast station side that broadcasts audio and video. Superimposing signal adding means 5003 is provided.
[0317]
For example, when the frame rate of the video to be broadcast is 30 frames / second, the data signal can be superimposed on the audio wave by sequentially superimposing the data signal every 1/30 seconds. As a method for superimposing the data signal on the voice, the signal adding means uses, for example, a data hiding technique (see Nikkei Electronics, No. 683 (1997), pp. 99 to 125, 149 to 162). Can do.
[0318]
As an example of a method of superimposing a data signal on an audio signal, the transmission side deletes a specific frequency component (band) of the audio signal in correspondence with “0” and “1” of the binarized data signal and transmits On the receiving side, the frequency component deleted from the audio signal is detected and the binary data string is reproduced. On the transmitting side, the binary data signal “0” or “1” is supported. There is a method of transmitting the specified frequency component outside the audio signal band and reproducing the binary data sequence by detecting the frequency component added outside the audio signal band on the receiving side.
[0319]
In FIG. 38, the broadcast receiving side includes a broadcast receiving apparatus that reproduces broadcast audio and video, and a viewer apparatus 5009 that does not have communication means such as the broadcast receiving apparatus 5007 and a communication line.
[0320]
FIG. 39 is a diagram illustrating an example of a configuration of a viewer apparatus. The viewer device 5009 extracts the microphone 10 for collecting the sound of the broadcast information reproduced from the speaker of the broadcast receiving device, the signal superimposed from the sound input from the microphone, and extracts the channel ID and the image. Data signal extracting means 5011 for confirming the frame ID and communication means 5015 for communicating with the related information content providing server on the network.
[0321]
Further, storage means 5016 for storing data necessary for each process, output means 5012 such as a display for displaying related information provided from a server on the network at the time of use to the user, It has input means 5013 such as a mouse and a keyboard for inputting information necessary for operating the terminal, and a control means 5017 for controlling them.
[0322]
In the broadcast-synchronized service providing system in the present embodiment, as shown in FIG. 39, on the broadcast station side, the data signal is superimposed on the audio of the broadcast information as described above, and broadcast together with the video of the broadcast information. On the other hand, the viewer apparatus extracts the data signal superimposed on the analog audio wave of the broadcast information by the data signal extraction means (channel ID and image frame identification means) shown in FIG. It is possible to accurately grasp the state of broadcast information that the user is viewing, that is, what kind of scene of which broadcast channel is being viewed.
[0323]
Therefore, the viewer apparatus can provide a broadcast synchronous service to the user by communicating with a server that provides related information related to the broadcast information existing on a network or the like. Here, as described above, the broadcast-synchronized service refers to, for example, sequentially providing related information that changes in synchronization with the progress of a program being watched (actually, changes in audio and image frames) to the user, or A service such as marking related information in the scene by pressing a button or the like in a scene in which the user is interested, and browsing the information later can be provided.
[0324]
Furthermore, by connecting and using means capable of recording and reproducing broadcast information to the broadcast receiving apparatus in the above-mentioned system, the user can not only broadcast the currently broadcast program but also the once recorded broadcast program. You can use the services as described above at any time. The operation of the broadcast synchronization service providing system will be described below.
[0325]
FIG. 40 shows a configuration diagram of an example in the fifth embodiment. In the figure, reference numeral 5001 is a broadcasting station, 5007 is a broadcast receiving device, 5008 is a video / audio recording device, 5009 is a viewer device, 5010 is a microphone (MIC), 5011 is a data signal extraction means, 5018 is an output device, 5019. Is an input device, 5014 is a connection line to the network, 5020 is a broadcast information database, 5021 is a broadcast information related information adding device, 5022 is a broadcast information database construction device, and 5023a to 5023d are related information content providing servers (a) to (d). ).
[0326]
In the broadcast synchronization service providing system of the present invention, the produced broadcast information is broadcast as a program by a broadcasting means on the broadcast station side for general users. At this time, a data signal including a channel ID capable of uniquely identifying a broadcast channel and an image frame ID capable of uniquely identifying an image frame is superimposed on the sound of the broadcast information by a signal adding unit.
[0327]
The above processing is performed for all broadcast information targeted for the broadcast synchronous service. As a result, the broadcast channel currently being viewed and the image frame can be uniquely identified by extracting the data signal superimposed on all the broadcast information to be serviced.
[0328]
On the other hand, on the broadcast receiving side, broadcast information broadcast by using a broadcast receiving device 5007 such as a television can be viewed as usual. The user can receive a broadcast synchronization service by activating the viewer device 5009. When the viewer apparatus 5009 is activated, the microphone 10 collects sound output from the speaker of the broadcast receiving apparatus 5007.
[0329]
The channel ID and the image frame ID are confirmed from the collected sound by the data signal extracting means. At this time, based on the confirmed channel ID, the viewer apparatus relates to the broadcast information of the currently viewed broadcast channel from the related information content providing server related to each broadcast information of each broadcast channel scattered on the network. After the related information content providing server is identified, the related information content providing server is accessed via the network and the image frame ID is transmitted.
[0330]
The related information content providing server manages a broadcast information database constructed by a broadcast information database construction device 5022, a related information addition device 5021, and the like. In the broadcast information database, a table is prepared in which each image frame ID is associated with various related information such as voice, video, text, and an execution instruction to the service terminal. By specifying the image frame ID, the broadcast information database is prepared. You can easily specify related information sets.
[0331]
Therefore, the related information content providing server can accurately grasp the scene currently being viewed by the user by receiving the information of the image frame ID transmitted from the viewer apparatus on the user side corresponding to the client. The related information according to the scene can be transmitted to the viewer apparatus. By sequentially repeating the above-described operation, the user can be provided with related information accurately synchronized with the broadcast information currently being viewed. Thereby, a broadcast synchronous service can be realized.
[0332]
In the broadcast synchronization service providing method of the present invention, the broadcast synchronization service providing system is based on the operation of the broadcast synchronization service providing system described above, and the broadcast information that the user is currently viewing by specifying the format of the image frame ID. To improve the reliability when the viewer apparatus grasps the above.
[0333]
FIG. 41 shows a data structure including a channel ID and an image frame ID. As described above, the channel ID and the image frame ID are such that the broadcast channel and the image frame can be uniquely identified. In particular, the image frame ID is a continuous number in time series. In the viewer apparatus, as described above, the sound reproduced from the speaker of the broadcast receiving apparatus is collected by the microphone, and the channel ID and the image frame ID are sequentially identified by the data signal extracting means.
[0334]
FIG. 42 shows an actual processing flow when the two IDs are confirmed. When the viewer apparatus is activated, it sets two values of “last channel ID” and “last image frame ID” as initial values. The initial value to be set at this time is, for example, the value of “Last Channel ID”, which may be the channel ID that was viewed immediately before the last viewing and termination, or a predetermined channel ID, etc. If the value is “image frame ID”, a value such as “0” may be considered.
[0335]
The viewer apparatus sequentially extracts a data signal from the sound and identifies the channel ID and the image frame ID (step S1). The viewer apparatus follows the following process based on whether or not the two IDs are correctly confirmed. First, when the channel ID is confirmed correctly, the channel ID is used as the channel ID of the currently reproduced broadcast channel (step S2), and the data signal is not correctly extracted from the sound, and the channel ID is confirmed. If not, the value of “last channel ID” is used as the channel ID of the currently reproduced broadcast channel (step S3). Then, the current channel frame ID is recorded (step S4).
[0336]
On the other hand, regarding the recognition of the image frame ID (step S5), when the image frame ID is correctly confirmed, the image frame ID is used as the image frame ID of the currently reproduced image in the same manner as the channel ID ( Step S6). On the other hand, if the image frame ID is not confirmed, the image frame ID is a continuous number in time series as described above, so that a value obtained by adding 1 to the value of the “last image frame ID” is currently reproduced. It is used as an image frame ID of the existing image (step S7). Then, the existing image frame ID is recorded (step S8).
[0337]
After both the channel ID and the image frame ID are used as the current values, the “last channel ID” value and the “last image frame ID” value are set (step S9), respectively. And a data signal is extracted from the audio | voice of the following area (step S10). In this way, it is possible to always hold and use the most recently used value in the processing flow sequentially performed. By determining the image frame ID as described above and following the processing flow, it is possible to interpolate the image frame ID even when the data signal is not correctly extracted from the sound during viewing of the same program, so that service provision is maintained. it can.
[0338]
A specific example of a case where the present broadcast synchronous service providing method is applied to a television broadcast will be described by taking a certain television program as an example. It is assumed that a broadcasting station that broadcasts the television program is provided with means for superimposing a data signal on sound in advance, “a” is given as the channel ID of the broadcasting station, and the image frame D is “ It starts with 1 ”.
[0339]
Here, the confirmation result of the channel ID and the image frame ID as a result of the data signal extraction means after the viewer apparatus is activated is assumed as shown in FIG. 43, and the variable for storing the value of “last channel ID” is set to “LAST”. -CH-ID ", the variable storing the value of" last image frame ID "is" LAST-FRAME-ID ", the variable storing the value of" current channel ID "is" CH-ID "," current A variable for storing “image frame ID” is assumed to be “FRAME-ID”.
[0340]
First, when the viewer apparatus is activated while watching this TV program, for example, “z” is set as “LAST-CH-ID” and “0” is set as “LAST-FRAME-ID”. Is set. Next, for the first time, the result of identification by the service terminal using the data signal extracting means is that the channel ID is “a” and the image frame ID is “1000” accurately confirmed from FIG. 43 (step 1). “CH” is set to “a”, “FRAME-ID” is set to “1000”, “LAST-CH-ID” is set to “a”, and “LAST-FRAME-ID” is set to “1000”. Is done.
[0341]
However, in the result of the next data signal extraction means, both the channel ID and the image frame ID are “unknown” from FIG. 43 (step 2). Therefore, in accordance with the processing flow of FIG. 42 described above, “CH-ID” refers to “LAST-CH-ID” and “FRAME-ID” refers to “LAST-FRAME-ID”. By adding 1, “1001” is set, and the respective values are set as new “LAST-CH-ID” and “LAST-FRAME-ID” values.
[0342]
FIG. 44 shows the values of the variables obtained for the data signal extraction processing result of FIG. 43 according to such a procedure. On the other hand, the viewer apparatus accesses the related information content providing server related to the broadcast content via the network based on the value of “CH-ID” obtained as a result of the processing flow, and sequentially transmits “FRAME-ID”. .
[0343]
The related information content providing server transmits the character data, voice data, image data, or the URL where the related information exists in advance to the received “FRAME-ID” to the service terminal. Is displayed, reproduced, drawn, or the URL is opened in a browser.
[0344]
For example, if the content of the program is English conversation, a change in related information such as character data is displayed as text in accordance with a sentence pronounced by a person in broadcast information, and more important sentences are underlined. be able to.
[0345]
In the above description, the case where video and audio are broadcast at the same time as in television broadcasting is described. However, the present invention is not limited to the case where audio and video are broadcast at the same time. It is also effective for broadcasting only. In this case, since there is no image frame, an audio frame ID is used instead of the image frame ID. The voice frame ID is an identifier uniquely assigned to each section of the voice divided by a certain time interval.
[0346]
In the description so far, the audio output from the speaker of the broadcast receiving apparatus such as a television receiver is received by the viewer apparatus with a microphone and converted into an electric signal, and the image frame ID and the audio frame ID are converted from the electric signal. Although a configuration for extracting as a data signal is described, when an audio electrical signal can be directly extracted from a broadcast receiver such as a television receiver, a data signal directly superimposed from the audio electrical signal without interposing a microphone It can also be set as the structure which extracts.
[0347]
Also in the present embodiment, it is possible to provide different related information for each viewer and viewer device based on the viewer information and the terminal information of the viewer device. For example, in the same manner as the method described in the embodiment 4-2, when the viewer apparatus requests related information from the related information content providing server, the viewer information and the terminal information are transmitted together with the frame ID and the like. The content providing server may select related information related to the viewer information or terminal information and provide it to the viewer apparatus.
[0348]
(effect)
According to the invention according to the present embodiment, even in a broadcast receiver such as a television receiver and a radio and a viewer apparatus that does not have a communication means such as a communication line for performing digital signal communication, the audio of the broadcast information By extracting the data signal superimposed on and confirming the channel ID, the image frame ID, and the audio frame ID, it is possible to recognize the currently viewed broadcast channel and image frame, and the broadcast contents and network It is possible to realize a service that needs to be accurately synchronized with related information contents.
[0349]
Further, by connecting means capable of recording and reproducing broadcast information, when not viewing in real time, that is, in a system configured to record broadcast audio-video in advance and view it when desired. By reproducing the video and audio by the means, it becomes possible to recognize the broadcast channel, the image frame, and the audio frame ID, and to receive the same service as when viewing in real time.
[0350]
Also, in the viewer device, when the sound reproduced from the broadcast receiving device is collected from the microphone, the data signal cannot be correctly extracted from the sound due to the influence of noise or the like, and the image frame ID is temporarily confirmed. Even if it is not possible, it is possible to interpolate the missing image frame ID and audio frame ID, so during the viewing of the same broadcast program, provision of a service that requires accurate synchronization between the broadcast information and the related information is in progress. Can continue to maintain without interruption.
[0351]
That is, as described above, according to the present embodiment, in the viewer apparatus that is provided separately from the broadcast video viewing apparatus and does not have a function that can directly acquire a data signal or the like multiplexed in the broadcast from the broadcast receiving apparatus, Currently, it is possible to provide a service of related information that is accurately synchronized with changes in the contents of a broadcast program being viewed. That is, even if the user does not operate according to the broadcast video, the related information can be updated automatically and in a timely manner, and the operability of the broadcast synchronous service can be improved.
[0352]
Furthermore, according to the broadcast synchronization type service providing method of the present embodiment, by setting the image frame ID as a continuous number, even if the viewer device fails to extract the image frame ID from the sound, the time The image frame ID can be interpolated from the difference and used. Further, even if the recorded video once accumulated by the recording device is used, it is possible to receive the broadcast synchronous service at the user's preferred time by utilizing the fact that the audio is simultaneously recorded.
[0353]
Note that the viewer apparatus and related information providing server of the present invention in each of the above embodiments can each be configured using a computer having a CPU, memory, hard disk, CD-ROM, etc. Functions in each of the information providing servers and the like can be realized by programs installed in each device or server. The program can be installed in a computer from a recording medium such as a CD-ROM, or can be downloaded to the computer via a network.
[0354]
The present invention is not limited to the above-described embodiments, and various modifications and applications can be made within the scope of the claims.
[0355]
【The invention's effect】
As described above, according to the present invention, a viewer of broadcast information or recorded information can easily acquire information or content related to the broadcast information or recorded information from a server or the like connected to the network. become able to.
[0356]
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a basic configuration example according to a first embodiment of the present invention.
FIG. 2 is a configuration diagram of a system in the first embodiment.
FIG. 3 is a diagram illustrating a configuration example of a viewer apparatus.
FIG. 4 is a diagram illustrating a configuration example of a related information content providing server.
FIG. 5 is a diagram illustrating a flow of information between a viewer apparatus and a related information content providing server.
FIG. 6 is a conceptual diagram showing the relationship between event information, broadcast information, and services.
FIG. 7 is a diagram illustrating a procedure for selecting a service and related content.
FIG. 8 is a diagram illustrating an example of a service information display screen.
FIG. 9 is a diagram illustrating an example of a notification setting (condition setting) screen.
FIG. 10 is a system configuration diagram according to the second embodiment of the present invention (Example 2-1);
FIG. 11 is a diagram illustrating an example of related information in the second embodiment.
FIG. 12 is a diagram for explaining a relationship between a subject on a video display unit and a subject representative figure on a subject related information display unit.
FIG. 13 is a diagram illustrating a display example in a subject-related information display unit.
FIG. 14 is a system configuration diagram according to the second embodiment of the present invention (Example 2-2);
FIG. 15 is a system configuration diagram according to the second embodiment of the present invention (Example 2-3);
FIG. 16 is a diagram illustrating another example in Example 2-3.
FIG. 17 is a system configuration diagram according to the second embodiment of the present invention (Example 2-4);
FIG. 18 is a system configuration diagram according to a third embodiment of the present invention.
19 is a configuration diagram of the related information providing server and the viewer apparatus of FIG. 18;
FIG. 20 is a sequence diagram of a method in the third embodiment.
FIG. 21 is an example of an action table according to the third embodiment.
FIG. 22 is an example of a client occurrence event list according to the third embodiment.
FIG. 23 is an example of an action table acquired first in Example 3-1.
FIG. 24 is an example of an action table acquired after FIG. 23;
FIG. 25 is an example of an action table in Example 3-1.
FIG. 26 is an example of an action table having different action content information from the action table of FIG.
FIG. 27 is an action table in Example 3-2;
28 is a system configuration diagram according to Embodiment 3-3. FIG.
FIG. 29 is an example of an information display area when a broadcast receiving apparatus that receives broadcast video and an output device of a viewer apparatus are integrated.
30 is a diagram showing an example of an action table in Example 3-3. FIG.
FIG. 31 is a diagram showing a broadcast video display area.
FIG. 32 is a diagram for explaining that an icon A is additionally displayed in the viewer apparatus output information display area.
FIG. 33 is a diagram illustrating an example of the overall configuration of a system according to a fourth embodiment of the present invention (Example 4-1);
34 is a diagram showing an example of a table included in the related information database 4022. FIG.
FIG. 35 is a diagram illustrating a configuration example of a viewer apparatus in Example 4-1.
FIG. 36 is a diagram illustrating an example of the overall configuration of a system according to a fourth embodiment of the present invention (Example 4-2);
FIG. 37 is a diagram illustrating a configuration example of a viewer apparatus in Example 4-2.
FIG. 38 is a diagram illustrating an example of the overall configuration of a broadcast synchronization type service providing system according to a fifth embodiment of the present invention.
FIG. 39 is a diagram illustrating an example of a configuration of a viewer apparatus according to a fifth embodiment.
FIG. 40 is a diagram illustrating a detailed example of the overall configuration of a broadcast synchronization type service providing system according to a fifth embodiment of the present invention.
FIG. 41 is a diagram illustrating an example of a configuration of a data signal and audio data to be superimposed on audio.
FIG. 42 is a flowchart showing processing from a data signal extracted from sound to determination of a channel ID and an image frame ID that are actually used.
FIG. 43 is an example of a confirmation result of a channel ID and an image frame ID based on the result of the data signal extraction unit after the viewer apparatus is activated.
44 is a value of each variable obtained for the data signal extraction processing result of FIG. 43.
[Explanation of symbols]
1001 Viewer device
1002 Related information content providing server
1003 Broadcasting station
1004 Event information providing server
1011 Service request means that can be provided
1012 Service information visualization display means
1013 Service selection / request means
1014 Service utilization means
1021 Available service selection means
1022 Providable service information transmission means
1023 Service request receiving means
1024 Access system state detection means
1025 Service content optimization means
1026 Service providing means
2010 Broadcast information
2011 video information
2012 Related Information
2002 Viewer device
2201 Broadcast receiver
2202 Video display controller
2203 Video display section
2204 First pointing device
2205 Related information display control unit
2206 Subject related information display section
2207 Second pointing device
2208 Input devices
2209 Subject attribute information storage unit
2210 Related Information Access Department
2211 Related Information Storage Unit
2212 Interest information extraction unit
2213 Broadcast information storage unit
2003 communication network
2004 broadcasting station
3001 Related Information Providing Server
3002 Viewer device
3003 Broadcasting station
3003 'Broadcast information storage server
3004 I / O device
3005 Broadcast receiving apparatus
3006 network
3010 Action table providing means
3011 Action table construction means
3012 Action table resource data
3013 Communication means
3014 Client identification means
3015 Client information management means
3021 Event management means
3022 Action table management means
3023 Action execution means
3024 communication means
3025 Output interface
3026 Input interface
4001 Viewer device
4002 Related information providing server
4003 Broadcast information storage device
4004 Content providing server
4005 Network (Internet)
4006 Broadcasting station
4011 related information acquisition unit
4012 Input section
4013 Content information browsing section
4014 Broadcast receiver
4015 Broadcast information modulation and decoding unit
4016 Display playback unit
4017 Network Communication Department
4018 Related information acquisition instruction button
4019 Partial broadcast information buffer
4021 Broadcast information database
4022 Related Information Database
4023 Broadcast information matching section
4024 Related Information Department
4030 storage unit
5001 Broadcasting station
5002 Transmission means
5003 Signal adding means
5004 videos
5005 voice
5006 Broadcast
5007 Broadcast receiving apparatus
5008 Video / audio recording device
5009 Viewer device
5010 Microphone (MIC)
5011 Data signal extraction means
5012 Output means
5013 Input means
5014 Connection line to network
5015 Communication means
5016 Storage means
5017 Control means
5018 Output device
5019 Input device
5020 Broadcast information database
5021 Broadcast information related information assigning device
5022 Broadcast information database construction device
5023 (a) to (d) Related information content providing server

Claims (1)

  1. A broadcast information transmission / reception system for transmitting / receiving broadcast information including at least video information including video and related information related to the video information,
    As the related information in the broadcast information, corresponding to each of a plurality of subjects included in the video information, subject coordinate values representing subject areas on the display screen for each video frame or time, and at least A broadcast station that transmits broadcast information including one piece of information resource identification information and subject attribute information that describes the subject, and a viewer device that receives the broadcast information,
    The viewer device is:
    A broadcast receiving unit that receives the broadcast information, a video display unit, a video display control unit, a first pointing means, a subject related information display unit, a related information display control unit, and a second pointing means; A subject attribute information storage unit, a related information access unit, and a related information storage unit;
    The video display control unit displays video information in the broadcast information received by the broadcast receiving unit on the video display unit, and the first pointing is performed among a plurality of subjects displayed on the video display unit. The coordinate value pointed by the means is compared with the subject coordinate value in the related information to identify the subject, and the subject attribute information and the information resource identification information in the related information corresponding to the identified subject are identified. And
    The related information display control unit displays characters, symbols, or figures representing subject attribute information corresponding to the subject identified by the video display control unit on the subject related information display unit, and in the subject related information display unit Identifying information resource identification information corresponding to the subject indicated by the character, symbol or graphic pointed by the second pointing means, and sending the information resource identification information to the related information access unit;
    The related information access unit obtains content information by accessing an information source connected to the related information storage unit or a communication network corresponding to the information resource identification information,
    The related information display control unit displays content information obtained by the related information access unit on the subject related information display unit ,
    The viewer device further includes an interest information extraction unit,
    The related information display control unit, information resource identification information corresponding to the subject indicated by the character, symbol or figure pointed by the second pointing means, subject attribute information, content information obtained from the information source, Any one or more of the display time information regarding the time when the content information is displayed on the subject-related information display unit is transmitted to the interest information extraction unit;
    The interest information extraction unit creates and holds interest information by referring to any or more of the information resource identification information, the subject attribute information, the content information, and the display time information, and stores the broadcast information. A broadcast information transmitting / receiving system , wherein a subject included in broadcast information received from the broadcast receiving unit at a time different from the received time is selected based on the interest information .
JP2001115997A 2000-04-14 2001-04-13 Broadcast information transmission / reception system Active JP3994682B2 (en)

Priority Applications (11)

Application Number Priority Date Filing Date Title
JP2000112805 2000-04-14
JP2000-112805 2000-04-14
JP2000-297846 2000-09-29
JP2000298179 2000-09-29
JP2000-298179 2000-09-29
JP2000299714 2000-09-29
JP2000-299714 2000-09-29
JP2000297846 2000-09-29
JP2000342032 2000-11-09
JP2000-342032 2000-11-09
JP2001115997A JP3994682B2 (en) 2000-04-14 2001-04-13 Broadcast information transmission / reception system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2001115997A JP3994682B2 (en) 2000-04-14 2001-04-13 Broadcast information transmission / reception system

Publications (2)

Publication Number Publication Date
JP2002209204A JP2002209204A (en) 2002-07-26
JP3994682B2 true JP3994682B2 (en) 2007-10-24

Family

ID=27554764

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2001115997A Active JP3994682B2 (en) 2000-04-14 2001-04-13 Broadcast information transmission / reception system

Country Status (1)

Country Link
JP (1) JP3994682B2 (en)

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002244970A (en) * 2001-02-21 2002-08-30 Mitsubishi Electric Corp Communication network system
JP3644955B2 (en) * 2001-09-27 2005-05-11 松下電器産業株式会社 Conversation device, conversation master device, conversation slave device, conversation control method, and conversation control program
JP4344185B2 (en) * 2003-01-28 2009-10-14 シャープ株式会社 Client terminal device, information processing method, sub-client terminal device, computer-executable program, and recording medium
CN1742487B (en) * 2003-01-28 2010-09-29 夏普株式会社 Information server apparatus, client terminal apparatus,
JP5046471B2 (en) * 2003-05-30 2012-10-10 ソニー株式会社 Information processing apparatus, information processing method, and computer program
US20070110397A1 (en) * 2003-09-25 2007-05-17 Kentaro Tanikawa Playback apparatus and bookmark system
JP2005159743A (en) * 2003-11-26 2005-06-16 Sharp Corp Video display apparatus, video display program, information distribution apparatus, and information communication system
US8407752B2 (en) * 2004-03-18 2013-03-26 Digimarc Corporation Synchronizing broadcast content with corresponding network content
CN101077007B (en) * 2004-12-09 2011-04-13 松下电器产业株式会社 Content viewing system
JP4688592B2 (en) * 2005-07-11 2011-05-25 株式会社シバソク Signal generator
JP2009524273A (en) * 2005-11-29 2009-06-25 グーグル・インコーポレーテッド Repetitive content detection in broadcast media
JP2007192988A (en) * 2006-01-18 2007-08-02 Asv:Kk Object enhancement display system in video reproduction system and object locus overlay display system, and player device and server device used for the display systems
US8411977B1 (en) 2006-08-29 2013-04-02 Google Inc. Audio identification using wavelet-based signatures
JPWO2008093632A1 (en) * 2007-01-29 2010-05-20 株式会社Access Movie processing method, movie processing program, and movie processing apparatus
JP4937795B2 (en) * 2007-03-06 2012-05-23 日本電信電話株式会社 Content-associated information display method, content-associated information display device, program thereof, and recording medium
JP2009038793A (en) * 2007-07-11 2009-02-19 Panasonic Corp Information processing server, program reception terminal, program-associated information providing method, and program-associated information plotting method
EP2306717B1 (en) * 2008-05-28 2019-10-09 Kyocera Corporation Communication terminal, search server, and communication system
JP2009302891A (en) * 2008-06-13 2009-12-24 Sony Corp Information processing device
JP2010098730A (en) * 2008-09-22 2010-04-30 Toshihiko Okabe Link information providing apparatus, display device, system, method, program, recording medium, and link information transmitting/receiving system
JP5428697B2 (en) * 2009-09-16 2014-02-26 ソニー株式会社 Receiving device, receiving method, transmitting device, and computer program
US9721465B2 (en) 2011-01-07 2017-08-01 Yamaha Corporation Information-providing system, portable terminal device, server, and program
JP2012155706A (en) * 2011-01-07 2012-08-16 Yamaha Corp Information provision system, portable terminal device, identification information solution server, and program
JP2012161030A (en) * 2011-02-02 2012-08-23 Nippon Telegr & Teleph Corp <Ntt> Associated content retrieval device, system, method, and program
KR101211098B1 (en) 2011-04-25 2012-12-11 (주)엔써즈 System and method for providing advertisement related informatiion included in broadcasting to client terminal through network
US20140090005A1 (en) * 2011-05-19 2014-03-27 Nippon Hoso Kyokai Integrated broadcasting communications receiver
JP5903783B2 (en) 2011-06-30 2016-04-13 ソニー株式会社 Server apparatus and information processing apparatus
JP5859245B2 (en) * 2011-08-11 2016-02-10 株式会社ビデオリサーチ Information display system and method, survey system and method
JP6071184B2 (en) * 2011-10-26 2017-02-01 サターン ライセンシング エルエルシーSaturn Licensing LLC Receiving apparatus, receiving method, program, and information processing system
WO2013088604A1 (en) 2011-12-15 2013-06-20 パナソニック株式会社 Information display device, information display method, and information display system
US9854276B2 (en) 2012-05-23 2017-12-26 Saturn Licensing Llc Information processing device, information processing method, and program
JP5306560B1 (en) 2012-05-30 2013-10-02 パナソニック株式会社 Program information display device, program information output device, and program information display method
US9456245B2 (en) 2012-07-05 2016-09-27 Sony Corporation Receiving device, receiving method, transmitting device, and transmitting method for controlling applications
JPWO2014010470A1 (en) 2012-07-12 2016-06-23 ソニー株式会社 Transmitting apparatus, information processing method, program, receiving apparatus, and application linkage system
BR112015000144A2 (en) * 2012-07-12 2017-06-27 Sony Corp receiving and transmitting devices, method of processing information, program, and application cooperation system
KR20140102388A (en) * 2013-02-13 2014-08-22 삼성전자주식회사 Display apparatus, server and control method thereof
JP6063300B2 (en) * 2013-02-28 2017-01-18 株式会社ビデオリサーチ Information display system, method, apparatus, and program
JP5838351B2 (en) 2013-03-26 2016-01-06 パナソニックIpマネジメント株式会社 Video receiving apparatus and image recognition method for received video
JP5820986B2 (en) * 2013-03-26 2015-11-24 パナソニックIpマネジメント株式会社 Video receiving apparatus and image recognition method for received video
EP3026922A4 (en) 2013-07-26 2016-08-03 Panasonic Ip Man Co Ltd Video receiving device, appended information display method, and appended information display system
US9762951B2 (en) 2013-07-30 2017-09-12 Panasonic Intellectual Property Management Co., Ltd. Video reception device, added-information display method, and added-information display system
JP2014027666A (en) * 2013-09-03 2014-02-06 Olympus Corp Camera, detailed picture reception method, and detailed picture reception program
US9906843B2 (en) 2013-09-04 2018-02-27 Panasonic Intellectual Property Management Co., Ltd. Video reception device, video recognition method, and display system for providing additional information to be superimposed on displayed image
EP3043571A4 (en) * 2013-09-04 2016-08-17 Panasonic Ip Man Co Ltd Video reception device, video recognition method, and additional information display system
JP5574556B1 (en) * 2013-09-26 2014-08-20 株式会社電通 Viewing program identification system, method and program
CN105144735A (en) * 2014-03-26 2015-12-09 松下知识产权经营株式会社 Video receiving device, video recognition method, and supplementary information display system
US10194216B2 (en) 2014-03-26 2019-01-29 Panasonic Intellectual Property Management Co., Ltd. Video reception device, video recognition method, and additional information display system
CN105850149B (en) * 2014-03-28 2018-12-14 松下知识产权经营株式会社 Video receiver, parameter setting method and additional information display system
CN104159159B (en) * 2014-05-30 2015-10-07 腾讯科技(深圳)有限公司 Based on the exchange method of video, terminal, server and system
CN104113786A (en) * 2014-06-26 2014-10-22 小米科技有限责任公司 Information acquisition method and device
JP6432047B2 (en) 2014-08-21 2018-12-05 パナソニックIpマネジメント株式会社 Content recognition apparatus and content recognition method
JP6232632B1 (en) * 2016-08-09 2017-11-22 パロニム株式会社 Video playback program, video playback device, video playback method, video distribution system, and metadata creation method
JP6261787B2 (en) * 2017-02-22 2018-01-17 株式会社 ディー・エヌ・エー System, method, and program for supporting sales of products
JP6270086B1 (en) * 2017-06-12 2018-01-31 パロニム株式会社 Video playback program, video playback device, video playback method, and video distribution system
JP2018026801A (en) * 2017-06-12 2018-02-15 パロニム株式会社 Video replay program, video replay device, video replay method and video delivery system
JP2018026799A (en) * 2017-06-12 2018-02-15 パロニム株式会社 Video replay program, video replay device, video replay method, video delivery system and metadata creation method

Also Published As

Publication number Publication date
JP2002209204A (en) 2002-07-26

Similar Documents

Publication Publication Date Title
EP1170944B1 (en) Image and data display method and apparatus
JP5819883B2 (en) Media library in interactive media guide application
JP5296778B2 (en) Multimedia content search and recording reservation system
JP4059631B2 (en) Interactive system
EP1099347B1 (en) Client-server electronic program guide
US8875212B2 (en) Systems and methods for remote control of interactive video
EP1157547B1 (en) System and method for tailoring television and/or electronic program guide features, such as advertising
JP6266818B2 (en) System and method for acquiring, classifying, and delivering media in an interactive media guidance application
US10306322B2 (en) Method for content-based non-linear control of multimedia playback
JP5675588B2 (en) Method and apparatus for recommending broadcast content
US6973665B2 (en) System and method for determining the desirability of video programming events using keyword matching
JP4062908B2 (en) Server device and image display device
US8832742B2 (en) Systems and methods for acquiring, categorizing and delivering media in interactive media guidance applications
US8381249B2 (en) Systems and methods for acquiring, categorizing and delivering media in interactive media guidance applications
JP5607116B2 (en) System and method for providing channel groups for interactive media guidance applications
DE69915106T2 (en) Smart agent based on custom, statistical inference and psychodemographic profiling
CN1264350C (en) Electronic program guide viewing history generator method and system
US8042136B2 (en) Information processing apparatus and information processing method, and computer program
KR100350787B1 (en) Multimedia browser based on user profile having ordering preference of searching item of multimedia data
EP1237371A2 (en) Enhanced television service
US20050125823A1 (en) Promotional philosophy for a video-on-demand-related interactive display within an interactive television application
US20030061610A1 (en) Audiovisual management system
US8677400B2 (en) Systems and methods for identifying audio content using an interactive media guidance application
JP4304185B2 (en) Stream output device and information providing device
US20020157101A1 (en) System for creating and delivering enhanced television services

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20040227

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20060829

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20061030

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20061128

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070126

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20070710

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20070723

R150 Certificate of patent or registration of utility model

Ref document number: 3994682

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100810

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100810

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100810

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110810

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120810

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130810

Year of fee payment: 6

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350