JP2003348551A - Image related information providing method, system, transmitting method, transmitter, execution program of transmitting method, recording medium with the program recorded, receiving method, receiver, execution program of receiving method and recording medium with the program recorded - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide preset related information without giving the trouble of setting temporal and spatial positions in individual objects in an image and without applying such a load that parallelly calculates various amounts of characteristics of the objects to an image receiving side. <P>SOLUTION: An image transmitting side detects that a signal outputted from an identifying signal generation means goes into the field of view of an image photographing means during image photographing (process 11). The detected identification signal is converted into a predesignated ID (process 12), and the predesignated ID is superimposed upon an image with the ID photographed or is parallelly transmitted to the image receiving side (process 13). The image receiving side retrieves a pretransmitted or preprovided ID and association information of the related information on the basis of the received ID, acquires preset related information from the association information (process 21) and displays the related information as well as its image (process 22). <P>COPYRIGHT: (C)2004,JPO

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a related information providing system for providing information corresponding to an object photographed in a video, and in particular, to digital terrestrial broadcasting, BS broadcasting, CS broadcasting, CATV broadcasting, and Internet broadcasting. The present invention relates to a method and system for providing related information for video, and a method for transmitting / receiving the same, which is suitable for transmitting and receiving non-storage video such as live video used in LAN broadcasting and the like.

[0002]

2. Description of the Related Art Conventionally, as a method of providing related information on an object in an image, a temporal position of the object in the image and
Correlate corresponding information to the spatial position in advance,
Before starting playback of the video, the association information is transmitted to the terminal on the video receiving side and stored in a database, a file, a memory, or the like, and when an interaction such as a mouse click occurs to an object in the video. There is a method of searching for, acquiring, and displaying related information based on the related information.

[0003] In the above-described method, the temporal and spatial positions of the object in the video and the association with the corresponding information are defined in advance. If the object in the video moves frequently, the work of setting the temporal position and the spatial position of the object in advance becomes very large, and the setter requires great labor. In addition, the above method cannot be applied to non-storage type images or live images that cannot be set in advance.

As a method for avoiding the above-mentioned problem, Japanese Patent Application No. 2000-125078 has been proposed. In this method, when an object in a video reaches a preset state, a related action is provided, and the state of the set object is continuously displayed on the video receiving side as the image progresses. Calculates in advance, calculates whether or not a preset state has been reached, and when the preset state is reached, executes the preset action to execute the related action. It is characterized by providing.

[0005] According to this method, in interactive hypermedia mainly composed of live video, the temporal position of each object in the video is previously determined on the video transmitting side.
Even if the spatial position is not set, it is possible to set an action such as presenting related information without impairing liveness.

[0006]

However, in Japanese Patent Application No. 2000-125078, the video receiving side
The feature amounts of the objects in the video must be constantly calculated, and when there are many objects, it is difficult to calculate the feature amounts of all the objects in parallel.

[0007] An object of the present invention is to save the trouble of setting a temporal position and a spatial position with respect to an individual object in an image in advance on an image transmitting side for an object in an image such as a live image. A related information providing method and system capable of providing preset related information without applying a load such as calculating various kinds of feature amounts of an object in parallel without applying the related information on the image receiving side. To provide a transmission / reception method and apparatus.

[0008]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention provides related information provision to a video which provides information set in advance when an ID specified in advance is detected during video reproduction. A transmitting-side method of transmitting or providing in advance a corresponding relationship between each ID and the information related to the ID to an associating information storage unit of a receiving side, and capturing an image by a video capturing unit. An image capturing procedure, and an identification signal detecting procedure for detecting that a signal identifiable for each object emitted from the identification signal generating means installed near the object to be imaged has entered the field of view of the image capturing means. And an ID conversion procedure for converting the detected identification signal into an ID designated in advance, a video transmission procedure for transmitting the captured video, and an ID transmission procedure for transmitting the converted ID. Then, the video receiving procedure for receiving the transmitted video, the ID receiving procedure for receiving the transmitted ID, and the correspondence relationship between the received ID and the information related to the received ID and the ID transmitted or provided in advance are associated with the ID. A related information search procedure for searching from a related information storage unit that stores a correspondence relationship of information to be obtained, and obtaining and displaying related information having the searched correspondence from a related information storage unit that stores preset related information. A method for providing related information for video, characterized by having a related information display procedure and a video display procedure for displaying the received video, is a means for solving the problem.

Alternatively, an ID specified in advance during video reproduction
A related information providing system for a video that provides information that has been set in advance when detecting
An identification signal generating unit that is installed near an object to be imaged and emits an identifiable signal for each object; a video image capturing unit that captures an image; and a signal emitted from the identification signal generating unit is a visual field of the image capturing unit. Identification signal detecting means for detecting that the image has entered, ID converting means for converting the detected identification signal into a predetermined ID, video transmitting means for transmitting the photographed video, and ID for transmitting the converted ID A transmitting device having a transmitting unit, a related information storing unit that stores predetermined related information, a video receiving unit that receives a transmitted video, and a transmitting ID. ID receiving means for receiving, each I transmitted or provided in advance
Association information storage means for storing the correspondence between D and information related to the ID, related information search means for searching the correspondence between the received ID and the information related to the information from the association information storage means, A related information providing system for video, comprising: related information display means for acquiring and displaying certain related information from the related information storage means; and a receiving device including video display means for displaying the received video. Means of solution.

Alternatively, an ID specified in advance during video reproduction
Is a related information providing transmission method for a video that provides information that is set in advance when a is detected.
An association information providing procedure for previously transmitting or providing a correspondence relationship of information related to the receiving side to the association information storage means on the receiving side, a video shooting procedure for shooting video by the video shooting means, and An identification signal detection procedure for detecting that an identifiable signal for each object emitted from the installed identification signal generation means has entered the field of view of the video photographing means, and converting the detected identification signal to an ID designated in advance. An ID conversion procedure for converting, a video transmission procedure for transmitting the captured video, an ID transmission procedure for transmitting the converted ID,
The related information provision transmission method for video, characterized by having:

Alternatively, an ID specified in advance during video reproduction
A related information providing and transmitting device for a video that provides information that has been set in advance when detecting the video, wherein a video capturing unit that captures the video and an identification signal generating unit that is installed near an object to be captured. Identification signal detection means for detecting that an identifiable signal for each emitted object has entered the field of view of the video photographing means, ID conversion means for converting the detected identification signal into a pre-designated ID, Video transmitting means for transmitting the captured video, and ID for transmitting the converted ID
And transmitting means for providing related information for video, characterized by having a transmitting means.

[0012] Alternatively, a program for causing a computer to execute the above-described procedure in the related information providing and transmitting method for a video is a program for causing a computer to execute the related information providing and transmitting method for a video.

[0013] Alternatively, the procedure in the method for providing related information for a video is transmitted to a computer as a program, and the program is recorded on a recording medium readable by the computer. A recording medium on which an execution program of the provided transmission method is recorded is a means for solving the problem.

Alternatively, an ID specified in advance during video reproduction
A related information provision receiving method for a video to be provided with information set in advance when detecting a video, a video receiving procedure for receiving a transmitted video, an ID receiving procedure for receiving a transmitted ID, A related information search procedure for searching the correspondence between the received ID and the information related to the ID from the association information storage means for storing the correspondence between the ID and the information related to the ID transmitted or provided in advance; A related information display procedure for acquiring and displaying related information having a correspondence relationship from related information storage means for storing preset related information, and a video display procedure for displaying the received video. A related information providing and receiving method for a video is used as a solution.

Alternatively, an ID specified in advance during video reproduction
A related information providing receiving apparatus for a video to be provided with information set in advance when detecting a related information, a related information storage unit for storing the related information set in advance, and receiving the transmitted video. Video receiving means for transmitting
ID receiving means for receiving the ID, association information storing means for storing the correspondence between each ID transmitted or provided in advance, and information related to the ID, and correspondence information between the received ID and the information related to the ID. Related information search means for searching from the storage means, related information display means for obtaining and displaying related information having the searched correspondence from the related information storage means, and video display means for displaying the received video, A related information provision receiving apparatus for video, characterized by having:

Alternatively, an execution program of the related information providing / receiving method for video, which is a program for causing a computer to execute the procedure in the related information providing / receiving method for video, is a means for solving the problem.

Alternatively, a program for causing a computer to execute the procedure in the method for providing and receiving related information for a video described above is provided, and the program is recorded on a recording medium readable by the computer. A recording medium on which an execution program of the providing / receiving method is recorded is a means for solving the problem.

In the present invention, identification signal generating means for emitting a signal identifiable for each object is provided in the vicinity of the object to be imaged, and it is determined that the signal emitted from the identification signal generating means has entered the field of view of the image photographing means. Upon detection, the detected identification signal is converted into a pre-designated ID, and is superimposed on the video or transmitted in parallel, so that the ID is transmitted or provided to the video receiving side in advance and stored. Related information can be provided based on the information.

[0019]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a diagram illustrating the principle of the present invention. In the related coast information providing method according to the present invention, the image transmitting side detects that a signal emitted from the identification signal generating means enters the field of view of the image capturing means during the image capturing (process 11), and converts the detected identification signal. Converted to the ID specified in advance (Process 12),
The converted ID is superimposed on the video or transmitted in parallel (process 13).

The video receiving side searches for related information set in advance based on the received ID (process 21), and displays the related information together with the video (process 22).

According to this method, the identification signal generation means, the identification signal detection means, and the ID conversion means reduce the time and effort required to set the temporal position and the spatial position for each object in advance on the video transmitting side. It is possible to search for the association information from the association information storage unit based on the ID, and to obtain the related information set in advance from the association information storage unit based on the association information. Can be reduced in parallel.

For example, taking a baseball broadcast as an example, while a pitcher in the ground or a video hit by a batter is being broadcast, when a batter hits a home run, when an advertising sign enters the field of view in the video, a signboard is displayed. By detecting an identification signal emitted from the identification signal generation means provided horizontally and converting it into an ID and transmitting it, the receiving side can provide more detailed information related to the advertisement.

Next, an embodiment of the present invention will be described with reference to FIG.

The system according to the embodiment shown in FIG. 2 is provided near an object to be photographed, and generates identification signals for each object.
A transmitting device 400 that detects an identification signal emitted from the vicinity of an object to be photographed, converts the signal into an ID, and transmits the ID together with an image;
The receiving apparatus 500 includes a receiving apparatus 500 that receives a video and an ID, searches for and displays related information, and a related information storage unit 600 that stores preset related information.

The transmitting device 400 includes a video photographing means 410 such as a camera, an identification signal detecting means for detecting an identification signal emitted from the vicinity of an object to be photographed (for example, a device having a spectral function capable of measuring the wavelength of light). Etc.) 420, ID conversion means 4 for converting the detected identification signal into an ID designated in advance
30, an image transmitting unit 440 for transmitting a captured image, and an ID transmitting unit 450 for transmitting an ID.

Receiving device 500 includes video receiving means (for example, a network (NW) device or broadcasting equipment) 510 for receiving a video to be transmitted, and an ID for receiving a transmitted ID.
A receiving unit 520, an association information storage unit 530 such as a database or a file for storing an association between each ID provided or transmitted in advance and the corresponding information, and an association information storage unit 530 when an ID transmitted and received is detected.
Related information searching means 540 for searching for matching information corresponding to this ID from the corresponding information, and storing the related information corresponding to the ID received based on the searched matching information to the related information storing means 600.
Related information display means (for example, a monitor device or the like) 550 obtained and displayed from a computer, and video display means 56 for displaying video.
Has zero.

FIG. 3 shows that the ID conversion means 430 converts the identification signal detected by the identification signal detection means 420 into an I signal.
It is a figure showing the example of correspondence which changes into D. Here, an example is shown in which the identification signal is distinguished by the wavelength of light. If the signal from the identification signal generating means 300 contains infrared rays of a certain level or higher, the signal is converted to ID001 and transmitted. . Similarly, when the level of the ultraviolet ray is equal to or more than a certain level, it is converted to ID002 and transmitted. It is possible to discriminate the identification signal other than the wavelength of the light given as an example here. For example, the identification signal may be based on a feature amount such as color information, a shape, and a texture in an image.

FIG. 4 is a diagram showing an example in which the ID received by the ID receiving means 520 is associated with the related information in the association information storage means 530. Received ID is ID
001 indicates that “http // image A.bmp” is provided as related information. Similarly, if the received ID is ID00
In the case of 2, it indicates that "C: \ bar \ voice B.wav" is provided as the related information.

In the transmitting device 400, the video photographing means 4
10, the photographing range 10 is set to include the object 200.
It is assumed that 0 is photographed. At this time, the identification signal detecting means 4
At 20, an infrared signal (wavelength: 1 μm to 100 μm) having a predetermined level or higher is output from the identification signal generating means 300.
It detects that it is incident from the. ID conversion means 430
Then, based on FIG. 3, the detected identification signal is converted into ID001, and the ID is transmitted by the ID transmitting means 450 together with the video.

In the receiving apparatus 500, the ID receiving means 5
20, the transmitted ID is received, and the related information search means 540 searches the related information “http // image A.bmp” corresponding to the ID 001 based on FIG. 4. The search result is presented on the related information display means 550 together with the video.

It should be noted that the related information providing system for the video shown in FIG. 2 and a part or all of the functions of each means in the transmitting device or the receiving device constituting the system are constituted by a computer program, and the program is executed by the computer. The present invention can be implemented by executing using a computer. Alternatively, the procedure of the processing on the transmission side or the procedure of the processing on the reception side described with reference to FIG. Needless to say, a computer-readable recording medium such as an FD (Programmable Copy Program) for realizing the function of the computer or a program for causing the computer to execute the procedure of the processing can be executed by the computer. Floppy disk (registered trademark)), MO, OM, memory card, CD, DV
D, it can be recorded on a removable disk or the like, and stored or distributed. Further, it is also possible to provide the above program through a network such as the Internet or e-mail.

[0033]

As described above, according to the present invention, there is no need to set a temporal position and a spatial position with respect to an object in a video such as a non-storage system such as a live video.
Further, it is possible to provide the relevant information for the object in the video without burdening the video receiving side with calculating various kinds of feature amounts in parallel.

[Brief description of the drawings]

FIG. 1 illustrates the principle of the present invention.

FIG. 2 is a diagram showing an embodiment of the present invention.

FIG. 3 is a diagram showing an example of correspondence between an identification signal and an ID;

FIG. 4 is a diagram showing an example of correspondence between IDs and related information;

[Explanation of symbols]

100 ... shooting range 200… Object 300 ... Identification signal generating means 400 ... Transmission device 410 ... Video shooting means 420 ... Identification signal detecting means 430 ... ID conversion means 440 ... ID transmission means 450 ... Video transmission means 500 receiving device 510 ... Video receiving means 520 ... ID receiving means 530... Association information storage means 540... Related information search means 550... Related information display means 560 ... Video display means 600 ... related information storage means

   ────────────────────────────────────────────────── ─── Continuation of front page    F term (reference) 5C063 AB05 AB07 CA23 CA29 CA36                       DA07 DA13 EB04 EB35 EB37                 5C064 BA01 BB10 BC07 BC16 BC18                       BC20 BC23 BC25 BD02 BD08                       BD09 BD13    (54) [Title of the Invention] Related information providing method for video, system, transmission method, transmission device, transmission method execution program,                     Recording medium recording the program, receiving method, receiving apparatus, receiving program execution program, and program                     Recording medium recording gram

Claims (10)

[Claims] 1. A related information providing method for a video, which provides information set in advance when an ID specified in advance during video playback is detected. An association information providing procedure for transmitting or providing the correspondence of the information to the association information storage means on the receiving side in advance, a video shooting procedure for shooting a video by the video shooting means, and an identification installed near the object to be shot. An identification signal detection procedure for detecting that an identifiable signal for each object emitted from the signal generation means has entered the field of view of the video photographing means, and I for converting the detected identification signal into an ID designated in advance.
A D-converting procedure; a video transmitting procedure for transmitting the captured video; and an ID transmitting procedure for transmitting the converted ID. An ID receiving procedure for receiving the received ID, and the correspondence between the received ID and the information related to the received ID is retrieved from the association information storage means for storing the correspondence between each ID transmitted and provided in advance and the information related to the ID. A related information search procedure, a related information display procedure for acquiring and displaying the searched related information in a related information storage unit that stores preset related information, and a video display for displaying the received video. And a related information providing method for video. 2. A related information providing system for a video, which provides preset information when an ID specified in advance is detected during video playback, comprising: An identification signal generating unit that is installed and emits an identifiable signal for each object; an image capturing unit that captures an image; and detects that a signal emitted from the identification signal generating unit enters a field of view of the image capturing unit. Identification signal detecting means for converting the detected identification signal into an ID designated in advance
D conversion means, a video transmission means for transmitting the captured video, and a transmission device having an ID transmission means for transmitting the converted ID, and stores, on the reception side, relevant information set in advance. Related information storage means, video receiving means for receiving a transmitted video, ID receiving means for receiving a transmitted ID, storing a correspondence relationship between each ID transmitted or provided in advance and information related to the ID Association information storage means; related information search means for searching the association between the received ID and information related to the information from the association information storage means; obtaining and displaying related information in the searched correspondence from the related information storage means. A related information providing system for a video, comprising: a related information display unit that performs the processing; and a receiving device that includes a video display unit that displays the received video. 3. A related information providing transmission method for a video which provides information set in advance when an ID specified in advance is detected during video playback, wherein a correspondence relationship between each ID and information related to the ID is provided. Information providing procedure for transmitting or providing the information to the association information storage means on the receiving side in advance, a video capturing procedure for capturing video by the video capturing means, and an identification signal generating means installed near the object to be captured An identification signal detecting procedure for detecting that a signal identifiable for each object emitted from the object has entered the field of view of the video photographing means, and converting the detected identification signal into an ID designated in advance.
A related information providing transmission method for a video, comprising: a D conversion procedure; a video transmission procedure for transmitting the captured video; and an ID transmission procedure for transmitting the converted ID. 4. A related information providing / transmitting apparatus for providing an image which provides preset information when an ID specified in advance is detected during image reproduction, the image capturing means for capturing an image, Identification signal detection means for detecting that a signal identifiable for each object emitted from the identification signal generation means installed near the object in the vicinity of the object has entered the field of view of the video photographing means; and I to convert to pre-specified ID
A related information providing transmission apparatus for a video, comprising: a D conversion unit; a video transmission unit for transmitting the captured video; and an ID transmission unit for transmitting the converted ID. 5. A program for causing a computer to execute the related information provision transmission method for a video according to claim 3, wherein the program is executed by a computer. 6. A program for causing a computer to execute the procedure of the method for providing related information for a video according to claim 3, wherein the program is recorded on a recording medium readable by the computer. A recording medium on which an execution program for a method for providing and transmitting related information to a video is recorded. 7. A related information providing and receiving method for a video to be provided with information set in advance when an ID specified in advance is detected during video playback, and a video receiving procedure for receiving a video to be transmitted. An ID receiving procedure for receiving a transmitted ID; and an association information storage unit for storing the correspondence between each ID and the information associated with the ID, the correspondence between the received ID and the information related to the ID being transmitted or provided in advance. A related information search procedure for retrieving from the related information, a related information display procedure for acquiring and displaying related information having a corresponding relationship from a related information storage unit that stores preset related information, and displaying the received video. And a related image providing and receiving method for a video. 8. A related information providing / receiving apparatus for a video to be provided with information set in advance when an ID specified in advance is detected during video playback, wherein the related information provision receiving apparatus stores the related information set in advance. Related information storage means, a video receiving means for receiving a transmitted video, an ID receiving means for receiving a transmitted ID, and storing a correspondence relationship between each ID transmitted or provided in advance and information related to the ID. Related information storing means, related information searching means for searching the correspondence between the received ID and related information from the related information storing means, and related information having the searched corresponding relationship from the related information storing means. A related information providing / receiving apparatus for a video, comprising: related information display means for acquiring and displaying; and video display means for displaying the received video. 9. A program for causing a computer to execute the procedure in the method for providing and receiving related information for a video according to claim 7, wherein the program is a program for causing a computer to execute. 10. A program for causing a computer to execute the procedure of the method for receiving and providing related information for a video according to claim 7, wherein the program is recorded on a recording medium readable by the computer. A recording medium on which an execution program of a related information providing / receiving method for a video is recorded.