JP4354082B2 - Streaming video information linked content creation support method and apparatus, and streaming video information linked content creation support program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a streaming video information-linked content creation support method and apparatus and a storage medium storing a streaming video information-linked content creation support program, and in particular, when a video is played back over a network, In addition, a streaming video information-linked content creation support method and apparatus for creating content including an interface that promotes understanding of video content by changing information related to video, and a storage storing a streaming video information-linked content creation support program It relates to the medium.
[0002]
[Prior art]
With the spread of electronic computer networks and the explosive spread of computers, many images are being distributed over electronic networks. In particular, several systems for transmitting video one after another have been developed and used on an IP network called the Internet, which is currently most popular. For example, SoftwareVision (NTT), RealSystem (Real Networks), MediaTechnorogy (MicroSoft), QuickTime 4.0 (Apple), and the like are typical ones.
[0003]
[Problems to be solved by the invention]
However, since the IP network called the currently popular Internet tends to be small in capacity due to its structure and real-time communication is not necessarily guaranteed, as of 1999, video quality of analog TV broadcasting (NTSC, PAL, etc.) ) In most cases.
[0004]
Therefore, the video quality distributed over the current IP network is inevitably sacrificed in terms of time or space, or both, compared to the TV quality, compared to the video satisfying the TV broadcast quality. In general, only low video information can be transmitted.
[0005]
Further, there are cases where even real-time playback, which is an essential feature of video, is impossible under poor network conditions. Such a problem is common as of 1999 and is considered to occur in many scenes for a while. In addition, video is a medium that needs to be viewed for the length of time, and it is difficult to satisfy the demand for instantly grasping the content and viewing it only where necessary. This is because the video imposes a strong time constraint on the viewer.
[0006]
Therefore, as a proposal to easily grasp the contents of the video and make it easy to view, the information of the cut point (shot change) corresponding to the camera ON / OFF of the video information is extracted and immediately after the cut point. An attempt is made to support viewing by displaying the above video and arbitrarily reproducing the video section corresponding to the video immediately after the shot change in response to the viewer's request. One example is Yukinobu Taniguti, Yoshinobu Tonomura, “Panorama Excerpts: Extracting and packing Panoramas for Video Browsing” (1996 ACM Multimedia 97). This method automatically detects multiple images that may have important meaning in the video, and presents the list to the viewer to help the viewer understand the video content. The video section can be freely selected and viewed.
[0007]
In addition, a method using map information has been proposed as a supplement to video information. For example, Masatoshi Arikawa, “Spatial Browing for Video Database” (1998, AMCP'98). This method combines the position of the landscape contained in the video information and the map information, and the video is arranged on the map. When the map information is operated, the corresponding video is displayed. Can watch.
[0008]
These two examples are intended to support viewing of the video, and the video can be accessed and viewed from the auxiliary information. These can reproduce the video by receiving the operation of reproducing the video via the related auxiliary information by the viewer, but the related information accompanying the reproduction does not change.
[0009]
This is because the above-described two examples are based on the premise that the video is reproduced in high quality in real time and sufficient information can be transmitted. If the video is finally played back, the contents can be transmitted, so that it is only necessary to provide a clue until the auxiliary video is played back.
[0010]
However, streaming video over a network requires that the video be played under poor conditions as described above, so it is subject to temporal and spatial resolution restrictions, and video information alone is sufficient to transmit information. Often you can't.
[0011]
Therefore, in order to transmit information that is desired to be transmitted instead of using other information for the purpose of viewing the video, it is necessary to provide information by transmitting the auxiliary information related to the video in combination. .
[0012]
That is, instead of using related auxiliary information to view the video, it actively uses the auxiliary information related to the video, and actively uses it for the purpose of supplementing information that cannot be fully communicated with the video alone. If so, it may be possible to transmit sufficient information even under poor conditions.
[0013]
It can be realized by adding a script technology such as publishing and constructing an interface including such video and related auxiliary information on the Internet, and further combining the above format with a player that can be played back.
[0014]
However, html and Java, JavaScript, and VBScript used here have a problem that they cannot be easily written by ordinary people because of complicated description. Further, in the description, it is necessary to find out, calculate, and describe the timing of cueing the video linked with the related auxiliary information, but cueing the video is extremely difficult as described above.
[0015]
The present invention has been made in view of the above points, has a graphical interface that can be easily handled by general users, and handles content centered on typical control scripts such as html and JavaScript. It is an object of the present invention to provide a streaming video information linked content creation support method and apparatus, and a storage medium storing a streaming video information linked content creation support program.
[0016]
[Means for Solving the Problems]
The present invention (Claim 1) reproduces a video and auxiliary information related to the video in conjunction with each other via an electronic network, and performs an operation on the auxiliary information. In a streaming video information linked content creation support method for creating content that changes information,
Load video information,
Read related auxiliary information related to video information,
Various playbacks including special playback of video information,
Play back related auxiliary information,
Perform correspondence to make interlocking and associated auxiliary information and video information,
A script that describes how the video information and related auxiliary information are linked is output.
[0017]
The present invention (Claim 2) uses network video as video information.
[0018]
In the present invention (Claim 3), when the video information is in a video format other than the network video, the video information is converted into the network video format.
[0019]
The present invention (Claim 4), when converting the video information into the network video format,
Convert to network video using script and related auxiliary information.
According to the present invention (Claim 5) , the script is read when the degree of interlocking between the video information and the related auxiliary information is changed .
[0020]
The present invention (Claim 6) reproduces a video and auxiliary information related to the video in conjunction with each other via an electronic network, and performs an operation on the auxiliary information. A streaming video information linked content creation support device for creating content that changes information,
Video information reading means for reading video information;
Related auxiliary information reading means for reading related auxiliary information related to video information;
Playback control means for performing various playbacks including special playback of video information;
Related auxiliary information operating means for reproducing the related auxiliary information;
And associated auxiliary information operating means for performing correlation for make interlocking and associated auxiliary information and video information,
Script processing means for outputting a script describing a state of interlocking between the video information and the related auxiliary information.
[0021]
The present invention (Claim 7) uses network video as video information.
[0022]
The present invention (Claim 8) includes conversion means for converting the video information into the network video format when the video information is in a video format other than the network video.
[0023]
According to the present invention (claim 9), in the conversion means,
Using the script and the related auxiliary information , it is converted into a network video.
The present invention (Claim 10) includes means for reading a script when the degree of interlocking between the video information and the related auxiliary information is changed .
[0024]
The present invention (Claim 11) is characterized by storing a program for causing a computer to function as each means constituting the streaming video information linked content creation support apparatus according to any one of Claims 6 to 10. A computer-readable storage medium.
[0028]
Correspondence to read video information and related auxiliary information related to network video, perform various playbacks including special playback of video information, play related auxiliary information, and link video information and related auxiliary information as above Output the script describing the operation process of the linked operation of the video information and the related auxiliary information, it is possible to freely read and save the result of the association between the related information and the video information, Information reusability increases, versatility increases, and editing is easy, making it possible to easily associate video information with related auxiliary information, and many people who do not know scripts can easily create content. It becomes possible to do.
[0029]
The present invention can also use a network video as the video information.
[0030]
Further, according to the present invention, even if the video information is a video format other than the network video, the video format can be converted into the network video format. At the time of conversion, it becomes possible to convert to network video while maintaining the link correspondence information with related auxiliary information, and when constructing the interface that performs linked playback between the final network video and related auxiliary information, When the association for the linkage of the related auxiliary information and the related auxiliary information is associated with either the network video itself or a video format other than the network video format, the final association is performed. The result will be obtained.
[0031]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 shows the configuration of a streaming video information linked playback support apparatus of the present invention.
[0032]
The apparatus shown in FIG. 1 includes a video information reading unit 11, a related auxiliary information reading unit 12, a video information reproduction control unit 13, a related auxiliary information operation unit 14, an interlocking control unit 16, and a script processing unit 17.
[0033]
In the figure, there is video information a and related auxiliary information b to be reproduced and displayed in relation to the video information a and is transmitted through a network as appropriate.
[0034]
The video information a is read into the video information reading unit 11 and the related auxiliary information reading unit 12 and sent to the video information reproduction control unit 13 and the related auxiliary information operation unit 14 so that the user can handle them.
[0035]
As described above, when a third party can handle the information, the information is sent to the interlocking control unit 16 in order to associate the video information with the related auxiliary information so as to change with time. And a response is attached. At this time, in order to cope with each of them, the video information playback control unit 13 plays back only a part of the video. Further, detailed work for association such as selecting related information occurs.
[0036]
As described above, when the video information and the associated auxiliary information are associated with each other, the information is described as the interlocking operation process description c for those schemes. This information is sent to the script processing unit 17 to construct an interface that performs the same operation on the browsing interface on the Internet.
[0037]
FIG. 2 is a flowchart showing the operation of the storming video information linked content creation support apparatus of the present invention.
[0038]
First, in the video information reading unit 11, the input video information a is read (step 101). The video information a may be in a network video format or in other formats.
[0039]
In cases other than the network video format, the video format data is converted into video information by a conversion unit (not shown) in the video information reading unit 11 (step 103). The conversion to video information may be any method as long as it can be converted into network video information.
[0040]
The video information a read in this way is input to the video information playback control unit 13 to enable playback and display including special playback functions such as fast forward, rewind, slow, and top feed. Note that special playback may have a function of jumping at every scene change (scene change) based on image difference information included in video information. The user can freely display and play back video by operating the video information playback control unit 13 (step 104).
[0041]
On the other hand, the input related auxiliary information b, which is the input material of the related auxiliary information that is reproduced and displayed in conjunction with the video information a, is read by the related auxiliary information reading unit 12 (step 105). The type of the related information may be image, text, music information, or special information including other 3D objects. At this time, data such as various images, texts, music, and videos may be processed. Even if the data itself is not processed, it is only necessary to add a control script that gives an instruction for processing the data. These related auxiliary information can be freely operated by the user by the related auxiliary information operation unit 14 (step 106). For example, it is possible to perform operations such as selecting information closely related to video information from the related auxiliary information of interest.
[0042]
In the processing so far, the user can issue an operation command to each of the video information and the related auxiliary information with a simple operation.
[0043]
Next, the video information and the related auxiliary information are associated with each other so that the related auxiliary information can be changed in conjunction with the reproduction and display of the network video (step 107). As an example, a scene transition in a video is associated with related information (for example, the name of the scene). In addition to this, processing and operations such as displaying an image when a scene is reached, switching an image to be displayed, playing music, changing the music to be played back to normal, and the like are performed. Other specific examples will be described later.
[0044]
When the association of these operations is completed, the linked operation process description C is input to the script processing unit 17. The script processing unit 17 has a function of writing the state of interlocking between the network video described in the interlocking operation processing description c and the related auxiliary information to an output to be executed by an Internet browser, and outputs the script d ( Step 108). Information on the Internet is displayed by using this script, the video information itself or a network video obtained by converting from another format, and related auxiliary information.
[0045]
If it is desired to change the degree of linkage between the video information and the related auxiliary information (step 109), the script processing unit 17 reads the output script d again. Through this process, the script is interpreted, the linked operation description is read, and it is possible to know how it is set. It is assumed that this script has a sufficient function of interpreting a script that can be interpreted by a plug-in related to a browser of a terminal connected to the Internet.
[0046]
【Example】
Embodiments of the present invention will be described below with reference to the drawings.
[0047]
[First embodiment]
FIG. 3 is a diagram for explaining the first embodiment of the present invention. In the figure, how the video information and the related auxiliary information are linked will be described. In the figure, a part of the video is used as related auxiliary information. Specifically, the video immediately after the scene change, which is the transition of the scene in the video, is used.
[0048]
Before explaining what operation is performed in this embodiment, an outline of an interface to be output by this embodiment will be described.
[0049]
This will be described using the output result interface shown in FIG. This interface shows one screen of a network browser, and there are streaming video and shot change group images. When the mouse, which is the instruction pointer, is superimposed on the image of the shot change group, only the image is switched. As shown in the switching procedure using the mouse in FIG. 5B, when the mouse is over the image (a), the images (a) to (b) are displayed. When clicked, reproduction starts from the starting point associated with (A), and the image display changes to (C). This operation occurs whether or not the video is being played back. Note that, as video playback continues, the video section changes, so the image area associated with the video section changes. In this case, the next image of the image (A) is targeted, heretofore as in (A) (c) is displayed, the same image is displayed.
[0050]
A tool for creating this content is the present embodiment.
[0051]
That is, as a necessary function, an image corresponding to images (a), (b), and (c) must be associated with a specific section of video information. Regarding the reading of the video, the reading is started by the video reading button that instructs the reading of the video 52. Thereby, the video information 52 is acquired. On the other hand, regarding the reading of the image group corresponding to the related auxiliary information, reading is started by the image group reading instruction 55. When reading, all images may be read one by one. However, since it is necessary to read a large number of images, a list to be read is prepared in advance, and when the list is read, the image group is automatically read. May be read.
[0052]
Next, a method for associating the read image group with the video will be described. What is required for the association is a video section, that is, a certain section from a certain start point to an end point of the video, and information on how the images (a) (b) (c) should be associated with the section. I need it. Therefore, on the image side, for example, an independent window 55 is displayed and associated in order to make such a description. In this window 55, a corresponding image and a corresponding section are designated. For example, when the item “Default” in the window 44 is clicked with the mouse, “Default” is inverted, and if an image is selected, it is replaced with the target image. Do the same for “Over” and “Click”. That is, when images (A), (B), and (C) are targeted, (A), (B), and (C) are selected for “Default”, “Over”, and “Click”, respectively. Next, regarding the designation of the video section, similarly, “Start” and “Stop” are reversed, and in this state, clicking “Time” indicating the video time can be associated. By repeating this process for each image group, it is possible to perform association for interlocking the video and the image group. When this process is repeated and the association is completed, an output instruction is given via the script output process button 56, and a final script is output.
[0053]
These kinds of scripts can be easily constructed using various Internet script technologies such as html + JavaScript, Html + VBScript, and Html + Java. In this embodiment, output is performed using html + JavaScript.
Furthermore, this embodiment has a function of re-reading such html + JavaScript. First, when implementing such linked functions using Html + JavaScript, a JavaScript Function that switches the display and starts video playback when the mouse is over or clicked from the <IMG> tag of html. The format to call
This
<IMG SRC = "deault image" OnClick = "JavaScript: ClickFunc (S)" OnOver = "JavaScipt: OverFunc (E)">
It becomes. That is, most information is given as an argument of the <IMG> tag. By reading this, it is possible to read the playback timing of the video and the image group, read the correspondence for interlocking, and reproduce the state being edited in this embodiment.
[0054]
In the present embodiment, when the association is performed, a digital video format other than the network video format is considered. Therefore, a function of outputting a network video format using this as an input is provided. In the construction, it may be included as a program or data may be handed over to an external program. In this case, the external program is activated to perform processing.
[0055]
As a result, the correspondence between the video information that is not in the network video format as the input, the video information in the network video format that is designated as the output and the list group indicating the image group, and the image information that is the video information and related auxiliary information And a script describing the behavior.
[0056]
[Second Embodiment]
In this embodiment, an example is shown in which map information is used as related auxiliary information instead of shot change information.
[0057]
FIG. 4 shows an example when map information is used for the related auxiliary concessions of the second embodiment of the present invention, and FIG. 5 is a diagram for explaining the second embodiment of the present invention.
[0058]
The content of the streaming video changes every moment, and it is assumed that various locations on the map are being shot. With the reproduction of the streaming video, in the related auxiliary information display, the position on the map corresponding to the landscape included in the video is highlighted. Various kinds of highlighting may be considered such as the image content may be reversed, the periphery may be surrounded, or the image may be displayed larger than other images. Here, it is assumed that the color on the map changes. Accordingly, as the streaming video is played back and displayed, the map information, which is related auxiliary information, goes through a process of returning after changing color one after another.
[0059]
On the other hand, when the viewer wants to view a video in which a specific area of the map information is captured, the specific area is specified with a pointing device or the like, and the corresponding area is recorded by performing an operation. Play and display the corresponding section of the streaming video.
[0060]
The difference between the present embodiment and the first embodiment described above is that the information as the related auxiliary information is map information. Unlike the shot Chen Di image information immediately after, a different image size, the arrangement of the image is not that it is sufficient to just list, adjacent relationship between the images becomes severe.
[0061]
In this embodiment, the position information is fixed by using the html Table environment. Specifically, it is as follows.
<TABLE>
<TR>
<TD>
<IMG SRC = "deault image" OnClick = "JavaScript: ClickFunc (S)" OnOver = "JavaScipt: OverFunc (E)">
</ TD>
...
</ TABLE>
Therefore, in the first embodiment, the <IMG> tag is handled as an analysis target, but in the future, a <TABLE> related tag will be handled as an analysis target. Describe the positional relationship between <IMG> tags enclosed in <TR></TR>,<TD></TD>, and reproduce it to maintain the positional relationship and maintain the image group and video. It provides an interface that realizes the association of relationships. Except for the arrangement relationship of the images, the second embodiment is the same as the first embodiment, and the detailed operation and the like are not described here.
[0062]
Two examples have been described above. Here, it is conceivable to handle music, text, video, and the like as the image auxiliary information. If it is a text, it can be handled as a specific area like an image. In the case of music or video, it is difficult to define the corresponding section in the time series, but it can be sufficiently handled by specifying the start and end times.
[0063]
2 is constructed as a program and stored in a portable storage medium such as a disk device connected to a computer used as a streaming video information linked content creation support device, a floppy disk, or a CD-ROM. It should be noted that the present invention can be easily realized by installing it when implementing the present invention.
[0064]
The present invention is not limited to the above-described embodiments, and various modifications and applications are possible within the scope of the claims.
[0065]
【The invention's effect】
As described above, according to the present invention, when viewing a streaming video for viewing a video over a network, the supplementary information is supplemented with the missing information and the related auxiliary information for freely viewing any video. By linking, it is possible to easily construct an interface for effectively transmitting information by video even on a restricted network.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a streaming video information linked content creation support apparatus of the present invention.
FIG. 2 is a flowchart showing an operation of the streaming video information linked content creation support apparatus of the present invention.
FIG. 3 is a diagram for explaining a first embodiment of the present invention.
FIG. 4 is a diagram showing an example when map information is used as related auxiliary information according to the second embodiment of the present invention.
FIG. 5 is a diagram for explaining a second embodiment of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 11 Image | video information reading part 12 Related auxiliary | assistant information reading part 13 Image | video information reproduction | regeneration control part 14 Related auxiliary | assistant information operation part 16 Interlocking corresponding | compatible control part 17 Script processing part 50 Image | video information 51 Related auxiliary | assistant information 52 Image | video information reading instruction | indication 53 Information screen by mouse click Display 54 Screen selection scroll button 55 Window 56 for inputting relation description with video 56 Script output 57 Video conversion button 61 Related auxiliary information a Video information b Related auxiliary information c Interlocking operation process description d Script

Claims (11)

Play back video and auxiliary information related to the video via electronic network and operate the auxiliary information to create contents that change the video and auxiliary information. In the streaming video information linked content creation support method for
Read the video information,
Read related auxiliary information related to the video information,
Perform various playbacks including special playback of the video information,
Replaying the related auxiliary information,
Perform correspondence to make interlocked with the associated auxiliary information and the video information,
A streaming video information linked content creation support method, comprising: outputting a script describing a state of linkage between the video information and the related auxiliary information.   The streaming video information linked content creation support method according to claim 1, wherein a network video is used as the video information.   2. The streaming video information linked content creation support method according to claim 1, wherein when the video information is a video format other than a network video, the video information is converted into a network video format. When converting the video information into a network video format,
4. The streaming video information linked content creation support method according to claim 3, wherein the script and the related auxiliary information are used to convert into a network video. The streaming video information linked content creation support method according to claim 1 , wherein the script is read when the degree of linkage between the video information and the related auxiliary information is changed . Play back video and auxiliary information related to the video via electronic network and operate the auxiliary information to create contents that change the video and auxiliary information. A streaming video information linked content creation support device for
Video information reading means for reading the video information;
Related auxiliary information reading means for reading related auxiliary information related to the video information;
Reproduction control means for performing various reproductions including special reproduction of the video information;
Related auxiliary information operating means for reproducing the related auxiliary information;
And associated auxiliary information operating means for performing correlation for make interlocked with the associated auxiliary information and the video information,
A streaming video information linked content creation support device, comprising: script processing means for outputting a script describing a state of linkage between the video information and the related auxiliary information.   The streaming video information linked content creation support device according to claim 6, wherein a network video is used as the video information.   7. The streaming video information linked content creation support apparatus according to claim 6, further comprising a converting means for converting the video information into a network video format when the video information is in a video format other than the network video. The converting means includes
9. The streaming video information linked content creation support apparatus according to claim 8, wherein the script and the related auxiliary information are used to convert into a network video. 7. The streaming video information linked content creation support apparatus according to claim 6 , further comprising the script unit when changing a degree of linkage between the video information and the related auxiliary information . 11. A computer-readable storage medium storing a program for causing a computer to function as each means constituting the streaming video information linked content creation support apparatus according to claim 6.

Images