JP2001292385A - Streaming video image reproducing method, streaming video image reproducing device and recording medium in which streaming video image reproduction programs is recorded - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide technology to transmit sufficient information to a user even in the streaming video image with bad quality and to make a part which is desired to be viewed possible to be viewed SOLUTION: This streaming video image reproducing method reproduces the streaming video image transmitted via a network, displays the video image together with related supplementary information and is constituted so as to receive the streaming video image, to extract prescribed information to be included in the streaming video image and to change the related supplementary information according to a preliminarily given scenario, based on the prescribed information. In addition, when an operation is added to the related supplementary information, the streaming video image according to the operation is reproduced by using the scenario.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for promoting the understanding of the contents of a video by using related auxiliary information when reproducing the video via a network.

[0002]

2. Description of the Related Art With the spread of electronic computer networks and the explosion of computers, many images are distributed on electronic networks. In particular, several systems for transmitting video one after another over the most popular IP network called the Internet have been developed and used. For example, Softwa
reVision (NTT), RealSystem (Real Networks), Me
diaTechnology (MicroSoft), QickTime4.0 (Apple
) Are representative of them.

[0003] However, the IP network which is currently widely used, called the Internet, has a small capacity due to its structure, and real-time communication is not always guaranteed. Therefore, at present, it does not satisfy the video quality of analog TV broadcasting. Things are mostly. Therefore, the video quality delivered over the current IP network is compelled to sacrifice one or both of time and space compared to TV quality, and is lower than video that satisfies TV broadcast quality. Generally, only video information can be transmitted. Further, under poor network conditions, there are cases where even real-time reproduction, which is an essential feature of video, cannot be performed. These problems are common at the present time, and will be problems that will occur in many situations in the future.

In order to understand the contents of a video, it is necessary to watch the video for the length of time, and it is possible to easily grasp the contents and easily meet the demand for viewing only the necessary places. It is a difficult media. This is because the video imposes a strong time constraint on the viewer.

Therefore, the contents of the video can be easily grasped, and
One proposal to make viewing easier is to extract the information of the cut point (shot change) corresponding to the camera ON / OFF of the video information, display the video immediately after the cut point, and respond to the viewer's request. There is an attempt to support viewing by arbitrarily reproducing a video section corresponding to a video immediately after a shot change. One example is Yukinobu Tanigu
chi, Yoshinobu Tonomura, "PanoramaExcerpts: Extr
acting and packing Panoramas for Video Browsing ''
(1996 ACM Multimedia 97). This method automatically detects multiple images that are considered to have important meaning in the video, makes the viewer present a list of the images, helps the viewer understand the video content, Video sections can be freely selected for viewing.

[0006] As a complement to video information, there has also been proposed one using map information. For example, Ma
satoshi Arikawa, Tetsu Kamiyama, `` Spatial Browsi
ng for Video Databases "(1998, AMCP'98). This method combines the position of the scenery contained in the video information and the map information, and the video is arranged on the map. You can watch.

The purpose of these two examples is to support viewing of a video, and it is possible to access and view the video from auxiliary information. These can reproduce the video by receiving the operation of reproducing the video via the related auxiliary information by the viewer, but the related information does not change with the reproduction.

This is because the above two examples are based on the premise that video is reproduced in high quality in real time and sufficient information can be transmitted. If the video is high-definition, the content can be transmitted by finally playing back the video, so the auxiliary information is used only as a clue until the video is reproduced.

[0009]

However, streaming video on a network is required to reproduce the video under poor conditions as described above. It cannot be assumed that the video will be played in high quality in real time.

[0010] Therefore, the content of the streaming video cannot be sufficiently transmitted only by using the auxiliary information as a clue until the reproduction is performed as in the above-described conventional technology.

SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and enables sufficient information to be transmitted to a user even with poor video quality of a streaming video on a network, and instantaneously grasps the content of the streaming video. And
It is an object of the present invention to provide a branch technique that allows a user to easily view a desired place.

[0012]

To achieve the above object, the present invention is configured as follows.

[0013] The invention described in claim 1 is a streaming video reproducing method for reproducing a streaming video transmitted through a network and displaying the streaming video together with related auxiliary information. The method includes an extracting step of extracting predetermined information included in the streaming video, and a changing step of changing the related auxiliary information according to a scenario given in advance based on the predetermined information.

According to a second aspect of the present invention, in the above configuration, the predetermined information is reproduction time information of a streaming video, and the scenario corresponds to the reproduction scene displayed at the time of video reproduction in the related auxiliary information. The image identification name shall include information described in association with the playback time of the streaming video, the changing step is a step of reading from the scenario the image identification name corresponding to the playback time information extracted in the extraction step, Switching the image displayed during non-video reproduction of the scene corresponding to the reproduction time information in the related auxiliary information to the image with the image identification name.

According to the above invention, the related auxiliary information is changed in accordance with the scenario based on the predetermined information.
In addition to viewing the streaming video obtained via the network, the user can also view the related auxiliary information linked to the streaming video, and the related auxiliary information conveys the content of the streaming video. In addition, it is possible to sufficiently transmit information even on a network that is likely to fall into a bad condition.

That is, instead of using other information for the purpose of viewing a video, in order to convey the content of the information to be transmitted, auxiliary information related to the video is combined,
Provide information. Rather than using related auxiliary information to watch video, actively use related auxiliary information related to video and actively use it to supplement information that is not sufficiently conveyed by video alone This allows sufficient information to be transmitted even under adverse conditions.

According to a third aspect of the present invention, in the above configuration, when an operation is performed on the related auxiliary information, a streaming step of reproducing a streaming video corresponding to the operation using the scenario is performed. This is a video playback method.

According to a fourth aspect of the present invention, in the above-mentioned configuration, said predetermined information is reproduction time information of a streaming video, and said scenario is that information of each part in said related auxiliary information is represented by a reproduction time of a streaming video. The information includes information described in association with information, and the reproducing step includes a step of obtaining information of a part operated in the related auxiliary information, and reading reproduction time information corresponding to the information of the part from the scenario. And a step of reproducing a streaming video corresponding to the reproduction time information.

According to the above invention, a desired streaming video can be reproduced by performing an operation on the related auxiliary information while the related auxiliary information linked with the streaming information is being displayed. The operation includes, for example, clicking a desired part with a mouse.

According to a fifth aspect of the present invention, there is provided a streaming video reproducing apparatus which reproduces a streaming video transmitted via a network and displays the streaming video together with related auxiliary information.
An extracting unit for extracting predetermined information included in the streaming video; and a changing unit for changing the related auxiliary information according to a scenario given in advance based on the predetermined information.

According to the invention described in claim 6, in the above configuration, the predetermined information is reproduction time information of a streaming video, and the scenario corresponds to the reproduction scene displayed at the time of video reproduction in the related auxiliary information. Means for reading the image identifier corresponding to the playback time information extracted by the extraction means, from the scenario, including information describing the image identifier to be associated with the playback time of the streaming video. A means for switching an image displayed during non-video reproduction of a scene corresponding to the reproduction time information to the image with the image identification name in the related auxiliary information.

According to a seventh aspect of the present invention, in the above configuration, when an operation is performed on the related auxiliary information, the streaming video includes a reproducing means for reproducing the streaming video corresponding to the operation using the scenario. It is a playback device.

According to the invention described in claim 8, in the above configuration, the predetermined information is reproduction time information of a streaming video, and the scenario is that information of each part in the related auxiliary information is represented by a reproduction time of a streaming video. The reproducing means includes information described in association with information, wherein the reproducing means obtains information of a part operated in the related auxiliary information, and reads reproduction time information corresponding to the information of the part from the scenario. And a means for reproducing a streaming video corresponding to the reproduction time information.

According to the invention described in claims 5 to 8,
A streaming video playback device suitable for the streaming video playback method according to any one of claims 1 to 4 can be provided, and the same effects as described above can be obtained.

According to a ninth aspect of the present invention, there is provided a recording medium which records a streaming video reproducing program for causing a computer to execute a process of reproducing a streaming video transmitted via a network and displaying it together with related auxiliary information. A receiving procedure for receiving a streaming video, an extracting procedure for extracting predetermined information included in the streaming video, and a changing procedure for changing the related auxiliary information according to a scenario given in advance based on the predetermined information. Is a recording medium on which a streaming video reproduction program to be executed by the user is recorded.

In the invention described in claim 10, in the above configuration, the predetermined information is reproduction time information of a streaming video, and the scenario corresponds to the reproduction scene displayed at the time of video reproduction in the related auxiliary information. Including information describing the image identifier to be associated with the playback time of the streaming video, wherein the changing step is a step of reading the image identifier corresponding to the playback time information extracted in the extraction step from the scenario, Switching the image displayed during non-video reproduction of a scene corresponding to the reproduction time information to the image with the image identification name in the related auxiliary information.

[0027] The invention described in claim 11 is the above-mentioned configuration, wherein, when an operation is performed on the related auxiliary information, a reproduction procedure for reproducing a streaming video according to the operation using the scenario is included.

[0028] In the invention according to claim 12, in the above-mentioned configuration, the predetermined information is reproduction time information of a streaming video, and the scenario is a method of converting information of each part in the related auxiliary information into a reproduction time of a streaming video. The information includes information described in association with the information, and the reproduction procedure includes:
A step of obtaining information of a portion operated in the related auxiliary information, a step of reading reproduction time information corresponding to the information of the portion from the scenario, and a step of reproducing a streaming video corresponding to the reproduction time information And

According to the ninth to twelfth aspects of the invention, it is possible to provide a recording medium on which a program for executing the method according to the first to fourth aspects on a computer is installed, and the program is installed in the computer. This makes it possible to provide a computer having the same functions and effects as the apparatus according to the fifth to eighth aspects.

[0030]

FIG. 1 shows a system configuration diagram to which the present invention is applied. As shown in the figure, the streaming video providing apparatus 1 supplies a video to the streaming video information linked playback apparatus 5 via the network 3. Further, the auxiliary information providing device 7 for providing the scenario and the related auxiliary information supplies the scenario and the related auxiliary information to the streaming video information linked playback device 5 via the network. It should be noted that the streaming video providing device 1 and the auxiliary information providing device 7 can be the same device. The scenario and the related auxiliary information may be generated by the streaming video information linked playback device 5. The streaming video information linked playback device may be referred to as a streaming video playback device. Here, in order to clarify that the linkage with the related auxiliary information is performed using the information of the streaming video, it is referred to as a streaming video information linked playback device.

The streaming video supplied by the streaming video providing apparatus 1 is a digital video that can be output while reproducing the reproduction time information and the like. It is necessary to have a function capable of transmitting only the section to be reproduced from the network without storing the streaming video data. That is, it is necessary to have an interface capable of realizing a function of reproducing a time section specified by an external command command and ending the specified section. All of the streaming video examples provided by the system described in the section of the prior art described above satisfy this condition.

The related auxiliary information is a part of the streaming video or information obtained by processing the streaming video, map information closely related to the streaming video, another video or another image closely related to the streaming video. Or a text that is closely related. For example, Yukinobu Taniguchi, Yo
shinobu Tonomura, “PanoramaExcerpts: Extracting a
nd packing Panoramas for Video Browsing "(1996 AC
The shot change information output by the shot change technique in M Multimedia 97) and the image immediately after the shot change can be used as scenario and related information, respectively.

In the case where a scene on a video is associated with map information and a scene on a map is displayed, the scenario is a correspondence between the scene on the video and the scene on the map. This is, for example, Masatoshi Arikawa, Tetsu Kami
yama, "Spatial Browsing for Video Databases" (199
8, AMCP'98), can be generated using GPS. That is, since the shooting time and the latitude and longitude of the shooting can be known from the GPS, it is possible to record the place and time at which the video was shot. In addition, the scenario and the related auxiliary information can be obtained by various methods.

FIG. 2 shows the configuration of the streaming video information linked playback device 5 in one embodiment of the present invention. As shown in the figure, a streaming video information linked playback device 5 of the present invention includes a streaming video playback control means 9 for playing and controlling streaming video, a playback display means 11 for playing and displaying streaming video, and a display of related auxiliary information. Related auxiliary information control means 13 for controlling, related auxiliary information display means 15 for displaying related auxiliary information, inter-control communication means 17 for linking the streaming video reproduction control means 9 and related auxiliary information control means 13, related auxiliary It has a related auxiliary information indicating means 19 for giving an operation instruction to the information. Also, as described above, the streaming video information linked playback device 5 is connected to the network 3 and receives streaming video, scenarios, and related auxiliary information.

The streaming video is displayed through the playback display means 11 while the streaming video reproduction control means 9 controls normal play and trick play such as pause and fast forward. As a result, the viewer 4 views the streaming video.

The related auxiliary information is stored in the related auxiliary information control unit 1.
3, a control for performing a normal display or a special display such as a display changed in conjunction with the streaming video as described later is performed.
The related auxiliary information is displayed.

The scenario is given to the inter-control communication means 16 via the network 3. The inter-control communication unit 16 transmits the video reproduction time information obtained from the streaming video reproduction control unit 9 to the related auxiliary information control unit 13. The related auxiliary information control means changes the related auxiliary information together with the given time information as described in the scenario. As a result,
Receives related auxiliary control information that changes according to the streaming video and the scenario.

On the other hand, the viewer can send a request to the related auxiliary information control means 13 via the related auxiliary information instruction means 19 to cause a change.
If the change given to the related auxiliary information is described in the scenario, some change is given to the streaming video. If the streaming video changes,
The streaming video reproduction control means 9 communicates with the related auxiliary information control means 13 via the inter-control communication means 17 as before.
The information is transmitted to the viewer, and the viewer is given the display of the streaming video finally changed and the display of the related auxiliary information changed together.

Next, the operation of the streaming video reproduction control means 9, the related auxiliary information control means 13, and the inter-control communication means 17 will be described. Here, the outline will be described. Details will be described later using a specific example.

As described above, the streaming video and the related auxiliary information are appropriately controlled by the streaming video reproduction control means 9 and the related auxiliary information control means 13, and necessary information is synchronized via the inter-control communication means 17. While the reproduction display means and the related auxiliary information display means 15
, And can be seen by the viewer.

At this time, the streaming video reproduction control means 9 extracts, for example, reproduction time information as information which can be easily extracted from the video information which is time-series information, and transmits the information to the inter-control communication means 17. In addition, telops attached to each image in the video, shot change, information obtained by analyzing the image content in the streaming video, for example,
Various information such as a person, an object, a color, brightness, and area information may be extracted and transmitted.

The related auxiliary information control means 13 extracts and uses only information necessary for controlling the related auxiliary information from a plurality of pieces of information sent from the streaming video reproduction control means 9 via the inter-control communication means 17. . Similarly, the related auxiliary information control means 13 gives a repetition command to the streaming video reproduction control means 9 via the inter-control communication means 17.
For example, start, end, pause, fast forward,
In addition to trick play such as slow, reverse, and jump to an arbitrary section, an operation command and necessary information relating to brightness adjustment, change of a specific area, and the like are transferred.

On the other hand, the viewer can display the related auxiliary information display means 15.
It is possible to give a request to the related auxiliary information control means 13 via the related auxiliary information instructing means 19 in order to perform an operation on the related auxiliary information displayed by. The related auxiliary information control means 13 receives this request and sends the request to the streaming video reproduction control means 9 via the inter-control communication means 17.
And reproduces and displays an arbitrary video section while maintaining a synchronized state in which the streaming video and the related auxiliary information are linked in accordance with the scenario.

Next, FIGS. 3 and 4 show examples of screen display by the streaming video information linked playback apparatus of the present invention.

FIG. 3 is a diagram showing an example in which a part of a streaming video is used as related auxiliary information. In this example, using the above-described shot change technique, information in which an image immediately after a shot change is arranged from video content previously used as a streaming video is used as related auxiliary information. The image right after this shot change is
It is assumed that the image represents a video section up to the image immediately after the next shot change.

As shown in FIG. 3B, when the streaming video is reproduced, the image representing the corresponding video section is highlighted. This highlighting can be performed in various ways, such as inverting the image content, surrounding the image, or displaying a larger image than other images. here,
It shall be underlined. As the reproduction of the streaming video advances, the underlined image changes sequentially.

On the other hand, when the viewer wants to reproduce an arbitrary portion of the streaming video, this is realized by giving a command to a corresponding video section. Generally, these interfaces are realized by a computer display, and an arbitrary streaming video is reproduced by selecting with a mouse operation.

Next, another example is shown in FIG.

This example is an example in which map information corresponding to a landscape shot by a streaming video is used as related auxiliary information. The content of the streaming video changes every moment, and it is assumed that various places on the map are photographed. As shown in FIG. 4B, with the reproduction of the streaming video, in the related auxiliary information display, the position on the map corresponding to the scenery included in the video is highlighted. For the highlighting, various things can be considered, such as the image content may be inverted, the surroundings may be surrounded, or the image may be displayed larger than other images. Here, it is assumed that the color on the map changes. Therefore, as the streaming video is played back and displayed, the map information, which is related auxiliary information, goes through a process of successively changing colors and returning.

On the other hand, when the viewer wants to view a video image of a specific area on the map, the viewer designates the specific area with a pointing device or the like and performs an operation to specify the corresponding area. The corresponding section of the recorded streaming video is reproduced and displayed. Streaming video reproduction control means 9 and related auxiliary information control means 1 as described above
The interlocking between the three is realized by the inter-control communication unit 17 which manages between the streaming video reproduction control unit 9 and the related auxiliary information control unit 13 interpreting the scenario. The control communication means 17 constantly monitors the state of the streaming video. Generally, it is known whether the video is being reproduced, stopped, or paused. If possible, it is possible to obtain information on who has stepped into the image, such as who is photographing where.

If the streaming video is being reproduced, the relative reproduction time of the streaming video being reproduced is obtained. Since it is specified in the scenario that the related information is switched according to the video playback time, the related auxiliary information is changed according to the scenario description.

On the other hand, the inter-control communication means 17 constantly monitors a predetermined operation given to the related auxiliary information from the viewer. For example, the position of the mouse click is confirmed according to the rule that when the user clicks on the image group, the reproduction is started from the corresponding streaming video section, and a command is given to the streaming video.

Hereinafter, an example of the operation of the present invention will be described more specifically using the example shown in FIG. 5 as the related auxiliary information. FIG. 6 shows an example of a scenario corresponding to the display of FIG.

In FIG. 6, "place name" indicates each place of the related auxiliary information. “START” indicates the time at which the video of each location starts in the stream video (relative time from the start of the video), and “STOP” indicates the time at which the video of that location ends. These times correspond to the playback time of each location in the actual stream video.

The "basic image" indicates an image to be displayed corresponding to each location of the related auxiliary information. In this case, the image file name is indicated. FIG. 5 shows a place name and a corresponding basic image. Further, “when the mouse cursor is placed” indicates a file name of an image to be displayed when the mouse cursor is placed at each location on the display screen of the related auxiliary information. This makes it possible to clearly indicate where the video to be viewed is specified. Specifically, various forms of images such as images in which the color and tone of the basic image are changed can be used. “When playing back video”
The figure shows the image displayed at the corresponding location in the display of the related auxiliary information while the streaming video of each location is being displayed. As described in the example of FIG. 4, the image corresponding to the image during the reproduction of the image is an image of various forms such as an inverted image content, a surrounding image, a larger display than other images, and a change in color. Can be used.

FIG. 7 is a diagram showing, in chronological order, changes in related auxiliary information accompanying video reproduction. The operations of the streaming video reproduction control means 9, the inter-control communication means 17, and the related auxiliary information control means 13 will be described in detail with reference to FIG.

As shown in the figure, as the video reproduction by the streaming video reproduction control means 9 proceeds, the images in the related auxiliary information are switched. That is, the inter-control communication means 17 obtains the reproduction time information of the streaming video, reads the corresponding image information from the scenario by comparing it with the time information described in the scenario shown in FIG. And the related auxiliary information control means 13 causes the related auxiliary information display means 15 to display the image information. In FIG. 7, for example, when the reproduction time reaches 9400 milliseconds, the basic image kyakuma.gif between the customers is kyakuma_.
Switch to click.gif.

Also, as shown in the time section of the canteen, when the mouse is placed at the corresponding place, the image of "when the mouse cursor is placed" is displayed in accordance with the position of the pointer regardless of the state of the image. indicate. Dining for dining room
_Over.gif is displayed. Thereafter, when the mouse is clicked to instruct the video reproduction, the information of the instruction is transmitted to the related auxiliary information control means 13, and the relevant auxiliary information control means 13 transmits the pointer position to the inter-control communication means 17,
The inter-control communication means 17 grasps the location from the pointer position, reads a time section corresponding to the location from the scenario, and transmits it to the streaming video reproduction control means 9. The streaming video reproduction control means 9 reproduces the streaming video using a video reproduction command corresponding to the time section. Note that the scenario may include information on the pointer position range corresponding to the time section.

Next, a recording medium on which the streaming video linked reproduction program of the present invention is recorded will be described.

The configuration of the streaming video linked playback device is not limited to the configuration of the embodiment shown in FIG.
Each component is constructed by software (program) having a procedure for performing the processing described above, and a general computer system is set as the streaming video linked playback apparatus of the present invention by causing the computer system to execute the program. Is possible.

FIG. 8 is a block diagram showing an example of the hardware configuration of the computer system. The computer system includes a CPU 100 that executes processing, a memory 101 that stores programs and data, an external storage device 102 that stores programs and data used by the memory 101 or the CPU 100, a display 103 that displays data, and inputs data or instructions. Keyboard 10
4. It comprises a communication processing device 105 for communicating with another computer system or the like via a network. The program is stored in the memory 101 or the external storage device 1
02 and is executed by the CPU 100.

The recording medium of the present invention corresponds to the memory 101 or the external storage device 102. Furthermore, an electronic memory, a hard disk, or a floppy (registered trademark) disk, C
A portable recording medium such as a D-ROM and a magnetic tape can be used as the recording medium of the present invention. By loading the program recorded on the streaming video linked playback program recording medium of the present invention into a general computer system as shown in FIG. 8, the streaming video linked playback of the present invention can be executed on the computer. It becomes possible. Further, the above program can be preinstalled on a computer.

Although the present invention has been described in detail with reference to the embodiments, the present invention is not limited to the embodiments and can be variously modified without departing from the gist of the present invention.

[0064]

According to the present invention, the related auxiliary information can be displayed in conjunction with the streaming video using the scenario, so that even if the video is of low quality such as a streaming video on the Internet, With the assistance of the related auxiliary information, it is possible to sufficiently transmit information by video. That is, according to the present invention, since the related auxiliary information can be supplemented with the missing information and any video can be viewed freely, even if the quality of the video itself is low, it is included in the video. It is possible to grasp information sufficiently. Further, it is possible to instantly grasp the contents of the streaming video and easily view a desired place.

[Brief description of the drawings]

FIG. 1 is a diagram showing a system configuration diagram of the present invention.

FIG. 2 is a diagram showing a configuration of a streaming video information linked playback device according to an embodiment of the present invention.

FIG. 3 is a diagram showing a first screen display example by the streaming video information linked playback device in one embodiment of the present invention.

FIG. 4 is a diagram showing a second screen display example by the streaming video information linked playback device in one embodiment of the present invention.

FIG. 5 is a diagram showing related auxiliary information according to an embodiment of the present invention.

FIG. 6 is a diagram illustrating an example of a scenario corresponding to FIG. 5;

FIG. 7 is a diagram showing, in chronological order, changes in images in related auxiliary information associated with streaming video reproduction.

FIG. 8 is a diagram illustrating a configuration example of a computer.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 streaming video providing device 3 network 5 streaming video information linked playback device 7 auxiliary information providing device 9 streaming video playback control means 11 playback display means 13 related auxiliary information control means 15 related auxiliary information display means 17 control communication means 19 related auxiliary information Instruction means 100 CPU 101 memory 102 external storage device 103 display 104 keyboard 105 communication processing device

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Takaaki Akimoto Inventor F-term in NTT Communications Co., Ltd. 1-6-1 Uchisaiwaicho, Chiyoda-ku, Tokyo 5C023 AA02 AA14 AA16 AA27 AA28 AA38 BA01 BA11 CA02 CA05 EA03 5C025 AA30 BA14 BA25 BA28 CA02 CA06 CA11 CA12 CB10 DA10 5C064 BA01 BB10 BC06 BC23 BD02 BD08 BD09 5E501 AA01 AC16 AC25 CA02 CB02 CB09 EA05 EA12 EA33 EB06 FA02 FA15 FA45

Claims (12)

[Claims] 1. A streaming video playback method for playing back a streaming video transmitted over a network and displaying the streaming video together with related auxiliary information, comprising: a receiving step of receiving the streaming video; and a predetermined information included in the streaming video. And a changing step of changing the related auxiliary information according to a predetermined scenario based on the predetermined information. 2. The method according to claim 1, wherein the predetermined information is reproduction time information of a streaming video, and the scenario is such that, in the related auxiliary information, an image identifier corresponding to the reproduction scene displayed at the time of video reproduction corresponds to the reproduction time of the streaming video. Reading the image identifier corresponding to the reproduction time information extracted in the extraction step from the scenario; and in the related auxiliary information, corresponding to the reproduction time information. Switching the image displayed during non-video playback of a scene to be played back to the image with the image identification name. 3. The streaming video playback method according to claim 1, further comprising a playback step of playing back the streaming video according to the operation using the scenario when an operation is performed on the related auxiliary information. 4. The scenario, wherein the predetermined information is playback time information of a streaming video, and the scenario includes information describing information of each part in the related auxiliary information in association with the playback time information of the streaming video, A reproducing step of obtaining information of a part operated in the related auxiliary information; a step of reading reproduction time information corresponding to the information of the part from the scenario; a streaming video corresponding to the reproduction time information 4. The streaming video playback method according to claim 3, further comprising: 5. A streaming video reproducing apparatus which reproduces a streaming video transmitted via a network and displays the streaming video together with related auxiliary information, a receiving means for receiving the streaming video, and predetermined information included in the streaming video. And a changing means for changing the related auxiliary information according to a predetermined scenario based on the predetermined information. 6. The predetermined information is reproduction time information of a streaming video, and the scenario is such that, in the related auxiliary information, an image identifier corresponding to the reproduction scene displayed at the time of reproducing the video corresponds to the reproduction time of the streaming video. Means for reading from the scenario the image identifier corresponding to the reproduction time information extracted by the extraction means, wherein the associated auxiliary information includes 6. The streaming video reproduction apparatus according to claim 5, further comprising: means for switching an image displayed during non-video reproduction of a corresponding scene to an image having the image identification name. 7. The streaming video playback device according to claim 5, further comprising: a playback unit configured to play back a streaming video according to the operation using the scenario when an operation is performed on the related auxiliary information. 8. The scenario, wherein the predetermined information is playback time information of a streaming video, and the scenario includes information describing information of each part in the related auxiliary information in association with the playback time information of the streaming video, Means for acquiring information of a portion operated in the related auxiliary information; means for reading playback time information corresponding to the information of the portion from the scenario; and streaming video corresponding to the playback time information. 8. The streaming video playback device according to claim 7, further comprising: means for playing back. 9. A recording medium for recording a streaming video reproducing program for causing a computer to execute a process of reproducing a streaming video transmitted over a network and displaying the streaming video together with related auxiliary information, and a receiving procedure for receiving the streaming video. And causing the computer to execute an extraction procedure for extracting predetermined information included in the streaming video, and a change procedure for changing the related auxiliary information according to a scenario given in advance based on the predetermined information. A recording medium on which a streaming video reproduction program is recorded. 10. The predetermined information is playback time information of a streaming video, and the scenario is such that, in the related auxiliary information, an image identifier corresponding to the playback scene displayed at the time of video playback corresponds to the playback time of the streaming video. The change procedure includes a step of reading the image identifier corresponding to the reproduction time information extracted in the extraction procedure from the scenario, and a step of corresponding to the reproduction time information in the related auxiliary information. 10. The recording medium according to claim 9, further comprising: a step of switching an image displayed during non-video reproduction of a scene to be reproduced to an image having the image identification name. 11. A recording recording the streaming video reproduction program according to claim 9, further comprising a reproduction procedure of reproducing a streaming video corresponding to the operation using the scenario when an operation is performed on the related auxiliary information. Medium. 12. The predetermined information is playback time information of a streaming video, and the scenario includes information describing information of each part in the related auxiliary information in association with the playback time information of the streaming video, The reproduction procedure includes: a step of obtaining information of a part operated in the related auxiliary information; a step of reading reproduction time information corresponding to the information of the part from the scenario; and a streaming video corresponding to the reproduction time information. 12. A recording medium on which the streaming video reproduction program according to claim 11 is recorded.