JP2002330392A - Device, method and program for generating video outline - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device, method and program for reproducing video data effectively on the basis of the video outline so that a user can understand the video data. SOLUTION: The video outline generating device detects scene sections of video data, selects a representative frame of each scene, cross-references the representative frame with the scene and records the result as video outline data. The device provides the generated video outline to a user, and when the user selects any representative frame and instructs its reproduction, the video data are reproduced not from the representative frame but from a head of the scene including the representative frame.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video summary creating apparatus for creating video summary data applied to video playback.

[0002]

2. Description of the Related Art In recent years, with the practical use of MPEG (Motion Picture Experts Group), which is a coding standard for digital video data, and the increase in the capacity and price of digital storage media such as DVD-RAM, conventional video recording media have been developed. The use of a randomly accessible storage medium instead of a magnetic tape as a storage medium for video data has become common. As a result, it is expected that the amount of video information stored in homes and businesses and the amount of video information exchanged between businesses and between individuals will further increase. For this reason, it is important to be able to efficiently search for necessary video data or a scene with video data when necessary from a large amount of video information.

[0003] In addition, the distribution of video information via the Internet has also been performed. With the progress of so-called streaming technology, a certain amount of video data can be downloaded from the beginning of the video without waiting for the entire video to be downloaded. When the process is completed, it is possible to start reproduction, and it is expected that video distribution and reproduction via a network will be performed more and more actively.

However, when video data is provided from a video distribution server to a client via a network, the amount of video data is enormous with respect to the bandwidth. become. Therefore, it is important to efficiently search for video data.

As a method of efficiently searching for video data, there is known a method of displaying a list of still images corresponding to the first screen of a scene and showing the outline to the user. There is also known a method in which, when a user selects a representative still image (representative frame) other than the first screen at which a scene is switched, a video is reproduced from that time.

However, the beginning of a scene is not always a still image suitable for showing an overview of the video data. Further, if the reproduction is performed from the time of the representative frame, that is, from the middle of the scene, it becomes difficult for the user to understand the contents of the video.

[0007]

SUMMARY OF THE INVENTION The present invention has been made in consideration of the above circumstances, and has as its object to efficiently and efficiently store video data based on a video overview so that a user can easily understand the video data. It is an object of the present invention to provide an apparatus, a method, and a program for performing reproduction.

[0008]

SUMMARY OF THE INVENTION In order to solve the above problems and achieve the object, the present invention is configured as follows.

According to a first aspect of the present invention, there is provided an image outline creating apparatus, comprising: inputting image data composed of a series of time-series scenes; detecting means for detecting a break between the scenes; Representative image selecting means for selecting at least one representative image representing each of the above, and recording means for associating and recording the representative image and information for identifying a break between scenes detected by the detecting means And characterized in that:

According to a second aspect of the present invention, there is provided a video outline creating method, comprising the steps of: inputting video data composed of a series of time-series scenes; detecting a break between the scenes; A representative image selecting step of selecting at least one representative image representing each of a series of scenes, and recording the representative image and information for identifying a break between scenes detected by the detecting means in association with each other Recording step of performing

According to a third aspect of the present invention, there is provided a program, comprising: an input step of inputting video data composed of a series of time-series scenes; a detection step of detecting a break between the scenes; A representative image selecting step of selecting at least one representative image representing each of the above, and a recording step of recording the representative image in association with information for identifying a break between scenes detected by the detecting means. Is a program that causes a computer to execute

[0012] According to a fourth aspect of the present invention, there is provided a video distribution method,
Detecting a time-series series of scene breaks constituting video data, selecting at least one representative image representing each of the series of scenes, and setting the representative image and the detected scene breaks. Record in association with information for identification, display a representative image of at least a part of the scene to the client of the video distribution request source, prompt the user to select a representative image to request the video distribution, selected by the client The video distribution server distributes a part of the video data to the client based on the identification information of the segment associated with the representative image.

A recording medium according to a fifth aspect of the present invention is a recording medium for recording a representative image in association with information for identifying a break between scenes.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a video distribution / playback system to which a video outline creation device according to an embodiment of the present invention is applied. In this video distribution / playback system, a video summary creation device 100 and a WWW (Worl
d Wide Web) The client 300 requests the video providing system including the server 200 to distribute a video via a network (not shown) (not shown).

[0015] From the WWW server 200 to the client 30
For example, in the case of using a streaming technique for video distribution to the WWW server 200, the video data is transmitted to the WWW server 200.
The video data already downloaded can be quickly reproduced on the client 300 while being downloaded from the client 300.
It is also one of the preferred embodiments that the video can be distributed (downloaded) for each scene unit.
Note that the present invention is not limited to application to the video distribution and reproduction system as in the present embodiment, but may be embodied in various forms. For example, the present invention can be applied to a system other than a video distribution system via a network, and can be implemented as a computer or a digital video deck in which software for providing a video recording and reproducing function is installed.

As shown in FIG. 1, an image outline creating device 10
Reference numeral 0 denotes a device that includes a cut detection unit 1, a representative frame selection unit 2, and a representative frame corresponding video recording unit 3 and creates video summary data of video data stored in the WWW server 200 as a distribution target. is there. WWW server 20
0 includes a representative frame distribution unit 4, a video distribution unit 5, and a database (DB) 8, and is connected to a network.

The client 300 is a user (viewer)
Has a display unit 6 for performing various screen operations for making a video distribution request and displaying a distributed video, and a video distribution request unit 7 for issuing a video distribution request to the WWW server 200 via a network.

In the above configuration, a process of creating video summary data from the video data shown in FIG. 2 will be described as an example. FIG. 3 is a flowchart illustrating a processing procedure for creating video summary data by the video summary creation device 100.

The video data 1 shown in FIG. 2 conceptually represents a video by a group of still images. That is, the ten still images arranged in a line are obtained by extracting still images at an arbitrary time from a video that changes with time, and are not representative frames described below.

First, the cut detection unit 1 of the video outline creating apparatus 100 inputs video data (step S1 in FIG. 3),
The scene is cut out by the cut detection (step S
2). The video data is composed of a series of time-series scenes (partial video for all video data). The cut detection unit 1 detects a change in the screen of the input video data or a change in the direction of motion (motion vector) of the input video data as a cut in which the video changes greatly (a break at which the scene is switched). . Techniques for detecting such a portion where the video is discontinuously switched are known, and for example, a method described in Japanese Patent Publication No. 5-74273 or Japanese Patent Application Laid-Open No. 9-93588 can be used.

In the example shown in FIG. 2, a portion where scene 1 is switched to scene 2 is detected as the first cut. Similarly, the switching portion from scene 2 to scene 3 is also detected as a cut (step S2). In this embodiment,
The part where scene 1 starts, that is, the beginning of the video is also defined as a cut.

If the portion automatically detected as a cut does not match the actual scene change, the user who creates the video outline may manually detect the video outline based on the video display. Alternatively, a configuration may be adopted in which a cut detection result obtained in advance is obtained from the outside. In this case, the cut detection unit 1 of the video outline creation device 100 becomes unnecessary. It is preferable that the cut detection result obtained as described above is configured to be adjustable by the user.

The creator of the video outline uses the representative frame selection unit 2 to select a representative frame considered appropriate as a representative frame of each scene from the video data of FIG. 2 (step S3). Here, it is assumed that three representative frames 1-1, 1-2, and 1-3 have been selected from the still image frames included in the video data 1 of FIG.
The representative frame 1-1 is a still image appearing in the video data 1 in FIG. 2 (the fourth image in the scene 1 in the figure), and the representative frame 1-3 is a still image appearing in the scene 3 (similarly, scene 3 (Third image in the above). Here, when not particularly selected, the top screen of each scene is set as the representative frame. For example, the representative frame 1-2 is the first frame of the scene 2.

Note that the representative frame is set to 1 for one scene.
A configuration may be adopted in which a plurality of sheets are selected instead of sheets.
In this case, the selected plurality of frames are treated in the same manner regarding the index association described below.

Next, the representative frame corresponding video recording unit 3
Representative frame 1-selected by the representative frame selection unit 2
WWW by associating 1, 1-2, and 1-3 with the index of a cut that switches to a scene including each representative frame among the cuts detected by the cut detection unit 1.
It is recorded in the database 8 of the server 200 (step S4). In the present embodiment, data composed of such a representative frame and an index is referred to as video outline data.

The "index" is information necessary for reproducing a video, and is a relative time of the reproduction start when the first time of the video data is set to 0, a frame number of the reproduction start, and a video data. Indicates an address or the like at which data of a place where reproduction is to be started on the storage unit storing the data is specified. Here, the relative time is used.

In the example of FIG. 2, the representative frame 1-1 is associated with the index of the first frame of the cut portion (beginning of the video) which switches to scene 1 including the still image. Similarly, representative frames 1-2, 1-3
For the index of the first frame of scene 2,
The index of the first frame of scene 3 is associated with each.

The indexes of scene 1, scene 2, and scene 3 are, for example, 00:00:00:
00 (00:00:00 00 is described in this way), 00: 01: 15: 30, 00: 01: 30: 4
It shall be 0.

The index associated with the representative frame is stored in the database (DB) 8 in the WWW server 200 that performs video distribution. The database 8 stores video data used as an input to the video outline creation device 100.

There are various methods for associating a representative frame with an index. Enter and save both data in a table format file, save the method of referencing when necessary, save the representative frame and index in separate files, and link information of those files to another file And how to save it. The present invention is applied irrespective of these storage methods and reference methods, and an example of storage and reference methods will be described below.

The created video outline data is used as follows.

Here, an HTML (Hypertex) prepared for distributing a representative frame from the WWW server 200 is used.
An example in which a still image file of a representative frame and a metafile are linked in a file of the t Markup Language) format will be described. In this meta file, video data and an index are described. FIG. 4 shows an example of the HTML file (a) and the metafile (b).

In the HTML description, still image data of the representative frames 1-1, 1-2, and 1-3 (extension “.
.jpg "file) and the metafiles 1-1, 1-2, 1--1 referred to when the still image is clicked.
3 (files with the extension “.asx”) are described in the order of metafile and still image data.

The representative frame in the database 8 is read out by the representative frame distribution unit 4 in the WWW server 200 and distributed to the client 300 together with the HTML description.
The screen of the representative frame shown in FIG.

When the viewer moves the pointer P to an interesting frame among the representative frames shown in FIG. 5 and selects and clicks on the frame, the corresponding meta file (“.asx”) stored in the WWW server 200 based on the HTML description. ”Format file), and the video distribution request unit 7 of the client 300 requests the corresponding video data. In response, the video data is read from the video distribution unit 5 of the WWW server 200 and distributed to the client 300. That is, when the .asx file is referred to, the video reproducing apparatus is started, and the reproduction of the video data is started according to the description of the “.asx” format file.

For example, a case where the representative frame shown on the right side of FIG.

This still image is represented by <representative frame 1-3.jp
g>, and the metafile referred to by clicking this is <metafile 1- according to the HTML description of FIG.
3.asx>. <Metafile 1-3.as in FIG.
x>, the WW “www.toshiba.co.jp”
The video database (V) stored in the W server 200
<video data 1.
asf> starts to be reproduced. At this time, StartTimeValue is set as the start time.
The time (index) of 00: 01: 30: 40 described below is used. That is, the reproduction is started from the portion of 1 minute 30 seconds 40 of <video data 1.asf>.

Thus, when the user (viewer) of the client 300 selects an interesting representative frame, it is possible to reproduce the video data from the beginning of the scene including the representative frame.

Therefore, as described in the background art, in the reproduction of video data, when a representative frame of the video data is selected, the video after the representative frame is reproduced, so that it becomes difficult to understand the contents. Inconvenience can be eliminated.

The present invention is not limited to the above-described embodiment, but can be implemented with various modifications. For example, in the embodiment, the video summary data created by the video summary creation device 100 is transmitted from the WWW server 200 to the client 300.
Although the description has been made on the assumption that the video summary data is used for video distribution to the user, the video outline data created by the present apparatus is not limited to the use for video distribution via a network. For example, it may be used for organizing video data at home or used via a storage medium.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a video distribution / playback system to which a video outline creation device according to an embodiment of the present invention is applied.

FIG. 2 is an explanatory diagram of video data and a representative frame.

FIG. 3 is a flowchart showing a processing procedure of creating video summary data by the video summary creation device 100;

FIG. 4A is a diagram showing the contents of an HTML format file, and FIG. 4B is a diagram showing the contents of a metafile;

FIG. 5 is a diagram showing a display example when the created video outline is used in the video playback device.

[Explanation of symbols]

Claims (5)

[Claims] 1. A detecting means for inputting video data composed of a series of time-series scenes, detecting a break between the scenes, and detecting at least one representative image representing each of the series of scenes. A video overview comprising: a representative image selecting unit to be selected; and a recording unit that records the representative image and information for identifying a break between scenes detected by the detecting unit in association with each other. Creation device. 2. An input step of inputting video data composed of a time-series series of scenes; a detection step of detecting a break between the scenes; and at least one sheet representing each of the series of scenes. A representative image selecting step of selecting a representative image; and a recording step of recording the representative image in association with information for identifying a break between scenes detected by the detection unit, and recording the representative image. How to create a video summary. 3. An inputting step of inputting video data composed of a series of time-series scenes; a detecting step of detecting a break between the scenes; and at least one sheet representing each of the series of scenes. A program for causing a computer to execute a representative image selecting step of selecting a representative image, and a recording step of recording the representative image in association with information for identifying a break between scenes detected by the detecting means. 4. A method for detecting a break of a series of scenes in time series constituting video data, selecting at least one representative image representing each of the series of scenes, and selecting the representative image and the detected image. Recording in association with information for identifying a scene break, displaying at least a part of the representative image of the scene to a client of a video distribution request source, and prompting a user to select a representative image to request a video distribution, A video distribution method, wherein a video distribution server distributes a part of the video data to the client based on identification information of a segment associated with a representative image selected by the client. 5. A recording medium for recording a representative image in association with information for identifying a break between scenes.