KR20040033766A - Service method about video summary and Value added information using video meta data on internet - Google Patents

Abstract

PURPOSE: A method for servicing a video summary and the value added information of a moving image by using video metadata on the Internet is provided to maximally reduce a service construction time and an operation expense for a VOD(Video On Demand) service by automatically synchronizing the video summary and various value added information with video playback. CONSTITUTION: A video source inputted from an analog/digital video is inputted to an encoder and is stored in a video streaming server after encoding the video source(6). A time code and a key frame are extracted as the video summary information and are bundled as a video clip by classifying into each content(3). The value added information data is inserted into the video clip. After completing a clipping operation, the video clip is stored to the video metadata(4). The video metadata is registered to a database system(5). A user searches the moving image and the value added information, and receives a search result by connecting to the database system through the Internet(12). In case that a video playback request is existed, a video playback service is performed by receiving the video clip from the streaming server.

Description

How to service video summary and video additional information using video metadata over the internet {Service method about video summary and Value added information using video meta data on internet}

When video on demand (VOD) service is performed on the Internet, a unique video metadata technology is applied to play a video and serve various additional information included in the video. The purpose of this service is to provide services that can be automatically synchronized with playback, so that service construction time and operating expenses can be reduced and saved as much as possible during VOD services.

According to the present invention, when a video on demand (VOD) service is performed on the Internet, a video metadata technology is applied to serve a video summary and various additional information included in the video. It is to provide a service to be synchronized. In the related art, in order to provide a video and various additional information together in a VOD service on the Internet, when a video is played, the additional information is dependent on manpower to provide a service based on web programming.

In order to achieve the above object, the present invention independently devised video metadata to handle video summaries using metadata based on commercial XML. In addition, in order to systematically manage the management of various additional information of the video, the additional information of the video is classified according to the contents, inserted into the video metadata, stored in the database of the video metadata, and then the search function of the database is used to search the video and the additional information Implemented to provide a service.

1 is an overall structural diagram of a service method of the present invention;

2 is a method of calculating a color histogram;

3 is a keyframe extraction method using a color histogram;

4 is a sample for extracting a keyframe according to FIG. 3;

5 is a kind of video additional information

6 is an example of classifying the video additional information of FIG. 5 based on an XML schema;

7 is a structural diagram of video metadata based on XML;

8 is an example of a video clip list grouped by contents after inserting additional information of a video.

9 shows an example of displaying additional information of a video while playing a video;

10 is an example of an administrator screen of a video metadata database;

11 is sample XML video metadata.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is an overall structural diagram of a method of serving a video summary and video additional information using video metadata on the Internet. First, the encoded video source is input from the analog and digital input video units. (1) The encoding device uses a general commercial video capture card and a commercial window system. The video input source is simultaneously input to the encoding unit (1) and is actually encoded into digital video and stored in the video streaming server (6). As a first step for creating video metadata through the timecode and keyframe extractor 2, timecode and keyframes are extracted as video summary information. The extracted timecodes and keyframes are grouped by content by the administrator and clipped into video clips. (3) The additional information data (2) created by the commercially available general information editor is inserted into the video clip section. 3) When the video clip is completed, the video clip is completed and stored in the video metadata. (4) The stored video metadata is registered in the database system. (5) The general users have a database of video metadata through the Internet. The system is connected (7) to retrieve registered video and additional information (8), and the searched result (9) is provided to the user (12). In addition, if there is a video playback request 7 for the searched result, the video streaming server 10 receives the corresponding video clip through the streaming service 11 and receives the video playback service 12. In the present invention, through the video metadata registration through the process of 1 to 6, it is shown that the general users can provide the video and various video additional information corresponding thereto in the form of VOD.

2 shows a calculation method for extracting keyframes from consecutive video frames to generate video summary information. Calculate the color difference between the corresponding pixels in two consecutive frames by using the basic concept of finding the place where the difference between frames in the successive video frame is above a certain value. A calculation method for detecting a key frame by using a histogram difference between two consecutive frames is detected.

3 illustrates an example of extracting a key frame using a histogram difference in a short unit of a frame unit by the method of FIG. 2.

4 is an example of a scene in which timecode and keyframes are extracted as video summary information from MediaCataloger, a product of our company, which is commercially developed with a function of extracting keyframes using a histogram difference.

5 shows the type of moving picture additional information. In the present invention, in order to classify and store the information contained in the video in the video metadata, it is divided into places, people, music, information, shopping, goods.

FIG. 6 is an example of classifying additional information of a video described with reference to FIG. 5 into clip label information in video metadata. The clip label information uses the structure of a commercial XML schema. XML schemas are created using a common commercial schema builder. Various additional information of the video is inserted into each field name and field value of the schema and stored in the video metadata.

FIG. 7 is a structural diagram of video metadata configured in FIG. The structure diagram of video metadata developed independently based on XML shows information about the author of the video, video label information about the introduction of the video, and information about the digital video file, that is, the bit rate of the digital video. Proxy information, which is encoded as information about where the digital video file is located and where the streaming server is located, clip label information classified for each news article, and key extracted for each clip Key frame track information for storing frames, and text track information for storing text information such as other subtitle characters. All information of the video metadata is connected between information based on time code, so that corresponding information is delivered based on the time code selected by the user.

8 is an example of a clip list in which the clip label information of FIG. 7 is inserted.

This is an example showing that various additional information of a video is inserted in each field.

FIG. 9 is an example of providing video and additional information as a service, and provides information on alcohol, which is additional information registered as metadata of a time corresponding to a time at which a scene where alcohol appears in a background of the video is played.

10 is an example of a manager screen of a database system of video metadata.

The database employs a common commercial database system. The function of the database system is constituted by functions such as registration, editing, deletion and retrieval of video metadata. It is implemented to register, edit, delete, and search by reflecting XML base of video metadata. 9 is an example of a screen to search.

11 is sample XML video metadata.

As described above, the method of serving additional information of a video using video metadata on the Internet of the present invention has the following effects.

First, by managing video data by applying video metadata, more than 70% of the work time and operation management work time, which previously depended on manpower, editing software and web programming, was used for data management and VOD services.

Second, by applying video metadata, it is possible to skip a series of work processes that cut and file a video by content.

Third, by inserting and managing additional information of a video into video metadata, information can be automatically synchronized with the playback time of the video. In the past, video playback and additional information had to be managed separately by human web programming.

Fourth, by dividing the additional information of the video into places, people, music, information, shopping, merchandise, etc. at a glance, information management is convenient and information necessary for information search can be searched quickly.

Fifth, by providing video metadata and additional information service on the Internet, it can contribute to the development of the digital data broadcasting era.

Claims (6)

A keyframe extracting unit extracting keyframes in a shot unit of a frame unit based on a color histogram to generate video summary information; A video clip unit for performing clipping according to the contents of the keyframe; A moving picture additional information data unit for inserting additional information of a moving picture into a video clip unit; A video metadata unit for storing data of the video clip unit in video metadata; A video metadata database unit for registering the video metadata with the database system; The method of claim 1, wherein the key frame extracting unit A module for calculating a color difference between corresponding pixels in two consecutive frames; And A module that detects a frame whose brightness difference is greater than or equal to a threshold value or calculates a histogram difference between two consecutive frames to find a character recognition object. Way The video clip unit of claim 1, wherein A method for servicing additional information of a video using video metadata on the Internet, characterized in that the content is grouped by content using extracted keyframes and audio information provided from the video. The video information information data unit of claim 1 Method of providing additional information of a video using video metadata on the Internet, characterized in that it is inserted into a video clip to manage additional information data created through a commercial editor as video metadata. The video metadata unit of claim 1, wherein the video metadata unit Method of serving additional information of video using video metadata on the Internet, characterized in that keyframe information is made insertable to utilize as video metadata based on commercial general XML data. The video metadata database unit of claim 1, A method of providing additional information of a video using video metadata on the Internet, characterized in that video metadata can be registered, edited, deleted, and searched in a commercial database system.