KR20110010082A - Method and apparatus for generating meta data of content data - Google Patents

Abstract

PURPOSE: A method and a device generating meta information using DNA information of contents data are provided to independently generate meta information based on partial or the whole DNA information of contents data, thereby using meta information even about edited contents data or copy which has partly the same content of contents. CONSTITUTION: A time point and section managing unit(11) manages the time point and section of contents data which is the target to generate meta information. A partial DNA(Deoxyribonucleic Acid) extracting unit(12) extracts partial DNA information related to the determined time point or section. A meta information managing unit(13) generates meta information including the extracted partial DNA information. The meta information managing unit includes UI managing unit to generates meta information by enabling a user to input data.

Description

METHOD AND APPARATUS FOR META INFORMATION CONSTRUCTION OF CONTENT DATA {METHOD AND APPARATUS FOR GENERATING META DATA OF CONTENT DATA}

The present invention relates to a method and apparatus for generating meta information of content data, and more particularly, to a method for generating meta information of corresponding content data based on partial or entire DNA information of content data such as audio or video data, and Relates to a device.

With the development of multimedia technology, today, a large number of audio or video contents produced by various copyright holders are supplied to users through the Internet. In addition, the types of content playback devices that were previously all TVs and radios have now been extended to various devices such as PCs, MP3 players, netbooks, PMPs, and smartphones. It became possible. However, the unit of content currently used in these various devices is a copy of a kind of content called a file, and the content playing device treats the inside of the file as a kind of black box and performs only the task of playing individual files. have. In addition, various meta information added to the content, such as lyrics for music and subtitles for video, etc., have also been attached to the file. However, since there may be dozens of different files corresponding to one content, this has prevented the effective production of meta information about the content. In addition, since the conventional meta information is generated based on the time information of the content file when used in association with one file, there is a limitation in that the meta information cannot be used when the content is only partly the same or edited content.

The present invention has been made in view of the above, and an object thereof is to provide a method and apparatus capable of generating meta information based on partial or entire DNA information of content data.

In addition, according to the present invention, the meta information is independently generated by referring to the exact location of the content data based on the partial or entire DNA information of the content data. It is an object of the present invention to provide a method and apparatus for enabling use.

In order to solve the above problems, the present invention provides a method for generating meta information of content data, comprising: a first step of determining a time point or a section of content data to be generated as meta information; Extracting partial DNA information associated with the determined time point or section; And a third step of generating meta information including the extracted partial DNA information.

Here, the first step may be determined by the user's selection.

In addition, the first step may be determined based on the associated data associated with the content data.

In addition, in the first step, when the viewpoint of the content data to be generated meta-information is determined, the second stage may be configured to extract partial DNA information for a section of a predetermined time range including the determined viewpoint. It may be.

In addition, in the first step, when the section of the content data to be generated meta information is determined, the second step may be configured to extract partial DNA information for at least one partial section of the determined section. .

In addition, the second step may be configured to extract partial DNA information based on at least one of an audio signal and a video signal of content data.

In addition, in the third step, the meta information may be configured to be generated by data input by a user.

In addition, in the third step, the meta information may be configured to be generated based on the related data associated with the content data.

In addition, the meta information generated by the third step may be configured to be referred together at the time of reproduction of the content data.

According to another aspect of the present invention, there is provided an apparatus for generating meta information of content data, comprising: a viewpoint and section manager configured to manage a viewpoint or a section of content data to be generated for meta information; A partial DNA extracting unit extracting partial DNA information related to the determined time point or section; And a meta information management unit configured to generate meta information including the extracted partial DNA information.

Here, the meta information manager may include a user interface manager that allows a user to input data to generate meta information.

According to still another aspect of the present invention, there is provided a method of generating meta information of content data, comprising: a first step of extracting entire DNA information for all of content data to be generated for meta information; A second step of determining a time point or section of the content data to be generated meta information; A third step of including identification information related to the determined time point or section to be identifiable in the entire DNA information; And generating a meta information related to the determined time point or section, including the entire DNA information.

Here, in the first step, the extracted total DNA information may be extracted to correspond to the time information of the content data.

In the third step, the identification information associated with the determined time point or section may be included in the entire DNA information with reference to the time information.

In addition, the second step may be determined by a user's selection.

In addition, the second step may be determined based on the related data associated with the content data.

In addition, in the fourth step, the meta information may be generated by data input by a user.

In addition, in the fourth step, the meta information may be generated based on the related data associated with the content data.

According to another aspect of the present invention, in the meta-information generating device of the content data, the entire DNA information for the entire content data to be generated meta-data is extracted, and the content data to be generated meta-information. A DNA information extraction unit managing to include identification information related to a viewpoint or a section so as to be identifiable in the entire DNA information; A time point and section manager which manages a time point or section of the content data to be generated meta information; Provided is a meta information generating apparatus of a content data including a meta information management unit for generating meta information related to the determined time or section including the full DNA information.

Here, the meta information manager may include a user interface manager that allows a user to input data to generate meta information.

According to the present invention, it is possible to provide a method and apparatus capable of generating meta information based on partial or entire DNA information of content data.

In addition, according to the present invention, meta information is generated independently by referring to the exact location of the content data based on the partial data or the entire DNA information of the content data. Provided are methods and apparatus for making information available.

In addition, the meta information generated by the present invention may be used as it is for partially identical content data such as an edited copy and a copy, or may be used as long as the corresponding partial DNA information is the same even when the encoding scheme is different. In addition, since the meta information generated as described above may be shared or distributed through a channel separate from the content data, the meta information may be easily reproduced.

In addition, since the meta information according to the present invention is based on partial or entire DNA information, it is possible to easily identify the exact position in which the meta information is related in the content data, so that only the non-important part or the important part of the content data is marked, for example, There is such an effect that information can be generated efficiently.

1 is a flowchart illustrating an embodiment of a method for generating meta information of content data according to the present invention.
2 is a view for explaining a case where the meta information generated by the present invention can be used.
3 is a diagram illustrating an example of a configuration of meta information generated by the present invention.
4 is a block diagram showing an example of the meta-information generating device according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating an embodiment of a method for generating meta information of content data according to the present invention.

Referring to FIG. 1, in the method for generating meta information of content data of the present embodiment, first, a time point or a section of content data to be generated for meta information is determined (S100). Determination of the point of view or the section of the content data to be generated meta information is performed by, for example, when the content data is video (video) data. The user can be made by the selection operation. To this end, it is a matter of course that the application program for reproducing the content data should be provided with such a function. Such a function may be added as a plug-in to a program such as a media player, which is a basic playback program provided in a window, or may be performed by a separate application program including such a function. . In the present invention, it is preferable to use a separate playback and meta information editing program that provides an interface for allowing a user to directly generate meta information as described below in addition to the above viewpoint or section selection function.

In the step S100, a viewpoint or a section may be determined, where a viewpoint means one point of the content data, and an interval means between one point and another point of the content data. For example, in the case of time reference, when a point of 30 seconds is determined after the content data is played back, this is a point of time, and when a period of 30 seconds to 35 seconds is selected, this means a section. The present invention can be applied to both cases where a specific time point or a specific section of content data is determined.

As such, when the viewpoint or section is determined in step S100, partial DNA information related to the determined viewpoint or section is extracted (S110). Herein, the DNA information refers to feature data representing characteristics of the data, and is also referred to as fingerprint data or fingerprint data. Regarding such DNA information, various methods have been proposed by the prior art, and the use of such DNA information makes it possible to easily determine whether or not the data is identical, and thus has been widely used in the field of copyright management (DRM). For example, when the content data is audio data, DNA information is generated using various feature data (eg, frequency, amplitude, etc.) representing the characteristics of the audio data, and in the case of video data, various feature data (eg, frames) of the video data are generated. Motion vector information, color information, etc.) to generate DNA information. The present invention is not intended to generate such DNA information itself, and any form of DNA production / extraction method according to the prior art may be used as it is, and thus detailed description thereof will be omitted. Meanwhile, Patent Application No. 10-2007-0044251 filed by the present applicant (Method and Apparatus for Generating Audio Fingerprint Data and Method and Apparatus for Comparing Audio Data Using the Same), No. 10-2007-0054601 (Determining the Sameness of Video Data) And the same section detecting method and apparatus), 10-2007-0060978 (method and system for clustering video data with the same video data), 10-2007-0071633 (video data using video data cluster) Search service providing method and apparatus), 10-2007-0091587 (method and apparatus for setting and providing advertisement data using video data cluster), and 10-2008-0051688 (video processing method and apparatus), A method of generating fingerprint (DNA) data of audio or video data and a method of clustering using such fingerprint data are described. In addition, the applicant's fingerprint (DNA) generation and extraction method may be used in the present invention, of course. In short, the present invention can use the conventional technology as it is, regardless of the method used for extracting DNA information from the content data, and it is important to extract partial DNA information related to an arbitrary time point or section of the user-selected content data. .

The partial DNA information may be extracted in relation to the time point or the section determined in step S100. When the time point is determined in step S100, partial DNA information on a section of a certain time range including the time point may be extracted. For example, a time point, which is predetermined as a starting point, has elapsed. Partial DNA can be extracted for the interval. This is because the extraction of DNA information for a point in time may reduce the discrimination power. If the partial DNA information is extracted from the point in time, for example, after 10 seconds or after 20 seconds, the extracted partial DNA information may have sufficient discrimination power. Can have In this case, of course, the partial DNA may be extracted for a section whose end point is a point in time up to a certain time on the basis of the point in time.

Meanwhile, when a section is determined in step S100, partial DNA information on at least one partial section of the determined section may be extracted. For example, in terms of time, when the interval between 30 seconds and 60 seconds is determined, the partial DNA information for the interval between 30 seconds and 40 seconds is extracted, and the portion for the interval between 50 seconds and 60 seconds is extracted. DNA information can also be extracted. This is because extracting partial DNA information for the entire section may increase the amount of data if the section is too long. Of course, partial DNA information for the entire section between 30 seconds and 60 seconds may be extracted. Alternatively, the 30 second to 60 second sections may be divided into, for example, four relatively short non-overlapping sections, and partial DNA information of each corresponding section may be extracted. As another method, partial DNA information may be extracted for a section of 10 seconds before and after 10 seconds, and partial DNA information for a section of 10 seconds before and after 60 seconds may be extracted.

On the other hand, in step S110, as described above, the partial DNA information may be extracted based on either the audio signal or the video signal of the content data, or the partial DNA information may be extracted by a combination thereof.

As such, when the partial DNA associated with the time point or the section determined in step S100 is extracted in step S110, meta information including the extracted partial DNA information is generated (S120). In this case, the meta information may be generated by a user input. As described above, the application program used in the present invention provides a user interface for inputting meta information in addition to a function for determining a point of view or a section in step S100. A user interface is provided, and the user can input desired meta information through an input device such as a keyboard or a mouse. The meta information may be configured in various forms such as, for example, a time stamp, caption information, lyrics information, content start / end point information, advertisement start point / end point information, and the like. The type of information and the content of the information may be directly selected by the user and input. Alternatively, the type of information may be specified and an interface may be provided for the user to select the type of the information and input the content of the information. For example, when inputting caption information for a specific section, when the caption information is selected from the type of information provided in the user interface, the application provides an input interface for inputting the content of the caption and the user desires here. Subtitles can be entered.

As such, when the input of the meta information is completed, the application program may generate the input meta information in the form of a file, for example. At this time, the meta information generated in the form of a file includes the extracted partial DNA information. Meta information generated in the form of a file may have the same name as the file name of the corresponding content, for example, and may have only a different extension of the file. The meta information generated in this way is referenced and reproduced at the time of execution when the corresponding content data is executed (reproduced). Of course, it is desirable to include such a function in the application used in the present invention to perform such a function. For example, when the content data is movie video data and the meta information of the corresponding content is subtitle information, when the corresponding content data is executed (played), the subtitle information is used by using partial DNA information of a corresponding time point or section included in the meta information. It will be shown on the movie screen.

Meanwhile, the meta information may be generated continuously. For example, when the meta information is generated as one file, the meta information may be generated to include a plurality of meta information in one file. For example, if the content data is a foreign movie and the Korean subtitle information is generated as the meta information, the Korean subtitle information should be generated continuously over almost all sections of the movie, so that a plurality of meta information may be included in one file. desirable.

When meta information is generated in this manner, since the meta information is generated based on partial DNA information related to a specific time point or section of the content data, the meta information is partially identical even if not completely identical from beginning to end, for example, an edited copy or a copy of the content data. Meta information can be used as it is in content data.

2 is a view for explaining a case where the meta information generated by the present invention can be used.

Referring to FIG. 2, in the case of (A), meta information is generated for a portion of red of the entire content data displayed in blue.

In the case of (B), the case where the content data of (A) further includes other parts indicated in yellow color is shown, but the case is not the same as the content data of (A) but is partially identical. Also, in the case of (B), since the section indicated in red is included, the meta information generated in (A) can be used as it is. That is, since the meta information generated in (A) includes the meta information generated based on the extracted partial DNA information in relation to the red section of (A), the same partial DNA information is also included in the case of (B). Because there is a part, that is, a red part, the meta information generated in (A) can be used as it is in (B).

The case of (C) is also partially the same, where there is another part indicated in yellow in the front / rear part in addition to the content data of (A). In this case, since the part shown in red is also included, the meta information generated in (A) can be used as it is.

In the case of (D), only a part of the content data of (A) is included and other content is added to the front / rear part. In this case as well, since the part shown in red is included, the meta information generated in (A) can be used as it is.

As described above, since the meta information generated by the present invention is not generated based on time information as in the related art, but is generated based on partial DNA information of an arbitrary time point or section, the corresponding time point or section is included. The exact location can be found in the content data, which is a copy or a compilation of all forms.

3 is a diagram illustrating an example of a configuration of meta information generated by the present invention.

Referring to FIG. 3, the meta information of the present invention may be composed of partial DNA information, meta information, and a time stamp, caption, lyrics, content start point, content end point, advertisement start point, advertisement end point, and user-defined information.

In the case of (A) of FIG. 3, the meta information is subtitle information, which includes partial DNA information expressed in binary numbers, and the subtitle information “I really loved you. If yes. Such meta information is used to display the corresponding subtitle information together with the corresponding content data at a time point or section corresponding to the corresponding partial DNA information. Here, it should be noted that the partial DNA information is represented by a binary number, but may be represented by a longer binary number than the actual case. The time stamp information indicates a time from the start time of the corresponding content data of the section including the partial DNA information to the end time of the section. On the other hand, the time stamp information may be utilized in various forms different from the case of FIG. 3A, and only time-lapse information (for example, 03:28) from the first starting point of the content data may be recorded (FIG. 3). (B)). In addition, the caption information may be configured such that it is displayed, for example, 1:00. By using this, information such as a point at which a specific event to be performed by meta information such as caption information starts, an end point, a section to be continued, and the like can be efficiently expressed.

4 shows that when a content starting point of content data is input, partial DNA information of the corresponding time point and time information of the corresponding time point are recorded. In the case of FIG. 4, for example, when an advertisement video is attached to the front of the content, the actual content starting point excluding the advertisement video is recorded. When the meta information is used, the user can easily determine the starting point of the corresponding content. You can go to the point where the content starts and play the content from that point.

As shown in FIG. 3 and FIG. 4, a user-defined item may be included, which allows a user to generate meta information desired by the user. Using this, for example, it is possible to simply write a phrase or a memo that comes to mind while watching the content data.

On the other hand, as described above, the meta information may include a plurality of information in one file, in this case can be configured as shown in FIG. FIG. 5 illustrates a case in which the case of FIG. 3A and FIG. 4 is included as one meta information, and the caption is output at a point corresponding to the partial DNA information as described in FIG. As described with reference to FIG. 4, the point corresponding to the corresponding partial DNA information performs a function of notifying the start point of the content. Although FIG. 5 illustrates only the case where two meta information is included for convenience of description, a plurality of meta information having two or more as shown in FIG. 5 may be included and generated in one file.

6 is a diagram illustrating an example of an apparatus for generating meta information for implementing the method for generating meta information as described above.

Referring to FIG. 6, the meta information generating apparatus 10 includes a viewpoint and section manager 11, a partial DNA extractor 12, and a meta information manager 13.

The viewpoint and section management unit 11 performs a function of managing the viewpoint or the section of the content data that is the object to generate the meta information. As described with reference to FIG. It generates and manages information on the section, and transmits the information on the time or section to the partial DNA extracting unit 12 and the meta information management unit 13.

The partial DNA extracting unit 12 is a means for performing a function of extracting partial DNA information related to the determined time point or section of the content data to be generated meta information, as described with reference to FIG. Extract the partial DNA associated with the point in time or section and transmit it to the meta-information management unit 13.

The meta information management unit 13 performs a function of generating and managing meta information including the extracted partial DNA information. For example, the meta information management unit 13 includes partial DNA information in the form of meta information as described in FIGS. 3 and 4. Role to create. In addition, the meta information manager 13 also manages a user interface (not shown) for receiving meta information from the user.

As described above, the meta-information generating device 10 of FIG. 6 may be implemented as an application program in an electronic device such as a computer or a smart phone, and although not shown, a video playback function and a user may select a viewpoint or a section. And a function and an interface for allowing a user to input meta information.

Meanwhile, in the embodiment described with reference to FIGS. 1 to 6, a case in which a viewpoint or section is determined by a user's selection and meta information is generated by the user's input has been described as an example. According to the present invention, the view point or the section may be determined based on the related data related to the content data, and the meta information may be generated. For example, when the text-based subtitle information generated based on the time information exists as a separate file as the associated data, the view point or the section of the content data is matched according to the time information of the corresponding subtitle information file, and the corresponding view or After extracting the partial DNA information associated with the interval, it may be configured to generate caption data corresponding to the time information as meta information. In this case, however, it is assumed that the content data to be referred to by the caption information file generated based on the time information and the content data to be generated meta information are the same. If these conditions are met, the existing meta information can be accurately matched to a time point or section based on time information. Therefore, partial DNA information related to the time point or section is extracted and the meta information is input based on the user's input. It can be created automatically without

7 is a flowchart illustrating a method of generating meta information of content data according to another embodiment of the present invention.

Referring to FIG. 7, first, the entire DNA information of the entire content data to be generated meta information is extracted (S200). At this time, the entire DNA information is extracted to correspond to the time information of the content data, and is generated to match each time information. For example, by dividing by one second unit, DNA information at each time point is extracted and generated for the entire time interval such as DNA information in one second, DNA information in two seconds, ..., and the like. In this case, as shown in FIG. 1, the DNA information at each time point is preferably configured to extract DNA information for a time interval within a predetermined range including the corresponding time point. For example, the DNA information in one second may be composed of DNA information extracted for a section between 1 second and 10 seconds, and the DNA information in 2 seconds may be composed of DNA information extracted for a section between 2 seconds and 11 seconds. desirable.

Next, a time point or section of the content data to be generated meta information is determined (S210). Since this is the same as described with reference to FIGS. 1 to 6, detailed description thereof will be omitted.

When the viewpoint or section is determined, identification information related to the determined viewpoint or section is included in the entire DNA information so as to be identified (S220). This means that the identification information associated with the determined time point or section is included in the entire DNA information generated in response to the time information in step S200. That is, it means that the determined time point or section is marked with reference to time information of all DNA information. In this way, it is possible to determine where the determined time point or section is located in the overall DNA information.

Next, meta information related to the determined time point or section is generated including the entire DNA information generated as described above (S230). Since the meta information generation here is the same as described with reference to FIGS. 1 to 6, detailed description thereof will be omitted. However, since the meta information generation at this time includes the entire DNA information, partial DNA information as described with reference to FIGS. 3 and 4 is not necessary and thus generated.

In the embodiment of Fig. 7, the DNA information of the entire content data is extracted in advance so as to correspond to the time information, and the time point or section to which meta information is to be generated is referenced with reference to the time information of the extracted DNA information, thereby marking the corresponding time point. Or it is effective in that the section can be easily visited.

In the embodiment of FIG. 7, the determination of the viewpoint or the section and the generation of the meta information may be performed by the selection / input of the user or automatically generated based on the related data as described with reference to FIGS. 1 to 6. .

Such meta information generated by the present invention can be used as it is for partially identical content data such as edited copies and copies, and can be used as long as the corresponding partial DNA information is the same even when encoding methods are different. In addition, the meta information generated as described above may be shared or distributed through a channel separate from the content data. Of course, the content data producer may also generate and distribute meta information along with the content data at the production stage.

In addition, since the meta information generated in this way uses DNA information, accurate positioning can be performed. For example, only important parts or important parts of the content data can be marked so as to cover the non-important parts and reproduce them in a digest format. . This will allow you to watch hours of drama footage in dozens of minutes.

In addition, the meta information according to the present invention can be shared and distributed separately from the content data, and since the individual user can easily re-edit the corresponding meta information, the meta information can be easily reproduced. .

Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various forms of modifications / are within the scope of the present invention with reference to the appended claims and the accompanying drawings. Of course, modifications can be made.

10 ... meta information generator,
11 ... time and section management,
12 ... partial DNA extraction section,
13 ... Meta Information Management.

Claims (20)

In the meta information generation method of the content data,
A first step of determining a time point or section of the content data to be generated meta information;
Extracting partial DNA information associated with the determined time point or section; And
A third step of generating meta information including the extracted partial DNA information
Meta information generation method of the content data comprising a.
The method of claim 1,
The first step is determined by the user's selection.
The method of claim 1,
The first step is determined based on the association data associated with the content data.
The method of claim 1,
In the first step, when it is determined the time point of the content data to be generated meta information, the second step is to extract the partial DNA information for the section of the predetermined time range including the determined time point How to generate meta information of content data.
The method of claim 1,
In the first step, if the section of the content data to be generated meta information is determined, the second step is to extract the partial DNA information for at least one or more partial section of the determined section How to generate meta information for.
The method of claim 1,
In the second step, the partial DNA information is extracted based on at least one of an audio signal and a video signal of the content data.
The method of claim 1,
In the third step, the meta information is generated by the data input by the user.
The method of claim 1,
In the third step, the meta information is generated based on the association data associated with the content data.
The method of claim 1,
The meta-information generated by the third step is referred to together at the time of reproduction of the content data.
An apparatus for generating meta information of content data,
A time point and section manager which manages a time point or section of the content data to be generated meta information;
A partial DNA extracting unit extracting partial DNA information related to the determined time point or section; And
Meta information management unit for generating meta information including the extracted partial DNA information
Meta information generating device of the content data comprising a.
The method of claim 10,
The meta information manager includes a user interface manager that allows a user to input data to generate meta information.
In the meta information generation method of the content data,
A first step of extracting full DNA information of all of the content data to be generated meta information;
A second step of determining a time point or section of the content data to be generated meta information;
A third step of including identification information related to the determined time point or section to be identifiable in the entire DNA information; And
A fourth step of generating meta information related to the determined time point or section including the entire DNA information
Meta information generation method of the content data comprising a.
The method of claim 12,
In the first step, the extracted total DNA information is extracted to correspond to the time information of the content data.
The method of claim 13,
In the third step, the identification information related to the determined time point or section may be included in the entire DNA information with reference to the time information.
The method of claim 12,
And wherein the second step is determined by a user's selection.
The method of claim 12,
The second step is determined based on the association data associated with the content data.
The method of claim 1,
In the fourth step, the meta information is generated by the data input by the user.
The method of claim 1,
In the fourth step, the meta information is generated based on the association data associated with the content data.
An apparatus for generating meta information of content data,
Extracting full DNA information about all of the content data to be generated meta information and including identification information related to the time point or section of the content data to be generated meta information to be identifiable in the full DNA information DNA information extraction unit for managing;
A time point and section manager which manages a time point or section of the content data to be generated meta information;
Meta information management unit for generating meta information related to the determined time point or section including the full DNA information
Meta information generating device of the content data comprising a.
The method of claim 19,
The meta information manager includes a user interface manager that allows a user to input data to generate meta information.

Images