KR20060081332A - An storage medium having metadata for providing enhanced search - Google Patents

Abstract

The present invention relates to a storage medium including meta data that provides an extended search function using various search keywords for video data.

A storage medium according to the present invention includes video data; And metadata for enabling extended search of the video data for each scene using at least one search keyword information. In addition, the metadata preferably includes an entry point and / or playback duration, angle information, and the like for each scene. Accordingly, it is possible to search according to various search keywords, control the playback device to reproduce the search results in various scenarios, and support multi-angle or multi-pass movie titles. Furthermore, metadata may be generated for each language to provide an extended search function that supports multiple languages.

Description

An storage medium having metadata for providing enhanced search}

1 is a reference diagram showing the structure of conventional video data;

2 is an example of an apparatus for reproducing a storage medium on which metadata is provided to provide an extended search function according to the present invention;

3 is a flowchart illustrating a method of reproducing a storage medium in which metadata is recorded according to the present invention;

4 is an application example of metadata according to the present invention;

5 is a reference diagram showing a relationship between metadata and video data according to the present invention;

6 is a reference diagram illustrating a directory structure of metadata according to the present invention;

7 is a reference diagram illustrating a naming rule of a metadata file according to the present invention;

8 illustrates a structure of metadata according to the present invention;

9 illustrates a detailed structure of metadata according to the present invention;

10 is a diagram illustrating an application range of a title for providing an extended search function according to the present invention;

11 is an embodiment of applying metadata according to the present invention;

12 is another embodiment of applying metadata according to the present invention;

13 is a view illustrating highlight reproduction using metadata according to the present invention;

14 is a reference diagram illustrating an example of providing an extended search function in a multi-angle title by applying metadata according to the present invention;

15 is a playback state diagram of a playback apparatus according to the present invention.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to reproduction of moving picture data recorded on a storage medium, and more particularly to a storage medium including metadata for providing an extended search function for moving picture data.

On a storage medium such as a Blu-ray disc, video data including audio and video or audio sub-title compressed and encoded according to a standard such as Motion Picture Experts Group (MPEG) is recorded. Further, additional information such as the encoding attribute of moving picture data or the reproduction order of moving picture data is further recorded. In general, moving images recorded on the storage medium are reproduced in order according to the above-described reproduction order. Sometimes, the moving images recorded on the storage medium are reproduced by jumping in chapter units during reproduction of moving image data.

1 is a reference diagram showing the structure of conventional video data. For a clip, which is a recording unit of moving picture data, at least one playlist (PlayList) as a reproduction unit and at least one PlayItem (PlayItem) as a reproduction unit is defined. In particular, a playlist mark (PlayListMark), which is a set of marks indicating a specific position of a clip corresponding to the playlist, is defined and can be played by jumping in chapter units.

However, the conventional storage medium does not provide a method of jumping and playing back to an arbitrary scene according to a search criterion desired by the user. That is, according to a search criterion desired by a user such as a scene, a character, a background location, a background music, or an item, the user moves to an arbitrary position of the video data for playback. There is a problem that various search is difficult because it is not provided

In addition, in a conventional storage medium, since the video information is multiplexed by compression encoding according to the MPEG-2 standard, it is not only difficult to produce a storage medium to include metadata for providing a search function of a video, but also to produce it once. The storage medium has a problem that it is almost impossible to edit or reuse the moving image data or metadata.

Meanwhile, as shown in FIG. 1, the currently defined playlist mark (PlayListMark) does not distinguish between multiple angles and multipaths, and thus provides smooth extended search function in case of video data supporting multi-angles or multipaths. There was a problem that can not.

Accordingly, an object of the present invention is to provide a storage medium that records metadata that provides an extended search function using various search keywords for video data.

On the other hand, another technical problem of the present invention for solving the above problems is to provide a storage medium that records metadata that provides a smooth extended search function in conjunction with video data of various formats.

According to the present invention, the above technical problem is provided; And metadata for enabling an extended search of the video data for each scene using at least one search keyword information.

Preferably, the video data is a movie title.

In addition, the metadata is preferably defined in a playlist unit which is a playback unit of the video data.

Further, the extended search is preferably applied to the main playback path playlist that is automatically played back by the index table when the storage medium is loaded.

In addition, the metadata preferably includes information on an entry point for each scene, wherein the scene is represented by content between two neighboring entry points among specific entry points specified in the playlist. And, when the user searches for the content using the search keyword, the search result is represented as a set of entry points included in scenes in which the search keyword information of the metadata matches the input search keyword. desirable. Further, the entry points are preferably arranged in sequential order on the playlist.

In addition, the metadata may include information on an entry point and a duration of playback for each scene. In addition, one scene may include a plurality of the entry points in chronological order. When arranged, it is preferable to define a section between one entry point and the point that has elapsed by the reproduction duration.

In addition, when the user searches for the content using the search keyword, it is preferable to start the playback from the entry point of the scene selected by the user in the search results and to the end of the playlist.

In addition, when the user searches for the content by using the search keyword, it is preferable to start playing from the entry point of the scene selected by the user in the search results and to play until the playback duration elapses, and to jump to the next searched scene. Do.

In addition, when a user searches for content using a search keyword, the search results are preferably reproduced continuously without waiting for the user's selection.

In addition, when the user searches for the content by using the search keyword, it is preferable to start playing from the entry point of the scene selected by the user in the search result and to play until the playback duration elapses, and the playback is stopped.

The metadata may further include information about angles supported for each scene.

In addition, when the video data is single angle data, each scene may be distinguished using the entry point, and information about the angle is preferably not used. In this case, among the extended search results for one search keyword, It is desirable that all entry points do not overlap.

In addition, when the video data is multi-angle data, each scene may be distinguished using the entry point and the information about the angle. In this case, at least one entry of an extended search result for one search keyword may be used. Points can overlap.

In addition, the search keyword information may be a keyword for a scene type unit search, a character unit search, an actor unit search, or a search based on a search criteria that can be arbitrarily defined by a producer. It is preferable to include.

In addition, the metadata is preferably recorded in a file separate from the video data.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is an example of an apparatus for reproducing a storage medium on which metadata is provided to provide an extended search function according to the present invention.

2, the playback apparatus according to the present invention includes a reader 10, a playback unit 20, a search unit 30, and a user interface 40.

The read unit 10 reads metadata for providing an extended search function together with video data from a storage medium such as a Blu-ray disc. The reproduction unit 20 decodes and reproduces the video data. In particular, when a search keyword desired to be searched is input from the user, the searcher 20 receives information about a specific scene of the video data corresponding to the search keyword and plays the video data of the corresponding scene. When there are a plurality of scenes matching the search keyword, the scenes may be displayed through the user interface 40 and the scenes selected by the user may be played or the scenes searched may be continuously played. The playback unit is also called a playback control engine.

Meanwhile, the search unit 30 receives a search keyword from the user interface, searches for a scene that matches the search keyword, and transmits the search keyword to the user interface 40 to display the search results in a list form, or to reproduce the search results. Transfer to regeneration unit 20. As shown, the search result may be represented as a list of scenes that match the search keyword. The user interface 40 receives a search keyword from a user, displays a search result, and receives selection information about a scene that the user wants to play from among the displayed search results.

3 is a flowchart illustrating a method of reproducing a storage medium in which metadata is recorded according to the present invention.

Referring to FIG. 3, a search keyword that a user wants to search is input through the user interface 40 (step 202). Search keywords include scene type, character, and actor. In addition, various search keywords defined by creators such as items, locations, background music, etc. May be included. For example, when playing a matrix movie, you can search for all scenes in which the character Neo appears, or you can search for all scenes in which a cell phone appears as a prop. Next, referring to the metadata file according to the present invention, scenes matching the input search keyword are searched (step 204). The metadata file defines a plurality of scenes, and each scene defines search keyword information included in the scene and an entry point of each scene. The detailed configuration of the metadata file will be described later. Next, using the entry point of the found scene, the moving image data corresponding to the scene is found and reproduced (step 206). Accordingly, an extended search function using various search keywords for video data can be provided. Hereinafter, the extended search function will be referred to as "title scene search".

4 is an application example of metadata according to the present invention.

Metadata for title scene retrieval describes retrieval information for each scene by dividing moving image data, which is content recorded on a storage medium such as a Blu-ray disc, by scene. Referring to FIG. 4, an application example of searching for a desired scene using metadata is illustrated. For example, while playing a movie title such as a matrix or Lord of the Rings, the user can use a user interface such as a remote controller to search for a specific scene containing a desired search keyword. Can be selected.

The user selects one of the displayed search keywords (2), and selects a value corresponding to the selected search keyword (3). For example, if you select the search keyword item and select Tower as its value, you can search for scenes in which the item titled Top appears in the movie title being played, and display the thumbnail of the scene. Display (4) together. Each scene found is sorted and displayed in the order of playback time. When the user selects a scene to be played from the searched scenes, the scene is played (5), and the user skips to the next searched result or skips to the previous searched result. The interface may be used to play the previous or next scene of the search results (6). It is also possible to highlight playback in which all the found scenes are subsequently played back. This highlight playback allows for continuous playback of all search results instead of waiting for user selection to play any search result. When a user selects a keyword for a search within the content, relevant search results are extracted to form a highlight consisting of successive search results.

Hereinafter, the structure of metadata for implementing the aforementioned title scene search function will be described in detail.

5 is a reference diagram illustrating a relationship between metadata and video data according to the present invention.

Referring to FIG. 5, the storage medium according to the present invention further includes metadata 100 for title scene search in addition to the video data shown in FIG. 1. As shown in the drawing, the metadata 100 is recorded in a file separate from a playlist PlayList, which is a playback unit of video data. In addition, one metadata file 100 is configured on a playlist basis. The metadata file 110 includes a plurality of scenes, which are sections arbitrarily defined by the creator for the playlist file. Each scene includes an entry point indicating a starting point of the scene, and a playback duration of each scene may be further included according to an embodiment. The entry point is converted to a specific address of the clip AV stream using the EP map included in the clip information file. Therefore, the entry point can be used to find the starting position of each scene in the clip AV stream which is the actual moving picture data. In addition, each scene includes search keyword information included in the scene. For example, scene 1 is a battle scene, characters A, B, and C appear, actors a, b, and c appear, and the background includes search keyword information such as x. Accordingly, scenes including a search keyword desired by a user may be searched by using search keyword information for each scene. In addition, by using the entry point information of the retrieved scene, the corresponding position of the clip AV stream which is actual video data can be found and played.

6 is a reference diagram illustrating a directory structure of metadata according to the present invention.

Referring to FIG. 6, the index table is index.bdmv file, the movie object is MovieObject.bdmv file, the playlist is xxxxx.mpls file in the PLAYLIST directory, and the clip information is in the CLIPINF directory. The xxxxx.clpi file, the clip AV stream is the xxxxx.m2ts file in the STREAM directory, and other data are recorded as files in the AUXDATA directory.

Meanwhile, the metadata 100 for searching for a title scene according to the present invention is recorded as a file in a META directory separate from the moving picture data. dlmt_xxx.xml is a metadata file for a disc library function, and the metadata file for title scene search according to the present invention is esmt_xxx_yyyyy.xml. The metadata according to the present invention is recorded in a file in XML format using a markup language that is easy to edit and reuse. This is to solve the problem of the conventional storage media that once produced, it is almost impossible to edit or reuse the data.

More specifically, FIG. 7 is a reference diagram illustrating a naming rule of a metadata file according to the present invention. Referring to FIG. 7, the name of the metadata file 110 starts with the prefix esmt_ to indicate that it is metadata, and the next three characters indicate a language code according to ISO 639-2, and the next five characters correspond to the corresponding one. Indicates a playlist number. As described above, one metadata file is generated corresponding to one playlist. In addition, the language code may be used to support multiple languages in a menu displayed when searching for a title scene.

8 is a diagram illustrating the structure of metadata according to the present invention.

As described above, one metadata file 110 includes a plurality of scenes 112. Referring to FIG. 8, each scene 112 includes search keywords such as a scene type, a character, an actor, etc., and the value of each search keyword is searched according to an XML rule. Can be expressed as a child element or attribute of a keyword.

More specifically, FIG. 9 is a diagram illustrating a detailed structure of metadata according to the present invention. Referring to FIG. 9, a search keyword element, which is a scene type, a character, an actor, or a creator, is defined as a search keyword below a scene 112 element for searching for a title scene. Included. In addition, the scene 112 element includes an entry point (entry_point) that designates the start position of each scene and a playback duration indicating the duration of the playback of each scene, and supports a specific angle when the multi-angle is supported. Contains an angle number (angle_num) that you specify. Inclusion of playback duration or angle number is optional.

Hereinafter, an application example of providing a title scene search function using the above-described metadata structure will be described.

10 is a diagram illustrating an application range of a title for providing an extended search function according to the present invention.

As illustrated in FIG. 5, a Blu-ray disc may include a movie title for playing a movie such as a movie and an interactive title including programs for providing a user interaction function. The metadata for title scene retrieval according to the present invention is used only for movie titles because it is intended to provide an extended retrieval function during reproduction of a moving image. According to the BD-ROM specification [2], the title type can be known through the Title_playback_type field. If this field is 0b, it indicates a movie title. If this field is 1b, it indicates an interactive title. Therefore, the title scene search function according to the present invention can be used only when the Title_playback_type field is 0b.

Referring to FIG. 10, when a disc is loaded, a title # 1 is accessed through an index table, and a corresponding playlist # 1 is played when a navigation command called PLAY PlayList # 1 included in a movie object # 1 of title # 1 is executed. . As shown, playlist # 1 is composed of one or more playitems. Units such as chapters or scenes according to the present invention, which are arbitrarily defined by the producer and shown to the user, may be divided by the creator, regardless of the boundaries of the playitems. In this way, a playlist that is automatically played by the index table when the disc is loaded is called a main playback path playlist, and a playlist of the main path is called by the user by a button object during playback. A playlist played by another movie object is called a side playback path playlist. Subpath playlists are not included in the range of chapters or scenes defined by the author. Therefore, the title scene search function according to the present invention is activated only for the main playback path playlist, and the title scene search function is not activated for the sub path playlist.

In summary, the application scope of a title that provides an extended search function has the following constraints.

1) Title scene search applies only to movie titles.

2) Metadata for title scene search is defined in playlist units. Since one movie title may include one or more playlists, one or more metadata may be defined for the playlist.

3) Title scene search applies only to the main playback path playlist, not to the side playback path playlist.

11 is an embodiment in which metadata according to the present invention is applied.

Referring to FIG. 11, the concept of a scene used in metadata in accordance with the present invention is shown. A scene is a basic unit used in metadata for title scene search and is a basic unit for describing content included in a playlist. Authors can specify specific entry points in the playlist on the global time axis, and the content between two neighboring entry points becomes a scene.

When a user searches for content by using a search keyword, the search result is a set of entry points included in scenes whose contents of metadata match the input search keyword. These entry points are sequentially arranged in chronological order and are passed to a playback control engine (also called a playback unit) 20. The reproduction control engine 20 may find and reproduce a plurality of scenes having the same search keyword value.

Referring to FIG. 11, entry points of a search result are indicated by one circle for each search keyword. If the user selects scenetype # 1 as a search keyword, the search results are scene # 1, scene # 3, and scene #n as shown. The user can select a scene to play among them. In addition, the user interface 40 may navigate and play the previous or next search result by using a user operation (abbreviated as UO) such as Skip to Next Scene () or Skip Back to Previous Scene (). .

12 is another embodiment of applying metadata according to the present invention.

Referring to FIG. 12, an application example of defining a scene using a reproduction duration in addition to the entry point described above is shown. As shown, a scene is defined from the entry point to the point where the reproduction duration has elapsed. When the user selects a specific scene from the search results, the search results can be played according to three scenarios as follows.

1) Scenario 1: Simple Play

Regardless of the playback duration, playback starts from the entry point of the scene selected by the user in the search results and plays to the end of the playlist unless otherwise input by the user. For example, if the user selects scenetype # 1, it plays from the entry point of scene # 1 to the end of playlist # 1.

2) Scenario 2: Highlight Playback

From the search results, playback starts from the entry point of the scene selected by the user, and playback until the playback duration elapses, and then jumps to the next searched scene and plays back. For example, when the user selects scenetype # 2, only the searched scene # 1 and scene # 3 are played. That is, only the highlight portion including the search keyword can be collected and reproduced.

Another example of highlight reproduction is shown in FIG. Referring to FIG. 13, instead of stopping after playing one searched scene and waiting for user input, the searched results are continuously played. That is, when one scene of the search results for the actor a is finished, the next scene is played immediately afterwards, so that the highlight portion for the actor a can be collected and reproduced.

3) Scenario 3: Play Scene by Scene

Play the search results in scene units. That is, the scene selected by the user from the search results is played back from the entry point until the playback duration elapses, and the playback is stopped and the user waits for input. This is similar to scenario 2 described above except that playback is stopped at the end of a scene.

14 is a reference diagram illustrating an example of providing an extended search function in a multi-angle title by applying metadata according to the present invention.

Referring to Fig. 14, an example of a multi-pass title composed of multi angles is shown. In the illustrated example, the multi-pass title is composed of five playitems (PlayItem), the second playitem is composed of three multi-angles, the fourth playitem is composed of four multi-angles. In a multi-angle playlist, two scenes from Scene # 1 and Scene # 2 that match the search keyword scenetype # 1, and two scenes from Scene # 3 and Scene # 3 that match the search keyword scenetype # 2 Searched. Each scene is defined by an entry point and a playback duration.

The retrieved scenes may overlap as shown. This is because the case where the entry points overlap can be distinguished by the angle number (angle_num) shown in FIG. On the other hand, when the entry points do not overlap, the scenes of the extended search results cannot overlap. If the user wants to reproduce the search result according to the above-described scenario 2), the playback apparatus sequentially plays the scenes according to the dotted arrow in the figure.

At the bottom of the figure, a scene defined over a portion or a plurality of playitems of a playitem is shown. In each scene, metadata for title scene retrieval of moving picture data constituting the scene is defined.

On the other hand, in a playitem portion that supports multi-angles (for example, in case of playitems 2 and 4), metadata is applied only to video data corresponding to one angle among various supported angles. For example, referring to the case of scene # 1, a playback section is defined over play items 1 and 2, and 3 is designated as an angle_num. The number specified in the angle_num is applied only to the part of the playitem that supports the multi-angle, and the part over the remaining general playitem is played with the default angle. The default angle is specified in PSR (Player Status Register) 3, which is the status register of the playback device. Therefore, when playing scene 1, the default angle is played in the part that spans the general play number 1, and the third angle is played by the value that is specified in the angle_num attribute in the part that spans the play item 2, which is a multi-angle. . At this time, the search keywords for title scene search defined in scene 1 are applied to angle 3 in the part spanning play angle 2, which is a multi-angle. As described above, in order to use metadata including angle_num, various extended search functions according to a specified search keyword may be provided even in a multi-angle title.

15 is a state diagram of reproduction of the playback apparatus according to the present invention.

Referring to Fig. 15, there is shown a state diagram of a playback device that provides a title scene search function while playing back a movie title. First, when a disc is loaded and playback of a movie title starts (120), the title scene search function is activated in a valid state (122). As described above with reference to FIG. 14, when a movie title supporting multi-angle is played back, a title scene search may be performed by changing the angle (130). In addition, if a multi-path playlist is supported (124), when switching to a playlist of the main playback path, the title scene search function is activated in a valid state (134), but the side playback path (side playback) is supported. When changing to a playlist of path), the title scene search function is invalid (132). Further, when changing to an interactive title instead of a movie title, the title scene search function is invalid (138).

Meanwhile, the extended retrieval method according to the present invention can be created by a computer program. Codes and code segments constituting the program can be easily inferred by a computer programmer in the art. In addition, the program is stored in a computer readable media, and read and executed by a computer to implement the extended search method. The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium.

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

As described above, according to the present invention, there is provided a storage medium recording metadata for providing an extended search function using various search keywords for moving image data, a reproducing apparatus, and a reproducing method thereof. In addition, it is possible to smoothly provide an extended search function by interworking with video data of various formats.

That is, metadata for the extended search function is defined for each scene that can be arbitrarily defined by the producer, and includes at least one search keyword information for each scene, entry point and / or playback duration, angle information, and the like. By defining to include, it is possible to provide an extended search function according to various search keywords.

In addition, the search results can be controlled to be reproduced in various scenarios. In addition, an extended search function can be provided for a movie title supporting multi-angle or multi-path. Furthermore, metadata may be generated for each language to provide an extended search function that supports multiple languages.

Claims (21)

Video data; And And metadata for enabling extended search of the video data for each scene using at least one search keyword information. The method of claim 1, And the video data is a movie title. The method of claim 1, The metadata is defined in a playlist unit which is a playback unit of the video data. The method of claim 1, And the extended search is applied to a main playback path playlist that is automatically played back by an index table when the storage medium is loaded. The method of claim 1, And the metadata includes information on an entry point for each scene. The method of claim 5, And the scene is represented by content between two neighboring entry points among specific entry points specified in the playlist. The method of claim 6, When a user searches for content using a search keyword, the search result is represented by a set of entry points included in scenes in which search keyword information of metadata matches the input search keyword. The method of claim 7, wherein And said entry points are arranged sequentially in chronological order on said playlist. The method of claim 1, And the metadata includes information on an entry point and a playback duration for each scene. The method of claim 9, A scene is defined as a section between one entry point elapsed by the playback duration when a plurality of the entry points are arranged in a time sequence. The method of claim 9, And when the user searches for the content using the search keyword, the playback medium starts to play from the entry point of the scene selected by the user from the search result to the end of the playlist. The method of claim 9, When the user searches for the content by using the search keyword, the user starts playing from the entry point of the scene selected by the user in the search results, and plays until the playback duration elapses, and then jumps to the next searched scene. Storage media. The method of claim 9, When the user searches for the content using the search keyword, the search results are continuously played without waiting for the user's selection. The method of claim 9, When the user searches for the content by using the search keyword, playback starts from the entry point of the scene selected by the user in the search result and is played until the playback duration elapses, and the playback is stopped. The method of claim 5, The metadata may further include information about angles supported for each scene. The method of claim 15, When the video data is single angle data, each scene may be distinguished using the entry point, and the information on the angle is not used. The method of claim 16, Storage entry, characterized in that all entry points do not overlap in the extended search results for one search keyword. The method of claim 15, When the moving picture data is multi-angle data, each scene may be distinguished using the entry point and the information about the angle. The method of claim 18, And at least one entry point of the extended search results for one search keyword may overlap. The method of claim 1, The search keyword information includes a keyword for searching in a scene type unit, searching for a character unit, searching for an actor unit, or searching based on a search criterion that can be arbitrarily defined by a producer. Storage medium, characterized in that. The method of claim 1, The metadata is recorded in a separate file from the video data.

Images