CN101430915B

CN101430915B - Reproducing apparatus

Info

Publication number: CN101430915B
Application number: CN200810179561.7A
Authority: CN
Inventors: 姜满锡; 郑吉洙; 郑铉权; 高祯完; 朴成煜
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2003-10-04
Filing date: 2004-10-08
Publication date: 2015-07-15
Anticipated expiration: 2024-10-08
Also published as: CN101093710A; CN101430915A; KR20050033100A; CN101093710B

Abstract

The present invention provides a reproducing device which comprises the following components: a searching unit which searches a plurality of scenes of audio-video data and obtains the scene that is matched with a preset searching condition in the plurality of scenes through referring the keyword included in the metadata from the storing medium; and a reproducing unit which continuously reproduces the obtained scene through using the metadata, wherein, the metadata comprises the keyword which is used for scene searching function, the initial point information and duration time information of at least one scene in the plurality of scenes. Therefore, each strengthened searching function can be provided with each kind of searching keywords. Additionally, various additional functions can be provided with searching information.

Description

Reproducer

The divisional application of the patented claim that the application is the applying date is on October 8th, 2004, application number is 200410080586.3, be entitled as " storage medium of storing search information and reproducer and method ".

This application claims the right of priority of No. 2003-78643 of the submission on November 7th, No. 2003-69021 1 submitted on October 4th, 2003 in Korean Intellectual Property Office and the korean patent application of No. 2003-79177 of submission on November 10th, 2003, these applications are all published in this for reference.

Technical field

The present invention relates to a kind of storage medium of storing search information and equipment and the method for audio-video (AV) data also by using Search Results to provide additional function for reproducing the Search Results matched corresponding to the search condition with user.

Background technology

Storage medium storage as DVD comprises according to the compression standard compression of such as Motion Picture Experts Group (MPEG) standard and the video of coding and audio-visual data (the AV data of voice data and captions; Be sometimes referred to as " motion image data ").In addition, storage medium is storing reproduction information also, as the information about the encoded attributes of AV data stream and the reproduction order of AV data.

The moving image be stored in storage medium reproduces continuously according to information reproduction.Sometimes, in the reproducing processes of AV data, perform by the unit of the chapters and sections of AV data and jump and reproduce.In addition, when the conventional storage media of such as DVD, having provided can by the function of search using part_of_title (division header) (PPT) or elapsed time reproducing positions to be changed to ad-hoc location.

But, in traditional storage medium, do not provide the search condition in response to user jump to any scene and reproduce the function of this scene.That is, the search condition in response to the user of such as scene, role, position, project and sound is not provided to locate and the function of optional position of reproducing motion pictures data.Therefore, be difficult to perform different search procedures.

Summary of the invention

The invention provides a kind of storing search information storage medium and for the AV data of reproducing the Search Results matched corresponding to the search condition with user and by using equipment and the method for searching and providing additional function as result

According to an aspect of the present invention, provide a kind of storage medium, for storing: view data; With metamessage (meta information), when being used to the presumptive area in searching image data and reproducing the view data in searched region, use the view data in predetermined searched region to provide additional function.

Metamessage can comprise the search information corresponding at least one search condition in scene, role, sound, position and project.

Metamessage can comprise and is used to locate searched region and the information reproducing the view data in searched region.

Metamessage can comprise the information being used to reproduce the additional information relevant to the view data in searched region when reproducing the view data in searched region.

Metamessage can comprise the information being used to generate foregone conclusion part (event) when reproducing the view data in searched region.

Metamessage can belong to playlist mark group, and wherein, playlist mark group is one group of mark at fragment (clip) the middle instruction ad-hoc location corresponding to playlist, and playlist is the reproduction units of view data.

Metamessage can be recorded in the separated space be separated with playlist, and wherein, playlist is the reproduction units of view data.

Metamessage usable text or binary data structure.

Metamessage can be included in the displaying time information of the view data in searched region.

Metamessage can comprise the bag identifying information of the relevant additional information of instruction and the displaying time information of this relevant additional information.

Metamessage can comprise the event being used to start the view data reproduced in searched region and/or the event being used to the view data in the searched region of end of reproduction, wherein, event is used as the application programming interfaces of the application program providing program function or function of browse.

Event can be used to reproduce continuously the view data in searched region at least one information.

Event can be used to reproduce a view data in searched region and return the information of the searching menu of the selection for user when terminating the reproduction of view data.

According to a further aspect in the invention, provide a kind of reproducer, this equipment comprises: search unit, for searching for the region of the view data of mating with predetermined search condition according to the metamessage from above-mentioned storage medium; And reproduction units, for reproducing the view data in searched region and the function by using metamessage to utilize the view data of region of search to provide additional.

According to a further aspect in the invention, provide a kind of reproducting method, the method comprises: according to the region of the view data that the metamessage search from above-mentioned storage medium is mated with predetermined search condition; Reproduce the view data in searched region and the additional function by using metamessage to provide the view data in the searched region of use.

Accompanying drawing explanation

In conjunction with the drawings to the detailed description that embodiment is carried out, above and other characteristic of the present invention and advantage will become apparent, wherein:

Figure 1A to 1C is the diagram of the mutual relationship representing playlist, playlist mark, metamessage, playitems playitem, frag info and fragment;

Fig. 2 A to 5 is the diagrams of the function representing location according to a first embodiment of the present invention and reproduce the AV data in searched region;

Fig. 2 A is used to the diagram of the operation explaining the AV data that the search condition of location and reproduction and user when metamessage is included in the play list matches;

Fig. 2 B is used to explain and locates when metamessage is recorded in the separated space be separated with playlist and reproduce and the diagram of operation of AV data that the search condition of user matches;

Fig. 3 A is used to explain the diagram of the operation of the Skip_to_next_Enhanced_search_point () (jumping to the next Searching point strengthened) when metamessage is included in playlist mark;

Fig. 3 B is used to the diagram explaining the operation of Skip_to_next_Enhanced_search_point () when metamessage is recorded in the separated space be separated with playlist mark;

Fig. 4 A is used to the diagram explaining the operation of Skip_back_to_previous_Enhanced_search_point () (Searching point of the enhancing before rebound) when metamessage is included in playlist mark;

Fig. 4 B is used to the diagram explaining that the Skip_back_to_previous_Enhanced_search_point () when metamessage is recorded in the separated space be separated with playlist mark operates;

Fig. 5 is the reproducer represented for reproducing the storage medium wherein recording search information of the present invention;

Fig. 6 to Figure 12 is the diagram of the function representing AV data in the searched region of reproduction according to a second embodiment of the present invention and relevant additional information;

Fig. 6 A to Fig. 6 C is the diagram of the example of the metamessage for the search that strengthens and additional information Presentation Function represented according to a second embodiment of the present invention;

Fig. 7 is the diagram comprising the example of the motion image data of the storage medium of the additional pid information being used to additional information Presentation Function represented according to a second embodiment of the present invention;

Fig. 8 is the schematic diagram of the reproducer represented according to a second embodiment of the present invention;

Fig. 9 is the block diagram being used to the reproducer of search and the additional information Presentation Function strengthened represented according to a second embodiment of the present invention;

Figure 10 is the diagram representing PID filtrator and the example from the motion image data wherein exported;

Figure 11 is the diagram that the use representing according to a second embodiment of the present invention comprises the example of the additional information Presentation Function of the metamessage of additional pid information;

Figure 12 is the process flow diagram providing the search of enhancing and the reproducting method of additional information Presentation Function represented according to a second embodiment of the present invention;

Figure 13 to Figure 19 is the diagram representing AV data in the searched region of reproduction according to a third embodiment of the present invention and generate the function of event;

Figure 13 is the diagram being recorded in the data of some kinds in storage medium represented according to a third embodiment of the present invention;

Figure 14 is the schematic diagram of the reproducer represented according to a third embodiment of the present invention;

Figure 15 is the block diagram of the reproducer represented according to a third embodiment of the present invention;

Figure 16 is the detailed diagram of the reproducer represented according to a third embodiment of the present invention;

Figure 17 A to Figure 17 C is the diagram being used to the example of the metamessage of search and the event generating process process strengthened represented according to a third embodiment of the present invention;

Figure 18 A to 18B is the diagram of the search of the enhancing represented according to a third embodiment of the present invention and the example of event systematic function; With

Figure 19 is the process flow diagram providing the search of enhancing and the reproducting method of event systematic function represented according to a third embodiment of the present invention.

Embodiment

Describe the preferred embodiments of the present invention in detail with reference to the accompanying drawings.

Storage medium storage is according to a preferred embodiment of the invention used to the motion image data of reproduction film and is used to the presumptive area of searching moving view data and uses the motion image data in searched region to provide the metamessage of additional function when reproducing the motion image data in searched region.

Preferably, metamessage comprises the search information corresponding at least one search condition of scene, role, sound, position and project.

Specifically, the additional function of search information is used to comprise:

1) move on to searched region and reproduce the function (the first embodiment) of the motion image data in searched region;

2) function (the second embodiment) of relevant additional information is reproduced when reproducing the motion image data in searched region;

3) function (the 3rd embodiment) of scheduled event is generated when reproducing the motion image data in searched region.

Figure 1A to Fig. 1 C is the diagram of the mutual relationship representing playlist, playlist mark, metamessage, playitems playitem, frag info and fragment.Be used to search for the AV data of mating with user-defined search condition and use the motion image data in searched region to provide the metamessage of additional function and the position of metamessage by describing.

AV data and metamessage is stored according to storage medium of the present invention.Storage medium uses metamessage to provide the function of search of enhancing.Record cell for AV data is fragment, and the reproduction units for AV data is playlist or playitems playitem.Playlist mark instruction is corresponding to the ad-hoc location of the fragment of playlist.Fragment in the present invention is corresponding to cell (cell), that is, the record cell of conventional DVD.Playlist in the present invention and playitems playitem corresponding to program and cell, that is, the reproduction units of conventional DVD.In other words, AV data with fragment be unit record on a storage medium.Usually, fragment is recorded in the continuous print section of storage medium.Compress and record AV data are to reduce its size.Therefore, in order to reproduce the AV data of record, need the characteristic information of the AV data of compression.In Segment A/V stream, the bag formed by multiplexed multiplexed video, audio frequency and other data stream is compressed, is encoded and record.Each bag is identified by bag identifier (PID) i.e. unique identifier.

The attribute information of AV data is recorded in the frag info section for each fragment.In frag info section, record audio-video characteristic information and the entry point diagram (entry point map) of each fragment, wherein, the information that the Presentation Time Stamp (presentationtime stamp) (PTS) that entry point diagram comprises the reproduction time information with expression fragment mates.In the mpeg standard being most widely used as Moving picture compression standard, entry point corresponding to the position of I-image through interior image (intra-picture) compression process, the time search process of the position that the certain hour of process is corresponding after entry point diagram is mainly used to start with reproduction for search.

Playlist is reproduction units.At least one playlist is stored in storage medium.A film can be made up of a playlist.In addition, a film can be made up of several playlist.Playitems playitem comprises reproduction start and end time IN_time and OUT_time of the file name of reproduced clip information file and clip information file to indicate fragment and the precalculated position in the fragment being used to reproducing motion pictures data.

Meanwhile, be used to provide the metamessage of the function of search of enhancing and additional function can be recorded in the playlist mark comprised in the play list according to the present invention.In addition, metamessage can be recorded in the separated space be separated with the playlist mark in playlist.And metamessage can the form of scale-of-two or text be recorded in the separated space be separated with playlist.

With reference to Figure 1A, metamessage can be included in the text based data of the text subtitle as separated with motion image data.With reference to Figure 1B, metamessage can comprise in playlist mark.With reference to Fig. 1 C, metamessage can be included in the separated space be separated with the playlist mark in playlist in binary form.

A playlist 110 comprises the playlist mark 111 of the ad-hoc location of multiple instruction moving picture stream, many metamessages 112 and multiple playitems playitem (play item) 120.Metamessage 112 can be recorded in playlist mark 111 or in the separated space that is separated with by the playlist mark 111 being used to the function of search strengthened.Playitems playitem 120 indicates the region in fragment.More particularly, playitems playitem 120 indicates reproduction time IN_time and the reproduction end time OUT_time in the region in fragment.In fact, by using the region of frag info 130 search snippet.In a word, in the unit of playlist, perform AV data reproduction, and in a playlist 110, perform AV data reproduction with the order of the playitems playitem 120 listed in playlist 110.

Therefore, playlist mark 111 can be used to change reproducing positions by the ad-hoc location moving on to AV data.In addition, as mentioned above, because metamessage comprises various information, in the reproducing processes of AV data, reproducing positions can be moved to the special scenes that the search condition selected with user mates.

Now, use description to perform the searched region moving on to motion image data and reproducing the first embodiment of the present invention of additional function of the motion image data in searched region.

Fig. 2 A is the diagram of the operation for explaining the AV data that location and reproduction are mated with the search condition of user when metamessage is included in the play list.

When metamessage is included in playlist mark, each search item is called as mark.Playlist mark comprise identify chapters and sections chapters and sections mark, identify as the browsable rest image transfer point slided in the application of display jump, be used to as the navigation command of LinkMK linking point and identify other marks of metamessage mark.Especially, the example mark of Chapter_mark (chapters and sections mark) and Scene_marks (scene markers) is used to illustrate in fig. 2.

When reproducing the storage medium that wherein playlist mark is defined, if by using the searching menu input search condition of the enhancing provided by the manufacturer of reproducer or storage medium: Mark_Type=Scene_mark (type of sign=scene markers), Desc=" dental clinic (dental clinic) ",, then metamessage compares with the type of sign of the mark in playlist mark to search for the mark (Mark1, Mark4 and Mark5) mated with the search condition inputted by the search engine in reproducer.Next, Search Results is provided to user, and user selects one of mark searched.When the reproduction of user's selection marker Mark1, according to mark_time_stamp (tag time stamp) value and the reference playitems playitem value indicating Mark1, in playitems playitem PlayItem0, reproduce the fragment corresponding to PTS:i.Now, reproducer in any register, record the mark number " 1 " with reproduction start position information and in reproducing processes when the mark mated with the search condition of input occurs the register value of more new record.

Fig. 2 B is used to the diagram explaining the operation of locating and reproducing the fragment of mating with the search condition of user when metamessage is recorded in the separated space be separated with playlist mark.

When metamessage is recorded in the separated space be separated with playlist mark, each search item is called as project.In addition, when metamessage is recorded in text subtitle file in addition, the project of metamessage can by with the formal definition identical with the element of marking document (markup document).This attribute of an element has pts value.

Metamessage can comprise the Scene_type (scene type) identifying movie scene, the Character_type (character types) identifying role and multiple item types.Illustrate in Fig. 2 B and only comprised the example of Scene_type as the metamessage of the item types of project.If user's input search condition: Item_type=Scene_type (item types=scene type), Desc=" dental clinic ", then reproducer compares the item types of the project in metamessage and metamessage and the project (Item0, Item2 and Item4) of mating with the search condition of input is supplied to user.When the reproduction of user's option Item0, according to the reference playitems playitem value of item_time_stamp (PROJECT TIME stamp) value and project Item0, in playitems playitem Playitem0, reproduce the fragment corresponding to PTS:i.Now, reproducer records the item number " 0 " with reproduction start position and the item number upgraded when the item types with Scene_type occurs in reproducing processes in register in a register.

Now, by user operation when being described in detail in the PTS of the metamessage that the search condition that inputs with user mates in the reproducer being used for reproduction of AV data.User operation corresponding to conventional DVD function, as the NextPG_Search () that changes for chapters and sections and PrevPG_Search ().In order to provide user operation, define the Skip_to_next_Enhanced_Search_point () for the conversion of searched metamessage and Skip_back_to_previous_Enhanced_Search_point ().Now, similar with the user operation of the routine of PrevPG_Search () to the NextPG_Search () used in single title, in current reproduction playlist, effectively use Skip_to_next_Enhanced_Search_point () and Skip_back_to_previous_Enhanced_Search_point ().In addition, if the information of the mutual relationship between defining about multiple playlist, then user operation effectively can use in multiple list.

According to user operation Skip_to_next_Enhanced_Search_point (), reproducer move on to be greater than register store metamessage pts value searched metamessage pts value among have the metamessage of minimum pts value PTS position and start reproduce.According to user operation Skip_back_to_previous_Enhanced_Search_point (), reproducer move on to be less than register store metamessage pts value searched metamessage pts value among have the metamessage of maximum pts value PTS position and start reproduce.Now, user operation is described in detail with reference to Fig. 3 A and 3B.

Fig. 3 A is used to the diagram explaining the operation of Skip_to_next_Enhanced_Search_point () when metamessage is included in playlist mark.

The example of Fig. 3 A represents the situation generating the specific incoming event distributed by user operation Skip_to_next_Enhanced_Search_point () in the reproducing processes of the AV data comprising the metamessage that the search condition that inputs with user mates.

Assuming that the input search condition of user is Mark_type=Scene_mark, Desc=" detal clinic " and the mark mated with the input search condition of user is Mark1, Mark4 and Mark5.If user's selection marker Mark1, then the PTS position being reproduced in correlating markings starts.Next, if have be greater than instruction be recorded in the current reproducing flag in the playlist mark in current reproduction playlist number register value Mark1 pts value pts value search sign in the middle of receive user operation Skip_to_next_Enhanced_Search_point (), then have and can be left in the basket with the mark Mark2 of the value of the unmatched Desc of search condition of input with the mark Mark3 of the unmatched type of sign of search condition of input.On the other hand, in the middle of mark Mark4 and Mark5 mated with the search condition of input, the mark Mark4 with minimum pts value is selected.As a result, reproduction point is moved to the PTS:l of the playitems playitem PlayItem1 indicated by mark Mark4.

In addition, when the next mark mated with the search condition of input selected by reproducer, be greater than to the pts value of the corresponding mark of the register value of instruction current reproducing flag number and the mark mated with the search condition of input if do not had, then preferably ignore user operation.

Fig. 3 B is used to the diagram explaining the operation of Skip_to_next_Enhanced_Search_point () when metamessage is recorded in the separated space be separated with playlist mark.

In this case, assuming that user's initial conditions is " Item_type=Scene_item, Desc=" dental clinic " ", and the project of mating with initial conditions is Item0, Item2 and Item4.If user's option Item0, then the PTS position being reproduced in relevant item starts.Next, similar to the situation of Fig. 3 A, if have the project being greater than current registrar pts value pts value search item in the middle of receive user operation Skip_to_next_Enhanced_Search_point (), then ignore the project Item1 of value had with the unmatched Desc of search condition of input.On the other hand, in the middle of the project Item2 mated with the search condition of input and Item4, the project Item2 with minimum pts value is selected.As a result, reproducing positions is moved to the PTS:k of the playitems playitem Playitem1 indicated by project Item2.

In addition, when the next project of mating with the search condition of input selected by reproducer, if not there is the pts value being greater than the project corresponding to the register value of the current reproduction item number of instruction and the project of mating with the search condition of input, then preferably ignore user operation.

Fig. 4 A is used to the diagram explaining the operation of Skip_back_to_previous_Enhanced_Search_point () when metamessage is included in playlist mark.

This example represents the situation generating the specific incoming event distributed by user operation Skip_back_to_previous_Enhanced_Search_point () in the process reproducing the AV data comprising the metamessage that the search condition that inputs with user mates.

Fig. 4 B is used to the diagram explaining the operation of Skip_back_to_previous_Enhanced_Search_point () when metamessage is recorded in the separated space be separated with playlist mark.

User operation Skip_back_to_previous_Enhanced_Search_point () is similar to user operation Skip_to_next_Enhanced_Search_point ().In user operation Skip_back_to_previous_Enhanced_Search_point (), there is the mark that is less than current registrar or project

In the middle of the searched mark of the pts value of pts value or project, select mark or the project with maximum pts value.Reproducing positions is moved to by the PTS position indicated by the mark selected or project.In addition, when the preceding mark that reproducer selection is mated with the search condition of input or project, if not there is the pts value being less than the mark corresponding to indicating the register value of current reproducing flag or item number or project and the mark mated with the search condition of input or project, then preferably ignore user operation.

Fig. 5 is the block diagram of the reproducer represented for reproducing the storage medium it recording search information of the present invention.

This reproducer comprises reads unit 510, search unit 520, reproduction units 530 and temporal information storage unit 540.

Read the metamessage be recorded on storage medium that unit 510 reads mark described above or project.The search item that the metamessage that search unit 520 search is read mates with the search condition exported with expect.Reproduction units 530 reproduces the AV data corresponding to the search item selected by user in the search item exported.Event information storage unit 540 stores the displaying time information be included in searched search item.

In response to the order moving on to next or preceding search item in the reproducing processes of AV data, reproduction units 530 compares the displaying time information of the displaying time information in the metamessage of search item of being included in and storage and jumps to AV data with reproduction of AV data according to comparative result.Namely, the order in next searched region is moved on in reproducing processes in response to AV data, reproduction units 530 changes the reproducing positions of AV data and according to the displaying time information regeneration AV data be stored in search item, displaying time information has closest to but is greater than the value of the value of the displaying time information of storage.On the other hand, the order of preceding search item is moved on in reproducing processes in response to AV data, reproduction units 530 changes the reproducing positions of AV data and according to the displaying time information regeneration AV data be stored in search item, but this displaying time information has closest to is less than the value of the value of the displaying time information of storage.

Now, the second embodiment of the present invention of the additional function reproducing relevant additional information when reproducing the motion image data in searched region is used description to perform.

Fig. 6 A to Fig. 6 C is the diagram of example of the metamessage of the function representing the search being used to strengthen according to a second embodiment of the present invention and additional information display.

This metamessage comprises search information 610, additional pid information 620 etc.

Search information 610 be used to search for inputted by user or the presumptive area of motion image data that the predetermined search condition of external reception mates.By using the search keyword be included in search information, the function of search strengthened can be realized.

In addition, additional pid information 620 is used to the bag identifier identifying the relevant additional information reproduced together to the motion image data in searched region.Additional pid information 620 may further include the output time information 630 of the recovery time of the additional information representing relevant.By using additional pid information 620, in special time, relevant additional information can and reproduced together with the motion image data in the searched region that search condition mates.Namely, when reproducing the motion image data using the function of search search strengthened, additional pid information 620 as the bag identifier of the additional information relevant to search keyword is applied to PID filtrator, is not the additional information stream exported in general motion image data reproducing processes to reproduce.

As mentioned above, during metamessage 112 can be recorded in the mark of the playlist of playlist or is recorded in the separated space that is separated with playlist mark.On the other hand, metamessage 112 can be recorded in the separated space be separated with playlist.

With reference to Fig. 6 A, illustrate the example of the data structure of the metamessage 112 be recorded in the playlist mark of playlist.

The metamessage 112 being used to the function of search and the additional information display strengthened is included in playlist mark 111.Playlist mark structure PlayListMark (playlist mark) comprises search information 610, as represented meta_info (metamessage) field of search keyword information, indicating the mark_time_stamp field of the position of ref_to_PlayItem_id field and the instruction relevant search keyword in indicated playitems playitem that wherein there is the playing catalog of specific search keyword.In addition, playlist mark structure PlayListMark comprises the additional pid information 620 of the entry_ES_PID field that wherein have recorded the bag of the additional information for relevant search keyword as instruction, with the output time information 630 of the Duration field in the time interval during output such as represented when the relevant additional information bag of maintenance.

With reference to Fig. 6 B, illustrate record in the play list but be the example of the data structure of the metamessage 112 in the structure be separated with the playlist mark of playlist.

The metamessage structure MetaInformation that wherein have recorded metamessage 112 comprises search information 640, as represented the meta_info field of search keyword information, wherein there is the ref_to_PlayItem_id field of the playitems playitem of specific search keyword in instruction, and the mark_time_stamp field of the position of the relevant search keyword of instruction in indicated playitems playitem.In addition, metamessage structure MetaInformation comprises the additional pid information of the Additional_PID field 650 that wherein have recorded the bag of the additional information for relevant search keyword as instruction, with the output time information 660 of the Duration field in the time interval during output such as represented when the relevant additional information bag of maintenance.

With reference to Fig. 6 C, illustrate the example of the data structure of the metamessage in the separated space being recorded in and being separated with playlist, particularly, with the data structure of text based mark (markup) language representation.

The unit that scene in moving image is search or reproduces.Film is divided into multiple scene.Each scene comprises: about the search information 670 of the role relevant to scene, sound and project; As instruction wherein have recorded the additional pid information of the PID field 680 of the bag of the stream of the additional information relevant to search information; With the output time information 690 of the Duration field in the time interval during output such as represented when the relevant additional information bag of maintenance.

In the example shown in Fig. 6 A to Fig. 6 C, manufacturer can be comprised by being provided for the start time of the output of the additional information stream of search information thus the information of the outgoing position of additional information stream can being indicated according to metamessage of the present invention.In addition, metamessage can comprise the end time field of the expression end time of the Duration field that instead of the time interval represented when maintaining the output of the additional information bag of being correlated with.

The metamessage of the search being used to realize strengthening due to above-mentioned and the function of additional information display is described by the embodiment of exemplarily property, and therefore its various forms can be implemented.

Fig. 7 is the diagram comprising the example of the motion image data of the storage medium of the additional pid information being used to additional information Presentation Function represented according to a second embodiment of the present invention.

Be recorded in and comprise video packets 710, audio pack 720, display graphics bag 730 and interactive graphics (IG) bag 740 according to the motion image data (Segment A V stream) on storage medium of the present invention.

In addition, interactive graphics (IG) bag 750 and 750 ' can multiplexed form be recorded on a storage medium.In addition, interactive graphics (IG) bag 750 with 750 ' can multiplexed outside the form of (out-of-multiplexed) be recorded in the separated space be separated with motion image data (Segment A V flows).In addition, have multiplexed outside the additional information stream of form can not store on a storage medium and be stored on local storage.

More particularly, in order to construct a video data stream, multiple video packets 710 with same PID field are compressed with MPEG2 transport stream scheme and encode and be multiplexed in motion image data (Segment A V stream).

In order to construct multiple audio data stream, multiple audio pack 720 with same PID field is multiplexed in the motion image data (Segment A V stream) as video packets 710.

In order to construct multiple subtitle bitmap (bitmap) image or other image data stream, multiple display image bag 730 with identical PID field is multiplexed in motion image data (Segment A V stream).

In order to be configured to multiple pushbutton datas etc. of user interactions, multiple interactive graphics (IG) bag 740 is multiplexed in motion image data (Segment A V stream).

On the other hand, in order to show the additional information with the search information association of metamessage, have the multiple interactive graphics (IG) bags 750 according to display additional information of the present invention and 750 ' comprising there being the multiple button data without navigation command.The interactive graphics (IG) bag 750 and 750 ' of display additional information can be multiplexed into motion image data (Segment A V stream) or be recorded in the separated space be separated with motion image data (Segment A V flows) with (out-of-multiplexed) form outside multiplexed as above.When above, in order to identify that formation is multiplexed into the bag of the stream of motion image data (Segment A V stream), flowing through respective PID field and being identified.When below, in order to identify that display is recorded to the interactive graphics (IG) bag 750 ' of the additional information stream of the separated space of separation with the form outside multiplexed, interactive graphics (IG) bag 750 ' is identified by respective unique PID field.

Fig. 8 is the schematic diagram of the reproducer illustrated according to a second embodiment of the present invention.

Reproducer comprises demodulation ECC decoder module 810, separates packetizer (de-packetizer) 820 and 821, PID filtrator 830 and 831, demoder 840 to 870 and mixer 880 and 881.

Be similar to Fig. 7, the basic exercise view data for reproducer can be recorded to recording medium 800, and some data can not be stored in storage medium but be stored in the separated space of the separation of such as local storage 801.

Demodulation ECC decoder module 810 reads moving data streaming with multiplexed form from the data be recorded in storage medium 800, and performs demodulation ECC decoding process to moving data streaming.Next, if the moving data streaming read is the data stream indicated by the playitems playitem comprised in the play list, then moving data streaming is sent to as main TS and separates packetizer 820.In addition, if the moving data streaming read is by the data stream indicated from playitems playitem, then moving data streaming separates packetizer 821 as being sent to from TS.

On the other hand, demodulation ECC decoder module 810 also reads the additional information stream 802 be stored in the form outside multiplexed in local storage 801, demodulation ECC decoding process is performed to additional information stream, and decoded additional information stream is sent to each solution packetizer 820 and 821.

Separate packetizer 820 and receive from the separated space be separated of storage medium 800 or such as local storage 801 coded data compressed with each in 821, the data received are performed and separates multiplexed (de-multiplexed) process, and be divided into multiple bags with same PID field by by the multiplexed data of solution: video stream packets, audio stream bag, display graphics bag and/or interactive graphic stream.Next, separate packetizer 820 and 821 and bag is separated subpackage for substantially flowing and delivering to PID filtrator 830 and 831 by substantially spreading.

Playable_PID_entries (PID entry can the be play) information of the PID field of the current use of the instruction in response to the playitems playitem from the information reproduction had about current kinetic view data, the basic stream with the PID field indicated by playable_PID_entries information only selected by PID filtrator 830 and 831 from the multiple basic stream transmitted by solution packetizer 820 and 821, and each demoder 840 to 870 is delivered in substantially spreading of selecting.

Demoder comprises Video Decoder 840, display graphics demoder 850, interactive graphic decoder 860 and audio decoder 870.

The basic stream of Video Decoder 840 decode video data.Decode other of caption stream or view data of display graphics demoder 850 flows substantially.Interactive graphic decoder 860 decoding represents basic stream and the additional information of the pushbutton data of button.The basic stream of audio decoder 870 decoding audio data.In addition, under the control of switch 832, audio decoder 870 can respectively from PID the filtrator 830 and 831 main TS data of reception with from TS data.Each of mixer 880 and 881 all performs hybrid processing so that data are shown as image at screen to the data of the decoding transmitted from demoder 840 to 870.

In a word, reproducer according to the present invention reads multiplexed motion image data, leach the PID field of reproduced data stream packets by using the playable_PID_entries of the PID field representing the current use be included in playitems playitem, only hybrid processing is performed to the data stream corresponding to the PID field be filtered, and export mixed data stream.

The block forming aforementioned reproducer can comprise for decoding and the display engine of reproducing motion pictures data.In addition, display engine can be configured to the block of separation.In addition, some or all blocks can be implemented with software mode.In addition, repertoire can be incorporated in a chip, that is, SOC (system on a chip) (system-on-chip) (SoC).

Fig. 9 is the block scheme of the reproducer of the function for the search that strengthens and additional information display illustrated according to a second embodiment of the present invention.

Reproducer comprises reads unit 510, search unit 520, reproduction units 530 and additional information filter element 541.Search unit 520 is by using the region of the exercise data of the search condition of search information search coupling input.Additional information filter element 541 leaches additional information stream relevant to motion image data in searched region by using pid information.Reproduction units 530 reproduces together with the motion image data of the additional information stream leached in searched region.In the time corresponding to output time information, reproduction units 530 reproduces relevant supplementary information.

Figure 10 is the diagram that PID filtrator and the example from the moving data streaming wherein exported are shown.

As by separating packetizer 820 from the basic stream 1000 of the main TS data decomposition of Fig. 8, audio stream AUDIO1 (PID:2), audio stream AUDIO 2 (PID:3), caption stream SUBTITLE (PID:4) and interactive graphic stream INTERACTIVE GRAPHICS (PID:5) are illustrated.

If the reproduction of PID:1 and PID:2 be expressed in the playitems playitem of the information be included in needed for the reproduction with current kinetic view data current by by the PID field that uses be recorded can playable_PID_entries information 510 allow, then the video flowing VIDEO and audio stream AUDIO1 that correspond to PID:1 and PID:2 are sent to each demoder (840 in Fig. 8 and 870) and are outputted on display screen 1030 by video flowing VIDEO and audio stream AUDIO1 by PID filtrator 520 respectively.

As shown in Figure 10, voice data is reproduced by together with video screen.

Figure 11 is the diagram adding the example of information display function that the utilization illustrating according to a second embodiment of the present invention comprises the metamessage of additional pid information.

When general reproduction, with reference to the description of Figure 10, only have wherein reproduce the video flowing VIDEO of PID:1 and PID:2 that allows by the playable_PID_entries information of the playitems playitem of current reproduction and audio stream AUDIO 1 be sent to each demoder and reproduced.

But, when the reproduction of function of search utilizing the enhancing for reproducing the motion image data matched with predetermined search keyword, in the basic stream of PID:1 to PID:5, PID:1 and PID:2 indicated by the playable_PID_entries information 1010 of playitems playitem and the PID:5 for the additional information stream being recorded in the search information " Mt.Everest " in the additional pid information of metamessage 1011 is sent to each demoder (840 in Fig. 8,860 and 870) and is displayed on display screen 1030.

More particularly, according to the present invention by the entry_ES_PID field be included in metamessage 1011 (in Fig. 6 A 620) or Additional_PID field (in Fig. 6 B 650 and Fig. 6 C in 680) PID:5 that represents also is sent to PID filtrator 1020.Therefore, the basic stream corresponding to PID:5 can be sent to each demoder with reproduced by PID filtrator 1020 together with PID:1 with PID:2.As a result, as shown in figure 11, except for except the Audio and Video of Mt.Everest, the additional information of search information " Mt.Everest " is output on display screen 1030.That is, the height of such as Mt.Everest and the additional information of position can be shown.

On the other hand, as mentioned above, Duration field (in Fig. 6 A 630,690 in 660 or Fig. 6 C in Fig. 6 B) be maintained at from exporting the start time corresponding to the time interval of the end of output time of the additional information stream for the information of searching for " Mt.Everest " when additional information.If the time represented by Duration field passes by, then represent and be used for being removed by the PID:5 of the additional information stream of the search keyword in the pid information that uses by PID filtrator 1020.Thereafter, the general motion view data of additional information is not had to be output and to reproduce.

Figure 12 is the process flow diagram providing the search of enhancing and the reproducting method of additional information Presentation Function illustrated according to a second embodiment of the present invention.

In order to provide search according to enhancing of the present invention and additional information Presentation Function, as the predetermined search condition of the search keyword strengthened by inputting from user from external reception (operation 1210).The position of the motion image data of the search condition of coupling input is retrieved according to the metamessage be stored in storage medium and obtains (operation 1220).This is just called as the function of search of enhancing.

On the other hand, by using the additional pid information of metamessage, the additional information relevant to search keyword information is reproduced together with the motion image data in searched position (operating 1230).When the output time past tense (operation 1240) of the additional information that the output time information by metamessage represents, only there is no the motion image data of additional information reproduced (operation 1250).This is just referred to as additional information Presentation Function.

As a result, the region of the motion image data mated with the search keyword information be included in metamessage can be searched and motion image data only in region of search can be reproduced.In addition, relevant to the motion image data of coupling additional information can be reproduced by together with motion image data.When certain time past tense, only general motion data are reproduced.Such as, when searching for keyword " Mt.Everest ", Audio and Video about Mt.Everest in motion image data is reproduced, and simultaneously, the such as height of search keyword information " Mt.Everest " and the additional information of position can be reproduced.When certain time past tense, only do not have the general motion data of additional information reproduced.

Now, is implemented the third embodiment of the present invention of the additional function generating foregone conclusion part the time being described in the motion image data reproduced in region of search.

Storage medium is according to a third embodiment of the present invention except the motion image data for reproducing film with for controlling the metamessage also comprising search for performing enhancing and the event of generation except the navigation information that reproduces.Metamessage comprises the search information in the region for searching for the motion image data mated with search condition and the time for starting in the reproduction for the motion image data in region of search and terminate and generates to reproduce and start and the event information of End Event.Therefore, program engine or browser engine for controlling display engine can perform specific operation to dependent event.

Figure 13 is the data of record some kinds on the recording medium illustrated according to a third embodiment of the present invention.

On a storage medium, core data 1300, complete data (full data) 1310 and system data 1320 are recorded.

Core data 1300 for reproducing motion pictures data comprises the moving-picture information 1302 of compressed encoding and the navigation information 1301 for the reproduction of controlled motion image information 1302.Moving-picture information 1302 comprise as record cell the Segment A/V stream file of encoding according to mpeg standard etc. and comprise the clip information file, entry point information etc. of encoded attributes of Segment A/V stream file.In addition, moving-picture information 1302 also comprises the playitems playitem of the IN_time (angle of incidence) of the reproduction start and end time of the instruction clip information file as reproduction units and OUT_time (going out the time) position and comprises the playlist of multiple playitems playitem.Therefore, moving-picture information 1302 can be reproduced according to the navigation information 1301 of storage medium, thus user can see the moving image of such as high image quality film.

On the other hand, for providing the complete data 1310 of additional function and reproducing motion pictures can comprise for providing the routine data 1311 of interactive function for user and/or for the browser data 1312 of getting with reproduce the information relevant to the mark of storing moving image relevant information (markup) document.When not using additional function, complete data 1310 can not be comprised.

Routine data 1311 can provide the game function using motion image data, the function showing the annotation of director together with the some parts of reproduced motion image data, the function of display additional information or the function of chatting at the reproduction period of motion image data together with the some parts of reproduced motion image data.In addition, the program implemented together with JAVA language etc. can be comprised.

Browser data 1312 is constructed by the order being used to get the information relevant with the moving image reproduced to be stored in marking document.Order can be implemented by the easily extensible script of the markup language of such as HTML (Hypertext Markup Language) (HTML) and/or such as ECMA script (script).Therefore, relevant to the moving image be stored in marking document information can be got and be reproduced together with moving image.Such as, the news about actor or actress in webpage is stored in or other file relevant to the film be recorded in storage medium, the news of event of being correlated with film, the captions of renewal or other relevant information are got and reproduce together with film.In addition, complete data 1310 can comprise the data of other type for providing the additional function except moving-image reproducing function.

Meanwhile, the system data 1320 for the reproduction of control core data 1300 and/or complete data 1310 comprises log-on message 1321 and/or heading message 1322.When reproducer reproduces storage medium, the first reproducing positions of log-on message 1321 indicating target.Heading message 1322 comprises the entry point information of the reproducing positions of indicating target.

Meanwhile, metamessage according to the present invention comprises the search information and event generation information that are respectively used to search and the event systematic function strengthened.

Such as, metamessage according to the present invention uses role, dialogue, sound, project, position or other information as search keyword based on the content of the plot of film.Therefore, by using the search keyword being used for role, dialogue, sound, project or position, the moving-picture information that can only want in reproducing motion pictures information.

In addition, by using according to metamessage of the present invention, the position being reproduced in the AV data of the search Keywords matching of user's input starts.In the position that the reproduction in the region comprising relevant search keyword starts and terminates, beginning is reproduced in region and End Event can be generated.Therefore, specific operation can be held to the event generated by the engine for executive routine data 1311 or browser data 1312 capable.

Meanwhile, metamessage can be recorded thus be included in moving-picture information 1302.In addition, metamessage can be separated record by with moving-picture information 1302.That is, metamessage can be included in the playlist mark in the playlist that is contained in moving-picture information 1302.In addition, metamessage can be included in the separated space be separated with the playlist mark in playlist.In addition, metamessage can be separate with playlist scale-of-two or the form of text.

Moving-picture information 1302 and navigation information 1301, that is, one group of order being used for reproducing motion pictures is referred to as core data 1300 or the data for core schema.Because core schema is for using DVD application program (i.e. the video application of a kind of extensive employing) to watch pattern needed for the rendering data of film, so core schema is called film mode.On the other hand, the data for the programing function for providing user interactions and/or browser function are referred to as complete data 1310 or the data for complete pattern.Log-on message 1321 not in AD HOC and heading message 1322 are referred to as system data 1320.

The motion image data be recorded on the storage medium wherein storing above-mentioned data can be reproduced in two modes.A kind of is wherein by using navigation data and core data 1300 with the core schema of general film mode reproducing motion pictures data.Another kind is the complete pattern that wherein reproduced motion image data is displayed on the display window that defined by the application program using the program language that is included in complete data 1310 or markup language to be performed.

When complete pattern is by user or when being selected according to flow of navigation, by program language or markup language (in the present invention, the example of program language is JAVA language, and below, application program refers to JAVA application program) in the application program that performs, the function that display window is programmed by JAVA or markup language object element are produced.Motion image data can be shown under the control of JAVA application program or ECMAScript application program.

On the other hand, the interior perhaps JAVA application of JAVA programming or several sources (such as, image, audio frequency etc.) of marking document institute reference are also shown together with motion image data.

Wherein under above-mentioned complete pattern motion image data be displayed on to be applied by JAVA and/or on display window that markup language object element defines when, motion image data to be applied with JAVA and/or marking document is synchronously necessary.

Figure 14 is the schematic representation of the reproducer illustrated according to a third embodiment of the present invention.

Reproducer comprises reads unit 1410, buffer unit 1420 to 1460, reproduction units 1421 to 1461 and user input unit 1470.

Reproducer works in three modes.First mode is for the core schema by using core data 1300 to reproduce the moving image of such as film.Second pattern is for the browse mode by using the browser data 1312 output token document constructed by markup language and correlated source.3rd pattern is the program schema for being provided program execution enviroment by the isostructure routine data 1311 of JAVA language by use.

In order to support this Three models, reproduction units 1420 to 1460 comprises program engine 1421, browser engine 1431 and navigation engine 1441 respectively.Application manager selects one of engine to support corresponding reproduction mode by using switch.Therefore, when core mode data or complete mode data are processed, one of engine 1421,1431 and 1441 is activated.

If reproducer is the basic reproducer of the basic exercise image for reproducing such as film, then reproducer can not comprise program and browser engine 1421 and 1431 and buffer unit 1420 to 1460.

Now, the structure of reproducer will be described in detail.

Read unit 1410 and read motion image data 1302, navigation information 1301, routine data 1311, browser data 1312 and system data 1320, and data are stored into each buffer unit temporarily.The navigation cushioned, program and browser data 1301,1311 and 1312 are sent to each engine.The system data 1320 be buffered is sent to the application manager 1461 of selection first reproduction mode (core or completely pattern) and related data.At reproduction period, in order to be changed pattern or search title by user, associative mode can be performed according to heading message 1322.

Buffer unit 1420 to 1460 stores the data from reading unit 1410 reception temporarily.Data are sent to each engine by buffer unit 1420 to 1450.According to the interim data stored, some programs, browser, navigation, moving image and system data buffer 1420 to 1460 can be combined.

Reproduction units 1421 to 1461 comprises program engine 1421, browser engine 1431, navigation engine 1441, display engine 1451 and application manager 1461 respectively.

Program engine 1421 has the function performing the program code be included in routine data 1311.The program performed by program engine 1421 can control display engine 1451 by API.

Browser engine 1431 is had output token document and is controlled the function of display engine 1451 by API.

Navigation engine 1441 has by being used as one group of function being used to the navigation data control display engine 1451 of the order of reproducing motion pictures.

Display engine 1451 has the function of the motion image data of decoding reproducing motion pictures.

Application manager 1461 comprises for the treatment of the API corresponding to the order inputted by user and the control module of API that transmits from engine.Application manager 1461 has and processes the order that inputted by user and this API of being generated by engine and function API being sent to the engine of associative mode.In addition, application manager 1461 has the management function of startup and shut down procedure engine 1421, browser engine 1431 and navigation engine 1441.

User input unit 1470 comprises user's load module 1480 and queue 1490.Queue 1490 has and receives corresponding to the API of the order inputted by user and the API that transmits from engine and API be sent to the function of application manager 1461.This API comprises event information, order execution information, status information and the out of Memory for executive routine engine.

Figure 15 is the block scheme of the reproducer illustrated according to a third embodiment of the present invention.

More particularly, Figure 15 schematically shows the region for searching for the motion image data mated with search condition, and for the exercise data in searched region, reproduce start and at the end of generate the structure of the reproducer of event.

Reproducer comprises reads unit 510, search unit 520, reproduction units 530 and event generation unit 542.Search unit 520 and event generation unit 542 are reproducing the generation of the motion image data moment in region of search foregone conclusion part.

Figure 16 is the more detailed block diagram of the reproduction illustrated according to a third embodiment of the present invention.

Figure 16 is the more detailed block diagram of the reproducer in Figure 14.For convenience of description, only describe core schema (film mode), ignore the description about program and browser model.

Application manager 1640 selects the first reproduction mode according to system data, and activates the correlation engine for performing this pattern.Because program and browser model are left in the basket in figure 16, so the first reproduction mode is the core schema performed by navigation engine 1610.Application manager 1640 comprises the control module 1641 generated for controlling event.

As shown in figure 16, navigation engine 1610 has process navigation data and controls display engine 1630 to reproduce the function of the moving image of such as film by API.Navigation engine 1610 comprises command processor 1611.Command processor 1611 analyzes navigation data, that is, from the movie objects (one group of navigation command) that navigation data buffer 1600 receives, and the rendering control commands being used for motion image data is sent to display engine 1630.

Display engine 1630 comprises the search engine 1632 reset and control engine 1631 and strengthen.In response to the rendering control commands transmitted from navigation engine 1610, display engine 1630 reads motion image data from moving-image data buffer 1620 and controls engine 1631 decoding moving picture data by using to reset.Now, extracted by from motion image data by analysis playlist and above-mentioned reproduction units metamessage according to the present invention, and be sent to the search engine 1632 of the enhancing of the function of search for providing expansion.When metamessage is stored in the unique file separated with playlist, data are preferable by the search engine 1632 being directly sent to enhancing from moving-image data buffer 1620.

On the other hand, according to the present invention, reset whenever generating and wherein recording mark or the project of the metamessage mated with predetermined search condition and control engine 1631 and generate event.The event generated is sent to application manager 1640 by queue 1650.Event is generated the AD HOC engine notifying current control display engine 1630 by application manager 1640.AD HOC engine can comprise program engine 1421 as shown in figure 14 or browser engine 1431.

As mentioned above, when the reproduction period at storage medium is for reproducing the user operation commands of the motion image data corresponding to specific search keyword (below, being called UOP order) when being inputted by user, UOP order is sent to the control module 1641 of application manager 1640 by queue 1650.The UOP order transmitted is sent to the search engine 1632 of the enhancing of display engine 1630.The motion image data corresponding to the scene relevant to the search keyword of input searched for by the search engine 1632 strengthened.In response to Search Results, reset and control the motion image data that engine 1631 starts the position being reproduced in search.

Figure 17 A to 17C is the diagram of the example of the metamessage for the search that strengthens and event generating process illustrated according to the third embodiment of the invention.

Figure 17 A illustrates that wherein metamessage is included in the example in playlist mark, and described playlist mark i.e. one group of instruction corresponds to the mark of ad-hoc location of the motion image data of playlist, the unit of the reproduction of described playlist and motion image data.In this instance, search information 1710 comprises meta_info (metamessage) field, ref_to_PlayItem_id field and mark_time_stamp (tag time stamp) field.The instruction of mark_time_stamp field wherein records the reproduction start position in the region of the motion image data of each search keyword.Mark_time_stamp field can indicate the time when event according to the present invention is generated.Duration field 1720 represent with search for keyword relevant from reproduction start position to reproduction end position interregional every information.At the end of the duration, can be generated according to event of the present invention.

Figure 17 B illustrates that wherein metamessage is included in the example in the space that metamessage structure MetaInformation (metamessage) namely separates with the playlist mark in playlist.In this instance, search information 1730 comprises meta_info field, ref_to_PlayItem_id field and item_time_stamp (PROJECT TIME stamp) field.The instruction of item_time_stamp field wherein records the reproduction start position in the region of the motion image data of each search information.Item_time_stamp field can indicate the time when event according to the present invention is generated.Duration field 1740 represent with search for keyword relevant from reproduction start position to reproduction end position interregional every information.At the end of the duration, can be generated according to event of the present invention.

When use has the metamessage of structure as illustrated in figures 17a and 17b, display engine 1630 controls engine 1631 by resetting and reproduces beginning event in the reproduction start position formation zone of metamessage.The event generated is sent to application manager by queue 1650.In addition, display engine 1630 produces region at the reproduction end position of the corresponding motion image data of the search keyword to moving image and reproduces End Event.The event of this generation is sent to application manager by queue 1650.

On the other hand, as mentioned above, when the event of generation, analyzed metamessage is sent to the search engine 1632 of enhancing to be used to provide according to the multiple search criterion of user's input the function of search of enhancing.

Figure 17 C illustrates that metamessage is recorded in the example in the space separated with playlist with scale-of-two or textual form.Specifically, in this instance, metamessage is labeled language and performs in the form of text.

Single film is divided into multiple scene and search keyword information is recorded in each scene.Such as, suppose scene Scene1 have from the outset between the time interval of x1 1750 to end time y1 1760 and the search keyword information 1770 of the such as information of performer A and the information of sound B.In addition, suppose scene 2 have from the outset between x2 to end time y2 the time interval and have at least one and be present in search information in scene.

In this case, reproduce and to start and End Event can by the start_time (start time) in use metamessage respectively and end_time (end time) attribute and being generated.

When the function of search strengthened is activated by the input of user, the search engine 1632 that the position corresponding to the search keyword of input is enhanced is searched for, and the motion image data of this position is reset, control engine 1631 reproduces.Therefore, if user's input or select the search keyword of expectation of such as scene, role, project, position and sound, then the relevant position of motion image data is searched by use search keyword, thus reproduction can from the position that user wants.

As mentioned above, except the function of search strengthened, the event systematic function starting event and/or End Event for the reproduction generated corresponding to specific search keyword can be provided by using metamessage.In the reproduction situation of complete pattern, when the motion image data mark relevant to special search or project being corresponded to specific search keyword is reproduced, the event of generation can be used to the additional function providing such as program function and browsing image data function.

Now, the other example of the event be generated will be described.

Figure 18 A and 18B is the diagram of the search of the enhancing illustrated according to the third embodiment of the invention and the example of event systematic function.

Search for and the mark of search Keywords matching, time or scene by using the search engine 1632 (see Figure 17 A to 17C) strengthened according to reproducer of the present invention.When user selects by the mark of reproduced search, time or scene for the moment, reproducer is switched to the relevant position as reproduction start position and starts to reproduce.The reproduction location information corresponding to related search keywords is sent to reset and controls engine 1631 by the search engine 1632 strengthened.Reset control engine 1631 by use the reproduction location information received reproduce relevant position motion image data and simultaneously formation zone reproduce beginning event.

When reproducing the duration having performed from the reproduction start position relevant to the search keyword selected by user, resetting controls engine 1631 and generates reproduction End Event by the end_time in the situation in the external file that uses the Duration field of the search item as shown in Figure 17 A and 17B or mark or be stored in as shown in Figure 17 C at metamessage.

By using the event generated, as shown in figures 18a and 18b, only relevant to specific search keyword scene can be continuously reproduced at a data rate r.Figure 18 A illustrates and reproduces the example that wherein metamessage is included in the storage medium in mark or project.Figure 18 B illustrates and reproduces the example that wherein metamessage is stored in the storage medium in the external file of separation.

In addition, in other example, a part for only relevant to specific search keyword information moving image can be reproduced, and when reproducing the End Event generated, reproducer can return searching menu.Like this, different examples can be implemented by use reproduction beginning and End Event.

Figure 19 is the process flow diagram providing the search of enhancing and the reproducting method of event systematic function illustrated according to a third embodiment of the present invention.

When user inputs predetermined search condition or searching request (operation 1910), the position (operating 1920) of the motion image data that reproducer mates with the search condition of input according to the metamessage search be recorded in storage medium.Now, this is referred to as the function of search of enhancing.According to the example of metamessage, there is at least one in mark, project or the scene of mating with search condition.In addition, reproducer reproduces the motion image data of searched position, and beginning event (operation 1930) is reproduced in formation zone simultaneously.When the past tense of the duration from reproduction start position, maybe when arriving end_time, reproducing End Event and being generated (operation 1940).When the mark searched for, project or scene exist, reproduction and event generating run 1930 and 1940 can be repeated (operation 1950).

As a result, at the reproduction period of the motion image data of match search condition, can be provided according to the function of search of the enhancing of different standards and event can be generated.As mentioned above, the event of generation can be applied to the situation that wherein only relevant to specific search keyword scene exists.In addition, the event of generation can be used to the synchronizing signal for routine data or browser data.

According to storage medium of the present invention preferably can with reproducer separate and can by using the optical devices of reproducer the CD that be read.Such as, storage medium can comprise the CD that such as CR-ROM, DVD maybe will be developed.

According to the present invention, the storage medium wherein recording metamessage can provide the function of search of the enhancing utilizing different search keywords.In addition, the additional function of search information is utilized to be provided.That is, the motion image data in the region of search can be switched to and reproducing motion pictures data.In addition, can reproducing motion pictures data and relevant additional information, and generate event.

The present invention can also implement as computer-readable code on a computer readable recording medium.This computer readable recording medium storing program for performing is any can storage by the data storage device of the data of computer system reads.The example of computer readable recording medium storing program for performing comprises ROM (read-only memory) (ROM), random access storage device (RAM), CD-ROM, tape, floppy disk, optical data storage device and carrier wave (such as being transmitted by the data of internet).This computer readable recording medium storing program for performing can also be distributed in the network being connected to computer system, thus computer-readable code is stored in a distributed fashion and is performed.

Although show and describe the present invention in detail with reference to its exemplary embodiment, but it should be appreciated by those skilled in the art when not departing from the spirit and scope of the present invention be defined by the following claims, the change of various forms and details can be carried out wherein.

Claims

1. a reproducer, comprising:

Read unit, read the metamessage that storage medium records, wherein, described metamessage comprise search keyword, the information being used to indicate the reproduction start position of multiple scenes of motion image data and Duration Information, described Duration Information represent to search keyword relevant from reproduction start position to reproduction end position interregional every information;

The search engine strengthened, multiple scenes of the motion image data that search is relevant to the search keyword comprised in the metamessage read in multiple scene, and obtain described scene;

Reset and control engine, beginning event is reproduced in reproduction start position formation zone by using described metamessage, reproduce End Event in reproduction end position formation zone, thus utilize the event generated to reproduce the obtained scene relevant to described search keyword continuously.