CN101093710B - Storage medium storing search information and reproducing apparatus and method - Google Patents
Storage medium storing search information and reproducing apparatus and method Download PDFInfo
- Publication number
- CN101093710B CN101093710B CN2007101090768A CN200710109076A CN101093710B CN 101093710 B CN101093710 B CN 101093710B CN 2007101090768 A CN2007101090768 A CN 2007101090768A CN 200710109076 A CN200710109076 A CN 200710109076A CN 101093710 B CN101093710 B CN 101093710B
- Authority
- CN
- China
- Prior art keywords
- search
- data
- information
- metamessage
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
- H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
- G11B2220/2537—Optical discs
- G11B2220/2562—DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
Abstract
A storage medium storing search information and a reproducing apparatus for and method of reproducing AV data corresponding to a searching result matching a user's search condition and providing additional functions by using the searching result are provided. The storage medium includes: image data; and meta information used to provide an additional function using the image data in a predetermined searched section at a time of searching the predetermined section of the image data and reproducing the image data in the searched section. The meta information includes: search information corresponding to at least one search condition of a scene, character, sound, location, and item; information used to position the searched section and reproduce the image data in the searched section; information used to reproduce additional information associated with the image data in the searched section at a time of reproducing the image data in the searched section; and information used to generate a predetermined event at the time of reproducing image data in the searched section. Accordingly, it is possible to provide various enhanced searching functions using various search keywords. In addition, it is possible to provide various additional functions using search information.
Description
The application is to be that October 8, application number in 2004 are 200410080586.3, are entitled as the dividing an application of patented claim of " storage medium of storing search information and reproducer and method " applying date.
The application requires the right of priority of 2003-78643 number of submitting on November 7th, 2003-69021 number 1 that Korea S Department of Intellectual Property submitted on October 4th, 2003 and 2003-79177 number the korean patent application of submitting on November 10th, 2003, and these applications all are published in this for reference.
Technical field
The storage medium that the present invention relates to a kind of storing search information and audio-video (AV) data that are used to reproduce the Search Results that is complementary corresponding to search condition and through using Search Results that the equipment and the method for additional function are provided with the user.
Background technology
Storage medium stores like DVD comprises according to compression standard compression and the video of coding and audio-video data (the AV data of voice data and captions like Motion Picture Experts Group (MPEG) standard; Be sometimes referred to as " motion image data ").In addition, storage medium is storing reproduction information also, like the information about the reproduction order of the encoded attributes of AV data stream and AV data.
The moving image that is stored in the storage medium reproduces according to information reproduction continuously.Sometimes, in the reproduction process of AV data, press the unit of the chapters and sections of AV data and carry out jump and reproduction.In addition, in situation like the conventional storage media of DVD, provide can through use part of title (division header) (PPT) or elapsed time will reproduce the function of search of position change to ad-hoc location.
Yet, in traditional storage medium, do not provide search condition in response to the user to jump to any scene and reproduce the function of this scene.That is, do not provide in response to locating like the user's of scene, role, position, project and sound search condition and the function of the optional position of reproducing motion pictures data.Therefore, be difficult to carry out different search procedures.
Summary of the invention
The storage medium that the invention provides a kind of storing search information and the AV data that are used to reproduce the Search Results that is complementary corresponding to the search condition with the user are also searched equipment and the method that additional function is provided as the result through use
According to an aspect of the present invention, a kind of storage medium is provided, has been used for storage: view data; And metamessage (meta information), be used to when the presumptive area of searching image data is also reproduced by the view data in the region of search, use predetermined view data that additional function is provided by in the region of search.
Metamessage can comprise the search information corresponding at least one search condition in scene, role, sound, position and the project.
Metamessage can comprise and is used to locate by the region of search and reproduces by the information of the view data in the region of search.
Metamessage can comprise be used to when reproducing, reproduce by the view data in the region of search with by the information of the relevant additional information of the view data in the region of search.
Metamessage can comprise the information that is used to when reproducing by the view data in the region of search, generate foregone conclusion spare (event).
Metamessage can belong to the playlist mark group, and wherein, the playlist mark group is the sign of one group of indication ad-hoc location in corresponding to the fragment (clip) of playlist, and playlist is the reproduction units of view data.
In the separated space that metamessage can be recorded in playlist separates, wherein, playlist is the reproduction units of view data.
Metamessage usable text or binary data structure.
Metamessage can be included in by the demonstration temporal information of the view data in the region of search.
Metamessage can comprise the demonstration temporal information of the additional information that the bag identifying information of the additional information that indication is relevant is relevant with this.
Metamessage can comprise and is used to begin to reproduce by the incident of the view data in the region of search and/or be used to end of reproduction by the incident of the view data in the region of search; Wherein, incident is used as the application programming interfaces of the application program that program function or function of browse are provided.
Incident can be at least one the information that is used to reproduce continuously by the view data in the region of search.
Incident can be to be used to reproduce by an information view data in the region of search and that when finishing the reproduction of view data, return the searching menu of the selection that is used for the user.
According to a further aspect in the invention, a kind of reproducer is provided, this equipment comprises: search unit is used for according to the zone of searching for the view data of mating with predetermined search condition from the metamessage of above-mentioned storage medium; And reproduction units, be used for reproducing by the view data of region of search and through using metamessage to utilize the view data of region of search that additional function is provided.
According to a further aspect in the invention, a kind of reproducting method is provided, this method comprises: according to the zone of searching for the view data of mating with predetermined search condition from the metamessage of above-mentioned storage medium; Reproduction is by the view data in the region of search and through using metamessage to provide use by the additional function of the view data in the region of search.
Description of drawings
The detailed description of in conjunction with the drawings embodiment being carried out, above-mentioned and other characteristics of the present invention and advantage will become apparent, wherein:
Figure 1A to 1C is the diagrammatic sketch of the mutual relationship of expression playlist, playlist mark, metamessage, playitems playitem, frag info and fragment;
Fig. 2 A to 5 is that expression is according to the location of first embodiment of the invention with reproduce by the diagrammatic sketch of the function of the AV data in the region of search;
Fig. 2 A is used for explaining the diagrammatic sketch that is included in the operation of the AV data that the search condition of location and reproduction and user is complementary under the situation in the playlist at metamessage;
Fig. 2 B is the diagrammatic sketch that is used for explaining the operation of the AV data that the search condition of location and reproduction and user is complementary under the situation in the separated space that metamessage is recorded in playlist separates;
Fig. 3 A is used for explaining the diagrammatic sketch that is included in the operation of Skip_to_next_Enhanced_search_point () under the situation in the playlist mark (jumping to the next search point that strengthens) at metamessage;
Fig. 3 B is the diagrammatic sketch that is used for explaining the operation of Skip_to_next_Enhanced_search_point () under the situation in the separated space that metamessage is recorded in playlist mark is separated;
Fig. 4 A is used for explaining the diagrammatic sketch that is included in the operation of Skip_back_to_previous_Enhanced_search_point () under the situation in the playlist mark (the search point of the enhancing before the rebound) at metamessage;
Fig. 4 B is the diagrammatic sketch that is used for explaining the Skip_back_to_previous_Enhanced_search_point () operation under the situation in the separated space that metamessage is recorded in playlist mark is separated;
Fig. 5 is the reproducer that expression is used to reproduce the storage medium that wherein records search information of the present invention;
Fig. 6 to Figure 12 is expression according to the reproduction of second embodiment of the invention by the diagrammatic sketch of the function of AV data in the region of search and relevant additional information;
Fig. 6 A to Fig. 6 C is the diagrammatic sketch of expression according to the example of the metamessage of the search that is used to strengthen of second embodiment of the invention and additional information Presentation Function;
Fig. 7 is the diagrammatic sketch of expression according to the example of the motion image data of the storage medium of the additional pid information that is used to the additional information Presentation Function comprising of second embodiment of the invention;
Fig. 8 is the synoptic diagram of expression according to the reproducer of second embodiment of the invention;
Fig. 9 is the block diagram of expression according to the reproducer of the search that is used to strengthen of second embodiment of the invention and additional information Presentation Function;
Figure 10 is an expression PID filtrator and from the diagrammatic sketch of example of the motion image data of output wherein;
Figure 11 is the diagrammatic sketch of example of the additional information Presentation Function of the expression metamessage that comprises additional pid information according to the use of second embodiment of the invention;
Figure 12 is the process flow diagram of expression according to the reproducting method of the search that enhancing is provided of second embodiment of the invention and additional information Presentation Function;
Figure 13 to Figure 19 is expression according to the reproduction of third embodiment of the invention by the AV data in the region of search and generate the diagrammatic sketch of the function of incident;
Figure 13 is the diagrammatic sketch of expression according to the data that are recorded in some kinds in the storage medium of third embodiment of the invention;
Figure 14 is the synoptic diagram of expression according to the reproducer of third embodiment of the invention;
Figure 15 is the block diagram of expression according to the reproducer of third embodiment of the invention;
Figure 16 is the detailed diagram of expression according to the reproducer of third embodiment of the invention;
Figure 17 A to Figure 17 C is that expression is according to the search that is used to strengthen of the third embodiment of the invention diagrammatic sketch with the example of the metamessage of incident generation processing procedure;
Figure 18 A to 18B is expression according to the diagrammatic sketch of the example of the search of the enhancing of third embodiment of the invention and incident systematic function; With
Figure 19 is the process flow diagram of expression according to the reproducting method of the search that enhancing is provided of third embodiment of the invention and incident systematic function.
Embodiment
To specify the preferred embodiments of the present invention with reference to accompanying drawing.
The motion image data that storage medium stores according to a preferred embodiment of the invention is used to reproduce film uses the metamessage that additional function is provided by the motion image data in the region of search with the presumptive area that is used to the searching moving view data and when reproducing by the motion image data in the region of search.
Preferably, metamessage comprises the corresponding search information of at least one search condition with scene, role, sound, position and project.
Specifically, use the additional function of search information to comprise:
1) moves on to by the region of search and reproduce by the function of the motion image data in the region of search (first embodiment);
The function (second embodiment) of the additional information that 2) reproduction is relevant when reproducing by the motion image data in the region of search;
3) function (the 3rd embodiment) of generation scheduled event when reproducing by the motion image data in the region of search.
Figure 1A to Fig. 1 C is the diagrammatic sketch of the mutual relationship of expression playlist, playlist mark, metamessage, playitems playitem, frag info and fragment.Description is used to search for the AV data of user-defined search condition coupling and uses by the motion image data in the region of search provides the metamessage of additional function and the position of metamessage.
According to storage medium stores AV data of the present invention and metamessage.Storage medium uses metamessage that the function of search of enhancing is provided.The record cell that is used for the AV data is a fragment, and the reproduction units that is used for the AV data is playlist or playitems playitem.The playlist mark indication is corresponding to the ad-hoc location of the fragment of playlist.Fragment among the present invention is corresponding to cell (cell), that is, and and the record cell of conventional DVD.Playlist among the present invention and playitems playitem be corresponding to program and cell, that is, and and the reproduction units of conventional DVD.In other words, the AV data are that unit record is on storage medium with the fragment.Usually, fragment is recorded in the continuous section of storage medium.Compress and record AV data are in order to reduce its size.Therefore, in order to reproduce the AV data of record, need the characteristic information of the AV data of compression.In Segment A/V stream, encapsulate compression, encode and record through what multiplexed multiplexing video, audio frequency and other data stream formed.Each bag is that unique identifier is identified through bag identifier (PID).
The attribute information of AV data is recorded in the frag info section that is used for each fragment.In the frag info section; Write down the audio-video characteristic information and the clauses and subclauses point diagram (entry point map) of each fragment; Wherein, the clauses and subclauses point diagram comprises (PTS) information matching of demonstration timestamp (presentationtime stamp) of the recovery time information with expression fragment.In being widely used as most the mpeg standard of moving image compression standard; Entry point is corresponding to the position of the I-image of process interior image (intra-picture) processed compressed, and the clauses and subclauses point diagram mainly is used to be used for searching for and reproduces the beginning time search process of the corresponding position of certain hour of process afterwards.
Playlist is a reproduction units.At least one playlist is stored in the storage medium.A film can be made up of a playlist.In addition, a film can be made up of several playlists.Playitems playitem comprise with by the reproduction start and end time IN_time of the file name of the clip information file reproduced and clip information file and OUT_time to indicate fragment and the precalculated position on the fragment that is used to the reproducing motion pictures data.
Simultaneously, be used to provide the function of search of enhancing and the metamessage of the function of adding to be recorded in the playlist mark that is included in the playlist according to the present invention.In addition, metamessage can be recorded in playlist in the separated space that separates of playlist mark in.And, metamessage can scale-of-two or the separated space that form is recorded in playlist separates of text in.
With reference to Figure 1A, metamessage can be included in the text based data like the text subtitle that separates with motion image data.With reference to Figure 1B, metamessage can comprise in the playlist mark.With reference to Fig. 1 C, metamessage can binary mode be included in playlist in the separated space that separates of playlist mark in.
A playlist 110 comprises the playlist mark 111 of the ad-hoc location of a plurality of indication moving picture streams, many metamessages 112 and a plurality of playitems playitem (play item) 120.Metamessage 112 can be recorded in playlist mark 111 or with separated space that the playlist mark 111 of the function of search that will be used to strengthen is separated in.Zone in the playitems playitem 120 indication fragments.More particularly, the reproduction start time IN_time and the reproduction end time OUT_time in the zone in the playitems playitem 120 indication fragments.In fact, through using the zone of frag info 130 search snippet.In a word, in the unit of playlist, carry out the AV data reproduction, and in a playlist 110, carry out the AV data reproduction with the order of the playitems playitem 120 listed in the playlist 110.
Therefore, can use playlist mark 111 to change and reproduce the position through the ad-hoc location that moves on to the AV data.In addition, as stated,, in the reproduction process of AV data, reproduce the special scenes that the position can be moved to the search condition coupling of selecting with the user because metamessage comprises various information.
Now, use description to carry out move on to motion image data by the region of search and reproducing by the first embodiment of the present invention of the additional function of the motion image data in the region of search.
Fig. 2 A is used for explaining the diagrammatic sketch that is included in the operation of the AV data of the search condition coupling of location and reproduction and user under the situation of playlist at metamessage.
Be included under the situation in the playlist mark at metamessage, each search item is called as sign.Playlist mark comprise the rest image transfer point in the application that the chapters and sections sign of discerning chapters and sections, identification as browsable slip show jump, be used to like the linking point of the navigation command of LinkMK and other signs of identification metamessage sign.Especially, the example sign that uses Chapter_mark (chapters and sections sign) and Scene_marks (scene sign) is shown in Fig. 2 A.
When reproducing the storage medium that playlist mark wherein defined; If the searching menu input search condition of the enhancing that provides through the manufacturer that uses by reproducer or storage medium: Mark_Type=Scene_mark (type of sign=scene sign); Desc=" dental clinic (dental clinic) ";, then the search engine in the reproducer compares the type of sign of the sign in metamessage and the playlist mark with the sign (Mark1, Mark4 and Mark5) of search with the search condition coupling of input.Next, Search Results is provided for the user, and the user selects one of sign that searches.Under the situation of the reproduction of user's selection marker Mark1,, in playitems playitem PlayItem0, reproduce and the corresponding fragment of PTS:i according to the reference playitems playitem value of mark_time_stamp (sign timestamp) value and sign Mark1.At this moment, reproducer record in any register have the mark number " 1 " of reproduction start position information and in the reproduction process when the sign with the search condition coupling of input occurs the register value of new record more.
Fig. 2 B is the diagrammatic sketch of operation of fragment of location and reproduction and user's when being used for explaining in the separated space that metamessage is recorded in playlist mark is separated search condition coupling.
Under the situation in the separated space that metamessage is recorded in playlist mark is separated, each search item is called as project.In addition, be recorded in addition under the situation in the text subtitle file at metamessage, the project of metamessage can by with the identical formal definition of element of marking document (markup document).This attribute of an element has pts value.
Metamessage can comprise the Scene_type (scene type) that discerns movie scene, identification role's Character_type (character types) and multiple item types.Illustrated among Fig. 2 B and only comprised the example of Scene_type as the metamessage of the item types of project.If user's input search condition: Item_type=Scene_type (item types=scene type); Desc=" dental clinic ", then reproducer compares the item types of the project in metamessage and the metamessage and will offer the user with the project (Item0, Item2 and Item4) of the search condition coupling of importing.Under the situation of the reproduction of user's option Item0,, in playitems playitem Playitem0, reproduce and the corresponding fragment of PTS:i according to the reference playitems playitem value of item_time_stamp (PROJECT TIME stamp) value and project Item0.At this moment, reproducer writes down the item number " 0 " with reproduction start position and in the reproduction process, when the item types with Scene_type occurs, upgrades the item number in the register in register.
During now, with the PTS that is described in detail in the metamessage of the search condition coupling of user input in user's operation of the reproducer that is used for reproduction of AV data.The user operates corresponding to conventional DVD function, as is used for the NextPG_Search () and the PrevPG_Search () of chapters and sections conversion.In order to provide the user to operate, defined the Skip_to_next_Enhanced_Search_point () and the Skip_back_to_previous_Enhanced_Search_point () of the conversion of the metamessage that is used for being searched for.At this moment; Operate similarly with the user of NextPG_Search () that in single title, uses and the routine of PrevPG_Search (), in current reproduction playlist, use Skip_to_next_Enhanced_Search_point () and Skip_back_to_previous_Enhanced_Search_point () effectively.In addition, if defined the information about the mutual relationship between a plurality of playlists, then user's operation can be used in a plurality of tabulations effectively.
Operate Skip_to_next_Enhanced_Search_point () according to the user, reproducer moves on to the PTS position of the metamessage that among the pts value of the metamessage of searching for greater than the quilt of the pts value of the metamessage of register-stored, has minimum pts value and begins to reproduce.Operate Skip_backto_previous_Enhanced_Search_point () according to the user, reproducer moves on to the PTS position of the metamessage that among the pts value of the metamessage of searching for less than the quilt of the pts value of the metamessage of register-stored, has maximum pts value and begins to reproduce.Now, will describe user's operation in detail with reference to Fig. 3 A and 3B.
Fig. 3 A is used for explaining the diagrammatic sketch that is included in the operation of Skip_to_next_Enhanced_Search_point () under the situation in the playlist mark at metamessage.
The example of Fig. 3 A is illustrated in and generates the situation of operating the specific incoming event that Skip_to_next_Enhanced_Search_point () distributes through the user in the reproduction process that comprises with the AV data of the metamessage of the search condition coupling of user input.
The input search condition of supposing the user is Mark_type=Scene_mark, Desc=" detal_clinic " and with the sign of user's input search condition coupling be Mark1, Mark4 and Mark5.If user's selection marker Mark1, the PTS position that then is reproduced in correlating markings begins.Next; Operate Skip_to_next_Enhanced_Search_point () if in the middle of the search sign of pts value of pts value, receive the user, then have with the sign Mark2 of the value of the unmatched Desc of search condition of input with the sign Mark3 of the unmatched type of sign of search condition of input and can be left in the basket with the register value Mark1 that is being recorded in the current reproduction mark number in the playlist mark in the current reproduction playlist greater than indication.On the other hand, in the middle of sign Mark4 and Mark5 that the search condition with input matees, the sign Mark4 with minimum pts value is selected.As a result, reproduce point and be moved to PTS:l by the playitems playitem PlayItem1 of sign Mark4 indication.
In addition; When reproducer is selected the sign of search condition coupling of next and input; If do not have greater than with the pts value of the corresponding sign of the register value of the current reproduction mark number of indication and with the sign of the search condition coupling of input, then preferably ignore user's operation.
Fig. 3 B is the diagrammatic sketch that is used for explaining the operation of Skip_to_next_Enhanced_Search_point () under the situation in the separated space that metamessage is recorded in playlist mark is separated.
In this case, suppose that user's initial conditions is " Item_type=Scene_item, Desc=" dental clinic " ", and with the project of initial conditions coupling be Item0, Item2 and Item4.If user's option Item0, the PTS position that then is reproduced in relevant item begins.Next; Similar with the situation of Fig. 3 A; Operate Skip_to_next_Enhanced_Search_point () if in the middle of the search item that has greater than the pts value of the pts value of current project of depositing, receive the user, then ignore the project Item1 that has with the value of the unmatched Desc of search condition of input.On the other hand, in the middle of project Item2 and Item4 that the search condition with input matees, the project Item2 with minimum pts value is selected.As a result, reproduce the position and be moved to PTS:k by the playitems playitem Playitem1 of project Item2 indication.
In addition; When reproducer is selected the next project with the search condition coupling of input; If do not have greater than with the pts value of the corresponding project of register value of the current reproduction item number of indication and with the project of the search condition coupling of input, then preferably ignore user's operation.
Fig. 4 A is used for explaining the diagrammatic sketch that is included in the operation of Skip_back_to_previous_Enhanced_Search_point () under the situation in the playlist mark at metamessage.
This example is illustrated in to reproduce and generates the situation of operating the specific incoming event that Skip_back_to_previous_Enhanced_Search_point () distributes through the user in the process comprise with the AV data of the metamessage of the search condition coupling of user's input.
Fig. 4 B is the diagrammatic sketch that is used for explaining the operation of Skip_back_to_previous_Enhanced_Search_point () under the situation in the separated space that metamessage is recorded in playlist mark is separated.
The user operates Skip_back_to_previous_Enhanced_Search_point () and user, and to operate Skip_to_next_Enhanced_Search_point () similar.Operate among the Skip_back_to_previous_Enhanced_Search_point () the user,, select to have the sign or the project of maximum pts value having in the middle of the sign of searching for less than the quilt of the pts value of the pts value of current sign of depositing or project or project.Reproduce the position and be moved to PTS position by selecteed sign or project indication.In addition; When reproducer select with the search condition coupling of input in preceding sign or project the time; If do not have less than indicating or the pts value of project and the sign or the project of mating, then preferably ignore user's operation with the search condition of importing with the register value of current reproduction sign of indication or item number is corresponding.
Fig. 5 is the block diagram that expression is used to reproduce the reproducer of the storage medium that records search information of the present invention on it.
This reproducer comprises reads unit 510, search unit 520, reproduction units 530 and temporal information storage unit 540.
Read unit 510 and read the metamessage on the storage medium that is recorded in like above-mentioned sign or project.The metamessage that search unit 520 search are read is with the search item of output with the search condition coupling of expectation.The corresponding AV data of selecting by the user in the search item of reproduction units 530 reproductions and output of search item.540 storages of event information storage unit are included in the demonstration temporal information in the search item of being searched for.
In response in the reproduction process of AV data, moving on to the next one or in the order of preceding search item, reproduction units 530 relatively is included in the demonstration temporal information of demonstration temporal information and storage in the metamessage of search item and jumps to the AV data with reproduction of AV data according to comparative result.Promptly; Move on to the order in the next zone of being searched in the reproduction process in response to the AV data; Reproduction units 530 changes the reproduction position of AV data and according to being stored in the demonstration temporal information reproduction of AV data in the search item, show temporal information have near but greater than the value of the value of the demonstration temporal information of storage.On the other hand; Move on to order in the reproduction process in response to the AV data at preceding search item; Reproduction units 530 changes the reproduction position of AV data and according to being stored in the demonstration temporal information reproduction of AV data in the search item, this demonstrations temporal information have near but less than the value of the value of the demonstration temporal information of storing.
Now, use description to carry out the second embodiment of the present invention of the additional function of when reproducing, reproducing relevant additional information by the motion image data in the region of search.
Fig. 6 A to Fig. 6 C is that expression is according to the search that is used to strengthen of the second embodiment of the invention diagrammatic sketch with the example of the metamessage of the function of additional information demonstration.
This metamessage comprises search information 610, additional pid information 620 or the like.
The presumptive area of the motion image data that the predetermined search condition that receives that search information 610 is used to search for and is imported by the user or outside matees.Be included in the searching key word in the search information through use, can realize the function of search that strengthens.
In addition, additional pid information 620 is the bag identifiers that are used for discerning with the relevant additional information of being reproduced together by the motion image data in the region of search.Additional pid information 620 may further include the output time information 630 of the recovery time of the relevant additional information of expression.Through using additional pid information 620, in special time, relevant additional information can be reproduced with the motion image data in the zone of searching for the quilt of search condition coupling.Promptly; When reproducing the motion image data that uses the function of search search that strengthens; Additional pid information 620 as the bag identifier of the additional information relevant with searching key word is applied to the PID filtrator, is not the additional information stream of in general motion image data reproduction process, exporting to reproduce.
As stated, metamessage 112 can be recorded in the sign of playlist of playlist or be recorded in separated space that playlist mark is separated in.On the other hand, in the separated space that metamessage 112 can be recorded in playlist separates.
With reference to Fig. 6 A, represented to be recorded in the example of the data structure of the metamessage 112 in the playlist mark of playlist.
The metamessage 112 of the function that search that is used to strengthen and additional information show is included in the playlist mark 111.Playlist mark structure PlayListMark (playlist mark) comprises search information 610, like meta_info (metamessage) field, the ref_to_PlayItem_id field of indicating the playing catalog that wherein has the particular search keyword of representing search keyword information and the mark_time_stamp field of indicating the position of the relevant searching key word in indicated playitems playitem.In addition; Playlist mark structure PlayListMark comprises the additional pid information 620 of entry_ES_PID field of bag that has wherein write down the additional information of the searching key word that is used to be correlated with like indication, with as the output time information 630 of the duration field in the time interval of expression when keeping the output of relevant additional information bag.
With reference to Fig. 6 B, represented to be recorded in the playlist but be with the playlist mark separated structures of playlist in the example of data structure of metamessage 112.
The metamessage structure MetaInformation that has wherein write down metamessage 112 comprises search information 640; As represent the meta_info field of search keyword information; Wherein there is the ref_to_PlayItem_id field of the playitems playitem of particular search keyword in indication, with the mark_time_stamp field of the position of indicating the relevant searching key word in indicated playitems playitem.In addition; Metamessage structure MetaInformation comprises the additional pid information of Additional_PID field 650 of bag that has wherein write down the additional information of the searching key word that is used to be correlated with like indication, with as the output time information 660 of the duration field in the time interval of expression when keeping the output of relevant additional information bag.
With reference to Fig. 6 C, represented to be recorded in separated space that playlist separates in the example of data structure of metamessage, particularly, with text based mark (markup) language representation's data structure.
Scene in the moving image is the unit of search or reproduction.Film is divided into a plurality of scenes.Each scene comprises: about the search information 670 of the role relevant with scene, sound and project; Wherein write down the additional pid information of PID field 680 of bag of the stream of the additional information relevant with search information like indication; With as the output time information 690 of duration field in the time interval of expression when keeping the output of relevant additional information bag.
In the example shown in Fig. 6 A to Fig. 6 C, thereby can comprise that according to metamessage of the present invention the start time of the output of the additional information stream of manufacturer through being provided for search information can indicate the information of the outgoing position of additional information stream.In addition, metamessage can comprise the concluding time field of the expression concluding time of the duration field that has substituted the time interval of expression when keeping the output of relevant additional information bag.
Because the above-mentioned metamessage that is used to realize the search that strengthens and the function of additional information demonstration is used as exemplary embodiment and describes, so its various forms can be implemented.
Fig. 7 is the diagrammatic sketch of expression according to the example of the motion image data of the storage medium of the additional pid information that is used to the additional information Presentation Function comprising of second embodiment of the invention.
Be recorded in according to the motion image data on the storage medium of the present invention (Segment A V stream) and comprise video packets 710, audio pack 720, display graphics bag 730 and interactive graphics (IG) bag 740.
In addition, interactive graphics (IG) bag 750 and 750 ' can multiplexed form be recorded on the storage medium.In addition, interactive graphics (IG) bag 750 and 750 ' can be multiplexed outside the form of (out-of-multiplexed) be recorded in the separated space that separates with motion image data (Segment A V stream).In addition, the additional information stream that has a form outside multiplexed can not be stored on the storage medium and be stored on the local memory storage.
More particularly, in order to construct a video data stream, a plurality of video packets 710 with same PID field are by with compression of MPEG2 MPTS scheme and coding and be multiplexed in the motion image data (Segment A V stream).
In order to construct a plurality of audio data streams, a plurality of audio pack 720 with same PID field are multiplexed in the motion image data (Segment A V stream) as video packets 710.
In order to construct a plurality of subtitle bitmaps (bitmap) image or other image data stream, a plurality of display image bags 730 with identical PID field are multiplexed in the motion image data (Segment A V stream).
For a plurality of pushbutton datas of being configured to user interactions etc., a plurality of interactive graphics (IG) bags 740 are multiplexed in the motion image data (Segment A V stream).
On the other hand, in order to show the additional information related, have comprising a plurality of interactive graphics (IG) bags 750 and 750 ' of display additional information that a plurality of button data with navigation command are arranged according to the present invention with the search information of metamessage.The interactive graphics (IG) bag 750 of display additional information and 750 ' can be multiplexed into motion image data (Segment A V stream) or record in the separated space that separates with motion image data (Segment A V stream) with aforesaid (out-of-multiplexed) form outside multiplexed.In the situation in front, in order to discern the bag that constitutes the stream that is multiplexed into motion image data (Segment A V stream), stream is identified through PID field separately.In the situation of back, in order to discern demonstration records the separated space of separation with the form outside the multiplexed interactive graphics (IG) bag 750 ' of additional information stream, interactive graphics (IG) bag 750 ' is identified through unique PID field separately.
Fig. 8 is the synoptic diagram that illustrates according to the reproducer of second embodiment of the invention.
Reproducer comprises demodulation ECC decoder module 810, separates packetizer (de-packetizer) 820 and 821, PID filtrator 830 and 831, demoder 840 to 870 and mixer 880 and 881.
Be similar to Fig. 7, the basic exercise view data that is used for reproducer can be recorded recording medium 800, and some data can not be stored storage medium but are stored in the separated space such as the separation of local memory storage 801.
Read moving data streaming with multiplexed form in the data of demodulation ECC decoder module 810 from be recorded in storage medium 800, and moving data streaming is carried out demodulation ECC decoding processing.Next, if the moving data streaming that reads is that then moving data streaming is sent to as main TS and separates packetizer 820 by the data stream that is included in the playitems playitem indication in the playlist.In addition, if the moving data streaming that reads is by the data stream from the playitems playitem indication, then moving data streaming is separated packetizer 821 as being sent to from TS.
On the other hand; Demodulation ECC decoder module 810 also reads with the additional information stream 802 of the stored in form outside multiplexed in local memory storage 801; Additional information stream is carried out demodulation ECC decoding processing, and decoded additional information stream is sent to each separates packetizer 820 and 821.
Each of separating in the packetizer 820 and 821 receives the coded data of compression from storage medium 800 or such as the separated space that separates of local memory storage 801; The data that receive are carried out separate multiplexed (de-multiplexed) and handle, and will be separated multiplexed data and be divided into a plurality of bags: video stream packets, audio stream bag, display graphics bag and/or interactive graphic stream with same PID field.Next, separate packetizer 820 and 821 bag is separated subpackage for basic stream and will spread basically and deliver to PID filtrator 830 and 831.
In response to from playable_PID_entries (can the play the PID clauses and subclauses) information that has about the PID field of the current use of indication of the playitems playitem of the information reproduction of current motion image data; PID filtrator 830 and 831 is from only selecting to have the basic stream by the PID field of playable_PID_entries information indication by separating a plurality of basic stream that packetizer 820 and 821 transmits, and spreading basically of will selecting delivered to each demoder 840 to 870.
Demoder comprises Video Decoder 840, display graphics demoder 850, interactive graphics (IG) demoder 860 and audio decoder 870.
The basic stream of Video Decoder 840 decode video datas.Other of display graphics demoder 850 decoding caption stream or view data flows basically.The basic stream and the additional information of the pushbutton data of button represented in 860 decodings of interactive graphics (IG) demoder.The basic stream of audio decoder 870 decoding audio datas.In addition, under the control of switch 832, audio decoder 870 can be respectively receives main TS data and from the TS data from PID filtrator 830 and 831.Mixer 880 and 881 each all the data of the decoding that transmits from demoder 840 to 870 are carried out hybrid processing so that data are shown as image at screen.
In a word; Reproducer according to the present invention reads multiplexed motion image data; Leach PID field through the playable_PID_entries that uses expression to be included in the PID field of the current use in the playitems playitem with the data stream packets of being reproduced; Only to carrying out hybrid processing, and export mixed data stream with the corresponding data stream of the PID field that is filtered.
The piece that constitutes aforementioned reproducer can comprise the display engine that is used to decode with the reproducing motion pictures data.In addition, display engine can constitute the piece of separation.In addition, some or all piece can be implemented with software mode.In addition, repertoire can be incorporated in the chip, that is, SOC(system on a chip) (system-on-chip) (SoC).
Fig. 9 is the block scheme that the reproducer of the function that shows according to the search that is used to strengthen of second embodiment of the invention and additional information is shown.
Reproducer comprises reads unit 510, search unit 520, reproduction units 530 and additional information filter element 541.Search unit 520 is through the zone of the exercise data of the search condition of use search information search matched input.Additional information filter element 541 leaches additional information stream relevant with motion image data in the zone of being searched for through using pid information.Reproduction units 530 reproduces with the additional information stream that leaches with by the motion image data in the zone of searching for together.With output time information in the corresponding time reproduction units 530 reproduce relevant supplementary information.
Figure 10 illustrates the PID filtrator and from the diagrammatic sketch of example of the moving data streaming of output wherein.
As by separating the basic stream 1000 of packetizer 820 from the main TS data decomposition of Fig. 8, audio stream AUDIO1 (PID:2), audio stream AUDIO 2 (PID:3), caption stream SUBTITLE (PID:4) and interactive graphic stream INTERACTIVE GRAPHICS (PID:5) are illustrated.
If but the current playable_PID_entries information 510 that is write down with the PID field that is used that the reproduction of PID:1 and PID:2 is expressed in the playitems playitem that is included in the required information of reproduction with current motion image data allows, then PID filtrator 520 will be sent to each demoder (840 among Fig. 8 and 870) respectively and video flowing VIDEO and audio stream AUDIO1 will be outputed on the display screen 1030 corresponding to the video flowing VIDEO of PID:1 and PID:2 and audio stream AUDIO1.
Shown in figure 10, the voice data quilt reproduces with video screen.
Figure 11 illustrates the diagrammatic sketch that comprises the example that adds information display function of the metamessage that adds pid information according to the utilization of second embodiment of the invention.
In general situation about reproducing; With reference to the description of Figure 10, only have the video flowing VIDEO that wherein reproduces the PID:1 that allowed by the playable_PID_entries information of the playitems playitem of current reproduction and PID:2 and audio stream AUDIO1 and be sent to each demoder and reproduced.
Yet; The situation of reproduction of function of search that is used for reproducing the enhancing of the motion image data that is complementary with the predetermined search keyword in utilization; At PID:1 in the basic stream of PID:5, by the PID:1 and the PID:2 of 1010 indications of the playable_PID_entries information of playitems playitem and the PID:5 of additional information stream of search information " Mt.Everest " that is used for being recorded in the additional pid information of metamessage 1011 be sent to each demoder (840 among Fig. 8,860 and 870) and be displayed on display screen 1030.
More particularly, also be sent to PID filtrator 1020 according to the present invention by the PID:5 that is included in entry_ES_PID field (620 among Fig. 6 A) or Additional_PID field in the metamessage 1011 (680 among 650 among Fig. 6 B and Fig. 6 C) expression.Therefore, PID filtrator 1020 can be sent to each demoder to be reproduced with PID:1 and PID:2 with the basic stream corresponding to PID:5.As a result, shown in figure 11, except the video and audio frequency that are used for Mt.Everest, the additional information of search information " Mt.Everest " is outputed on the display screen 1030.That is, can be shown such as the height of Mt.Everest and the additional information of position.
On the other hand; As stated, duration field (690 among 660 or Fig. 6 C among 630 among Fig. 6 A, Fig. 6 B) with when additional information be maintained at from output the start time corresponding to the time interval of the end of output time of the additional information stream that is used for search information " Mt.Everest ".If the time by the duration field is represented is over and done with, then expression is used for the PID:5 of the additional information stream of the searching key word of the pid information that is used is removed by PID filtrator 1020.There is not the general motion view data of additional information exported and reproduce thereafter.
Figure 12 is the process flow diagram that illustrates according to the reproducting method of the search that enhancing is provided of second embodiment of the invention and additional information Presentation Function.
For search and the additional information Presentation Function according to enhancing of the present invention is provided, imported and the reception from the outside (operation 1210) from the user as the predetermined search condition of the searching key word that strengthens.The position of the motion image data of the search condition of coupling input is retrieved and obtains (operation 1220) according to being stored in metamessage in the storage medium.This just is called as the function of search of enhancing.
On the other hand, through using the additional pid information of metamessage, the additional information quilt relevant with search keyword information reproduces (operation 1230) with the motion image data in the position of being searched for.When the output time of the additional information of being represented by the output time information of metamessage is over and done with (operation 1240), only there is not the motion image data of additional information to be reproduced (operation 1250).This just is known as the additional information Presentation Function.
As a result, with the zone of the motion image data that is included in the search keyword information coupling in the metamessage can by search and only the motion image data in the region of search can be reproduced.In addition, can be reproduced with motion image data with the relevant additional information of motion image data of coupling.When certain time was over and done with, only the general motion data were reproduced.For example; Under the situation of searching key word " Mt.Everest "; Video and audio frequency about Mt.Everest in motion image data are reproduced, and simultaneously, can be reproduced such as the height of search keyword information " Mt.Everest " and the additional information of position.When certain time is over and done with, only there are not the general motion data of additional information to be reproduced.
Now, with being described in the third embodiment of the present invention that the time enforcement of reproducing the motion image data in the region of search generates the additional function of foregone conclusion spare.
Also comprise except the motion image data that is used to reproduce film and the navigation information that is used to control reproduction according to the storage medium of third embodiment of the invention and to be used to carry out the search of enhancing and the metamessage of the incident of generation.Metamessage comprises that being used for searching for the time that begins and finishes with the search information in the zone of the motion image data of search condition coupling and the reproduction that is used at the motion image data that is used for the region of search generates to reproduce and begin and the event information of End Event.Therefore, the program engine or the browser engine that are used to control display engine can be carried out specific operation to dependent event.
Figure 13 is the data that are recorded in some kinds on the recording medium that illustrate according to third embodiment of the invention.
On storage medium, core data 1300, complete data (full data) 1310 and system data 1320 are by record.
The core data 1300 that is used for the reproducing motion pictures data comprises the moving-picture information 1302 and the navigation information 1301 that is used for the reproduction of controlled motion image information 1302 of compressed encoding.Moving-picture information 1302 comprises the Segment A according to codings such as the mpeg standards/V stream file and the clip information file that comprises the encoded attributes of Segment A/V stream file, entry point information etc. as record cell.In addition, moving-picture information 1302 also comprises as the IN_time (angle of incidence) of reproduction start and end time of the indication clip information file of reproduction units and the playitems playitem and the playlist that comprises a plurality of playitems playitem of OUT_time (going out the time) position.Therefore, moving-picture information 1302 can be reproduced according to the navigation information 1301 of storage medium, thereby the user can see the moving image such as the high image quality film.
On the other hand, be used to provide the complete data 1310 of additional function and reproducing motion pictures to comprise and be used to the browser data 1312 that the user provides the routine data 1311 of interactive function and/or is used to get the information relevant with mark (markup) document of storing moving image relevant information with reproduction.In the situation of not using additional function, can not comprise complete data 1310.
Simultaneously, the system data 1320 that is used to control the reproduction of core data 1300 and/or complete data 1310 comprises log-on message 1321 and/or heading message 1322.When reproducer reproduces storage medium, the first reproduction position of log-on message 1321 indicating targets.Heading message 1322 comprises the entry point information of the reproduction position of indicating target.
Simultaneously, metamessage according to the present invention comprises that the search information of the search that is respectively applied for enhancing and incident systematic function and incident generate information.
For example, metamessage according to the present invention uses role, dialogue, sound, project, position based on the content of the plot of film or as other information of searching key word.Therefore, be used for the searching key word of role, dialogue, sound, project or position, the moving-picture information of only wanting in the reproducing motion pictures information through use.
In addition, through using according to metamessage of the present invention, the position of AV data that is reproduced in the searching key word coupling of user's input begins.The position that reproduction in the zone that comprises relevant searching key word begins and finishes, beginning is reproduced in the zone and End Event can be generated.Therefore, it is capable to hold specific operation to the incident that is generated by the engine that is used for executive routine data 1311 or browser data 1312.
Simultaneously, thus metamessage can by the record be included in the moving-picture information 1302.In addition, metamessage can be opened record in 1302 minutes with moving-picture information.That is, metamessage can be included in the playlist mark in the playlist that is contained in the moving-picture information 1302.In addition, metamessage can be included in playlist in the separated space that separates of playlist mark in.In addition, metamessage can be with playlist separate scale-of-two or the form of text.
Moving-picture information 1302 and navigation information 1301, that is, one group of order that is used for reproducing motion pictures is known as core data 1300 or is used for the data of core schema.Because core schema is to be used to the required pattern of reproduction data of using DVD application program (being a kind of video application of extensive employing) to watch film, so core schema is called film mode.On the other hand, the data that are used to the programing function that user interactions and/or browser function are provided are known as complete data 1310 or are used for the data of complete pattern.The log-on message in AD HOC 1321 is not known as system data 1320 with heading message 1322.
The motion image data that is recorded on the storage medium that wherein stores above-mentioned data can be reproduced with two kinds of patterns.A kind of is to be the core schema of core data 1300 with general film mode reproducing motion pictures data through using navigation data wherein.Another kind is that the motion image data that wherein reproduced is displayed on by use and is included in the complete pattern on the defined display window of application program that program language or SGML in the complete data 1310 be performed.
When complete pattern is selected by the user or according to flow of navigation; (in the present invention by program language or SGML; The example of program language is the JAVA language; And below, application program refers to the JAVA application program) in the application program carried out, display window is produced by the function or the SGML object element of JAVA programming.Motion image data can be shown under the control of JAVA application program or ECMAScript application program.
On the other hand, the interior perhaps JAVA application of JAVA programming or several sources (for example, image, audio frequency etc.) of marking document institute reference also are shown with motion image data.
Therein motion image data under the above-mentioned complete pattern be displayed on use by JAVA and/or the display window of SGML object element definition on situation under, be necessary with motion image data synchronously with JAVA application and/or marking document.
Figure 14 is the schematic representation that illustrates according to the reproducer of third embodiment of the invention.
Reproducer comprises reads unit 1410, buffer unit 1420 to 1460, reproduction units 1421 to 1461 and user input unit 1470.
Reproducer is with three kinds of pattern work.First pattern is the core schema that is used for through using core data 1300 to reproduce such as the moving image of film.Second pattern is to be used for through using the browse mode by the browser data 1312 output token documents of SGML and correlated source structure.Three-mode is the program schema that is used for being provided by the isostructure routine data 1311 of JAVA language through use program execution enviroment.
In order to support this three kinds of patterns, reproduction units 1420 to 1460 comprises program engine 1421, browser engine 1431 and navigation engine 1441 respectively.Application manager selects one of engine to support corresponding reproduction mode through using switch.Therefore, when core mode data or when fully mode data is processed, engine 1421,1431 and one of 1441 is activated.
If reproducer is to be used to reproduce the basic reproducer such as the basic exercise image of film, then reproducer can not comprise program and browser engine 1421 and 1431 and buffer unit 1420 to 1460.
Now, with the structure of describing reproducer in detail.
Read unit 1410 and read motion image data 1302, navigation information 1301, routine data 1311, browser data 1312 and system data 1320, and store data into each buffer unit temporarily.Navigation, program and the browser data 1301,1311 and 1312 of buffering are sent to each engine.The system data 1320 that is cushioned is sent to the application manager 1461 of selecting first reproduction mode (core or complete pattern) and related data.At reproduction period, in order to be changed pattern or search title by the user, associative mode can be performed according to heading message 1322.
Figure 15 is the block scheme that illustrates according to the reproducer of third embodiment of the invention.
More particularly, the schematically illustrated zone that is used to search for the motion image data that matees with search condition of Figure 15, and, when reproducing beginning and finishing, generate the structure of the reproducer of incident for by the exercise data in the region of search.
Reproducer comprises reads unit 510, search unit 520, reproduction units 530 and incident generation unit 542.Search unit 520 generates foregone conclusion spare constantly with the motion image data of incident generation unit 542 in reproducing the region of search.
Figure 16 is the more detailed block diagram that illustrates according to the reproduction of third embodiment of the invention.
Figure 16 is the more detailed block diagram of the reproducer among Figure 14.For the ease of describing, core schema (film mode) is only described, ignore description about program and browser model.
Shown in figure 16, navigation engine 1610 has to be handled navigation data and controls display engine 1630 to reproduce the function such as the moving image of film through API.Navigation engine 1610 comprises command processor 1611.Command processor 1611 is analyzed navigation datas, that is, the movie objects (one group of navigation command) that receives from navigation data buffer 1600, and the reproducing control order that will be used for motion image data is sent to display engine 1630.
On the other hand, according to the present invention, whenever generating playback Control Engine 1631 generation incidents when wherein recording with the mark of the metamessage of predetermined search condition coupling or project.The incident that generates is sent to application manager 1640 through formation 1650.Application manager 1640 generates incident in the AD HOC engine of notifying current control display engine 1630.The AD HOC engine can comprise program engine shown in figure 14 1421 or browser engine 1431.
As stated; When the reproduction period at storage medium be used to reproduce with the user operation commands of the corresponding motion image data of particular search keyword (below; Being called the UOP order) when being imported by the user, the UOP order is sent to the control module 1641 of application manager 1640 through formation 1650.The UOP order that transmits is sent to the search engine 1632 of the enhancing of display engine 1630.Search engine 1632 search that strengthen are corresponding to the motion image data of the scene relevant with the searching key word of input.In response to Search Results, playback Control Engine 1631 begins to be reproduced in the motion image data of the position of search.
Figure 17 A is that the search that is used to strengthen of a third embodiment in accordance with the invention and the diagrammatic sketch that incident generates the example of the metamessage of handling are shown to 17C.
Figure 17 A illustrates wherein that metamessage is included in the example in the playlist mark, and promptly a group-indicate is corresponding to the mark of the ad-hoc location of the motion image data of playlist for said playlist mark, and said playlist is the unit of the reproduction of motion image data.In this example, search information 1710 comprises meta_info (metamessage) field, ref_to_PlayItem_id field and mark_time_stamp (sign timestamp) field.The mark_time_stamp field is indicated the reproduction start position in the zone of the motion image data that wherein records each searching key word.The mark_time_stamp field can be indicated when the time of incident according to the present invention when generating.The interregional separated information that 1720 expressions of duration field are relevant with searching key word from reproduction start position to the reproduction end position.When the duration finishes, can be generated according to incident of the present invention.
Figure 17 B illustrate metamessage wherein be included in metamessage structure MetaInformation (metamessage) promptly with playlist in the space that separates of playlist mark in example.In this example, search information 1730 comprises meta_info field, ref_to_PlayItem_id field and item_time_stamp (PROJECT TIME stamp) field.The item_time_stamp field is indicated the reproduction start position in the zone of the motion image data that wherein records each search information.The item_time_stamp field can be indicated when the time of incident according to the present invention when generating.The interregional separated information that 1740 expressions of duration field are relevant with searching key word from reproduction start position to the reproduction end position.When the duration finishes, can be generated according to incident of the present invention.
Have in use under the situation of the metamessage of structure shown in Figure 17 A and 17B, display engine 1630 generates reproduction beginning incident in zone through reproducing control engine 1631 in the reproduction start position of metamessage.The incident that generates is sent to application manager through formation 1650.In addition, display engine 1630 produces the zone at the reproduction end position with the corresponding motion image data of searching key word of moving image and reproduces End Event.The incident of this generation is sent to application manager through formation 1650.
On the other hand, as stated, the metamessage of when the incident of generation, being analyzed is sent to the search engine 1632 of enhancing to be used to provide according to the multiple search criterion of user's input the function of search of enhancing.
Figure 17 C illustrates metamessage and is recorded in the example in the space that separates with playlist with scale-of-two or textual form.Specifically, in this example, metamessage is labeled language and carries out with textual form.
Single film is divided into a plurality of scenes and search keyword information is recorded in each scene.For example, suppose scene Scene1 have from the outset between x11750 to time interval of concluding time y11760 and such as the search keyword information 1770 of the information of the information of performer A and sound B.In addition, suppose scene 2 have from the outset between x2 to time interval of concluding time y2 and have at least one search information that be present in the scene.
In this situation, reproduce that beginning and End Event can quilt be generated through using start_time (start time) and end_time (concluding time) attribute in the metamessage respectively.
When the function of search that strengthens is activated by user's input, search engine 1632 search that are enhanced corresponding to the position of the searching key word of input, and the motion image data of this position is by 1631 reproductions of reproducing control engine.Therefore; If the searching key word of the expectation of user's input or selection such as scene, role, project, position and sound; Then the relevant position of motion image data is searched for through using searching key word, can begin from the position that the user wants thereby reproduce.
As stated, except the function of search that strengthens, being used to generate the incident systematic function that reproduction corresponding to the particular search keyword begins incident and/or End Event can be provided through using metamessage.In the reproduction situation of complete pattern; When sign that will be relevant with special search or project were reproduced corresponding to the motion image data of particular search keyword, the incident of generation can be used to provide the additional function such as program function and browsing image data function.
Now, with the other example of describing the incident that is generated.
Figure 18 A and 18B are the diagrammatic sketch of example of search and incident systematic function that the enhancing of a third embodiment in accordance with the invention is shown.
Reproducer according to the present invention is searched for mark, time or the scene of mating with searching key word through using the search engine 1632 (seeing that Figure 17 A is to 17C) that strengthens.During one of mark, time or scene of the search of selecting to be reproduced as the user, reproducer switches to as the relevant position of reproduction start position and begins to reproduce.The search engine 1632 that strengthens will reproduce positional information accordingly with the relevant search keyword and be sent to reproducing control engine 1631.Reproducing control engine 1631 reproduces the beginning incident through using the reproduction positional information that receives and reproducing the motion image data of relevant position and generate the zone simultaneously.
When reproducing the duration carried out from the reproduction start position relevant with the searching key word of being selected by the user, reproducing control engine 1631 generates the reproduction End Event through use like the duration field of search item shown in Figure 18 A and the 18B or mark or the end_time that is stored in the situation in the external file shown in Figure 18 C at metamessage.
Through using the incident that generates, shown in Figure 18 A and 18B, only relevant with particular search keyword scene can be by successively reproducing.Figure 18 A illustrates and reproduces the example that metamessage wherein is included in the storage medium in sign or the project.Figure 18 B illustrates the example of reproducing the storage medium in the external file that metamessage wherein is stored in separation.
In addition, in other example, the part of only relevant with particular search key word information moving image can be reproduced, and when reproducing the End Event that generates, reproducer can return searching menu.Like this, different examples can be implemented through using reproduction beginning and End Event.
Figure 19 is the process flow diagram that illustrates according to the reproducting method of the search that enhancing is provided of third embodiment of the invention and incident systematic function.
When the user imports predetermined search condition or searching request (operation 1910), reproducer is according to the position (operation 1920) of the motion image data of the search condition coupling that is recorded in the metamessage search in the storage medium and imports.At this moment, this is known as the function of search of enhancing.According to the example of metamessage, at least one in mark, project or the scene of mating with search condition arranged.In addition, reproducer reproduces the motion image data of the position of being searched for, and generates zone reproduction beginning incident (operation 1930) simultaneously.When the duration that begins from reproduction start position is over and done with, maybe when arriving end_time, reproduces End Event and generated (operation 1940).When mark, project or the scene of search existed, reproduction and incident generating run 1930 and 1940 can be repeated (operation 1950).
As a result, at the reproduction period of the motion image data of match search condition, can be provided and incident can be generated according to the function of search of the enhancing of different standards.As stated, the incident of generation can be applied to the situation that wherein only relevant with particular search keyword scene exists.In addition, the incident of generation can be used to be used for the synchronizing signal of routine data or browser data.
That preferably can separate according to storage medium of the present invention and can be read CD through the optical devices that use reproducer with reproducer.For example, storage medium can comprise such as CR-ROM, DVD or the CD that will be developed.
According to the present invention, the storage medium that wherein records metamessage can provide the function of search of the enhancing that utilizes different searching key words.In addition, utilize the additional function of search information to be provided.That is, can switch to the motion image data and the reproducing motion pictures data in zone in search.In addition, can reproducing motion pictures data and relevant additional information, and the generation incident.
The present invention can also implement as computer-readable code on computer readable recording medium storing program for performing.This computer readable recording medium storing program for performing is any data storage device that can store by the data of computer system reads.The example of computer readable recording medium storing program for performing comprises ROM (read-only memory) (ROM), random access storage device (RAM), CD-ROM, tape, floppy disk, optical data storage device and carrier wave (such as the data transmission through the internet).This computer readable recording medium storing program for performing can also be distributed in the network that has connected computer system, thereby computer-readable code is stored and is performed with distributed mode.
Though represented in detail with reference to its exemplary embodiment and described the present invention; But it should be appreciated by those skilled in the art under the situation that does not break away from the spirit and scope of the present invention that are defined by the following claims, can carry out the change of various forms and details therein.
Claims (2)
1. reproducting method comprises:
According at least one scene of searching for the audio-visual data of mating from the metadata of storage medium with predetermined search condition; With
Reproduce by the audio-visual data in the search for scenes through the use metadata,
Wherein, metadata comprises the keyword that is used for scene search function, the start position information and the duration information of search item.
2. reproducting method as claimed in claim 1, said metadata comprise be used for beginning and/or end of reproduction by the incident of the view data of region of search, said method also comprises through using said metadata to generate said incident, and
Comprised through the incident of using said generation by the reproduction of the audio-video data in the search for scenes and to reproduce continuously by at least one view data in the region of search.
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020030069021A KR20050033100A (en) | 2003-10-04 | 2003-10-04 | Information storage medium storing search information, jump and reproducing method and apparatus of search item |
| KR10-2003-0069021 | 2003-10-04 | ||
| KR1020030069021 | 2003-10-04 | ||
| KR1020030078643A KR100813957B1 (en) | 2003-11-07 | 2003-11-07 | Storage medium including meta data for enhanced search and event-generation, display playback device and display playback method thereof |
| KR1020030078643 | 2003-11-07 | ||
| KR10-2003-0078643 | 2003-11-07 | ||
| KR1020030079177 | 2003-11-10 | ||
| KR10-2003-0079177 | 2003-11-10 | ||
| KR1020030079177A KR20050045205A (en) | 2003-11-10 | 2003-11-10 | Storage medium including meta data for enhanced search and additional-information display, display playback device and display playback method thereof |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2004100805863A Division CN1604634A (en) | 2003-10-04 | 2004-10-08 | Storage medium storing search information and reproducing apparatus and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101093710A CN101093710A (en) | 2007-12-26 |
| CN101093710B true CN101093710B (en) | 2012-09-26 |
Family
ID=37237371
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101090768A Active CN101093710B (en) | 2003-10-04 | 2004-10-08 | Storage medium storing search information and reproducing apparatus and method |
| CN200810179561.7A Expired - Fee Related CN101430915B (en) | 2003-10-04 | 2004-10-08 | Reproducing apparatus |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810179561.7A Expired - Fee Related CN101430915B (en) | 2003-10-04 | 2004-10-08 | Reproducing apparatus |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR20050033100A (en) |
| CN (2) | CN101093710B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104599692B (en) * | 2014-12-16 | 2017-12-15 | 上海合合信息科技发展有限公司 | The way of recording and device, recording substance searching method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1364380A (en) * | 1999-02-24 | 2002-08-14 | 索尼公司 | Screen control method |
| CN1402853A (en) * | 1999-12-02 | 2003-03-12 | 三菱电机株式会社 | Image retrieval system and image retrieval method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2000040011A1 (en) * | 1998-12-28 | 2000-07-06 | Sony Corporation | Method for editing video information and editing device |
-
2003
- 2003-10-04 KR KR1020030069021A patent/KR20050033100A/en not_active Application Discontinuation
-
2004
- 2004-10-08 CN CN2007101090768A patent/CN101093710B/en active Active
- 2004-10-08 CN CN200810179561.7A patent/CN101430915B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1364380A (en) * | 1999-02-24 | 2002-08-14 | 索尼公司 | Screen control method |
| CN1402853A (en) * | 1999-12-02 | 2003-03-12 | 三菱电机株式会社 | Image retrieval system and image retrieval method |
Non-Patent Citations (2)
| Title |
|---|
| JOSHUA S. WACHMAN* ROSALIND W. PICARD.Tools for Browsing a TV Situation Comedy Based on ContentSpecific Attributes.Multimedia Tools and Applications13.2001,13255-284. |
| JOSHUA S. WACHMAN* ROSALIND W. PICARD.Tools for Browsing a TV Situation Comedy Based on ContentSpecific Attributes.Multimedia Tools and Applications13.2001,13255-284. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101093710A (en) | 2007-12-26 |
| CN101430915A (en) | 2009-05-13 |
| KR20050033100A (en) | 2005-04-12 |
| CN101430915B (en) | 2015-07-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI478154B (en) | Reproducing method of storage medium storing search information | |
| CN101800060B (en) | Method for reproducing AV data stored in information storage medium | |
| JP5048488B2 (en) | Recording medium including metadata, reproducing apparatus and method thereof | |
| JP4694813B2 (en) | Information storage medium on which event occurrence information is recorded, reproducing apparatus and reproducing method thereof | |
| RU2315370C2 (en) | Data carrier, on which audio-visual data is recorded with event information, reproduction device and reproduction method | |
| US20090274435A1 (en) | Reproduction device, reproduction method, recording device, recording medium, program storage medium, and program | |
| CN101093710B (en) | Storage medium storing search information and reproducing apparatus and method | |
| KR100813957B1 (en) | Storage medium including meta data for enhanced search and event-generation, display playback device and display playback method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20071226 Assignee: Shenzhen Maxmade Technology Co.,Ltd. Assignor: Blue light United Co., Ltd. Contract record no.: X2019990000006 Denomination of invention: Method for recording and reproducing compacted voice file by using decryption key Granted publication date: 20120926 License type: Common License Record date: 20190923 |
|
| EE01 | Entry into force of recordation of patent licensing contract |