CN100521761C - Method and system for generating and using extended time code - Google Patents

Method and system for generating and using extended time code Download PDF

Info

Publication number
CN100521761C
CN100521761C CNB2003101015612A CN200310101561A CN100521761C CN 100521761 C CN100521761 C CN 100521761C CN B2003101015612 A CNB2003101015612 A CN B2003101015612A CN 200310101561 A CN200310101561 A CN 200310101561A CN 100521761 C CN100521761 C CN 100521761C
Authority
CN
China
Prior art keywords
time
multimedia
expansion
value
sign indicating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2003101015612A
Other languages
Chinese (zh)
Other versions
CN1497971A (en
Inventor
R·K·小休斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Corp
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of CN1497971A publication Critical patent/CN1497971A/en
Application granted granted Critical
Publication of CN100521761C publication Critical patent/CN100521761C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Abstract

The present disclosure relates to providing extended time-code numbers to multimedia elements that make up multimedia presentation content. A linear time-code is used to properly sequence the multimedia elements for proper presentation. Prefix and suffixes are attached to the linear time-code to different between multimedia elements having the same linear time-code. Multimedia elements having the same linear time-code are used for different presentation variations, such as scene variations for a movie. The unique extended time-code may be provided in a time map table such as used in a medium such as DVD, and may be provided separate from the multimedia elements. Such a time map is appended to a pre-existing information file or provided as a replacement information extension file that includes a legacy IFO file.

Description

Be used to produce and use the method and system of expansion time sign indicating number
Priority to provisional application
This application has priority to the provisional application sequence number of submitting on October 7th, 2,002 60416976.
(1) technical field
System and method described here relates to represents relevant and special and the system and method for will unique time code value being correlated with the distribution element with the audio frequency and video element with time reference and multimedia.
(2) background technology
Audio frequency and video (A/V) expression is to be made of the discrete element that comprises frame of video, picture, video segment and audio fragment (A/V element).One group or a series of A/V element (being Voice ﹠ Video) are provided at special scenes or the chapters and sections of A/V in representing.The example that A/V represents comprises the multiple title in video tape film, television broadcasting and the Digital video disc (DVD).The DVD optical disc title may comprise the towing title, give title and movie title.In some DVD CDs, have a plurality of movie titles.
For the suitable experience of viewing and admiring is provided, specific Voice ﹠ Video element is sorted to play at special time.For realizing this point, different elements is relevant with time value, and then compares to determine when start element with time reference or other linear clock value that increases.For example, the Voice ﹠ Video element of the first act of film can begin at times 141 place to play, and the Voice ﹠ Video element of the act 2 of film can begin at times 160 place in succession to play, wherein two time be relative common time with reference to and designated.
Provided the method for the time value of audio frequency and video element to comprise the scheme that is called " control is followed the tracks of " in the past.The video record band reproduces special this control tracking scheme that uses.The control tracking scheme adds no characteristic pulse in every frame of video record band.When the video record band is played, pulse-triggered counter, it then triggers the time value that the dullness corresponding to the current broadcast point in reproducing increases.This time value compares with time reference and controls playing speed, position and synchronism.The shortcoming of control tracking scheme is that the different time value is to generate according to the point that reproduction inside counting device is initialised.This may be problematic when searching for and accurately identifying particular frame, and this is because can not guarantee that unique value is relevant with any particular frame all the time.
" timing code " scheme is the replacement of control tracking scheme.The timing code scheme is relevant with each A/V element or scene with many bits time-code numbers.The structure of timing code can be " HH:MM:SS:FF ", wherein, " HH " representative hour, " MM " representative minute, " SS " represent second, and " FF " represents the interior frame of per second.Corresponding video has identical time-code numbers with audio element, makes specific video and corresponding audio begin simultaneously.Equally, the time code value is compared to determine when start element with time reference.
Be responsible for the professional association of the standard of development film and audio frequency, moving image and Television Engineer association (SMPTE) standardization the use of timing code.Developing SMTPE timing code standard comprises SMTPE 12M and SMTPE 328M.Because SMTPE timing code standard extensively is implemented in industrial quarters, preferably A/V reproduces support or backwards-compatible with smpte time code.
In many cases, the A/V element is made of computer or MRDF.In this case, time encoding may be positioned at the head of each A/V element or file.Special scenes in the corresponding film of each element possibility, and film may comprise a plurality of scenes or element.
Go up storage and distribute film and its corresponding A/V element through the DVD that is everlasting.DVD comprises the audio-visual data that is organized into video object unit (VOBU).VOBU is the physical location of DVD storage, and is the minimum access unit of DVD CD.The VOBU of (physics is continuous) group may be formed the unit that is called " sub-district " continuously.The sub-district is the video unit of the index minimum that can find.The part of each sub-district corresponding A/V content, for example a scene.The time span of sub-district may have nothing in common with each other, from several seconds zero point to several hrs.
One group of sub-district may be formed an object video (VOB) in logic.VOB is a single file that possible comprise a plurality of through multiplexed audio and video stream.The set of VOBs may be formed object video group (VOBS).
DVD has a plurality of " titles ".Each title is the potential different arrangement or the ordering of sub-district (and VOBU).In many cases, the different editions of the corresponding film of these titles possibilities.For example, film has the version of different brackets, different language etc.When seeing DVD, the version that the general selection of user will be put.In many cases, different titles can share or use many same sub-districts or VOBU (to come from same VOBS object video group; May be from the same vob file in organizing).
Data on the DVD are turned to the sequence of the logical partition that is identified by logical partition number (LSN) by physical format.Each subregion comprises 2048 data sequence.Generally being sub-district on the DVD and VOBS is assigned in file or the subregion according to the LSN and the byte offset of its subregion.
Each audio title on the DVD has user's control " title " option information or the IFO file of describing on broadcast behavior and the DVD.Particularly the IFO file provides and points to the pointer (being LSN) that DVD goes up the sub-district.The IFO file is used in particular on DVD play title navigation and information reproduction is provided.
, the cause of DVD tissue, its content produce different DVD titles because may playing in a different manner.Title in the dvd video disc may be formed by reaching 999 program chains (PGC).A program chain comprises nearly 99 programs (PG).PGC is a cell list.Each PGC has the sensing that comprises ordering to indicate the program control module (PCB) of one group of pointer of sub-district of the playing sequence of program and sub-district.Different PGC allows the difference ordering of sub-district.The IFO file provides index, and the sub-district that will list in PGC is decomposed into the VOBU and the LSN that can play the different titles with different video sequence.
Fig. 1 illustrates two types DVD title, and how they may be played.DVD start of header,, wherein timeline 102 was represented the linear session reference in " the Relative Zero time " of timeline 102.The DVD title of play-overing is known as " one_sequential_PGC title ".Its ordering may be called as " multi_PGC title ", " multi_angle title " or " parental_blocktitle " by vicissitudinous DVD title.A PGC 1 105 is shown, the title that be play-overed or the linear title of playing promptly are provided.When having " multi_PGC title ", " multi_angle title " or " parental_blocktitle ", there is non-linear playback.Specific title may start from PGC 2 110, transfers to then or PGC 3 115 or PCG 4 120.PGC 3 115 transfers to PGC 5 125.PGC 4 120 transfers to PGC 6 130.PGC 5 125 transfers to PGC 7 135.PGC 6 130 may transfer to or PGC 8140 or PGC 9 145.All titles in this example finish to play PGC 10146 in position 150,152 or 154.
The version of transferring to the title of PGC 7 135 may be that grade is the film of NC-17.The version of transferring to the title of PGC 8140 may be that the film grade is the version of R.The version of transferring to the title of PGC 9 145 may be the version of the G grade of film.
Different conversion (title that " multi_PGC title " or " parental_block title " promptly arranged) has the scene that starts from different time.In other words, different conversion meetings might start from the corresponding scene of the different time on timeline 102, and timeline 102 is the duration from PGC 2 110 beginnings.This is because may be by the different video to Same Scene by the title of " multi_PGC title " definition, and/or the different language of same video.Only, have no idea to distinguish which video and/or audio that to play different conversion to specific scene according to time-code numbers.In this example, PGC 10 146 may be on timeline 102 three different times begin to play, this depends on the title of broadcast and the path that arrives this place.
The broadcasting or the stream that may also reproduce A/V are used time-code numbers.Fig. 2 has illustrated the previous method that is scattered with such as the stream of the scene of the HTML(Hypertext Markup Language) document elements of representing commercial film.An element is different from the scene of being made up of the Voice ﹠ Video component.Scene may be from different sources or broadcast point with element.The user receives the broadcasting 200 of the stream that comprises scene and element.Scene may be made of many discrete A/V components of Voice ﹠ Video fragment that comprise.In this example, broadcasting 200 broadcasting in the following order: scene 205, element 210, scene 215, scene 220, element 225 and scene 230.Each A/V component (fragment) of each scene is identified by specific linear session sign indicating number (LTC) numbering.Specific LTC numbering is positioned at any top of file that has identified each scene.The example explanation that illustrates and the audio fragment 205-B and the relevant LTC head 205-A of video segment 205-C of scene 205.LTC head 215-A is relevant with the audio fragment 215-B and the video segment 215-C of scene 215, and LTC head 220-A is relevant with the audio fragment 220-B and the video segment 220-C of scene 220.LTC head 230-A is relevant with the audio fragment 230-B and the video segment 230-C of scene 21530.
Element 210 and 225 may be the readable file of computer (machine), such as the file of writing with HTML or similar language.In this example, element 210 and 225 not relevant specific LTC numberings with them.The broadcasting of scene and the stream that receives have describes the numbering when scene is played; Yet, do not have the element of LTC numbering not indicate the information when they are played.This when scene and scatter element never homology be received and be a problem especially when having no idea to determine its playing sequence.
The field of development is based on the multimedia of web, and it comprises that the element that comes from the remote web website scatters therebetween from the next DVD video of local player.This element may comprise the covering (for example letter) and/or the promotional content of scene update, scene change (for example, the new plot in the film), different language (audio frequency) sound channel, literal and figure.Because DVD relies on the IF0 file, may not the sorting or accessed at random with existing A/V element of distribution new or not free sign indicating number according to existing IFO file based on the element of web.
(3) summary of the invention
System and method described here comprises that identification has the multimedia element of the linear session sign indicating number relevant with them numbering and prefix and suffix value are joined in the linear session sign indicating number numbering to set up unique time-code numbers through expanding to distinguish specific multimedia element.
In certain embodiments, the linear session sign indicating number numbering that has prefix and a suffix value is added in the multimedia element that does not have the linear session sign indicating number.
In a particular embodiment, possible service time, mapping table was so that relevant with specific multimedia element through the time-code numbers of expansion.
(4) description of drawings
Fig. 1 is the title of " one_sequential_PGC title " and non-linear playback " multi_PGC title " definition is play in explanation by linearity a block diagram;
The block diagram of the previous method that flows of the element of Fig. 2 scene that to be explanation come from one or more broadcast point and distribution;
Fig. 3 A be explanation receive from source the stream that scatters element and player from another source receive the stream of basic element;
Fig. 3 B is that explanation is the block diagram through expansion time harbour portion that scatter and part basic element;
Fig. 4 be explanation comprise IFO file and additional time map table the IFX file and and DVD between the block diagram that concerns.
Fig. 5 is the block diagram that explanation provides the system of the multimedia equipment of multimedia reproduction and broadcaster.
Fig. 6 is the block diagram of explanation multimedia equipment structure.
Fig. 7 is the block diagram of explanation multi-media player structure.
Fig. 8 is the process of the time code value through expanding was set up or added in explanation in A/V element and/or element a flow chart.
Fig. 9 is explanation according to through the time-code numbers of expansion and the flow chart of the process of searching element.
(5) embodiment
Unique timing code identifier numbering
The technology of describing utilize prefix and suffix in conjunction with linear time-code numbers so that the unique identification of any specific multimedia element to be provided.In certain embodiments, prefix and suffix are added in the smpte time code structure " HH.MM.SS.FF " to keep and the back compatible of standard in the past, such as SMPTE 12M and 328M.Smpte time code structure HH:MM:SS:FF is defined as follows: " HH " representative hour, and " MM " representative minute, " SS " represent second, and " FF " represents the interior frame of per second.
Fig. 3 A illustrates to receive and scatters element and basic element.Scatter element 300 (1), 300 (2) ... 300 (N) comprise each specific distribution element 300 head 305 (1), 305 (2) ... 305 (N), and actual content 310 (1), 310 (2) ... 310 (N).Scattering element 300 is received at the player place.Scattering element 300 may be received from the source such as internet (for example website).
Player 315 also receive basic element 320 (1), 320 (2) ... 320 (N), it comprise head 325 (1), 325 (2) to each specific basic element 320 ... 325 (N) and actual content 330 (1), 330 (2) ... 330 (N).Basic element 320 never homology is received, such as internet source (for example the 2nd web website).When actual content 310 and 330 is authorized to, may not know actual content 310 and 320 relative timings with respect to another.By with timing code or time-stamp addition on head 305 and 325, each that scatter element 300 may be sorted in each of basic element 320 suitably.
For example, player 315 may be from DVD dvd playback basic element 320, and (promptly with streamed) is received from the web website and scatter element 300, and wherein, distribution element 300 may be that the director of relevant certain specific basic element 320 appraises through discussion.When scattering at each in element 320 behind the joining day sign indicating number, basic element 320 is by with suitable rank order.In other words, the director's of distribution element 300 the specific basic element 320 of appraising coupling through discussion may be a film scene.Other example comprises suitably promotional elements 320 orderings, and this promotional elements is such as may being that the basic element 320 of film is as the commercial advertisement of scattering elements 300.This makes commercial advertisement to be positioned at suitably between the scene of film.The reproduction of " distribution element " may change with the elementary audio video elementary, or synchronous (for example foreign language dialogue and performer's is lip-sync, is superimposed upon figure above the video image or below or text subtitle).
The relevant details of the head 335 that Fig. 3 B explanation is relevant with the particular segment of content 300 and 320.Head 335 comprises LTC numbering 340, prefix 345 and suffix 350,355 and 360.LTC number field 340 is specified the time representation of " HH.MM.SS.FF " form, when begins content 300 and 320 to indicate.LTC number field 340 may be the previous SMPTE relevant with the specific A/V element numbering that is pre-stored in, and maybe may be the derivation value that appends to the multimedia element that does not before have the SMPTE numbering.The ordering of distribution element and corresponding audio/video (A/V) element may be embodied as the production process when the Voice ﹠ Video element is set up or edited for certain specific A/V reproduces.Perhaps, time corresponding sign indicating number numbering may be added into (being about to web webpage content that sends and the audiovisual content that local dvd video disc comes combines) in the distribution element that separately sends, and separately the element of transmission is linked with the A/V element of time-code numbers consistent with each other and existence.This process is called as " last combination " or " binding at last " synchronously.Timing code itself may be timing code index (for example making the synchronous time map table of timing code and audiovisual content with the LSN index) that the audiovisual content of previous not free sign indicating number is quoted is provided and " combines at last " with the audiovisual content of existence by download.
Prefix 345 and comprised period or header field before LTC number field 340.The specific title in the DVD CD may be described and distinguish to header field 345, maybe may describe or distinguish broadcast program or streaming film and such as the distribution element of commercial advertisement.For example, on specific DVD CD, have and comprise about particular video frequency art film how to take this film and the title that comprises film.May expect will be from specific art film specific multimedia element that comes and the scene ordering that comes from movie title.According to scheme described here, specific special literary film video segment can sort with the certain movie scene, and may in its corresponding LTC number field 340 same time code value be arranged.Prefix header field 345 is used for difference and appraises through discussion and film scene.For example, corresponding header may comprise " making the movie.00:55:33:13 " and " movie.00:55:33:13 ", wherein the LTC value of " 00:55:33:13 " be used to make specific appraise through discussion with the certain movie scene synchronous.
Prefix header field 345 itself may be formatted according to comprising the international standard audio frequency and video to number one of several standards of (ISAN).ISAN is to provide unique identification each global data base such as the video work of movie or television program.The ISAN numbering convention is the identifier that definition is divided into 16 hexadecimal digits of two sections: the root segmentation of 12 bit digital then is 4 bit digital segmentations, is used to identify the segmentation of plot or part when using.
Has the different variation of the various combination that comprises the video of describing special scenes and audio frequency as mentioned above.This variation includes but not limited to, language, camera angle and grade (being father's module).Head 335 comprises three suffix value fields: language field 350, angle field 355 and father's module (grade) field 360.Language field 350 is the difference specific title by the language (for example, Spanish, English and French) that uses in audio frequency, video and the subimage.Angle field 355 is further distinguished title by video camera perspective view (for example front, back, first visual angle).Father's module field 360 is by grade (for example " G ", " R ", " PG ") difference specific title.
Different A/V element (the promptly different different scenes of playing that change) may use LTC to number 340 same values (be different scene in identical time or played in order); Yet they are by the particular value difference of language field 350, angle field 355 and father's module field 360.For example, if the particular combinations of prefix and suffix allows, may have the scene of describing by " movie.1:23:02.15.span.front.NC-17 ", the expression film scene begins the relative time place at 1 hour, 23 minutes, 2 seconds and 15 frames, and content is that Spanish, preceding visual angle and grade are NC-17.Other element may be by the time value of identical 1 hour, 23 minutes, 2 seconds and 15 frames; Yet this element may be and the interview of directing.Specific element may be identified as " interview.1:23:02.15.english.null.null ".
The Demonstration Application of the timing code UNC of use through expanding comprises according to the selection of specific suffix value plays certain movie; Skip by prefix header field 345 and be " commercial " defined element-specific; And according to searching for special scenes in the specific suffix of specific LTC numbering place broadcast.
May be described to " TT.HH.MM.SS:FF.LL.AA.PB " such as being included in numbering through the expansion time sign indicating number in the head 335, wherein " T " is title, and " LL " is language, and " AA " is angle, and " PP " is father's module.
Multimedia element is described by particular file format.For example, audio file may be described by " wave " audio file formats of MicrosoftCorporation definition.The Wave audio file is by the file extension definition of .wav.The example of particular video file form is interweave form or AVI of audio/video.Avi file defines with " .avi " suffix.Can think that no matter what the form of file is each specific A/V element may comprise describes specific head through expansion time sign indicating number numbering.
In some cases, may be without some specific field.In other words, may have only the variation of or limited quantity, other scene is had more changeableization number special scenes." NULL " value can be used to set no field.Can omit separator with different separator (for example, fullstop, comma, colon, branch, oblique line etc.) and when zero of beginning or ending place is not expressed with can having ambiguity.
Information expansion (IFX) file
The DVD CD can be described as the data structure sequence quoted by logical sector number (LSN) byte offset, and they identify with index data structure.Index data structure has occupied the predefined procedure of sequence and continuous LSN.Object video (VOB) is by order and continuous the arrangement to offer known position and other the video index data structure of program chain (PGC) with the LSN visit.Information on the DVD (IFO) file comprises index data structure and the pointer that points to the physical disc position (being LSN) that comprises the video of being quoted by specific PGC is provided.So to the title of multi_PGC_title, a plurality of PGCs in the IFO file are the heading message link, select or select by user action by program instructions, and the broadcast that produces selecteed different titles.
Data structure in the IFO file comprises audio frequency controller information (VMGI), and it provides the information of arranging about CD; Video title set information (VTSI) provides about the navigation of certain specific title group on the CD and the information of reproduction; And object video group (VOBS) comprises the video cell group in the VOB.One of function of IFO file is that the position of VOBU, sub-district and the VOB of specific title is provided by the pointer that provides suitable sensing to comprise the specific LSN of data.
Fig. 4 illustrates the IFX file 400 that comprises IFO file 405, time map (TMAP) data structure or TMAP 410, and TMAP data structure through expanding or the TMAP 415 through expanding.
TMAP 410 is relevant with VOBU in its video title set with the LTC value.In this example, TMAP 410 is made up of list item 1 415 (1), list item 2 415 (2) to list item N 415 (N).Each list item of list item 415 has linear session code value 420 and pointer 425.The pointer 425 of list item 415 points to VOBU table 430, and especially points to list item 435 (1) to 435 (N), and they provide video content and are defined by VOBU 440 and LSN 442.TMAP 410 definition one_sequential_PGC_titles.VOBU table 430 may be included in the IFO file 405 and the LSN 442 by each VOBU 440 that each VOBU is linked on the CD shows out the also memory location of index.
General IFO file 405 includes only TMAP 410.Append to TMAP 410 and IFO file 405 to set up IFX file 400 through the TMAP 415 of expansion.Provide the realization of timing code form through the TMAP415 of expansion through expansion, it on only reading traditional playback equipment of IFO file 405, keeps adding multi_PGC title in the normal DVD video IFO file function through the expansion time sign indicating number.In this example, through the TMAP415 of expansion the pointer 445 that some entries 435 in the sensing VOBU table 430 are provided is shown.In some cases, the same list item of the list item of being quoted by TMAP 410 435 is directed; Yet, not necessarily quote (sensings) by all of TMAP 410 indications or same list item 435 through expansion TMAP 415.
Use for being used to be equipped with the player of reading through expansion time sign indicating number numbering through expansion TMAP 415.Particularly, through the TMAP 415 of expansion with VOBU with number through the expansion time sign indicating number relevant.Be equipped with and be used to read use IFO file 425 (TMAP 410) and ignore TMAP415 through expansion through the conventional players of expansion time sign indicating number numbering.
TMAP 415 through expansion comprises list item 1 450 (1), list item 2 450 (2) ..., list item N 450 (N).List item 450 is relevant with the specific linear time-code numbers that is provided by alignment timing code 455 with element-specific.Each of list item 450 is further by element column 460 signs.The prefix or the title value that may provide according to the title (prefix) 465 by the available DVD title of describing the particular entry support are distinguished list item 450.Further suffix 470 is according to distinguishing list item such as " language, camera angle and father's module " suffix value.Title (prefix) 465, linear session sign indicating number 455 and suffix 470 are formed through the expansion time code structure.To each list item 450, provide a pointer by pointer 455.Specific VOBU in the pointed table 430 of list item 450.To realizing of correspondence being linked in the physical access of the video data of expansion time sign indicating number is LSN 442 relevant by the VOBU in visit and the table 430 440 and table 415 through the expansion time sign indicating number.
IFX file 405 constitutes makes IFO 405 (TMAP 410) can use through the conventional players of expansion time sign indicating number numbering not reading.Be added in the IFO file 405 so that the time-code numbers through expansion of additional function to be provided through expansion TMAP 415.Provide according to function through expansion time sign indicating number numbering through expansion time representation and search (i.e. navigation) dvd content.Make the DVD title specifically to be identified through the expansion time numbering by subject prefix through expansion time sign indicating number numbering structure, and by being the element that points to specific title through the linear session sign indicating number of the time of an expansion numbering part.And, may comprise that (promptly scattering) has the additional element by the dvd content of the specific title of describing through the expansion time sign indicating number, wherein additional elements comprise sign about the element of specific title relevant where to be played number through the expansion time sign indicating number.
Demonstration system
Fig. 5 illustrates multimedia equipment and the system 500 of broadcasting equipment so that multimedia reproduction to be provided.Network 505 comprises local area network, wide area network, private network and public/private network, comprises the internet.Hardwired (for example cable) and/or wireless network may constitute network 505.Network 505 is used to provide from the multimedia communication that come or that offer different entities of different entities.
Television broadcasting point 510 provides " multimedia reproduction content " in system 500.The multimedia element that television broadcasting point 510 is play from A/V source 515.Many multimedia elements such as the A/V element are formed whole A/V from A/V source 315 and are reproduced.The A/V element may be relevant with specific timing code.Television broadcasting point 510 may scatter in the A/V element in A/V source 515 from increasing the element such as commercial advertisement or sales promotion (promptly scattering element) of content source 520.Scatter the not time-code numbers relevant of element with them.A/V element and the element that is added into be called as together multimedia represent in MPC perhaps.A/V source 515 and the content source 520 that is added into may flow out in the different time, therefore may be in the different time place at different multimedia equipment and be received.When they when television broadcasting point 510 flows out, may be affixed to each A/V element and scattered in the element by the time-code numbers through expansion of Fig. 3 B definition.
Television broadcasting point 510 is linked the satellite dish antenna 525 that is linked to satellite 530.Satellite antenna 525 emissions have the signal of MPC to satellite 530.Satellite antenna 535 second lines of a couplet are from the signal that is loaded with MPC of satellite 530.Network 505 is directly linked satellite antenna reflector 535 to receive MPC.Perhaps network 505 may directly be linked television broadcasting point 510.Television broadcasting point 510 also may have radio frequency (RF) signal of MPC by antenna 540 emissions.This kind RF signal may be received by the different multimedia equipment that comprises television set.
Multimedia equipment 545 is the separate units that are not coupled to network 505, but can receive from the MPC of television broadcasting point 510.Multimedia equipment 545 comprises A/V broadcast unit 545-A, and this may be television set or tuner be arranged and the monitor of A/V input and output.Multimedia equipment 545 may also comprise the multi-media player 545-B such as DVD player, and multi-media recording device 545-C.Multimedia equipment 545 is linked end from the reception antenna 550 such as the next RF signal in the source of antenna 540, and wherein the RF signal carries MPC.MPC may be also by multimedia equipment 545 antenna 555 and being received via satellite, the signal that receives from satellite 530 of satellite antenna 555 wherein.
In some cases, multimedia equipment 545 receives the A/V elements and without any the distribution element of relevant time-code numbers.Can when receiving, will join in each A/V element and the distribution element through expansion time sign indicating number numbering by multimedia equipment 545.A/V element and scatter element and may record by multi-media recording device 545-C, and unique by reference through expansion time sign indicating number numbering and accessed.
The broadcasting of MPC may also realize by the internet.Generally, this Digital Transmission that is called " web broadcasting " and MPC is provided.Web broadcast point 560 may comprise can be by the interactive addressable web website of network 505 visits.Web broadcasting 560 received from comprising from the A/V of the distribution element of the literal, figure, audio/video fragment and/or the HTML that increase content source 570 or SMIL file of A/V source 565 reproduces.Perhaps this element can come from other source.
Web broadcast point 560 sends to network 505 can be linked the different multimedia device access of network 505 with MPC (element of routine A/V element and distribution).Perhaps, web broadcast point 560 may send MPC as mentioned above via satellite.
Multimedia equipment 575 is coupled to network 505 and receives from the next MPC of not homology that comprises television broadcasting point 510 and web broadcast point 560.Multimedia equipment 575 comprises A/V display unit 575-A, and this may be television set or have tuner and the monitor of A/V input and output.Multimedia equipment 575 may also comprise such as the multi-media player 575-B of DVD player and multi-media recording device 575-C.
In many cases, multimedia equipment 575 is similar to multimedia equipment 545, may receive the A/V element of not being with relevant time-code numbers and scatter element.Expansion time sign indicating number numbering joins each A/V element and scatters in the element when receiving in multimedia equipment 575.A/V element and distribution element may be recorded for multi-media recording machine 575-C, and visit through expansion time sign indicating number numbering by unique.In other cases, the A/V element of the free sign indicating number numbering of multimedia equipment 545 and 575 receiving belts and/or distribution element.In the ordering of the reproduction at multimedia equipment 545 and 575 places and when playing according to time-code numbers through expansion.
Multimedia equipment and separate unit comprise WebTV unit and personal video recording machine (PVR) unit.PC 580 is coupled to network 505 and receives MPC in this example.As multimedia equipment 545 and 575, PC580 may join the time-code numbers through expansion the A/V element that does not have the time-code numbers through expanding of reception and scatter in the element.
Different sources may provide other content, comprises the file of multimedia equipment use and the renewal of program.Content is multimedia element or A/V element not necessarily, and may comprise the IFX file of describing as Fig. 4.In this example, the visit of web website 585 explanation multimedia equipments such as through the additional content of transaction file from the source.And, may transmit new A/V element flow such as the broadcast point of television broadcasting point 510 and web broadcast point 560 and to make itself and the content ordering that is pre-stored at different multimedia equipment place.
The demonstration multimedia equipment
Fig. 6 illustrates the structure of demonstration multimedia file 600.The multimedia equipment 545,575 and 580 of Fig. 5 is structures of representing multimedia equipment 600.Multimedia equipment 600 may be that the oneself who is different from such as PC 580 comprises the unit., maybe may comprise different units such as multimedia equipment 545 and 575.With described, multimedia 600 provides and receives MPC, handles the function of MPC and demonstration MPC as below.In some instances, multimedia equipment 600 is also recorded MPC.
Multimedia equipment 600 may comprise receiver module 605, is used to receive the RF signal that comes from television source.Other signal and data also may by audio frequency and video input module 610 never homology be received, comprise equipment and network.
Multimedia equipment 600 comprises one or more processors 615 (for example microprocessor), its handle different control multimedia equipments 600 operation and with the instruction of other electronics and computing device communication.
When the A/V element with scatter element and be received under the situation of not free sign indicating number numbering, this kind numbering may be by being affixed in each element through expansion time sign indicating number module 620.When expansion time sign indicating number module 620 is used for receiving at multimedia equipment 600 places, generates and will append to each A/V element and each and scatter in the element and go through the time-code numbers of expansion.
Multimedia equipment 600 can be realized with one or more memory elements, comprise nonvolatile storage 630 (for example ROM, Flash, EPROM, EEPROM etc.) for example.Memory 630 is used to store the operating system module 635 that is included in the operating system of using on the multimedia equipment 600.Application program may be stored in the application program module 640 of memory 630.Random access storage device (RAM) also may realize being used to store interim file and the program that multimedia equipment 600 uses in multimedia equipment 600.
MPC may be stored in the multimedia memory module 650.Multimedia memory module 650 may be used different mediums, such as CD, tape and disk.Multimedia memory module 650 may be by other module and equipment and multimedia equipment 600 device access in addition that are the part of multimedia equipment 600.Multi-media recording machine module 655 offers the ability that multimedia memory 650 is recorded.Multi-media player module 660 may or directly directly receive MPC or visit MPC from the multimedia memory 650 of MPC from processor 615.Processor 615 may be visited element in A/V element and the multimedia memory module 650 by identifying specific time-code numbers through expansion.
Audio/video output module 665 is provided to the direct output of demonstration or intermediate equipment.Output module 665 may and make it flow into individual channel with the audio ﹠ video unpack.Processor 515 control output modules 665 and from the A/V stream of output module 665.
The demonstration multi-media player
Fig. 7 illustrates the structure of demonstration multi-media player 700.Multi-media player 700 comprises distinct device, but particularly including the DVD player of using industrial standard, particularly the standard of being set by national television system committee (NTSC).The structure of multi-media player 700 may be used for the multi-media player 660 of Fig. 6.Multi-media player 700 may read from the multimedia such as the prerecording of the DVD of commodity production, or reads from the writeable medium of the DVDs that can record, or receives the A/V element and scatter element flow.
One or more processors 705 may be used for handling from the next signal of medium (for example DVD), and communicate by letter with the disparate modules of multi-media player 700.Be that processor illustrated in fig. 6 may be that processor 705 uses under the situation of a part of multimedia equipment 700 at multi-media player 700.The A/V element ordering through the time-code numbers of expansion is handled and will have been added to processor 705.Under the DVD situation, the IFX file is used so that the A/V element is sorted by processor 705.
Multi-media player 700 may comprise memory module 710, and its storage is included in the operating system module 715 of the operating system of using on the multimedia 700.Memory module 710 also may comprise the file available that comprises multi-media player 700 and/or the file/program module 720 of program.
A/V element or element synchronizer module 725 are used for according to time-code numbers audio frequency, video and/or other data flow of separating synchronously through expansion.Synchronizer module 725 is used in particular for realizing to previous not by the last binding of the stream of synchronous A/V element and/or element.For example, multi-media player may receive the stream that comprises the newspeak sound channel, with reside in audio video synchronization in the multi-media player 700 or that receive from other source.Synchronizer module 725 is according to synchronous with Voice ﹠ Video through the time-code numbers of expansion.Particularly, the linear session sign indicating number of the time-code numbers through expanding numbering is used to make Voice ﹠ Video synchronous.
Multi-media player 700 also may comprise and reproduce engine modules 730, and its uses the demonstration of the information that the reproduction data of coming from medium derive from multi-media player 300 with control in IFO or IFX file.Navigation administration module 735 uses navigation data interface to be provided, to set up menu, also to control also from IFO or the A/V element of IFX file derivation or any branch of scene.In addition, the audio/video output module 740 that provides in multi-media player 700 is used for signal is outputed to display device, or the intermediate equipment before display device.
Adding is through the timing code of expansion
Fig. 8 illustrates process 800, and it is set up or adds through the expansion time code value.Process 800 may realize in television broadcasting point 510 or the broadcast point the web broadcast point 560 such as Fig. 5.In some implementations, process 800 makes at the multimedia equipment place at all multimedia equipments 545,575 as shown in Figure 5 and 580 places and realizes, and by the structrual description of the multimedia equipment shown in Fig. 6 600.In other cases, process 800 is realizing when setting up a DVD or other medium.
At module 805 places, determine whether the A/V element or scatter unit to have additional linear session sign indicating number numbering.Linear session sign indicating number numbering may be by the SMPTE standard definition.If A/V element or distribution element have linear time-code numbers (the then YES branch of module 805), keep linear time-code numbers.If A/V element or distribution element do not have linear session sign indicating number numbering (the then NO branch of module 805), add the linear session sign indicating numbers in module 810.At square frame 810 places, the linear session sign indicating number of affix is described and when is play specific A/V element or scatter element.
At module 815 places, in the linear session sign indicating number of specific A/V element or distribution element, add title value.Foundation is through the time-code numbers of expansion.The title value difference that different MPC reproduce.
In module 820, determine whether that the suffix used (being the suffix field) that further defines the A/V element or scatter element exists.This kind suffix comprises angle, language and father's module (being grade).If use suffix (the YES branch of module 820), realize module 825, and in the time-code numbers of expansion, adding the suffix value.Be determined the back up to all suffix used and realize module 820.All can use suffix all be concatenated into through the expansion time-code numbers, up to having determined all suffix values (the NO branch of module 820).In some cases, some A/V elements or distribution element are not used specific suffix field.
According to through the expansion time code searching
Fig. 9 shows process 900, and it is according to the time-code numbers searching element through expansion.Process 900 may realize at the multimedia equipment place such as the multimedia equipment 545,575 of Fig. 5 and 580, and by the structrual description of the multimedia equipment shown in Fig. 6 600.The multi-media player 700 of Fig. 7 may be gone back use 900 to search for specific A/V element and/or to scatter element according to subject prefix and/or suffix value.
At module 905 places, determine title value through the time-code numbers of expansion.The title value difference is the A/V element of the next specific MPC part of other MPCs and scatters element.For example, may be to certain movie or particular commercial title search.
May in the selection of specific A/V element and/or distribution element, use some suffix.For example, may expect according to language-specific, special angle, particular parent module or above three kinds combinatorial search.
At module 910 places, determine whether to use specific suffix.Though suffix may be leading or be followed other suffix in the time-code numbers structure of expansion, after be embroidered with same hierarchical structure.Therefore can search for any specific suffix value.
If search is according to specific suffix value (the YES branch of module 910), realize module 915.At module 915 places, determine the specific suffix value.If (the NO branch of module 910) appears in all suffix field search values, realize module 920.In module 920, all A/V elements and distribution element are selected according to the title and the suffix value that are determined.May expect this complete process 900, and provide and meet all A/V elements that value determines and scatter element.
May take further step to select specific A/V element or distribution element, this may comprise the special scenes according to linear session sign indicating number numbering.At module 925 places, search narrows down to specific linear time-code numbers.If realize search (the then YES branch of module 925) according to the linear session sign indicating number, then module 930 realizations are to the sign of this element-specific.For example, process 900 may be used to realize according to the special scenes of the specific change of certain movie title and to the search of element-specific.
Though the present invention describes with the language-specific of structural and/or method, be appreciated that the invention that defines not necessarily limits special characteristic described here or behavior in additional claims.But in order to disclose demonstration form of implementation of the present invention.

Claims (23)

1. method that is used to produce through the time-code numbers of expansion is characterized in that comprising:
Sign has the multimedia element of linear session sign indicating number numbering;
Title value is joined each by in the linear session sign indicating number of the identification of multimedia element numbering; And
The suffix value is joined each by in the linear session sign indicating number of the identification of multimedia element numbering, and described suffix value comprises at least one in language value, angle value and the father's module value.
2. the method for claim 1 is characterized in that, described multimedia element comprises the audio frequency and video element and is dispersed in distribution element between the audio frequency and video element.
3. the method for claim 1 is characterized in that, the linear session sign indicating number numbering that has title value and suffix value resides in the time map table that multimedia element is relevant with linear session sign indicating number numbering.
4. method as claimed in claim 3 is characterized in that, time map table is used to refer to certain particular sector that comprises on the DVD CD of representing the multimedia element content by DVD player.
5. method as claimed in claim 3 is characterized in that, time map table provides the part of the file of the pointer that points to the medium internal data structure.
6. the method for claim 1 is characterized in that also comprising, sign does not have the element of linear session sign indicating number numbering, and the adding of linear session sign indicating number is not had in the element that is identified of linear session sign indicating number.
7. method as claimed in claim 6 is characterized in that, described do not have the element of linear session sign indicating number numbering to be dispersed between the audio frequency and video element with linear session sign indicating number numbering.
8. method that is used to search for specific multimedia element is characterized in that comprising:
Sign is described the title value of specific multimedia reproduction content, and wherein specific multimedia reproduction content is by forming through the described multimedia element of time-code numbers of expansion; And
According to the specific multimedia element of time-code numbers search through expansion,
Wherein said time-code numbers through expansion be by add to linear session sign indicating number numbering title value as prefix and add in language value, angle value and the father's module value at least one produce as suffix.
9. method as claimed in claim 8 is characterized in that, described search is carried out according to title value and one or more suffix.
10. method as claimed in claim 8 is characterized in that, described search is according to multimedia element is carried out with the relevant time map table of time-code numbers through expansion.
11. method as claimed in claim 10 is characterized in that, described time map table is the part that the message file of navigation and information reproduction is provided for title in the medium.
12. a method that is used for the various titles of playback is characterized in that comprising:
Thereby the message file of expansion in DVD is stored in the function that content in the DVD provides interpolation for description, and
Provide from the navigation of message file and information reproduction being used for the playback of various titles,
Wherein the extend information file is by carrying out with the time-code numbers through expansion of describing content ordering, and
Wherein said time-code numbers through expansion be by add to linear session sign indicating number numbering title value as prefix and add in language value, angle value and the father's module value at least one produce as suffix.
13. method as claimed in claim 12 is characterized in that, the extend information file has added a time map table of describing content ordering.
14. method as claimed in claim 12 is characterized in that, message file is by expanding from dividing the source of opening to receive the information of describing the function of adding with DVD.
15. one kind is used for it is characterized in that comprising producing or be added into the multimedia equipment of the multimedia element that does not have the linear session sign indicating number through the time of expansion code value:
Processor;
The multimedia memory module is used to store the multimedia reproduction content that comprises multimedia element; And
Through expansion time sign indicating number numbering module, be used for the time-code numbers through expansion is added the multimedia element of not free sign indicating number numbering,
Wherein said time-code numbers through expansion be by add to linear session sign indicating number numbering title value as prefix and add in language value, angle value and the father's module value at least one produce as suffix.
16. multimedia equipment as claimed in claim 15 is characterized in that also comprising the multi-media player module, is used for audio plays/video elementary and is dispersed in distribution element between the audio/video element.
17. multimedia equipment as claimed in claim 16 is characterized in that, described multi-media player module is used for according to through the time-code numbers search audio/video element of expansion be dispersed in distribution element between the audio/video element.
18. multimedia equipment as claimed in claim 16 is characterized in that, described multi-media player module is a multi-media player.
19. multimedia equipment as claimed in claim 15 is characterized in that, described multimedia equipment is a DVD player.
20. multimedia equipment as claimed in claim 15 is characterized in that, described multimedia equipment is the personal video recording machine.
21. one kind is used for time-code numbers and multimedia element system associated through expansion be is characterized in that comprising:
The broadcast point of multimedia element is provided; And
Receive the multimedia equipment of multimedia element, wherein multimedia equipment also receives through expansion time sign indicating number number relevant with each multimedia element,
Wherein said time-code numbers through expansion be by add to linear session sign indicating number numbering title value as prefix and add in language value, angle value and the father's module value at least one produce as suffix.
22. system as claimed in claim 21 is characterized in that, described time-code numbers through expansion is provided by broadcast point.
23. system as claimed in claim 21 is characterized in that, described time-code numbers through expansion is provided by the web website.
CNB2003101015612A 2002-10-07 2003-10-08 Method and system for generating and using extended time code Expired - Fee Related CN100521761C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US41697602P 2002-10-07 2002-10-07
US60/416,976 2002-10-07

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CNA2009101426975A Division CN101593542A (en) 2002-10-07 2003-10-08 The expansion time sign indicating number that is used for multimedia reproduction

Publications (2)

Publication Number Publication Date
CN1497971A CN1497971A (en) 2004-05-19
CN100521761C true CN100521761C (en) 2009-07-29

Family

ID=32393281

Family Applications (3)

Application Number Title Priority Date Filing Date
CNA031272347A Pending CN1497440A (en) 2002-10-07 2003-09-30 Time reference of multimedium object
CNA2009101426975A Pending CN101593542A (en) 2002-10-07 2003-10-08 The expansion time sign indicating number that is used for multimedia reproduction
CNB2003101015612A Expired - Fee Related CN100521761C (en) 2002-10-07 2003-10-08 Method and system for generating and using extended time code

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CNA031272347A Pending CN1497440A (en) 2002-10-07 2003-09-30 Time reference of multimedium object
CNA2009101426975A Pending CN101593542A (en) 2002-10-07 2003-10-08 The expansion time sign indicating number that is used for multimedia reproduction

Country Status (5)

Country Link
CN (3) CN1497440A (en)
BR (2) BR0304163A (en)
CA (2) CA2439733A1 (en)
MX (2) MXPA03008767A (en)
RU (3) RU2342692C2 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8077745B2 (en) 2007-03-23 2011-12-13 Qualcomm Incorporated Techniques for unidirectional disabling of audio-video synchronization
US8612643B2 (en) * 2007-06-30 2013-12-17 Microsoft Corporation Interfaces for digital media processing
US10007734B2 (en) 2011-11-01 2018-06-26 Microsoft Technology Licensing, Llc Real time document presentation data synchronization through generic service
US9936231B2 (en) * 2012-03-21 2018-04-03 Saturn Licensing Llc Trigger compaction
RU2627040C2 (en) * 2012-06-22 2017-08-03 Сони Корпорейшн Receiving device and method of synchronized processing of images in this device
US20140298157A1 (en) * 2013-03-26 2014-10-02 Samsung Electronics Co., Ltd Apparatus and method for presenting html page
US9626068B2 (en) * 2013-06-06 2017-04-18 Microsoft Technology Licensing, Llc Automated system for organizing presentation slides
CN109982757A (en) * 2016-06-30 2019-07-05 阿巴卡达巴广告和出版有限公司 Digital multi-media platform

Also Published As

Publication number Publication date
CA2439737A1 (en) 2004-04-07
BR0304295A (en) 2004-08-31
MXPA03008768A (en) 2004-09-10
MXPA03008767A (en) 2004-09-10
CA2439733A1 (en) 2004-04-07
RU2008132644A (en) 2010-02-20
RU2342692C2 (en) 2008-12-27
RU2345402C2 (en) 2009-01-27
CN101593542A (en) 2009-12-02
BR0304163A (en) 2004-08-31
RU2003129661A (en) 2005-03-27
RU2003129663A (en) 2005-03-27
CN1497440A (en) 2004-05-19
CN1497971A (en) 2004-05-19

Similar Documents

Publication Publication Date Title
CN100409358C (en) Reproducing apparatus providing colored slider bar
KR100445538B1 (en) Data recording method and apparatus, data record medium and data reproducing method and apparatus
RU2228546C2 (en) Data medium, reader, recorder, method for graphical data transfer, method for recording plurality of optional programs, and reproduction method
US7680395B2 (en) Apparatus and method for writing and playing back digital broadcasting supplementary service information and recording media therefor
CN1326396C (en) Reproducing apparatus and reproducing method
KR100930354B1 (en) Content information playback method in interactive optical disk device and content information provision method in content providing server
US20050220439A1 (en) Interactive multimedia system and method
US20120054798A1 (en) Advertisement display processing method and apparatus associated with reproduction title
CN1878280B (en) Method of video information transmission, as well as an information carrier, a device for receiving and a device for transmitting video information
US20090262238A1 (en) Generation And Delivery of Stepped-Frame Content Via MPEG Transport Streams
US20090119706A1 (en) Generation and Delivery of Stepped-Frame Content Via MPEG Transport Streams
US20060153531A1 (en) Information recording medium, information recording device and method, information reproduction device and method, information recording/reproduction device and method, information recording program, and information reproduction program
JP3152651B2 (en) Information recording medium, apparatus and method for recording and reproducing information on information recording medium
CN100521761C (en) Method and system for generating and using extended time code
CN1867992B (en) Recording and reproduction method and device for managing reproduction of text subtitle
EP1408507A2 (en) Extended time-code for multimedia presentations
CN100492512C (en) Recording apparatus, reproducing apparatus, recording method, reproducing method and recording medium thereof
US6415098B1 (en) Image recording/reproducing apparatus, an image recording apparatus, and an image recording method
KR20020064463A (en) Recording medium with data structure capable of reproducing sub-title with regard to title, reproducing apparatus and method thereof
JP2001251565A (en) Reception device, information reproduction method for the same, electronic unit and information reproduction method for the same
CN1771549B (en) Methods and apparatus for recording and reproducing data structure for managing playback control of recording medium
JP2000069413A (en) Method and device for recording and reproducing transmitted program work
KR100492446B1 (en) System and method for pvr(personal video recorder)
JP3505310B2 (en) Reproduction device, reproduction method, recording device, and recording method
CN100361204C (en) Recording medium having data structure for managing reproduction duration of still pictures recorded thereon and recording and reproducing methods and apparatuses

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090729

Termination date: 20091109