CN101593542A

CN101593542A - The expansion time sign indicating number that is used for multimedia reproduction

Info

Publication number: CN101593542A
Application number: CNA2009101426975A
Authority: CN
Inventors: R·K·小休斯
Original assignee: Microsoft Corp
Current assignee: Microsoft Corp
Priority date: 2002-10-07
Filing date: 2003-10-08
Publication date: 2009-12-02
Also published as: RU2345402C2; RU2008132644A; MXPA03008768A; CN1497440A; RU2342692C2; CA2439737A1; CN1497971A; RU2003129661A; BR0304163A; MXPA03008767A; BR0304295A; RU2003129663A; CN100521761C; CA2439733A1

Abstract

The present invention relates to be used for the expansion time sign indicating number of multimedia reproduction.The present invention relates to the time-code numbers through expansion is offered the multimedia element that comprises formation multimedia reproduction content.The linear session sign indicating number is used to the suitable reproduction of multimedia element to carry out suitable ordering.Prefix and suffix are added to the multimedia element that same linear session sign indicating number is arranged with difference in the linear session sign indicating number.There is the element of same linear session sign indicating number to be used for different reproduction variations, such as the scene variation of film.Provide unique extended time-code in the time map table that may in medium, use, and may separate with multimedia element and provide such as DVD.This kind time map is added the message file that is pre-existing in to or as comprising the replacement information extendfile of traditional IFO file and being provided.

Description

The expansion time sign indicating number that is used for multimedia reproduction

The application is to be application number the dividing an application for the Chinese patent application of " the expansion time sign indicating number that is used for multimedia reproduction " that be No. 200310101561.2 denomination of invention on October 8th, 2003 applying date.

Right of priority to provisional application

This application has right of priority to the provisional application sequence number of submitting on October 7th, 2,002 60416976.

(1) technical field

System and method described here relates to represents relevant and special and the system and method for will unique time code value being correlated with the insertion element with the audio frequency and video element with time reference and multimedia.

(2) background technology

Audio frequency and video (A/V) expression is to be made of the discrete element that comprises frame of video, picture, video segment and audio fragment (A/V element).One group or a series of A/V element (being Voice ﹠ Video) are provided at special scenes or the chapters and sections of A/V in representing.The example that A/V represents comprises the multiple title in video tape film, television broadcasting and the Digital video disc (DVD).The DVD optical disc title may comprise the towing title, give title and movie title.In some DVD CDs, have a plurality of movie titles.

For the suitable experience of viewing and admiring is provided, specific Voice ﹠ Video element is sorted to play at special time.For realizing this point, different elements is relevant with time value, and then compares to determine when start element with time reference or other linear clock value that increases.For example, the Voice ﹠ Video element of the first act of film can begin at times 141 place to play, and the Voice ﹠ Video element of the act 2 of film can begin at times 160 place in succession to play, wherein two time be relative common time with reference to and designated.

Provided the method for the time value of audio frequency and video element to comprise the scheme that is called " control is followed the tracks of " in the past.The video record band reproduces special this control tracking scheme that uses.The control tracking scheme adds no characteristic pulse in every frame of video record band.When the video record band is played, trigger action counter, it then triggers the time value that the dullness corresponding to the current broadcast point in reproducing increases.This time value compares with time reference and controls playing speed, position and synchronism.The shortcoming of control tracking scheme is that the different time value is to generate according to the point that reproduction inside counting device is initialised.This may be problematic when searching and accurately identifying particular frame, and this is because can not guarantee that unique value is relevant with any particular frame all the time.

" timing code " scheme is the replacement of control tracking scheme.The timing code scheme is relevant with each A/V element or scene with many bits time-code numbers.The structure of timing code can be " HH:MM:SS:FF ", wherein, " HH " representative hour, " MM " representative minute, " SS " represent second, and " FF " represents the interior frame of per second.Corresponding video has identical time-code numbers with audio element, makes specific video and corresponding audio begin simultaneously.Equally, the time code value is compared to determine when start element with time reference.

Be responsible for the professional association of the standard of development film and audio frequency, moving image and Television Engineer association (SMPTE) standardization the use of timing code.Developing SMTPE timing code standard comprises SMTPE 12M and SMTPE 328M.Because SMTPE timing code standard extensively is implemented in industry member, preferably A/V reproduces support or backwards-compatible with smpte time code.

In many cases, the A/V element is made of computing machine or MRDF.In this case, time encoding may be positioned at the head of each A/V element or file.Special scenes in the corresponding film of each element possibility, and film may comprise a plurality of scenes or element.

Go up storage and distribute film and its corresponding A/V element through the DVD that is everlasting.DVD comprises the audio-visual data that is organized into video object unit (VOBU).VOBU is the physical location of DVD storage, and is the minimum access unit of DVD CD.The VOBU of (physics is continuous) group may be formed the unit that is called " sub-district " continuously.The sub-district is the video unit of the index minimum that can find.The part of each sub-district corresponding A/V content, for example a scene.The time span of sub-district may have nothing in common with each other, from several seconds zero point to several hrs.

One group of sub-district may be formed an object video (VOB) in logic.VOB is a single file that possible comprise a plurality of through multiplexed audio and video stream.The set of VOBs may be formed object video group (VOBS).

DVD has a plurality of " titles ".Each title is the potential different arrangement or the ordering of sub-district (and VOBU).In many cases, the different editions of the corresponding film of these titles possibilities.For example, film has the version of different brackets, different language etc.When seeing DVD, the version that the general selection of user will be put.In many cases, different titles can share or use many same sub-districts or VOBU (to come from same VOBS object video group; May be from the same vob file in organizing).

Data on the DVD are turned to the sequence of the logical partition that is identified by logical partition number (LSN) by physical format.Each subregion comprises 2048 data sequence.Generally being sub-district on the DVD and VOBS is assigned in file or the subregion according to the LSN and the byte offset of its subregion.

Each audio title on the DVD has user's control " title " option information or the IFO file of describing on broadcast behavior and the DVD.Particularly the IFO file provides and points to the pointer (being LSN) that DVD goes up the sub-district.The IFO file is used in particular on DVD play title navigation and information reproduction is provided.

, the cause of DVD tissue, its content produce different DVD titles because may playing in a different manner.Title in the dvd video disc may be formed by reaching 999 program chains (PGC).A program chain comprises nearly 99 programs (PG).PGC is a cell list.Each PGC has the sensing that comprises ordering to indicate the program control module (PCB) of one group of pointer of sub-district of the playing sequence of program and sub-district.Different PGC allows the difference ordering of sub-district.The IFO file provides index, and the sub-district that will list in PGC is decomposed into the VOBU and the LSN that can play the different titles with different video sequence.

Fig. 1 illustrates two types DVD title, and how they may be played.DVD start of header,, wherein timeline 102 was represented the linear session reference in " the Relative Zero time " of timeline 102.The DVD title of play-overing is known as " one_sequential_PGC title ".Its ordering may be called as " multi_PGC title ", " multi_angle title " or " parental_blocktitle " by vicissitudinous DVD title.A PGC 1105 is shown, the title that be play-overed or the linear title of playing promptly are provided.When having " multi_PGC title ", " multi_angle title " or " parental_blocktitle ", there is non-linear playback.Specific title may start from PGC 2110, transfers to then or PGC 3115 or PCG 4120.PGC 3115 transfers to PGC 5125.PGC 4120 transfers to PGC 6130.PGC 5125 transfers to PGC 7135.PGC 6130 may transfer to or PGC 8140 or PGC 9145.All titles in this example finish to play PGC 10146 in position 150,152 or 154.

The version of transferring to the title of PGC 7135 may be that grade is the film of NC-17.The version of transferring to the title of PGC 8140 may be that the film grade is the version of R.The version of transferring to the title of PGC 9145 may be the version of the G grade of film.

Different conversion (title that " multi_PGC title " or " parental_block title " promptly arranged) has the scene that starts from different time.In other words, different conversion meetings might start from the corresponding scene of the different time on timeline 102, and timeline 102 is the duration from PGC 2110 beginnings.This is because may be by the different video to Same Scene by the title of " multi_PGC title " definition, and/or the different language of same video.Only, have no idea to distinguish which video and/or audio that to play different conversion to specific scene according to time-code numbers.In this example, PGC 10146 may be on timeline 102 three different times begin to play, this depends on the title of broadcast and the path that arrives this place.

The broadcasting or the stream that may also reproduce A/V are used time-code numbers.Fig. 2 has illustrated the previous method that is scattered with such as the stream of the scene of the HTML(Hypertext Markup Language) document elements of representing commercial film.An element is different from the scene of being made up of the Voice ﹠ Video component.Scene may be from different sources or broadcast point with element.The user receives the broadcasting 200 of the stream that comprises scene and element.Scene may be made of many discrete A/V components of Voice ﹠ Video fragment that comprise.In this example, broadcasting 200 broadcasting in the following order: scene 205, element 210, scene 215, scene 220, element 225 and scene 230.Each A/V component (fragment) of each scene is identified by specific linear session sign indicating number (LTC) numbering.Specific LTC numbering is positioned at any top of file that has identified each scene.The example explanation that illustrates and the audio fragment 205-B and the relevant LTC head 205-A of video segment 205-C of scene 205.LTC head 215-A is relevant with the audio fragment 215-B and the video segment 215-C of scene 215, and LTC head 220-A is relevant with the audio fragment 220-B and the video segment 220-C of scene 220.LTC head 230-A is relevant with the audio fragment 230-B and the video segment 230-C of scene 21530.

Element

210 and 225 may be the readable file of computing machine (machine), such as the file of writing with HTML or similar language.In this example,

element

210 and 225 not relevant specific LTC numberings with them.The broadcasting of scene and the stream that receives have describes the numbering when scene is played; Yet, do not have the element of LTC numbering not indicate the information when they are played.This when scene and insert element never homology be received and be a problem especially when having no idea to determine its playing sequence.

The field of development is based on the multimedia of web, and it comprises that the element that comes from the remote web website scatters therebetween from the next DVD video of local player.This element may comprise the covering (for example letter) and/or the promotional content of scene update, scene change (for example, the new plot in the film), different language (audio frequency) sound channel, literal and figure.Because DVD dependence IFO file, the element based on web of distribution new or not free sign indicating number may not be used the A/V element that exists to sort or be accessed at random according to the IFO file that exists.

(3) summary of the invention

System and method described here comprises that identification has the multimedia element of the linear session sign indicating number relevant with them numbering and prefix and suffix value are joined in the linear session sign indicating number numbering to set up unique time-code numbers through expanding to distinguish specific multimedia element.

In certain embodiments, the linear session sign indicating number numbering that has prefix and a suffix value is added in the multimedia element that does not have the linear session sign indicating number.

In a particular embodiment, possible service time, mapping table was so that relevant with specific multimedia element through the time-code numbers of expansion.

(4) description of drawings

Fig. 1 is the title of " one_sequential_PGC title " and non-linear playback " multi_PGC title " definition is play in explanation by linearity a block scheme;

The block scheme of the previous method that flows of the element of Fig. 2 scene that to be explanation come from one or more broadcast point and distribution;

Fig. 3 A be explanation receive from source the insertion element that scatters stream and player from another source receive the stream of fundamental element;

Fig. 3 B is that explanation is the block scheme through expansion time harbour portion that scatter and part fundamental element;

Fig. 4 be explanation comprise IFO file and additional time map table the IFX file and and DVD between the block scheme that concerns.

Fig. 5 is the block scheme that explanation provides the system of the multimedia equipment of multimedia reproduction and broadcaster.

Fig. 6 is the block scheme of explanation multimedia equipment structure.

Fig. 7 is the block scheme of explanation multi-media player structure.

Fig. 8 is the process of the time code value through expanding was set up or added in explanation in A/V element and/or element a process flow diagram.

Fig. 9 is explanation according to through the time-code numbers of expansion and the process flow diagram of the process of searching element.

(5) embodiment

Unique timing code identifier numbering

The technology of describing utilize prefix and suffix in conjunction with linear time-code numbers so that the unique identification of any specific multimedia element to be provided.In certain embodiments, prefix and suffix are added in the smpte time code structure " HH.MM.SS.FF " to keep and the back compatible of standard in the past, such as SMPTE 12M and 328M.Smpte time code structure HH:MM:SS:FF is defined as follows: " HH " representative hour, and " MM " representative minute, " SS " represent second, and " FF " represents the interior frame of per second.

Fig. 3 A illustrates to receive and scatters element and fundamental element.Scatter element 300 (1), 300 (2) ... 300 (N) comprise each specific distribution element 300 head 305 (1), 305 (2) ... 305 (N), and actual content 310 (1), 310 (2) ... 310 (N).Scattering element 300 is received at the player place.Scattering element 300 may be received from the source such as the Internet (for example website).

Player 315 also receive fundamental element 320 (1), 320 (2) ... 320 (N), it comprise head 325 (1), 325 (2) to each specific fundamental element 320 ... 325 (N) and actual content 330 (1), 330 (2) ... 330 (N).Fundamental element 320 never homology is received, such as internet source (for example the 2nd web website).When

actual content

310 and 330 is authorized to, may not know

actual content

310 and 320 relative timings with respect to another.By with timing code or time-stamp addition on

head

305 and 325, each that scatter element 300 may be sorted in each of fundamental element 320 suitably.

For example, player 315 may be from DVD dvd playback fundamental element 320, and (promptly with streamed) is received from the web website and scatter element 300, and wherein, distribution element 300 may be that the director of relevant certain specific fundamental element 320 appraises through discussion.When scattering at each in element 320 behind the joining day sign indicating number, fundamental element 320 is by with suitable rank order.In other words, the director's of distribution element 300 the specific fundamental element 320 of appraising coupling through discussion may be a film scene.Other example comprises suitably promotional elements 320 orderings, and this promotional elements is such as may being that the fundamental element 320 of film is as the commercial advertisement of scattering elements 300.This makes commercial advertisement to be positioned at suitably between the scene of film.The reproduction of " distribution element " may change with the elementary audio video elementary, or synchronous (for example foreign language dialogue and performer's is lip-sync, is superimposed upon figure above the video image or below or text subtitle).

The relevant details of the head 335 that Fig. 3 B explanation is relevant with the particular segment of content 300 and 320.Head 335 comprises LTC numbering 340, prefix 345 and suffix 350,355 and 360.LTC number field 340 is specified the time representation of " HH.MM.SS.FF " form, when begins

content

300 and 320 to indicate.LTC number field 340 may be the previous SMPTE relevant with the specific A/V element numbering that is pre-stored in, and maybe may be the derivation value that appends to the multimedia element that does not before have the SMPTE numbering.The ordering of distribution element and corresponding audio/video (A/V) element may be embodied as the production run when the Voice ﹠ Video element is set up or edited for certain specific A/V reproduces.Perhaps, time corresponding sign indicating number numbering may be added into (being about to web webpage content that sends and the audiovisual content that local dvd video disc comes combines) in the distribution element that separately sends, and separately the element of transmission is linked with the A/V element of time-code numbers consistent with each other and existence.This process is called as " last combination " or " binding at last " synchronously.Timing code itself may be timing code index (for example making the synchronous time map table of timing code and audiovisual content with the LSN index) that the audiovisual content of previous not free sign indicating number is quoted is provided and " combines at last " with the audiovisual content of existence by download.

Prefix 345 and comprised period or header field before LTC number field 340.The specific title in the DVD CD may be described and distinguish to header field 345, maybe may describe or distinguish broadcast program or streaming film and such as the distribution element of commercial advertisement.For example, on specific DVD CD, have and comprise about particular video frequency art film how to take this film and the title that comprises film.May expect will be from specific art film specific multimedia element that comes and the scene ordering that comes from movie title.According to scheme described here, specific special literary film video segment can sort with the certain movie scene, and may in its corresponding LTC number field 340 same time code value be arranged.Prefix header field 345 is used for difference and appraises through discussion and film scene.For example, corresponding header may comprise " making the movie.00:55:33:13 " and " movie.00:55:33:13 ", wherein the LTC value of " 00:55:33:13 " be used to make specific appraise through discussion with the certain movie scene synchronous.

Prefix header field 345 itself may be formatted according to comprising the international standard audio frequency and video to number one of several standards of (ISAN).ISAN is to provide unique identification each global data base such as the video work of movie or television program.The ISAN numbering convention is the identifier that definition is divided into 16 hexadecimal digits of two sections: the root segmentation of 12 bit digital then is 4 bit digital segmentations, is used to identify the segmentation of plot or part when using.

Has the different variation of the various combination that comprises the video of describing special scenes and audio frequency as mentioned above.This variation includes but not limited to, language, camera angle and grade (being father's module).Head 335 comprises three suffix value fields: language field 350, angle field 355 and father's module (grade) field 360.Language field 350 is the difference specific title by the language (for example, Spanish, English and French) that uses in audio frequency, video and the subimage.Angle field 355 is further distinguished title by video camera perspective view (for example front, back, first visual angle).Father's module field 360 is by grade (for example " G ", " R ", " PG ") difference specific title.

Different A/V element (the promptly different different scenes of playing that change) may use LTC to number 340 same values (be different scene in identical time or played in order); Yet they are by the particular value difference of language field 350, angle field 355 and father's module field 360.For example, if the particular combinations of prefix and suffix allows, may have the scene of describing by " movie.1:23:02.15.span.front.NC-17 ", the expression film scene begins the relative time place at 1 hour, 23 minutes, 2 seconds and 15 frames, and content is that Spanish, preceding visual angle and grade are NC-17.Other element may be by the time value of identical 1 hour, 23 minutes, 2 seconds and 15 frames; Yet this element may be and the interview of directing.Specific element may be identified as " interview.1:23:02.15.english.null.null ".

The Demonstration Application of the timing code UNC of use through expanding comprises according to the selection of specific suffix value plays certain movie; Skip by prefix header field 345 and be " commercial " defined element-specific; And according to searching special scenes in the specific suffix of specific LTC numbering place broadcast.

May be described to " TT.HH.MM.SS:FF.LL.AA.PB " such as being included in numbering through the expansion time sign indicating number in the head 335, wherein " T " is title, and " LL " is language, and " AA " is angle, and " PP " is father's module.

Multimedia element is described by particular file format.For example, audio file may be described by " wave " audio file formats of MicrosoftCorporation definition.The Wave audio file is by the file extension definition of .wav.The example of particular video file form is interweave form or AVI of audio/video.Avi file defines with " .avi " suffix.Can think that no matter what the form of file is each specific A/V element may comprise describes specific head through expansion time sign indicating number numbering.

In some cases, may be without some specific field.In other words, may have only the variation of or limited quantity, other scene is had more changeableization number special scenes." NULL " value can be used to set no field.Can omit separator with different separator (for example, fullstop, comma, colon, branch, oblique line etc.) and when zero of beginning or ending place is not expressed with can having ambiguity.

Information expansion (IFX) file

The DVD CD can be described as the data structure sequence quoted by logical sector number (LSN) byte offset, and they identify with index data structure.Index data structure has occupied the predefined procedure of sequence and continuous LSN.Object video (VOB) is by order and continuous the arrangement to offer known position and other the video index data structure of program chain (PGC) with the LSN visit.Information on the DVD (IFO) file comprises index data structure and the pointer that points to the physical disc position (being LSN) that comprises the video of being quoted by specific PGC is provided.So to the title of multi_PGC_title, a plurality of PGCs in the IFO file are the heading message link, select or select by user action by program instructions, and the broadcast that produces selecteed different titles.

Data structure in the IFO file comprises audio frequency controller information (VMGI), and it provides the information of arranging about CD; Video title set information (VTSI) provides about the navigation of certain specific title group on the CD and the information of reproduction; And object video group (VOBS) comprises the video cell group in the VOB.One of function of IFO file is that the position of VOBU, sub-district and the VOB of specific title is provided by the pointer that provides suitable sensing to comprise the specific LSN of data.

Fig. 4 illustrates the IFX file 400 that comprises IFO file 405, time map (TMAP) data structure or TMAP 410, and TMAP data structure through expanding or the TMAP 415 through expanding.

TMAP 410 is relevant with VOBU in its video title set with the LTC value.In this example, TMAP 410 is made up of list item 1415 (1), list item 2415 (2) to list item N 415 (N).Each list item of list item 415 has linear session code value 420 and pointer 425.The pointer 425 of list item 415 points to VOBU table 430, and especially points to list item 435 (1) to 435 (N), and they provide video content and are defined by VOBU 440 and LSN 442.TMAP 410 definition one_sequential_PGC_titles.VOBU table 430 may be included in the IFO file 405 and the LSN 442 by each VOBU 440 that each VOBU is linked on the CD shows out the also memory location of index.

General IFO file 405 includes only TMAP 410.Append to TMAP 410 and IFO file 405 to set up IFX file 400 through the TMAP 415 of expansion.Provide the realization of timing code form through the TMAP415 of expansion through expansion, it on only reading traditional playback equipment of IFO file 405, keeps adding multi_PGC title in the normal DVD video IFO file function through the expansion time sign indicating number.In this example, through the TMAP415 of expansion the pointer 445 that some entries435 in the sensing VOBU table 430 are provided is shown.In some cases, the same list item of the list item of being quoted by TMAP 410 435 is directed; Yet, not necessarily quote (sensings) by all of TMAP 410 indications or same list item 435 through expansion TMAP 415.

Use for being used to be equipped with the player of reading through expansion time sign indicating number numbering through expansion TMAP 415.Particularly, through the TMAP 415 of expansion with VOBU with number through the expansion time sign indicating number relevant.Be equipped with and be used to read use IFO file 425 (TMAP 410) and ignore TMAP415 through expansion through the conventional players of expansion time sign indicating number numbering.

TMAP 415 through expansion comprises list item 1450 (1), list item 2450 (2) ..., list item N 450 (N).List item 450 is relevant with the specific linear time-code numbers that is provided by alignment timing code 455 with element-specific.Each of list item 450 is further by element column 460 signs.The prefix or the title value that may provide according to the title (prefix) 465 by the available DVD title of describing the particular entry support are distinguished list item 450.Further suffix 470 is according to distinguishing list item such as " language, camera angle and father's module " suffix value.Title (prefix) 465, linear session sign indicating number 455 and suffix 470 are formed through the expansion time code structure.To each list item 450, provide a pointer by pointer 455.Specific VOBU in the pointed table 430 of list item 450.To realizing of correspondence being linked in the physical access of the video data of expansion time sign indicating number is LSN 442 relevant by the VOBU in visit and the table 430 440 and table 415 through the expansion time sign indicating number.

IFX file 405 constitutes makes IFO 405 (TMAP 410) can use through the conventional players of expansion time sign indicating number numbering not reading.Be added in the IFO file 405 so that the time-code numbers through expansion of additional function to be provided through expansion TMAP 415.Provide according to function through expansion time sign indicating number numbering through expansion time representation and search (i.e. navigation) dvd content.Make the DVD title specifically to be identified through the expansion time numbering by subject prefix through expansion time sign indicating number numbering structure, and by being the element that points to specific title through the linear session sign indicating number of the time of an expansion numbering part.And, may comprise that (promptly scattering) has the additional element by the dvd content of the specific title of describing through the expansion time sign indicating number, wherein additional elements comprise sign about the element of specific title relevant where to be played number through the expansion time sign indicating number.

Demonstration system

Fig. 5 illustrates multimedia equipment and the system 500 of broadcasting equipment so that multimedia reproduction to be provided.Network 505 comprises local area network, wide area network, private and public/private, comprises the Internet.Hardwired (for example cable) and/or wireless network may constitute network 505.Network 505 is used to provide from the multimedia communication that come or that offer different entities of different entities.

Television broadcasting point 510 provides " the multimedia reproduction content " in the system 500.The multimedia element that television broadcasting point 510 is play from A/V source 515.Many multimedia elements such as the A/V element are formed whole A/V from A/V source 315 and are reproduced.The A/V element may be relevant with specific timing code.Television broadcasting point 510 may scatter in the A/V element in A/V source 515 from increasing the element such as commercial advertisement or sales promotion (promptly scattering element) of content source 520.Scatter the not time-code numbers relevant of element with them.A/V element and the element that is added into be called as together multimedia represent in MPC perhaps.A/V source 515 and the content source 520 that is added into may flow out in the different time, therefore may be in the different time place at different multimedia equipment and be received.When they when television broadcasting point 510 flows out, may be affixed to each A/V element and scattered in the element by the time-code numbers through expansion of Fig. 3 B definition.

Television broadcasting point 510 is linked the satellite dish antenna 525 that is linked to satellite 530.Satellite antenna 525 emissions have the signal of MPC to satellite 530.Satellite antenna 535 second lines of a couplet are from the signal that is loaded with MPC of satellite 530.Network 505 is directly linked satellite antenna reverberator 535 to receive MPC.Perhaps network 505 may directly be linked television broadcasting point 510.Television broadcasting point 510 also may have radio frequency (RF) signal of MPC by antenna 540 emissions.This kind RF signal may be received by the different multimedia equipment that comprises televisor.

Multimedia equipment 545 is the separate units that are not coupled to network 505, but can receive from the MPC of television broadcasting point 510.Multimedia equipment 545 comprises A/V broadcast unit 545-A, and this may be televisor or tuner be arranged and the monitor of A/V input and output.Multimedia equipment 545 may also comprise the multi-media player 545-B such as DVD player, and multi-media recording device 545-C.Multimedia equipment 545 is linked end from the receiving antenna 550 such as the next RF signal in the source of antenna 540, and wherein the RF signal carries MPC.MPC may be also by multimedia equipment 545 antenna 555 and being received via satellite, the signal that receives from satellite 530 of satellite antenna 555 wherein.

In some cases, multimedia equipment 545 receives the A/V elements and without any the distribution element of relevant time-code numbers.Can when receiving, will join in each A/V element and the distribution element through expansion time sign indicating number numbering by multimedia equipment 545.A/V element and scatter element and may record by multi-media recording device 545-C, and unique by reference through expansion time sign indicating number numbering and accessed.

The broadcasting of MPC may also realize by the Internet.Generally, this digital transmission that is called " web broadcasting " and MPC is provided.Web broadcast point 560 may comprise can be by the interactive addressable web website of network 505 visits.Web broadcasting 560 received from comprising from the A/V of the distribution element of the literal, figure, audio/video fragment and/or the HTML that increase content source 570 or SMIL file of A/V source 565 reproduces.Perhaps this element can come from other source.

Web broadcast point 560 sends to network 505 can be linked the different multimedia device access of network 505 with MPC (element of routine A/V element and distribution).Perhaps, web broadcast point 560 may send MPC as mentioned above via satellite.

Multimedia equipment 575 is coupled to network 505 and receives from the next MPC of not homology that comprises television broadcasting point 510 and web broadcast point 560.Multimedia equipment 575 comprises A/V display unit 575-A, and this may be televisor or have tuner and the monitor of A/V input and output.Multimedia equipment 575 may also comprise such as the multi-media player 575-B of DVD player and multi-media recording device 575-C.

In many cases, multimedia equipment 575 is similar to multimedia equipment 545, may receive the A/V element of not being with relevant time-code numbers and scatter element.Expansion time sign indicating number numbering joins each A/V element and scatters in the element when receiving in multimedia equipment 575.A/V element and distribution element may be recorded for multi-media recording machine 575-C, and visit through expansion time sign indicating number numbering by unique.In other cases, the A/V element of the free sign indicating number numbering of

multimedia equipment

545 and 575 receiving belts and/or distribution element.In the ordering of the reproduction at

multimedia equipment

545 and 575 places and when playing according to time-code numbers through expansion.

Multimedia equipment and separate unit comprise WebTV unit and personal video recording machine (PVR) unit.PC 580 is coupled to network 505 and receives MPC in this

example.As multimedia equipment

545 and 575, PC580 may join the time-code numbers through expansion the A/V element that does not have the time-code numbers through expanding of reception and scatter in the element.

Different sources may provide other content, comprises the file of multimedia equipment use and the renewal of program.Content is multimedia element or A/V element not necessarily, and may comprise the IFX file of describing as Fig. 4.In this example, the visit of web website 585 explanation multimedia equipments such as through the additional content of updating file from the source.And, may transmit new A/V element flow such as the broadcast point of television broadcasting point 510 and web broadcast point 560 and to make itself and the content ordering that is pre-stored at different multimedia equipment place.

The demonstration multimedia equipment

Fig. 6 illustrates the structure of demonstration multimedia file 600.The multimedia equipment 545,575 and 580 of Fig. 5 is structures of representing multimedia equipment 600.Multimedia equipment 600 may be that the oneself who is different from such as PC 580 comprises the unit., maybe may comprise different units such as multimedia equipment 545 and 575.With described, multimedia 600 provides and receives MPC, handles the function of MPC and demonstration MPC as below.In some instances, multimedia equipment 600 is also recorded MPC.

Multimedia equipment 600 may comprise receiver module 605, is used to receive the RF signal that comes from television source.Other signal and data also may by audio frequency and video load module 610 never homology be received, comprise equipment and network.

Multimedia equipment 600 comprises one or more processors 615 (for example microprocessor), its handle different control multimedia equipments 600 operation and with the instruction of other electronics and computing device communication.

When the A/V element with scatter element and be received under the situation of not free sign indicating number numbering, this kind numbering may be by being affixed in each element through expansion time sign indicating number module 620.When expansion time sign indicating number module 620 is used for receiving at multimedia equipment 600 places, generates and will append to each A/V element and each and scatter in the element and go through the time-code numbers of expansion.

Multimedia equipment 600 can be realized with one or more memory elements, comprise nonvolatile memory 630 (for example ROM, Flash, EPROM, EEPROM etc.) for example.Storer 630 is used to store the operating system module 635 that is included in the operating system of using on the multimedia equipment 600.Application program may be stored in the application program module 640 of storer 630.Random access storage device (RAM) also may realize being used to store interim file and the program that multimedia equipment 600 uses in multimedia equipment 600.

MPC may be stored in the multimedia memory module 650.Multimedia memory module 650 may be used different mediums, such as CD, tape and disk.Multimedia memory module 650 may be by other module and equipment and multimedia equipment 600 device access in addition that are the part of multimedia equipment 600.Multi-media recording machine module 655 offers the ability that multimedia storer 650 is recorded.Multi-media player module 660 may or directly directly receive MPC or visit MPC from the multimedia storer 650 of MPC from processor 615.Processor 615 may be visited element in A/V element and the multimedia memory module 650 by identifying specific time-code numbers through expansion.

Audio/video output module 665 is provided to the direct output of demonstration or intermediate equipment.Output module 665 may and make it flow into individual channel with the audio ﹠ video unpack.Processor 515 control output modules 665 and from the A/V stream of output module 665.

The demonstration multi-media player

Fig. 7 illustrates the structure of demonstration multi-media player 700.Multi-media player 700 comprises distinct device, but particularly including the DVD player of using industrial standard, particularly the standard of being set by National Television System Committee (NTSC) (NTSC).The structure of multi-media player 700 may be used for the multi-media player 660 of Fig. 6.Multi-media player 700 may read from the multimedia such as the prerecording of the DVD of commodity production, or reads from the writeable medium of the DVDs that can record, or receives the A/V element and scatter element flow.

One or more processors 705 may be used for handling from the next signal of medium (for example DVD), and communicate by letter with the disparate modules of multi-media player 700.Be that processor illustrated in fig. 6 may be that processor 705 uses under the situation of a part of multimedia equipment 700 at multi-media player 700.The A/V element ordering through the time-code numbers of expansion is handled and will have been added to processor 705.Under the DVD situation, the IFX file is used so that the A/V element is sorted by processor 705.

Multi-media player 700 may comprise memory module 710, and its storage is included in the operating system module 715 of the operating system of using on the multimedia 700.Memory module 710 also may comprise the file available that comprises multi-media player 700 and/or the file/program module 720 of program.

A/V element or element synchronizer module 725 are used for according to time-code numbers audio frequency, video and/or other data stream of separating synchronously through expansion.Synchronizer module 725 is used in particular for realizing to previous not by the last binding of the stream of synchronous A/V element and/or element.For example, multi-media player may receive the stream that comprises the newspeak sound channel, with reside in audio video synchronization in the multi-media player 700 or that receive from other source.Synchronizer module 725 is according to synchronous with Voice ﹠ Video through the time-code numbers of expansion.Particularly, the linear session sign indicating number of the time-code numbers through expanding numbering is used to make Voice ﹠ Video synchronous.

Multi-media player 700 also may comprise and reproduce engine modules 730, and its uses the demonstration of the information that the reproduction data of coming from medium derive from multi-media player 300 with control in IFO or IFX file.Navigation administration module 735 uses navigation data interface to be provided, to set up menu, also to control also from IFO or the A/V element of TFX file derivation or any branch of scene.In addition, the audio/video output module 740 that provides in multi-media player 700 is used for signal is outputed to display device, or the intermediate equipment before display device.

Adding is through the timing code of expansion

Fig. 8 illustrates process 800, and it is set up or adds through the expansion time code value.Process 800 may realize in television broadcasting point 510 or the broadcast point the web broadcast point 560 such as Fig. 5.In some implementations, process 800 makes at the multimedia equipment place at all multimedia equipments 545,575 as shown in Figure 5 and 580 places and realizes, and by the structrual description of the multimedia equipment shown in Fig. 6 600.In other cases, process 800 is realizing when setting up a DVD or other medium.

At module 805 places, determine whether the A/V element or scatter unit to have additional linear session sign indicating number numbering.Linear session sign indicating number numbering may be by the SMPTE standard definition.If A/V element or insertion element have linear time-code numbers (the then YES branch of module 805), keep linear time-code numbers.If A/V element or distribution element do not have linear session sign indicating number numbering (the then NO branch of module 805), add the linear session sign indicating numbers in module 810.At square frame 810 places, the linear session sign indicating number of affix is described and when is play specific A/V element or scatter element.

At module 815 places, in the linear session sign indicating number of specific A/V element or insertion element, add title value.Foundation is through the time-code numbers of expansion.The title value difference that different MPC reproduce.

In module 820, determine whether that the suffix used (being the suffix field) that further defines the A/V element or insert element exists.This kind suffix comprises angle, language and father's module (being grade).If use suffix (the YES branch of module 820), realize module 825, and in the time-code numbers of expansion, adding the suffix value.Be determined the back up to all suffix used and realize module 820.All can use suffix all be concatenated into through the expansion time-code numbers, up to having determined all suffix values (the NO branch of module 820).In some cases, some A/V elements or distribution element are not used specific suffix field.

According to searching through the expansion time sign indicating number

Fig. 9 shows process 900, and it searches element according to the time-code numbers through expansion.Process 900 may realize at the multimedia equipment place such as the multimedia equipment 545,575 of Fig. 5 and 580, and by the structrual description of the multimedia equipment shown in Fig. 6 600.The multi-media player 700 of Fig. 7 may be gone back use 900 to search specific A/V element and/or to scatter element according to subject prefix and/or suffix value.

At module 905 places, determine title value through the time-code numbers of expansion.The title value difference is the A/V element of the next specific MPC part of other MPCs and scatters element.For example, may search certain movie or particular commercial title.

May in the selection of specific A/V element and/or distribution element, use some suffix.For example, may expect according to language-specific, special angle, particular parent module or above three kinds combination search.

At module 910 places, determine whether to use specific suffix.Though suffix may be leading or be followed other suffix in the time-code numbers structure of expansion, after be embroidered with same hierarchical structure.Therefore can search any specific suffix value.

If searching is according to specific suffix value (the YES branch of module 910), realize module 915.At module 915 places, determine the specific suffix value.If (the NO branch of module 910) appears in all suffix field search values, realize module 920.In module 920, all A/V elements and distribution element are selected according to the title and the suffix value that are determined.May expect this complete process 900, and provide and meet all A/V elements that value determines and scatter element.

May take further step to select specific A/V element or distribution element, this may comprise the special scenes according to linear session sign indicating number numbering.At module 925 places, search and narrow down to specific linear time-code numbers.If realize searching (the then YES branch of module 925) according to the linear session sign indicating number, then module 930 realizations are to the sign of this element-specific.For example, process 900 may be used to realize according to the special scenes of the specific change of certain movie title and to the search of element-specific.

Though the present invention describes with the language-specific of structural and/or method, be appreciated that the invention that defines not necessarily limits special characteristic described here or behavior in additional claims.But in order to disclose demonstration form of implementation of the present invention.

Claims

1, a kind of method is characterized in that comprising:

Receiving belt has the multimedia element of linear timing code;

Reception does not have the multimedia element of linear session sign indicating number;

Add the linear session sign indicating number; And

Make all multimedia elements synchronous according to unique linear session sign indicating number.

2, enforcement of rights requires the broadcast point of 1 described method.

3, enforcement of rights requires the multimedia equipment of 1 described method.

4, enforcement of rights requires the multi-media player of 1 described method.