CN101218798A - Improving error resilience using out of band directory information - Google Patents

Improving error resilience using out of band directory information Download PDF

Info

Publication number
CN101218798A
CN101218798A CNA2006800246838A CN200680024683A CN101218798A CN 101218798 A CN101218798 A CN 101218798A CN A2006800246838 A CNA2006800246838 A CN A2006800246838A CN 200680024683 A CN200680024683 A CN 200680024683A CN 101218798 A CN101218798 A CN 101218798A
Authority
CN
China
Prior art keywords
bag
catalogue
information
multimedia data
data stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2006800246838A
Other languages
Chinese (zh)
Inventor
萨迪·M·纳加拉杰
阿姆农·西尔贝格
布鲁斯·柯林斯
戈登·肯特·沃克
迈克·劳卡斯
维贾雅拉克希米·R·拉韦恩德拉恩
石方
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN101218798A publication Critical patent/CN101218798A/en
Pending legal-status Critical Current

Links

Images

Abstract

A method and apparatus to improve error resiliency in processing a multimedia bitstream is described. A directory of header information is generated for a multimedia bitstream. The directory information comprises packet header information associated with the multimedia bitstream. The directory information may be transmitted to a receiver along with the multimedia bitstream. A receiver of the multimedia bitstream and the directory can utilize the header information to identify and locate packets within and subsequent to erroneous data in the received bitstream. By identifying and locating packets that may otherwise be discarded, the receiver may be able to improve error recovery and decoding of the multimedia data.

Description

The outer directory information of service band improves anti-mistake
Cross reference
Present application for patent advocates on April 4th, 2006 to apply for and to transfer the 60/789th of being entitled as of assignee of the present invention " ImprovingError Resilience Using Out of Band Directory Information ", No. 454 provisional application cases and on May 13rd, 2005 apply for and transfer the 60/680th of being entitled as of assignee of the present invention " Methods and Apparatus forImproving Packet Error Resiliency Using Out-Of-Band Directory Information ", the priority of No. 809 provisional application cases, both clearly incorporate this paper by reference into described provisional application case.
Technical field
The present invention relates to carry out to digital data the method and apparatus of Code And Decode with the mismanage scheme.
Background technology
Because the swift and violent growth of internet and radio communication and success greatly, and to the demand that increases of multimedia service always, by the internet with move/the wireless channel Streaming Media caused great concern.In heterogeneous the Internet protocol (IP) network, video is provided by server and can be by one or more client fluidisation.Wired connection comprises dialing, integrated service digital network (ISDN), cable, digital subscriber line agreement (being referred to as xDSL), optical fiber, Local Area Network, wide area network (WAN) and is connected with other.Emission mode can be unicast or multicast.
Mobile/radio communication is similar to heterogeneous IP network.By move/wireless channel carries content of multimedia to have challenge because these channels because multipath attenuation, cover, intersymbol interference and noise disturbance and usually seriously undermined.For example mobility and some professional other reason of competition also cause bandwidth change and loss.Interchannel noise and the number of users of just serving determine the time-varying characteristics of channel circumstance.
Demand to higher data rate and higher quality of service in heterogeneous IP network and the mobile communication system increases fast.Yet for example the factor of finite delay time, limited transmitting power, finite bandwidth and multipath attenuation continues the data rate that the restriction real system is handled.In multimedia communication, especially in the environment of easily makeing mistakes, launch medium mistake to recover providing aspect the required service quality be crucial because even the mistake in single decode value also can cause the decoding illusion propagated on the room and time.Various encoding measurements have been used to reduce mistake, keep data necessary speed simultaneously, yet all these technology all exist decoder-side wrong problem to occur.
By using the source decoder, data transmit maximum information through overcompression by the position of consumes least number, use channel encoder subsequently, and it tends to maximize at the given error probability in receiving these ability of send channel.
Chnnel coding, for example the Reed-Solomon coding is used to improve the robustness of source coded data.Joint source-channel coding method has been used for providing to the source coded data of the important level with variation the error protection grade of variation, or enables the rate adapted of coding video frequency data to available network bandwidth by cutting apart with discarded packets.This is because common host-host protocol does not transmit corrupt data to the source decoder.
The source code technology of for example reversible variable length code (for example, in MPEG-4) is used for mistake and recovers by with reversed order bag being decoded when damaging bag in actual reception.In the code efficiency of the source code technology that is converted to decoded video quality at given bit rate, exist compromise.
The hybrid coding standard, for example MPEG-1, MPEG-2, MPEG-4 (being referred to as MPEG-x), H.261, H.262, H.263 and H.264 (be referred to as H.26x) synchronous points again used in the bit stream main method as the mistake of handling the decoder place.
Can causing surpassing initially, another reason of the data degradation of damage is because the emulation of incorrect code word.The identification of initial bit mistake position is not loaded down with trivial details task, and normally impossible under the situation of the particular design of the identification of not supporting MAC layer or physical layer component meta errors present.Therefore, damage in case detect bit stream, decoder may must stop decoding and move forward in bit stream finding next synchronous points again, and must skip a large amount of possible intact data during the course.Although the emulation of the different code word identical with original (that is, credible) codeword length may think with respect to the process of above-mentioned incident it is not problem, in fact situation is not like this.Exist many modes of failure that this type of mistake may cause the correct bit stream decipher of decoder.For instance, in the current codec of majority, in bit stream, exist its value to influence the object (compression relevant parameter) of the sentence structure of following part of bit stream.Therefore, the incorrect value of this object can cause incorrect bit stream decipher.
Because normally used variable packet length in the hybrid coding standard, the necessary information of the bag of decoding variable length (for example, packet length and/or synchronizing information) must be transmitted into decoding device, so that be correctly decoded bit stream.Because the header information that common host-host protocol depends on various layer (for example, transport layer header and/or layer, sync header) transmit this necessary variable packet length and/or synchronizing information, so having limited capability, the source decoder handles wrong bit stream, wherein discarded packets and be the most common solution again synchronously.Need a kind of to the improving one's methods that the bit-errors of propagation and data degradation handles that lead to errors of the problem owing to for example synchronization loss and the emulation of error code word.
Summary of the invention
A kind of method of handling multi-medium data is provided.Described method comprises and receives the catalogue that described multi-medium data and generation comprise at least a portion of the header information that is associated with described multi-medium data.In some respects, described method further comprises the described multi-medium data of emission and launches described catalogue.
A kind of processor that is used to handle multi-medium data is provided.Described processor is configured to receive the catalogue that described multi-medium data and generation comprise at least a portion of the header information that is associated with described multi-medium data.In some respects, described processor also is configured to launch described multi-medium data and launches described catalogue.
A kind of equipment that is used to handle multi-medium data is provided.Described equipment comprises: receiver, in order to receive described multi-medium data; And generator, comprise the catalogue of at least a portion of the header information that is associated with described multi-medium data in order to generation.In some respects, described equipment also comprises reflector, in order to launch described multi-medium data and described catalogue.
A kind of equipment that is used to handle multi-medium data is provided.Described equipment comprises: the device that is used to receive described multi-medium data; And the device that is used to produce the catalogue of at least a portion that comprises the header information that is associated with described multi-medium data.In some respects, described equipment also comprises the device that is used to launch described multi-medium data and described catalogue.
A kind of computer-readable media that comprises the method for handling multi-medium data is provided.Described method comprises and receives the catalogue that described multi-medium data and generation comprise at least a portion of the header information that is associated with described multi-medium data.In some respects, described method also comprises described multi-medium data of emission and the described catalogue of emission.
A kind of method of handling multi-medium data is provided.Described method comprises receiving multimedia data stream; And the catalogue that receives at least a portion that comprises the header information that is associated with described multimedia data stream.In some respects, described method also comprises and uses described catalogue that the part of described multimedia data stream is decoded.
A kind of processor that is used to handle multi-medium data is provided.The catalogue that described processor is configured to receiving multimedia data stream and receives at least a portion that comprises the header information that is associated with described multimedia data stream.In some respects, described processor also is configured to use described catalogue that the part of described multimedia data stream is decoded.
A kind of equipment that is used to handle multi-medium data is provided.Described equipment comprises: receiver, in order to receiving multimedia data stream and comprise the catalogue of at least a portion of the header information that is associated with described multimedia data stream in order to reception; And memory, in order at least a portion of the catalogue of storing described reception.In certain aspects, described equipment also comprises decoder, in order to use described catalogue at least a portion of described multimedia data stream is decoded.
A kind of equipment that is used to handle multi-medium data is provided.Described equipment comprises the device that is used for receiving multimedia data stream and is used to receive the catalogue of at least a portion that comprises the header information that is associated with described multimedia data stream; And the device that is used to store at least a portion of described catalogue.In some respects, described equipment also comprises and is used to the device that uses described catalogue that at least a portion of described multimedia data stream is decoded.
A kind of computer-readable media that comprises the method for handling multi-medium data is provided.The catalogue that described method comprises receiving multimedia data stream and receives at least a portion that comprises the header information that is associated with described multimedia data stream.In some respects, described method also comprises and uses described catalogue that the part of described multimedia data stream is decoded.
Description of drawings
Fig. 1 is the explanation that is used to flow the communication system example that video transmits.
Fig. 2 is the block diagram that is used for dividing at the encoder apparatus 105 of Fig. 1 and decoder device 110 the multi-layer protocol storehouse example of tasks.
Fig. 3 is the flow chart that explanation is used to handle the method example of streamed multimedia data.
Fig. 4 is the explanation of multilayer packetize scheme case.
Fig. 5 is the flow chart that explanation is used to handle the method example of streamed multimedia data.
Fig. 6 shows that explanation is used to handle the block diagram of the device instance of multi-medium data.
Fig. 7 shows that explanation is used to handle the block diagram of another example of the equipment of multi-medium data.
Embodiment
A kind of method and apparatus that improves the anti-mistake of bag in the decoding multimedia data flow is described.Encoder apparatus can be discerned the header information that various bags that one or more layers with multimedia data stream contain in (for example, transport layer and/or layer, sync) are associated.Header information can comprise the position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate of another header in the size, packet number, bag or the many bags that are associated in one group of bag.The catalogue of header information produces and is transmitted under the situation that decoder is lost in emission for some original header informations in data flow or receive mistakenly and uses.In some respects, by for example launching the catalogue that contains header information with the communication link that emission contains the different channel of the communication link of packet of original header.Therefore, the decoder that receives catalogue can use header information to locate packet in institute's receiving multimedia data stream.Receive under the situation of erroneous packets the data that decoder can use the catalogue header information to assist recovery originally will lose at decoder.In the following description, provide detail so that the detailed understanding to embodiment to be provided.Yet, be understood by those skilled in the art that not have implementing embodiment under the situation of these details.For instance, in block diagram, electric component can be showed so that in unnecessary details, do not obscure embodiment.In other example, but these assemblies of detail display, other structure and technology, with further explanation embodiment.The those skilled in the art should also be clear that the electric component that is shown as independent piece can rearrange and/or be combined as an assembly.
Be also noted that some embodiment can be described to a process, it is depicted as flow chart, flow graph, structure chart or block diagram.Although flow chart can be described as operation process in proper order, many operations can walk abreast or carry out simultaneously, and process can repeat.In addition, can rearrange the order of operation.Process stops when the operation of process is finished.Process can be corresponding to method, function, program, subroutine, subprogram etc.When process during corresponding to function, it stops corresponding to function returning to call function or principal function.
Fig. 1 is the explanation that is used to transmit the communication system example that flows video.System 100 comprises encoder apparatus 105 and decoder device 110.For example the communicator of encoder apparatus 105 and decoder device 110 can use the multi-layer protocol storehouse of the task that is used to distribute.Upper component in encoder apparatus 105 and the decoder device 110 can comprise a plurality of application, for example video or audio coder and/or decoder.Some embodiment can comprise a plurality of information flows that will decode simultaneously.Also can in upper component, carry out the synchronous task of a plurality of streams in these cases.In encoder apparatus 105, upper component can provide by the encoded timing information in the bit stream of wireless network and/or cable network 150 emissions.In decoder device 110, upper component can be resolved a plurality of information flows, makes the application that is associated roughly decode to it simultaneously.
Lower layer components in the encoder apparatus 110 can comprise the various schemes that anti-mistake is provided.The channel of easily makeing mistakes for example wired and/or wireless network 150 can be introduced mistake the bit stream that is received by decoder device 110.The anti-mistake scheme of these that provide in the lower layer components can comprise other known scheme of one or more error control coding schemes, interlace scheme and those skilled in the art.Lower layer components in the decoder device 110 can comprise the corresponding decoded in error assembly that can detect with error recovery.By some wrong may corrections wired and/or that wireless network 150 is introduced by the lower layer components of decoder device 110.For uncorrectable those mistakes, the lower layer components of for example asking encoder apparatus 105 concerning the solution of the re-transmission of broken parts for some situation may and infeasible.
Fig. 2 is the block diagram that is used at the multi-layer protocol storehouse example of encoder apparatus 105 and decoder device 110 division tasks.The upper component of encoder apparatus 105 is distributed in one or more in application layer 206 and the layer, sync 207.The lower layer components of encoder apparatus 105 is distributed in one or more in transport layer 216, stream and/or medium access control (MAC) layer 217 and the physical layer 218.Similarly, the upper component of decoder device 110 is distributed in one or more in application layer 211 and the layer, sync 212.The lower layer components of decoder device 110 is distributed in one or more in transport layer 221, stream and/or medium access control (MAC) layer 222 and the physical layer 223.The those skilled in the art will be familiar with these layers and be familiar with the distribution of various tasks therebetween.
Referring to Fig. 1 and 2, encoder apparatus 105 further comprises header information identifier 115, header catalogue generator 120, multimedia coding device 125, memory assembly 130, processor 135 and receiver/transmitter 140.The integrated operation of processor 135 general control exemplary encoder device 105.
Header information recognizer component 115 identification about the multi-medium data packetize for example about the information in the header of each communication layers.In some instances, the header information that is added by each layer coder to the small part use various levels execution packetizes divide (parsing) a plurality of data flow and decoding in cataloged procedure with permission during is recombinated.For instance, layer, sync 207 can be added the header information of the polytype bag of identification, and described polytype bag is linked with a plurality of decoder component that can decode to the polytype bag simultaneously.The layer, sync header information can comprise the field of recognition data sequence time, data sequence duration, destination decoder component (for example, audio frequency, video and closed-caption), frame number, packet number and out of Memory.The layer, sync bag can have variable-length in some instances.This may be the cause owing to the various encoding schemes of the digital compression scheme that for example comprises the variable length code scheme.
Can comprise the regular length bag that for example can in transport layer 216, utilize by the bag of other type of header information identifier 115 identification.The transport layer bag can have regular length, so that support other scheme of various error coded schemes, modulation scheme and use regular length bag.The transmission header can contain the information of identification from the number of the transport layer bag of single layer, sync bag parsing.If the layer, sync packet length is variable, the number of transport layer bag that needs to contain data so is variable equally.
Header information identifier 115 also can be discerned the information of discerning the length (being unit with position or byte for example) of each bag for decoder.Because some bags have variable-length, and even can have different length from the regular length bag of homology not, therefore may need packet length to come the reconstruct bag.According to the character of packet length information, wrap in position (position that for example, has some transport layer bags of big layer, sync bag) in another bag and also can (for example use the bag size information of accumulation) indirectly and determine or directly definite.Hereinafter will discuss the details how decoder can use the various forms of header informations of being discerned by header information assembly 115.
Header catalogue generator 120 obtains by at least some information of header information identifier 115 identifications and produces catalogue.Catalogue can comprise the relevant header information of each layer with for example application layer 206, layer, sync 207, transport layer 217 and other layer.Information can be used for recovering from various mistakes by decoder device, comprise the erroneous packets that identification error receives size, discern next available packages so that synchronous again etc.Header information from the header catalogue can be used for losing or wrong original header information in the replacement data stream.
Multimedia coding device 125 can comprise sub-component, comprises the transformer/quantizer assembly that video (or audio frequency or closed captioned test) data of (for example frequency domain under DCT (discrete cosine transform) situation) from spatial domain to another territory are carried out conversion and/or quantification.The multimedia coding device also can comprise the entropy coder assembly.The entropy coder assembly can use context-adaptive variable length code (CAVLC).Coded data can comprise quantized data, transform data, packed data or its any combination.Memory assembly 130 is used for stored information, original video data for example to be encoded, armed encoded video data, header information, header catalogue or the intermediate data of being operated by each encoder component.
In this example, receiver/transmitter assembly 140 contains circuit and/or the logic that is useful on from external source 145 reception data to be encoded.External source 145 can for example be external memory storage, internet, live video and/or audio feed, and the reception data can comprise wired and/or radio communication.Reflector 140 also contains circuit and/or the logic by network 150 emission (Tx) coded datas, for example reflector.Network 150 for example can be the wired system of phone, cable and optical fiber or the part of wireless system.Under the situation of wireless communication system, network 150 can comprise for example part of code division multiple access (CDMA or CDMA2000) communication system, perhaps system can be frequency division multiple access (FDMA) system, OFDM (OFDMA) system, for example be used for GSM/GPRS (the GPRS)/EDGE (strengthening the data gsm environment) of service trade or time division multiple access (TDMA) system of TETRA (terrestrial trunked radio) mobile phone technology, Wideband Code Division Multiple Access (WCDMA) (WCDMA), high data rate (1xEV-DO or the multicast of 1xEV-DO gold) system, or adopt any wireless communication system of technical combinations usually.
Launch data and can comprise a plurality of bit streams, for example video, audio frequency and/or closed-caption.Launch at least a portion that data also comprise the header catalogue in some instances.Go up launching dart head record at the different channels (virtual or actual) different in some instances with the channel of a plurality of bit streams of emission.
It should be noted that to be task of explanation, encoder apparatus 105 is a simplified example.Therefore, one or more elements of the encoder apparatus shown in Fig. 1 and/or 2 105 can omit, rearrange and/or make up.For instance, processor module 135 can be in the outside of encoder apparatus 105.
Decoder device 110 contains and encoder apparatus 105 similar assemblies, comprises header information identifier 155, bag locator 160, multimedia decoder 165, memory assembly 170, marker 172, receiver 175, processor 180 and resolver 182.Decoder device 110 receives the encoded multi-medium data that passes through network 150 or launch from external memory 185.Receiver 175 contains circuit and/or the logic that is useful in conjunction with network 150 reception (Rx) coded datas, and is used for from the logic of external memory 185 received code data.External memory 185 can be for example external RAM or ROM, or remote server.Except receiving the multimedia bit stream, receiver 175 can be received in the header catalogue that produces in the header catalogue generator 120.
Multimedia decoder 165 contains and is useful on circuit and/or the logic that encoded multimedia bit stream that butt joint receives is decoded.The sub-component of multimedia decoder 165 can comprise dequantization component, inverse transform component and various error recovery component.The correct bag that receives can be by the corresponding assembly decoding of application layer 211.Error recovery component can comprise lower floor's error detection and proofread and correct assembly (for example Reed-Solomon coding and/or Turbo coding), and is used to replace and/or the upper strata mistake of hiding the data that can not be proofreaied and correct by layer method is down recovered and/or error concealing.Various error recovery component can be benefited from the information that contains in the header catalogue that the header catalogue generator 120 by encoder apparatus 105 produces.The sub-component of multimedia decoder 165 can reside in application layer 211, layer, sync 212, transport layer 221, stream/MAC layer 222, physical layer 223 or its combination.
Header information identifier 155 contains circuit and/or the logic that is useful on the identification information (for example, header information) that contains in the header catalogue that receives.When decoder device 110 receives wrong bag, can be used for discerning the information of the position of the subsequent packet in the bit stream in the header information identifier 155 identification header catalogues.Header information in the header catalogue also can be used for replacing the wrong header information that receives in the erroneous packets, or locatees and remove the header that mistake unnecessary in the bag receives.Bag locator 160 contains circuit and/or the logic that is useful on the use header directory information localization package of discerning.In some instances, being positioned at higher level bag (for example, application layer bag) in the wrong lower-level bag (for example, transport layer and/or layer, sync bag) can be labeled as wrong.Marker 172 contains circuit and/or the logic that is useful on the marked erroneous bag.Because its position in another erroneous packets and the bag of possible errors, components in higher levels (for example, application layer component) can be done to make mistake and recover decision-making by mark.Application layer 211 assemblies can use header directory information and bag locator 160 to locate wrong application layer bag, to carry out the various wrong actions that recover.
Because decoder device 110 may receive a plurality of bit streams, therefore wrong bag may be arranged in a plurality of bit streams.Resolver 182 can be used for lower floor and layer, sync 212 to be sentenced and resolves correct that receive and bag mistake, and it is forwarded to suitable application layer 211 assemblies of multimedia decoder 165.In addition, also the header directory information of necessity can be forwarded to upper strata (for example, layer, sync 212 and/or application layer 211) from transport layer 221, the mistake that is used for bit stream with the bag that allows identification error is recovered and/or is synchronous again.Transport layer 221 removes the transport layer header information usually from the bag that is forwarded to the upper strata.
Multi-medium data through decoding can show with display module 190, be stored in the external memory 185 or be stored in the internal memory component 170.Display module 190 can be the integration section of decoder device 110.Display module 190 contains for example part of video and/or audio viewing hardware and logic, comprises display screen and/or loud speaker.Display module 190 also can be external peripheral devices.In this example, receiver 175 also contains to be useful on the multi-medium data through decoding is sent to the logic of exterior storage assembly 185 or display module 190.
It shall yet further be noted that decoding device 110 is that simplified example is to be used for task of explanation.Therefore, one or more elements of the decoder device shown in Fig. 1 and/or 2 110 can omit, rearrange and/or make up.For instance, processor 180 can be in the outside of decoder device 110.
Fig. 3 is the flow chart that explanation is used to handle the method example of streamed multimedia data.Method 300 is to produce to comprise and be used for the method for decoder with the catalogue of the header information that improves anti-mistake.Method 300 is by beginning at state 305 place's receiving multimedia data bit streams.A plurality of bit streams (for example, video, audio frequency and/or closed captioned test) can be included in the single bit stream.For example the receiving system of the receiver/transmitter 140 of Fig. 1 can receive the multimedia bit stream at state 305 places.
After state 305 places receive bit stream, the header information that method is associated with multi-medium data in the bit stream in the identification of optional state 310 places.As discussed above, header information can comprise the information from a plurality of layers.Fig. 4 shows the explanation of multilayer packetize scheme case.In this example, application layer bag 405A and 405B can be the bag of fixing and/or variable-length.Layer, sync is added layer, sync header (header synchronously) 410 to each application layer bag 405A and 405B, thereby obtains layer, sync bag 406A and 406B (layer, sync bag 406A among Fig. 4 and 406B comprise layer, sync header 410 and application layer bag 405A and 405B respectively).Layer, sync bag 406A and 406B then are imported into transport layer.In this example, the transport layer bag has regular length.Transport layer is decomposed into part corresponding to transport layer bag size with the layer, sync bag, and transport layer header 415 is added to the transport layer bag of gained.In this example, will comprise that the layer, sync bag 406A of application layer bag 405A is split into two transport layer bag 420A and 420B, and wherein wrap 420B and comprise the remainder 425B of layer, sync bag 406A and the 425C of first of layer, sync bag 406B.In this example, add extra transport layer header 415 the part 425C of transport layer bag 420B to, it is before the beginning of next layer, sync bag 406B.The 3rd transport layer bag 420D contains the next part 425D of layer, sync bag 406B.
Layer, sync header 410 and transport layer header 415 can contain at making can the recombinate similar information of layer, sync bag and application layer bag of decoder.Header can contain the information of the number of related bag in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and/or the group of for example wrapping header in size, packet number, the bag.In addition, header information can comprise the stream identifying information, and it is identified as the association bag and belongs to video bit stream, audio bit stream and/or closed-caption bit stream.
For example the recognition device of the header information identifier 115 of Fig. 1 can be at the header information in the optional state 310 places identification multimedia bit stream.
Method 300 is followed at state 315 places based on being at least a portion of the header information of discerning in the multimedia bit stream and producing the header information catalogue at state 310.Catalogue can contain relevant for the information from a plurality of layers header and other type header of for example application layer, layer, sync and/or transport layer.The information that contains in the catalogue can be used with the location by decoder and contain packet boundary in the bit stream of misdata, replaces the header information of losing and/or remove wrong header information.
In some instances, the header information catalogue contains the information on the border of discerning each bag, and wherein said bag can be from arbitrary layer (for example, emission, synchronously, use or its combination).The header information of bag can be discerned layer, the described bag of described header correspondence and be positioned at the out of Memory big or small and that as above discuss of any other bag of described bag.In other example, the independent catalogue or the different piece of catalogue can be at independent layers (for example, transport layer catalogue, layer, sync catalogue etc.).
Now will discuss the example of the transport layer catalogue that produces at state 315 places.Layer, sync of describing among this case representation Fig. 4 and transport layer relation.At some examples of an example for example shown in Figure 4 (for example, has regular length transport layer bag (promptly, 122 byte/bags) system), each transport layer header is regular length (for example, byte is long) and occurs at the place that begins of each transport layer bag at least.The form of header can comprise END FLAG field, and wherein END FLAG field can be 1 flag, and it can be set at 1 when current bag is the latter end of layer, sync bag, otherwise can be set at 0.The transport layer header also can comprise the BYTE_OFFSET field, it can indicate the employed byte number of latter end of layer, sync bag, and (this also indicates the place that can find next transport layer header, as shown in Figure 4, wherein the second transport layer header 415 among the transport layer bag 420B between packet portion 425B and 425C).If the transport layer bag is less than 128 bytes, 7 BYTE_OFFSET field can be enough so.If there is not extra transmission header in the current transmission layer bag, the BYTE_OFFSET field can be set at the length of transport layer bag so.
The catalogue that produces with this transmission header information can comprise the field of listing in the table 1.
Table 1
Field name Field description
NUMBER_OF_PACKETS The number of the bag of listing in this header directory listing
(NUMBER_OF_PACKETS-1) record of type subsequently
PACKET_OFFSET The next one is unwrapped the number of the byte at beginning place
BYTE_OFFSET The number of the byte that another bag and/or bag header begin to locate in the current bag
The number of the bag of containing by header catalogue message (that is the trailer record of PACKET_OFFSET and BYTE_OFFSET) that the NUMBER_OF_PACKETS field is represented to send in the bit stream.The PACKET_OFFSET field entries is pointed to the next one bag in the bag group.PACKET_OFFSET can be the many bytes on arrival end-of-packet border or the data unit of position or other number.The BYTE_OFFSET field is used for the unnecessary transport layer header in the localization package, for example transport layer packet portion 425B among Fig. 4 and the transport layer header 415 between the 425C.In this example, the effective range of BYTE_OFFSET is 1 to 121.If can occur unnecessary transport layer header more than in the single transport layer bag, can use another field that defines BYTE_OFFSET number of entries in the single bag so.In some instances, PACKET_OFFSET and/or BYTE_OFFSET value be for accumulation, and be illustrated in the bit stream from the distance of the bag header position reach of last location, and it comprises all previous reaches.
Field big or small predeterminable or variable.For instance, the NUMBER_OF_PACKETS field can be limited to single byte, can represent the group of the bag of 255 serial numbers at the most in the case before field repeats.Therefore, if possible need transport layer bag more than 255 to cooperate the data (using exemplary parsing shown in Figure 4) of single layer, sync bag, may need more position so.Catalogue can contain as shown in table 1 at one group in the group of entries of predetermined associated packet group.For instance, each bag of information representation can be included in the single video data group of a frame for example or a fragment in the table 1.And audio frequency or closed-caption bit stream can have the independent catalogue that contains similar field.
In being similar to this example with constant transmissions layer header, upper component (for example, layer, sync and/or application layer) can use this known fixed-header size to come when transmitting, to peel off header, and correspondingly adjust PACKET_OFFSET and BYTE_OFFSET clauses and subclauses in the header catalogue.
Now will discuss the example of the layer, sync header catalogue that produces at state 315 places.In this example, single layer, sync bag (for example, layer, sync header 410 and application layer bag 405A) contains video, audio frequency and/or the closed-caption data of Frame.Other data group of cutting apart (for example, the part of frame) also can be included in the layer, sync bag.Layer, sync header catalogue can comprise the similar field of listing with above table 1 of those fields.Yet wrap in this example, and the header that is associated is represented layer, sync bag and header.The layer, sync bag will be made of the many transport layer bags that also are called piece (the transmission header is peeled off).List the example of layer, sync header category field in the table 2.
Table 2
Field name Field description
NUMBER_OF_PACKETS The number of the layer, sync bag of listing in this header directory listing
(NUMBER_OF_PACKETS-1) record of type subsequently
BLOCK_OFFSET Next layer, sync is unwrapped the number of the transport layer bag (piece) at beginning place
BYTE_OFFSET Unwrap the number of the byte at beginning place in the transport layer bag by next layer, sync of BLOCK_OFFSET indication
The NUMBER_OF_PACKETS field is represented the number of the transport layer bag contained by the trailer record of BLOCK_OFFSET and BYTE_OFFSET.In addition, the number of the transport layer bag in NUMBER_OF_PACKETS field video, audio frequency and/or the closed-caption Frame also representing to show simultaneously.In the fixed-size example of transport layer bag, so wrap the number that number is known the position of reach by specifying in the example.The BLOCK_OFFSET field is pointed to next the layer, sync bag (with next the multimedia frame in this example) in the layer, sync bag group of being contained.Layer, sync bag group can be the frame of predetermined number.BLOCK_OFFSET also can be the data unit of many bytes or position or other number.Locate it when the BYTE_OFFSET field is used in the transport layer bag next layer, sync bag taking place and begin, for example be included in the part 425C of the beginning that comprises the second layer, sync bag 406B (comprising synchronous header 410 and application layer bag 405B) among the transport layer bag 420B shown in Figure 4.In some instances, the BLOCK_OFFSET value is accumulated, and is illustrated in the bit stream from the number of the transport layer bag of the piece position reach of last location, and it comprises all previous reaches.
Field big or small predeterminable or variable.For instance, the NUMBER_OF_PACKETS field can be limited to single byte, can represent the group of the transport layer bag of 255 serial numbers at the most in the case before field repeats.Therefore, if possible need transport layer bag more than 255 to cooperate the data (using exemplary parsing shown in Figure 4) of single layer, sync bag, may need more position so.Catalogue can contain as shown in table 1 at one group in the group of entries of predetermined associated packet group.For instance, each represented bag of the information in the table 1 can be included in the single video data group of a frame for example or a fragment.And audio frequency or closed-caption bit stream can have the independent catalogue that contains similar field.
Except the data that contain in the table 2, layer, sync header catalogue or the message that contains the header directory information of table 2 also can comprise one or more in the layer, sync header category field that table 3 lists.
Table 3
Field name Field description
MESSAGE_ID Be used for the field that Indication message is a layer, sync catalogue message
STREAM_ID The field of the type of the application (for example, audio frequency, video and/or closed-caption) that identification is associated with the header directory information
SIZE_OF_BLOCK_OFFSET The number that is used for the position of BLOCK_OFFSET field shown in the expression table 2
SEQUENCE_TIME The field that specify to show the sequence time of the frame that bag that group thus contains is represented.
FRAME_NUMBER Discern the unique frame number in audio frequency, video and/or the closed-caption sequence of other frame.
ENHANCEMENT_FLAG Send this frame and relate to the signal that video CODEC basic unit still is enhancement layer (for example, in the multi-layer coding scheme).
RAP_FLAG Whether this field indication frame subsequently is the random access frame (for example, intra coded frame) that is used for obtaining again bit stream.
FRAME_RATE In the system that frame rate can dynamically change, when this field can indicate display frame to decoder.
UNREFERENCED_FRAME_FLAG Whether send frame is the signal of reference frame, (for example, the indication frame in the reconstruct of one or more other frames whether
Field name Field description
With for referencial use).
RESERVED For the byte alignment of header provides the reservation of filling up position.
The generation device of header catalogue generator for example shown in Figure 1 can produce the header information catalogue at state 315 places.
Method 300 proceeds to the wherein optional state 320 of transmitting multimedia data stream.Discuss about Fig. 1 as mentioned, can pass through wired and/or wireless network 150 transmitting multimedia datas.In this example, in the optional state 325 launching dart heads of place record.In some instances, the transmission of the transmission of state 320 place's multi-medium datas and state 325 place's header catalogues is finished by independent channel.This can finish so that different error protection grades is provided or the channel diversity is provided, and it can improve the anti-mistake at receiver place.In some instances, can transmit the one or both in (being respectively state 320 or 325) multimedia data stream or the header catalogue by pseudo channel.Pseudo channel can provide to a certain degree the degree of freedom so that the error protection that can adjust separately at multi-medium data and header catalogue to be provided.The emitter of receiver/transmitter 140 for example shown in Figure 1 can flow at optional state 320 place's transmitting multimedia datas, and in the optional state 325 launching dart heads of place record.
It should be noted that in the piece illustrated in the flow chart shown in Figure 3 any one can omit, rearrange order or with one or more other pieces combinations.
Fig. 5 is the flow chart that explanation is used to handle the method example of streamed multimedia data.Method 500 can be carried out by decoder device shown in Figure 1 110.Method 500 explanations are to the use of the header information catalogue of use said method 300 generations, to improve the anti-mistake in the decoder device 110.Decoder device 110 receives the multimedia data stream that comprises video, audio frequency and/or closed-caption data at state 505 places.Data can be encoded as mentioned above, wherein coded data packet content data, transform data, packed data and combination thereof.Multi-medium data can comprise packetized data, wherein can carry out packetize in a plurality of levels.The receiving system of receiver 175 for example shown in Figure 1 can be at state 505 place's receiving multimedia datas.
Decoder device 110 also receives the header information catalogue at state 510 places.In the one or more message during the header information catalogue can be comprised in and comprise in the above table 1,2 and 3 institute's field of showing and describing.Can in unitary part, receive catalogue, transport layer header catalogue that example is as shown in table 1 and the layer, sync header catalogue shown in table 2 and 3.Can receive the header information catalogue by the channel identical with receiving multimedia data (505).Can receive the header information catalogue by the channel different with receiving multimedia data.In some instances, can receive the one or both in (respectively at state 505 and 510 places) multi-medium data and the header information catalogue by pseudo channel.After receiving the header information catalogue, can be at state 510 places in the header information catalogue some or all be stored in the memory.The memory module 180 for example shown in Figure 1 or the memory storage apparatus of outer memory module 185 are used in state 510 places storage header information catalogue.
At optional state 515 places, after receiving multimedia data, decoder device 110 can detect and proofread and correct the mistake of introducing bit stream during launching by network 150.Can use the known various error detection of those skilled in the art and correcting scheme detects and error recovery.Some mistakes may be uncorrectable, and the bag that may lead to errors.Can come the bag of mark (being wrong value for example) mistake by the labelling apparatus of marker for example shown in Figure 1 172 by a field being set at the indication bag.Erroneous packets is labeled as mistake makes upper component more easily identification error bag and initial error recovery scheme.Under without any the situation of label information, also can in the upper strata, erroneous packets be identified as mistake.
At optional state 520 places, will correctly wrap with erroneous packets and be forwarded to upper strata (for example, layer, sync and application layer).Except the repeating multimedia packet, also transmit the header information catalogue when needed or make it can be used for the upper strata at least.The multimedia bag that is forwarded to the upper strata may be peeled off one or more lower floor's headers, and can revise header directory information the removing with reflection lower floor's header that relates to the bag size.
Decoder device 110 is decoded to the multi-medium data bag of correct reception at state 525 places.Decoding can comprise de-quantization, inverse transformation, decompression and combination thereof.The multi-medium data bag can be arranged in a plurality of bit streams (for example, video, audio frequency and/or closed-caption) that can decode simultaneously and play.Owing to transmit erroneous packets at state 520 places, therefore decoding may postpone, till the mistake of decoding is recovered and/or can be carried out synchronously again.
When running into misdata, the header directory information can be used for discerning indivedual subsequent packet (by identification packet boundary position), and may discern the application layer component that bag is gone to, so that recover preferably from misdata.The header information that decoder device 110 contains in the header information catalogue that optional state 530 places discern with erroneous packets in the bit stream is associated.Then decoder device 110 for example uses the PACKET_OFFSET information that contains in the header catalogue to locate the bag of being discerned at optional state 535 places, to be advanced to the subsequent packet in the bit stream.Can be when running into mistake arbitrary layer that comprises transport layer, layer, sync and the application layer identification of locating executing state 530 places.
Referring to Fig. 4, suppose that the second transport layer bag 420B (comprising part transport layer packet portion 425B and 425C) is wrong.Because its mistake, so decoder may not know to be positioned at the middle unnecessary transport layer header 415 of transport layer bag 420B.As above discuss, unnecessary transport layer header 415 is the beginnings that comprise the second layer, sync bag 406B of synchronous header 410 and application layer bag 405B.By using the header information catalogue, can be by discern the position of unnecessary transport layer header 415 referring to the BYTE_OFFSET field (shown in the table 1) of the header information record that is associated with erroneous transmissions layer bag 420B.Then transport layer is located the transport layer bag of unnecessary transport layer bag header and parse error at state 535 places, peels off the transport layer header and described two layer, sync bags (all being labeled as mistake) are forwarded to layer, sync.Then layer, sync can be used the information Recognition application layer component shown in table 2 and 3, is forwarded to its suitable application layer component with application layer bag 405A and 405B with mistake.The resolver of resolver 182 for example shown in Figure 1 can be carried out above-mentioned parsing.
So in the example, when the information of example STREAM_ID as shown in table 3 was included in the header information catalogue, the identification at state 530 places can occur in the layer, sync place to small part.But mark several applications layer bag also is forwarded to application component with it, locates it with decoded at this.In other example, the catalogue header information can be transmitted the application layer component of the location that (and may through adjusting to reflect removing of any lower floor header data) wrap to the identification that can carry out header information and state 535 places.The catalogue header information that a bag (or a plurality of bag) after the recognition device of header information identifier 155 for example shown in Figure 1 can be discerned (530) and be positioned at misdata is associated.The positioner of bag locator 160 for example shown in Figure 1 can be in location, state 535 places subsequent packet.
At identification catalogue header information and after locating one or more subsequent packet, but method 500 execution errors recover to recover erroneous packets at optional state 540 places and/or to restart the decoding at subsequent packet place.Application layer component can utilize the bag through identification and location to improve its error recovery scheme.In some instances, the bag through identification and location can be faultless, and decoder can continue the bag that uses the header directory information to be obtained is decoded.Only can discern the zone errors that originally position (under the situation of variable length packets) of disabled bag be can be used for discerning bit stream.By discerning these zones, the some parts that is positioned at misdata data afterwards that originally may abandon in the bit stream may be able to be preserved and/or replace to error recovery method.
It should be noted that in the piece illustrated in the flow chart shown in Figure 5 any one can omit, rearrange order or with one or more other pieces combinations.
Example provides a kind of equipment that is used to handle multi-medium data.Described demonstration equipment comprises the device that is used for receiving multimedia data, and the device that is used to produce catalogue, and wherein catalogue comprises at least a portion of the header information that is associated with multi-medium data.The device that is used for receiving multimedia data can comprise the receiver/transmitter 140 of Fig. 1.The device that is used to produce catalogue can comprise the header catalogue generator 120 of Fig. 1.
Example provides a kind of equipment that is used to handle multi-medium data.Described demonstration equipment comprises the device that is used for receiving multimedia data stream and is used to receive the catalogue of at least a portion that comprises the header information that is associated with multimedia data stream.Demonstration equipment also comprises the device of at least a portion that is used for storage directory.The device that is used to receive can comprise the receiver 175 of Fig. 1.The device that is used for storage directory can comprise the memory module 170 of Fig. 1.
Fig. 6 shows that explanation is used to handle the block diagram of the device instance of multi-medium data.The demonstration equipment 600 of Fig. 6 comprises the device that is used for receiving multimedia data, and the device that is used to produce catalogue, and wherein catalogue comprises at least a portion of the header information that is associated with multi-medium data.The device that is used for receiving multimedia data can comprise the receiver 605 of Fig. 6.The device that is used to produce catalogue can comprise the header catalogue generator 610 of Fig. 6.
Fig. 7 shows that explanation is used to handle the block diagram of the device instance of multi-medium data.Described demonstration equipment comprises the device that is used for receiving multimedia data stream and is used to receive the catalogue of at least a portion that comprises the header information that is associated with multimedia data stream.Demonstration equipment also comprises the device of at least a portion that is used for storage directory.The device that is used to receive can comprise the receiver 705 of Fig. 7.The device that is used for storage directory can comprise the memory stores module 710 of Fig. 7.
Describe the example that above provides about header and header information, wherein header has been depicted as the front portion that is in bag.It should be noted that header information can be arranged in bag or from other position of independent bit stream of bag.
Be understood by those skilled in the art that, can use in multiple different technologies and the skill any to come expression information and signal.For instance, data, instruction, order, information, signal, position, symbol and the chip that runs through possibility reference in the foregoing description content can be represented by voltage, electric current, electromagnetic wave, magnetic field or particulate, light field or particulate or its arbitrary combination.
The those skilled in the art will further understand, and various illustrative components, blocks, module and the algorithm steps of describing in conjunction with example disclosed herein can be embodied as electronic hardware, firmware, computer software, middleware, microcode or its combination.For this interchangeability of hardware and software clearly is described, above substantially according to its functional descriptions various Illustrative components, piece, module, circuit and step.With this type of functional hardware that is embodied as still is that software depends on the specific application and the design constraint of forcing on whole system.The those skilled in the art is at each application-specific, can various mode implements described functionally, but this type of implementation decision should not be interpreted as causing departing from the scope of institute revealing method.
Various illustrative components, blocks, assembly, module and the circuit of describing in conjunction with example disclosed herein can be used with lower device and implement or carry out: general processor, digital signal processor (DSP), application-specific integrated circuit (ASIC) (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components or its through design to carry out arbitrary combination of function as herein described.General processor can be a microprocessor, but in replacement scheme, processor can be arbitrary conventional processors, controller, microcontroller or state machine.Processor also can be embodied as the combination of calculation element, for example DSP and combination, a plurality of microprocessor of microprocessor, one or more microprocessors that combine the DSP core or any other this type of configuration.
The method of describing in conjunction with example disclosed herein or the step of algorithm can directly be implemented in hardware, implement in the software module of being carried out by processor, or implement in the two combination.Software module can reside in the medium of any other form known in RAM memory, flash memory, ROM memory, eprom memory, eeprom memory, register, hard disk, removable dish, CD-ROM or this technology.Exemplary storage medium is coupled to processor, makes processor and to write information to medium from read information.In replacement scheme, medium can be integral with processor.Processor and medium can reside in the application-specific integrated circuit (ASIC) (ASIC).ASIC can reside in the radio modem.In replacement scheme, processor and medium can be used as discrete component and reside in the radio modem.
The those skilled in the art provides the previous description content of revealed instance, so that can make or use institute's revealing method and equipment.The those skilled in the art will understand the various modifications to these examples easily, and the principle that this paper defined can be applicable to other example and can add extra element.
Therefore, described the method and apparatus that produces the header information catalogue that comprises the header information that is associated with the multimedia bit stream, and received and use the header information catalogue that the method and apparatus of the mismanage of multimedia bit stream is provided.

Claims (65)

1. method of handling multi-medium data, it comprises:
Receive described multi-medium data; And
Generation comprises the catalogue of at least a portion of the header information that is associated with described multi-medium data.
2. method according to claim 1, it further comprises:
Launch described multi-medium data; And
Launch described catalogue.
3. method according to claim 1, wherein said header information comprise one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
4. method according to claim 2 is wherein launched described multi-medium data and is comprised by first communication link emission, and wherein launches described catalogue and comprise by the second communication link and launching.
5. method according to claim 4, wherein said first or the second communication link comprise pseudo channel.
6. method according to claim 1, wherein said catalogue further comprise the bag in the described multi-medium data are identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
7. method according to claim 1, wherein said catalogue further comprises a plurality of records, wherein record comprises the information about the position of wrapping in the described multi-medium data.
8. method according to claim 1, it comprises that further emission identification contains the information of the message of described directory information.
9. processor that is used to handle multi-medium data, described processor is configured to:
Receive described multi-medium data; And
Generation comprises the catalogue of at least a portion of the header information that is associated with described multi-medium data.
10. processor according to claim 9, wherein said header information comprise one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
11. processor according to claim 9, wherein said catalogue further comprise the bag in the described multi-medium data is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
12. processor according to claim 9, wherein said catalogue further comprises a plurality of records, and wherein record comprises the information about the position of wrapping in the described multi-medium data.
13. an equipment that is used to handle multi-medium data, it comprises:
Receiver is in order to receive described multi-medium data; And
Generator comprises the catalogue of at least a portion of the header information that is associated with described multi-medium data in order to generation.
14. equipment according to claim 13, it further comprises:
Reflector is in order to launch described multi-medium data and described catalogue.
15. equipment according to claim 13, wherein said header information comprise one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
16. equipment according to claim 14, wherein said reflector is launched described multi-medium data by first communication link, and launches described catalogue by the second communication link, wherein said first or the second communication link comprise pseudo channel.
17. equipment according to claim 13, wherein said catalogue further comprise the bag in the described multi-medium data is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
18. equipment according to claim 13, wherein said catalogue further comprises a plurality of records, and wherein record comprises the information about the position of wrapping in the described multi-medium data.
19. equipment according to claim 14, wherein said reflector emission identification contains the information of the message of described directory information.
20. an equipment that is used to handle multi-medium data, it comprises:
Be used to receive the device of described multi-medium data; And
Be used to produce the device of the catalogue of at least a portion that comprises the header information that is associated with described multi-medium data.
21. equipment according to claim 20, it further comprises:
Be used to launch the device of described multi-medium data and described catalogue.
22. equipment according to claim 20, wherein said header information comprise one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
23. equipment according to claim 20, wherein said catalogue further comprise the bag in the described multi-medium data is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
24. equipment according to claim 20, wherein said catalogue further comprises a plurality of records, and wherein record comprises the information about the position of wrapping in the described multi-medium data.
25. equipment according to claim 21, wherein said emitter further comprise the device that is used to launch the information of discerning the message that contains described directory information.
26. a computer-readable media that comprises the method for handling multi-medium data, described method comprises:
Receive described multi-medium data; And
Generation comprises the catalogue of at least a portion of the header information that is associated with described multi-medium data.
27. computer-readable media according to claim 26, wherein said header information comprise one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
28. computer-readable media according to claim 26, wherein said catalogue further comprise the bag in the described multi-medium data is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
29. computer-readable media according to claim 26, wherein said catalogue further comprises a plurality of records, and wherein record comprises the information about the position of wrapping in the described multi-medium data.
30. a method of handling multi-medium data, it comprises:
Receiving multimedia data stream; And
Reception comprises the catalogue of at least a portion of the header information that is associated with described multimedia data stream.
31. method according to claim 30, it further comprises:
Use described catalogue that at least a portion of described multimedia data stream is decoded.
32. method according to claim 30, wherein said catalogue further comprises a plurality of records, and wherein record comprises the information about the position of wrapping in the described multimedia data stream.
33. method according to claim 32, it further comprises based on the bag in the described multimedia data stream in one or more location in described a plurality of institutes receiving record.
34. method according to claim 30, wherein said header information comprise one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
35. method according to claim 30 wherein receives described multimedia data stream and comprises by first communication link and receiving, and wherein receives described catalogue and comprise by the second communication link and receiving.
36. method according to claim 35, wherein said first or the second communication link comprise pseudo channel.
37. method according to claim 30, wherein said catalogue further comprise the bag in the described multimedia data stream is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
38. method according to claim 30, wherein said multimedia data stream comprise that in a plurality of bags and the described bag at least one is wrong, described method further comprises:
The part of the described directory information that identification is associated with described erroneous packets bag afterwards in the described multimedia data stream; And
The described subsequent packet in the described multimedia data stream is assigned to locate in the described identification part of use directory information.
39. according to the described method of claim 38, wherein said subsequent packet is positioned at described erroneous packets, described method further comprises:
Resolve described subsequent packet from described erroneous packets; And
The bag of described parsing is labeled as wrong.
40. a processor that is used to handle multi-medium data, described processor is configured to:
Receiving multimedia data stream; And
Reception comprises the catalogue of at least a portion of the header information that is associated with described multimedia data stream.
41. according to the described processor of claim 40, wherein said processor further is configured to:
Use described catalogue that at least a portion of described multimedia data stream is decoded.
42. according to the described processor of claim 40, wherein said catalogue further comprises a plurality of records, wherein record comprises the information about the position of wrapping in the described multimedia data stream, and wherein said in addition processor further is configured to based on one in the described bag in the described multimedia data stream in one or more location in described a plurality of institutes receiving record.
43. according to the described processor of claim 40, wherein said multimedia data stream comprises that in a plurality of bags and the described bag at least one is wrong, described processor further is configured to:
The part of the described directory information that identification is associated with described erroneous packets bag afterwards in the described multimedia data stream; And
The described subsequent packet in the described multimedia data stream is assigned to locate in the described identification part of use directory information.
44. according to the described processor of claim 43, wherein said subsequent packet is positioned at described erroneous packets, and described processor further is configured to:
Resolve described subsequent packet from described erroneous packets; And
The bag of described parsing is labeled as wrong.
45. an equipment that is used to handle multi-medium data, it comprises:
Receiver is in order to receiving multimedia data stream and comprise the catalogue of at least a portion of the header information that is associated with described multimedia data stream in order to reception; And
Memory is in order at least a portion of the catalogue of storing described reception.
46. according to the described equipment of claim 45, it further comprises:
Decoder is decoded at least a portion of described multimedia data stream in order to use described catalogue.
47. according to the described equipment of claim 45, wherein said catalogue further comprises a plurality of records, wherein record comprises the information about the position of wrapping in the described multimedia data stream.
48. according to the described equipment of claim 47, it further comprises in order to the locator based on one in the described bag in the described multimedia data stream in one or more location in described a plurality of institutes receiving record.
49. according to the described equipment of claim 45, wherein said header information comprises one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
50. according to the described equipment of claim 45, wherein said catalogue further comprises the bag in the described multimedia data stream is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
51. according to the described equipment of claim 45, wherein said multimedia data stream comprises that in a plurality of bags and the described bag at least one is wrong, described equipment further comprises:
Identifier is in order to discern the part of the described catalogue header information that is associated with the bag afterwards of erroneous packets described in the described multimedia data stream; And
Locator assigns to locate described subsequent packet in the described multimedia data stream in order to the described identification part of using the catalogue header information.
52. according to the described equipment of claim 51, wherein said subsequent packet is positioned at described erroneous packets, described equipment further comprises:
Resolver is in order to resolve described subsequent packet from described erroneous packets; And
Marker is labeled as wrong in order to the bag with described parsing.
53. an equipment that is used to handle multi-medium data, it comprises:
Be used for the device that receiving multimedia data flows and be used to receive the catalogue of at least a portion that comprises the header information that is associated with described multimedia data stream; And
Be used to store the device of at least a portion of described catalogue.
54. according to the described equipment of claim 53, it further comprises:
Be used to the device that uses described catalogue that at least a portion of described multimedia data stream is decoded.
55. according to the described equipment of claim 53, wherein said catalogue further comprises a plurality of records, wherein record comprises the information about the position of wrapping in the described multimedia data stream.
56. according to the described equipment of claim 55, it further comprises:
Be used for device based on the bag in the described multimedia data stream in one or more location of described a plurality of institutes receiving record.
57. according to the described equipment of claim 53, wherein said header information comprises one or more in the following: the related number that wraps in position, data sequence time, data sequence duration, frame time, frame number, random access point flag, frame rate and the group of header in bag size, packet number, the bag.
58. according to the described equipment of claim 53, wherein said catalogue further comprises the bag in the described multimedia data stream is identified as at least one stream identifying information in audio pack, video packets and the closed-caption bag.
59. according to the described equipment of claim 53, wherein said multimedia data stream comprises that in a plurality of bags and the described bag at least one is wrong, described equipment further comprises:
Be used for discerning the device of the part of the described directory information that the bag after the described erroneous packets with described multimedia data stream is associated; And
Be used for using the described identification part of directory information to assign to locate the device of the described subsequent packet of described multimedia data stream.
60. according to the described equipment of claim 59, wherein said subsequent packet is positioned at described erroneous packets, described equipment further comprises:
Be used for resolving the device of described subsequent packet from described erroneous packets; And
Be used for the bag of described parsing is labeled as wrong device.
61. a computer-readable media that comprises the method for handling multi-medium data, described method comprises:
Receiving multimedia data stream; And
Reception comprises the catalogue of at least a portion of the header information that is associated with described multimedia data stream.
62. according to the described computer-readable media of claim 61, wherein said method further comprises:
Use described catalogue that at least a portion of described multimedia data stream is decoded.
63. according to the described computer-readable media of claim 61, wherein said catalogue further comprises a plurality of records, wherein record comprises the information about the position of wrapping in the described multimedia data stream, and wherein said in addition method further comprises based on the bag in the described multimedia data stream in one or more location in described a plurality of institutes receiving record.
64. according to the described computer-readable media of claim 61, wherein said multimedia data stream comprises that in a plurality of bags and the described bag at least one is wrong, described method further comprises:
The part of the described directory information that identification is associated with described erroneous packets bag afterwards in the described multimedia data stream; And
The described subsequent packet in the described multimedia data stream is assigned to locate in the described identification part of use directory information.
65. according to the described computer-readable media of claim 64, wherein said subsequent packet is positioned at described erroneous packets, described method further comprises:
Resolve described subsequent packet from described erroneous packets; And
The bag of described parsing is labeled as wrong.
CNA2006800246838A 2005-05-13 2006-05-15 Improving error resilience using out of band directory information Pending CN101218798A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US68080905P 2005-05-13 2005-05-13
US60/680,809 2005-05-13
US60/789,454 2006-04-04

Publications (1)

Publication Number Publication Date
CN101218798A true CN101218798A (en) 2008-07-09

Family

ID=39624319

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2006800246838A Pending CN101218798A (en) 2005-05-13 2006-05-15 Improving error resilience using out of band directory information

Country Status (1)

Country Link
CN (1) CN101218798A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106576097A (en) * 2014-07-09 2017-04-19 高通股份有限公司 Error handling for files exchanged over a network

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106576097A (en) * 2014-07-09 2017-04-19 高通股份有限公司 Error handling for files exchanged over a network
CN106576097B (en) * 2014-07-09 2018-12-21 高通股份有限公司 For the error handle in the cocommutative file of network

Similar Documents

Publication Publication Date Title
KR100926017B1 (en) Improving error resilience using out of band directory information
US11895357B2 (en) Broadcasting signal transmission device, broadcasting signal reception device, broadcasting signal transmission method, and broadcasting signal reception method
KR101805537B1 (en) Broadcast signal transmitting apparatus, broadcast signal receiving apparatus, broadcast signal transmitting method and broadcast signal receiving method
US7586924B2 (en) Apparatus and method for coding an information signal into a data stream, converting the data stream and decoding the data stream
US7584495B2 (en) Redundant stream alignment in IP datacasting over DVB-H
KR100998454B1 (en) Error recovery using in band error patterns
US20170272691A1 (en) Broadcast signal transmission device, broadcast signal reception device, broadcast signal transmission method, and broadcast signal reception method
KR102288815B1 (en) How to deal with packet loss in transmission based on DASH standard and FLUTE protocol
CN101790098A (en) Be used for streamed multimedia and optimize the decoder architecture of mismanage
US9319446B2 (en) System and method for transport stream sync byte detection with transport stream having multiple emulated sync bytes
US8514887B2 (en) Method and apparatus for repairing samples included in container files having lost packets
CN101218798A (en) Improving error resilience using out of band directory information
CN101176353A (en) Decoder architecture for optimized error management in streaming multimedia

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent for invention or patent application
CB03 Change of inventor or designer information

Inventor after: Nagaraj Thadi M.

Inventor after: Silberger Amnon

Inventor after: Collins Bruce

Inventor after: Walker Gordon Kent

Inventor after: Loukas Serafim S.

Inventor after: Raveendran Vijayalakshmi R

Inventor after: Shi Fang

Inventor before: Nagaraj Thadi M.

Inventor before: Silberger Amnon

Inventor before: Collins Bruce

Inventor before: Walker Gordon Kent

Inventor before: Loukas Mike

Inventor before: Raveendran Vijayalakshmi R

Inventor before: Shi Fang

COR Change of bibliographic data

Free format text: CORRECT: INVENTOR; FROM: NAGARAJ THADI M. SILBERGER AMNON COLLINS BRUCE WALKER GORDON KENT LOUKAS MIKE RAVEENDRAN VIJAYALAKSHMI R. SHI FANG TO: NAGARAJ THADI M. SILBERGER AMNON COLLINS BRUCE WALKER GORDON KENT LOUKAS SERAFIM S. RAVEENDRAN VIJAYALAKSHMI R. SHI FANG

C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20080709