CN104811782A - Audio video code stream synchronization decoder and decoding method - Google Patents
Audio video code stream synchronization decoder and decoding method Download PDFInfo
- Publication number
- CN104811782A CN104811782A CN201410043653.8A CN201410043653A CN104811782A CN 104811782 A CN104811782 A CN 104811782A CN 201410043653 A CN201410043653 A CN 201410043653A CN 104811782 A CN104811782 A CN 104811782A
- Authority
- CN
- China
- Prior art keywords
- value
- scope
- show value
- clock
- show
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides an audio video code stream synchronization decoding method. Audio video code stream comprises a plurality of clock reference values and a plurality of video signal and audio signal data packets, wherein each data packet is corresponding to a display value. The decoding method comprises the following steps: reestablishing a clock value by utilizing the first clock reference value; judging whether error between the clock value and a first display value of a plurality of display values is larger than a first range; when the error between the clock value and the first display value is larger than the first range, changing the clock value into a second display value of the plurality of display values; and executing at least one audio video synchronization step by utilizing the clock value set by the second display value.
Description
Technical field
System of the present invention, about audio-visual broadcasting, is about the image of audio-visual broadcasting and synchronous between sound especially.
Background technology
Ornamental film is a part indispensable in the modern life.No matter be need of work or amusement, modern can play film from CD, network video database, intelligent electronic device, digital TV channel.Modern industry circle has also formulated the standard of many audio-visual compressions and broadcasting, such as animation expert group (MPEG), high-order video coding H.264, digital audio/video encoding and decoding technique standard A VS, video signal codec VC-1 etc.
In the middle of the compacting and broadcasting of the film of these industrial standard institute references, both define the synchronization mechanism (Audio Video Synchronization, AV Sync) of image and sound.But, in broadcasting end, if encounter image and the nonsynchronous film of sound, still need the task of broadcasting.Because broadcasting end or decoding end cannot ensure that compacting end or coding side carry out suppressing film in accordance with industrial standard completely, therefore, play the mechanism that in fact end needs a certain document-video in-pace, correct audio-visual nonsynchronous situation in film as much as possible, experience to provide better user.
Summary of the invention
In one embodiment of this invention, a kind of coding/decoding method of synchronous audio-visual code stream is provided.Wherein above-mentioned audio-visual stream packet contains the data packet of multiple clock reference value and multiple video signal and message, and each data packet all corresponds to a show value.This coding/decoding method comprises: utilize one first clock reference value to rebuild a clock value; Judge whether the error of one first show value in this clock value and the plurality of show value is greater than one first scope; When the error of this clock value and this first show value is greater than this first scope, changing this clock value is one second show value in the plurality of show value; And utilize this clock value set by this second show value to perform at least one document-video in-pace step.
In another embodiment of the invention, a kind of decoder of synchronous audio-visual code stream is provided, wherein above-mentioned audio-visual stream packet contains the data packet of multiple clock reference value and multiple video signal and message, each data packet all corresponds to a show value, this decoder comprises: a code stream read module, for rebuilding a clock value according to one first clock reference value; One administration module, for judging whether the error in one first show value of this clock value and the plurality of show value is greater than one first scope, when the error of this clock value and this first show value is greater than this first scope, changing this clock value is one second show value in the plurality of show value; And a document-video in-pace module, perform at least one document-video in-pace step for this clock value set by this second show value.
Accompanying drawing explanation
Fig. 1 is the schematic diagram playing the state machine of end according to one of one embodiment of the invention.
Fig. 2 is a schematic diagram of the state machine of a broadcasting end according to another embodiment of the present invention.
Fig. 3 is the schematic diagram of a flow process of a player method according to an embodiment of the invention.
Fig. 4 is the schematic diagram of a flow process of a player method according to another embodiment of the present invention.
Fig. 5 is a block schematic diagram of a movie player according to an embodiment of the invention.
Embodiment
It is as follows that the present invention will describe some embodiments in detail.But except disclosed embodiment, scope of the present invention by the restriction of those embodiments, is not be as the criterion with claim thereafter.And in order to provide clearer description and make the ordinary person of this skill can understand summary of the invention of the present invention, in diagram, each several part is not drawn according to its relative size, the ratio of some size or other scale dependent may be seemed by highlighting exaggeration, and incoherent detail section is not drawn completely, in the hope of succinctly illustrated.
Movement is drawn expert group (MPEG) as example by the following description, those having ordinary skill in the art will appreciate that, except MPEG, still has other industrial standard applicatory.Scope of the present invention is not limited in the middle of MPEG.Next will sketch according to mpeg standard how suppressing film, particularly about the part of document-video in-pace.
The video-audio signal of simulation, after sampling, quantification and compression, will form elementary stream (ES, elementary stream).Each elementary stream comprises several access unit (AU, access unit).Access unit can comprise video signal data or message data.Each access unit comprises the data of a video signal frame (frame) or a message frame.
Continuous print elementary stream obtains the first section of being divided into, and becomes packetized elementary stream (PES, packetizedelementary stream).When forming packetized elementary stream, Presentation Time Stamp (PTS, presentation time stamp) and decoded time stamp (DTS, decode time stamp) can be added in its head end message.Above-mentioned Presentation Time Stamp PTS can inform video signal data or the message data broadcasting end and when will show or play first access unit in this packetized elementary stream.In other words, video signal data can correspond to a Presentation Time Stamp PTS, and message data also can correspond to a Presentation Time Stamp PTS.Above-mentioned decoded time stamp DTS is then for informing when broadcast end will decode.
Next, packetized elementary stream is divided into the transmission code stream (TS, transport stream) or the program stream of variable-length (PS, program stream) with regular length by the compacting end of film again.In the middle of the head end message of transmission code stream TS, comprise program clock reference value (PCR, program clock reference).
Need to possess a system clock (STC, system timing clock) in the middle of compacting end or coding side, its frequency is 27MHz.System clock STC system is used to refer to above-mentioned Presentation Time Stamp PTS and program clock reference value PCR.Coding side will must be incorporated at the last moment in program clock reference value PCR field, just using system clock STC moment sampling value as program clock reference value PCR, in the middle of this field.
In the part of decoding end, program clock reference value PCR can be utilized to rebuild the system clock STC synchronous with coding side.When receiving new program clock reference value PCR each time, will reconstructing system clock STC again.Then, when untiing the head end message of packetized elementary stream, the Presentation Time Stamp PTS of video signal data and the Presentation Time Stamp PTS of message data can be solved, also can solve relevant decoded time stamp DTS.Presentation Time Stamp PTS and decoded time stamp DTS, stores together with being failed to be convened for lack of a quorum to be fed in memory by the basic code untied.
Before each access unit of elementary stream starts decoding, first can compare decoded time stamp DTS and the program clock reference value PCR of its correspondence, namely start decoding when both are equal.Before the video signal data of each access unit or message data start to play, first can compare Presentation Time Stamp PTS and the program clock reference value PCR of its correspondence, namely start video signal data or the message data of playing this access unit when both are equal.
Above-mentioned mentioned is perfect condition, situation when namely the compacting end of film or coding side carry out implementation in strict accordance with standard.If coding side carries out the compacting of film not in accordance with such standard, there is error in program clock reference value PCR tend.Under such conditions, decoding end still will continue to play film.One of main spirits of the present invention, is that the error amount of program clock reference value PCR is within certain scope, can utilize Presentation Time Stamp PTS turn one's head correction coding end rebuild system clock STC, make video signal and message data syn-chronization broadcast as far as possible.Another main spirits of the present invention, is, when the error amount of program clock reference value PCR is outside certain scope, directly to abandon video signal and message data synchronization process, the computational resource of the decoder that cuts the waste and the energy.
Please refer to shown in Fig. 1, it is the schematic diagram playing the state machine 100 of end according to one of one embodiment of the invention.This broadcasting end system is for playing an audio-visual code stream, and this audio-visual stream packet contains the data packet of multiple video signal and message, and the data packet of video signal and message includes a Presentation Time Stamp PTS separately.This audio-visual code stream also comprises multiple program clock reference value PCR, when this broadcasting termination receives each this program clock reference value PCR, will rebuild the value of a system clock STC.When system clock STC conforms to Presentation Time Stamp PTS, namely this broadcasting end plays the content of the data packet of video signal belonging to this Presentation Time Stamp PTS or message.
This state machine 100 includes three states, one normal condition 110, check state 120, with an abnormal condition 130.When the error of above-mentioned system clock STC and Presentation Time Stamp PTS is in one first scope, when namely program clock reference value PCR is reasonable, normal condition 110 can follow path 112, maintains normal condition 110.But when the error of above-mentioned system clock STC and Presentation Time Stamp PTS exceedes this first scope, that is program clock reference value PCR is unreasonable, then state machine 100 will follow path 114, changes inspection state 120 into from normal condition 110.
In a certain embodiment, first scope of above-mentioned system clock STC and the error of Presentation Time Stamp PTS, can be that the leading Presentation Time Stamp PTS of system clock STC does not reach one first lower limit, or the leading system clock STC of Presentation Time Stamp PTS reach one second time in limited time.In an example, this first lower limit equals this second lower limit.For example, the first lower limit and the second lower limit all equal 0.5 second.In another example, this first lower limit equals this second lower limit.For example, the first lower limit is 1 second, and the second lower limit is 0.7 second.
When being in inspection state 120, if when the error of above-mentioned program clock reference value PCR/ system clock STC and Presentation Time Stamp PTS is returned to again within this first scope, then state machine gets back to above-mentioned normal condition 110 by follow path 122.If the error of above-mentioned program clock reference value PCR/ system clock STC and Presentation Time Stamp PTS continues to exceed this first scope, but also do not exceed a certain time limit (as in ten seconds), then state machine 100 still follows path 124, maintains inspection state 120.But, when the error of above-mentioned program clock reference value PCR/ system clock STC and Presentation Time Stamp PTS continues to exceed this first scope, and when exceeding above-mentioned time limit (as ten seconds), then state machine 100 can follow path 126, is transformed into abnormal condition 130.
When being in abnormal condition 130, playing end and the next value of the Presentation Time Stamp PTS of message data or video signal data can be used to carry out the value of initialization system clock STC.In one embodiment, the above-mentioned Presentation Time Stamp PTS for initialization system clock STC corresponds to message data.Therefore, the Presentation Time Stamp PTS of message data is just at once synchronous with system clock STC.But video signal data may not be synchronous with system clock STC.May need to see the Presentation Time Stamp PTS of video signal data and the relation of system clock STC so play end, carry out some video signal data of repeat playing or skip the step not playing some video signal data.
In another embodiment, the above-mentioned Presentation Time Stamp PTS for initialization system clock STC corresponds to video signal data.Therefore, the Presentation Time Stamp PTS of video signal data is just at once synchronous with system clock STC.But message data may not be synchronous with system clock STC.May need to see the Presentation Time Stamp PTS of message data and the relation of system clock STC so play end, carry out some message data of repeat playing or skip the step not playing some message data.
When being in abnormal condition 130, playing end and can ignore program clock reference value PCR.Only utilize the Presentation Time Stamp PTS of message data or video signal data to carry out initialization system clock STC, and do not utilize new program clock reference value PCR to carry out reconstructing system clock STC.
If use the Presentation Time Stamp PTS of message data to carry out initialization system clock STC, and the error of the Presentation Time Stamp PTS of video signal data and new program clock reference value PCR is less than the first scope, then state machine 100 can follow path 134 from abnormal condition 130 and get back to normal condition 110.If the error of the Presentation Time Stamp PTS of video signal data and new program clock reference value PCR is still greater than the first scope, then state machine 100 can follow path 132 from abnormal condition 130 and rest on abnormal condition 130.
Similarly, if use the Presentation Time Stamp PTS of video signal data to carry out initialization system clock STC, and the error of the Presentation Time Stamp PTS of message data and new program clock reference value PCR is less than the first scope, then state machine 100 can follow path 134 from abnormal condition 130 and get back to normal condition 110.If the error of the Presentation Time Stamp PTS of message data and new program clock reference value PCR is still greater than the first scope, then state machine 100 can follow path 132 from abnormal condition 130 and rest on abnormal condition 130.
Please refer to shown in Fig. 2, it is a schematic diagram of the state machine 200 of a broadcasting end according to another embodiment of the present invention.The difference of this state machine 200 and state machine 100 shown in Fig. 1 is in abnormal condition 230 and free floating state 240, and the state that label is identical and path, all can the explanation of reference diagram 1, does not add superfluous chatting at this.
When being in abnormal condition 230, playing end and the next value of Presentation Time Stamp PTS can be used to carry out the value of initialization system clock STC.If use the Presentation Time Stamp PTS of message data to carry out initialization system clock STC, and the error of the Presentation Time Stamp PTS of video signal data and new program clock reference value PCR is less than the first scope, then state machine 100 can follow path 134 from abnormal condition 230 and get back to normal condition 110.If the error of the Presentation Time Stamp PTS of video signal data and new program clock reference value PCR is still greater than the first scope, then state machine 200 can follow path 132 from abnormal condition 230 and rest on abnormal condition 130.If but the error of the Presentation Time Stamp PTS of the Presentation Time Stamp PTS of video signal data and message data is not only greater than the first scope, and being greater than second scope larger than the first scope, then state machine 200 can follow path 236 from abnormal condition 230 and be switched to free floating state 240.
Similarly, if use the Presentation Time Stamp PTS of video signal data to carry out initialization system clock STC, and the error of the Presentation Time Stamp PTS of message data and new program clock reference value PCR is less than the first scope, then state machine 100 can follow path 134 from abnormal condition 230 and get back to normal condition 110.If the error of the Presentation Time Stamp PTS of message data and new program clock reference value PCR is still greater than the first scope, then state machine 200 can follow path 132 from abnormal condition 230 and rest on abnormal condition 130.If but the error of the Presentation Time Stamp PTS of the Presentation Time Stamp PTS of message data and video signal data is not only greater than the first scope, and being greater than second scope larger than the first scope, then state machine 200 can follow path 236 from abnormal condition 230 and be switched to free floating state 240.
Identical with the first scope, the second scope can be symmetrical, also can be asymmetric.But in case that asymmetrical, the absolute value of the second scope is also higher than the absolute value of the first scope.For example first scope of system clock STC is positive and negative 0.5 second, then the second scope can be positive and negative 0.8 second.In another example, when first scope of system clock STC can be positive 0.5 second and negative 0.8 second, then the second scope can be positive 0.7 second and negative 1 second.Wherein be greater than 0.5 second on the occasion of the scope of 0.7 second, and the negative value scope of 1 second is higher than the negative value scope of 0.8 second.
In the middle of free floating state 240, because program clock reference value PCR is inaccurate, and the error between the Presentation Time Stamp PTS of message data and video signal data is also higher than the second scope.Therefore it is considered herein that under such situation, do not need to waste data and carry out the synchronous of video signal data and message data, therefore decoder does not just carry out the action of computing and document-video in-pace to these values, allow the broadcasting of video signal data and the broadcasting free floating of message data.
Please refer to shown in Fig. 3, it is the schematic diagram of a flow process 300 of a player method according to an embodiment of the invention.Player method system is for playing an audio-visual code stream, and this audio-visual stream packet contains the data packet of multiple video signal and message, and the data packet of video signal and message includes a Presentation Time Stamp PTS separately.This audio-visual code stream also comprises multiple program clock reference value PCR, when receiving each this program clock reference value PCR, will rebuild the value of a system clock STC.When system clock STC conforms to Presentation Time Stamp PTS, namely play the content of the data packet of video signal belonging to this Presentation Time Stamp PTS or message.This flow process 300 comprises following steps:
Step 310: according to the broadcasting step of the system clock STC execution document-video in-pace that the first program clock reference value is rebuild.
Step 320: judge that whether the error of system clock STC and the first Presentation Time Stamp PTS is more than the first scope.When more than the first scope, return step 310.When more than the first scope, perform step 330.
Step 330: utilize the second Presentation Time Stamp PTS initialization system clock STC, then performs step 340.In one embodiment, the Presentation Time Stamp PTS for initialization system clock STC equals the Presentation Time Stamp PTS in the middle of step 320, that is the first Presentation Time Stamp PTS equals the second Presentation Time Stamp PTS.In another embodiment, in step 320 and 330, the Presentation Time Stamp PTS of institute's reference is not same, that is the first Presentation Time Stamp PTS is not equal to the second Presentation Time Stamp PTS.
Step 340: the system clock STC set by Presentation Time Stamp PTS performs the broadcasting step of document-video in-pace, then performs step 350.
Step 350: judge whether the error of second program clock reference value and the 3rd Presentation Time Stamp PTS is less than the first scope.When being less than the first scope, replying and performing step 310.Otherwise, when error is also greater than the first scope, replys and perform step 340.
In the middle of step 330, the second Presentation Time Stamp PTS for initialization system clock STC is relevant to video signal data or message data.When step 330 uses the Presentation Time Stamp PTS of video signal data, namely the 3rd Presentation Time Stamp PTS of step 350 is relevant to message data.Otherwise when step 330 uses the second Presentation Time Stamp PTS of message data, namely the 3rd Presentation Time Stamp PTS of step 350 is relevant to video signal data.
Please refer to shown in Fig. 4, it is the schematic diagram of a flow process 400 of a player method according to another embodiment of the present invention.Compared with the flow process 300 shown in Fig. 3, the difference of flow process 400 is following steps:
Step 420: the error judging system clock STC and Presentation Time Stamp PTS whether more than the first scope and error more than time of the first scope whether more than a time limit.When more than the first scope or this time in limited time, return step 310.When more than the first scope and this time in limited time, perform step 330.
Step 460: judge whether the error of the 3rd Presentation Time Stamp PTS and the 4th Presentation Time Stamp PTS is greater than the second scope, and wherein the second scope is more than or equal to the first scope.When being less than the second scope, replying and performing step 340.Otherwise, when error is greater than the second scope, perform step 470.
Step 470: stop the broadcasting step performing document-video in-pace.
Please refer to shown in Fig. 5, it is a block schematic diagram of a movie player 500 according to an embodiment of the invention.This movie player 500 comprises input interface 510, processing module 520, memory module 530 of film, the output module 540 with video signal and audio signals.This input interface 510 imports the content of film into this processing module 520, after this processing module 520 utilizes this memory module 530 to implement decoding and keep in, exports suitable video signal and audio signals by this output module 540.
This processing module 520 can more comprise one administration module 522, code stream read (stream parsing) module 524, with a document-video in-pace module 526.In one embodiment, this processing module 520 can comprise at least one processor, for performing suitable program code to realize the function of above-mentioned three modules.In another embodiment, this processing module 520 can comprise three processors, performs suitable program code separately to realize the function of above-mentioned three modules.Those having ordinary skill in the art will appreciate that, these functions can be realized by the mode that software, hardware or software and hardware are mixed.The present invention does not limit the method in fact done.
Above-mentioned code stream read module 524 is for reading the audio-visual code stream of film, and responsible solution translates multiple program clock reference value PCR, and rebuilds the system clock STC field 532 being positioned at memory module 530 according to program clock reference value PCR.In addition, code stream read module 524 is for the data packet of the multiple video signal and message that read film, and solution translates the Presentation Time Stamp PTS of each data packet, leave the Presentation Time Stamp field 534 of the video signal data package in memory module 530 and the Presentation Time Stamp field 536 of message data packet in.
Above-mentioned document-video in-pace module 526 is according to the field 532,534 and 536 in memory module, performs the broadcasting step of document-video in-pace.Above-mentioned administration module 522 is whether error for judging system clock STC and Presentation Time Stamp PTS is more than the first scope.When more than the first scope, make code stream read module 524 stop utilizing program clock reference value PCR to rebuild the system clock STC field 532 being positioned at memory module 530, and utilize Presentation Time Stamp PTS field 534 or 536 initialization system clock STC field 532.
In another embodiment, except whether error is more than except the first scope, whether above-mentioned administration module 522 also wants error in judgement more than the time of the first scope more than a time limit.When error exceedes this more than the time of the first scope in limited time, administration module 522 just makes code stream read module 524 stop utilizing program clock reference value PCR to rebuild the system clock STC field 532 being positioned at memory module 530, and utilizes Presentation Time Stamp PTS field 534 or 536 initialization system clock STC field 532.。
Then, the system clock STC of document-video in-pace module 526 set by Presentation Time Stamp PTS performs the broadcasting step of document-video in-pace.Then, administration module 522 judges whether the system clock STC field 532 set by Presentation Time Stamp PTS is less than the first scope with the error of another Presentation Time Stamp PTS field 536 or 534.When being less than the first scope, making code stream read module 524 re-use program clock reference value PCR and rebuilding the system clock STC field 532 being positioned at memory module 530.When error is also greater than the first scope, then the system clock STC of document-video in-pace module 526 set by Presentation Time Stamp PTS is still made to perform the broadcasting step of document-video in-pace.
In another embodiment, when error is also greater than the first scope, whether the error of the Presentation Time Stamp PTS and another Presentation Time Stamp PTS that belong to message data and video signal data is respectively greater than the second scope by administration module 522, and wherein the second scope is more than or equal to the first scope.When being less than the second scope, the system clock STC of document-video in-pace module 526 set by Presentation Time Stamp PTS is still made to perform the broadcasting step of document-video in-pace.When error is greater than the second scope, then document-video in-pace module 526 is made to stop performing the broadcasting step of document-video in-pace.
Those having ordinary skill in the art will appreciate that, one of main spirits of the present invention, be that the error amount of program clock reference value PCR is within certain scope, can utilize Presentation Time Stamp PTS turn one's head correction coding end rebuild system clock STC, make video signal and message data syn-chronization broadcast as far as possible.Another main spirits of the present invention, is, when the Presentation Time Stamp PTS of message data and video signal data is outside certain scope, directly to abandon video signal and message data synchronization process, the computational resource of the decoder that cuts the waste and the energy.
In addition, the present invention does not limit above-mentioned audio-visual code stream is the specification meeting animation expert group MPEG.Audio-visual stream packet is only needed to contain the data packet of multiple clock reference value and multiple video signal and message, each data packet all corresponds to a show value, and decoding end is used for rebuilding a clock value according to this clock reference value, and this clock value and those show values is utilized to carry out the step of document-video in-pace.Show value corresponding to each data packet can directly be included in audio-visual code stream, also can be derived by other show value in audio-visual code stream.In one embodiment, above-mentioned clock reference value can be program clock reference value PCR, and show value can be Presentation Time Stamp PTS, and clock value can be system clock STC.Above-mentioned video signal and the data packet of message comprise the data of a video signal frame and the data of a message frame respectively.And the step of above-mentioned document-video in-pace comprise following one of them: make the data packet of at least one video signal repeat broadcast; The data packet of at least one message is made to repeat to broadcast; The data packet of at least one video signal is made not broadcast; And make the data packet of at least one message not broadcast.
The foregoing is only preferred embodiment of the present invention, and be not used to limit claim of the present invention; All other changes for the equivalence completed under the disclosed spirit of disengaging or modifies, and all should be included in following claim.
Claims (22)
1. a coding/decoding method for synchronous audio-visual code stream, wherein above-mentioned audio-visual stream packet contains the data packet of multiple clock reference value and multiple video signal and message, and each data packet all corresponds to show value, and this coding/decoding method comprises:
The first clock reference value is utilized to rebuild clock value;
Judge whether the error of the first show value in this clock value and the plurality of show value is greater than the first scope;
When the error of this clock value and this first show value is greater than this first scope, changing this clock value is the second show value in the plurality of show value; And
This clock value set by this second show value is utilized to perform at least one document-video in-pace step.
2. coding/decoding method as claimed in claim 1, is characterized in that, more comprise:
After this at least one document-video in-pace step of execution, judge whether the error of the 3rd show value in second clock reference value and the plurality of show value is less than this first scope; And
When the error of this second clock reference value and the 3rd show value is less than this first scope, utilize this second clock reference value to rebuild this clock value, wherein in this audio-visual code stream, this second clock reference value is after this first clock reference value.
3. coding/decoding method as claimed in claim 2, it is characterized in that, one of them of the second above-mentioned show value and the 3rd show value corresponds to video signal data package, and another corresponds to message data packet.
4. coding/decoding method as claimed in claim 2, more comprises:
When the error of this second clock reference value and the 3rd show value is greater than this first scope, and the error of the 3rd show value and the 4th show value is when being greater than the second scope, stop performing this at least one document-video in-pace step again, one of them of wherein the 3rd show value and the 4th show value corresponds to video signal data package, and another corresponds to message data packet.
5. coding/decoding method as claimed in claim 4, is characterized in that, more comprise:
When the error of this second clock reference value and the 3rd show value is greater than this first scope and the error of the 3rd show value and the 4th show value is less than this second scope, then perform this at least one document-video in-pace step.
6. coding/decoding method as claimed in claim 4, it is characterized in that, the second above-mentioned scope is more than or equal to this first scope.
7. coding/decoding method as claimed in claim 4, it is characterized in that, the first above-mentioned scope and the positive and negative boundary of the second scope asymmetric, and the positive boundary of this second scope is greater than the positive boundary of this first scope, and the negative boundary of this second scope is less than the negative boundary of this second scope.
8. coding/decoding method as claimed in claim 1, it is characterized in that, when the error of this clock value and this first show value is greater than this first scope, more comprise and judge that the error of this clock value and this first show value is greater than the time whether overstepping the time limit of this first scope, when exceeding this in limited time, just change this clock value and be set to this second show value.
9. coding/decoding method as claimed in claim 1, it is characterized in that, the second above-mentioned show value equals the first show value.
10. coding/decoding method as claimed in claim 1, it is characterized in that, above-mentioned video signal and the data packet of message comprise the data of video signal frame (frame) and the data of message frame respectively.
11. coding/decoding methods as claimed in claim 1, is characterized in that, above-mentioned at least one document-video in-pace step comprise following one of them:
The data packet of at least one video signal is made to repeat to broadcast;
The data packet of at least one message is made to repeat to broadcast;
The data packet of at least one video signal is made not broadcast; And
The data packet of at least one message is made not broadcast.
The decoder of 12. 1 kinds of synchronous audio-visual code streams, wherein above-mentioned audio-visual stream packet contains the data packet of multiple clock reference value and multiple video signal and message, and each data packet all corresponds to show value, and this decoder comprises:
Code stream read module, for rebuilding clock value according to the first clock reference value;
Administration module, for judging whether the error of the first show value in this clock value and the plurality of show value is greater than the first scope, when the error of this clock value and this first show value is greater than this first scope, changing this clock value is the second show value in the plurality of show value; And
Document-video in-pace module, performs at least one document-video in-pace step for this clock value set by this second show value.
13. decoders as claimed in claim 12, it is characterized in that, above-mentioned administration module more for after this at least one document-video in-pace step of execution, judges whether the error of the 3rd show value in second clock reference value and the plurality of show value is less than this first scope; And when the error of this second clock reference value and the 3rd show value is less than this first scope, this code stream read module is made to utilize this new second clock reference value to rebuild this clock value, wherein in this audio-visual code stream, this second clock reference value is after this first clock reference value.
14. decoders as claimed in claim 13, it is characterized in that, one of them of the second above-mentioned show value and the 3rd show value corresponds to video signal data package, and another corresponds to message data packet.
15. decoders as claimed in claim 13, it is characterized in that, above-mentioned administration module is more for when the error of this second clock reference value and the 3rd show value is greater than this first scope, and the error of the 3rd show value and the 4th show value is when being greater than the second scope, this document-video in-pace module is made to stop performing this at least one document-video in-pace step again, one of them of wherein the 3rd show value and the 4th show value corresponds to video signal data package, and another corresponds to message data packet.
16. decoders as claimed in claim 15, it is characterized in that, above-mentioned administration module more for when the error of this second clock reference value and the 3rd show value is greater than this first scope and the error of the 3rd show value and the 4th show value is less than this second scope, makes this document-video in-pace module perform this at least one document-video in-pace step again.
17. decoders as claimed in claim 15, it is characterized in that, the second above-mentioned scope is more than or equal to this first scope.
18. decoders as claimed in claim 15, it is characterized in that, the first above-mentioned scope and the positive and negative boundary of the second scope asymmetric, and the positive boundary of this second scope is greater than the positive boundary of this first scope, and the negative boundary of this second scope is less than the negative boundary of this second scope.
19. decoders as claimed in claim 12, it is characterized in that, above-mentioned administration module judges when the error of this clock value and this first show value is greater than this first scope, more comprise and judge that the error of this clock value and this first show value is greater than the time whether overstepping the time limit of this first scope, when exceeding this in limited time, just changing this clock value is this second show value.
20. decoders as claimed in claim 12, it is characterized in that, the second above-mentioned show value equals the first show value.
21. decoders as claimed in claim 12, is characterized in that, above-mentioned video signal and the data packet of message comprise the data of video signal frame (frame) and the data of message frame respectively.
22. decoders as claimed in claim 12, is characterized in that, above-mentioned document-video in-pace module be used for carrying out following one of them:
The data packet of at least one video signal is made to repeat to broadcast;
The data packet of at least one message is made to repeat to broadcast;
The data packet of at least one video signal is made not broadcast; And
The data packet of at least one message is made not broadcast.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410043653.8A CN104811782B (en) | 2014-01-29 | 2014-01-29 | The decoder and coding/decoding method of synchronous audio-visual code stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410043653.8A CN104811782B (en) | 2014-01-29 | 2014-01-29 | The decoder and coding/decoding method of synchronous audio-visual code stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104811782A true CN104811782A (en) | 2015-07-29 |
| CN104811782B CN104811782B (en) | 2018-03-02 |
Family
ID=53696197
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410043653.8A Expired - Fee Related CN104811782B (en) | 2014-01-29 | 2014-01-29 | The decoder and coding/decoding method of synchronous audio-visual code stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104811782B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106470291A (en) * | 2015-08-19 | 2017-03-01 | 飞思卡尔半导体公司 | Recover in the interruption in time synchronized from audio/video decoder |
| CN110858922A (en) * | 2018-08-23 | 2020-03-03 | 晨星半导体股份有限公司 | Operation method of digital video and audio device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100142624A1 (en) * | 2007-08-27 | 2010-06-10 | Fujitsu Limited | Decoder and decoding method |
| CN102075806A (en) * | 2011-01-26 | 2011-05-25 | 四川长虹电器股份有限公司 | Audio and video synchronization method of digital television |
-
2014
- 2014-01-29 CN CN201410043653.8A patent/CN104811782B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100142624A1 (en) * | 2007-08-27 | 2010-06-10 | Fujitsu Limited | Decoder and decoding method |
| CN102075806A (en) * | 2011-01-26 | 2011-05-25 | 四川长虹电器股份有限公司 | Audio and video synchronization method of digital television |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106470291A (en) * | 2015-08-19 | 2017-03-01 | 飞思卡尔半导体公司 | Recover in the interruption in time synchronized from audio/video decoder |
| CN110858922A (en) * | 2018-08-23 | 2020-03-03 | 晨星半导体股份有限公司 | Operation method of digital video and audio device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104811782B (en) | 2018-03-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9736340B2 (en) | Decoder and decoding method for audio video stream synchronization | |
| CN111355976B (en) | Video live broadcast method and system based on HEVC standard | |
| CN102938848A (en) | Instantaneous decoder refresh frame aligned multi-bitrate transcoder output | |
| CN105359449B (en) | Sending method, method of reseptance, sending device and reception device | |
| CN104780422A (en) | Streaming media playing method and streaming media player | |
| CN103873952B (en) | A kind of efficient video playback frame losing control system and its method | |
| CN104394450B (en) | A kind of processing method and processing device of multimedia frame | |
| CN102547299A (en) | Audio and video synchronous control method based on moving picture experts group (MPEG)-2 | |
| CN103458271A (en) | Audio-video file splicing method and audio-video file splicing device | |
| US20170055045A1 (en) | Recovering from discontinuities in time synchronization in audio/video decoder | |
| US9106948B2 (en) | Adaptive PID controller for audio/video clock recovery | |
| CN104333764B (en) | A kind of multi-channel video player method and device | |
| CN105142037B (en) | A kind of distributed trans-coding audio-video synthetic method and system | |
| CN103581730A (en) | Method for achieving synchronization of audio and video on digital set top box | |
| CN104811782A (en) | Audio video code stream synchronization decoder and decoding method | |
| CN104320676A (en) | A method for correcting abnormal jitter of program clock reference in video transmission stream | |
| CN104796702B (en) | A kind of conversion method and device of H264 video frame rates | |
| US8873639B2 (en) | System and method for demultiplexing an MPEG-2 transport stream | |
| CN104185028A (en) | Video playing method and terminal thereof | |
| US8331459B2 (en) | Method and apparatus for smooth digital media playback | |
| CN113630643B (en) | Media stream recording method and device, computer storage medium and electronic equipment | |
| US20100076944A1 (en) | Multiprocessor systems for processing multimedia data and methods thereof | |
| CN100591140C (en) | Method for displaying subtitling in video | |
| JP5552993B2 (en) | MXF processing equipment | |
| KR101671311B1 (en) | Cloud stream service system, apparatus and cloud streaming service method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211027 Address after: China Taiwan Hsinchu Science Park Hsinchu city Dusing Road No. 1 Patentee after: MEDIATEK Inc. Address before: Taiwan Hsinchu County Tai Yuan Street China jhubei City, No. 26 4 floor 1 Patentee before: MSTAR SEMICONDUCTOR Inc. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180302 Termination date: 20220129 |