CN104811782B - The decoder and coding/decoding method of synchronous audio-visual code stream - Google Patents
The decoder and coding/decoding method of synchronous audio-visual code stream Download PDFInfo
- Publication number
- CN104811782B CN104811782B CN201410043653.8A CN201410043653A CN104811782B CN 104811782 B CN104811782 B CN 104811782B CN 201410043653 A CN201410043653 A CN 201410043653A CN 104811782 B CN104811782 B CN 104811782B
- Authority
- CN
- China
- Prior art keywords
- value
- scope
- show
- clock
- show value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention provides a kind of coding/decoding method of the audio-visual code stream of synchronization.Data packet of the wherein above-mentioned audio-visual stream packet containing multiple clock reference values and multiple video signals and message, each data packet are corresponded to a show value.The coding/decoding method includes：A clock value is rebuild using one first clock reference value；Judge whether the error of the clock value and one first show value in the plurality of show value is more than one first scope；When the error of the clock value and first show value is more than first scope, the clock value is changed as one second show value in the plurality of show value；And perform an at least document-video in-pace step using the clock value set by second show value.
Description
Technical field
The present disclosure generally relates to audio-visual broadcasting, and especially system is on synchronous between the image and sound of audio-visual broadcasting.
Background technology
Ornamental film is a part indispensable in the modern life.Either need of work or amusement, modern can
To play film from CD, network video database, intelligent electric sub-device, digital TV channel.Modern industry circle is also made
Determined many audio-visual compressions and the standards played, for example, animation expert group (MPEG), high-order video coding H.264, digital sound regards
Frequency encoding and decoding technique standard AVS, video signal codec VC-1 etc..
Among the compacting and broadcasting of the film of these industrial standard institute references, the synchronous machine of image and sound is both defined
Make (Audio Video Synchronization, AV Sync).However, in terms of end is played, if encountering image and sound
The nonsynchronous film of sound, still need to complete playing for task.It can not ensure to suppress end or coding due to playing end or decoding end
Suppressing film is carried out in end in accordance with industrial standard completely, and therefore, playing end actually needs the mechanism of a certain document-video in-pace, as far as possible
Audio-visual nonsynchronous situation in ground correction film, experienced with providing more preferably user.
The content of the invention
In one embodiment of this invention, there is provided a kind of coding/decoding method of the audio-visual code stream of synchronization.Wherein above-mentioned audio-visual code
Data packet of the stream comprising multiple clock reference values with multiple video signals and message, each data packet are corresponded to a display
Value.The coding/decoding method includes：A clock value is rebuild using one first clock reference value；Judge the clock value and the plurality of show value
In the error of one first show value whether be more than one first scope；It is somebody's turn to do when the error of the clock value and first show value is more than
During the first scope, the clock value is changed as one second show value in the plurality of show value；And utilize the second show value institute
The clock value of setting performs an at least document-video in-pace step.
In another embodiment of the invention, there is provided a kind of decoder of the audio-visual code stream of synchronization, wherein above-mentioned audio-visual code
Data packet of the stream comprising multiple clock reference values with multiple video signals and message, each data packet are corresponded to a display
Value, the decoder include：One code stream read module, for rebuilding a clock value according to one first clock reference value；One management mould
Block, for judging whether the clock value is more than one first scope with the error in one first show value of the plurality of show value, when
When the error of the clock value and first show value is more than first scope, the clock value is changed as one in the plurality of show value
Second show value；And a document-video in-pace module, perform at least one for the clock value according to set by second show value
Document-video in-pace step.
Brief description of the drawings
Fig. 1 is the schematic diagram according to the one of one embodiment of the invention state machine for playing end.
Fig. 2 is the schematic diagram according to the one of another embodiment of the present invention state machine for playing end.
Fig. 3 is the schematic diagram according to a flow of a player method of one embodiment of the invention.
Fig. 4 is the schematic diagram according to a flow of a player method of another embodiment of the present invention.
Fig. 5 is the block schematic diagram according to a movie player of one embodiment of the invention.
Embodiment
It is as follows that the present invention will be described in some embodiments.However, in addition to disclosed embodiment, the scope of the present invention
Do not limited by those embodiments, be to be defined by claim thereafter.And in order to provide clearer description and make
The ordinary person of this skill is understood that the content of the invention of the present invention, it is illustrated that interior each several part does not have the size relative according to its and entered
Row is drawn, and the ratio of some sizes or other scale dependents may be highlighted and the exaggeration that seems, and incoherent detail portion
Divide and draw completely, in the hope of the succinct of diagram.
The following description will lift animation expert group (MPEG) and be used as example, it will be understood by those skilled in the art that
Arrive, in addition to MPEG, still there are other industrial standards applicatory.The scope of the present invention is not limited among MPEG.Connect down
Come will sketch according to MPEG standards how suppressing film, especially with regard to the part of document-video in-pace.
The video-audio signal of simulation is after over sampling, quantization and compression, it will forms elementary stream (ES, elementary
stream).Each elementary stream includes several access units (AU, access unit).Access unit can include video signal number
According to or message data.Each access unit includes the data of a video frame (frame) or a message frame.
Continuous elementary stream, which obtains, is first divided into section, turns into packetized elementary stream (PES, packetized
elementary stream).When forming packetized elementary stream, Presentation Time Stamp can be added in its head end message
(PTS, presentation time stamp) and decoded time stamp (DTS, decode time stamp).During above-mentioned display
Between stamp PTS can inform and broadcast when end will show or play the video signal number of first access unit in the packetized elementary stream
According to or message data.In other words, video signal data can correspond to a Presentation Time Stamp PTS, and message data can also correspond to one
Presentation Time Stamp PTS.Above-mentioned decoded time stamp DTS, which is then used to inform, broadcasts when end will be decoded.
Next, the compacting end of film again by packetized elementary stream be divided into regular length transmission code stream (TS,
Transport stream) or variable-length program stream (PS, program stream).Interrogated in transmission code stream TS head end
Among breath, include program clock reference value (PCR, program clock reference).
A system clock (STC, system timing clock), its frequency are needed to have among compacting end or coding side
Rate is 27MHz.System clock STC systems are used to refer to above-mentioned Presentation Time Stamp PTS and program clock reference value PCR.Coding side
Must be incorporated at the last moment in program clock reference value PCR fields, just using system clock STC moment sampling value as
Program clock reference value PCR, it is stored among the field.
In the part of decoding end, program clock reference value PCR can be utilized to rebuild the system clock STC synchronous with coding side.
, will reconstructing system clock STC again when receiving new program clock reference value PCR each time.Then packetized is being untied
During the head end message of elementary stream, the Presentation Time Stamp PTS of video signal data and the Presentation Time Stamp of message data can be solved
PTS, it can also solve the decoded time stamp DTS of correlation.Presentation Time Stamp PTS and decoded time stamp DTS, it is basic together with what is be disengaged
Code stream can be fed in memory and store.
Before each access unit of elementary stream starts decoding, can first compare its corresponding decoded time stamp DTS with
Program clock reference value PCR, start to decode when both are equal.Opened in the video signal data or message data of each access unit
It before beginning to play, can first compare its corresponding Presentation Time Stamp PTS and program clock reference value PCR, open when both are equal
Beginning plays the video signal data or message data of the access unit.
It is above-mentioned it is mentioned be perfect condition, that is, when the compacting end of film or coding side carry out implementation in strict accordance with standard
Situation.If coding side does not carry out the compacting of film according to such standard, program clock reference value PCR often just occurs
Error.Under such conditions, decoding end will still continue to play film.One of main spirits of the present invention, when being program
Clock reference value PCR error amount within the scope of some, can utilize Presentation Time Stamp PTS turn one's head correction coding end reconstruction system
Clock STC, as far as possible video signal is broadcast with message data syn-chronization.Another main spirits of the present invention, are when program
Clock reference value PCR error amount directly abandons video signal and message data synchronization process when outside some scope, reduces and wastes solution
The computing resource and the energy of code device.
It refer to shown in Fig. 1, it is the signal according to the one of one embodiment of the invention state machine 100 for playing end
Figure.The broadcasting end system be used for play an audio-visual code stream, data packet of the audio-visual stream packet containing multiple video signals and message, video signal with
The data packet of message each includes a Presentation Time Stamp PTS.The audio-visual code stream also includes multiple program clock reference values
PCR, when the broadcasting end receives each program clock reference value PCR, the value of a system clock STC will be rebuild.When being
When system clock STC is consistent with Presentation Time Stamp PTS, the broadcasting end is to play the video signal or message belonging to Presentation Time Stamp PTS
Data packet content.
The state machine 100 includes three states, a normal condition 110, an inspection state 120 and an abnormal condition
130.When above-mentioned system clock STC and Presentation Time Stamp PTS error is in the range of one first, that is, program clock ginseng
Examine value PCR it is reasonable when, normal condition 110 can follow path 112, maintain normal condition 110.However, when above-mentioned system
When clock STC and Presentation Time Stamp PTS error exceedes first scope, that is, program clock reference value PCR is unreasonable, then state
Machine 100 will follow path 114, be changed into inspection state 120 from normal condition 110.
In a certain embodiment, the first scope of above-mentioned system clock STC and Presentation Time Stamp PTS error can be with
It is that the leading Presentation Time Stamp PTS of system clock STC are not up to one first lower limit, or during the leading systems of Presentation Time Stamp PTS
When clock STC is not up to second lower limit.In an example, first lower limit is equal to second lower limit.For example, the first lower limit
It is equal to 0.5 second with the second lower limit.In another example, first lower limit is equal to second lower limit.For example, the first lower limit
For 1 second, and the second lower limit was 0.7 second.
When being in inspection state 120, if above-mentioned program clock reference value PCR/ system clocks STC and Presentation Time Stamp
PTS error is returned within first scope again when, then state machine returns to above-mentioned normal condition 110 by path 122 is follow.
If above-mentioned program clock reference value PCR/ system clocks STC and Presentation Time Stamp PTS error persistently exceeds first model
Enclose, but also not less than a certain time limit (in such as ten seconds), then state machine 100 still follows path 124, maintains inspection state 120.No
Cross, when above-mentioned program clock reference value PCR/ system clocks STC and Presentation Time Stamp PTS error persistently exceed first model
When enclosing, and exceed above-mentioned time limit (such as ten seconds), then state machine 100 can follow path 126, be transformed into abnormal condition
130。
When being in abnormal condition 130, playing end can be come using the Presentation Time Stamp PTS of message data or video signal data
Value carry out initialization system clock STC value.In one embodiment, the above-mentioned Presentation Time Stamp PTS for initialization system clock STC
It is to correspond to message data.Therefore, the Presentation Time Stamp PTS of message data is just at once synchronous with system clock STC.However, regard
Interrogating data may not be synchronous with system clock STC.So playing end may need to see the Presentation Time Stamp PTS of video signal data and system
Clock STC relation, carry out repeating playing some video signal datas or skip the step of not playing some video signal datas.
In another embodiment, the above-mentioned Presentation Time Stamp PTS for initialization system clock STC is to correspond to video signal number
According to.Therefore, the Presentation Time Stamp PTS of video signal data is just at once synchronous with system clock STC.However, message data may not be with being
The clock STC that unites is synchronous.So playing end may need to see the Presentation Time Stamp PTS and system clock STC of message data relation,
Carry out repeating playing some message data or skip the step of not playing some message data.
When being in abnormal condition 130, program clock reference value PCR can be ignored by playing end.Only utilize message data
Or the Presentation Time Stamp PTS of video signal data carrys out initialization system clock STC, without being weighed using new program clock reference value PCR
Build system clock STC.
If come initialization system clock STC, and the Presentation Time Stamp of video signal data using the Presentation Time Stamp PTS of message data
PTS and new program clock reference value PCR error is less than the first scope, then state machine 100 can follow road from abnormal condition 130
Footpath 134 returns to normal condition 110.If the Presentation Time Stamp PTS of video signal data and new program clock reference value PCR error is still
More than the first scope, then the meeting of state machine 100 follow path 132 from abnormal condition 130 and rest on abnormal condition 130.
Similarly, if carrying out initialization system clock STC using the Presentation Time Stamp PTS of video signal data, and message data is aobvious
Show that timestamp PTS and new program clock reference value PCR error are less than the first scope, then state machine 100 can be from improper shape
State 130 follows path 134 and returns to normal condition 110.If the Presentation Time Stamp PTS of message data and new program clock reference value
PCR error can follow path 132 from abnormal condition 130 and rest on abnormal condition still greater than the first scope, then state machine 100
130。
It refer to shown in Fig. 2, it is the signal according to the one of another embodiment of the present invention state machine 200 for playing end
Figure.The difference of state machine 100 is in abnormal condition 230 and free floating state 240, label phase shown in this state machine 200 and Fig. 1
Same state and path, may be referred to Fig. 1 explanation, be not added with superfluous chat herein.
During in abnormal condition 230, initialization system clock STC can be carried out using the Presentation Time Stamp PTS values come by playing end
Value.If come initialization system clock STC, and the Presentation Time Stamp PTS of video signal data using the Presentation Time Stamp PTS of message data
It is less than the first scope with new program clock reference value PCR error, then state machine 100 can follow path from abnormal condition 230
134 return to normal condition 110.If the Presentation Time Stamp PTS of video signal data and new program clock reference value PCR error are still big
In the first scope, then the meeting of state machine 200 follow path 132 from abnormal condition 230 and rest on abnormal condition 130.But if depending on
The error for interrogating the Presentation Time Stamp PTS of data and the Presentation Time Stamp PTS of message data is not only more than the first scope, and is more than
Second scope bigger than the first scope, the then meeting of state machine 200 follow path 236 from abnormal condition 230 and be switched to free floating
State 240.
Similarly, if carrying out initialization system clock STC using the Presentation Time Stamp PTS of video signal data, and message data is aobvious
Show that timestamp PTS and new program clock reference value PCR error are less than the first scope, then state machine 100 can be from improper shape
State 230 follows path 134 and returns to normal condition 110.If the Presentation Time Stamp PTS of message data and new program clock reference value
PCR error can follow path 132 from abnormal condition 230 and rest on abnormal condition still greater than the first scope, then state machine 200
130.But if the Presentation Time Stamp PTS of message data and the Presentation Time Stamp PTS of video signal data error are not only more than the
One scope, and be more than second scope bigger than the first scope, then state machine 200 can follow path 236 from abnormal condition 230 and cut
Change to free floating state 240.
Identical with the first scope, the second scope can be symmetrical or asymmetric.But in asymmetric situation
Under, the absolute value of the second scope is also higher than the absolute value of the first scope.For example system clock STC the first scope is positive and negative
0.5 second, then second it may range from positive and negative 0.8 second.In another example, when system clock STC the first scope can be just
0.5 second and minus 0.8 second, then the second scope can be positive 0.7 second and minus 1 second.Scope wherein on the occasion of 0.7 second is greater than 0.5 second,
And the negative value scope of 1 second is higher than the negative value scope of 0.8 second.
Among free floating state 240, because program clock reference value PCR is inaccurate, and message data with
Error between the Presentation Time Stamp PTS of video signal data is also above the second scope.Therefore it is considered herein that such situation it
Under, data need not be wasted at all carries out that video signal data is synchronous with message data, therefore decoder to these values with regard to not transporting
Calculate and the action of document-video in-pace, allow the broadcasting of video signal data and the broadcasting free floating of message data.
It refer to shown in Fig. 3, it is the schematic diagram according to a flow 300 of a player method of one embodiment of the invention.
Player method system is used to play an audio-visual code stream, data packet of the audio-visual stream packet containing multiple video signals and message, video signal and sound
The data packet of news each includes a Presentation Time Stamp PTS.The audio-visual code stream also includes multiple program clock reference value PCR,
When receiving each program clock reference value PCR, the value of a system clock STC will be rebuild.When system clock STC is with showing
When showing that timestamp PTS is consistent, that is, play the content of the data packet of video signal or message belonging to Presentation Time Stamp PTS.The stream
Journey 300 comprises the steps of：
Step 310：The broadcasting that the system clock STC rebuild according to the first program clock reference value performs document-video in-pace walks
Suddenly.
Step 320：Judge system clock STC and the first Presentation Time Stamp PTS error whether more than the first scope.When not
During more than the first scope, return to step 310.When alreading exceed the first scope, step 330 is performed.
Step 330：Using the second Presentation Time Stamp PTS initialization system clock STC, step 340 is then performed.Implement one
In example, the Presentation Time Stamp PTS for initialization system clock STC is equal to Presentation Time Stamp PTS, Yi Ji among step 320
One Presentation Time Stamp PTS is equal to the second Presentation Time Stamp PTS.In another embodiment, in step 320 and 330 institute's reference it is aobvious
Show that timestamp PTS is not same, that is, the first Presentation Time Stamp PTS is not equal to the second Presentation Time Stamp PTS.
Step 340：System clock STC according to set by Presentation Time Stamp PTS performs the broadcasting step of document-video in-pace, connects
Execution step 350.
Step 350：Judge whether second program clock reference value and the 3rd Presentation Time Stamp PTS error are less than the first model
Enclose.When less than the first scope, reply and perform step 310.Conversely, when error is also greater than the first scope, replys and perform step
340。
Among step 330, the second Presentation Time Stamp PTS for initialization system clock STC can be relevant to video signal
Data or message data.As Presentation Time Stamp PTS of the step 330 using video signal data, the 3rd Presentation Time Stamp of step 350
PTS is relevant to message data.Conversely, as second Presentation Time Stamp PTS of the step 330 using message data, step 350
3rd Presentation Time Stamp PTS is relevant to video signal data.
It refer to shown in Fig. 4, it is the signal according to a flow 400 of a player method of another embodiment of the present invention
Figure.Compared with the flow 300 shown in Fig. 3, the difference of flow 400 is following steps：
Step 420：Judge system clock STC and Presentation Time Stamp PTS error whether more than the first scope and error
More than the first scope time whether more than a time limit.When not less than the first scope or this when prescribe a time limit, return to step 310.When
Through more than the first scope and this when prescribe a time limit, perform step 330.
Step 460：Judge whether the 3rd Presentation Time Stamp PTS and the 4th Presentation Time Stamp PTS error is more than the second model
Enclose, wherein the second scope is more than or equal to the first scope.When less than the second scope, reply and perform step 340.Conversely, when mistake
When difference is more than the second scope, step 470 is performed.
Step 470：Stop performing the broadcasting step of document-video in-pace.
It refer to shown in Fig. 5, it is the block schematic diagram according to a movie player 500 of one embodiment of the invention.
The movie player 500 include an input interface 510 of film, a processing module 520, a memory module 530, with video signal with
One output module 540 of audio signals.The content of film is passed to the processing module 520 by the input interface 510, by the processing
After module 520 is implemented decoding and kept in using the memory module 530, appropriate video signal and sound are exported by the output module 540
Interrogate signal.
The processing module 520 can further include a management module 522, a code stream reads (stream parsing) module 524,
With a document-video in-pace module 526.In one embodiment, the processing module 520 can include at least one processor, for performing
Appropriate program code is to realize the function of above three module.In another embodiment, the processing module 520 can include three
Individual processor, appropriate program code is each performed to realize the function of above three module.One of ordinary skill in the art
It is understood that these functions can be realized by the mode that software, hardware or software and hardware mix.The present invention does not limit it
The method done in fact.
Above-mentioned code stream read module 524 is used for the audio-visual code stream for reading film, and responsible solution translates multiple program clock ginsengs
Examine value PCR, and the system clock STC fields 532 rebuild according to program clock reference value PCR in memory module 530.
In addition, code stream read module 524 be used for read film multiple video signals and message data packet, and solution translate it is each
The Presentation Time Stamp PTS of data packet, the Presentation Time Stamp field for the video signal data package being stored in memory module 530
534 with the Presentation Time Stamp field 536 of message data packet.
The above-mentioned system of document-video in-pace module 526 performs audio-visual same according to the field 532,534 and 536 in memory module
The broadcasting step of step.The above-mentioned system of management module 522 be used to judging system clock STC and Presentation Time Stamp PTS error whether
More than the first scope.When more than the first scope, code stream read module 524 is made to stop rebuilding using program clock reference value PCR
System clock STC fields 532 in memory module 530, and set using Presentation Time Stamp PTS fields 534 or 536
System clock STC fields 532.
In another embodiment, in addition to whether error is more than the first scope, above-mentioned management module 522 will also judge
Error more than the first scope time whether more than a time limit.Prescribe a time limit, manage when error exceedes this more than the time of the first scope
Reason module 522 just makes code stream read module 524 stop rebuilding in memory module 530 using program clock reference value PCR
System clock STC fields 532, and utilize Presentation Time Stamp PTS fields 534 or 536 initialization system clock STC fields
532。。
Then, system clock STC of the document-video in-pace module 526 according to set by Presentation Time Stamp PTS performs document-video in-pace
Broadcasting step.Then, management module 522 judge system clock STC fields 532 set by Presentation Time Stamp PTS with it is another
Whether the error of Presentation Time Stamp PTS fields 536 or 534 is less than the first scope.When less than the first scope, code stream is made to read mould
Block 524 re-uses the system clock STC fields 532 that program clock reference value PCR is rebuild in memory module 530.When
When error is also greater than the first scope, then system clock of the document-video in-pace module 526 according to set by Presentation Time Stamp PTS is still made
STC performs the broadcasting step of document-video in-pace.
In another embodiment, when error is also greater than the first scope, management module 522 will be belonging respectively to message data with
Whether the Presentation Time Stamp PTS and another Presentation Time Stamp PTS of video signal data error are more than the second scope, wherein the second model
Enclose and be more than or equal to the first scope.When less than the second scope, document-video in-pace module 526 is still made according to Presentation Time Stamp PTS
Set system clock STC performs the broadcasting step of document-video in-pace.When error is more than the second scope, then document-video in-pace mould is made
Block 526 stops performing the broadcasting step of document-video in-pace.
It will be understood by those skilled in the art that arriving, one of main spirits of the invention, it is program clock reference
Value PCR error amount within the scope of some, can utilize Presentation Time Stamp PTS turn one's head correction coding end reconstruction system clock
STC, as far as possible video signal is broadcast with message data syn-chronization.The present invention another main spirits, be when message data with
The Presentation Time Stamp PTS of video signal data directly abandons video signal and message data synchronization process when outside some scope, reduces wave
Take the computing resource and the energy of decoder.
In addition, the present invention does not limit specification of the above-mentioned audio-visual code stream to meet animation expert group MPEG.Only need
Want data packet of the audio-visual stream packet containing multiple clock reference values and multiple video signals and message, each data packet correspond to
One show value, and decoding end is used to rebuild a clock value according to the clock reference value, and utilize the clock value and those displays
Value carries out the step of document-video in-pace.Show value corresponding to each data packet can be directly contained in audio-visual code stream
It is interior, it can also be derived by other show values in audio-visual code stream.In one embodiment, above-mentioned clock reference value can be with
It is program clock reference value PCR, show value can be Presentation Time Stamp PTS, and clock value can be system clock STC.It is above-mentioned
Video signal and message data packet respectively comprising a video frame data and a message frame data.And above-mentioned document-video in-pace
The step of comprising it is following one of them：The data packet of at least one video signal is made to repeat to broadcast；Make the data of at least one message
Package repeats to broadcast；The data packet of at least one video signal is made not broadcast；And the data packet of at least one message is made not broadcast
Go out.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not limited to the claim of the present invention；
It is all other to depart from the equivalent change or modification completed under disclosed spirit, it is special that following applications all should be included in
Sharp scope.
Claims (22)
- A kind of 1. coding/decoding method of the audio-visual code stream of synchronization, wherein above-mentioned audio-visual stream packet regards containing multiple clock reference values with multiple The data packet of news and message, each data packet are corresponded to show value, and the coding/decoding method includes：Clock value is rebuild using the first clock reference value；Judge whether the error of the clock value and the first show value in the plurality of show value is more than the first scope；When the error of the clock value and first show value is more than first scope, it is the plurality of show value to change the clock value In the second show value；AndAn at least document-video in-pace step is performed using the clock value set by second show value.
- 2. coding/decoding method as claimed in claim 1, it is characterised in that further include：After an at least document-video in-pace step is performed, judge that second clock reference value and the 3rd in the plurality of show value are aobvious Whether the error of indicating value is less than first scope；AndWhen the error of the second clock reference value and the 3rd show value is less than first scope, referred to using the second clock Value rebuilds the clock value, wherein in the audio-visual code stream, the second clock reference value is after first clock reference value.
- 3. coding/decoding method as claimed in claim 2, it is characterised in that above-mentioned the second show value and the 3rd show value its One of correspond to video signal data package, it is another to correspond to message data packet.
- 4. coding/decoding method as claimed in claim 2, is further included：When the error of the second clock reference value and the 3rd show value is more than first scope, and the 3rd show value and the When the error of four show values is more than the second scope, stopping performs at least a document-video in-pace step, wherein the 3rd show value again Video signal data package is corresponded to one of the 4th show value, it is another to correspond to message data packet.
- 5. coding/decoding method as claimed in claim 4, it is characterised in that further include：When the error of the second clock reference value and the 3rd show value be more than first scope and the 3rd show value with this When the error of four show values is less than second scope, then perform an at least document-video in-pace step.
- 6. coding/decoding method as claimed in claim 4, it is characterised in that the second above-mentioned scope is more than or equal to first model Enclose.
- 7. coding/decoding method as claimed in claim 4, it is characterised in that the positive and negative boundary of the first above-mentioned scope and the second scope Asymmetry, and the positive boundary of second scope is more than the positive boundary of first scope, the negative boundary of second scope be less than this The negative boundary of two scopes.
- 8. coding/decoding method as claimed in claim 1, it is characterised in that when the error of the clock value and first show value is more than During first scope, further include and judge whether the error of the clock value and first show value surpasses more than the time of first scope The time limit is spent, is prescribed a time limit when more than this, the clock value is just changed and is set to second show value.
- 9. coding/decoding method as claimed in claim 1, it is characterised in that the second above-mentioned show value is equal to the first show value.
- 10. coding/decoding method as claimed in claim 1, it is characterised in that above-mentioned video signal and the data packet of message wrap respectively The data of data and message frame containing video frame (frame).
- 11. coding/decoding method as claimed in claim 1, it is characterised in that an above-mentioned at least document-video in-pace step includes following One of them：The data packet of at least one video signal is made to repeat to broadcast；The data packet of at least one message is made to repeat to broadcast；The data packet of at least one video signal is made not broadcast；AndThe data packet of at least one message is made not broadcast.
- A kind of 12. decoder of the audio-visual code stream of synchronization, wherein above-mentioned audio-visual stream packet regards containing multiple clock reference values with multiple The data packet of news and message, each data packet are corresponded to show value, and the decoder includes：Code stream read module, for rebuilding clock value according to the first clock reference value；Management module, for judging whether the error of the clock value and the first show value in the plurality of show value is more than the first model Enclose, when the error of the clock value and first show value is more than first scope, it is the plurality of show value to change the clock value In the second show value；AndDocument-video in-pace module, an at least document-video in-pace step is performed for the clock value according to set by second show value.
- 13. decoder as claimed in claim 12, it is characterised in that above-mentioned management module more be used for perform this at least one After document-video in-pace step, judge whether second clock reference value and the error of the 3rd show value in the plurality of show value are less than First scope；And when the error of the second clock reference value and the 3rd show value is less than first scope, make the code Stream read module rebuilds the clock value using the new second clock reference value, wherein in the audio-visual code stream, the second clock Reference value is after first clock reference value.
- 14. decoder as claimed in claim 13, it is characterised in that above-mentioned the second show value and the 3rd show value its One of correspond to video signal data package, it is another to correspond to message data packet.
- 15. decoder as claimed in claim 13, it is characterised in that above-mentioned management module is more used for when the second clock is joined When examining the error of value and the 3rd show value and being more than first scope, and the error of the 3rd show value and the 4th show value is more than During the second scope, make the document-video in-pace module stop performing an at least document-video in-pace step again, wherein the 3rd show value with One of 4th show value corresponds to video signal data package, another to correspond to message data packet.
- 16. decoder as claimed in claim 15, it is characterised in that above-mentioned management module is more used for when the second clock is joined The error for examining value and the 3rd show value is less than more than the error of first scope and the 3rd show value and the 4th show value During second scope, the document-video in-pace module is made to perform an at least document-video in-pace step again.
- 17. decoder as claimed in claim 15, it is characterised in that the second above-mentioned scope is more than or equal to first model Enclose.
- 18. decoder as claimed in claim 15, it is characterised in that the positive and negative boundary of the first above-mentioned scope and the second scope Asymmetry, and the positive boundary of second scope is more than the positive boundary of first scope, the negative boundary of second scope be less than this The negative boundary of two scopes.
- 19. decoder as claimed in claim 12, it is characterised in that above-mentioned management module judge when the clock value with this When the error of one show value is more than first scope, further include judge the clock value and first show value error be more than this Whether the time of one scope exceedes the time limit, is prescribed a time limit when more than this, and it is second show value just to change the clock value.
- 20. decoder as claimed in claim 12, it is characterised in that the second above-mentioned show value is equal to the first show value.
- 21. decoder as claimed in claim 12, it is characterised in that above-mentioned video signal and the data packet of message include respectively The data of video frame (frame) and the data of message frame.
- 22. decoder as claimed in claim 12, it is characterised in that above-mentioned document-video in-pace module be used for carry out it is following wherein One of：The data packet of at least one video signal is made to repeat to broadcast；The data packet of at least one message is made to repeat to broadcast；The data packet of at least one video signal is made not broadcast；AndThe data packet of at least one message is made not broadcast.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410043653.8A CN104811782B (en) | 2014-01-29 | 2014-01-29 | The decoder and coding/decoding method of synchronous audio-visual code stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410043653.8A CN104811782B (en) | 2014-01-29 | 2014-01-29 | The decoder and coding/decoding method of synchronous audio-visual code stream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104811782A CN104811782A (en) | 2015-07-29 |
| CN104811782B true CN104811782B (en) | 2018-03-02 |
Family
ID=53696197
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410043653.8A Expired - Fee Related CN104811782B (en) | 2014-01-29 | 2014-01-29 | The decoder and coding/decoding method of synchronous audio-visual code stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104811782B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106470291A (en) * | 2015-08-19 | 2017-03-01 | 飞思卡尔半导体公司 | Recover in the interruption in time synchronized from audio/video decoder |
| CN110858922A (en) * | 2018-08-23 | 2020-03-03 | 晨星半导体股份有限公司 | Operation method of digital video and audio device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102075806A (en) * | 2011-01-26 | 2011-05-25 | 四川长虹电器股份有限公司 | Audio and video synchronization method of digital television |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009028038A1 (en) * | 2007-08-27 | 2009-03-05 | Fujitsu Limited | Decoder and decoding method |
-
2014
- 2014-01-29 CN CN201410043653.8A patent/CN104811782B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102075806A (en) * | 2011-01-26 | 2011-05-25 | 四川长虹电器股份有限公司 | Audio and video synchronization method of digital television |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104811782A (en) | 2015-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107995155A (en) | Video data encoding, decoding, methods of exhibiting, video system and storage medium | |
| CN103873952B (en) | A kind of efficient video playback frame losing control system and its method | |
| TW201528793A (en) | Decoder and decoding method for audio video stream synchronization | |
| CN110278474A (en) | Method of reseptance, sending method, reception device and sending device | |
| CN100391261C (en) | Method of transmission flow multiplex | |
| US6868125B2 (en) | Transport stream to program stream conversion | |
| CN103929657A (en) | Video multiplexing apparatus, video multiplexing method, multiplexed video decoding apparatus, and multiplexed video decoding method | |
| CN108243350A (en) | A kind of method and apparatus of audio-visual synchronization processing | |
| CN101984672A (en) | Method and device for multi-thread video and audio synchronous control | |
| CN103458271A (en) | Audio-video file splicing method and audio-video file splicing device | |
| KR20160106150A (en) | Embedding encoded audio into transport stream for perfect splicing | |
| US7349395B2 (en) | System, method, and computer program product for parsing packetized, multi-program transport stream | |
| CN103828381B (en) | adaptive PID controller for audio/video clock recovery | |
| CN112929713B (en) | Data synchronization method, device, terminal and storage medium | |
| CN104811782B (en) | The decoder and coding/decoding method of synchronous audio-visual code stream | |
| CN106470291A (en) | Recover in the interruption in time synchronized from audio/video decoder | |
| CN103581730A (en) | Method for achieving synchronization of audio and video on digital set top box | |
| CN103024450B (en) | A kind of method and system being realized interactive TV by NFC technique | |
| CN105847990B (en) | The method and apparatus for playing media file | |
| US8269887B2 (en) | Image processing method, image processing program and image processing apparatus, and playback method, playback program and playback apparatus | |
| US8873639B2 (en) | System and method for demultiplexing an MPEG-2 transport stream | |
| CN105120323B (en) | A kind of method and system of distribution player task scheduling | |
| CN103596043A (en) | Method for converting TS into PS in digital television | |
| CN113630643B (en) | Media stream recording method and device, computer storage medium and electronic equipment | |
| CN103647970B (en) | Audio and video synchronization method and system for distributed transcoding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211027 Address after: China Taiwan Hsinchu Science Park Hsinchu city Dusing Road No. 1 Patentee after: MEDIATEK Inc. Address before: Taiwan Hsinchu County Tai Yuan Street China jhubei City, No. 26 4 floor 1 Patentee before: MSTAR SEMICONDUCTOR Inc. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180302 Termination date: 20220129 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |