CN106612452A - Audio-video synchronizing method and device of set top box - Google Patents
Audio-video synchronizing method and device of set top box Download PDFInfo
- Publication number
- CN106612452A CN106612452A CN201510691001.XA CN201510691001A CN106612452A CN 106612452 A CN106612452 A CN 106612452A CN 201510691001 A CN201510691001 A CN 201510691001A CN 106612452 A CN106612452 A CN 106612452A
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- audio
- per
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
- H04N7/52—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal
- H04N7/54—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal the signals being synchronous
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Receiver Circuits (AREA)
Abstract
The invention provides an audio and video synchronizing method of a set top box. The method comprises that when it is determined that a first frame of audio-video is output in a present synchronization queue, a time stamp of a video frame sequence in the present synchronization queue is obtained, and the time stamp is restored and predicted; the first frame of audio-video comprises a first audio frame and a first video frame; an ideal frame rate and a compensatory frame rate in the video frame sequence are calculated; according to the ideal frame rate and the compensatory frame rate, a repetitive frame rate of the video frame sequence is obtained; and according to the repetitive frame rate, the audio and video frames in the present synchronization queue are synchronized and output. Thus, an error of the time stamp for obtaining audio and video frames is reduced, and the audio and video synchronizing effect is improved. The invention also provides an audio and video synchronizing device of the set top box.
Description
Technical field
The present invention relates to Intelligent set top box technical field, more particularly to a kind of method of Set Top Box audio-visual synchronization
And device.
Background technology
With the popularization of broadband technology, top box of digital machine increasingly becomes the focus of smart home research.At present
Top box of digital machine expanded application, therefore, the quality of the audio-visual synchronization effect of Set Top Box is directly affected
To the Consumer's Experience of set-top box users.
Due to the demand and central processing unit (Center Processing Unit, CPU) of HD video quality
Resource constraint, current Set Top Box is needed in the audio frequency and video for completing to decode generally by the way of hardware decoding
Frame is sent to before display module and does synchronization process to audio/video frames, i.e. the frame per second of aobvious frame is currently sent in control, with
Guarantee that the reproduction time difference of audio/video frames is less.However, after this hardware decoding process is to audio/video frames decoding
There is larger error in the timestamp of acquisition, the synchronous effect of audio frequency and video is bad.
The content of the invention
In view of this, the embodiment of the present invention is expected to provide a kind of method and device of Set Top Box audio-visual synchronization,
To improve the effect of audio-visual synchronization.
What the technical scheme of the embodiment of the present invention was realized in：
A kind of method of Set Top Box audio-visual synchronization, including：
Determine when having exported the first frame audio frequency and video in current sync queue, obtain the current sync queue
In sequence of frames of video timestamp, and the timestamp is repaired and predicted；Wherein, described first
Frame audio frequency and video include the first frame audio frame and the first frame frame of video；
Calculate the preferable frame per second and compensation frame per second of the sequence of frames of video；
According to the preferable frame per second and the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained；
Repeat frame per second according to described, place is synchronized to the audio frame and frame of video in the current sync queue
Manage and export.
In said method, the preferable frame per second for calculating the sequence of frames of video and compensation frame per second, including：
According to the refresh rate and the timestamp of the sequence of frames of video of current display module, by low frame per second interleave
Algorithm and high frame per second frame losing algorithm calculate the preferable frame per second of the sequence of frames of video；
According to the difference between the timestamp of the sequence of frames of video and the timestamp of audio frame sequence, institute is calculated
State the compensation frame per second of sequence of frames of video.
It is described according to the preferable frame per second and the compensation frame per second in said method, obtain the frame of video sequence
The repetition frame per second of row, including：
The preferable frame per second is added with the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained.
It is described to repeat frame per second according to described in said method, to the audio frame in the current sync queue and
Frame of video synchronizes and processes and export, including：
If the frame per second that repeats is more than zero, by Video post-processing module when that front node enters is described current same
Step queue, and repeat frame number equal to the repetition frame per second；
If the frame per second that repeats is less than or equal to zero, current video frame, current sync described in synchronism output are abandoned
The audio frame in queue and the frame of video in addition to current video frame；
If the frame per second that repeats is equal to the preferable frame per second, with current sync described in preferable frame per second synchronism output
The audio frame and frame of video in queue；
If the frame per second that repeats is more than the preferable frame per second, the compensation frame per second is inserted in the frame of video
Individual repeating frame, so that the audio frame and the video frame synchronization output in the current sync queue.
In said method, export before the first frame audio frequency and video in the determination current sync queue, institute
Stating method also includes：
Judge the first frame sound whether is exported in the current sync queue according to the first frame audio frequency and video output identification position
Video；
If the first frame audio frequency and video output identification position is no, judge output is not the first frame sound
Video；
If the first frame audio frequency and video output identification position is yes, judge output is that the first frame sound is regarded
Frequently.
In said method, methods described also includes：
Determine when not exporting the first frame audio frequency and video in the current sync queue, according to default first frame sound
Video frequency output synchronization scenario exports the first frame audio frequency and video；Wherein, the default first frame audio frequency and video output
Synchronization scenario is slow synchronization scenario or fast synchronization scenario；
If the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario, described first is first exported
Frame frame of video, then other frame of video in the isochronous queue and audio frame are synchronized into output；
If the default first frame audio frequency and video output synchronization scenario is fast synchronization scenario, described the is exported simultaneously
One frame audio frame and the first frame frame of video.
It is described while export the first frame audio frame and the first frame frame of video in said method, including：
If detecting the first frame audio frame not arriving, the first frame frame of video is waited, and is not exported；
If detecting the first frame audio frame to arrive, judge whether the first frame audio frame exports；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video then exports the first frame audio frequency and video in Preset Time difference scope, and will
First frame audio frequency and video output identification position is no；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video not the Preset Time difference scope in, then in the first frame frame of video ratio
When the first frame audio frame is fast, the first frame frame of video is waited, in the first frame frame of video than described
When first frame audio frame is slow, the first frame frame of video is abandoned；
If the first frame audio frame is exported, the first frame frame of video is exported, and the first frame sound is regarded
Frequency output identification position is no.
It is described to be judged in the current sync queue according to the first frame audio frequency and video output identification position in said method
Before whether exporting the first frame audio frequency and video, methods described also includes：
Judge whether the input frame number in the current sync queue meets default frame number, and judge to show queue
Whether overflow；
When the input frame number in the current sync queue meets the default frame number, and the display queue is not
During spilling, the operation whether first frame audio frequency and video judged in the current sync queue export is performed.
A kind of device of Set Top Box audio-visual synchronization, described device includes：
Determining module, for determining current sync queue in exported the first frame audio frequency and video；
Acquisition module, for having exported described first in determining the current sync queue in the determining module
During frame audio frequency and video, the timestamp of the sequence of frames of video in the current sync queue is obtained, and to the time
Stamp is repaired and predicted；The first frame audio frequency and video include the first frame audio frame and the first frame frame of video；
Computing module, for calculating the preferable frame per second and compensation frame per second of the sequence of frames of video；
The acquisition module is used for according to the preferable frame per second and the compensation frame per second, obtains the frame of video sequence
The repetition frame per second of row；Repeat frame per second according to described, to audio frame and frame of video in the current sync queue
Synchronize and process and export.
In said apparatus, the computing module specifically for：According to the refresh rate of current display module and described
The timestamp of sequence of frames of video, by low frame per second interleave algorithm and high frame per second frame losing algorithm the frame of video is calculated
The preferable frame per second of sequence；According between the timestamp of the sequence of frames of video and the timestamp of audio frame sequence
Difference, calculates the compensation frame per second of the sequence of frames of video.
In said apparatus, the acquisition module specifically for：
The preferable frame per second is added with the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained.
In said apparatus, the acquisition module specifically for：
If the frame per second that repeats is more than zero, by Video post-processing module when that front node enters is described current same
Step queue, and repeat frame number equal to the repetition frame per second；
If the frame per second that repeats is less than or equal to zero, current video frame, current sync described in synchronism output are abandoned
The audio frame in queue and the frame of video in addition to current video frame；
If the frame per second that repeats is equal to the preferable frame per second, with current sync described in preferable frame per second synchronism output
The audio frame and frame of video in queue；
If the frame per second that repeats is more than the preferable frame per second, the compensation frame per second is inserted in the frame of video
Individual repeating frame, so that the audio frame and the video frame synchronization output in the current sync queue.
In said apparatus, described device also includes：Judge module, for being marked according to the output of the first frame audio frequency and video
Know position and judge the first frame audio frequency and video whether are exported in the current sync queue；If the first frame audio frequency and video are defeated
It is no to go out home position, then judge output is not the first frame audio frequency and video；If the first frame audio frequency and video
Output identification position is yes, then judge output is the first frame audio frequency and video.
In said apparatus, the acquisition module is additionally operable to：Determine the current sync team in the determining module
When the first frame audio frequency and video are not exported in row, according to default first frame audio frequency and video output synchronization scenario output institute
State the first frame audio frequency and video；Wherein, the default first frame audio frequency and video output synchronization scenario be slow synchronization scenario or
The fast synchronization scenario of person；
If the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario, the acquisition module elder generation
The first frame frame of video is exported, then other frame of video in the isochronous queue are synchronized with audio frame
Output；
If the default first frame audio frequency and video output synchronization scenario is fast synchronization scenario, the acquisition module is same
When export the first frame audio frame and the first frame frame of video.
In said apparatus, the acquisition module specifically for：
If detecting the first frame audio frame not arriving, the first frame frame of video is waited, and is not exported；
If detecting the first frame audio frame to arrive, judge whether the first frame audio frame exports；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video then exports the first frame audio frequency and video in Preset Time difference scope, and will
First frame audio frequency and video output identification position is no；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video not the Preset Time difference scope in, then in the first frame frame of video ratio
When the first frame audio frame is fast, the first frame frame of video is waited, in the first frame frame of video than described
When first frame audio frame is slow, the first frame frame of video is abandoned；
If the first frame audio frame is exported, the first frame frame of video is exported, and the first frame sound is regarded
Frequency output identification position is no.
In said apparatus, the judge module is additionally operable to：
Judge whether the input frame number in the current sync queue meets default frame number, and judge to show queue
Whether overflow；
Input frame number in the judge module judges the current sync queue meets the default frame number,
And the display queue is not when overflowing, the processing module is performed and described judged in the current sync queue
The operation whether the first frame audio frequency and video export.
The method and device of Set Top Box audio-visual synchronization provided in an embodiment of the present invention, by determining current sync
When having exported the first frame audio frequency and video in queue, the sequence of frames of video in the acquisition current sync queue
Timestamp, and the timestamp is repaired and predicted；The first frame audio frequency and video include the first frame audio frequency
Frame and the first frame frame of video；Calculate the preferable frame per second and compensation frame per second of the sequence of frames of video；According to the reason
Think frame per second and the compensation frame per second, obtain the repetition frame per second of the sequence of frames of video；Repeat frame per second according to described,
Audio frame and frame of video in the current sync queue is synchronized and is processed and is exported；Thus, can reduce
The error of the timestamp of audio/video frames is obtained, so as to improve the synchronous effect of audio frequency and video.
Description of the drawings
Fig. 1 is the flow chart of the method for Set Top Box audio-visual synchronization provided in an embodiment of the present invention；
Fig. 2 is the structural representation of the device of Set Top Box audio-visual synchronization provided in an embodiment of the present invention.
Specific embodiment
In the various embodiments of the invention, using the timestamp of audio frame as time standard, in synchronizing process,
The main frame per second that frame of video is adjusted according to the time tolerance of audio frequency and video, to be waited audio frame or be abandoned
Frame of video, so as to realize that frame of video is synchronous with audio frame, so as to reduce the timestamp for obtaining audio/video frames
Error, improve the synchronous effect of audio frequency and video.
Fig. 1 is the flow chart of the method for Set Top Box audio-visual synchronization provided in an embodiment of the present invention.Such as Fig. 1 institutes
Show, the method for the Set Top Box audio-visual synchronization that the present embodiment is provided specifically can include：
Step 101, determine when having exported the first frame audio frequency and video in current sync queue, obtain described working as
The timestamp of the sequence of frames of video in preamble queue, and the timestamp is repaired and predicted；It is described
First frame audio frequency and video include the first frame audio frame and the first frame frame of video.
If current sync queue output is not the first frame audio frequency and video, i.e. the first frame audio frequency and video have been exported, then
Need that the timestamp of sequence of frames of video is repaired and predicted.
Specifically, in playing process, normal pts sequences have the characteristics of being constantly incremented by, i.e.,
pts1<pts2<pts3<Pts4, if the pts sequences for being unsatisfactory for this condition are all judged as abnormal pts.This enforcement
Three kinds of abnormal morphologies are enumerated in example to illustrate.
Abnormal morphology 1：pts1<pts2,pts2>pts4>Pts3, when direct broadcast band occur winding (film source circulation broadcast,
Head and the tail tie point), it may appear that this kind of form；Some built-in variables by synchronization module are needed to reset under this exception,
Expression restarts to play, and does not go to repair pts；Abnormal morphology 2：pts1<pts2<pts3,p3>pts4>p2；This
Plant needs to repair pts3 under form, and restorative procedure is pts3=pts2+delay；Delay represents preferable interframe
Pts is poor；Abnormal morphology 3：p3<p1<p2<p4；Need to repair pts3 under this form, restorative procedure is
Pts3=pts2+delay；Wherein, delay represents that preferable interframe pts is poor, by counting regarding for front 100 frame
The distribution of the pts differences of two frames, takes the pts differences of maximum probability as preferable delay before and after frequency.
For pts predictions：If by interlaced video after de interlacing process, frame per second is double, i.e., originally
Each field become a frame after interpolation, each frame originally reforms into two frames, and a frame is using original
The pts of frame takes current original frame with the pts averages of next primitive frame as pre- as pts, the in addition pts of a frame
The pts of survey.
In the present embodiment, before it is determined that having exported the first frame audio frequency and video in current sync queue, in addition it is also necessary to root
Judge the first frame audio frequency and video whether are exported in the current sync queue according to the first frame audio frequency and video output identification position；
If the first frame audio frequency and video output identification position is no, judge output is not the first frame audio frequency and video；
If the first frame audio frequency and video output identification position is yes, judge output is the first frame audio frequency and video.
For example, can arrange when the first frame audio frequency and video output identification position is 1, show the first frame sound
Video is exported, is not now the first frame audio frequency and video when what is will exported in isochronous queue, is shown when being set to 0
The first frame audio frequency and video are not exported, and are now the first frame audio frequency and video when what is will exported in isochronous queue；Or
Person can be arranged when the first frame audio frequency and video output identification position is 0, show that the first frame audio frequency and video are defeated
Go out, show that the first frame audio frequency and video are not exported when being set to 1.The present embodiment is not particularly limited to this.
Judging whether export the first frame in the current sync queue according to the first frame audio frequency and video output identification position
Before audio frequency and video, in addition it is also necessary to judge whether the input frame number in the current sync queue meets default frame number,
And judge to show whether queue overflows；When the input frame number in the current sync queue meets the default frame
Number, and the display queue performs the first frame sound judged in the current sync queue when not overflowing
The operation whether video exports.
Judge whether the input frame number in current sync queue meets default frame number, in the present embodiment, for every
For row film source is exported line by line, it is desirable to which frame number is more than or equal to 3, then require that frame number is more than or equal to 2 in the case of other.
Further, determine when not exporting the first frame audio frequency and video in the current sync queue, according to pre-
If the first frame audio frequency and video output synchronization scenario exports the first frame audio frequency and video, terminate this handling process.
It should be noted that the default first frame audio frequency and video output synchronization scenario is the real needs according to client
Pre-set, when the first frame audio frequency and video are exported in judging current sync queue, can be according to default
First frame audio frequency and video output synchronization scenario is exported to the first frame audio frequency and video.
Specifically, the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario or fast synchronization scenario；
If the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario, first exports first frame and regard
Frequency frame, then other frame of video in the isochronous queue and audio frame are synchronized into output, i.e. it is slow synchronous
Scheme requires that the first frame frame of video is exported immediately, will be regarded by synchronization scenario again after the first frame frame of video is exported
Frequency frame and audio frequency frame synchronization；If the default first frame audio frequency and video output synchronization scenario is fast synchronization scenario,
Export the first frame audio frame and the first frame frame of video simultaneously, i.e. in fast synchronization scenario, it is desirable to
Audio frequency and video are exported and synchronous in output simultaneously.
In fast synchronization scenario, while the first frame audio frame and the first frame frame of video are exported, specifically
Can include：If detecting the first frame audio frame not arriving, the first frame frame of video is waited, and is not entered
Row output；If detecting the first frame audio frame to arrive, judge whether the first frame audio frame exports；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and the first frame video
The difference of the timestamp of frame then exports the first frame audio frequency and video in Preset Time difference scope, and by first
Frame audio frequency and video output identification position is no；If the first frame audio frame is not exported, and the first frame audio frequency
The difference of the timestamp of frame and the timestamp of the first frame frame of video not in the poor scope of the Preset Time,
Then when the first frame frame of video is faster than the first frame audio frame, the first frame frame of video is waited,
When the first frame frame of video is slower than the first frame audio frame, the first frame frame of video is abandoned；If described
First frame audio frame is exported, then export the first frame frame of video, and by the first frame audio frequency and video output identification
Position is no.
In addition it should be noted that, if it exceeds 1.5s audio frequency and video do not have synchronization or audio frame not to arrive, then
First frame frame of video is forced to export.
Step 102, the preferable frame per second for calculating the sequence of frames of video and compensation frame per second.
In this step, according to the refresh rate and the timestamp of the sequence of frames of video of current display module, pass through
Low frame per second interleave algorithm and high frame per second frame losing algorithm calculate preferable frame per second idea_repeat of the sequence of frames of video；
According to the difference between the timestamp of the sequence of frames of video and the timestamp of audio frame sequence, regard described in calculating
Compensation frame per second extra_repeat of frequency frame sequence.
Specifically, the high frame per second frame losing algorithm for adopting in the present embodiment for：Three frames lose present frame across two cycles,
By taking display module time delay 20ms as an example：Obtain three out of synchronous input rank (Video post-processing) order
Frame pts, is designated as pts0, pts1, pts2, and synchronism output queue tail frame pts, synchronous input rank are corresponded to respectively
Head frame pts, synchronous input rank the second frame pts；If (pts2-pts0)>2*20ms, then prepare to lose pts1 pair
The frame of video answered；Otherwise it is assumed that being low frame per second film source, algorithm is exited；If showing, the frame number pressed in queue is inadequate
N frames (empirical value), then do not allow to lose frame of video and now realize audio frequency etc. by inserting a small amount of voice data
The effect of video is treated, current video frame is otherwise lost.
Specifically, in the low frame per second interleave algorithm for adopting in the present embodiment, guarantee is needed to send aobvious frequency to surpass
Go out the refresh rate of display module, so as to ensure that each valid frame is stopped suitably on screen by inserting repeating frame
Time.
Because preferable frame per second simply considers the impact of the refresh rate of display module, with guarantee the decoding of video with
Playing can be smooth, does not consider the synchronization between audio frequency and video, is exactly according to audio frequency by audio video synchronization to audio frequency
Broadcasting speed interleave or frame losing are carried out to frame of video, referred to as compensate frame per second extra_repeat.
Step 103, according to the preferable frame per second and the compensation frame per second, obtain the weight of the sequence of frames of video
Multi-frame rate.
The preferable frame per second is added with the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained
all_repeat；Specifically, all_repeat=idea_repeat+extra_repeat.
Step 104, according to it is described repeat frame per second, to audio frame and frame of video in the current sync queue
Synchronize and process and export.
If the frame per second that repeats is more than zero, by Video post-processing module when that front node enters is described current same
Step queue, and repeat frame number equal to the repetition frame per second；If the frame per second that repeats is less than or equal to zero, abandon
Current video frame, the audio frame in current sync queue described in synchronism output and in addition to current video frame
Frame of video；If the frame per second that repeats is equal to the preferable frame per second, with current described in preferable frame per second synchronism output
The audio frame and frame of video in isochronous queue；If the frame per second that repeats is more than the preferable frame per second, to
The compensation frame per second repeating frame is inserted in the frame of video, so that the sound in the current sync queue
Frequency frame and the video frame synchronization are exported.
That is, if all_repeat>0, represent that Video post-processing module, when front node enters isochronous queue, repeats
Frame number is all_repeat, if all_repeat=idea_repeat is represented with the broadcasting of preferable frame per second, if
all_repeat>Idea_repeat represents that video is faster than audio frequency, and being compared to preferable frame per second needs another insertion
Extra_repeat repeating frame is compensated to frame per second, it is ensured that audio frequency and video can be synchronous；If all_repeat<=0,
Represent that video is slower than audio frequency, need to abandon present frame, for present frame can insert multiple repeating frames but at most
A frame can be lost.
In actual applications, to prevent picture from occurring freezing, extra_repeat is worked as<0 judges to lose as frame losing,
Now the display queuing data of display module is not enough, then by extra_repeat=1；To prevent picture interim card, most
Continuously lose 3 frames more；To prevent the excessive picture of repeating frame from living, for a frame node enters isochronous queue, most
Insert 3 repeating frames more；Play smooth to ensure that broadcasting starts former frame pictures, in the former frames for playing beginning
Extra_repeat at most inserts 1 repeating frame and compensates.
The technical scheme of the present embodiment, it is possible to reduce obtain the error of the timestamp of audio/video frames, improves sound and regards
The synchronous effect of frequency.
Fig. 2 is the structural representation of the device of Set Top Box audio-visual synchronization provided in an embodiment of the present invention.As schemed
Shown in 2, the device that the present embodiment is provided can include：
Determining module 11, for determining current sync queue in exported the first frame audio frequency and video；
Acquisition module 12, for having exported described in determining the current sync queue in the determining module
During one frame audio frequency and video, obtain the timestamp of the sequence of frames of video in the current sync queue, and to it is described when
Between stamp repaired and predicted；The first frame audio frequency and video include the first frame audio frame and the first frame frame of video；
Computing module 13, for calculating the preferable frame per second and compensation frame per second of the sequence of frames of video；
The acquisition module 12 is used for according to the preferable frame per second and the compensation frame per second, obtains the frame of video
The repetition frame per second of sequence；Repeat frame per second according to described, to audio frame and video in the current sync queue
Frame synchronizes and processes and export.
The computing module 13 specifically for：According to the refresh rate and the sequence of frames of video of current display module
Timestamp, the ideal of the sequence of frames of video is calculated by low frame per second interleave algorithm and high frame per second frame losing algorithm
Frame per second；According to the difference between the timestamp of the sequence of frames of video and the timestamp of audio frame sequence, calculate
The compensation frame per second of the sequence of frames of video.
The acquisition module 12 specifically for：The preferable frame per second is added with the compensation frame per second, institute is obtained
State the repetition frame per second of sequence of frames of video；If the frame per second that repeats is more than zero, working as Video post-processing module
Front node enters the current sync queue, and repeats frame number equal to the repetition frame per second；If the repeating frame
Rate is less than or equal to zero, then abandon current video frame, the audio frequency in current sync queue described in synchronism output
Frame and the frame of video in addition to current video frame；If the frame per second that repeats is equal to the preferable frame per second, with ideal
The audio frame and frame of video in current sync queue described in frame per second synchronism output；If the repetition frame per second is big
In the preferable frame per second, then frame per second repeating frame is repaid described in insertion in the frame of video, so that described current
The audio frame and video frame synchronization output in isochronous queue.
Further, described device can also include judge module, for being marked according to the output of the first frame audio frequency and video
Know position and judge the first frame audio frequency and video whether are exported in the current sync queue；If the first frame audio frequency and video are defeated
It is no to go out home position, then judge output is not the first frame audio frequency and video；If the first frame audio frequency and video
Output identification position is yes, then judge output is the first frame audio frequency and video.
Further, the acquisition module 12 can be also used for：Determine in determining module 11 described current same
It is defeated according to default first frame audio frequency and video output synchronization scenario when not exporting the first frame audio frequency and video in step queue
Go out the first frame audio frequency and video；Wherein, the default first frame audio frequency and video output synchronization scenario is slow synchronization side
Case or fast synchronization scenario；If the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario,
The acquisition module 12 first exports the first frame frame of video, then by other frame of video in the isochronous queue
Output is synchronized with audio frame；If the default first frame audio frequency and video output synchronization scenario is fast synchronization scenario,
Then the acquisition module 12 exports the first frame audio frame and the first frame frame of video simultaneously.
Specifically, the acquisition module 12 specifically can be used for：If detecting the first frame audio frame not arriving,
Then the first frame frame of video is waited, and is not exported；If detecting the first frame audio frame to arrive, sentence
Whether the first frame audio frame that breaks exports；If the first frame audio frame is not exported, and the first frame sound
The difference of the timestamp of frequency frame and the timestamp of the first frame frame of video is in the poor scope of Preset Time, then defeated
Go out the first frame audio frequency and video, and be to export by the first frame audio frequency and video output identification position；If described first
Frame audio frame is not exported, and the timestamp of the timestamp of the first frame audio frame and the first frame frame of video
Difference not the Preset Time difference scope in, then in the first frame frame of video than the first frame audio frequency
When frame is fast, the first frame frame of video is waited, slower than the first frame audio frame in the first frame frame of video
When, abandon the first frame frame of video；If the first frame audio frame is exported, first frame is exported
Frame of video, and be to export by the first frame audio frequency and video output identification position.
The judge module can be also used for：Judge whether the input frame number in the current sync queue meets
Default frame number, and judge to show whether queue overflows；When the judge module judges the current sync queue
In input frame number meet the default frame number, and the display queue, when not overflowing, the processing module is held
The operation whether the row first frame audio frequency and video judged in the current sync queue export.
The device of the Set Top Box audio-visual synchronization of the present embodiment, can be used for performing method reality shown in above-mentioned Fig. 1
The technical scheme of example is applied, it realizes that principle is similar with technique effect, and here is omitted.
In actual applications, the determining module 11, acquisition module 12 and computing module 13 can be by positioned at users
Central processing unit (CPU), microprocessor (MPU), digital signal processor (DSP) in terminal or
The devices such as field programmable gate array (FPGA) are realized.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or meter
Calculation machine program product.Therefore, the present invention can using hardware embodiment, software implementation or with reference to software and
The form of the embodiment of hardware aspect.And, the present invention can be adopted and wherein include calculating at one or more
Computer-usable storage medium (including but not limited to magnetic disc store and the optical storage of machine usable program code
Device etc.) on implement computer program form.
The present invention is with reference to method according to embodiments of the present invention, equipment (system) and computer program
Flow chart and/or block diagram describing.It should be understood that can be by computer program instructions flowchart and/or side
The knot of each flow process and/or square frame and flow chart and/or the flow process in block diagram and/or square frame in block diagram
Close.Can provide these computer program instructions to all-purpose computer, special-purpose computer, Embedded Processor or
The processor of other programmable data processing devices is producing a machine so that by computer or other can
The instruction of the computing device of programming data processing equipment is produced for realizing in one flow process or multiple of flow chart
The device of the function of specifying in one square frame of flow process and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing devices
In the computer-readable memory for working in a specific way so that in being stored in the computer-readable memory
Instruction produces the manufacture for including command device, and the command device is realized in one flow process of flow chart or multiple streams
The function of specifying in one square frame of journey and/or block diagram or multiple square frames.
These computer program instructions also can be loaded in computer or other programmable data processing devices, made
Obtain and series of operation steps performed on computer or other programmable devices to produce computer implemented process,
So as to the instruction performed on computer or other programmable devices is provided for realizing in one flow process of flow chart
Or specify in one square frame of multiple flow processs and/or block diagram or multiple square frames function the step of.
The above, only presently preferred embodiments of the present invention is not intended to limit the protection model of the present invention
Enclose.
Claims (16)
1. a kind of method of Set Top Box audio-visual synchronization, it is characterised in that methods described includes：
Determine when having exported the first frame audio frequency and video in current sync queue, obtain the current sync queue
In sequence of frames of video timestamp, and the timestamp is repaired and predicted；Wherein, described first
Frame audio frequency and video include the first frame audio frame and the first frame frame of video；
Calculate the preferable frame per second and compensation frame per second of the sequence of frames of video；
According to the preferable frame per second and the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained；
Repeat frame per second according to described, place is synchronized to the audio frame and frame of video in the current sync queue
Manage and export.
2. method according to claim 1, it is characterised in that the calculating sequence of frames of video
Preferable frame per second and compensation frame per second, including：
According to the refresh rate and the timestamp of the sequence of frames of video of current display module, by low frame per second interleave
Algorithm and high frame per second frame losing algorithm calculate the preferable frame per second of the sequence of frames of video；
According to the difference between the timestamp of the sequence of frames of video and the timestamp of audio frame sequence, institute is calculated
State the compensation frame per second of sequence of frames of video.
3. method according to claim 1, it is characterised in that described according to the preferable frame per second and institute
Compensation frame per second is stated, the repetition frame per second of the sequence of frames of video is obtained, including：
The preferable frame per second is added with the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained.
4. method according to claim 1, it is characterised in that described to repeat frame per second according to described is right
Audio frame and frame of video in the current sync queue synchronizes and processes and export, including：
If the frame per second that repeats is more than zero, by Video post-processing module when that front node enters is described current same
Step queue, and repeat frame number equal to the repetition frame per second；
If the frame per second that repeats is less than or equal to zero, current video frame, current sync described in synchronism output are abandoned
The audio frame in queue and the frame of video in addition to current video frame；
If the frame per second that repeats is equal to the preferable frame per second, with current sync described in preferable frame per second synchronism output
The audio frame and frame of video in queue；
If the frame per second that repeats is more than the preferable frame per second, the compensation frame per second is inserted in the frame of video
Individual repeating frame, so that the audio frame and the video frame synchronization output in the current sync queue.
5. method according to claim 1, it is characterised in that in the determination current sync queue
Before exporting the first frame audio frequency and video, methods described also includes：
Judge the first frame sound whether is exported in the current sync queue according to the first frame audio frequency and video output identification position
Video；
If the first frame audio frequency and video output identification position is no, judge output is not the first frame sound
Video；
If the first frame audio frequency and video output identification position is yes, judge output is that the first frame sound is regarded
Frequently.
6. method according to claim 1, it is characterised in that methods described also includes：
Determine when not exporting the first frame audio frequency and video in the current sync queue, according to default first frame sound
Video frequency output synchronization scenario exports the first frame audio frequency and video；Wherein, the default first frame audio frequency and video output
Synchronization scenario is slow synchronization scenario or fast synchronization scenario；
If the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario, described first is first exported
Frame frame of video, then other frame of video in the isochronous queue and audio frame are synchronized into output；
If the default first frame audio frequency and video output synchronization scenario is fast synchronization scenario, described the is exported simultaneously
One frame audio frame and the first frame frame of video.
7. method according to claim 6, it is characterised in that described while output the first frame sound
Frequency frame and the first frame frame of video, including：
If detecting the first frame audio frame not arriving, the first frame frame of video is waited, and is not exported；
If detecting the first frame audio frame to arrive, judge whether the first frame audio frame exports；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video then exports the first frame audio frequency and video in Preset Time difference scope, and will
First frame audio frequency and video output identification position is no；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video not the Preset Time difference scope in, then in the first frame frame of video ratio
When the first frame audio frame is fast, the first frame frame of video is waited, in the first frame frame of video than described
When first frame audio frame is slow, the first frame frame of video is abandoned；
If the first frame audio frame is exported, the first frame frame of video is exported, and the first frame sound is regarded
Frequency output identification position is no.
8. method according to claim 5, it is characterised in that described to be exported according to the first frame audio frequency and video
Flag judges whether export in the current sync queue before the first frame audio frequency and video, and methods described also includes：
Judge whether the input frame number in the current sync queue meets default frame number, and judge to show queue
Whether overflow；
When the input frame number in the current sync queue meets the default frame number, and the display queue is not
During spilling, the operation whether first frame audio frequency and video judged in the current sync queue export is performed.
9. a kind of device of Set Top Box audio-visual synchronization, it is characterised in that described device includes：
Determining module, for determining current sync queue in exported the first frame audio frequency and video；
Acquisition module, for having exported described first in determining the current sync queue in the determining module
During frame audio frequency and video, the timestamp of the sequence of frames of video in the current sync queue is obtained, and to the time
Stamp is repaired and predicted；The first frame audio frequency and video include the first frame audio frame and the first frame frame of video；
Computing module, for calculating the preferable frame per second and compensation frame per second of the sequence of frames of video；
The acquisition module is used for according to the preferable frame per second and the compensation frame per second, obtains the frame of video sequence
The repetition frame per second of row；Repeat frame per second according to described, to audio frame and frame of video in the current sync queue
Synchronize and process and export.
10. device according to claim 9, it is characterised in that the computing module specifically for：
According to the refresh rate and the timestamp of the sequence of frames of video of current display module, by low frame per second interleave algorithm
With the preferable frame per second that high frame per second frame losing algorithm calculates the sequence of frames of video；According to the sequence of frames of video when
Between difference between stamp and the timestamp of audio frame sequence, calculate the compensation frame per second of the sequence of frames of video.
11. devices according to claim 9, it is characterised in that the acquisition module specifically for：
The preferable frame per second is added with the compensation frame per second, the repetition frame per second of the sequence of frames of video is obtained.
12. devices according to claim 9, it is characterised in that the acquisition module specifically for：
If the frame per second that repeats is more than zero, by Video post-processing module when that front node enters is described current same
Step queue, and repeat frame number equal to the repetition frame per second；
If the frame per second that repeats is less than or equal to zero, current video frame, current sync described in synchronism output are abandoned
The audio frame in queue and the frame of video in addition to current video frame；
If the frame per second that repeats is equal to the preferable frame per second, with current sync described in preferable frame per second synchronism output
The audio frame and frame of video in queue；
If the frame per second that repeats is more than the preferable frame per second, the compensation frame per second is inserted in the frame of video
Individual repeating frame, so that the audio frame and the video frame synchronization output in the current sync queue.
13. devices according to claim 9, it is characterised in that described device also includes：Judge mould
Block, for judging whether export first in the current sync queue according to the first frame audio frequency and video output identification position
Frame audio frequency and video；If the first frame audio frequency and video output identification position is no, judge output is not described the
One frame audio frequency and video；If the first frame audio frequency and video output identification position is yes, judge output is described the
One frame audio frequency and video.
14. devices according to claim 9, it is characterised in that the acquisition module is additionally operable to：
The determining module is determined when not exporting the first frame audio frequency and video in the current sync queue, according to default
First frame audio frequency and video output synchronization scenario exports the first frame audio frequency and video；Wherein, the default first frame sound
Video frequency output synchronization scenario is slow synchronization scenario or fast synchronization scenario；
If the default first frame audio frequency and video output synchronization scenario is slow synchronization scenario, the acquisition module elder generation
The first frame frame of video is exported, then other frame of video in the isochronous queue are synchronized with audio frame
Output；
If the default first frame audio frequency and video output synchronization scenario is fast synchronization scenario, the acquisition module is same
When export the first frame audio frame and the first frame frame of video.
15. devices according to claim 14, it is characterised in that the acquisition module specifically for：
If detecting the first frame audio frame not arriving, the first frame frame of video is waited, and is not exported；
If detecting the first frame audio frame to arrive, judge whether the first frame audio frame exports；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video then exports the first frame audio frequency and video in Preset Time difference scope, and will
First frame audio frequency and video output identification position is no；
If the first frame audio frame is not exported, and the timestamp of the first frame audio frame and first frame
The difference of the timestamp of frame of video not the Preset Time difference scope in, then in the first frame frame of video ratio
When the first frame audio frame is fast, the first frame frame of video is waited, in the first frame frame of video than described
When first frame audio frame is slow, the first frame frame of video is abandoned；
If the first frame audio frame is exported, the first frame frame of video is exported, and the first frame sound is regarded
Frequency output identification position is no.
16. devices according to claim 13, it is characterised in that the judge module is additionally operable to：
Judge whether the input frame number in the current sync queue meets default frame number, and judge to show queue
Whether overflow；
Input frame number in the judge module judges the current sync queue meets the default frame number,
And the display queue is not when overflowing, the processing module is performed and described judged in the current sync queue
The operation whether the first frame audio frequency and video export.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510691001.XA CN106612452B (en) | 2015-10-22 | 2015-10-22 | method and device for synchronizing audio and video of set top box |
| PCT/CN2016/102775 WO2017067489A1 (en) | 2015-10-22 | 2016-10-20 | Set-top box audio-visual synchronization method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510691001.XA CN106612452B (en) | 2015-10-22 | 2015-10-22 | method and device for synchronizing audio and video of set top box |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106612452A true CN106612452A (en) | 2017-05-03 |
| CN106612452B CN106612452B (en) | 2019-12-13 |
Family
ID=58556676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510691001.XA Active CN106612452B (en) | 2015-10-22 | 2015-10-22 | method and device for synchronizing audio and video of set top box |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106612452B (en) |
| WO (1) | WO2017067489A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108379832A (en) * | 2018-01-29 | 2018-08-10 | 珠海金山网络游戏科技有限公司 | A kind of game synchronization method and apparatus |
| CN108495164A (en) * | 2018-04-09 | 2018-09-04 | 珠海全志科技股份有限公司 | Audio-visual synchronization processing method and processing device, computer installation and storage medium |
| CN109711421A (en) * | 2017-10-25 | 2019-05-03 | 腾讯科技（深圳）有限公司 | A kind of data processing method and device |
| CN111355989A (en) * | 2018-12-21 | 2020-06-30 | 深圳市中兴微电子技术有限公司 | Frame rate control method and related equipment |
| CN112825562A (en) * | 2019-11-21 | 2021-05-21 | 杭州海康威视数字技术股份有限公司 | Video frame compensation method and device and video processing chip |
| CN113573119A (en) * | 2021-06-15 | 2021-10-29 | 荣耀终端有限公司 | Method and device for generating time stamp of multimedia data |
| CN113949898A (en) * | 2021-10-13 | 2022-01-18 | 北京奇艺世纪科技有限公司 | Multimedia processing method, device, equipment and storage medium |
| WO2023029936A1 (en) * | 2020-10-13 | 2023-03-09 | 杭州涂鸦信息技术有限公司 | Audio and video synchronization method and apparatus based on different reference clocks, and computer device |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113157228B (en) * | 2021-02-01 | 2022-07-05 | 中国船舶重工集团公司第七0九研究所 | Display control device and method for multi-source frame rate interactive high frame rate |
| CN114268830B (en) * | 2021-12-06 | 2024-05-24 | 咪咕文化科技有限公司 | Cloud guide synchronization method, device, equipment and storage medium |
| CN114302169B (en) * | 2021-12-24 | 2023-03-07 | 威创集团股份有限公司 | Picture synchronous recording method, device, system and computer storage medium |
| CN114512139B (en) * | 2022-04-18 | 2022-09-20 | 杭州星犀科技有限公司 | Processing method and system for multi-channel audio mixing, mixing processor and storage medium |
| CN115334344B (en) * | 2022-08-08 | 2023-08-18 | 青岛海信宽带多媒体技术有限公司 | Channel switching method and device applied to intelligent set top box |
| CN116233472B (en) * | 2023-05-08 | 2023-07-18 | 湖南马栏山视频先进技术研究院有限公司 | Audio and video synchronization method and cloud processing system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101207822A (en) * | 2006-12-22 | 2008-06-25 | 上海晨兴电子科技有限公司 | Method for synchronization of audio frequency and video frequency of stream media terminal |
| CN101771869A (en) * | 2008-12-30 | 2010-07-07 | 深圳市万兴软件有限公司 | AV (audio/video) encoding and decoding device and method |
| EP2334049A2 (en) * | 2009-12-14 | 2011-06-15 | QNX Software Systems GmbH & Co. KG | Synchronization of video presentation by video cadence modification |
| CN102685437A (en) * | 2012-02-03 | 2012-09-19 | 深圳市创维群欣安防科技有限公司 | Method and monitor for compensating video image |
| CN103167342A (en) * | 2013-03-29 | 2013-06-19 | 天脉聚源(北京)传媒科技有限公司 | Audio and video synchronous processing device and method |
| CN103581730A (en) * | 2013-10-28 | 2014-02-12 | 南京熊猫电子股份有限公司 | Method for achieving synchronization of audio and video on digital set top box |
| CN104378675A (en) * | 2014-12-08 | 2015-02-25 | 厦门雅迅网络股份有限公司 | Multichannel audio-video synchronized playing processing method |
| US20150062353A1 (en) * | 2013-08-30 | 2015-03-05 | Microsoft Corporation | Audio video playback synchronization for encoded media |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
-
2015
- 2015-10-22 CN CN201510691001.XA patent/CN106612452B/en active Active
-
2016
- 2016-10-20 WO PCT/CN2016/102775 patent/WO2017067489A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101207822A (en) * | 2006-12-22 | 2008-06-25 | 上海晨兴电子科技有限公司 | Method for synchronization of audio frequency and video frequency of stream media terminal |
| CN101771869A (en) * | 2008-12-30 | 2010-07-07 | 深圳市万兴软件有限公司 | AV (audio/video) encoding and decoding device and method |
| EP2334049A2 (en) * | 2009-12-14 | 2011-06-15 | QNX Software Systems GmbH & Co. KG | Synchronization of video presentation by video cadence modification |
| CN102685437A (en) * | 2012-02-03 | 2012-09-19 | 深圳市创维群欣安防科技有限公司 | Method and monitor for compensating video image |
| CN103167342A (en) * | 2013-03-29 | 2013-06-19 | 天脉聚源(北京)传媒科技有限公司 | Audio and video synchronous processing device and method |
| US20150062353A1 (en) * | 2013-08-30 | 2015-03-05 | Microsoft Corporation | Audio video playback synchronization for encoded media |
| CN103581730A (en) * | 2013-10-28 | 2014-02-12 | 南京熊猫电子股份有限公司 | Method for achieving synchronization of audio and video on digital set top box |
| CN104378675A (en) * | 2014-12-08 | 2015-02-25 | 厦门雅迅网络股份有限公司 | Multichannel audio-video synchronized playing processing method |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109711421A (en) * | 2017-10-25 | 2019-05-03 | 腾讯科技（深圳）有限公司 | A kind of data processing method and device |
| CN108379832B (en) * | 2018-01-29 | 2021-03-30 | 珠海金山网络游戏科技有限公司 | Game synchronization method and device |
| CN108379832A (en) * | 2018-01-29 | 2018-08-10 | 珠海金山网络游戏科技有限公司 | A kind of game synchronization method and apparatus |
| CN108495164A (en) * | 2018-04-09 | 2018-09-04 | 珠海全志科技股份有限公司 | Audio-visual synchronization processing method and processing device, computer installation and storage medium |
| CN108495164B (en) * | 2018-04-09 | 2021-01-29 | 珠海全志科技股份有限公司 | Audio and video synchronization processing method and device, computer device and storage medium |
| CN111355989B (en) * | 2018-12-21 | 2023-08-08 | 深圳市中兴微电子技术有限公司 | Frame rate control method and related equipment |
| CN111355989A (en) * | 2018-12-21 | 2020-06-30 | 深圳市中兴微电子技术有限公司 | Frame rate control method and related equipment |
| CN112825562A (en) * | 2019-11-21 | 2021-05-21 | 杭州海康威视数字技术股份有限公司 | Video frame compensation method and device and video processing chip |
| CN112825562B (en) * | 2019-11-21 | 2022-11-01 | 杭州海康威视数字技术股份有限公司 | Video frame compensation method and device and video processing chip |
| WO2023029936A1 (en) * | 2020-10-13 | 2023-03-09 | 杭州涂鸦信息技术有限公司 | Audio and video synchronization method and apparatus based on different reference clocks, and computer device |
| CN113573119A (en) * | 2021-06-15 | 2021-10-29 | 荣耀终端有限公司 | Method and device for generating time stamp of multimedia data |
| CN113949898A (en) * | 2021-10-13 | 2022-01-18 | 北京奇艺世纪科技有限公司 | Multimedia processing method, device, equipment and storage medium |
| CN113949898B (en) * | 2021-10-13 | 2024-03-08 | 北京奇艺世纪科技有限公司 | Multimedia processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017067489A1 (en) | 2017-04-27 |
| CN106612452B (en) | 2019-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106612452A (en) | Audio-video synchronizing method and device of set top box | |
| CN110139148B (en) | Video switching definition method and related device | |
| CN104269182B (en) | The methods, devices and systems that a kind of audio sync is played | |
| CN109275008B (en) | Audio and video synchronization method and device | |
| CN107509100A (en) | Audio and video synchronization method, system, computer installation and computer-readable recording medium | |
| JP6313704B2 (en) | Reception device and synchronization processing method thereof | |
| CN105376628A (en) | Method and device for synchronizing audio-video signals | |
| CN103873952B (en) | A kind of efficient video playback frame losing control system and its method | |
| CN103458271A (en) | Audio-video file splicing method and audio-video file splicing device | |
| CN105898500A (en) | Network video play method and device | |
| US20040264577A1 (en) | Apparatus and method for controlling the synchronization of a video transport stream | |
| US20110157163A1 (en) | Image processing device and image processing method | |
| CN106658030B (en) | A kind of playback method and equipment of the composite video comprising SCVF single channel voice frequency multi-channel video | |
| US9736340B2 (en) | Decoder and decoding method for audio video stream synchronization | |
| CN104822008A (en) | Video synchronizing method and device | |
| CN111131874B (en) | Method, equipment and computer storage medium for solving problem of playing jam of H.265 code stream random access point | |
| CN112929713B (en) | Data synchronization method, device, terminal and storage medium | |
| CN110087116B (en) | Multi-rate live video stream editing method and device, terminal and storage medium | |
| CN103581730A (en) | Method for achieving synchronization of audio and video on digital set top box | |
| CN106470291A (en) | Recover in the interruption in time synchronized from audio/video decoder | |
| CN108156498B (en) | Audio and video synchronization method and device | |
| CN109525873A (en) | A kind of audio plays synchronous method and device | |
| CN114697712A (en) | Method, device and equipment for downloading media stream and storage medium | |
| CN111641758B (en) | Video and audio recording method and device and computer readable storage medium | |
| CN110177293B (en) | Synchronous multicast and video forwarding method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |