CN108156498A - A kind of method and device of audio-visual synchronization - Google Patents
A kind of method and device of audio-visual synchronization Download PDFInfo
- Publication number
- CN108156498A CN108156498A CN201711115267.5A CN201711115267A CN108156498A CN 108156498 A CN108156498 A CN 108156498A CN 201711115267 A CN201711115267 A CN 201711115267A CN 108156498 A CN108156498 A CN 108156498A
- Authority
- CN
- China
- Prior art keywords
- player
- time
- multimedia
- time point
- difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Abstract
The invention discloses a kind of method and devices of audio-visual synchronization, are related to wireless communication technology field.For solve the problem of to exist in the prior art from player redirect after time point will not still be fully equivalent to domination time of main player and cause to will appear long-time interim card.From player according to the multimedia information currently playing from main player received, determine the first difference from the synchronizing information of the multimedia first time point of player plays and the main player domination time, carrying the synchronizing information in the multimedia information dominates the time；When first difference is less than hop threshold, it is described from player according to the synchronizing information dominates time update from the time shaft that is played simultaneously of player, and the currently playing multimedia audio/video frames are synchronized according to the time shaft that is played simultaneously.
Description
Technical field
The present invention relates to wireless communication technology fields, more particularly relate to a kind of method and device of audio-visual synchronization.
Background technology
When market shows tv product, it will usually identical film source is played during the television identical for using multiple displayings, so as to more
The good each product of comparison and attraction customer.Since the player that different tv products is configured is different, multiple products exist
It carries out same piece source video and plays sowing time, can there are problems that between sowing time and broadcasting speed difference, different broadcastings is caused to be asked
Between film source play it is asynchronous, so as to influence the contrast effect of different player plays.
In the prior art, in order to solve the problems, such as the audio-visual synchronization between multiple players, a kind of scheme is at one
One main player is set in LAN and multiple from player, it is multiple all to play phase simultaneously from player and a main player
Same video specifically, when playing video, the time is dominated by the time point that main player real-time broadcast current video plays,
Then judge whether currently playing video is synchronous with main player according to the domination time at time point received from player, if not
It is synchronous then judge its error whether in allowed limits.It is redirected when range of the error more than permission from player oneself
Operation jumps to the domination time at time point received, so as to fulfill being played simultaneously between main player.In said program,
Due to information such as the key frames for redirecting that time-consuming and needing to look for video when redirecting from player, the time point after redirecting
It will not still be fully equivalent to dominate the time, therefore will appear long-time Caton phenomenon.
Invention content
The embodiment of the present invention provides a kind of method and device of audio-visual synchronization, to solve to exist in the prior art from broadcasting
The domination time that the time point after device redirects still not exclusively is equal to main player is put, causes to will appear asking for long-time interim card
Topic.
An embodiment of the present invention provides a kind of method of audio-visual synchronization, including：
From player according to the multimedia information currently playing from main player received, determine to broadcast from player
It puts the multimedia first time point and plays the first of the multimedia synchronizing information domination time with the main player
Difference carries the synchronizing information in the multimedia information and dominates the time；
It is described that time update is dominated according to the synchronizing information from player when first difference is less than hop threshold
The time shaft that is played simultaneously from player, and according to described time shaft be played simultaneously to synchronize this currently playing from player
The multimedia audio/video frames.
Preferably, time shaft is played simultaneously described in the basis and synchronizes this from currently playing described multimedia of player
Audio/video frames specifically include：
Second time point that decoding audio and video are obtained from player, determine second time point and third time point
Between the second difference, time shaft broadcasting more matchmakers are played simultaneously from player to be described the third time point according to
The time of body；
Threshold value is exported, and the third at the third time point and second time point when determining that second difference is less than
Difference is more than delay threshold value, abandons described from the currently playing multimedia audio frame of player and video frame.
Preferably, it further includes：When determining that second difference is less than output threshold value, and the third time point and described the
The third difference at two time points is less than delay threshold value, output it is described from the currently playing multimedia video frame of player and
Video frame.
Preferably, it further includes：
When determining that second difference is more than output threshold value, then after the stand-by period is set, according to described from broadcasting
Device obtains the second time point of decoding audio and video, determines that second between second time point and the third time point is poor
Value.
Preferably, the multimedia identification information is also carried in the multimedia information；
It is described to determine to play more matchmakers from first time point multimedia described in player plays and the main player
Before the synchronizing information of body dominates the first difference of time, further include：
From the currently playing multimedia of player and the master according to being determined the multimedia identification information
The currently playing multimedia of player belongs to identical film source.
The embodiment of the present invention additionally provides a kind of device of audio-visual synchronization, including：
Determination unit, for from player according to the multimedia information currently playing from main player received,
It determines to play the multimedia synchronizing information from first time point multimedia described in player plays and the main player
The first difference of time is dominated, the synchronizing information is carried in the multimedia information and dominates the time；
Updating unit, it is described synchronous to be believed according to described from player for when first difference is less than hop threshold
Breath dominates the time update time shaft that is played simultaneously from player, and according to it is described be played simultaneously that time shaft synchronizes should be from broadcasting
Put the currently playing multimedia audio/video frames of device.
Preferably, the updating unit is specifically used for：
Second time point that decoding audio and video are obtained from player, determine second time point and third time point
Between the second difference, third time point position is described, and time shaft broadcasting more matchmakers are played simultaneously from player according to
The time of body；
Threshold value is exported, and the third at the third time point and second time point when determining that second difference is less than
Difference is more than delay threshold value, abandons described from the currently playing multimedia audio frame of player and video frame.
Preferably, the updating unit is additionally operable to：
Threshold value is exported, and the third at the third time point and second time point when determining that second difference is less than
Difference is less than delay threshold value, and output is described from the player currently playing multimedia video frame and video frame.
Preferably, the updating unit is additionally operable to：
When first difference is more than hop threshold, according to redirecting the time to this from currently playing described more of player
The time of media is redirected.
An embodiment of the present invention provides a kind of method and device of audio-visual synchronization, this method includes：From player according to
The multimedia information currently playing from main player received is determined from the multimedia first time point of player plays
The first difference of time is dominated with the synchronizing information of the main player, the synchronous letter is carried in the multimedia information
Breath dominates the time；It is described that the time is dominated according to the synchronizing information from player when first difference is less than hop threshold
Update is described to be played simultaneously time shaft from player.In the above method, due to from player in the synchronization for receiving main player
After information dominates the time, first determine that synchronizing information dominates the time and from the difference between the multimedia first time of player plays
When determining that the difference is less than hop threshold, the sound of time update current player is dominated from player according to synchronizing information for value
Audio video synchronization reproduction time axis, and synchronize currently playing multimedia audio/video frames according to time shaft is played simultaneously.This method
It is middle that multimedia audio/video frames are synchronized using time shaft is played simultaneously, it avoids when being redirected in the prior art from player
It needs to find the key frame of video, has saved the time redirected, it further, can will be currently playing when synchronous
Multimedia audio/video frames synchronized with the multimedia audio/video frames that main player plays, avoid and redirect rear time point
The problem of being still not exclusively equal, so as to solve the problems, such as long-time interim card.
Description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of method flow schematic diagram of audio-visual synchronization provided in an embodiment of the present invention；
Fig. 2 is the schematic diagram that multiple players provided in an embodiment of the present invention are connected by router；
Fig. 3 is the method schematic diagram provided in an embodiment of the present invention according to time shaft synchronized audio/video frame；
Fig. 4 is a kind of audio and video synchronization method flow diagram that the embodiment of the present invention one provides；
Fig. 5 carrys out the method schematic diagram of synchronized audio/video frame for usage time axis provided by Embodiment 2 of the present invention；
Fig. 6 is a kind of apparatus structure schematic diagram of audio-visual synchronization provided in an embodiment of the present invention.
Specific embodiment
An embodiment of the present invention provides a kind of method of audio-visual synchronization, including：It is come from from player according to what is received
The currently playing multimedia information of main player determines to put from the multimedia first time point of player plays with the main broadcaster
The synchronizing information of device dominates the first difference of time, and the synchronizing information is carried in the multimedia information and dominates the time；
When first difference is less than hop threshold, it is described from player according to the synchronizing information dominates time update from broadcasting
The time shaft that is played simultaneously of device is put, and the currently playing multimedia audio and video are synchronized according to the time shaft that is played simultaneously
Frame.Due to can be synchronized according to time shaft is played simultaneously from the currently playing multimedia audio/video frames of player, so as to solve
Determined in the prior art from player redirect after time point will not still be fully equivalent to domination time of main player, can go out
Now the problem of long-time interim card.
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without making creative work
Embodiment shall fall within the protection scope of the present invention.
Wherein, the multimedia in the embodiment of the present invention can be：Video file, audio file etc..
Fig. 1 illustratively shows a kind of method flow schematic diagram of audio-visual synchronization provided in an embodiment of the present invention, should
Method mainly includes the following steps that：
Step 101, from player according to the multimedia information currently playing from main player received, determine from
The synchronizing information of the multimedia first time point of player plays and the main player dominates the first difference of time, described more
The synchronizing information is carried in the information of media and dominates the time；
Step 102, it is described to be dominated from player according to the synchronizing information when first difference is less than hop threshold
The time update time shaft that is played simultaneously from player, and currently playing institute is synchronized according to the time shaft that is played simultaneously
State multimedia audio/video frames.
Fig. 2 is the schematic diagram that multiple players provided in an embodiment of the present invention are connected by router, as described in Figure 2,
In one showroom or display area, more players can be included, wherein, in more players, a main broadcaster is set
Device is put, other remaining players are disposed as electrically connecting by router from player, main player and Duo Tai from player.
Specifically, main player needs to broadcast currently playing multimedia information in real time when playing multimedia, with
Facilitate and multiple judge whether currently playing multimedia with the multimedia that main player plays belongs to identical film source from player.
In embodiments of the present invention, multimedia information has synchronizing information to dominate time and multimedia identification information,
In, the synchronizing information domination time can be the currently playing time point to media, and multimedia identification information can be current
The multimedia film source ID played or multimedia currently playing source name etc..Further, when multiple from player
During the multimedia identification information received, it can be determined according to multimedia identification information from the currently playing multimedia of player
Whether the multimedia currently playing with main player belongs to identical film source.It should be noted that the embodiment of the present invention is provided
Method, mainly solve to belong to identical film source from the currently playing multimedia of player and the currently playing multimedia of main player
When, main player currently playing multimedia time point from player is currently playing with nonsynchronous to media time point asking
Topic.
In a step 101, in a showroom or display area, main player, can be real-time when playing multimedia
The synchronizing information that announcing play-by-play puts device dominates time and multimedia identification information.It can be according to the main broadcaster received from player
The multimedia identification information of device broadcast is put, it is currently playing from the currently playing multimedia of player and main player to determine
Whether multimedia belongs to identical film source, from player it needs to be determined that current from player when determining to belong to identical film source
The multimedia first time point played, calculates from the currently playing multimedia first time point of player and the master received
The synchronizing information of player broadcast dominates the first difference of time.
In a step 102, it is multiple from player other than main player in a showroom or display area
It is provided with one and performs the hop threshold that redirects, in embodiments of the present invention, need according to the first difference and hop threshold
Relationship, it is determined whether perform skip operation.
A kind of situation：When the first difference is more than hop threshold, from player according to the reproduction time redirected to multimedia
The currently playing time is redirected.
Another situation：When the first difference is less than hop threshold, then broadcasted from player needs according to main player
Time shaft is played simultaneously to update from player in the synchronizing information domination time.Specifically, it is wide according to main player from player
The synchronizing information broadcast dominates the time, to update the time shaft of the synchronization module from player itself.
Further, after the time shaft that the synchronization template of itself is completed from player, from player according to above-mentioned same
The time shaft of module is walked, to synchronize currently playing multimedia audio/video frames.
Specifically, the second time point of decoding audio and video is obtained from player, the second time point decoded sound from player
The timestamp of video frame, then determine to play above-mentioned multimedia third time point on time shaft in synchronization template, then it will determine
The second time point be compared with third time point, obtain the second difference between third time point and the second time point, root
According to the magnitude relationship of the second determining difference and output threshold value, it is determined whether export multimedia audio/video frames.
Specifically, when determining that the second difference is less than output threshold value, and the multimedia played on time shaft in synchronization template
Third time point with from player plays multimedia second time point third difference be more than delay threshold value, then abandon more matchmakers
The audio frame of body；Meanwhile when determining that the second difference is less than output threshold value, and the multimedia played on time shaft in synchronization template
Third time point with from player plays multimedia second time point third difference be more than delay threshold value, then abandon more matchmakers
The video frame of body.
Further, when determining that the second difference is less than output threshold value, and the more matchmakers played on time shaft in synchronization template
The third time point of body is less than delay threshold value with the third difference from player plays multimedia second time point, then exports more
The video frame and audio frame of media.Specifically, it when determining that the second difference is more than output threshold value, then waits for a period of time, from broadcasting
It puts the second time point of device reacquisition decoding audio and video, then second between the second determining time point and third time point is poor
Then second difference and output threshold value are compared by value, according to comparison result, further determine that it is to abandon multimedia video
Frame still exports multimedia video frame.
Fig. 3 is the method schematic diagram provided in an embodiment of the present invention according to time shaft synchronized audio/video frame, when from player
After the time for playing multimedia body by reproduction time axis, you can to determine from the player currently playing multimedia time
For the third time, you can according to third time point, to export threshold value, postpone threshold value and the size at the second time point, to determine
Whether export from the currently playing multimedia video frame of player and video frame or abandon from currently playing more of player
The audio frame and video frame of media still reacquire the second time point of decoding audio and video, i.e. audio/video frames etc. from player
It is exported after time to be set.
As shown in Figure 3, it is assumed that the time point of third time point on a timeline is 0 point of 5S, and output threshold value is 4S, and is postponed
When threshold value is 3S：A kind of situation, when the second time point was 0 point of 1S, it may be determined that the difference at the second time point and third time point
It is -4 seconds to be worth, because -4S is less than the corresponding 4S of output threshold value, then can be determined again, third time point and the second time point
Difference when the difference at third time point and the second time point is 4S, because 4S is more than the delay corresponding 3S of threshold value, then can determine
It needs to perform and abandon from the currently playing multimedia audio frame of player and video frame；A kind of situation is 0 when the second time point
When dividing 3S, it may be determined that the difference at the second time point and third time point is -2S, because -2S is less than the corresponding 4S of output threshold value,
It can then determine again, the difference at third time point and the second time point, i.e. the difference at third time point and the second time point is
2S because 2S is less than the corresponding 3S of delay threshold value, then can determine to need to perform output from the currently playing multimedia of player
Video frame and video frame；Also a kind of situation, when the second time point was 0 point of 10S, it may be determined that the second time point and third
The difference at time point is 5S, because 5S is more than the corresponding 4S of output threshold value, then can determine the time to be set such as audio/video frames
After export.
As shown in figure 3, in the first situation, because the second time point was 0 point of 1S, third time point is 0 point of 5S, is postponed
It is 3S that threshold value, which is less than output threshold value and delay threshold value, and the difference between third time point and the second time point is 4S, you can with
It determines using third time point as starting point, the time point for postponing threshold value and determining is equal to the time span of the second time point direction displacement
For boundary, when falling into the time point less than this boundary at the second time point, it is required to perform to abandon and works as from player
The multimedia audio frame and video frame of preceding broadcasting.
In the second situation, because the second time point was 0 point of 3S, third time point is 0 point of 5S, the second time point and the
The difference at three time points and the difference at third time point and the second time point are respectively less than and postpone threshold value and output threshold value, you can with true
It is fixed, using third time point as starting point, it is equal to output threshold value to the time span of the right side displacement at the second time point, to the second time
The time span of the left side displacement of point is equal to delay threshold value, i.e., is fallen into when the second time point including within third time point, and with
When postponing threshold value and exporting the time point of threshold value as in the region of boundary, need to perform output from the currently playing more matchmakers of player
The video frame and video frame of body.
In the third case, because the second time point for 0 point 10 seconds, third time point be 0 point of 5S, output threshold value be 4S,
Difference between second time point and third time point is more than output threshold value, you can to determine, using third time point as starting point, to
The time span of second time point direction displacement is boundary equal to the time point that output threshold value determines, is fallen into greatly when the second time point
When in the time point of this boundary, it is thus necessary to determine that audio/video frames etc. export after the time to be set.
In conclusion an embodiment of the present invention provides a kind of method of audio-visual synchronization, in this method, due to from player
After the synchronizing information for receiving main player dominates the time, first determine that synchronizing information dominates time and more matchmakers from player plays
Difference between the first time of body, when determining that the difference is less than hop threshold, from player according to synchronizing information branch timing
Between update the audio-visual synchronization reproduction time axis of current player, and synchronize currently playing more matchmakers according to time shaft is played simultaneously
The audio/video frames of body.The convenience synchronized according to time shaft is played simultaneously is avoided when being redirected in the prior art from player
It needs to find the key frame of video, has saved the time redirected, it further, can will be currently playing when synchronous
Multimedia audio/video frames synchronized with the multimedia audio/video frames that main player plays, avoid and redirect rear time point
The problem of people is not exclusively equal, so as to solve the problems, such as long-time interim card.
For the clearer method for introducing a kind of audio-visual synchronization provided in an embodiment of the present invention, once with reference to Fig. 3 and
Fig. 4 specifically to introduce audio and video synchronization method and usage time axis carrys out the method for synchronized audio/video frame.
Embodiment one
Fig. 4 is a kind of audio and video synchronization method flow diagram that the embodiment of the present invention one provides, as shown in figure 3, the party
Method mainly includes the following steps that：
Step 301, the multimedia information of main player broadcast is received from player, wherein, multimedia information
Including video synchronizing information and piece source identification information；
Step 302, judge whether playing the video from player the machine from player according to piece source identification information, if
Currently playing video is identical with the piece source identification information that main player is broadcasted, then performs step 303, otherwise performs step 304；
Step 303, it calculates from the currently playing first time point of the player plays videos from player and is put with main broadcaster
The synchronizing information of device dominates the first difference between the time；
Step 304, the multimedia information of main player broadcast received is ignored from player；
Step 305：The absolute value of the first difference and the size of the hop threshold of setting are judged, if the first absolute difference
More than hop threshold, then step 308 is performed, otherwise perform step 306；
Step 306, time shaft of the time update from player synchronization module is dominated using synchronizing information；
Step 307, using the audio/video frames of the time shaft synchronization video from player synchronization module；
Step 308, execution redirects.
Embodiment two
Fig. 5 carrys out the method schematic diagram of synchronized audio/video frame for usage time axis provided by Embodiment 2 of the present invention, such as Fig. 5 institutes
Show, this method mainly includes the following steps that：
Step 401, the second time point from audio/video frames after player decoding is obtained；
Step 402, the second time point and the currently playing third time out of player synchronization module on time shaft are calculated
Second difference of point if the second difference is less than the output threshold value of setting, performs step 403, and no person performs step 404；
Step 403, calculating third time point subtracts the third difference at the second time point, if third difference is more than setting
Delay time then performs step 406, otherwise performs step 405；
Step 404, it waits for a period of time and re-executes step 401；
Step 405, the audio or video frame of currently playing video are exported from player；
Step 406, the audio or video frame of currently playing video are abandoned from player.
Based on same inventive concept, an embodiment of the present invention provides a kind of device of audio-visual synchronization, due to the device solution
Certainly the principle of technical problem is similar to a kind of method of audio-visual synchronization, therefore the implementation of the device may refer to the reality of method
It applies, overlaps will not be repeated.
Fig. 6 is a kind of apparatus structure schematic diagram of audio-visual synchronization provided in an embodiment of the present invention, as shown in fig. 6, the dress
Put including：
Determination unit 501, for from player according to the multimedia letter currently playing from main player received
Breath determines to dominate the first poor of time from the synchronizing information of the multimedia first time point of player plays and the main player
It is worth, the synchronizing information is carried in the multimedia information and dominates the time；
Updating unit 502, for when first difference be less than hop threshold when, it is described from player according to the synchronization
Information dominates the time update time shaft that is played simultaneously from player, and is synchronized currently according to the time shaft that is played simultaneously
The multimedia audio/video frames played.
Preferably, the updating unit 502 is specifically used for：
Second time point that decoding audio and video are obtained from player, determine second time point and third time point
Between the second difference, third time point position is described, and time shaft broadcasting more matchmakers are played simultaneously from player according to
The time of body；
Threshold value is exported, and the third at the third time point and second time point when determining that second difference is less than
Difference is more than delay threshold value, abandons described from the currently playing multimedia audio frame of player and video frame.
Preferably, the updating unit 502 is additionally operable to：
Threshold value is exported, and the third at the third time point and second time point when determining that second difference is less than
Difference is less than delay threshold value, and output is described from the player currently playing multimedia video frame and video frame.
Preferably, the updating unit 502 is additionally operable to：When first difference is more than hop threshold, during according to redirecting
Between this is redirected from the player currently playing multimedia time.
It should be appreciated that the unit that includes of the device of one of the above audio-visual synchronization only according to the work(realized of the apparatus
The logical partitioning that can be carried out, in practical application, can carry out the superposition or fractionation of said units.And the one of embodiment offer
The method of determining flame spread rates that the function that the device of kind audio-visual synchronization is realized is provided with above-described embodiment corresponds,
For the more detailed process flow that the device is realized, it has been described in detail in above method embodiment one, herein not
It is described in detail again.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program
Product.Therefore, the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware can be used in the present invention
Apply the form of example.Moreover, the computer for wherein including computer usable program code in one or more can be used in the present invention
The computer program production that usable storage medium is implemented on (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)
The form of product.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
The processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices is generated for real
The device of function specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps are performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or
The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Although preferred embodiments of the present invention have been described, but those skilled in the art once know basic creation
Property concept, then additional changes and modifications may be made to these embodiments.So appended claims be intended to be construed to include it is excellent
It selects embodiment and falls into all change and modification of the scope of the invention.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
God and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (10)
- A kind of 1. method of audio-visual synchronization, which is characterized in that this method includes：From player according to the multimedia information currently playing from main player received, determine from player plays institute The first difference that multimedia first time point plays the multimedia synchronizing information domination time with the main player is stated, The synchronizing information is carried in the multimedia information and dominates the time；When first difference be less than hop threshold when, it is described from player according to the synchronizing information dominate the time update described in From the time shaft that is played simultaneously of player, and according to it is described be played simultaneously time shaft synchronize this from player it is currently playing described in Multimedia audio/video frames.
- 2. the method as described in claim 1, which is characterized in that time shaft synchronization is played simultaneously described in the basis should be from broadcasting The currently playing multimedia audio/video frames of device, specifically include：It second time point that decoding audio and video are obtained from player, determines between second time point and third time point The second difference, the third time point, that time shaft broadcasting is played simultaneously according to from player was described multimedia to be described Time；Threshold value is exported, and the third difference at the third time point and second time point when determining that second difference is less than More than delay threshold value, abandon described from the currently playing multimedia audio frame of player and video frame.
- 3. method as claimed in claim 2, which is characterized in that further include：Threshold value is exported, and the third difference at the third time point and second time point when determining that second difference is less than Less than delay threshold value, output is described from the player currently playing multimedia video frame and video frame.
- 4. method as claimed in claim 2, which is characterized in that further include：When determining that second difference is more than output threshold value, then after the stand-by period is set, obtained according to described from player The second time point of decoding audio and video is taken, determines the second difference between second time point and the third time point.
- 5. the method as described in claim 1, which is characterized in that further include：When first difference is more than hop threshold, root This is redirected from the player currently playing multimedia time according to the time is redirected.
- 6. the method as described in claim 1, which is characterized in that also carried in the multimedia information described multimedia Identification information；It is described determining described multimedia from first time point multimedia described in player plays and main player broadcasting Before synchronizing information dominates the first difference of time, further include：It is put according to being determined the multimedia identification information from the currently playing multimedia of player with the main broadcaster The currently playing multimedia of device belongs to identical film source.
- 7. a kind of device of audio-visual synchronization, which is characterized in that including：Determination unit, for, according to the multimedia information currently playing from main player received, being determined from player The multimedia synchronizing information is played from first time point multimedia described in player plays and the main player to dominate The first difference of time carries the synchronizing information in the multimedia information and dominates the time；Updating unit, for when first difference be less than hop threshold when, it is described from player according to the synchronizing information branch This is synchronized from player with the time update time shaft that is played simultaneously from player, and according to the time shaft that is played simultaneously The currently playing multimedia audio/video frames.
- 8. device as claimed in claim 7, which is characterized in that the updating unit is specifically used for：It second time point that decoding audio and video are obtained from player, determines between second time point and third time point The second difference, third time point position is described, and that time shaft broadcasting is played simultaneously according to from player is described multimedia Time；Threshold value is exported, and the third difference at the third time point and second time point when determining that second difference is less than More than delay threshold value, abandon described from the currently playing multimedia audio frame of player and video frame.
- 9. device as claimed in claim 8, which is characterized in that the updating unit is additionally operable to：Threshold value is exported, and the third difference at the third time point and second time point when determining that second difference is less than Less than delay threshold value, output is described from the player currently playing multimedia video frame and video frame.
- 10. device as claimed in claim 7, which is characterized in that the updating unit is additionally operable to：When first difference is more than hop threshold, according to redirecting the time to this from the currently playing multimedia of player Time redirected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711115267.5A CN108156498B (en) | 2017-11-13 | 2017-11-13 | Audio and video synchronization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711115267.5A CN108156498B (en) | 2017-11-13 | 2017-11-13 | Audio and video synchronization method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108156498A true CN108156498A (en) | 2018-06-12 |
| CN108156498B CN108156498B (en) | 2020-11-20 |
Family
ID=62467979
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711115267.5A Active CN108156498B (en) | 2017-11-13 | 2017-11-13 | Audio and video synchronization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108156498B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109218795A (en) * | 2018-11-29 | 2019-01-15 | 青岛海信电器股份有限公司 | A kind of more device plays progress synchronous method, device and terminal device |
| CN109413469A (en) * | 2018-08-31 | 2019-03-01 | 北京潘达互娱科技有限公司 | A kind of live streaming company wheat delay control method, device, electronic equipment and storage medium |
| CN111614522A (en) * | 2020-05-29 | 2020-09-01 | 国网浙江省电力有限公司电力科学研究院 | Method for preventing sampling error synchronization of in-situ looped network submachine |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110218656A1 (en) * | 2010-03-02 | 2011-09-08 | Microsoft Corporation | Social media playback |
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
-
2017
- 2017-11-13 CN CN201711115267.5A patent/CN108156498B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110218656A1 (en) * | 2010-03-02 | 2011-09-08 | Microsoft Corporation | Social media playback |
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413469A (en) * | 2018-08-31 | 2019-03-01 | 北京潘达互娱科技有限公司 | A kind of live streaming company wheat delay control method, device, electronic equipment and storage medium |
| CN109218795A (en) * | 2018-11-29 | 2019-01-15 | 青岛海信电器股份有限公司 | A kind of more device plays progress synchronous method, device and terminal device |
| CN111614522A (en) * | 2020-05-29 | 2020-09-01 | 国网浙江省电力有限公司电力科学研究院 | Method for preventing sampling error synchronization of in-situ looped network submachine |
| CN111614522B (en) * | 2020-05-29 | 2021-11-12 | 国网浙江省电力有限公司电力科学研究院 | Method for preventing sampling error synchronization of in-situ looped network submachine |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108156498B (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1192628C (en) | Latency handling for interconnected devices | |
| CN105245976B (en) | Voice & Video synchronizes the method and system play | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| CN109218795A (en) | A kind of more device plays progress synchronous method, device and terminal device | |
| CN108156498A (en) | A kind of method and device of audio-visual synchronization | |
| CN108600815A (en) | A kind of online method and system chorused in real time | |
| EP3361738A1 (en) | Method and device for stitching multimedia files | |
| CN108282684A (en) | A kind of multimedia advertising broadcasting method based on scene or special object | |
| CN105979289A (en) | Video generation and play method and device | |
| JPH11275519A (en) | Data recording method and data recorder | |
| CN101419827A (en) | Method for synchronzing audio and video data in avi file | |
| CN108429931A (en) | A kind of method for broadcasting multimedia file and device | |
| CN107566889A (en) | Audio stream flow rate error processing method, device, computer installation and computer-readable recording medium | |
| CN109905749B (en) | Video playing method and device, storage medium and electronic device | |
| CN112929713B (en) | Data synchronization method, device, terminal and storage medium | |
| CN109275008A (en) | A kind of method and apparatus of audio-visual synchronization | |
| CN110290411A (en) | Sound is automatically corrected in video display process draws nonsynchronous method | |
| CN109167890A (en) | A kind of sound draws synchronous method and device and display equipment | |
| CN108600814A (en) | A kind of audio video synchronization playback method and device | |
| US20230370691A1 (en) | Systems and methods for determining delay of a plurality of media streams | |
| US20020106188A1 (en) | Apparatus and method for a real time movie editing device | |
| CN106303672A (en) | A kind of synchronous broadcast method based on recorded broadcast video and device | |
| CN103581730A (en) | Method for achieving synchronization of audio and video on digital set top box | |
| CN105872697A (en) | Cloud program direction console and continuous play method of cloud program direction console based on audio/video synchronization | |
| CN108650541A (en) | Realize that the method and system of video is played simultaneously in distinct device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Video Technology Co., Ltd Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant before: HISENSE ELECTRIC Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |