CN108156498B - Audio and video synchronization method and device - Google Patents
Audio and video synchronization method and device Download PDFInfo
- Publication number
- CN108156498B CN108156498B CN201711115267.5A CN201711115267A CN108156498B CN 108156498 B CN108156498 B CN 108156498B CN 201711115267 A CN201711115267 A CN 201711115267A CN 108156498 B CN108156498 B CN 108156498B
- Authority
- CN
- China
- Prior art keywords
- multimedia
- time
- time point
- player
- difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000001360 synchronised effect Effects 0.000 claims abstract description 58
- 230000009191 jumping Effects 0.000 claims description 11
- 238000004891 communication Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 18
- 238000004590 computer program Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000006073 displacement reaction Methods 0.000 description 4
- 230000000903 blocking effect Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses an audio and video synchronization method and device, and relates to the technical field of wireless communication. The method and the device are used for solving the problem that in the prior art, the time point after the jump from the player is not completely equal to the domination time of the main player, so that long-time pause can occur. The method comprises the steps that a slave player determines a first difference value between a first time point when the slave player plays multimedia and a dominant time of synchronous information of a main player according to received information of the multimedia currently played by the main player, wherein the dominant time of the synchronous information is carried in the information of the multimedia; and when the first difference is smaller than the jump threshold, the slave player updates the synchronous playing time axis of the slave player according to the time dominated by the synchronous information, and synchronizes the audio and video frames of the multimedia which are currently played according to the synchronous playing time axis.
Description
Technical Field
The invention relates to the technical field of wireless communication, in particular to an audio and video synchronization method and device.
Background
When a television product is displayed in a store, a plurality of displayed televisions are usually used to simultaneously play the same film source, so that the various products can be better compared and customers can be attracted. Due to the fact that players configured for different television products are different, when a plurality of products play the same video with the same film source, the problems of playing time and playing speed difference exist, so that the film source playing of different players is asynchronous, and the playing contrast effect of different players is affected.
In the prior art, in order to solve the problem of audio and video synchronization among multiple players, one scheme is to set a master player and multiple slave players in a local area network, where the multiple slave players and the master player all play the same video at the same time, specifically, when playing the video, the master player broadcasts the time point dominating time of the current video playing in real time, and the slave players judge whether the current video playing is synchronized with the master player according to the received time point dominating time, and if not, judge whether the error is within an allowable range. When the error exceeds the allowable range, the player jumps to the time point which is determined by the jump operation, thereby realizing synchronous playing with the main player. In the above scheme, since the jumping from the player takes a long time and information such as a key frame of a video needs to be found during jumping, a time point after jumping is not completely equal to a dominant time, and thus a long-time pause phenomenon occurs.
Disclosure of Invention
The embodiment of the invention provides an audio and video synchronization method and device, which are used for solving the problem that in the prior art, the time point after the jump from a slave player is not completely equal to the dominant time of a main player, so that long-time blocking occurs.
The embodiment of the invention provides an audio and video synchronization method, which comprises the following steps:
the method comprises the steps that a slave player determines a first difference value between a first time point when the slave player plays the multimedia and a dominant time of synchronous information when a main player plays the multimedia according to received information of the multimedia currently played by the main player, wherein the dominant time of the synchronous information is carried in the information of the multimedia;
and when the first difference is smaller than the jump threshold, the slave player updates the synchronous playing time axis of the slave player according to the time dominated by the synchronous information, and synchronizes the audio and video frames of the multimedia currently played by the slave player according to the synchronous playing time axis.
Preferably, the synchronizing the audio/video frame of the multimedia currently played by the slave player according to the synchronized playing time axis specifically includes:
the slave player acquires a second time point of the decoded audio and video, and determines a second difference value between the second time point and a third time point, wherein the third time point is the time for the slave player to play the multimedia according to the synchronous playing time axis;
and when the second difference is determined to be smaller than the output threshold value and the third difference between the third time point and the second time point is larger than the delay threshold value, discarding the audio frame and the video frame of the multimedia currently played by the slave player.
Preferably, the method further comprises the following steps: and when the second difference value is smaller than an output threshold value and a third difference value between the third time point and the second time point is smaller than a delay threshold value, outputting the video frame and the video frame of the multimedia currently played by the slave player.
Preferably, the method further comprises the following steps:
and when the second difference is determined to be larger than the output threshold, after the waiting time is set, determining a second difference between the second time point and the third time point according to a second time point of the decoded audio and video acquired by the slave player.
Preferably, the multimedia information also carries identification information of the multimedia;
before determining a first difference between a first time point when the slave player plays the multimedia and a time dominated by synchronization information when the master player plays the multimedia, the method further includes:
and determining that the multimedia currently played by the slave player and the multimedia currently played by the main player belong to the same film source according to the identification information of the multimedia.
The embodiment of the invention also provides an audio and video synchronization device, which comprises:
a determining unit, configured to determine, by a slave player, a first difference between a first time point at which the slave player plays a multimedia and a dominant time of synchronization information at which the master player plays the multimedia according to received information of the multimedia currently played by the master player, where the dominant time of the synchronization information is carried in information of the multimedia;
and the updating unit is used for updating the synchronous playing time axis of the slave player according to the time dominated by the synchronous information and synchronizing the audio and video frames of the multimedia currently played by the slave player according to the synchronous playing time axis when the first difference is smaller than the jump threshold.
Preferably, the updating unit is specifically configured to:
the slave player acquires a second time point of the decoded audio and video, and determines a second difference value between the second time point and a third time point, wherein the third time point is the time for the slave player to play the multimedia according to the synchronous playing time axis;
and when the second difference is determined to be smaller than the output threshold value and the third difference between the third time point and the second time point is larger than the delay threshold value, discarding the audio frame and the video frame of the multimedia currently played by the slave player.
Preferably, the updating unit is further configured to:
and when the second difference value is smaller than an output threshold value and a third difference value between the third time point and the second time point is smaller than a delay threshold value, outputting the video frame and the video frame of the multimedia currently played by the slave player.
Preferably, the updating unit is further configured to:
and when the first difference is larger than the jump threshold, jumping the time of the multimedia currently played by the slave player according to the jump time.
The embodiment of the invention provides an audio and video synchronization method and device, wherein the method comprises the following steps: the method comprises the steps that a slave player determines a first difference value between a first time point when the slave player plays multimedia and a dominant time of synchronous information of a main player according to received information of the multimedia currently played by the main player, wherein the dominant time of the synchronous information is carried in the information of the multimedia; and when the first difference is smaller than a jump threshold, the slave player updates the synchronous playing time axis of the slave player according to the synchronous information domination time. In the method, after receiving the synchronization information domination time of the master player, the slave player determines a difference between the synchronization information domination time and the first time of the multimedia played by the slave player, and when the difference is smaller than the jump threshold, the slave player updates the audio and video synchronous playing time axis of the current player according to the synchronization information domination time and synchronizes the audio and video frames of the multimedia played at present according to the synchronous playing time axis. The method adopts the synchronous playing time axis to synchronize the audio and video frames of the multimedia, avoids the problem that the key frames of the video need to be found when the player jumps in the prior art, saves the jumping time, further can synchronize the audio and video frames of the currently played multimedia with the audio and video frames of the multimedia played by the main player during synchronization, avoids the problem that the time points are not completely identical after the jumping, and solves the problem of long-time blocking.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for audio and video synchronization according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a plurality of players connected by a router according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a method for synchronizing audio and video frames according to a time axis according to an embodiment of the present invention;
fig. 4 is a schematic flowchart of an audio and video synchronization method according to a first embodiment of the present invention;
fig. 5 is a schematic diagram of a method for synchronizing audio and video frames by using a time axis according to a second embodiment of the present invention;
fig. 6 is a schematic structural diagram of an audio and video synchronization apparatus according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides an audio and video synchronization method, which comprises the following steps: the method comprises the steps that a slave player determines a first difference value between a first time point when the slave player plays multimedia and a dominant time of synchronous information of a main player according to received information of the multimedia currently played by the main player, wherein the dominant time of the synchronous information is carried in the information of the multimedia; and when the first difference is smaller than the jump threshold, the slave player updates the synchronous playing time axis of the slave player according to the time dominated by the synchronous information, and synchronizes the audio and video frames of the multimedia which are currently played according to the synchronous playing time axis. The audio and video frames of the multimedia currently played by the slave player can be synchronized according to the synchronous playing time axis, so that the problem that in the prior art, the time point after the slave player jumps is not completely equal to the dominant time of the master player, and long-time pause occurs is solved.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The multimedia in the embodiment of the present invention may be: video files, audio files, etc.
Fig. 1 exemplarily shows a schematic flow diagram of a method for audio and video synchronization provided by an embodiment of the present invention, where the method mainly includes the following steps:
and step 102, when the first difference is smaller than a jump threshold, the slave player updates a synchronous playing time axis of the slave player according to the time dominated by the synchronous information, and synchronizes the audio and video frames of the multimedia which are currently played according to the synchronous playing time axis.
Fig. 2 is a schematic diagram of multiple players connected through a router according to an embodiment of the present invention, and as shown in fig. 2, multiple players may be included in one exhibition hall or exhibition area, where one master player is set in the multiple players, the other remaining players are all set as slave players, and the master player and the multiple slave players are electrically connected through the router.
Specifically, when the master player plays the multimedia, it needs to broadcast the information of the currently played multimedia in real time, so that it is convenient for the multiple slave players to determine whether the currently played multimedia belongs to the same film source as the multimedia played by the master player.
In the embodiment of the present invention, the multimedia information includes a synchronization information dominant time and multimedia identification information, where the synchronization information dominant time may be a time point of the currently played multimedia, and the multimedia identification information may be a title of a currently played multimedia, such as a title ID of the currently played multimedia. Further, when a plurality of slave players receive the identification information of the multimedia, it may be determined whether the multimedia currently played by the slave player belongs to the same movie source as the multimedia currently played by the master player based on the identification information of the multimedia. It should be noted that the method provided in the embodiment of the present invention mainly solves the problem that when the multimedia currently played by the slave player and the multimedia currently played by the master player belong to the same source, the time point of the multimedia currently played by the master player and the time point of the media currently played by the slave player are not synchronized.
In step 101, in a presentation hall or a presentation area, when a main player plays multimedia, synchronization information of the main player dominates time and identification information of the multimedia are broadcasted in real time. The slave player may determine whether the multimedia currently played by the slave player and the multimedia currently played by the master player belong to the same film source according to the received identification information of the multimedia broadcasted by the master player, and when determining that the multimedia currently played by the slave player belongs to the same film source, the slave player needs to determine a first time point of the multimedia currently played by the slave player, and calculate a first difference value between the first time point of the multimedia currently played by the slave player and the received domination time of the synchronization information broadcasted by the master player.
In step 102, in a presentation hall or a presentation area, a plurality of slave players except for a master player are all set with a jump threshold for executing a jump.
One of the situations is: and when the first difference is larger than the jump threshold, the slave player jumps the current playing time of the multimedia according to the jumped playing time.
In another case: when the first difference is smaller than the jump threshold, the slave player needs to update the synchronous playing time axis of the slave player according to the time dominated by the synchronous information broadcast by the master player. Specifically, the slave player updates the time axis of the slave player's own synchronization module according to the synchronization information dominating time broadcast by the master player.
Further, after the slave player completes the time axis of its own synchronization template, the slave player synchronizes the audio/video frame of the currently played multimedia according to the time axis of the synchronization module.
Specifically, a second time point of decoding the audio and video is obtained from the player, the second time point is a time stamp of decoding the audio and video frame from the player, a third time point of playing the multimedia on a time axis in the synchronization template is determined, the determined second time point is compared with the third time point to obtain a second difference value between the third time point and the second time point, and whether the audio and video frame of the multimedia is output or not is determined according to the magnitude relation between the determined second difference value and the output threshold.
Specifically, when it is determined that the second difference is smaller than the output threshold, and a third difference between a third time point of the multimedia played on the time axis in the synchronization template and a second time point of the multimedia played from the player is larger than the delay threshold, discarding the audio frame of the multimedia; meanwhile, when the second difference is determined to be smaller than the output threshold, and a third difference between a third time point of the multimedia played on the time axis in the synchronous template and a second time point of the multimedia played from the player is larger than the delay threshold, the video frame of the multimedia is discarded.
Further, when it is determined that the second difference is smaller than the output threshold, and a third difference between a third time point of the multimedia played on the time axis in the synchronization template and a second time point of the multimedia played from the player is smaller than the delay threshold, the video frame and the audio frame of the multimedia are output. Specifically, when the second difference is determined to be greater than the output threshold, waiting for a period of time, re-acquiring a second time point of the decoded audio and video from the player, determining a second difference between the second time point and a third time point, comparing the second difference with the output threshold, and further determining whether to discard the multimedia video frame or output the multimedia video frame according to a comparison result.
Fig. 3 is a schematic diagram of a method for synchronizing audio and video frames according to a time axis according to an embodiment of the present invention, when a slave player plays multimedia according to a synchronized play time axis, it may be determined that a time for the slave player to currently play the multimedia is a third time, that is, it may be determined whether to output a video frame and a video frame of the multimedia currently played by the slave player, discard an audio frame and a video frame of the multimedia currently played by the slave player, or reacquire a second time point of decoded audio and video from the slave player, that is, the audio and video frame waits for a set time and is then output according to a third time point, an output threshold, a delay threshold, and a size of the second time point.
As shown in fig. 3, assuming that the time point of the third time point on the time axis is 0 min 5S, the output threshold is 4S, and the delay threshold is 3S: in one case, when the second time point is 0 min 1S, it may be determined that a difference between the second time point and the third time point is-4 seconds, because-4S is less than 4S corresponding to the output threshold, it may be determined again, and when a difference between the third time point and the second time point is 4S, because 4S is greater than 3S corresponding to the delay threshold, it may be determined that it is necessary to perform discarding of the audio frame and the video frame of the multimedia currently played from the player; in one case, when the second time point is 0 min 3S, it may be determined that a difference between the second time point and the third time point is-2S, because-2S is less than 4S corresponding to the output threshold, it may be determined again that a difference between the third time point and the second time point, that is, a difference between the third time point and the second time point is 2S, because 2S is less than 3S corresponding to the delay threshold, it may be determined that it is necessary to perform output of a video frame and a video frame of multimedia currently played from the player; in another case, when the second time point is 0 minutes and 10 seconds, it may be determined that the difference between the second time point and the third time point is 5 seconds, and because 5 seconds is greater than 4 seconds corresponding to the output threshold, it may be determined that the audio/video frame is output after waiting for the set time.
As shown in fig. 3, in the first case, since the second time point is 0 min 1S, the third time point is 0 min 5S, the delay threshold is smaller than the output threshold and is 3S, and the difference between the third time point and the second time point is 4S, it can be determined that the time length of the displacement toward the second time point is equal to the time point determined by the delay threshold as a boundary, and when the second time point falls within the time point smaller than the boundary, it is necessary to perform the discarding of the audio frame and the video frame of the multimedia currently played from the player.
In the second case, since the second time point is 0 min 3S, the third time point is 0 min 5S, and both the difference between the second time point and the third time point and the difference between the third time point and the second time point are smaller than the delay threshold and the output threshold, it can be determined that, when the third time point is taken as a starting point, the time length of the displacement to the right of the second time point is equal to the output threshold, and the time length of the displacement to the left of the second time point is equal to the delay threshold, that is, when the second time point falls within the area including the third time point and bounded by the time points of the delay threshold and the output threshold, the output of the video frame and the video frame of the multimedia currently played from the player needs to be performed.
In a third case, since the second time point is 0 minutes 10 seconds, the third time point is 0 minutes 5 seconds, the output threshold is 4 seconds, and the difference between the second time point and the third time point is greater than the output threshold, it can be determined that, with the third time point as a starting point, the time length of the displacement toward the second time point is equal to the time point determined by the output threshold as a limit, and when the second time point falls within the time point greater than the limit, it is necessary to determine that the audio/video frame is output after waiting for the set time.
In summary, in the method, after receiving the synchronization information domination time of the master player, the slave player determines a difference between the synchronization information domination time and a first time of the multimedia played by the slave player, and when it is determined that the difference is smaller than the jump threshold, the slave player updates the audio and video synchronous playing time axis of the current player according to the synchronization information domination time, and synchronizes the audio and video frames of the multimedia currently played according to the synchronous playing time axis. The method has the advantages that the synchronization is convenient according to the synchronous playing time axis, the situation that the key frame of the video needs to be found when the player jumps in the prior art is avoided, the jumping time is saved, furthermore, the audio and video frame of the multimedia played at present can be synchronized with the audio and video frame of the multimedia played by the main player in the synchronization process, the problem that the time point is not completely equivalent after the jumping is avoided, and the problem of long-time blocking is solved.
To more clearly describe the method for audio and video synchronization provided by the embodiment of the present invention, the audio and video synchronization method and the method for synchronizing audio and video frames by using a time axis are described in detail below with reference to fig. 3 and 4.
Example one
Fig. 4 is a schematic flow diagram of an audio and video synchronization method according to a first embodiment of the present invention, and as shown in fig. 3, the method mainly includes the following steps:
step 305: judging the absolute value of the first difference value and the set jump threshold, if the absolute value of the first difference value is larger than the jump threshold, executing the step 308, otherwise executing the step 306;
Example two
Fig. 5 is a schematic diagram of a method for synchronizing audio and video frames by using a time axis according to a second embodiment of the present invention, and as shown in fig. 5, the method mainly includes the following steps:
step 403, calculating a third difference value obtained by subtracting the second time point from the third time point, if the third difference value is greater than the set delay time, executing step 406, otherwise executing step 405;
at step 406, the audio or video frames of the currently playing video are dropped from the player.
Based on the same inventive concept, the embodiment of the invention provides an audio and video synchronization device, and as the principle of the device for solving the technical problem is similar to an audio and video synchronization method, the implementation of the device can refer to the implementation of the method, and repeated parts are not described again.
Fig. 6 is a schematic structural diagram of an audio and video synchronization apparatus provided in an embodiment of the present invention, and as shown in fig. 6, the apparatus includes:
a determining unit 501, configured to determine, by a slave player, a first difference between a first time point at which the slave player plays multimedia and a dominant time of synchronization information of a master player according to received information of the multimedia currently played by the master player, where the dominant time of the synchronization information is carried in the multimedia information;
an updating unit 502, configured to update a synchronous playing time axis of the slave player according to the time dominated by the synchronization information and synchronize the currently played audio/video frame of the multimedia according to the synchronous playing time axis when the first difference is smaller than the jump threshold.
Preferably, the updating unit 502 is specifically configured to:
the slave player acquires a second time point of the decoded audio and video, and determines a second difference value between the second time point and a third time point, wherein the third time point is the time for the slave player to play the multimedia according to the synchronous playing time axis;
and when the second difference is determined to be smaller than the output threshold value and the third difference between the third time point and the second time point is larger than the delay threshold value, discarding the audio frame and the video frame of the multimedia currently played by the slave player.
Preferably, the updating unit 502 is further configured to:
and when the second difference value is smaller than an output threshold value and a third difference value between the third time point and the second time point is smaller than a delay threshold value, outputting the video frame and the video frame of the multimedia currently played by the slave player.
Preferably, the updating unit 502 is further configured to: and when the first difference is larger than the jump threshold, jumping the time of the multimedia currently played by the slave player according to the jump time.
It should be understood that the above audio and video synchronization apparatus includes only units that are logically divided according to the functions implemented by the device apparatus, and in practical applications, the above units may be stacked or split. The functions implemented by the audio and video synchronization device provided by this embodiment correspond to the methods for determining the fire spreading speed provided by the above embodiments one to one, and for the more detailed processing flow implemented by the device, detailed description is already made in the above method embodiment, and detailed description is not given here.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A method of audio video synchronization, the method comprising:
the method comprises the steps that a slave player determines a first difference value between a first time point when the slave player plays the multimedia and a dominant time of synchronous information when a main player plays the multimedia according to received information of the multimedia currently played by the main player, wherein the dominant time of the synchronous information is carried in the information of the multimedia;
and when the first difference is smaller than the jump threshold, the slave player updates the synchronous playing time axis of the slave player according to the time dominated by the synchronous information, and synchronizes the audio and video frames of the multimedia currently played by the slave player according to the synchronous playing time axis.
2. The method according to claim 1, wherein the synchronizing the audio/video frames of the multimedia currently played by the slave player according to the synchronized playing time axis specifically comprises:
the slave player acquires a second time point of the decoded audio and video, and determines a second difference value between the second time point and a third time point, wherein the third time point is the time for the slave player to play the multimedia according to the synchronous playing time axis;
and when the second difference is determined to be smaller than the output threshold value and the third difference between the third time point and the second time point is larger than the delay threshold value, discarding the audio frame and the video frame of the multimedia currently played by the slave player.
3. The method of claim 2, further comprising:
and when the second difference value is smaller than an output threshold value and a third difference value between the third time point and the second time point is smaller than a delay threshold value, outputting the video frame and the video frame of the multimedia currently played by the slave player.
4. The method of claim 2, further comprising:
and when the second difference is determined to be larger than the output threshold, after the waiting time is set, determining a second difference between the second time point and the third time point according to a second time point of the decoded audio and video acquired by the slave player.
5. The method of claim 1, further comprising: and when the first difference is larger than the jump threshold, jumping the time of the multimedia currently played by the slave player according to the jump time.
6. The method of claim 1, wherein the multimedia information further carries identification information of the multimedia;
before determining a first difference between a first time point when the slave player plays the multimedia and a time dominated by synchronization information when the master player plays the multimedia, the method further includes:
and determining that the multimedia currently played by the slave player and the multimedia currently played by the main player belong to the same film source according to the identification information of the multimedia.
7. An apparatus for audio and video synchronization, comprising:
a determining unit, configured to determine, by a slave player, a first difference between a first time point at which the slave player plays a multimedia and a dominant time of synchronization information at which the master player plays the multimedia according to received information of the multimedia currently played by the master player, where the dominant time of the synchronization information is carried in information of the multimedia;
and the updating unit is used for updating the synchronous playing time axis of the slave player according to the time dominated by the synchronous information and synchronizing the audio and video frames of the multimedia currently played by the slave player according to the synchronous playing time axis when the first difference is smaller than the jump threshold.
8. The apparatus as claimed in claim 7, wherein said updating unit is specifically configured to:
the slave player acquires a second time point of the decoded audio and video, and determines a second difference value between the second time point and a third time point, wherein the third time point is the time for the slave player to play the multimedia according to the synchronous playing time axis;
and when the second difference is determined to be smaller than the output threshold value and the third difference between the third time point and the second time point is larger than the delay threshold value, discarding the audio frame and the video frame of the multimedia currently played by the slave player.
9. The apparatus of claim 8, wherein the update unit is further to:
and when the second difference value is smaller than an output threshold value and a third difference value between the third time point and the second time point is smaller than a delay threshold value, outputting the video frame and the video frame of the multimedia currently played by the slave player.
10. The apparatus of claim 7, wherein the update unit is further to:
and when the first difference is larger than the jump threshold, jumping the time of the multimedia currently played by the slave player according to the jump time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711115267.5A CN108156498B (en) | 2017-11-13 | 2017-11-13 | Audio and video synchronization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711115267.5A CN108156498B (en) | 2017-11-13 | 2017-11-13 | Audio and video synchronization method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108156498A CN108156498A (en) | 2018-06-12 |
| CN108156498B true CN108156498B (en) | 2020-11-20 |
Family
ID=62467979
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711115267.5A Active CN108156498B (en) | 2017-11-13 | 2017-11-13 | Audio and video synchronization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108156498B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413469A (en) * | 2018-08-31 | 2019-03-01 | 北京潘达互娱科技有限公司 | A kind of live streaming company wheat delay control method, device, electronic equipment and storage medium |
| CN109218795B (en) * | 2018-11-29 | 2021-09-24 | 海信视像科技股份有限公司 | Multi-device playing progress synchronization method and device and terminal device |
| CN111614522B (en) * | 2020-05-29 | 2021-11-12 | 国网浙江省电力有限公司电力科学研究院 | Method for preventing sampling error synchronization of in-situ looped network submachine |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9209987B2 (en) * | 2010-03-02 | 2015-12-08 | Microsoft Technology Licensing, Llc | Social media playback |
-
2017
- 2017-11-13 CN CN201711115267.5A patent/CN108156498B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103839558A (en) * | 2012-11-23 | 2014-06-04 | 三星电子（中国）研发中心 | Method and server for synchronous playing and player |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108156498A (en) | 2018-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106658133B (en) | Audio and video synchronous playing method and terminal | |
| CN108156498B (en) | Audio and video synchronization method and device | |
| CN106612452B (en) | method and device for synchronizing audio and video of set top box | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| US8931024B2 (en) | Receiving apparatus and subtitle processing method | |
| CN105376628A (en) | Method and device for synchronizing audio-video signals | |
| CN109218795A (en) | A kind of more device plays progress synchronous method, device and terminal device | |
| US10298901B2 (en) | Method for synchronous playback by multiple smart devices, and apparatus | |
| CN109828742B (en) | Audio multi-channel synchronous output method, computer device and computer readable storage medium | |
| CN104822008A (en) | Video synchronizing method and device | |
| CN105898500A (en) | Network video play method and device | |
| CN107071502A (en) | Video broadcasting method and device | |
| US20170164010A1 (en) | Method and device for generating and playing video | |
| KR102566550B1 (en) | Method of display playback synchronization of digital contents in multiple connected devices and apparatus using the same | |
| CN110581973A (en) | data playback method and device, terminal equipment and storage medium | |
| CN109275008A (en) | A kind of method and apparatus of audio-visual synchronization | |
| CN110933489B (en) | Video playing control method and device and video playing equipment | |
| CN104717542A (en) | Method, device and system for obtaining synchronization information of intelligent television | |
| CN112929713B (en) | Data synchronization method, device, terminal and storage medium | |
| WO2024212738A1 (en) | Vibration processing method and related device | |
| CN104394450A (en) | Multimedia-frame processing method and device | |
| CN103581730A (en) | Method for achieving synchronization of audio and video on digital set top box | |
| CN114827698B (en) | Method, device, terminal equipment and storage medium for synchronizing play information | |
| CN110087116B (en) | Multi-rate live video stream editing method and device, terminal and storage medium | |
| CN102292988B (en) | Method for synchronization of interactive contextual content with broadcasting audio and/or video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant after: Hisense Visual Technology Co., Ltd. Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218 Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |