CN105744334A - Method and equipment for audio and video synchronization and synchronous playing - Google Patents
Method and equipment for audio and video synchronization and synchronous playing Download PDFInfo
- Publication number
- CN105744334A CN105744334A CN201610091514.1A CN201610091514A CN105744334A CN 105744334 A CN105744334 A CN 105744334A CN 201610091514 A CN201610091514 A CN 201610091514A CN 105744334 A CN105744334 A CN 105744334A
- Authority
- CN
- China
- Prior art keywords
- video data
- data
- audio
- video
- packets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to the field of signal transmission, in particular to a method and equipment for audio and video synchronization and synchronous playing used for solving a problem of asynchronous audio and video playing caused by a network problem in the prior art. In the embodiments, the method comprises the following steps of determining video data and audio data at the same unit time according to the marker information of the video data and the marker information of the audio data, and playing the video data according to the adjusted playing time; and adjusting the number of audio data packets in the audio data and playing the adjusted audio data. According to the embodiments of the invention, the problem of asynchronous video and audio caused by the network problem in a network transmission process is solved, so that audio and video synchronization and synchronous playing are effectively guaranteed.
Description
Technical field
The present invention relates to field of signal transmissions, particularly to a kind of audio-visual synchronization and the method and apparatus synchronizing broadcasting.
Background technology
Along with developing rapidly of information technology, the application of the multimedia technology such as IP Camera, Web TV is also more and more extensive, and streaming media playing is increasingly becoming focus.In real time streaming process, stream medium audio and video synchronizes to play, it has also become one of insider institute questions of common interest.
At present, synchronizing in playing process at real time flow medium, network delay and packet loss are that real time flow medium synchronizes to play topmost unfavorable factor.In prior art, when audio video transmission, the packet of audio frequency and video is added timestamp, this method adding timestamp at packet, efficiently solve the nonsynchronous problem of audio frequency and video because network delay causes, but, effectively do not solve in audio video transmission process, because the nonsynchronous problem of audio, video data that Network Packet Loss causes.
In sum, at present, prior art cannot solve the nonsynchronous problem of audio and video playing because network problem causes.
Summary of the invention
The present invention provides a kind of audio-visual synchronization and synchronizes the method and apparatus play, in order to solve the nonsynchronous problem of audio and video playing caused because of network problem existed in prior art.
Based on the problems referred to above, the method for a kind of audio-visual synchronization that the embodiment of the present invention provides, including:
For the audio, video data collected in the unit interval, the video data in described audio, video data is divided into N number of video data bag, and respectively N number of video data bag is carried out labelling；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；
Video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that receiving terminal is according to video marker information, when the described video data bag quantity determined in the unit interval received is not equal to N, adjust the playing duration of each video data bag received, and according to audio indicia information, when the packets of audio data determined in the unit interval received is not equal to M, adjust the packets of audio data number in described voice data.
Due to the embodiment of the present invention video data collected in the unit interval is divided into multiple packet labelling respectively, and the voice data collected in the unit interval is divided into multiple packet and carries out labelling respectively, video data after labelling and voice data are sent by different sendaisles simultaneously, make receiving terminal according to the video data bag number being divided into by video data before sending, determine when video data is imperfect, adjust the playing duration of each video data bag；Meanwhile, make receiving terminal according to the packets of audio data number that is divided into by voice data before sending, it is judged that whether be unit time whole voice data, the voice data when determining that voice data is imperfect, in adjustment voice data if receiving voice data.If existing within a unit interval because network problem causes packet loss, receiving terminal is adjusted for the audio, video data bag of this unit interval, when guarantor unit terminates the time, voice data and the video data of unit interval all finish playing, guarantee the audio-visual synchronization transmission without influence on the next unit interval, thus avoiding the video and the nonsynchronous problem of audio frequency that cause in network transmission process due to network problem, effectively ensure audio-visual synchronization transmission.
The method that a kind of audio-visual synchronization that the embodiment of the present invention provides is play, including:
Receive the video data from transmitting terminal and voice data, wherein video data and voice data are the video data that collected the described same unit interval of transmitting terminal and voice data is respectively divided into N number of video data bag and M packets of audio data, and send after respectively N number of video data bag and M packets of audio data are carried out labelling；Wherein, M, N are the integer more than 1；
Label information according to video data and the label information of voice data, it is determined that be positioned at video data and the voice data of same unit interval, and determine the video data bag number Vn in described video data and the packets of audio data number An in described voice data；
If the video data bag number Vn in described video data is not equal to N, then adjusts the playing duration of described each video data bag, and according to the playing duration after described adjustment, play described video data；If the packets of audio data number An in described voice data is not equal to M, then adjusts the packets of audio data number in described voice data, and play the voice data after adjustment.
Owing to the embodiment of the present invention receives after the video data and voice data of transmitting terminal, determined by video marker information the unit interval received video data bag number with send before the number of video data bag that video data bag is divided into whether identical, it is judged that the integrity of the video data of the unit interval received；Determined by audio indicia information the unit interval received packets of audio data number with send before the number of packets of audio data that packets of audio data is divided into whether identical, judge the integrity of the voice data received, if the video data of this unit interval is imperfect, then adjust the playing duration of each video data bag of this unit interval video data, if the voice data of unit interval is imperfect, then adjust the number of the packets of audio data of this unit interval, thus ensure that the video data of this unit interval and voice data finish playing simultaneously, and then realize the synchronous transfer of audio, video data.
On the other hand, the equipment of a kind of audio-visual synchronization that the embodiment of the present invention provides, including:
Mark module, for for the audio, video data collected in the unit interval, being divided into N number of video data bag, and respectively N number of video data bag carried out labelling by the video data in described audio, video data；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；
Sending module, for the video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that receiving terminal is according to video marker information, when the described video data bag quantity determined in the unit interval received is not equal to N, adjust the playing duration of each video data bag received, and according to audio indicia information, when the packets of audio data determined in the unit interval received is not equal to M, adjust the packets of audio data number in described voice data.
The equipment that a kind of audio-visual synchronization that the embodiment of the present invention provides is play, including:
Receiver module, for receiving video data from transmitting terminal and voice data, wherein video data and voice data are the video data that collected the described same unit interval of transmitting terminal and voice data is respectively divided into N number of video data bag and M packets of audio data, and send after respectively each video data bag and packets of audio data are carried out labelling；Wherein, M, N are the integer more than 1；
Determine module, label information for the label information according to video data and voice data, determine the video data and voice data that are positioned at the same unit interval, and determine the video data bag number Vn in described video data and the packets of audio data number An in described voice data；
Control module, when being not equal to N for the video data bag number Vn in described video data, adjust the playing duration of described each video data bag, and according to the playing duration after described adjustment, play described video data；When packets of audio data number An in described voice data is not equal to M, adjusts the packets of audio data number in described voice data, and play the voice data after adjustment.
Accompanying drawing explanation
The flow chart of the method for a kind of audio-visual synchronization that Fig. 1 provides for the embodiment of the present invention；
The flow chart of the method that Fig. 2 plays for a kind of audio-visual synchronization that the embodiment of the present invention provides；
Fig. 3 is the structural representation that embodiment of the present invention receiving terminal receives relief area；
The structural representation of the equipment of a kind of audio-visual synchronization that Fig. 4 provides for the embodiment of the present invention；
The structural representation of the equipment that Fig. 5 plays for a kind of audio-visual synchronization that the embodiment of the present invention provides.
Detailed description of the invention
Video data in described audio, video data, for the audio, video data collected in the unit interval, is divided into N number of video data bag, and respectively N number of video data bag is carried out labelling by the embodiment of the present invention；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；Video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that receiving terminal is according to video marker information, when the described video data bag quantity determined in the unit interval received is not equal to N, adjust the playing duration of each video data bag received, and according to audio indicia information, when the packets of audio data determined in the unit interval received is not equal to M, adjust the packets of audio data number in described voice data.
Due to the embodiment of the present invention video data collected in the unit interval is divided into multiple packet labelling respectively, and the voice data collected in the unit interval is divided into multiple packet and carries out labelling respectively, video data after labelling and voice data are sent by different sendaisles simultaneously, make receiving terminal according to the video data bag number being divided into by video data before sending, determine when video data is imperfect, adjust the playing duration of each video data bag；Meanwhile, make receiving terminal according to the packets of audio data number that is divided into by voice data before sending, it is judged that whether be unit time whole voice data, the voice data when determining that voice data is imperfect, in adjustment voice data if receiving voice data.If existing within a unit interval because network problem causes packet loss, receiving terminal is adjusted for the audio, video data bag of this unit interval, when guarantor unit terminates the time, voice data and the video data of unit interval all finish playing, guarantee the audio-visual synchronization transmission without influence on the next unit interval, thus avoiding the video and the nonsynchronous problem of audio frequency that cause in network transmission process due to network problem, effectively ensure audio-visual synchronization transmission.
Wherein, the network problem in network transmission process includes Network Packet Loss and network delay.
Below in conjunction with Figure of description, the embodiment of the present application is described in further detail.
As it is shown in figure 1, the method for a kind of audio-visual synchronization transmission of the embodiment of the present invention, including:
Step 101, for the audio, video data collected in the unit interval, the video data in described audio, video data is divided into N number of video data bag, and respectively N number of video data bag is carried out labelling；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；
Step 102, the video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that receiving terminal is according to video marker information, when the described video data bag quantity determined in the unit interval received is not equal to N, adjust the playing duration of each video data bag received, and according to audio indicia information, when the packets of audio data determined in the unit interval received is not equal to M, adjust the packets of audio data number in described voice data.
In the embodiment of the present invention, transmitting terminal adopts two independent sendaisles, the video collected for synchronized transmission and audio frequency, and the mechanism of video sendaisle and audio frequency sendaisle and flow process are identical, thus ensureing the synchronized transmission of video and audio frequency.
Optionally, M and N differs.
Owing to the size of data of unit interval video data is much larger than the size of data of same unit interval voice data, buffer memory for the ease of each video data bag, the size of data of each video data bag can not be excessive, therefore, the video data of unit interval is being divided into M video data bag, when voice data is divided into N number of packets of audio data, it is necessary to make M more than N.
Concrete, video data is carried out labelling according to the following step by the embodiment of the present invention.
1, the video data in the unit interval is divided into N number of video data bag；
In enforcement, optionally, the video data in the unit interval is divided into N number of video data bag, it is preferred that using one-frame video data as a video data bag.Such as, the unit interval is 1s, and the video data in this 1s includes 15 frames, then the video data in this 1s is divided into 15 video data bags, and namely the data of each frame are as a video data bag.
2, respectively each video data bag is carried out labelling；
Optionally, according to time sequencing, N number of video data bag is added respectively video heads labelling and the corresponding video heads labelling of each video data bag；Wherein, the video heads labelling of first video data bag and the video heads labelling of other video data bag are different.
Owing to N number of video data bag is added video heads labelling by the embodiment of the present invention respectively, it is simple to the video data bag number of the unit interval that receiving terminal is received by video heads marker for judgment, thus accurately determining the integrity of the video data received.
In the embodiment of the present invention, when the N number of video data bag for the unit time adds video heads labelling, it is necessary to add only one video heads labelling for each video data bag, and the video heads of first video data bag is labeled as special video heads labelling.Such as, the unit interval is that the video data of 1s, 1s includes 10 frames, then using frame each in the video data of this 1s as a video data bag, it is divided into 10 video data bags, is Th by first video data packet making, the labeling head of 9 video data bags of residue can be identical, it is also possible to different；Such as, remain 9 video data Bao Jun and be labeled as Ti, or 9 video data bags of residue are labeled as T1, T2, T3, T4, T5, T6, T7, T8 successively.
Or, the playing sequence when video data bag is carried out labelling, according to the video data of unit interval, it is also possible to add timestamp at each video data bag.
Such as, for the video data in 1s, the video data of 1s is included 10 frames, then using frame each in the video data of this 1s as a video data bag, being divided into 10 video data bags, first video data bag is added timestamp is 00:00:00, it is 00:00:06 that second video data bag adds timestamp, it is 00:00:12 that 3rd video data bag adds timestamp, the like, the timestamp of the tenth video data bag interpolation is 00:00:54.
It should be noted that, before the video data transmission that transmitting terminal collects, need to pre-set the transmission frequency of video, owing to Voice & Video is synchronized transmission, therefore the transmission frequency of video and the transmission frequency of audio frequency are identical, and benchmark lock in time that the transmission frequency of just identical video and audio frequency sends as audio-visual synchronization.
Concrete, voice data is carried out labelling according to the following step by the embodiment of the present invention.
1, the voice data in the unit interval is divided into M packets of audio data；
In enforcement, optionally, the voice data in the unit interval is divided into M packets of audio data.Such as, the unit interval is 1s, and the voice data in 1s is divided into 10 packets of audio data, and namely the voice data of every 0.1s is as a packets of audio data.
2, respectively each packets of audio data is carried out labelling；
Optionally, M packets of audio data is added identical or different audio head labelling, wherein the corresponding audio head labelling of each packets of audio data.
Owing to M packets of audio data is added audio head labelling by the embodiment of the present invention, it is simple to the packets of audio data number of the unit interval that receiving terminal is received by audio head marker for judgment, thus accurately determining the integrity of the voice data received.
In the embodiment of the present invention, when M the packets of audio data for the unit time adds audio head labelling, it is necessary to add only one audio head labelling for each packets of audio data, and this M audio head labelling can be identical or different audio head labelling.Such as, unit interval is 1s, voice data in 1s is divided into 10 packets of audio data, it is that 10 packets of audio data interpolation audio head labellings are followed successively by Tm0, Tm1, Tm2, Tm3, Tm4, Tm5, Tm6, Tm7, Tm8, Tm9, or, it is that 10 packets of audio data interpolation audio head labellings are Tm.
Or, the playing sequence when sound packet is carried out labelling, according to the video data of unit interval, it is also possible to add timestamp in each packets of audio data.
Such as, for the voice data in 1s, voice data in 1s is divided into 10 packets of audio data, first packets of audio data is added timestamp is 00:00:00, it is 00:00:06 that second packets of audio data adds timestamp, it is 00:00:12 that 3rd packets of audio data adds timestamp, the like, the timestamp of the tenth packets of audio data interpolation is 00:00:54.
In enforcement, the audio head that the video heads labelling added for the video data of same unit interval and voice data add is labeled as different types of labeling head, in order to according to label information, receiving terminal judges that whether video data and voice data be complete.
It should be noted that, before the voice data transmission that transmitting terminal collects, need to pre-set the transmission frequency of audio frequency, owing to Voice & Video is synchronized transmission, therefore the transmission frequency of audio frequency and the transmission frequency of video are identical, and using the transmission frequency of identical video and audio frequency as benchmark lock in time that audio-visual synchronization sends.
The embodiment of the present invention before adding video transmission relief area to, and voice data adding to audio frequency transmission relief area by the video data of the unit interval collected, in addition it is also necessary to does following judgement.
Optionally, satisfying condition for the moment, the video data in the audio, video data collected is being added to video send in relief area in the described unit interval, and the voice data in described audio, video data is being added in audio frequency transmission relief area；Being unsatisfactory for condition for the moment, abandon the audio, video data collected in the described unit interval；Its conditional one is: video sends the video data volume to be sent in relief area and is not more than first threshold, and the amount of audio data to be sent that described audio frequency sends in relief area is not more than Second Threshold.
The video data of the unit interval collected is being added to video transmission relief area by the embodiment of the present invention, and before voice data is added to audio frequency transmission relief area, judge that in transmission relief area, whether the video data volume is more than first threshold, and judge that whether audio frequency sends the amount of audio data in relief area more than Second Threshold.Send the video data volume to be sent in relief area at video and be not more than first threshold, and when the amount of audio data to be sent in audio frequency transmission relief area is not more than Second Threshold, illustrate that network is unimpeded, it is possible to continue buffer memory audio, video data；If in video transmission relief area, the video data volume is more than first threshold, it is determined that the video data of this unit interval cannot add video to and send in relief area；Or audio frequency sends the amount of audio data in relief area more than Second Threshold, then determine that the voice data of this unit interval cannot add audio frequency to and send in relief area, or, video sends the video data volume in relief area and sends the amount of audio data in relief area more than Second Threshold more than first threshold and audio frequency, then determine that the video data of unit interval cannot add video to and send in relief area, and voice data cannot add audio frequency to and send in relief area, in order to ensure the synchronous transfer of video and audio frequency, when at video and audio frequency, one of them cannot add, then abandon video data and the voice data of this unit interval, thus avoiding the packet loss because network congestion causes, and then ensure the synchronized transmission of audio, video data.
Wherein, to be user set in advance according to the video data volume and the amount of audio data of unit interval for first threshold and Second Threshold.
Such as, when the unit interval is 1s, if video sends relief area and can add at most the video data of 3s, and the video data volume of 1s is A, audio frequency sends relief area can add at most the voice data of 3s, and the amount of audio data of 1s is B, then setting first threshold as 2A, Second Threshold is 2B.In the T0 moment, the video data of the 1s collected is added to video and sends relief area, and when the voice data of this 1s is added to audio frequency transmission relief area, network congestion is there will be in transmitting due to network, video and voice data before causing do not send, and determining that the video data volume that video sends in relief area is more than 2A, and determining that amount of audio data that audio frequency sends in relief area is more than 2B, then abandoning video data and the voice data of the 1s started from the T0 moment.
As in figure 2 it is shown, the embodiment of the present invention also provides for a kind of method that audio-visual synchronization is play, including:
Step 201, receive from the video data of transmitting terminal and voice data, wherein video data and voice data are the video data that collected the described same unit interval of transmitting terminal and voice data is respectively divided into N number of video data bag and M packets of audio data, and send after respectively N number of video data bag and M packets of audio data are carried out labelling；Wherein, M, N are the integer more than 1；
Step 202, label information according to the label information of video data and voice data, determine the video data and voice data that are positioned at the same unit interval, and determine the video data bag number Vn in described video data and the packets of audio data number An in described voice data；
If the video data bag number Vn in the described video data of step 203 is not equal to N, then adjusts the playing duration of described each video data bag, and according to the playing duration after described adjustment, play described video data；If the packets of audio data number An in described voice data is not equal to M, then adjusts the packets of audio data number in described voice data, and play the voice data after adjustment.
Owing to the embodiment of the present invention receives after the video data and voice data of transmitting terminal, determined by video marker information the unit interval received video data bag number with send before the number of video data bag that video data bag is divided into whether identical, it is judged that the integrity of the video data of the unit interval received；Determined by audio indicia information the unit interval received packets of audio data number with send before the number of packets of audio data that packets of audio data is divided into whether identical, judge the integrity of the voice data received, if the video data of this unit interval is imperfect, then adjust the playing duration of each video data bag of this unit interval video data, if the voice data of unit interval is imperfect, then adjust the number of the packets of audio data of this unit interval, thus ensure that the video data of this unit interval and voice data finish playing simultaneously, and then realize the synchronous transfer of audio, video data.
The video data that in the embodiment of the present invention, receiving terminal receives is the video data after labelling, and the voice data that receiving terminal receives is the voice data after labelling.
Wherein, for the audio, video data of unit interval, the embodiment of the present invention adopts following manner that video data is carried out labelling.
The video data of unit interval is divided into N number of video data bag, according to time sequencing, N number of video data bag is added respectively video heads labelling and the corresponding video heads labelling of each video data bag；Wherein, the video heads labelling of first video data bag and the video heads labelling of other video data bag are different.
For the audio, video data of unit interval, the embodiment of the present invention adopts following manner that voice data is carried out labelling.
The voice data of unit interval being divided into M packets of audio data, according to time sequencing, N number of packets of audio data is added audio head labelling respectively, wherein, N number of audio head labelling can be identical or different.
At receiving terminal, arrange one and receive relief area, as it is shown on figure 3, this reception relief area is divided into again five parts, respectively video Dan Bao data receiver district 301, audio frequency Dan Bao data receiver district 302, the linear queue buffer 303 of audio frequency and video, Video processing relief area 304 and Audio Processing relief area 305.Wherein, single bag video data that video Dan Bao data receiver district 301 sends from video sendaisle for receiving end/sending end；Single bag voice data that audio frequency Dan Bao data receiver district 302 sends from audio frequency sendaisle for receiving end/sending end；The linear queue buffer 303 of audio frequency and video is for storing the video data bag received and packets of audio data linear queue sequentially in time, and determines video data and the voice data of same unit interval according to video marker information and audio indicia information；Video processing relief area 304 is for storing the video data of the same unit interval that the linear queue buffer of audio frequency and video 303 is determined, and this video data queue of labelling；Audio Processing relief area 305 is for storing the voice data of the same unit interval corresponding with Video processing relief area 304, and this voice data queue of labelling.
Introduce reception and the player method of audio, video data in detail below.
1, when receiving terminal receives the video data and voice data that adopt two different Channel Synchronous to send, video data and voice data are separately deposited, leave each video data bag received in video Dan Bao data receiver district 301, each packets of audio data received is left in audio frequency Dan Bao data receiver district 302；
2, according to time sequencing, the video data bag that video Dan Bao data receiver district 301 is received, and the packets of audio data that audio frequency Dan Bao data receiver district 302 receives is stored in the linear queue buffer 303 of audio frequency and video sequentially in time successively；
3, the label information according to video marker information and voice data, it is determined that be positioned at video data and the voice data of same unit interval in the linear queue buffer of audio frequency and video 303；
4, read the video data being positioned at the same unit interval in the linear queue buffer of audio frequency and video 303, deposit in Video processing relief area 304, and be labeled as Fv；Read the voice data being positioned at the same unit interval in the linear queue buffer of audio frequency and video 303, deposit in Audio Processing relief area 305, and be labeled as Fa；
5, the video data bag number Vn of video data in Video processing relief area 304 is determined, it is judged that whether Vn is equal to N, if it is not, then adjust the playing duration of each video data bag of this unit interval, if so, then the video data of this unit interval is complete, it is not necessary to adjust；Determine the packets of audio data number An of Audio Processing relief area 305 sound intermediate frequency data, it is judged that An is whether equal to M, if it is not, the packets of audio data number of then unit of adjustment's time, if so, then the voice data of this unit interval is complete, it is not necessary to adjust.
6, the playing duration according to video data bag each in Video processing relief area 304, and the playing duration of each packets of audio data in Audio Processing relief area 305, simultaneously playing video data and voice data.
According to time sequencing, after described video data and described voice data are stored in reception relief area, determine the video data being positioned at the same unit interval and voice data according to following manner:
According to described video marker information, obtain the video data bag between the two adjacent video data having special video labeling head in described reception relief area, and it is positioned at the video data bag having special video labeling head above, and it is stored in Video processing relief area, as the video data of a unit interval；According to described audio indicia information, obtain the packets of audio data between the two adjacent video data having special video labeling head, and be stored in Audio Processing relief area, as the voice data of a unit interval；And using the voice data of the video data of one unit interval and the one unit interval video data as the same unit interval and voice data.
A kind of according to video marker information and audio indicia information owing to embodiments providing, determine the video data of same unit interval and the method for voice data, thus accurately determining video data and the voice data of same unit interval, and then obtain video data bag number and the packets of audio data number of unit interval, and determine Network Packet Loss situation, it is adjusted correspondingly, thus avoiding the audio and video playing caused because of Network Packet Loss asynchronous.
The video data received and voice data are stored in after the linear queue buffer 303 of audio frequency and video by the embodiment of the present invention jointly, according to video marker information, determine the position of adjacent two video data bags having special video labeling head in the linear queue buffer of audio frequency and video 303, then will be located in the two and have the video data bag between the video data bag of special video labeling head, and it is positioned at the video data bag having special video labeling head above, video data as the unit interval, and be stored in Video processing relief area 304, it is labeled as Fv.Will be located in the two and have the packets of audio data between the video data bag of special video labeling head, as the voice data of unit interval, and be stored in Audio Processing relief area 305, be labeled as Fa.
It should be noted that the video data of the unit interval being stored in Video processing relief area 304, and the voice data of the unit interval being stored in Audio Processing relief area 305, for video data and the voice data of same unit interval.
Such as, when unit interval is 1s, the video data of 1s is 10 frames, when the video data of 1s and voice data are carried out labelling, the video data of 1s is divided into 10 video data bags, each video data bag is the video data of a frame, and these 10 video data bags are labeled as Th, T1, T2, T3, T4, T5, T6, T7, T8, T9 successively；The voice data of 1s is divided into 8 packets of audio data, is all labeled as Tm；According to time sequencing, when video data bag and packets of audio data are stored in audio frequency and video linear queue buffer 303, storage order is Th, Tm, T1, Tm, T2, Tm, T3, Tm, T4, T5, Tm, T6, Tm, T7, Tm, T8, Tm, T9, Th, Tm, T1, Tm, T2 ... determine the position of the video data bag of adjacent two Th labeling heads in the linear queue buffer of audio frequency and video 303, by the video data bag between two adjacent Th labeling heads, and the video data bag of Th labeling head above is as the video data of 1s, it is labeled as Fv, then the queue of Fv video data is: Th, T1, T2, T3, T4, T5, T6, T7, T8, T9, and be stored in Video processing relief area 304；Using the packets of audio data between two adjacent Th labeling heads as the voice data of 1s, be labeled as Fa, then the queue of Fa video data is: Tm, Tm, Tm, Tm, Tm, Tm, Tm, Tm, and is stored in Audio Processing relief area 305.Wherein, Video processing relief area 304 is labeled as the video data of Fv, with the data that voice data is same 1s being labeled as Fa in Audio Processing relief area 305.
The embodiment of the present invention, after the video data determining the same unit interval and voice data, also needs to judge that whether the video data being stored in Video processing relief area 304 is complete, and judges that whether the voice data being stored in Audio Processing relief area 305 is complete.
Whether the video data bag number Vn of video data is during equal to N in judging Video processing relief area 304 for the embodiment of the present invention, and Vn is not equal to N and includes again following two situation.
One, determine that Vn is more than N.
In network transmission process, packet loss phenomenon often occurs when network condition is poor, if in video data transmission process, video data packet loss with special labeling head, then when there being the video data that the unit interval determined by the video data bag of special labeling head according to adjacent two, the video data bag that can cause the unit interval determined increases, and namely determines that the video data bag Vn of video data of unit interval is more than N.
Such as, when the unit interval is 1s, the video data of 1s is 5 frames, the video data of 1s is divided into 5 packets, and is labeled as Th, T1, T2, T3, T4 with this；The voice data of 1s is divided into 3 packets, all it is labeled as Tm, if in transmitting procedure, video data packet loss with special labeling head, according to time sequencing, video data bag and the packets of audio data deposited at the linear queue buffer 303 of audio frequency and video are followed successively by: Th, Tm, T1, Tm, T2, T3, Tm, T4, Tm, T1, Tm, T2, T3, Tm, T4, Th, Tm, T1, Tm, T2, T3, Tm, T4 ... then when determining the video data of unit interval, video data bag between adjacent two video data bags with special labeling head is Th, T1, T2, T3, T4, T1, T2, T3, T4, namely the video data bag Vn=9 of the video data of unit interval is determined.
Two, determine that Vn is less than N.
In network transmission process, packet loss phenomenon often occurs when network condition is poor, if in video data transmission process, video data packet loss with no special labeling head, then when there being the video data that the unit interval determined by the video data bag of special labeling head according to adjacent two, the video data bag that can cause the unit interval determined reduces, and namely determines that the video data bag Vn of video data of unit interval is less than N.
Such as, when the unit interval is 1s, the video data of 1s is 5 frames, the video data of 1s is divided into 5 packets, and is labeled as Th, T1, T2, T3, T4 with this；The voice data of 1s is divided into 3 packets, all it is labeled as Tm, if in transmitting procedure, video data packet loss with no special labeling head, according to time sequencing, video data bag and the packets of audio data deposited at the linear queue buffer 303 of audio frequency and video are followed successively by: Th, Tm, T1, Tm, T3, Tm, T4, Th, Tm, T1, Tm, T2 ... then when determining the video data of unit interval, video data bag between adjacent two video data bags with special labeling head is Th, T1, T3, T4, namely the video data bag Vn=4 of the video data of unit interval is determined.
The embodiment of the present invention is when the video data bag number Vn determining the unit interval video data received is not equal to N, it is necessary to adjusts the playing duration Tn of each video data bag, and is adjusted according to following manner.
Optionally, by the unit interval divided by the video data bag number Vn in video data, the quotient obtained is as the playing duration of each video data bag.
The embodiment of the present invention, when the video data bag number Vn determining the unit interval video data received is not equal to N, adjusts the playing duration Tn=T/Vn of each video data bag, and wherein, T is the unit time.
Due to the method embodiments providing the playing duration adjusting each video data bag, thus controlling the playing duration of each video data bag flexibly.
It should be noted that, after transmitting terminal is determined and the video data of unit interval is divided into N number of packet, calculate the playing duration Tn=T/N of each video data bag of the video data obtaining this unit interval, and the value of Tn is preset, if receiving terminal determines the video data bag number Vn of the unit interval video data received equal to N, then without adjusting the playing duration of each video data bag, the value of Tn set in advance is directly adopted to play the video data of this unit interval.
Such as, when unit interval is 1s, the video data of 1s is 10 frames, when the video data of 1s and voice data are carried out labelling, the video data of 1s is divided into 10 video data bags, then preset the playing duration Tn=0.1s of each video data bag of this unit interval, if during the packet number Vn=8 of this unit interval that receiving terminal receives, then adjust the playing duration Tn=1/8=0.125s of each video data bag of this unit interval, and play the video data of this unit interval according to Tn=0.125s.
The embodiment of the present invention is when whether the packets of audio data number An judging Audio Processing relief area 305 sound intermediate frequency data is equal to M, and An is not equal to M and includes again following two situation.
One, determine that An is more than M.
In network transmission process, packet loss phenomenon often occurs when network condition is poor, if in video data transmission process, video data packet loss with special labeling head, then when there being the voice data that the unit interval determined by the video data bag of special labeling head according to adjacent two, the packets of audio data that can cause the unit interval determined increases, and namely determines that the video data bag An of video data of unit interval is more than M.
Such as, when the unit interval is 1s, the video data of 1s is 5 frames, the video data of 1s is divided into 5 packets, and is labeled as Th, T1, T2, T3, T4 with this；The voice data of 1s is divided into 3 packets, all it is labeled as Tm, if in transmitting procedure, video data packet loss with special labeling head, according to time sequencing, video data bag and the packets of audio data deposited at the linear queue buffer 303 of audio frequency and video are followed successively by: Th, Tm, T1, Tm, T2, T3, Tm, T4, Tm, T1, Tm, T2, T3, Tm, T4, Th, Tm, T1, Tm, T2, T3, Tm, T4 ... then when determining the video data of unit interval, video data bag between adjacent two video data bags with special labeling head is Tm, Tm, Tm, Tm, Tm, Tm, namely the video data bag An=6 of the video data of unit interval is determined.
Two, determine that An is less than M.
In network transmission process, packet loss phenomenon often occurs when network condition is poor, if in voice data transmitting procedure, portion of audio data packet loss, then when there being the voice data that the unit interval determined by the video data bag of special labeling head according to adjacent two, the packets of audio data that can cause the unit interval determined reduces, and namely determines that the packets of audio data An of voice data of unit interval is less than M.
Such as, when the unit interval is 1s, the video data of 1s is 5 frames, the video data of 1s is divided into 5 packets, and is labeled as Th, T1, T2, T3, T4 with this；The voice data of 1s is divided into 3 packets, all it is labeled as Tm, if in transmitting procedure, one voice data packet loss, according to time sequencing, video data bag and the packets of audio data deposited at the linear queue buffer 303 of audio frequency and video are followed successively by: Th, Tm, T1, Tm, T2, T3, T4, Th, Tm, T1, Tm, T2 ... then when determining the voice data of unit interval, packets of audio data between adjacent two video data bags with special labeling head is Tm, Tm, namely determines the packets of audio data An=2 of the voice data of unit interval.
The embodiment of the present invention is when the packets of audio data number An determining the unit interval voice data received is not equal to M, it is necessary to adjusts the number An of the packets of audio data of this unit interval, and is adjusted according to following manner.
Optionally, if An is > M, then abandon An-M packets of audio data in described voice data；If An is < M, then from alternative audio packet, chooses M-An packets of audio data, insert in described voice data.
Due to the method embodiments providing the packets of audio data number adjusted in voice data, thus the packets of audio data number being effectively ensured the unit interval is constant.
The embodiment of the present invention deposits multiple alternative audio packet in advance in Audio Processing relief area, the size of this alternative audio packet is identical with the size of M the packets of audio data that voice data is divided into by transmitting terminal, and these alternative audio data are the ambient sound data realizing recording, the not voice data of simply complete zero or complete.
The embodiment of the present invention is in the number An > M of the packets of audio data determining the unit interval received, then An-M packets of audio data of random drop；At the number An < M of the packets of audio data determining the unit interval received, then choose in the voice data that M-An alternative audio packet adds the unit interval at random to.Thus the number of the packets of audio data of guarantor unit's time is always M.And the playing duration Ta according to each packets of audio data of unit interval set in advance plays audio frequency.
It should be noted that after transmitting terminal is determined and the voice data of unit interval is divided into M packet, calculate the playing duration Ta=T/M of each packets of audio data of the voice data obtaining this unit interval, and the value of Tn preset.
Based on same inventive concept, the embodiment of the present application additionally provides the equipment of a kind of audio-visual synchronization, owing to the principle of this equipment solution problem is similar to the method for the embodiment of the present application audio-visual synchronization, therefore the enforcement of this equipment may refer to the enforcement of method, repeats part and repeats no more.
As shown in Figure 4, the equipment of a kind of audio-visual synchronization of the embodiment of the present invention, including:
Mark module 401, for for the audio, video data collected in the unit interval, being divided into N number of video data bag, and respectively N number of video data bag carried out labelling by the video data in described audio, video data；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；
Sending module 402, for the video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that according to video marker information, receiving terminal judges that whether the video data received is complete, and judge that whether the voice data received is complete according to audio indicia information.
Optionally, described mark module 401, it is additionally operable to:
Satisfying condition for the moment, the video data in the audio, video data collected is being added to video send in relief area in the described unit interval, and the voice data in described audio, video data is being added in audio frequency transmission relief area；Being unsatisfactory for condition for the moment, abandon the audio, video data collected in the described unit interval；Described condition one is: video sends the video data volume to be sent in relief area and is not more than first threshold, and the amount of audio data to be sent that described audio frequency sends in relief area is not more than Second Threshold.
Optionally, described mark module 401, specifically for:
According to time sequencing, N number of video data bag is added respectively video heads labelling and the corresponding video heads labelling of each video data bag；Wherein, the video heads labelling of first video data bag and the video heads labelling of other video data bag are different；M packets of audio data is added identical or different audio head labelling, wherein the corresponding audio head labelling of each packets of audio data.
As it is shown in figure 5, the equipment that a kind of audio-visual synchronization that the embodiment of the present invention provides is play, including:
Receiver module 501, for receiving video data from transmitting terminal and voice data, wherein video data and voice data are the video data that collected the described same unit interval of transmitting terminal and voice data is respectively divided into N number of video data bag and M packets of audio data, and send after respectively N number of video data bag and M packets of audio data are carried out labelling；Wherein, M, N are the integer more than 1；
Determine module 502, label information for the label information according to video data and voice data, determine the video data and voice data that are positioned at the same unit interval, and determine the video data bag number Vn in described video data and the packets of audio data number An in described voice data；
Control module 503, when being not equal to N for the video data bag number Vn in described video data, adjust the playing duration of described each video data bag, and according to the playing duration after described adjustment, play described video data；When packets of audio data number An in described voice data is not equal to M, adjusts the packets of audio data number in described voice data, and play the voice data after adjustment.
Optionally, described determine module 502, specifically for:
According to time sequencing, described video data and described voice data are stored in reception relief area；According to described video marker information, obtain the video data bag between the two adjacent video data having special video labeling head in described reception relief area, and it is positioned at the video data bag having special video labeling head above, and it is stored in Video processing relief area, as the video data of a unit interval；According to described audio indicia information, obtain the packets of audio data between the two adjacent video data having special video labeling head, and be stored in Audio Processing relief area, as the voice data of a unit interval；And using the voice data of the video data of one unit interval and the one unit interval video data as the same unit interval and voice data.
Optionally, described control module 503, specifically for:
By the unit interval divided by the video data bag number Vn in video data, the quotient obtained is as the playing duration of each video data bag；When An > M, abandon An-M packets of audio data in described voice data；When An < M, from alternative audio packet, choose M-An packets of audio data, insert in described voice data.
Above by reference to illustrating that block diagram and/or flow chart according to the method for the embodiment of the present application, device (system) and/or computer program describe the application.Should be understood that and can be realized a block of block diagram and/or flowchart illustration and the combination of the block of block diagram and/or flowchart illustration by computer program instructions.These computer program instructions can be supplied to general purpose computer, the processor of special-purpose computer and/or other programmable data and process device, to produce machine so that the instruction processing device execution via computer processor and/or other programmable data creates the method for realizing function/action specified in block diagram and/or flow chart block.
Correspondingly, it is also possible to implement the application with hardware and/or software (including firmware, resident software, microcode etc.).Further, the application can take computer to use or the form of computer program on computer-readable recording medium, it has the computer realized in media as well and can use or computer readable program code, with used by instruction execution system or combined command perform system and use.In the present context, computer can use or computer-readable medium can be arbitrary medium, it can comprise, stores, communicates, transmit or transmission program, and to be used by instruction execution system, device or equipment, or combined command performs system, device or equipment and uses.
Obviously, the present invention can be carried out various change and modification without deviating from the spirit and scope of the present invention by those skilled in the art.So, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (10)
1. the method for an audio-visual synchronization, it is characterised in that the method includes:
For the audio, video data collected in the unit interval, the video data in described audio, video data is divided into N number of video data bag, and respectively N number of video data bag is carried out labelling；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；
Video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that receiving terminal is according to video marker information, when the described video data bag quantity determined in the unit interval received is not equal to N, adjust the playing duration of each video data bag received, and according to audio indicia information, when the packets of audio data determined in the unit interval received is not equal to M, adjust the packets of audio data number in described voice data.
2. the method for claim 1, it is characterised in that described video data in audio, video data is divided into N number of video data bag, and before the voice data in described audio, video data is divided into M packets of audio data, also include:
Satisfying condition for the moment, the video data in the audio, video data collected is being added to video send in relief area in the described unit interval, and the voice data in described audio, video data is being added in audio frequency transmission relief area；
Being unsatisfactory for condition for the moment, abandon the audio, video data collected in the described unit interval；
Described condition one is: video sends the video data volume to be sent in relief area and is not more than first threshold, and the amount of audio data to be sent that described audio frequency sends in relief area is not more than Second Threshold.
3. the method for claim 1, it is characterised in that described respectively N number of video data bag is carried out labelling, including:
According to time sequencing, N number of video data bag is added respectively video heads labelling and the corresponding video heads labelling of each video data bag；Wherein, the video heads labelling of first video data bag and the video heads labelling of other video data bag are different；
Described respectively M packets of audio data is carried out labelling, including:
M packets of audio data is added identical or different audio head labelling, wherein the corresponding audio head labelling of each packets of audio data.
4. the method that an audio-visual synchronization is play, it is characterised in that including:
Receive the video data from transmitting terminal and voice data, wherein video data and voice data are the video data that collected the described same unit interval of transmitting terminal and voice data is respectively divided into N number of video data bag and M packets of audio data, and send after respectively N number of video data bag and M packets of audio data are carried out labelling；Wherein, M, N are the integer more than 1；
Label information according to video data and the label information of voice data, it is determined that be positioned at video data and the voice data of same unit interval, and determine the video data bag number Vn in described video data and the packets of audio data number An in described voice data；
If the video data bag number Vn in described video data is not equal to N, then adjusts the playing duration of described each video data bag, and according to the playing duration after described adjustment, play described video data；If the packets of audio data number An in described voice data is not equal to M, then adjusts the packets of audio data number in described voice data, and play the voice data after adjustment.
5. method as claimed in claim 4, it is characterised in that the label information of the described label information according to video data and voice data, it is determined that be positioned at video data and the voice data of same unit interval, including:
According to time sequencing, described video data and described voice data are stored in reception relief area；
According to described video marker information, obtain the video data bag between the two adjacent video data having special video labeling head in described reception relief area, and it is positioned at the video data bag having special video labeling head above, and it is stored in Video processing relief area, as the video data of a unit interval；According to described audio indicia information, obtain the packets of audio data between the two adjacent video data having special video labeling head, and be stored in Audio Processing relief area, as the voice data of a unit interval；And using the voice data of the video data of one unit interval and the one unit interval video data as the same unit interval and voice data.
6. method as claimed in claim 4, it is characterised in that the playing duration of each video data bag of described adjustment, including:
By the unit interval divided by the video data bag number Vn in video data, the quotient obtained is as the playing duration of each video data bag；
If the packets of audio data number An in described voice data is not equal to M, then adjust the packets of audio data number in described voice data, including:
If An is > M, then abandon An-M packets of audio data in described voice data；
If An is < M, then from alternative audio packet, chooses M-An packets of audio data, insert in described voice data.
7. the equipment of an audio-visual synchronization, it is characterised in that including:
Mark module, for for the audio, video data collected in the unit interval, being divided into N number of video data bag, and respectively N number of video data bag carried out labelling by the video data in described audio, video data；And the voice data in described audio, video data is divided into M packets of audio data, and respectively M packets of audio data is carried out labelling；Wherein, M, N are the integer more than 1；
Sending module, for the video data after labelling and the voice data after labelling are sent by different sendaisles simultaneously, so that receiving terminal is according to video marker information, when the described video data bag quantity determined in the unit interval received is not equal to N, adjust the playing duration of each video data bag received, and according to audio indicia information, when the packets of audio data determined in the unit interval received is not equal to M, adjust the packets of audio data number in described voice data.
8. equipment as claimed in claim 7, it is characterised in that described mark module, specifically for:
According to time sequencing, N number of video data bag is added respectively video heads labelling and the corresponding video heads labelling of each video data bag；Wherein, the video heads labelling of first video data bag and the video heads labelling of other video data bag are different；M packets of audio data is added identical or different audio head labelling, wherein the corresponding audio head labelling of each packets of audio data.
9. the equipment that an audio-visual synchronization is play, it is characterised in that including:
Receiver module, for receiving video data from transmitting terminal and voice data, wherein video data and voice data are the video data that collected the described same unit interval of transmitting terminal and voice data is respectively divided into N number of video data bag and M packets of audio data, and send after respectively each video data bag and packets of audio data are carried out labelling；Wherein, M, N are the integer more than 1；
Determine module, label information for the label information according to video data and voice data, determine the video data and voice data that are positioned at the same unit interval, and determine the video data bag number Vn in described video data and the packets of audio data number An in described voice data；
Control module, when being not equal to N for the video data bag number Vn in described video data, adjust the playing duration of described each video data bag, and according to the playing duration after described adjustment, play described video data；When packets of audio data number An in described voice data is not equal to M, adjusts the packets of audio data number in described voice data, and play the voice data after adjustment.
10. equipment as claimed in claim 9, it is characterised in that described determine module, specifically for:
According to time sequencing, described video data and described voice data are stored in reception relief area；
According to described video marker information, obtain the video data bag between the two adjacent video data having special video labeling head in described reception relief area, and it is positioned at the video data bag having special video labeling head above, and it is stored in Video processing relief area, as the video data of a unit interval；According to described audio indicia information, obtain the packets of audio data between the two adjacent video data having special video labeling head, and be stored in Audio Processing relief area, as the voice data of a unit interval；And using the voice data of the video data of one unit interval and the one unit interval video data as the same unit interval and voice data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610091514.1A CN105744334A (en) | 2016-02-18 | 2016-02-18 | Method and equipment for audio and video synchronization and synchronous playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610091514.1A CN105744334A (en) | 2016-02-18 | 2016-02-18 | Method and equipment for audio and video synchronization and synchronous playing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105744334A true CN105744334A (en) | 2016-07-06 |
Family
ID=56246014
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610091514.1A Pending CN105744334A (en) | 2016-02-18 | 2016-02-18 | Method and equipment for audio and video synchronization and synchronous playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105744334A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN107342098A (en) * | 2017-07-20 | 2017-11-10 | 青岛海信电器股份有限公司 | Audio frequency playing method and device |
| CN108614829A (en) * | 2016-12-12 | 2018-10-02 | 中移（杭州）信息技术有限公司 | A kind of playback method and terminal |
| CN108769770A (en) * | 2018-06-21 | 2018-11-06 | 广州酷狗计算机科技有限公司 | The method and apparatus for adjusting audio unit |
| CN109327724A (en) * | 2017-08-01 | 2019-02-12 | 成都鼎桥通信技术有限公司 | Audio and video synchronization playing method and device |
| WO2019153960A1 (en) * | 2018-02-11 | 2019-08-15 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for synchronizing audio and video |
| CN110312159A (en) * | 2019-05-24 | 2019-10-08 | 深圳市朗强科技有限公司 | A kind of signal receiving device, stream media transmission system and flow-medium transmission method |
| CN110519627A (en) * | 2018-05-21 | 2019-11-29 | 视联动力信息技术股份有限公司 | A kind of synchronous method and device of audio data |
| CN110545447A (en) * | 2019-07-31 | 2019-12-06 | 视联动力信息技术股份有限公司 | Audio and video synchronization method and device |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| CN113590079A (en) * | 2021-08-05 | 2021-11-02 | 广州飞傲电子科技有限公司 | Music playing control method and device and computer readable storage medium |
| CN114024925A (en) * | 2021-11-02 | 2022-02-08 | 成都达拓智通科技有限公司 | Method for controlling discontinuous call audio stream transmission queue |
| CN115297335A (en) * | 2022-08-03 | 2022-11-04 | 深圳市野草声学有限公司 | Audio transmission method and system during video live broadcasting based on receiving buffer area |
| CN115297337A (en) * | 2022-08-05 | 2022-11-04 | 深圳市野草声学有限公司 | Audio transmission method and system during video live broadcasting based on data receiving and transmitting cache |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080056154A1 (en) * | 2006-09-06 | 2008-03-06 | Cisco Technology, Inc. | Measurement of round-trip delay over a network |
| US20080263402A1 (en) * | 2007-04-20 | 2008-10-23 | Nethawk Oyj | method, arrangement, testing device and program for testing multimedia communication equipment and software |
| CN101303880A (en) * | 2008-06-30 | 2008-11-12 | 北京中星微电子有限公司 | Method and apparatus for recording and playing audio-video document |
| CN102404650A (en) * | 2011-11-30 | 2012-04-04 | 江苏奇异点网络有限公司 | Method for synchronously controlling audio and video of online video |
| CN102740064A (en) * | 2012-06-15 | 2012-10-17 | 福建星网视易信息系统有限公司 | Packing method for streaming media transmission in intercom system |
| CN103546662A (en) * | 2013-09-23 | 2014-01-29 | 浙江工业大学 | Audio and video synchronizing method in network monitoring system |
-
2016
- 2016-02-18 CN CN201610091514.1A patent/CN105744334A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080056154A1 (en) * | 2006-09-06 | 2008-03-06 | Cisco Technology, Inc. | Measurement of round-trip delay over a network |
| US20080263402A1 (en) * | 2007-04-20 | 2008-10-23 | Nethawk Oyj | method, arrangement, testing device and program for testing multimedia communication equipment and software |
| CN101303880A (en) * | 2008-06-30 | 2008-11-12 | 北京中星微电子有限公司 | Method and apparatus for recording and playing audio-video document |
| CN102404650A (en) * | 2011-11-30 | 2012-04-04 | 江苏奇异点网络有限公司 | Method for synchronously controlling audio and video of online video |
| CN102740064A (en) * | 2012-06-15 | 2012-10-17 | 福建星网视易信息系统有限公司 | Packing method for streaming media transmission in intercom system |
| CN103546662A (en) * | 2013-09-23 | 2014-01-29 | 浙江工业大学 | Audio and video synchronizing method in network monitoring system |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108614829A (en) * | 2016-12-12 | 2018-10-02 | 中移（杭州）信息技术有限公司 | A kind of playback method and terminal |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN106792070B (en) * | 2016-12-19 | 2020-06-23 | 广东威创视讯科技股份有限公司 | DMA transmission method and device for audio and video data |
| CN107342098A (en) * | 2017-07-20 | 2017-11-10 | 青岛海信电器股份有限公司 | Audio frequency playing method and device |
| CN107342098B (en) * | 2017-07-20 | 2019-11-26 | 青岛海信电器股份有限公司 | Audio frequency playing method and device |
| CN109327724A (en) * | 2017-08-01 | 2019-02-12 | 成都鼎桥通信技术有限公司 | Audio and video synchronization playing method and device |
| CN109327724B (en) * | 2017-08-01 | 2021-08-31 | 成都鼎桥通信技术有限公司 | Audio and video synchronous playing method and device |
| WO2019153960A1 (en) * | 2018-02-11 | 2019-08-15 | Zhejiang Dahua Technology Co., Ltd. | Systems and methods for synchronizing audio and video |
| US11343560B2 (en) | 2018-02-11 | 2022-05-24 | Zhejiang Xinsheng Electronic Technology Co., Ltd. | Systems and methods for synchronizing audio and video |
| CN110519627B (en) * | 2018-05-21 | 2021-05-14 | 视联动力信息技术股份有限公司 | Audio data synchronization method and device |
| CN110519627A (en) * | 2018-05-21 | 2019-11-29 | 视联动力信息技术股份有限公司 | A kind of synchronous method and device of audio data |
| CN108769770A (en) * | 2018-06-21 | 2018-11-06 | 广州酷狗计算机科技有限公司 | The method and apparatus for adjusting audio unit |
| CN110312159A (en) * | 2019-05-24 | 2019-10-08 | 深圳市朗强科技有限公司 | A kind of signal receiving device, stream media transmission system and flow-medium transmission method |
| CN110312159B (en) * | 2019-05-24 | 2022-03-11 | 深圳市朗强科技有限公司 | Signal receiving device, streaming media transmission system and streaming media transmission method |
| CN110545447A (en) * | 2019-07-31 | 2019-12-06 | 视联动力信息技术股份有限公司 | Audio and video synchronization method and device |
| CN112511885A (en) * | 2020-11-20 | 2021-03-16 | 深圳乐播科技有限公司 | Audio and video synchronization method and device and storage medium |
| CN113590079A (en) * | 2021-08-05 | 2021-11-02 | 广州飞傲电子科技有限公司 | Music playing control method and device and computer readable storage medium |
| CN113590079B (en) * | 2021-08-05 | 2024-03-22 | 广州飞傲电子科技有限公司 | Music playing control method, device and computer readable storage medium |
| CN114024925A (en) * | 2021-11-02 | 2022-02-08 | 成都达拓智通科技有限公司 | Method for controlling discontinuous call audio stream transmission queue |
| CN114024925B (en) * | 2021-11-02 | 2023-04-07 | 成都达拓智通科技有限公司 | Method for controlling discontinuous call audio stream transmission queue |
| CN115297335A (en) * | 2022-08-03 | 2022-11-04 | 深圳市野草声学有限公司 | Audio transmission method and system during video live broadcasting based on receiving buffer area |
| CN115297335B (en) * | 2022-08-03 | 2024-05-14 | 深圳市野草声学有限公司 | Audio transmission method and system based on receiving buffer area during live video broadcast |
| CN115297337A (en) * | 2022-08-05 | 2022-11-04 | 深圳市野草声学有限公司 | Audio transmission method and system during video live broadcasting based on data receiving and transmitting cache |
| CN115297337B (en) * | 2022-08-05 | 2024-05-28 | 深圳市野草声学有限公司 | Audio transmission method and system based on data transceiving cache during live video broadcast |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105744334A (en) | Method and equipment for audio and video synchronization and synchronous playing | |
| US8345668B2 (en) | Video delivering system, video delivering device, and synchronization correcting device | |
| DK3118855T3 (en) | Method, device and system for synchronous audio playback | |
| EP2292013B1 (en) | Synchronization of media stream components | |
| CN102932676B (en) | Self-adaptive bandwidth transmitting and playing method based on audio and video frequency synchronization | |
| KR101535827B1 (en) | Apparatus and method for audio and video synchronization in wireless communication network | |
| KR100482287B1 (en) | Apparatus and method for injection of synchronized stream data in digital broadcasting environment | |
| CN103338386A (en) | Audio and video synchronization method based on simplified timestamps | |
| US20130091528A1 (en) | Video reproduction system, receive terminal, home gateway device, and quality control system | |
| US8675727B2 (en) | Method and apparatus for SVC video and AAC audio synchronization using NPT | |
| CN105992025A (en) | Audio synchronous playing-based system time calibration method, audio synchronous playing method and devices | |
| CN101207822A (en) | Method for synchronization of audio frequency and video frequency of stream media terminal | |
| CN109565466A (en) | More equipment room labial synchronization method and apparatus | |
| WO2008028367A1 (en) | A method for realizing multi-audio tracks for mobile mutilmedia broadcasting system | |
| CN114827681B (en) | Video synchronization method, device, electronic equipment, terminal equipment and storage medium | |
| CN100596195C (en) | Method and device for controlling flow media play | |
| KR20120041095A (en) | Apparatus and method for transmitting/receiving streaming service | |
| EP2462738B1 (en) | Apparatus and method for tuning to a channel of a moving pictures expert group transport stream (mpeg-ts) | |
| CN110225385A (en) | A kind of audio-visual synchronization method of adjustment and device | |
| US8339986B2 (en) | Instrumentation of MPEG-2 transport streams for testing network performance | |
| CN107948703A (en) | Playing progress rate synchronous method and device | |
| CN107517401B (en) | Multimedia data playing method and device | |
| US6791987B1 (en) | Maintaining synchronization over asynchronous interface | |
| US8041831B2 (en) | Method for broadcasting a series of contents from a source to receiver terminals, through a computer network, related signal, broadcasting source and terminal | |
| JP2002369163A (en) | Method of controlling multistream output timing and control apparatus therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160706 |
|
| RJ01 | Rejection of invention patent application after publication |