CN107517401A - multimedia data playing method and device - Google Patents
multimedia data playing method and device Download PDFInfo
- Publication number
- CN107517401A CN107517401A CN201610432011.6A CN201610432011A CN107517401A CN 107517401 A CN107517401 A CN 107517401A CN 201610432011 A CN201610432011 A CN 201610432011A CN 107517401 A CN107517401 A CN 107517401A
- Authority
- CN
- China
- Prior art keywords
- rtp
- difference
- ntp
- rtcp
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
Abstract
The present invention provides a kind of multimedia data playing method and device, belong to multimedia communication technology field, the RTCP SR of the first voice data, the 2nd RTCP SR of second audio data, the 3rd RTCP SR of the first video data and the 4th RTCP SR of the second video data are obtained respectively；2nd RTP time accuracys are determined according to the first system time, second system time, the first NTP times, the 2nd NTP times, the first RTP times and the 2nd RTP times；The same accuracy for determining for the 4th RTP times；According to the accuracy and the accuracy of the 4th RTP times of the 2nd RTP times, the broadcast point of second audio data and the broadcast point of the second video data are determined.Multimedia data playing method and device provided by the invention, improve the fluency of multi-medium data broadcasting.
Description
Technical field
The present invention relates to multimedia communication technology field, more particularly to a kind of multimedia data playing method and device.
Background technology
Multimedia programming is watched, such as：TV programme, all can not as daily life for most of users
An or scarce part, it is generally the case that user is required for selecting a certain player to be used to play before multimedia programming is watched
The multimedia programming.
The data of multimedia programming generally include voice data and video data, in the prior art, in order to increase viewing
Effect, most players carry out audio number when playing multimedia programming using voice data and video data synchronization mechanism
According to video data synchronization play, so as to people simultaneously obtain acoustically with visual thoughts and feelings, so as to improve the body of user
Test sense.But, it is necessary to first calculate accurately before multimedia programming is played using voice data and video data synchronization mechanism
Voice data and video data broadcast point so that the broadcast point of video data is broadcast according to the broadcast point of voice data
Put, played so as to realize that voice data is synchronous with video data.However, the broadcast point of voice data and video data is to pass through
Voice data and the respective RTP of video data (Real-time Transport Protocol, RTP) bags are corresponding
RTCP (Real-time Transport Control Protocol, RTCP Real-time Transport Control Protocol) SR (Sender
Report, sender report) in parameter be calculated, therefore, if the reference record mistake in any RTCP SR, leads
Cause voice data and video data respective broadcast point calculate it is inaccurate so that multimedia programming occur interim card or
The phenomenon of F.F..
However, in the prior art, the fluency that multi-medium data plays is not high.
The content of the invention
The present invention provides a kind of multimedia data playing method and device, to improve the fluency of multi-medium data broadcasting.
The present invention provides a kind of multimedia data playing method, including：
Obtain the first RTCP Real-time Transport Control Protocol RTCP sender reports SR, the first RTCP of the first voice data
First network time protocol NTP times and the first realtime transmission protocol RTP time are included in SR, the first RTCP SR are corresponding
The first system time；
The 2nd RTCP SR of second audio data are obtained, the 2nd NTP times and second are included in the 2nd RTCP SR
RTP times, the 2nd RTCP SR correspond to the second system time, wherein, first voice data is the second audio number
According to data before；
The 3rd RTCP SR of the first video data are obtained, the 3rd NTP times and the 3rd are included in the 3rd RTCP SR
RTP times, corresponding 3rd system times of the 3rd RTCP SR；
The 4th RTCP SR of the second video data are obtained, the 4th NTP times and the 4th are included in the 4th RTCP SR
The RTP times, corresponding 4th system times of the 4th RTCP SR, wherein, first video data is second video counts
According to data before；
During according to the first system time, the second system time, the first NTP times, two NTP
Between, the first RTP times and the 2nd RTP times determine the 2nd RTP time accuracys；
During according to the 3rd system time, the 4th system time, the 3rd NTP times, four NTP
Between, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys；
According to the accuracy and the accuracy of the 4th RTP times of the 2nd RTP times, second audio is determined
The broadcast point of the broadcast point of data and second video data.
In an embodiment of the present invention, the accuracy according to the 2nd RTP times and the 4th RTP times
Accuracy, the broadcast point of the second audio data and the broadcast point of second video data are determined, including：
If the 2nd RTP times are accurate, according to the 2nd RTP times, initial audio RTP times and audio sample
Rate, determine the broadcast point of the second audio data；
If the 4th RTP times are accurate, according to the 4th RTP times, initial video RTP times and video sampling
Rate, determine the broadcast point of second video data.
In an embodiment of the present invention, it is described according to the 2nd RTP times, initial audio RTP times and audio sample
Rate, the broadcast point of the second audio data is determined, including：
The difference of the 2nd RTP times and the initial audio RTP times divided by the audio sample rate are determined, is obtained
Time point be the second audio data broadcast point；
The difference of the 4th RTP times and the initial video RTP times divided by the video sampling rate are determined, is obtained
Time point be second video data broadcast point.
In an embodiment of the present invention, the accuracy according to the 2nd RTP times and the 4th RTP times
Accuracy, the broadcast point of the second audio data and the broadcast point of second video data are determined, including：
If the 2nd RTP times are inaccurate, or the 4th RTP times are inaccurate；
Then according to the frame per second before second video data, second video data is played.
In an embodiment of the present invention, it is described according to the first system time, the second system time, described first
NTP times, the 2nd NTP times, the first RTP times and the 2nd RTP times determine that the 2nd RTP times are accurate
True property, including：
Determine whether the absolute difference of the first difference and the second difference is less than the first predetermined threshold value, first difference is
The difference of the second system time and the first system time, second difference are the 2nd NTP times and described
The difference of first NTP times；
If the absolute difference of first difference and second difference is less than the first predetermined threshold value, it is determined that described
Whether the absolute difference of two differences and the 3rd difference is less than the second predetermined threshold value, wherein, the 3rd difference is described second
RTP times divided by audio sample rate, with the first RTP times divided by the difference of audio sample rate；
If the absolute difference of second difference and the 3rd difference is less than the second predetermined threshold value, it is determined that described the
Two RTP times are accurate.
In an embodiment of the present invention, it is described according to the 3rd system time, the 4th system time, the described 3rd
NTP times, the 4th NTP times, the 3rd RTP times and the 4th RTP times determine that the 4th RTP times are accurate
True property, including：
Determine whether the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, the 4th difference is
4th system time and the 3rd system time difference, the 5th difference are the 4th NTP times and the 3rd NTP
The difference of time；
If the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, it is determined that described
Whether the absolute difference of five differences and the 6th difference is less than the 4th predetermined threshold value, wherein, the 5th difference is the described 4th
RTP times divided by video sampling rate, with the 3rd RTP times divided by the difference of video sampling rate；
If the absolute difference of the 4th difference and the 5th difference is less than the 4th predetermined threshold value, it is determined that described the
Four RTP times are accurate.
The present invention also provides a kind of multi-medium data playing device, including：
First acquisition module, for obtaining the first RTCP SR of the first voice data, included in the first RTCP SR
First NTP times and the first RTP times, the first RTCP SR correspond to the first system time；
Second acquisition module, for obtaining the 2nd RTCP SR of second audio data, included in the 2nd RTCP SR
2nd NTP times and the 2nd RTP times, the 2nd RTCP SR correspond to the second system time, wherein, the first audio number
According to the data before being the second audio data；
3rd acquisition module, for obtaining the 3rd RTCP SR of the first video data, included in the 3rd RTCP SR
3rd NTP times and the 3rd RTP times, corresponding 3rd system times of the 3rd RTCP SR；
4th acquisition module, for obtaining the 4th RTCP SR of the second video data, included in the 4th RTCP SR
4th NTP times and the 4th RTP times, corresponding 4th system times of the 4th RTCP SR, wherein, first video counts
According to the data before being second video data；
First processing module, during for according to the first system time, the second system time, a NTP
Between, the 2nd NTP times, the first RTP times and the 2nd RTP times determine the 2nd RTP time accuracys；
Second processing module, during for according to the 3rd system time, the 4th system time, three NTP
Between, the 4th NTP times, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys；
3rd processing module, it is accurate for the accuracy according to the 2nd RTP times and the 4th RTP times
Property, determine the broadcast point of the second audio data and the broadcast point of second video data.
In an embodiment of the present invention, if the 3rd processing module is accurate specifically for the 2nd RTP times, root
According to the 2nd RTP times, initial audio RTP times and audio sample rate, the broadcast point of the second audio data is determined；If
The 4th RTP times are accurate, then according to the 4th RTP times, initial video RTP times and video sampling rate, determine institute
State the broadcast point of the second video data.
In an embodiment of the present invention, the 3rd processing module be specifically used for determining the 2nd RTP times with it is described
The difference divided by the audio sample rate of initial audio RTP times, obtained time point are the broadcasting of the second audio data
Point；Determine the difference of the 4th RTP times and the initial video RTP times divided by the video sampling rate, obtain when
Between point for second video data broadcast point.
In an embodiment of the present invention, if the 3rd processing module is specifically used for the 2nd RTP times inaccuracy, or
The 4th RTP times described in person are inaccurate；Then according to the frame per second before second video data, second video counts are played
According to.
In an embodiment of the present invention, the first processing module is specifically used for the difference for determining the first difference and the second difference
Whether value absolute value is less than the first predetermined threshold value, and first difference is the second system time and the first system time
Difference, second difference is the difference of the 2nd NTP times and the first NTP times；If first difference and
The absolute difference of second difference is less than the first predetermined threshold value, it is determined that the difference of second difference and the 3rd difference is exhausted
Whether the second predetermined threshold value is less than to value, wherein, the 3rd difference is the 2nd RTP times divided by audio sample rate, with
The first RTP times divided by the difference of audio sample rate；If the absolute difference of second difference and the 3rd difference
Less than the second predetermined threshold value, it is determined that the 2nd RTP times are accurate.
In an embodiment of the present invention, the Second processing module is specifically used for the difference for determining the 4th difference and the 5th difference
Whether value absolute value is less than the 3rd predetermined threshold value, and the 4th difference is that the 4th system time and the 3rd system time are poor
Value, the 5th difference are the difference of the 4th NTP times and the 3rd NTP times；If the 4th difference and described
The absolute difference of 5th difference is less than the 3rd predetermined threshold value, it is determined that the absolute difference of the 5th difference and the 6th difference
Whether the 4th predetermined threshold value is less than, wherein, the 5th difference is the 4th RTP times divided by video sampling rate, and described
3rd RTP times divided by the difference of video sampling rate；If the absolute difference of the 4th difference and the 5th difference is less than
4th predetermined threshold value, it is determined that the 4th RTP times are accurate.
In the present embodiment, first according to the first system time, the second system time, the first NTP times, the 2nd NTP times,
First RTP times and the 2nd RTP times determine the 2nd RTP time accuracys；According to the 3rd system time, the 4th system time,
3rd NTP times, the 4th NTP times, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys；And then
The broadcast point of second audio data and the second video data is determined according to the accuracy of the 2nd RTP times and the 4th RTP times, if
2nd RTP times and the 4th RTP times are accurate, then calculate the broadcast point and second video data of second audio data respectively
Broadcast point, so that the second video data can uniformly be played according to the broadcast point calculated, it is effectively improved
The fluency that two video datas play, meanwhile, because the broadcast point of the broadcast point of the second video data and second audio data
Match somebody with somebody, can also realize that second audio data is synchronous with the second video data and play.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to do one and simply introduce, it should be apparent that, drawings in the following description are this hairs
Some bright embodiments, for those of ordinary skill in the art, without having to pay creative labor, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the flow chart of multimedia data playing method embodiment one of the present invention；
Fig. 2 is the flow chart of multimedia data playing method embodiment two of the present invention；
Fig. 3 is the flow chart of multimedia data playing method embodiment three of the present invention；
Fig. 4 is the structural representation of multi-medium data playing device embodiment one of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Term " first ", " second ", " the 3rd " " in description and claims of this specification and above-mentioned accompanying drawing
The (if present)s such as four " are for distinguishing similar object, without for describing specific order or precedence.It should manage
The data that solution so uses can exchange in the appropriate case, so as to embodiments of the invention described herein for example can with except
Order beyond those for illustrating or describing herein is implemented.In addition, term " comprising " and " having " and theirs is any
Deformation, it is intended that cover it is non-exclusive include, for example, containing the process of series of steps or unit, method, system, production
Product or equipment are not necessarily limited to those steps clearly listed or unit, but may include not list clearly or for this
The intrinsic other steps of a little process, method, product or equipment or unit.
It should be noted that these specific embodiments can be combined with each other below, for same or analogous concept
Or process may repeat no more in certain embodiments.
Fig. 1 is the flow chart of multimedia data playing method embodiment one of the present invention, and the multimedia data playing method can
Shown in Figure 1 to be performed by multi-medium data playing device, the multimedia data playing method can include：
S101, the first RTCP Real-time Transport Control Protocol RTCP the sender reports SR, the first RTCP for obtaining the first voice data
First network time protocol NTP times and the first realtime transmission protocol RTP time, the first RTCP SR corresponding first are included in SR
System time.
Wherein, the first voice data can be the voice data of initial play, may not be the audio number of initial play
According to, as long as the voice data before second audio data, here, the present invention does not do and further limited.
In actual application, transmitting terminal often sends a packet, and it is corresponding all periodically to send the packet
RTCP SR, RTCP SR include NTP times and RTP times, wherein, the NTP times are the systems that transmitting terminal sends RTCP SR
Time, RTP times can be regarded as the acquisition time of the packet, and system time corresponding to RTCP SR is that receiving terminal receives
The RTCP SR reception time.The first NTP times in the present embodiment are that transmitting terminal sends RTCP corresponding to the first voice data
SR system time, the first RTP times are the acquisition times of the first voice data, and the first system time is that receiving terminal receives first
The reception time of RTCP SR corresponding to voice data.Optionally, transmitting terminal can be server or terminal, receiving terminal
It can be the terminal with playing audio-fequency data and video data function.
The 2nd NTP times and second are included in S102, acquisition second audio data the 2nd RTCP SR, the 2nd RTCP SR
RTP times, the 2nd RTCP SR correspond to the second system time, wherein, the first voice data be second audio data before number
According to.
Wherein, second audio data can be the voice data or the 3rd audio played of second broadcasting
Data, it is primarily referred to as generation current video data to be played, and second audio data plays after the first voice data.Show
Example, if now having been received by four voice datas, and it will play and play the 4th voice data, then the second audio number
According to the 4th voice data that will as play, the first voice data can be the voice data of first broadcasting, can also
It is the voice data of second broadcasting, it is of course also possible to be the voice data of the 3rd broadcasting, here, for the first audio number
According to referring specifically to for which voice data, the present invention, which is not done, further to be limited.
When the 2nd NTP times in the present embodiment are that transmitting terminal sends RTCP SR system corresponding to second audio data
Between, the 2nd RTP times were the acquisition times of second audio data, and the second system time is that receiving terminal receives second audio data pair
The RTCP SR answered the reception time.
The 3rd NTP times and the 3rd are included in S103, the first video data of acquisition the 3rd RTCP SR, the 3rd RTCP SR
RTP times, corresponding 3rd system times of the 3rd RTCP SR.
Wherein, the first video data can be the video data of initial play, may not be the video counts of initial play
According to, as long as the video data before the second video data, here, the present invention does not do and further limited.
When the first NTP times in the present embodiment are that transmitting terminal sends RTCP SR system corresponding to the first video data
Between, the first RTP times were the acquisition times of the first video data, and the first system time is that receiving terminal receives the first video data pair
The RTCP SR answered the reception time.
The 4th NTP times and the 4th are included in S104, the second video data of acquisition the 4th RTCP SR, the 4th RTCP SR
The RTP times, corresponding 4th system times of the 4th RTCP SR, wherein, the first video data be the second video data before number
According to.
Wherein, the second video data can be the video data or the 3rd video played of second broadcasting
Data, it is primarily referred to as generation current video data to be played, and the second video data plays after the first video data.Show
Example, if now having been received by four video datas, and the 4th video data will be played, then the second video data is
For the 4th video data that will be played, the first video data can be the video data or the of first broadcasting
The video data of two broadcastings, it is of course also possible to be the video data of the 3rd broadcasting, here, having for the first video data
Which video data body refers to, and the present invention, which is not done, further to be limited.
When the 2nd NTP times in the present embodiment are that transmitting terminal sends RTCP SR system corresponding to the second video data
Between, the 2nd RTP times were the acquisition times of the second video data, and the second system time is that receiving terminal receives the second video data pair
The RTCP SR answered the reception time.
It should be noted that in the present embodiment, step S101 and S102 can be first carried out, i.e., first obtain the first audio number
According to and second audio data, then perform step S103 and S104, step S103 and S104 can also be first carried out, i.e., first obtain first
Video data and the second video data, then step S101 and S102 are performed, here, for first carrying out step S101 and S102, also
It is to first carry out step S103 and S104, the present invention, which is not done, further to be limited.
S105, according to the first system time, second system time, the first NTP times, the 2nd NTP times, a RTP when
Between and the 2nd RTP times determine the 2nd RTP time accuracys.
Wherein, the first system time and second system time are respectively that receiving terminal receives the first RTCP SR and second
RTCP SR reception time, the first system time and second system time are a correct time points, can according to this
The accuracy of one system time and second system time determine the accuracy of the first NTP times and the 2nd NTP times, and then root again
The accuracy of the first RTP times and the 2nd RTP times are finally determined according to the accuracy of the first NTP times and the 2nd NTP times.
S106, according to the 3rd system time, the 4th system time, the 3rd NTP times, the 4th NTP times, during three RTP
Between and the 4th RTP times determine the 4th RTP time accuracys.
Wherein, the 3rd system time and the 4th system time are respectively that receiving terminal receives the 3rd RTCP SR and the 4th
RTCP SR reception time, the 3rd system time and the 4th system time are a correct time points, can according to this
The accuracy of three system times and the 4th system time determines the accuracy of the 3rd NTP times and the 4th NTP times, and then root again
The accuracy of the 3rd RTP times and the 4th RTP times are finally determined according to the accuracy of the 3rd NTP times and the 4th NTP times.
It should be noted that in the present embodiment, step S105 can be first carried out, i.e., first determine the standard of the 2nd RTP times
True property, then step S106 is performed, step S106 can also be first carried out, i.e., first determines the accuracy of the 4th RTP times, then performs step
Rapid S105, here, for first carrying out step S105, step S106 is still first carried out, the present invention, which is not done, further to be limited.
S107, accuracy and the accuracy of the 4th RTP times according to the 2nd RTP times, determine second audio data
The broadcast point of broadcast point and the second video data.
Example, if the 2nd RTP times are accurate, the broadcasting of second audio data can be determined according to the 2nd RTP times
Point, if likewise, the 4th RTP times are accurate, the broadcast point of the second video data can be determined according to the 4th RTP times, this
The second audio data and the broadcast point of the second video data that sample is calculated are consistent, the i.e. broadcast points of second audio data
With the broadcasting Point matching of the second video data, can now be carried out according to the broadcast point of second audio data and the second video data
It is synchronous to play, the fluency of the second video data broadcasting is effectively improved, it is also possible to realize second audio data and the
The synchronous broadcasting of two video datas.
In the present embodiment, first according to the first system time, the second system time, the first NTP times, the 2nd NTP times,
First RTP times and the 2nd RTP times determine the 2nd RTP time accuracys；According to the 3rd system time, the 4th system time,
3rd NTP times, the 4th NTP times, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys；And then
The broadcast point of second audio data and the second video data is determined according to the accuracy of the 2nd RTP times and the 4th RTP times, if
2nd RTP times and the 4th RTP times are accurate, then calculate the broadcast point and second video data of second audio data respectively
Broadcast point, so that the second video data can uniformly be played according to the broadcast point calculated, it is effectively improved
The fluency that two video datas play, meanwhile, because the broadcast point of the broadcast point of the second video data and second audio data
Match somebody with somebody, can also realize that second audio data is synchronous with the second video data and play.
Based on embodiment corresponding to Fig. 1, on the basis of embodiment corresponding to Fig. 1, further, the embodiment of the present invention carries
Another multimedia data playing method is supplied, shown in Figure 2, Fig. 2 is implemented for multimedia data playing method of the present invention
The schematic flow sheet of example two.
Optionally, in the present embodiment, according to the accuracy and the accuracy of the 4th RTP times of the 2nd RTP times, it is determined that
The broadcast point of the broadcast point of second audio data and the second video data, including：
If S108, the 2nd RTP times are inaccurate, or the 4th RTP times are inaccurate；Then according to the second video data before
Frame per second, play the second video data.
Example, can be according to the first system time with reference to the record of above-described embodiment one, the second system time, first
NTP times, the 2nd NTP times, the first RTP times determine whether the 2nd RTP times are accurate with the 2nd RTP times.It is determined that
Two RTP times whether accurately during, the first NTP times and the are first determined according to the first system time and second system time
Whether two NTP are accurate, because the first system time and second system time are accurate, it is possible to according to the first system time and
The two system time determines whether the first NTP times and the 2nd NTP times are accurate, however, it is determined that the 2nd RTP times are inaccurate, then need not
Further determine that whether the 4th RTP times are accurate, can directly count in the preset time period before the second video data
The play frame rate of video data, and the second video data is played out according to the play frame rate, so as to improve the second video counts
According to the fluency of broadcasting.Or, however, it is determined that the 4th RTP times are inaccurate, then without further whether determining for the 2nd RTP times
Accurately, the play frame rate of the video data in the preset time period before the second video data can be directly counted, and according to this
Play frame rate plays out to the second video data, so as to improve the fluency of the second video data broadcasting.Wherein, preset time
Section can be 10s, it is of course also possible to be 15s, can be specifically configured according to being actually needed, here, for preset time period
Occurrence, the present invention do not do and further limits.
It should be noted that the above-mentioned RTP times of determination the 2nd whether accurately during, if the first NTP times and the
Two NTP times are inaccurate, at this point it is possible to without further according to the first NTP times and the 2nd NTP times determine the first RTP times and
The accuracy of 2nd RTP times, you can obtained for the first RTP times and the 2nd RTP times are also inaccurate.Likewise, during four RTP
Between accuracy determination process it is similar with the determination process of the 2nd RTP times, here, the present invention repeats no more.
In the present embodiment, if the 2nd RTP times are inaccurate, or the 4th RTP times are inaccurate, then the be calculated
The broadcast point of the broadcast point of two voice datas or the second video data is just inaccurate, i.e. the broadcast point of second audio data and second
The broadcast point of video data mismatches, now if also according to the second audio data in above-described embodiment one and the second video
The broadcast point of data synchronizes broadcasting, and the second video data can be caused interim card or the phenomenon of F.F. occur when playing, because
This, in order that the second video data can be played equably, can count in the preset time period before the second video data
Video data play frame rate, and the second video data is played out according to the play frame rate, so as to improve the second video
The fluency of data playback.
Based on embodiment corresponding to Fig. 1, on the basis of embodiment corresponding to Fig. 1, further, the embodiment of the present invention carries
Another multimedia data playing method is supplied, shown in Figure 3, Fig. 3 is implemented for multimedia data playing method of the present invention
The schematic flow sheet of example three.
Optionally, in the present embodiment, according to the accuracy and the accuracy of the 4th RTP times of the 2nd RTP times, it is determined that
The broadcast point of the broadcast point of second audio data and the second video data, including：
If the 2nd RTP times are accurate, according to the 2nd RTP times, initial audio RTP times and audio sample rate, it is determined that
The broadcast point of second audio data；If the 4th RTP times are accurate, according to the 4th RTP times, initial video RTP times and sound
Frequency sampling rate, determine the broadcast point of second audio data.
Further, according to the 2nd RTP times, initial audio RTP times and audio sample rate, second audio data is determined
Broadcast point, can specifically include：
The difference divided by audio sample rate of the 2nd RTP times and initial audio RTP times are determined, obtained time point is the
The broadcast point of two voice datas；The difference divided by video sampling rate of the 4th RTP times and initial video RTP times are determined, is obtained
Time point be second audio data broadcast point.
Wherein, initial audio is first voice data, and initial video is first video data.Under normal circumstances, sound
Frequency sampling rate is 8000, and video sampling rate is 90000.
Example, it is assumed that receiving terminal receives four voice datas, and the RTP times corresponding to this four voice datas are respectively
160,320,480,640, then according to the computational methods of above-mentioned audio broadcast point, the broadcast point of this four voice datas can be obtained
0ms, 20ms, 40ms, 60ms are followed successively by, likewise, assume that receiving terminal receives four video datas, this four video datas pair
The RTP times answered are respectively 0,3600,7200,10800, then according to the computational methods of above-mentioned video playback point, can obtain this
The broadcast point of four video datas is followed successively by 0ms, 40ms, 80ms, 120ms, and the broadcast point of voice data is being calculated and is regarding
After the broadcast point of frequency evidence, because the broadcast point of the broadcast point of voice data and video data mismatches, if according to audio number
When synchronizing broadcasting according to the broadcast point with video data, then the phenomenon of interim card occurs in video data, therefore, in such case
Under, when the broadcast point for the voice data and video data being calculated mismatches, can count video data to be played it
The play frame rate of video data in preceding preset time period, and video data to be played is broadcast according to the play frame rate
Put, so as to improve the fluency that the video data to be played plays.
The broadcast point of the above-mentioned voice data being calculated and video data mismatches, and its reason is：Voice data pair
RTP time misregistrations in the RTCP SR answered, or the RTP time misregistrations in RTCP SR corresponding to video data,
So as to cause the broadcast point inaccuracy of voice data or the broadcast point inaccuracy of video data that are calculated, i.e. voice data
Broadcast point and video data broadcast point mismatch, and then cause video data and voice data synchronously play when block
Pause or the phenomenon of F.F., the i.e. broadcasting of video data be not smooth.
So, how to determine whether the RTP times in RTCP SR corresponding to voice data are accurateIn the present embodiment,
Optionally, according to the first system time, second system time, the first NTP times, the 2nd NTP times, the first RTP times and
Two RTP times determined the 2nd RTP time accuracys, including：
S1051, determine whether the absolute difference of the first difference and the second difference is less than the first predetermined threshold value, the first difference
For the difference of second system time and the first system time, the second difference is the difference of the 2nd NTP times and the first NTP times.
If S1052, the first difference and the second difference absolute difference are less than the first predetermined threshold value, it is determined that the second difference
Whether it is less than the second predetermined threshold value with the absolute difference of the 3rd difference, wherein, the 3rd difference is the 2nd RTP times divided by audio
Sample rate, with the first RTP times divided by the difference of audio sample rate.
If the absolute difference of S1053, the second difference and the 3rd difference is less than the second predetermined threshold value, it is determined that the 2nd RTP
Time is accurate.
Wherein, the first predetermined threshold value and the second predetermined threshold value be able to can also be differed with identical, specifically can be according to reality
Need to be configured, in the present embodiment, the first predetermined threshold value and the second predetermined threshold value can be disposed as 10ms with identical.
In actual application, it is default first whether to be less than first according to the absolute difference of the first difference and the second difference
Threshold value 10ms, so that it is determined that whether the first NTP times and the 2nd NTP times are accurate, if the difference of the first difference and the second difference
Absolute value is less than 10ms, then illustrates that the first NTP times and the 2nd NTP times are accurate, next determine the second difference with it is the 3rd poor
Whether the absolute difference of value is less than the second predetermined threshold value 10ms, however, it is determined that the absolute difference of the second difference and the 3rd difference is small
In 10ms, it is determined that the 2nd RTP times are accurate, illustrate that the 2nd RTCP SR records are accurate corresponding to second audio data.If it is determined that
The absolute difference of second difference and the 3rd difference is more than 10ms, it is determined that the 2nd RTP times are inaccurate, illustrate the second audio number
According to corresponding 2nd RTCP SR misregisters.
During whether the above-mentioned RTP times of determination the 2nd are accurate, if the difference of the first difference and the second difference is absolute
Value is more than 10ms, then illustrates that the first NTP times and the 2nd NTP times are inaccurate, and during because of the first RTP times and two RTP
Between accuracy be to be determined according to the difference of the first NTP times and the 2nd NTP times again, therefore, when the first NTP times and
During two NTP time inaccuracy, then immediately arrived at for the first RTP times and the 2nd RTP times are also inaccurate, without further root
Determine whether the 2nd RTP times are accurate according to the absolute difference of the second difference and the 3rd difference.
In the present embodiment, the 2nd RTCP SR corresponding to second audio data can be judged whether using following false code
Record is accurate：
In the present embodiment, optionally, according to the 3rd system time, the 4th system time, the 3rd NTP times, the 4th NTP
Time, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys, including：
S1061, determine whether the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, the 4th difference
For the 4th system time and the 3rd system time difference, the 5th difference is the difference of the 4th NTP times and the 3rd NTP times；
If S1062, the 4th difference and the 5th difference absolute difference are less than the 3rd predetermined threshold value, it is determined that the 5th difference
Whether it is less than the 4th predetermined threshold value with the absolute difference of the 6th difference, wherein, the 5th difference is the 4th RTP times divided by video
Sample rate, with the 3rd RTP times divided by the difference of video sampling rate；
If the absolute difference of S1063, the 4th difference and the 5th difference is less than the 4th predetermined threshold value, it is determined that the 4th RTP
Time is accurate.
Wherein, the 3rd predetermined threshold value and the 4th predetermined threshold value be able to can also be differed with identical, specifically can be according to reality
Need to be configured, in the present embodiment, the 3rd predetermined threshold value and the 4th predetermined threshold value can be disposed as 10ms with identical.
In actual application, it is default first whether to be less than the 3rd according to the absolute difference of the 4th difference and the 5th difference
Threshold value 10ms, so that it is determined that whether the 3rd NTP times and the 4th NTP times are accurate, if the difference of the 4th difference and the 5th difference
Absolute value is less than 10ms, then illustrates that the 3rd NTP times and the 4th NTP times are accurate, next determine the 5th difference with it is the 6th poor
Whether the absolute difference of value is less than the 4th predetermined threshold value 10ms, however, it is determined that the absolute difference of the 5th difference and the 6th difference is small
In 10ms, it is determined that the 4th RTP times are accurate, illustrate that the 4th RTCP SR records are accurate corresponding to the second video data.If it is determined that
The absolute difference of 5th difference and the 6th difference is more than 10ms, it is determined that the 4th RTP times are inaccurate, illustrate the second video counts
According to corresponding 4th RTCP SR misregisters.
During whether the above-mentioned RTP times of determination the 4th are accurate, if the difference of the 4th difference and the 5th difference is absolute
Value is more than 10ms, then illustrates that the 3rd NTP times and the 4th NTP times are inaccurate, and during because of the 3rd RTP times and four RTP
Between accuracy be to be determined according to the difference of the 3rd NTP times and the 4th NTP times again, therefore, when the 3rd NTP times and
During four NTP time inaccuracy, then immediately arrived at for the 3rd RTP times and the 4th RTP times are also inaccurate, without further root
Determine whether the 4th RTP times are accurate according to the absolute difference of the 5th difference and the 6th difference.
In the present embodiment, the 4th RTCP SR corresponding to the second video data can be judged whether using following false code
Record is accurate：
In the present embodiment, the first RTCP SR corresponding to the first voice data are being obtained respectively, second audio data corresponds to
The 2nd RTCP SR, the 4th RTCP SR corresponding to the 3rd RTCP SR corresponding to the first video data and the second video data it
Afterwards, it can determine whether are the first NTP times and the 2nd NTP times according to the absolute difference between the first difference and the second difference
Accurately, however, it is determined that the first NTP times and the 2nd NTP times are accurate, then further according between the second difference and the 3rd difference
Absolute difference determine whether the first RTP times and the 2nd RTP times accurate, however, it is determined that when the first RTP times and two RTP
Between it is accurate, then be calculated according to the difference divided by audio sample rate can of the 2nd RTP times and the RTP times of initial audio
The broadcast point of second audio data, likewise, the calculating process of the broadcast point of the second video data and second audio data are broadcast
The calculating process put a little is similar, here, not repeating.So, it is determined that the 2nd RTP times and the 4th RTP times accurate feelings
Under condition, the broadcast point of the broadcast point for the second audio data being calculated and the second video data is consistent, i.e. the second audio
The broadcasting Point matching of the broadcast point of data and the second video data, now can be according to second audio data and the second video data
Broadcast point synchronize broadcasting, can not only improve the fluency of the second video data broadcasting, and second can also be realized
The synchronous broadcasting of voice data and the second video data.It is worth noting that, it is determined that the 2nd RTP times and the 4th RTP times
During, as long as determining that any of the 2nd NTP times or the 4th NTP times the NTP times are inaccurate, then corresponding the
Two RTP times or the 4th RTP times will be inaccurate, without yet further according to the 2nd NTP times or the 4th NTP
Time determines whether the 2nd RTP times or the 4th RTP times are accurate, it is possible to pre- before directly counting the second video data
If the play frame rate of the video data in the period, and the second video data is played out according to the play frame rate, so as to carry
The fluency that high second video data plays.
Fig. 4 is the structural representation of the embodiment one of multi-medium data playing device 40 of the present invention, shown in Figure 4, should
Multi-medium data playing device 40 can include：
First acquisition module 401, for obtaining the first RTCP SR of the first voice data, comprising the in the first RTCP SR
One NTP times and the first RTP times, the first RTCP SR correspond to the first system time.
Second acquisition module 402, for obtaining the 2nd RTCP SR of second audio data, comprising the in the 2nd RTCP SR
Two NTP times and the 2nd RTP times, the 2nd RTCP SR correspond to the second system time, wherein, the first voice data is the second sound
Data before frequency evidence.
3rd acquisition module 403, for obtaining the 3rd RTCP SR of the first video data, comprising the in the 3rd RTCP SR
Three NTP times and the 3rd RTP times, corresponding 3rd system times of the 3rd RTCP SR.
4th acquisition module 404, for obtaining the 4th RTCP SR of the second video data, comprising the in the 4th RTCP SR
Four NTP times and the 4th RTP times, corresponding 4th system times of the 4th RTCP SR, wherein, the first video data is second to regard
Data before frequency evidence.
First processing module 405, for according to the first system time, second system time, the first NTP times, the 2nd NTP
Time, the first RTP times and the 2nd RTP times determine the 2nd RTP time accuracys.
Second processing module 406, for according to the 3rd system time, the 4th system time, the 3rd NTP times, the 4th NTP
Time, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys.
3rd processing module 407, for the accuracy and the accuracy of the 4th RTP times according to the 2nd RTP times, it is determined that
The broadcast point of the broadcast point of second audio data and the second video data.
Multi-medium data playing device 40 shown in the embodiment of the present invention, can perform the skill shown in above method embodiment
Art scheme, its realization principle and beneficial effect are similar, are no longer repeated herein.
Optionally, if the 3rd processing module 407 is accurate specifically for the 2nd RTP times, according to the 2nd RTP times, just
Audio RTP times beginning and audio sample rate, determine the broadcast point of second audio data；If the 4th RTP times are accurate, according to
Four RTP times, initial video RTP times and video sampling rate, determine the broadcast point of the second video data.
Optionally, the 3rd processing module 407 is specifically used for the difference for determining the 2nd RTP times and initial audio RTP times
Divided by audio sample rate, obtained time point are the broadcast point of second audio data；Determine the 4th RTP times and initial video
The difference divided by video sampling rate of RTP times, obtained time point are the broadcast point of the second video data.
Optionally, if the 3rd processing module 407 is specifically used for the 2nd RTP times inaccuracy, or the 4th RTP times were forbidden
Really；Then according to the frame per second before the second video data, the second video data is played.
Optionally, first processing module 405 be specifically used for determining the first difference and the second difference absolute difference whether
Less than the first predetermined threshold value, the first difference is the difference of second system time and the first system time, and the second difference is the 2nd NTP
Time and the difference of the first NTP times；If the absolute difference of the first difference and the second difference is less than the first predetermined threshold value, really
Whether the absolute difference of fixed second difference and the 3rd difference is less than the second predetermined threshold value, wherein, when the 3rd difference is two RTP
Between divided by audio sample rate, with the first RTP times divided by the difference of audio sample rate；If the difference of the second difference and the 3rd difference
Absolute value is less than the second predetermined threshold value, it is determined that the 2nd RTP times are accurate.
Optionally, Second processing module 406 be specifically used for determining the 4th difference and the 5th difference absolute difference whether
Less than the 3rd predetermined threshold value, the 4th difference is the 4th system time and the 3rd system time difference, when the 5th difference is four NTP
Between and the 3rd NTP times difference；If the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, it is determined that
Whether the absolute difference of the 5th difference and the 6th difference is less than the 4th predetermined threshold value, wherein, the 5th difference was the 4th RTP times
Divided by video sampling rate, with the 3rd RTP times divided by the difference of video sampling rate；If the difference of the 4th difference and the 5th difference is exhausted
4th predetermined threshold value is less than to value, it is determined that the 4th RTP times are accurate.
Multi-medium data playing device 40 shown in the embodiment of the present invention can perform the skill shown in above method embodiment
Art scheme, its realization principle and beneficial effect are similar, are no longer repeated herein.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above-mentioned each method embodiment can lead to
The related hardware of programmed instruction is crossed to complete.Foregoing program can be stored in a computer read/write memory medium.The journey
Sequence upon execution, execution the step of including above-mentioned each method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic disc or
Person's CD etc. is various can be with the medium of store program codes.
Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations；To the greatest extent
The present invention is described in detail with reference to foregoing embodiments for pipe, it will be understood by those within the art that：Its according to
The technical scheme described in foregoing embodiments can so be modified, either which part or all technical characteristic are entered
Row equivalent substitution；And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology
The scope of scheme.
Claims (12)
- A kind of 1. multimedia data playing method, it is characterised in that including：In the first RTCP Real-time Transport Control Protocol RTCP the sender reports SR, the first RTCP SR for obtaining the first voice data Comprising first network time protocol NTP times and the first realtime transmission protocol RTP time, the first RTCP SR corresponding first System time；The 2nd RTCP SR of second audio data are obtained, when including the 2nd NTP times and two RTP in the 2nd RTCP SR Between, the 2nd RTCP SR correspond to the second system time, wherein, first voice data be the second audio data it Preceding data；The 3rd RTCP SR of the first video data are obtained, when including the 3rd NTP times and three RTP in the 3rd RTCP SR Between, corresponding 3rd system times of the 3rd RTCP SR；The 4th RTCP SR of the second video data are obtained, when including the 4th NTP times and four RTP in the 4th RTCP SR Between, corresponding 4th system time of the 4th RTCP SR, wherein, first video data be second video data it Preceding data；According to the first system time, the second system time, the first NTP times, the 2nd NTP times, institute Stated for the first RTP times and the 2nd RTP times determine the 2nd RTP time accuracys；According to the 3rd system time, the 4th system time, the 3rd NTP times, the 4th NTP times, institute Stated for the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys；According to the accuracy and the accuracy of the 4th RTP times of the 2nd RTP times, the second audio data is determined Broadcast point and second video data broadcast point.
- 2. according to the method for claim 1, it is characterised in that the accuracy and institute according to the 2nd RTP times The accuracy of the 4th RTP times is stated, determines the broadcast point of the second audio data and the broadcast point of second video data, Including：If the 2nd RTP times are accurate, according to the 2nd RTP times, initial audio RTP times and audio sample rate, Determine the broadcast point of the second audio data；If the 4th RTP times are accurate, according to the 4th RTP times, initial video RTP times and video sampling rate, Determine the broadcast point of second video data.
- 3. according to the method for claim 2, it is characterised in that described according to the 2nd RTP times, initial audio RTP Time and audio sample rate, the broadcast point of the second audio data is determined, including：Determine the difference of the 2nd RTP times and the initial audio RTP times divided by the audio sample rate, obtain when Between point for the second audio data broadcast point；Determine the difference of the 4th RTP times and the initial video RTP times divided by the video sampling rate, obtain when Between point for second video data broadcast point.
- 4. according to the method for claim 1, it is characterised in that the accuracy and institute according to the 2nd RTP times The accuracy of the 4th RTP times is stated, determines the broadcast point of the second audio data and the broadcast point of second video data, Including：If the 2nd RTP times are inaccurate, or the 4th RTP times are inaccurate；Then according to the frame per second before second video data, second video data is played.
- 5. according to the method described in claim any one of 1-4, it is characterised in that described according to the first system time, institute When stating second system time, the first NTP times, the 2nd NTP times, the first RTP times and two RTP Between determine the 2nd RTP time accuracys, including：Determine whether the absolute difference of the first difference and the second difference is less than the first predetermined threshold value, first difference is described The difference of second system time and the first system time, second difference is the 2nd NTP times and described first The difference of NTP times；If the absolute difference of first difference and second difference is less than the first predetermined threshold value, it is determined that described second is poor Whether the absolute difference of value and the 3rd difference is less than the second predetermined threshold value, wherein, when the 3rd difference is two RTP Between divided by audio sample rate, with the first RTP times divided by the difference of audio sample rate；If the absolute difference of second difference and the 3rd difference is less than the second predetermined threshold value, it is determined that described second The RTP times are accurate.
- 6. according to the method described in claim any one of 1-4, it is characterised in that described according to the 3rd system time, institute When stating the 4th system time, the 3rd NTP times, the 4th NTP times, the 3rd RTP times and four RTP Between determine the 4th RTP time accuracys, including：Determine whether the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, the 4th difference is described 4th system time and the 3rd system time difference, the 5th difference are the 4th NTP times and the 3rd NTP times Difference；If the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, it is determined that the described 5th is poor Whether the absolute difference of value and the 6th difference is less than the 4th predetermined threshold value, wherein, when the 5th difference is four RTP Between divided by video sampling rate, with the 3rd RTP times divided by the difference of video sampling rate；If the absolute difference of the 4th difference and the 5th difference is less than the 4th predetermined threshold value, it is determined that the described 4th The RTP times are accurate.
- A kind of 7. multi-medium data playing device, it is characterised in that including：First acquisition module, for obtaining the first RTCP SR of the first voice data, first is included in the first RTCPSR NTP times and the first RTP times, the first RTCP SR correspond to the first system time；Second acquisition module, for obtaining the 2nd RTCP SR of second audio data, second is included in the 2nd RTCPSR NTP times and the 2nd RTP times, the 2nd RTCP SR correspond to the second system time, wherein, first voice data is Data before the second audio data；3rd acquisition module, for obtaining the 3rd RTCP SR of the first video data, the 3rd is included in the 3rd RTCPSR NTP times and the 3rd RTP times, corresponding 3rd system times of the 3rd RTCP SR；4th acquisition module, for obtaining the 4th RTCP SR of the second video data, the 4th is included in the 4th RTCPSR NTP times and the 4th RTP times, corresponding 4th system times of the 4th RTCP SR, wherein, first video data is Data before second video data；First processing module, for according to the first system time, the second system time, the first NTP times, institute Stating the 2nd NTP times, the first RTP times and the 2nd RTP times determines the 2nd RTP time accuracys；Second processing module, for according to the 3rd system time, the 4th system time, the 3rd NTP times, institute Stated for the 4th NTP times, the 3rd RTP times and the 4th RTP times determine the 4th RTP time accuracys；3rd processing module, for the accuracy and the accuracy of the 4th RTP times according to the 2nd RTP times, really The broadcast point of the fixed second audio data and the broadcast point of second video data.
- 8. device according to claim 7, it is characterised in that if the 3rd processing module is specifically used for described second The RTP times are accurate, then according to the 2nd RTP times, initial audio RTP times and audio sample rate, determine second sound The broadcast point of frequency evidence；If the 4th RTP times are accurate, according to the 4th RTP times, the initial video RTP times and Video sampling rate, determine the broadcast point of second video data.
- 9. device according to claim 8, it is characterised in that the 3rd processing module is specifically used for determining described second The RTP times are second sound with the difference of the initial audio RTP times divided by the audio sample rate, obtained time point The broadcast point of frequency evidence；Determine the difference of the 4th RTP times and the initial video RTP times divided by the video sampling Rate, obtained time point are the broadcast point of second video data.
- 10. device according to claim 7, it is characterised in that if the 3rd processing module is specifically used for described second The RTP times are inaccurate, or the 4th RTP times are inaccurate；Then according to the frame per second before second video data, play Second video data.
- 11. according to the device described in claim any one of 7-10, it is characterised in that the first processing module is specifically used for true Whether the absolute difference of fixed first difference and the second difference is less than the first predetermined threshold value, and first difference is second system The difference of system time and the first system time, second difference is the 2nd NTP times and the first NTP times Difference；If the absolute difference of first difference and second difference is less than the first predetermined threshold value, it is determined that described Whether the absolute difference of two differences and the 3rd difference is less than the second predetermined threshold value, wherein, the 3rd difference is described second RTP times divided by audio sample rate, with the first RTP times divided by the difference of audio sample rate；If second difference with The absolute difference of 3rd difference is less than the second predetermined threshold value, it is determined that the 2nd RTP times are accurate.
- 12. according to the device described in claim any one of 7-10, it is characterised in that the Second processing module is specifically used for true Whether the absolute difference of fixed 4th difference and the 5th difference is less than the 3rd predetermined threshold value, and the 4th difference is the 4th system System time and the 3rd system time difference, the 5th difference are the difference of the 4th NTP times and the 3rd NTP times Value；If the absolute difference of the 4th difference and the 5th difference is less than the 3rd predetermined threshold value, it is determined that the described 5th is poor Whether the absolute difference of value and the 6th difference is less than the 4th predetermined threshold value, wherein, when the 5th difference is four RTP Between divided by video sampling rate, with the 3rd RTP times divided by the difference of video sampling rate；If the 4th difference and described the The absolute difference of five differences is less than the 4th predetermined threshold value, it is determined that the 4th RTP times are accurate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610432011.6A CN107517401B (en) | 2016-06-15 | 2016-06-15 | Multimedia data playing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610432011.6A CN107517401B (en) | 2016-06-15 | 2016-06-15 | Multimedia data playing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107517401A true CN107517401A (en) | 2017-12-26 |
| CN107517401B CN107517401B (en) | 2019-11-19 |
Family
ID=60720586
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610432011.6A Active CN107517401B (en) | 2016-06-15 | 2016-06-15 | Multimedia data playing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107517401B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110225385A (en) * | 2019-06-19 | 2019-09-10 | 鼎桥通信技术有限公司 | A kind of audio-visual synchronization method of adjustment and device |
| WO2020024945A1 (en) * | 2018-08-01 | 2020-02-06 | 北京微播视界科技有限公司 | Method and apparatus for determining timestamp |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1738437A (en) * | 2004-06-22 | 2006-02-22 | Lg电子株式会社 | Synchronizing video/audio of mobile communication terminal |
| CN1996897A (en) * | 2005-12-28 | 2007-07-11 | 中兴通讯股份有限公司 | A method for real time detection of the network transfer delay in the RTP |
| CN101179484A (en) * | 2006-11-09 | 2008-05-14 | 华为技术有限公司 | Method and system of synchronizing different media stream |
| CN101282482A (en) * | 2008-05-04 | 2008-10-08 | 中兴通讯股份有限公司 | Apparatus, system and method for synchronously playing video data and audio data |
| CN102595202A (en) * | 2011-01-11 | 2012-07-18 | 中兴通讯股份有限公司 | Method, device and system for synchronizing multiple media streams |
| CN103269448A (en) * | 2013-05-24 | 2013-08-28 | 浙江工商大学 | Method for achieving synchronization of audio and video on the basis of RTP/RTCP feedback early-warning algorithm |
| EP2871848A1 (en) * | 2013-11-12 | 2015-05-13 | Koninklijke KPN N.V. | Providing correction information for media synchronization |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
-
2016
- 2016-06-15 CN CN201610432011.6A patent/CN107517401B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1738437A (en) * | 2004-06-22 | 2006-02-22 | Lg电子株式会社 | Synchronizing video/audio of mobile communication terminal |
| CN1996897A (en) * | 2005-12-28 | 2007-07-11 | 中兴通讯股份有限公司 | A method for real time detection of the network transfer delay in the RTP |
| CN101179484A (en) * | 2006-11-09 | 2008-05-14 | 华为技术有限公司 | Method and system of synchronizing different media stream |
| CN101282482A (en) * | 2008-05-04 | 2008-10-08 | 中兴通讯股份有限公司 | Apparatus, system and method for synchronously playing video data and audio data |
| CN102595202A (en) * | 2011-01-11 | 2012-07-18 | 中兴通讯股份有限公司 | Method, device and system for synchronizing multiple media streams |
| CN103269448A (en) * | 2013-05-24 | 2013-08-28 | 浙江工商大学 | Method for achieving synchronization of audio and video on the basis of RTP/RTCP feedback early-warning algorithm |
| EP2871848A1 (en) * | 2013-11-12 | 2015-05-13 | Koninklijke KPN N.V. | Providing correction information for media synchronization |
| CN104618786A (en) * | 2014-12-22 | 2015-05-13 | 深圳市腾讯计算机系统有限公司 | Audio/video synchronization method and device |
Non-Patent Citations (1)
| Title |
|---|
| 漆峰: "《基于RTP/RTCP协议的音视频同步算法研究》", 《世界科技研究与发展》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020024945A1 (en) * | 2018-08-01 | 2020-02-06 | 北京微播视界科技有限公司 | Method and apparatus for determining timestamp |
| CN110225385A (en) * | 2019-06-19 | 2019-09-10 | 鼎桥通信技术有限公司 | A kind of audio-visual synchronization method of adjustment and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107517401B (en) | 2019-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10111196B2 (en) | Method for time synchronization between wireless devices, wireless device, and wireless communication system | |
| CN104768082B (en) | A kind of audio and video playing information processing method and server | |
| CN104581388B (en) | The processing method of broadcast state, apparatus and system | |
| US7633551B2 (en) | Compressed timing indicators for media samples | |
| EP1423936B1 (en) | Message reconstruction from partial detection | |
| CN107172135A (en) | Method for statisticsing audience rating and system based on block chain | |
| CN110324643B (en) | Video recording method and system | |
| CN104185066B (en) | A kind of method and device of automatic Verification electric program menu | |
| CN109525865B (en) | Block chain-based audience rating monitoring method and computer-readable storage medium | |
| CN107426629A (en) | A kind of streaming media file processing method and live broadcast system | |
| CN105049882A (en) | Method and device for video recommendation | |
| CN108235149B (en) | Method and device for optimizing video playing fluency | |
| CN103731716A (en) | Method for synchronizing audio and video in TS stream playing | |
| CN101931775A (en) | Video recording method and device | |
| CN107517401B (en) | Multimedia data playing method and device | |
| CN107133892A (en) | The real-time estimating method and system of a kind of network Piano lesson | |
| CN109982100A (en) | A kind of audio/video processing method and system | |
| CN110475156A (en) | A kind of calculation method and device of slowed-down video value | |
| CN109905763A (en) | Optimize the method that player audio plays Caton | |
| CN109511011A (en) | A kind of finger print data base construction method towards YouTube DASH encrypted video | |
| CN107682711A (en) | Video intercepting method, server and Online Video play system | |
| CN101887739A (en) | Method and device for synchronizing media play | |
| CN110225385A (en) | A kind of audio-visual synchronization method of adjustment and device | |
| CN103685975A (en) | Video playing system and method | |
| CN108810522A (en) | A kind of appraisal procedure and device of stream medium data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |