CN107517401B - Multimedia data playing method and device - Google Patents
Multimedia data playing method and device Download PDFInfo
- Publication number
- CN107517401B CN107517401B CN201610432011.6A CN201610432011A CN107517401B CN 107517401 B CN107517401 B CN 107517401B CN 201610432011 A CN201610432011 A CN 201610432011A CN 107517401 B CN107517401 B CN 107517401B
- Authority
- CN
- China
- Prior art keywords
- time
- difference
- rtp
- rtcp
- ntp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Synchronisation In Digital Transmission Systems (AREA)
Abstract
The present invention provides a kind of multimedia data playing method and device, belong to multimedia communication technology field, the RTCP SR of the first audio data, the 2nd RTCP SR of second audio data, the 3rd RTCP SR of the first video data and the 4th RTCP SR of the second video data are obtained respectively；The 2nd RTP time accuracy is determined according to the first system time, second system time, the first NTP time, the 2nd NTP time, the first RTP time and the 2nd RTP time；The same accuracy for determining for the 4th RTP time；According to the accuracy and the accuracy of the 4th RTP time of the 2nd RTP time, the broadcast point of second audio data and the broadcast point of the second video data are determined.Multimedia data playing method and device provided by the invention improve the fluency of multi-medium data broadcasting.
Description
Technical field
The present invention relates to multimedia communication technology field more particularly to a kind of multimedia data playing methods and device.
Background technique
Multimedia programming is watched, such as: TV programme, for most users, all having become daily life can not
Or scarce a part, it is generally the case that user requires to select a certain player for playing before watching multimedia programming
The multimedia programming.
The data of multimedia programming generally include audio data and video data, in the prior art, in order to increase viewing
Effect, most players are all made of audio data and video data synchronization mechanism carry out audio number when playing multimedia programming
Be played simultaneously according to video data, so as to people obtain simultaneously acoustically with visual thoughts and feelings, to improve the body of user
Test sense.But before playing multimedia programming using audio data and video data synchronization mechanism, it is accurate to need first to calculate
Audio data and video data broadcast point so that the broadcast point of video data is broadcast according to the broadcast point of audio data
It puts, to realize being played simultaneously for audio data and video data.However, the broadcast point of audio data and video data is to pass through
Audio data and the respective RTP of video data (Real-time Transport Protocol, real-time transport protocol) packet correspond to
RTCP (Real-time Transport Control Protocol, RTCP Real-time Transport Control Protocol) SR (Sender
Report, sender report) in parameter be calculated, therefore, if the reference record mistake in any RTCP SR, leads
Cause the respective broadcast point of audio data and video data to calculate inaccuracy so that multimedia programming occur Caton or
The phenomenon that F.F..
However, in the prior art, the fluency that multi-medium data plays is not high.
Summary of the invention
The present invention provides a kind of multimedia data playing method and device, to improve the fluency of multi-medium data broadcasting.
The present invention provides a kind of multimedia data playing method, comprising:
Obtain the first RTCP Real-time Transport Control Protocol RTCP sender report SR, the first RTCP of the first audio data
It include first network time protocol NTP time and the first realtime transmission protocol RTP time in SR, the first RTCP SR is corresponding
The first system time；
The 2nd RTCP SR of second audio data is obtained, includes the 2nd NTP time and second in the 2nd RTCP SR
RTP time, the 2nd RTCP SR correspond to the second system time, wherein first audio data is the second audio number
According to data before；
The 3rd RTCP SR of the first video data is obtained, includes the 3rd NTP time and third in the 3rd RTCP SR
RTP time, the 3rd RTCP SR correspond to third system time；
The 4th RTCP SR of the second video data is obtained, includes the 4th NTP time and the 4th in the 4th RTCP SR
RTP time, corresponding 4th system time of the 4th RTCP SR, wherein first video data is second video counts
According to data before；
When according to the first system time, the second system time, the first NTP time, two NTP
Between, the first RTP time and the 2nd RTP time determine the 2nd RTP time accuracy；
When according to the third system time, the 4th system time, the 3rd NTP time, four NTP
Between, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy；
According to the accuracy and the accuracy of the 4th RTP time of the 2nd RTP time, second audio is determined
The broadcast point of the broadcast point of data and second video data.
In an embodiment of the present invention, the accuracy according to the 2nd RTP time and the 4th RTP time
Accuracy determines the broadcast point of the second audio data and the broadcast point of second video data, comprising:
If the 2nd RTP time is accurate, according to the 2nd RTP time, initial audio RTP time and audio sample
Rate determines the broadcast point of the second audio data；
If the 4th RTP time is accurate, according to the 4th RTP time, initial video RTP time and video sampling
Rate determines the broadcast point of second video data.
In an embodiment of the present invention, described according to the 2nd RTP time, initial audio RTP time and audio sample
Rate determines the broadcast point of the second audio data, comprising:
Determine that the difference of the 2nd RTP time and the initial audio RTP time divided by the audio sample rate, obtain
Time point be the second audio data broadcast point；
Determine that the difference of the 4th RTP time and the initial video RTP time divided by the video sampling rate, obtain
Time point be second video data broadcast point.
In an embodiment of the present invention, the accuracy according to the 2nd RTP time and the 4th RTP time
Accuracy determines the broadcast point of the second audio data and the broadcast point of second video data, comprising:
If the 2nd RTP time inaccuracy or the 4th RTP time inaccuracy；
Then according to the frame per second before second video data, second video data is played.
In an embodiment of the present invention, described according to the first system time, the second system time, described first
NTP time, the 2nd NTP time, the first RTP time and the 2nd RTP time determine that the 2nd RTP time is quasi-
True property, comprising:
The absolute difference of the first difference and the second difference is determined whether less than the first preset threshold, first difference is
The difference of the second system time and the first system time, second difference are the 2nd NTP time and described
The difference of first NTP time；
If the absolute difference of first difference and second difference is less than the first preset threshold, it is determined that described
Whether the absolute difference of two differences and third difference is less than the second preset threshold, wherein the third difference is described second
The RTP time divided by audio sample rate, with the first RTP time divided by the difference of audio sample rate；
If the absolute difference of second difference and the third difference is less than the second preset threshold, it is determined that described the
Two RTP times are accurate.
In an embodiment of the present invention, described according to the third system time, the 4th system time, the third
NTP time, the 4th NTP time, the 3rd RTP time and the 4th RTP time determine that the 4th RTP time is quasi-
True property, comprising:
Determine whether the absolute difference of the 4th difference and the 5th difference is less than third predetermined threshold value, the 4th difference is
4th system time and third system time difference, the 5th difference are the 4th NTP time and the 3rd NTP
The difference of time；
If the absolute difference of the 4th difference and the 5th difference is less than third predetermined threshold value, it is determined that described the
Whether the absolute difference of five differences and the 6th difference is less than the 4th preset threshold, wherein the 5th difference is the described 4th
The RTP time divided by video sampling rate, with the 3rd RTP time divided by the difference of video sampling rate；
If the absolute difference of the 4th difference and the 5th difference is less than the 4th preset threshold, it is determined that described the
Four RTP times are accurate.
The present invention also provides a kind of multi-medium data playing devices, comprising:
First obtains module for obtaining the first RTCP SR of the first audio data includes in the first RTCP SR
First NTP time and the first RTP time, the first RTCP SR correspond to the first system time；
Second obtains module for obtaining the 2nd RTCP SR of second audio data includes in the 2nd RTCP SR
2nd NTP time and the 2nd RTP time, the 2nd RTCP SR correspond to the second system time, wherein the first audio number
According to the data before being the second audio data；
Third obtains module for obtaining the 3rd RTCP SR of the first video data
3rd NTP time and the 3rd RTP time, the 3rd RTCP SR correspond to third system time；
4th obtains module for obtaining the 4th RTCP SR of the second video data includes in the 4th RTCP SR
4th NTP time and the 4th RTP time, corresponding 4th system time of the 4th RTCP SR, wherein first video counts
According to the data before being second video data；
First processing module, when for according to the first system time, the second system time, a NTP
Between, the 2nd NTP time, the first RTP time and the 2nd RTP time determine the 2nd RTP time accuracy；
Second processing module, when for according to the third system time, the 4th system time, three NTP
Between, the 4th NTP time, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy；
Third processing module, for accurate according to the accuracy of the 2nd RTP time and the 4th RTP time
Property, determine the broadcast point of the second audio data and the broadcast point of second video data.
In an embodiment of the present invention, if the third processing module is accurate specifically for the 2nd RTP time, root
According to the 2nd RTP time, initial audio RTP time and audio sample rate, the broadcast point of the second audio data is determined；If
The 4th RTP time is accurate, then according to the 4th RTP time, initial video RTP time and video sampling rate, determines institute
State the broadcast point of the second video data.
In an embodiment of the present invention, the third processing module be specifically used for determining the 2nd RTP time with it is described
For the difference of initial audio RTP time divided by the audio sample rate, obtained time point is the broadcasting of the second audio data
Point；The difference of the 4th RTP time and the initial video RTP time are determined divided by the video sampling rate, obtain when
Between point be second video data broadcast point.
In an embodiment of the present invention, if the third processing module is specifically used for the 2nd RTP time inaccuracy, or
The inaccuracy of 4th RTP time described in person；Then according to the frame per second before second video data, second video counts are played
According to.
In an embodiment of the present invention, the first processing module is specifically used for determining the difference of the first difference and the second difference
Whether it is worth absolute value less than the first preset threshold, first difference is the second system time and the first system time
Difference, second difference be the 2nd NTP time and the first NTP time difference；If first difference and
The absolute difference of second difference is less than the first preset threshold, it is determined that the difference of second difference and third difference is exhausted
To value whether less than the second preset threshold, wherein the third difference is the 2nd RTP time divided by audio sample rate, with
The first RTP time divided by audio sample rate difference；If the absolute difference of second difference and the third difference
Less than the second preset threshold, it is determined that the 2nd RTP time is accurate.
In an embodiment of the present invention, the Second processing module is specifically used for determining the difference of the 4th difference and the 5th difference
Whether value absolute value is less than third predetermined threshold value, and the 4th difference is that the 4th system time and third system time are poor
Value, the 5th difference are the difference of the 4th NTP time and the 3rd NTP time；If the 4th difference and described
The absolute difference of 5th difference is less than third predetermined threshold value, it is determined that the absolute difference of the 5th difference and the 6th difference
Whether less than the 4th preset threshold, wherein the 5th difference is the 4th RTP time divided by video sampling rate, and described
3rd RTP time divided by video sampling rate difference；If the absolute difference of the 4th difference and the 5th difference is less than
4th preset threshold, it is determined that the 4th RTP time is accurate.
In the present embodiment, first according to the first system time, the second system time, the first NTP time, the 2nd NTP time,
First RTP time and the 2nd RTP time determine the 2nd RTP time accuracy；According to third system time, the 4th system time,
3rd NTP time, the 4th NTP time, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy；And then
The broadcast point of second audio data and the second video data is determined according to the accuracy of the 2nd RTP time and the 4th RTP time, if
2nd RTP time and the 4th RTP time are accurate, then calculate separately out the broadcast point and second video data of second audio data
Broadcast point effectively improves so that the second video data can uniformly be played according to calculated broadcast point
The fluency that two video datas play, meanwhile, because of the broadcast point of the broadcast point of the second video data and second audio data
Match, being played simultaneously for second audio data and the second video data also may be implemented.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to do one simply to introduce, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without any creative labor, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the flow chart of multimedia data playing method embodiment one of the present invention；
Fig. 2 is the flow chart of multimedia data playing method embodiment two of the present invention；
Fig. 3 is the flow chart of multimedia data playing method embodiment three of the present invention；
Fig. 4 is the structural schematic diagram of multi-medium data playing device embodiment one of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Description and claims of this specification and term " first ", " second ", " third " " in above-mentioned attached drawing
The (if present)s such as four " are to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should manage
The data that solution uses in this way are interchangeable under appropriate circumstances, so that the embodiment of the present invention described herein for example can be to remove
Sequence other than those of illustrating or describe herein is implemented.In addition, term " includes " and " having " and theirs is any
Deformation, it is intended that cover it is non-exclusive include, for example, containing the process, method of a series of steps or units, system, production
Product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include be not clearly listed or for this
A little process, methods, the other step or units of product or equipment inherently.
It should be noted that these specific embodiments can be combined with each other below, for the same or similar concept
Or process may repeat no more in certain embodiments.
Fig. 1 is the flow chart of multimedia data playing method embodiment one of the present invention, which can
Shown in Figure 1 to be executed by multi-medium data playing device, which may include:
S101, the first RTCP Real-time Transport Control Protocol RTCP the sender report SR, the first RTCP for obtaining the first audio data
It include first network time protocol NTP time and the first realtime transmission protocol RTP time, the first RTCP SR corresponding first in SR
System time.
Wherein, the first audio data can be the audio data of initial play, may not be the audio number of initial play
According to as long as the audio data before second audio data, further limits here, the present invention is not done.
In actual application, it is corresponding all periodically to send the data packet for one data packet of the every transmission of transmitting terminal
RTCP SR, RTCP SR in include NTP time and RTP time, wherein the NTP time be transmitting terminal send RTCP SR system
Time, RTP time can be regarded as the acquisition time of the data packet, and the corresponding system time of RTCP SR is that receiving end receives
The receiving time of RTCP SR.The first NTP time in the present embodiment is that transmitting terminal sends the corresponding RTCP of the first audio data
The system time of SR, the first RTP time are the acquisition times of the first audio data, and the first system time is that receiving end receives first
The receiving time of the corresponding RTCP SR of audio data.Optionally, transmitting terminal can be server, be also possible to terminal, receiving end
It can be the terminal with playing audio-fequency data and video data function.
It include the 2nd NTP time and second in the 2nd RTCP SR of S102, acquisition second audio data, the 2nd RTCP SR
RTP time, the 2nd RTCP SR correspond to the second system time, wherein the first audio data be second audio data before number
According to.
Wherein, second audio data can be the audio data of second broadcasting, be also possible to the audio of third broadcasting
Data are primarily referred to as generation current video data to be played, and second audio data plays after the first audio data.Show
Example, if four audio datas have been received at this time, and it will play and play the 4th audio data, then the second audio number
According to being the 4th audio data will playing, the first audio data can be the audio data of first broadcasting, can also be with
It is the audio data of second broadcasting, it is of course also possible to be the audio data that third plays, here, for the first audio number
According to referring specifically to for which audio data, the present invention does not do and further limits.
When the 2nd NTP time in the present embodiment is the system that transmitting terminal sends the corresponding RTCP SR of second audio data
Between, the 2nd RTP time was the acquisition time of second audio data, and the second system time is that receiving end receives second audio data pair
The receiving time of the RTCP SR answered.
It include the 3rd NTP time and third in the 3rd RTCP SR of S103, the first video data of acquisition, the 3rd RTCP SR
RTP time, the 3rd RTCP SR correspond to third system time.
Wherein, the first video data can be the video data of initial play, may not be the video counts of initial play
According to as long as the video data before the second video data, further limits here, the present invention is not done.
When the 3rd NTP time in the present embodiment is the system that transmitting terminal sends the corresponding RTCP SR of the first video data
Between, the 3rd RTP time was the acquisition time of the first video data, and third system time is that receiving end receives the first video data pair
The receiving time of the RTCP SR answered.
It include the 4th NTP time and the 4th in the 4th RTCP SR of S104, the second video data of acquisition, the 4th RTCP SR
RTP time, corresponding 4th system time of the 4th RTCP SR, wherein the first video data be the second video data before number
According to.
Wherein, the second video data can be the video data of second broadcasting, be also possible to the video of third broadcasting
Data are primarily referred to as generation current video data to be played, and the second video data plays after the first video data.Show
Example, if four video datas have been received at this time, and the 4th video data will be played, then the second video data is
For the 4th video data that will be played, the first video data can be the video data of first broadcasting, be also possible to the
The video data of two broadcastings, it is of course also possible to be the video data that third plays, here, having for the first video data
Which video data body refers to, and the present invention does not do and further limits.
When the 4th NTP time in the present embodiment is the system that transmitting terminal sends the corresponding RTCP SR of the second video data
Between, the 4th RTP time was the acquisition time of the second video data, and the 4th system time is that receiving end receives the second video data pair
The receiving time of the RTCP SR answered.
It should be noted that in the present embodiment, step S101 and S102 can be first carried out, i.e., first obtain the first audio number
According to and second audio data, then execute step S103 and S104, step S103 and S104 can also be first carried out, i.e., first obtain first
Video data and the second video data, then step S101 and S102 are executed, here, for first carrying out step S101 and S102, also
It is to first carry out step S103 and S104, the present invention does not do and further limits.
S105, according to the first system time, second system time, the first NTP time, the 2nd NTP time, a RTP when
Between and the 2nd RTP time determine the 2nd RTP time accuracy.
Wherein, the first system time and second system time are respectively that receiving end receives the first RTCP SR and second
The receiving time of RTCP SR, the first system time and second system time are a correct time points, can according to this
The accuracy of one system time and second system time determine the accuracy of the first NTP time and the 2nd NTP time, and then root again
The accuracy of the first RTP time and the 2nd RTP time is finally determined according to the accuracy of the first NTP time and the 2nd NTP time.
S106, according to third system time, the 4th system time, the 3rd NTP time, the 4th NTP time, when three RTP
Between and the 4th RTP time determine the 4th RTP time accuracy.
Wherein, third system time and the 4th system time are respectively that receiving end receives the 3rd RTCP SR and the 4th
The receiving time of RTCP SR, the third system time and the 4th system time are a correct time points, can according to this
The accuracy of three system times and the 4th system time determines the accuracy of the 3rd NTP time and the 4th NTP time, and then root again
The accuracy of the 3rd RTP time and the 4th RTP time is finally determined according to the accuracy of the 3rd NTP time and the 4th NTP time.
It should be noted that in the present embodiment, step S105 can be first carried out, i.e., first determine the standard of the 2nd RTP time
True property, then step S106 is executed, step S106 can also be first carried out, i.e., first determines the accuracy of the 4th RTP time, then executes step
Rapid S105, here, still first carrying out step S106 for first carrying out step S105, the present invention does not do and further limits.
S107, accuracy and the accuracy of the 4th RTP time according to the 2nd RTP time, determine second audio data
The broadcast point of broadcast point and the second video data.
It is exemplary, if the 2nd RTP time is accurate, the broadcasting of second audio data can be determined according to the 2nd RTP time
Point, likewise, the broadcast point of the second video data can be determined according to the 4th RTP time if the 4th RTP time is accurate, this
The broadcast point of the second audio data that sample is calculated and the second video data is consistent, i.e. the broadcast point of second audio data
It matches with the broadcast point of the second video data, can be carried out at this time according to the broadcast point of second audio data and the second video data
It is played simultaneously, effectively improves the fluency of the second video data broadcasting, it is also possible to realize second audio data and the
Two video datas are played simultaneously.
In the present embodiment, first according to the first system time, the second system time, the first NTP time, the 2nd NTP time,
First RTP time and the 2nd RTP time determine the 2nd RTP time accuracy；According to third system time, the 4th system time,
3rd NTP time, the 4th NTP time, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy；And then
The broadcast point of second audio data and the second video data is determined according to the accuracy of the 2nd RTP time and the 4th RTP time, if
2nd RTP time and the 4th RTP time are accurate, then calculate separately out the broadcast point and second video data of second audio data
Broadcast point effectively improves so that the second video data can uniformly be played according to calculated broadcast point
The fluency that two video datas play, meanwhile, because of the broadcast point of the broadcast point of the second video data and second audio data
Match, being played simultaneously for second audio data and the second video data also may be implemented.
Based on the corresponding embodiment of Fig. 1, on the basis of Fig. 1 corresponding embodiment, further, the embodiment of the present invention is mentioned
Another multimedia data playing method is supplied, shown in Figure 2, Fig. 2 is multimedia data playing method of the present invention implementation
The flow diagram of example two.
Optionally, in the present embodiment, it according to the accuracy and the accuracy of the 4th RTP time of the 2nd RTP time, determines
The broadcast point of the broadcast point of second audio data and the second video data, comprising:
If S108, the 2nd RTP time inaccuracy or the 4th RTP time inaccuracy；Then according to the second video data before
Frame per second, play the second video data.
It is exemplary, can be according to the first system time in conjunction with the record of above-described embodiment one, the second system time, first
NTP time, the 2nd NTP time, the first RTP time determine whether the 2nd RTP time is accurate with the 2nd RTP time.Determining
Two RTP times whether accurately during, the first NTP time and the are first determined according to the first system time and second system time
Whether two NTP are accurate, because the first system time and second system time are accurate, it is possible to according to the first system time and
The two system time determines whether the first NTP time and the 2nd NTP time are accurate, however, it is determined that the 2nd RTP time inaccuracy is then not necessarily to
Further determine that whether the 4th RTP time is accurate, can directly count in the preset time period before the second video data
The play frame rate of video data, and the second video data is played out according to the play frame rate, to improve the second video counts
According to the fluency of broadcasting.Or, however, it is determined that the 4th RTP time inaccuracy then no longer needs to whether further determine that for the 2nd RTP time
Accurately, the play frame rate of the video data in the preset time period before the second video data can be directly counted, and according to this
Play frame rate plays out the second video data, to improve the fluency that the second video data plays.Wherein, preset time
Section can be that 10s can be specifically configured, it is of course also possible to be 15s here, for preset time period according to actual needs
Occurrence, the present invention do not do and further limits.
It should be noted that above-mentioned the 2nd RTP time of determination whether accurately during, if the first NTP time and the
Two NTP times inaccuracy, at this point it is possible to do not have to further according to the first NTP time and the 2nd NTP time determine the first RTP time and
The accuracy of 2nd RTP time, can be obtained for the first RTP time and the 2nd RTP time is also inaccurate.Likewise, when four RTP
Between accuracy determination process it is similar with the determination process of the 2nd RTP time, here, the present invention repeats no more.
In the present embodiment, if the 2nd RTP time inaccuracy or the 4th RTP time inaccuracy, the be calculated
The broadcast point of the broadcast point of two audio datas or the second video data is just inaccurate, i.e. the broadcast point of second audio data and second
The broadcast point of video data mismatches, at this time if also according to the second audio data and the second video in above-described embodiment one
The broadcast point of data synchronizes broadcasting, will lead to the phenomenon that the second video data Caton or F.F. occurs when playing, because
This can be counted in the preset time period before the second video data in order to enable the second video data can be played equably
Video data play frame rate, and the second video data is played out according to the play frame rate, to improve the second video
The fluency of data playback.
Based on the corresponding embodiment of Fig. 1, on the basis of Fig. 1 corresponding embodiment, further, the embodiment of the present invention is mentioned
Another multimedia data playing method is supplied, shown in Figure 3, Fig. 3 is multimedia data playing method of the present invention implementation
The flow diagram of example three.
Optionally, in the present embodiment, it according to the accuracy and the accuracy of the 4th RTP time of the 2nd RTP time, determines
The broadcast point of the broadcast point of second audio data and the second video data, comprising:
If the 2nd RTP time is accurate, according to the 2nd RTP time, initial audio RTP time and audio sample rate, determine
The broadcast point of second audio data；If the 4th RTP time is accurate, according to the 4th RTP time, initial video RTP time and sound
Frequency sampling rate determines the broadcast point of second audio data.
Further, according to the 2nd RTP time, initial audio RTP time and audio sample rate, second audio data is determined
Broadcast point, can specifically include:
The difference of the 2nd RTP time and initial audio RTP time are determined divided by audio sample rate, obtained time point is the
The broadcast point of two audio datas；Determine that the difference of the 4th RTP time and initial video RTP time divided by video sampling rate, obtain
Time point be second audio data broadcast point.
Wherein, initial audio is first audio data, and initial video is first video data.Under normal conditions, sound
Frequency sampling rate is 8000, and video sampling rate is 90000.
It is exemplary, it is assumed that receiving end receives four audio datas, this four audio datas corresponding RTP time is respectively
160,320,480,640, then according to the calculation method of above-mentioned audio broadcast point, the broadcast point of this available four audio datas
It is followed successively by 0ms, 20ms, 40ms, 60ms, likewise, assume that receiving end receives four video datas, this four video datas pair
The RTP time answered is respectively 0,3600,7200,10800, then according to the calculation method of above-mentioned video playing point, it is available this
The broadcast point of four video datas is followed successively by 0ms, 40ms, 80ms, 120ms, in the broadcast point and view that audio data is calculated
After the broadcast point of frequency evidence, because the broadcast point of the broadcast point of audio data and video data mismatches, if according to audio number
When synchronizing broadcasting according to the broadcast point with video data, then the phenomenon that video data will appear Caton, therefore, in such case
Under, when the broadcast point for the audio data and video data being calculated mismatches, can count video data to be played it
The play frame rate of video data in preceding preset time period, and video data to be played is broadcast according to the play frame rate
It puts, to improve the fluency that the video data to be played plays.
The broadcast point of the above-mentioned audio data being calculated and video data mismatches, and reason is: audio data pair
The RTP time misregistration in RTP time misregistration or the corresponding RTCP SR of video data in the RTCP SR answered,
So as to cause the broadcast point inaccuracy for the audio data being calculated or the broadcast point inaccuracy of video data, i.e. audio data
Broadcast point and the broadcast point of video data mismatch, and then video data and audio data is caused to block when being played simultaneously
Or the phenomenon that F.F., i.e. the broadcasting of video data is not smooth.
So, how to determine whether the RTP time in the corresponding RTCP SR of audio data accurate in the present embodiment,
Optionally, according to the first system time, second system time, the first NTP time, the 2nd NTP time, the first RTP time and
Two RTP times determined the 2nd RTP time accuracy, comprising:
S1051, determine the absolute difference of the first difference and the second difference whether less than the first preset threshold, the first difference
For the difference of second system time and the first system time, the second difference is the difference of the 2nd NTP time and the first NTP time.
If the absolute difference of S1052, the first difference and the second difference are less than the first preset threshold, it is determined that the second difference
Whether the absolute difference with third difference is less than the second preset threshold, wherein third difference was the 2nd RTP time divided by audio
Sample rate, with the first RTP time divided by the difference of audio sample rate.
If the absolute difference of S1053, the second difference and third difference is less than the second preset threshold, it is determined that the 2nd RTP
Time is accurate.
Wherein, the first preset threshold and the second preset threshold can be identical, can not also be identical, specifically can be according to reality
It needs to be configured, in the present embodiment, the first preset threshold and the second preset threshold can be identical, are disposed as 10ms.
In actual application, first whether default less than first according to the absolute difference of the first difference and the second difference
Threshold value 10ms, so that it is determined that whether the first NTP time and the 2nd NTP time are accurate, if the difference of the first difference and the second difference
Absolute value is less than 10ms, then illustrates that the first NTP time and the 2nd NTP time are accurate, next determines that the second difference and third are poor
Whether the absolute difference of value is less than the second preset threshold 10ms, however, it is determined that the absolute difference of the second difference and third difference is small
In 10ms, it is determined that the 2nd RTP time is accurate, illustrates that the corresponding 2nd RTCP SR record of second audio data is accurate.If it is determined that
The absolute difference of second difference and third difference is greater than 10ms, it is determined that the 2nd RTP time inaccuracy illustrates the second audio number
According to corresponding 2nd RTCP SR misregister.
During whether above-mentioned the 2nd RTP time of determination is accurate, if the difference of the first difference and the second difference is absolute
Value is greater than 10ms, then illustrates the first NTP time and the 2nd NTP time inaccuracy, and because when the first RTP time and two RTP
Between accuracy be to be determined according to the difference of the first NTP time and the 2nd NTP time again, therefore, when the first NTP time and the
When two NTP time inaccuracy, then immediately arrived at for the first RTP time and the 2nd RTP time is also inaccurate, without further root
Determine whether the 2nd RTP time is accurate according to the absolute difference of the second difference and third difference.
In the present embodiment, it can be used whether following pseudocode judges the corresponding 2nd RTCP SR of second audio data
Record is accurate:
In the present embodiment, optionally, according to third system time, the 4th system time, the 3rd NTP time, the 4th NTP
Time, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy, comprising:
S1061, determine whether the absolute difference of the 4th difference and the 5th difference is less than third predetermined threshold value, the 4th difference
For the 4th system time and third system time difference, the 5th difference is the difference of the 4th NTP time and the 3rd NTP time；
If the absolute difference of S1062, the 4th difference and the 5th difference are less than third predetermined threshold value, it is determined that the 5th difference
Whether the absolute difference with the 6th difference is less than the 4th preset threshold, wherein the 5th difference was the 4th RTP time divided by video
Sample rate, with the 3rd RTP time divided by the difference of video sampling rate；
If the absolute difference of S1063, the 4th difference and the 5th difference is less than the 4th preset threshold, it is determined that the 4th RTP
Time is accurate.
Wherein, third predetermined threshold value and the 4th preset threshold can be identical, can not also be identical, specifically can be according to reality
It needs to be configured, in the present embodiment, third predetermined threshold value and the 4th preset threshold can be identical, are disposed as 10ms.
In actual application, first whether default less than third according to the absolute difference of the 4th difference and the 5th difference
Threshold value 10ms, so that it is determined that whether the 3rd NTP time and the 4th NTP time are accurate, if the difference of the 4th difference and the 5th difference
Absolute value is less than 10ms, then illustrates that the 3rd NTP time and the 4th NTP time are accurate, next determine the 5th difference with it is the 6th poor
Whether the absolute difference of value is less than the 4th preset threshold 10ms, however, it is determined that the absolute difference of the 5th difference and the 6th difference is small
In 10ms, it is determined that the 4th RTP time is accurate, illustrates that the corresponding 4th RTCP SR record of the second video data is accurate.If it is determined that
The absolute difference of 5th difference and the 6th difference is greater than 10ms, it is determined that the 4th RTP time inaccuracy illustrates the second video counts
According to corresponding 4th RTCP SR misregister.
During whether above-mentioned the 4th RTP time of determination is accurate, if the difference of the 4th difference and the 5th difference is absolute
Value is greater than 10ms, then illustrates the 3rd NTP time and the 4th NTP time inaccuracy, and because when the 3rd RTP time and four RTP
Between accuracy be to be determined according to the difference of the 3rd NTP time and the 4th NTP time again, therefore, when the 3rd NTP time and the
When four NTP time inaccuracy, then immediately arrived at for the 3rd RTP time and the 4th RTP time is also inaccurate, without further root
Determine whether the 4th RTP time is accurate according to the absolute difference of the 5th difference and the 6th difference.
In the present embodiment, it can be used whether following pseudocode judges the corresponding 4th RTCP SR of the second video data
Record is accurate:
In the present embodiment, the corresponding first RTCP SR of the first audio data is being obtained respectively, second audio data is corresponding
The 2nd RTCP SR, the first video data corresponding 3rd RTCP SR and the corresponding 4th RTCP SR of the second video data it
Afterwards, can determine whether are the first NTP time and the 2nd NTP time according to the absolute difference between the first difference and the second difference
Accurately, however, it is determined that the first NTP time and the 2nd NTP time are accurate, then further according between the second difference and third difference
Absolute difference determine whether the first RTP time and the 2nd RTP time accurate, however, it is determined that the first RTP time and when two RTP
Between it is accurate, then can be calculated according to the difference of the 2nd RTP time and the RTP time of initial audio divided by audio sample rate
The broadcast point of second audio data, likewise, the calculating process of the broadcast point of the second video data and second audio data are broadcast
The calculating process put a little is similar, here, not repeating them here.In this way, determining the 2nd RTP time and the 4th RTP time accurate feelings
Under condition, the broadcast point for the second audio data being calculated and the broadcast point of the second video data are consistent, i.e. the second audio
The broadcast point of data is matched with the broadcast point of the second video data, at this time can be according to second audio data and the second video data
Broadcast point synchronize broadcasting, the fluency of the second video data broadcasting not only can be improved, but also may be implemented second
Audio data and the second video data are played simultaneously.It is worth noting that, determining the 2nd RTP time and the 4th RTP time
During, as long as determining any of the 2nd NTP time or the 4th NTP time NTP time inaccuracy, then corresponding the
Two RTP times, perhaps the 4th RTP time will be inaccurate without yet further according to the 2nd NTP time or the 4th NTP
Time determines whether the 2nd RTP time or the 4th RTP time are accurate, so that it may directly pre- before the second video data of statistics
If the play frame rate of the video data in the period, and the second video data is played out according to the play frame rate, to mention
The fluency that high second video data plays.
Fig. 4 is the structural schematic diagram of 40 embodiment one of multi-medium data playing device of the present invention, shown in Figure 4, should
Multi-medium data playing device 40 may include:
First obtains module 401, includes for obtaining the first RTCP SR of the first audio data, in the first RTCP SR
One NTP time and the first RTP time, the first RTCP SR correspond to the first system time.
Second obtains module 402, for obtaining the 2nd RTCP SR of second audio data, comprising the in the 2nd RTCP SR
Two NTP times and the 2nd RTP time, the 2nd RTCP SR correspond to the second system time, wherein the first audio data is the second sound
Data before frequency evidence.
Third obtains module 403, includes for obtaining the 3rd RTCP SR of the first video data, in the 3rd RTCP SR
Three NTP times and the 3rd RTP time, the 3rd RTCP SR correspond to third system time.
4th obtains module 404, includes for obtaining the 4th RTCP SR of the second video data, in the 4th RTCP SR
Four NTP times and the 4th RTP time, corresponding 4th system time of the 4th RTCP SR, wherein the first video data is the second view
Data before frequency evidence.
First processing module 405, for according to the first system time, second system time, the first NTP time, the 2nd NTP
Time, the first RTP time and the 2nd RTP time determine the 2nd RTP time accuracy.
Second processing module 406, for according to third system time, the 4th system time, the 3rd NTP time, the 4th NTP
Time, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy.
Third processing module 407 is determined for the accuracy and the accuracy of the 4th RTP time according to the 2nd RTP time
The broadcast point of the broadcast point of second audio data and the second video data.
Multi-medium data playing device 40 shown in the embodiment of the present invention, can execute skill shown in above method embodiment
Art scheme, realization principle and beneficial effect are similar, are no longer repeated herein.
Optionally, if third processing module 407 is accurate specifically for the 2nd RTP time, according to the 2nd RTP time, just
Audio RTP time beginning and audio sample rate, determine the broadcast point of second audio data；If the 4th RTP time is accurate, according to
Four RTP times, initial video RTP time and video sampling rate, determine the broadcast point of the second video data.
Optionally, third processing module 407 is specifically used for determining the difference of the 2nd RTP time and initial audio RTP time
Divided by audio sample rate, obtained time point is the broadcast point of second audio data；Determine the 4th RTP time and initial video
For the difference of RTP time divided by video sampling rate, obtained time point is the broadcast point of the second video data.
Optionally, if third processing module 407 is specifically used for the 2nd RTP time inaccuracy or the 4th RTP time is inaccurate
Really；Then according to the frame per second before the second video data, the second video data is played.
Optionally, first processing module 405 be specifically used for determining the first difference and the second difference absolute difference whether
Less than the first preset threshold, the first difference is the difference of second system time and the first system time, and the second difference is the 2nd NTP
The difference of time and the first NTP time；If the absolute difference of the first difference and the second difference is less than the first preset threshold, really
Whether the absolute difference of fixed second difference and third difference is less than the second preset threshold, wherein when third difference is two RTP
Between divided by audio sample rate, with the first RTP time divided by the difference of audio sample rate；If the difference of the second difference and third difference
Absolute value is less than the second preset threshold, it is determined that the 2nd RTP time is accurate.
Optionally, Second processing module 406 be specifically used for determining the 4th difference and the 5th difference absolute difference whether
Less than third predetermined threshold value, the 4th difference is the 4th system time and third system time difference, when the 5th difference is four NTP
Between and the 3rd NTP time difference；If the absolute difference of the 4th difference and the 5th difference is less than third predetermined threshold value, it is determined that
Whether the absolute difference of the 5th difference and the 6th difference is less than the 4th preset threshold, wherein the 5th difference was the 4th RTP time
Divided by video sampling rate, with the 3rd RTP time divided by the difference of video sampling rate；If the difference of the 4th difference and the 5th difference is exhausted
To value less than the 4th preset threshold, it is determined that the 4th RTP time is accurate.
Multi-medium data playing device 40 shown in the embodiment of the present invention can execute skill shown in above method embodiment
Art scheme, realization principle and beneficial effect are similar, are no longer repeated herein.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above-mentioned each method embodiment can lead to
The relevant hardware of program instruction is crossed to complete.Program above-mentioned can be stored in a computer readable storage medium.The journey
When being executed, execution includes the steps that above-mentioned each method embodiment to sequence；And storage medium above-mentioned include: ROM, RAM, magnetic disk or
The various media that can store program code such as person's CD.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (8)
1. a kind of multimedia data playing method characterized by comprising
It obtains and is wrapped in sender report the RTCP SR, the first RTCP SR of the first RTCP Real-time Transport Control Protocol of the first audio data
The NTP time of time protocol containing first network and the first realtime transmission protocol RTP time, corresponding first system of the first RTCP SR
It unites the time；The first system time is the receiving time for receiving the corresponding RTCP SR of the first audio data；
The 2nd RTCP SR of second audio data is obtained, when including the 2nd NTP time and two RTP in the 2nd RTCP SR
Between, the 2nd RTCP SR corresponds to the second system time, wherein first audio data be the second audio data it
Preceding data；The second system time is the receiving time for receiving the corresponding RTCP SR of second audio data；
The 3rd RTCP SR of the first video data is obtained, when including the 3rd NTP time and three RTP in the 3rd RTCP SR
Between, the 3rd RTCP SR corresponds to third system time；The third system time is that the first video data of reception is corresponding
The receiving time of RTCP SR；
The 4th RTCP SR of the second video data is obtained, when including the 4th NTP time and four RTP in the 4th RTCP SR
Between, corresponding 4th system time of the 4th RTCP SR, wherein first video data be second video data it
Preceding data；4th system time is the receiving time for receiving the corresponding RTCP SR of the second video data；
According to the first system time, the second system time, the first NTP time, the 2nd NTP time, institute
It stated for the first RTP time and the 2nd RTP time determines the 2nd RTP time accuracy；
According to the third system time, the 4th system time, the 3rd NTP time, the 4th NTP time, institute
It stated for the 3rd RTP time and the 4th RTP time determines the 4th RTP time accuracy；
According to the accuracy and the accuracy of the 4th RTP time of the 2nd RTP time, the second audio data is determined
Broadcast point and second video data broadcast point；
Wherein, described according to the first system time, the second system time, the first NTP time, described second
NTP time, the first RTP time and the 2nd RTP time determine the 2nd RTP time accuracy, comprising:
The absolute difference of the first difference and the second difference is determined whether less than the first preset threshold, first difference is described
The difference of second system time and the first system time, second difference are the 2nd NTP time and described first
The difference of NTP time；
If the absolute difference of first difference and second difference is less than the first preset threshold, it is determined that described second is poor
Whether the absolute difference of value and third difference is less than the second preset threshold, wherein when the third difference is two RTP
Between divided by audio sample rate, with the first RTP time divided by the difference of audio sample rate；
If the absolute difference of second difference and the third difference is less than the second preset threshold, it is determined that described second
The RTP time is accurate；
It is described according to the third system time, the 4th system time, the 3rd NTP time, four NTP when
Between, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy, comprising:
Determine whether the absolute difference of the 4th difference and the 5th difference is less than third predetermined threshold value, the 4th difference is described
4th system time and third system time difference, the 5th difference are the 4th NTP time and the 3rd NTP time
Difference；
If the absolute difference of the 4th difference and the 5th difference is less than third predetermined threshold value, it is determined that the described 5th is poor
Whether the absolute difference of value and the 6th difference is less than the 4th preset threshold, wherein when the 5th difference is four RTP
Between divided by video sampling rate, with the 3rd RTP time divided by the difference of video sampling rate；
If the absolute difference of the 4th difference and the 5th difference is less than the 4th preset threshold, it is determined that the described 4th
The RTP time is accurate.
2. the method according to claim 1, wherein the accuracy and institute according to the 2nd RTP time
The accuracy for stating for the 4th RTP time determines the broadcast point of the second audio data and the broadcast point of second video data,
Include:
If the 2nd RTP time is accurate, according to the 2nd RTP time, initial audio RTP time and audio sample rate,
Determine the broadcast point of the second audio data；
If the 4th RTP time is accurate, according to the 4th RTP time, initial video RTP time and video sampling rate,
Determine the broadcast point of second video data.
3. according to the method described in claim 2, it is characterized in that, described according to the 2nd RTP time, initial audio RTP
Time and audio sample rate determine the broadcast point of the second audio data, comprising:
The difference of the 2nd RTP time and the initial audio RTP time are determined divided by the audio sample rate, obtain when
Between point be the second audio data broadcast point；
The difference of the 4th RTP time and the initial video RTP time are determined divided by the video sampling rate, obtain when
Between point be second video data broadcast point.
4. the method according to claim 1, wherein the accuracy and institute according to the 2nd RTP time
The accuracy for stating for the 4th RTP time determines the broadcast point of the second audio data and the broadcast point of second video data,
Include:
If the 2nd RTP time inaccuracy or the 4th RTP time inaccuracy；
Then according to the frame per second before second video data, second video data is played.
5. a kind of multi-medium data playing device characterized by comprising
First obtains module, includes first in the first RTCP SR for obtaining the first RTCP SR of the first audio data
NTP time and the first RTP time, the first RTCP SR correspond to the first system time；The first system time is reception
The receiving time of the corresponding RTCP SR of one audio data；
Second obtains module, includes second in the 2nd RTCP SR for obtaining the 2nd RTCP SR of second audio data
NTP time and the 2nd RTP time, the 2nd RTCP SR correspond to the second system time, wherein first audio data is
Data before the second audio data；The second system time is to receive the corresponding RTCP SR of second audio data
Receiving time；
Third obtains module, includes third in the 3rd RTCP SR for obtaining the 3rd RTCP SR of the first video data
NTP time and the 3rd RTP time, the 3rd RTCP SR correspond to third system time；The third system time is reception
The receiving time of the corresponding RTCP SR of one video data；
4th obtains module, includes the 4th in the 4th RTCP SR for obtaining the 4th RTCP SR of the second video data
NTP time and the 4th RTP time, corresponding 4th system time of the 4th RTCP SR, wherein first video data is
Data before second video data；4th system time is to receive the corresponding RTCP SR of the second video data
Receiving time；
First processing module, for according to the first system time, the second system time, the first NTP time, institute
Stating the 2nd NTP time, the first RTP time and the 2nd RTP time determines the 2nd RTP time accuracy；
Second processing module, for according to the third system time, the 4th system time, the 3rd NTP time, institute
Stated for the 4th NTP time, the 3rd RTP time and the 4th RTP time determine the 4th RTP time accuracy；
Third processing module, for the accuracy and the accuracy of the 4th RTP time according to the 2nd RTP time, really
The broadcast point of the fixed second audio data and the broadcast point of second video data；
Wherein, whether the first processing module is specifically used for determining the absolute difference of the first difference and the second difference less than the
One preset threshold, first difference are the difference of the second system time and the first system time, and described second is poor
Value is the difference of the 2nd NTP time and the first NTP time；If the difference of first difference and second difference
Absolute value is less than the first preset threshold, it is determined that whether the absolute difference of second difference and third difference is pre- less than second
If threshold value, wherein the third difference is the 2nd RTP time divided by audio sample rate, with the first RTP time divided by
The difference of audio sample rate；If the absolute difference of second difference and the third difference less than the second preset threshold,
Determine that the 2nd RTP time is accurate；
The Second processing module is specifically for determining it is pre- whether the absolute difference of the 4th difference and the 5th difference is less than third
If threshold value, the 4th difference is the 4th system time and third system time difference, and the 5th difference is described the
The difference of four NTP times and the 3rd NTP time；If the absolute difference of the 4th difference and the 5th difference is less than
Third predetermined threshold value, it is determined that the absolute difference of the 5th difference and the 6th difference whether less than the 4th preset threshold,
In, the 5th difference is the 4th RTP time divided by video sampling rate, with the 3rd RTP time divided by video sampling
The difference of rate；If the absolute difference of the 4th difference and the 5th difference is less than the 4th preset threshold, it is determined that described
4th RTP time is accurate.
6. device according to claim 5, which is characterized in that if the third processing module is specifically used for described second
The RTP time is accurate, then according to the 2nd RTP time, initial audio RTP time and audio sample rate, determines second sound
The broadcast point of frequency evidence；If the 4th RTP time is accurate, according to the 4th RTP time, the initial video RTP time and
Video sampling rate determines the broadcast point of second video data.
7. device according to claim 6, which is characterized in that the third processing module is specifically used for determining described second
For the difference of RTP time and the initial audio RTP time divided by the audio sample rate, obtained time point is second sound
The broadcast point of frequency evidence；Determine the difference of the 4th RTP time and the initial video RTP time divided by the video sampling
Rate, obtained time point are the broadcast point of second video data.
8. device according to claim 5, which is characterized in that if the third processing module is specifically used for described second
RTP time inaccuracy or the 4th RTP time inaccuracy；Then according to the frame per second before second video data, play
Second video data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610432011.6A CN107517401B (en) | 2016-06-15 | 2016-06-15 | Multimedia data playing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610432011.6A CN107517401B (en) | 2016-06-15 | 2016-06-15 | Multimedia data playing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107517401A CN107517401A (en) | 2017-12-26 |
| CN107517401B true CN107517401B (en) | 2019-11-19 |
Family
ID=60720586
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610432011.6A Active CN107517401B (en) | 2016-06-15 | 2016-06-15 | Multimedia data playing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107517401B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109600564B (en) * | 2018-08-01 | 2020-06-02 | 北京微播视界科技有限公司 | Method and apparatus for determining a timestamp |
| CN110225385B (en) * | 2019-06-19 | 2021-09-10 | 鼎桥通信技术有限公司 | Audio and video synchronization adjustment method and device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100565333B1 (en) * | 2004-06-22 | 2006-03-30 | 엘지전자 주식회사 | A method and a apparatus of synchronization video signal with audio signal for mobile phone |
| CN100568828C (en) * | 2005-12-28 | 2009-12-09 | 中兴通讯股份有限公司 | A kind of method that in RTP, detects network transfer delay in real time |
| CN101179484A (en) * | 2006-11-09 | 2008-05-14 | 华为技术有限公司 | Method and system of synchronizing different media stream |
| CN101282482B (en) * | 2008-05-04 | 2011-05-11 | 中兴通讯股份有限公司 | Apparatus, system and method for synchronously playing video data and audio data |
| CN103269448A (en) * | 2013-05-24 | 2013-08-28 | 浙江工商大学 | Method for achieving synchronization of audio and video on the basis of RTP/RTCP feedback early-warning algorithm |
| EP2871848A1 (en) * | 2013-11-12 | 2015-05-13 | Koninklijke KPN N.V. | Providing correction information for media synchronization |
| CN104618786B (en) * | 2014-12-22 | 2018-01-05 | 深圳市腾讯计算机系统有限公司 | Audio and video synchronization method and device |
-
2016
- 2016-06-15 CN CN201610432011.6A patent/CN107517401B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107517401A (en) | 2017-12-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104581388B (en) | The processing method of broadcast state, apparatus and system | |
| CN105306110B (en) | A kind of method and system realized synchronous music and played | |
| CN104768082B (en) | A kind of audio and video playing information processing method and server | |
| CN104869430B (en) | A kind of video speed player method and device | |
| CN103731716B (en) | Method for synchronizing audio and video in TS stream playing | |
| CN103414957A (en) | Method and device for synchronization of audio data and video data | |
| CN107426629A (en) | A kind of streaming media file processing method and live broadcast system | |
| CN100450163C (en) | A video and audio synchronization playing method for mobile multimedia broadcasting | |
| CN105578308B (en) | The implementation method that a kind of RTP multicasts live streaming is combined with HLS unicast time shifts | |
| US20130091528A1 (en) | Video reproduction system, receive terminal, home gateway device, and quality control system | |
| CN109714622B (en) | Video data processing method and device and electronic equipment | |
| CN105744334A (en) | Method and equipment for audio and video synchronization and synchronous playing | |
| CN104811751A (en) | Streaming media playing blockage pause recognition method and streaming media playing blockage pause recognition device | |
| CN106612452A (en) | Audio-video synchronizing method and device of set top box | |
| CN105898500A (en) | Network video play method and device | |
| CN107517401B (en) | Multimedia data playing method and device | |
| CN109275008A (en) | A kind of method and apparatus of audio-visual synchronization | |
| CN101931775A (en) | Video recording method and device | |
| CN105763942B (en) | A kind of computational methods of IPTV set top box VMOS values | |
| CN109168059A (en) | A kind of labial synchronization method playing audio & video respectively on different devices | |
| CN109905763A (en) | Optimize the method that player audio plays Caton | |
| CN101887739B (en) | Method and device for synchronizing media play | |
| CN106303672A (en) | A kind of synchronous broadcast method based on recorded broadcast video and device | |
| CN104079958B (en) | A kind of method of video broadcast synchronous with multichannel audio | |
| CN110225385A (en) | A kind of audio-visual synchronization method of adjustment and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |