CN107682715A

CN107682715A - Video synchronization method and device

Info

Publication number: CN107682715A
Application number: CN201610621430.4A
Authority: CN
Inventors: 张磊; 张世鹏; 谢志杰; 万超; 徐欣; 丁超辉; 毛华; 王涛; 廖利珍
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2016-08-01
Filing date: 2016-08-01
Publication date: 2018-02-09
Anticipated expiration: 2036-08-01
Also published as: CN107682715B

Abstract

The invention discloses a kind of video synchronization method and device, belong to communication technical field.This method includes：During live video stream is sent to multiple user terminals, timestamp is added on the designated frame of live video stream；For each user terminal in the plurality of user terminal, the forward delay interval of the user terminal is obtained, the response message that the forward delay interval is sent by the plurality of user terminal according to the timestamp on the designated frame received determines to obtain；According to the forward delay interval of the user terminal, postpone to send live video stream to the user terminal, so that the live video stream that the plurality of user terminal plays is synchronous.The present invention solves the problems, such as that the live video stream that different user end plays can not be synchronous, improves live effect.

Description

Video synchronization method and device

Technical field

The present embodiments relate to communication technical field, more particularly to a kind of video synchronization method and device.

Background technology

In video living transmission system, video source server can obtain what the video capture devices such as video camera collected Live video, and live video stream is sent to different user terminals, or relayed via different relaying servers, indirectly The live video stream is sent to different user terminals, so that different user terminals can play the live video stream, and then It is so that different with may be viewed by the live video per family.

But needed because video flowing is issued to from video source server during user terminal plays this from certain Manage the time, therefore video source server sends the time of video flowing and user terminal and plays the time possibility of the video flowing and different Step, i.e., in the presence of certain broadcast time-delay.The processing time that different relaying servers are additionally, since to the live video stream is different, Therefore in the live broadcast system of same video source server, the broadcast time-delay at different user end may be different, so as to cause not The video flowing played with user terminal at same time point can not be synchronous, influences live effect.

Therefore, a kind of video synchronization method is needed badly at present, can not be same to solve the live video stream of different user end broadcasting The problem of step.

The content of the invention

In order to solve problem of the prior art, the embodiments of the invention provide a kind of video synchronization method and device.It is described Technical scheme is as follows：

First aspect, there is provided a kind of video synchronization method, methods described include：

During live video stream is sent to multiple user terminals, when being added on the designated frame of live video stream Between stab, the timestamp is used to indicate transmission time of the designated frame；

For each user terminal in the multiple user terminal, the forward delay interval of the user terminal is obtained, the transmission is prolonged When by the multiple user terminal according on the designated frame received timestamp send response message determine to obtain；

According to the forward delay interval of the user terminal, the live video stream is sent to user terminal delay, so that described The live video stream that multiple user terminals play is synchronous.

Second aspect, there is provided a kind of video synchronization method, methods described include：

The designated frame in the live video stream that video source server is sent is received, is added with the designated frame Timestamp, the timestamp are used for the transmission time for indicating the designated frame；

According to the timestamp, according to the timestamp, response message is sent to the video server.

The third aspect, there is provided a kind of video synchronization device, described device include：

First add module, for multiple user terminals send live video stream during, in live video stream Timestamp is added on designated frame, the timestamp is used for the transmission time for indicating the designated frame；

First acquisition module, for for each user terminal in the multiple user terminal, obtaining the hair of the user terminal Delay is sent, the forward delay interval is sent by the multiple user terminal according to the timestamp on the designated frame received Response message determines to obtain；

Sending module, for the forward delay interval according to the user terminal, described live regard is sent to user terminal delay Frequency flows, so that the live video stream that the multiple user terminal plays is synchronous.

Fourth aspect, there is provided a kind of video synchronization device, described device include：

Receiving module, the designated frame in live video stream for receiving the transmission of video source server are described to specify Timestamp is added with frame of video, the timestamp is used for the transmission time for indicating the designated frame；

Sending module, for according to the timestamp, response message to be sent to the video server.

5th aspect, there is provided a kind of video synchronizing system, the system include that the above-mentioned third aspect is any described to be regarded Frequency source server and any described user terminal of multiple above-mentioned fourth aspects.

The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：

In the embodiment of the present invention, video source server can to multiple user terminals send live video stream during, Timestamp is added on the designated frame of live video stream so that each user terminal in the plurality of user terminal can be according to connecing The timestamp on designated frame received sends response message to video server, so as to which the video source server can basis The response message that the plurality of user terminal is sent determines the forward delay interval of each user terminal, and respectively according to the hair of each user terminal Delay is sent to send live video stream to corresponding client delay, to ensure that the live video stream that the plurality of user terminal plays is synchronous. That is, the video source server can receive the delay of designated frame according to different user end, set respectively to difference User terminal send live video stream delay so that different user end play live video stream can be synchronous, so as to solve The problem of live video stream that different user end plays can not be synchronous, improves live effect.

Brief description of the drawings

Technical scheme in order to illustrate the embodiments of the present invention more clearly, make required in being described below to embodiment Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.

Figure 1A is a kind of schematic diagram of video living transmission system provided in an embodiment of the present invention；

Figure 1B is the schematic diagram of another video living transmission system provided in an embodiment of the present invention；

Fig. 1 C are a kind of video synchronization method flow charts provided in an embodiment of the present invention；

Fig. 2 is another video synchronization method flow chart provided in an embodiment of the present invention；

Fig. 3 A are another video synchronization method flow charts provided in an embodiment of the present invention；

Fig. 3 B are a kind of schematic diagrames of video living transmission system provided in an embodiment of the present invention；

Fig. 4 is a kind of video synchronization device block diagram provided in an embodiment of the present invention；

Fig. 5 is another video synchronization device block diagram provided in an embodiment of the present invention；

Fig. 6 is a kind of server architecture schematic diagram of video synchronization device provided in an embodiment of the present invention；

Fig. 7 is a kind of terminal structure schematic diagram of video synchronization device provided in an embodiment of the present invention.

Embodiment

To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention Formula is described in further detail.

Before detailed explanation is carried out to the embodiment of the present invention, first the application scenarios of the embodiment of the present invention are given Introduce.Method provided in an embodiment of the present invention is applied in video living transmission system, and referring to Figure 1A, the video living transmission system can wrap Video source server 10 and multiple user terminals 20 are included, video source server 10 can obtain the video capture devices such as video camera The live video collected, and live video stream is sent to multiple user terminals 20, user terminal 20 can play the live video stream. Wherein, user terminal 20 can be PC (Personal Computer, personal computer), mobile phone, tablet personal computer etc., and the user End 20 can also play the live video stream, this hair by the player client terminal playing live video stream by webpage Bright embodiment is not limited this.Further, during user terminal difference, processing procedure of the video living transmission system to live video stream May be different, when playing form difference, the also different therefore different use of processing procedure of the video living transmission system to live video stream Family end may have different time delays when playing the live video stream.For example, with reference to Figure 1B, PC ends 21 refer to pass through broadcasting The pc user end of device client terminal playing live video stream, mobile phone web pages end 22 refer to the mobile phone that live video stream is played by webpage User terminal, PC page ends 23 refer to the pc user end that live video stream is played by webpage, pass through Figure 1B, video source service , need to also be via the place of streaming media playing server when device 10 is to mobile phone web pages end 22 and the transmission live video stream of PC page ends 23 Reason, time delay are longer than pc user end；Moreover, the live video stream for being sent to mobile phone web pages end 22 and PC page ends 23, stream The processing procedure of media play server and processing time are also different, and corresponding time delay also can be different.Example, PC ends 21 Time delay be 0.7s, the time delay at mobile phone web pages end 22 is 16s, and the time delay of PC page ends 23 is 26s, due to this The time delay that the user terminal of three types plays live video stream is different, therefore the live video played at same time point is drawn Face also cannot be synchronous.In order to solve the problems, such as that the live video that different user end plays can not be synchronous, the invention provides one Kind video synchronization method, it is described in detail below.

Fig. 1 C are a kind of video synchronization method flow charts provided in an embodiment of the present invention, and referring to Fig. 1 C, this method can wrap Include the following steps：

Step 101：During live video stream is sent to multiple user terminals, in the designated frame of live video stream Upper addition timestamp, the timestamp are used for the transmission time for indicating the designated frame.

Step 102：For each user terminal in the plurality of user terminal, the forward delay interval of the user terminal, the transmission are obtained The response message that delay is sent by the plurality of user terminal according to the timestamp on the designated frame received determines to obtain.

Step 103：According to the forward delay interval of the user terminal, postpone to send the live video stream to the user terminal, so that should The live video stream that multiple user terminals play is synchronous.

Alternatively, the forward delay interval of the user terminal is obtained, including：

The time change factor of the user terminal is obtained, the time change factor is used to indicate to send from video source server to be somebody's turn to do The system that designated frame is played to the user terminal between the designated frame handles delay, and the time change factor is by the use Family end determines to obtain according to the timestamp on the designated frame received；

According to the time change factor of the plurality of user terminal, the forward delay interval of the user terminal is determined.

Alternatively, according to the time change factor of the plurality of user terminal, the forward delay interval of the user terminal is determined, including：

It is determined that sending the time change factor, the transmission time change factor is in the time change factor of the plurality of user terminal The maximum time change factor or specified time transformation factor, the specified time transformation factor is more than the maximum time change The factor；

Determine the difference between the transmission time change factor and the time change factor of the user terminal；

Based on the difference between the transmission time change factor and the time change factor of the user terminal, the user terminal is determined Forward delay interval.

Alternatively, after the time change factor for obtaining the user terminal, in addition to：

When showing the first system time in the live video stream, first object video is obtained from the live video stream Frame, the first system time is shown in the video pictures where the first object frame of video, the first system time regards for this The system time of frequency source server and be the standard time；

The first system time is added with the time change factor of the user terminal, obtains the second system time；

The first system time that will be shown in video pictures where the first object frame of video for being sent to the user terminal Replace with the second system time；

When not showing the first system time in the live video stream, the second target is obtained from the live video stream and is regarded Frequency frame, the second target video frame are any frame of video in the live video stream, and the first system time takes for the video source Be engaged in device system time and be the standard time；

When sending the second target video frame to the user terminal, by the transmission time of the second target video frame and the use The time change factor at family end is added, and obtains the second system time；

The second system time is added in the second target video frame for being sent to the user terminal.

Above-mentioned all optional technical schemes, can form the alternative embodiment of the present invention according to any combination, and the present invention is real Example is applied no longer to repeat this one by one.

Fig. 2 is a kind of video synchronization method flow chart provided in an embodiment of the present invention, and referring to Fig. 2, this method can include The following steps：

Step 201：The designated frame in the live video stream that video source server is sent is received, on the designated frame Added with timestamp, the timestamp is used for the transmission time for indicating the designated frame.

Step 202：According to the timestamp, response message is sent to the video server.

In the embodiment of the present invention, user terminal can take according to the timestamp on the designated frame received to the video Business device sends response message, and the response message can indicate that the user terminal receives the delay of the designated frame, so as to the video Source server according to the delay of multiple user terminals, can determine the forward delay interval of each user terminal, and respectively according to each use The forward delay interval at family end sends live video stream to corresponding client delay, to ensure the live video of the plurality of user terminal broadcasting Stream is synchronous, so as to solve the problems, such as that the live video stream that different user end plays can not be synchronous, improves live effect.

Alternatively, this sends response message according to the timestamp to the video server, including：

According to the timestamp, the time change factor of user terminal is determined, the time change factor is for indicating from the video Source server sends the system that the designated frame is played to the user terminal between the designated frame and handles delay；

The time change factor is sent to the video source server.

Alternatively, this determines the time change factor of user terminal according to the timestamp, including：

When the user terminal is by the player client terminal playing live video stream, obtain indicated by the timestamp when Between；

The reception time of the designated frame is obtained, the reception time is when the user terminal receives the designated frame System time, and the reception time by the user terminal when with the video source server pair after determine to obtain；

By the difference between the time indicated by the reception time and the timestamp, be defined as the user terminal first receives Delay；

Obtain the network delay between the user terminal and the video source server；

By the difference between first reception delay and the network delay, it is defined as the time change factor of the client.

When the user terminal plays the live video stream by webpage, the time indicated by the timestamp is obtained；

The reception time of the designated frame is obtained, the reception time is the user terminal when receiving the designated frame The standard network time of acquisition；

By the difference between first reception delay and the network delay, it is defined as the second reception delay of the user terminal；

The broadcast time-delay that the user terminal plays the live video stream by the webpage is obtained, the broadcast time-delay is the user terminal By the webpage from the designated frame is received to the time delay played the designated frame；

Second reception delay is added with the broadcast time-delay, obtains the time change factor of the user terminal.

Fig. 3 A are a kind of video synchronization method flow charts provided in an embodiment of the present invention, and this method is applied to audio video synchronization system In system, the video synchronizing system includes video source server and multiple user terminals, and referring to Fig. 3 A, this method can include following several Individual step：

Step 301：Video source server to multiple user terminals during live video stream is sent, in live video stream Designated frame on add timestamp, the timestamp is used to indicate transmission time of the designated frame.

In the embodiment of the present invention, time delay is obtained for the ease of user terminal, can be in the finger of the live video stream of transmission Determine to add a timestamp in frame of video, to indicate the transmission time of the designated frame.

Wherein, the designated frame can be any frame of video of live video stream, such as can be the I of live video stream Frame and SEI frames etc., the embodiment of the present invention is not limited this.

Wherein, the video source server can to user terminal send live video stream during any time, Timestamp is added on the designated frame of transmitted live video stream, the embodiment of the present invention was not limited the opportunity for adding timestamp It is fixed.For example, the video source server can be when starting to send live video stream to user terminal, just in live video to be sent Timestamp is added on the designated frame of stream, any middle time point of live video stream can also be being sent to user terminal, obtained The designated frame in future time point live video stream to be sent is taken, and timestamp is added on the designated frame.

Wherein, in order to ensure the accuracy of timestamp, the video source server can also first will before timestamp is added The system time of the video source server is adjusted to the standard time, to add the time on designated frame according to the standard time Stamp.Specifically, the video source server can by open NTP (Network Time Protocol, NTP), The agreements such as DAYTIME (Daytime Protocol, date inquiries agreement), TIME (a kind of time tranfer agreement), by the video The system time of the server in source is adjusted to universal time, is such as adjusted to UTC (Coordinated Universal Time, Coordinated Universal Time(UTC)) etc., the embodiment of the present invention is not limited the mode of the video source server adjustment time.

Step 302：Each user terminal in the plurality of user terminal receives the live video stream of video source server transmission In designated frame.

Step 303：According to the timestamp on the designated frame, response message is sent to the video server.

Specifically, according to the timestamp on the designated frame, the process that response message is sent to the video server can With including：According to the timestamp on the designated frame, the time change factor of the user terminal is determined, the time change factor is used In instruction at the system that the video source server sends that the designated frame played to the user terminal the designated frame Reason delay；The time change factor is sent to the video source server.

Wherein, when the user terminal plays the mode difference of live video stream, the user terminal obtains the time change factor Process is also different.Specifically, the process of the user terminal acquisition time change factor can include any of in the following manner：

The first implementation：When the user terminal is by the player client terminal playing live video stream, the user terminal The time indicated by the timestamp can be obtained；The reception time of the designated frame is obtained, the reception time is the user terminal Receive the system time during designated frame, and the reception time by the user terminal when with the video source server pair after It is determined that obtain；By the difference between the time indicated by the reception time and the timestamp, be defined as the user terminal first connects Receive delay；Obtain the network delay between the user terminal and the video source server；First reception delay is prolonged with the network When between difference, be defined as the time change factor of the user terminal.

Wherein, the user terminal can be by calling PING (Packet Internet Groper, the Internet packets survey meter) Order to obtain the network delay between the video source server, can also obtain by other means and the video source service Network delay between device, the embodiment of the present invention are not limited this.

In this kind of mode, when receiving the designated frame, due to needing to refer to the system time of the user terminal with this Determining the time indicated by the timestamp in frame of video is compared, and the time indicated by the timestamp is by video source service What the system time of device obtained, therefore in order to ensure accuracy, the user terminal is also needed to before the designated frame is received, Set time with the video source server.

In a kind of possible implementation, when the video source server has been adjusted to the standard time, by the user After end is also adjusted to the standard time, the system time of the system time of the user terminal and the video source server can keep one Cause.Specifically, the user terminal can be adjusted the system time of the user terminal by opening the agreements such as NTP, DAYTIME, TIME For universal time, UTC time is such as adjusted to, the embodiment of the present invention is not limited this.Certainly, the user terminal can also Set time by other means with the video source server so that the system time of the user terminal and the video source server System time is consistent, and the embodiment of the present invention is not limited this.

For the user terminal by player client terminal playing live video stream, specified because the user terminates to this The designated frame can be directly played during frame of video, therefore the designated frame is sent to the user terminal from video source server The comprehensive delay played between the designated frame is above-mentioned first reception delay.In addition, the synthesis delay package of the user terminal The designated frame is included from the video source server to the system processing delay the user terminal and network delay, therefore, will First reception delay subtracts the time change factor that the network delay obtains, and is that the video source server sends described specify The system that frame of video is played to the user terminal between the designated frame handles delay.

For the comprehensive delay of the user terminal, because network delay can become at random with factors such as network performances Change, therefore the network delay is a variable in synthesis delay；Due to being treated in live broadcast system to live video stream Journey will not typically change, therefore it is that one in synthesis delay quantifies that the system, which handles delay,.So as to which the present invention is implemented In example, in order to which the synthesis delay accurately to user terminal is adjusted, it can calculate at quantitative-system in the aggregate delay Reason delay, and the system is handled into the time change factor of the delay as the user terminal, during so as to video source server according to this Between convert factor pair send live video stream time be adjusted.

In two kinds of possible implementations, when the user terminal plays the live video stream by webpage, the user terminal The time indicated by the timestamp can be obtained；The reception time of the designated frame is obtained, the reception time is the user terminal The standard network time obtained when receiving the designated frame；By the reception time and time indicated by the timestamp it Between difference, be defined as the first reception delay of the user terminal；Obtain the network between the user terminal and the video source server Delay；By the difference between first reception delay and the network delay, it is defined as the second reception delay of the user terminal；Obtain The user terminal plays the broadcast time-delay of the live video stream by the webpage, the broadcast time-delay be the user terminal by the webpage from The designated frame is received to the time delay played between the designated frame；Second reception delay is prolonged with the broadcasting Shi Jinhang is added, and obtains the time change factor of the user terminal.

Wherein, because the user terminal is to play the live video stream by webpage, therefore in this kind of mode, this is being received During designated frame can directly by the Network Capture standard network time, as the reception time of the designated frame, so as to Without being set time with video source server.

Wherein, the user terminal can be prolonged by calling PING orders to obtain the network between the video source server When, the network delay between the video source server can also be obtained by other means, and the embodiment of the present invention is not done to this Limit.

For the user terminal that live video stream is played by webpage, because the user terminal from by webpage receives this Designated frame also has a broadcast time-delay between the designated frame to playing out, therefore the system processing delay of the user terminal Also include broadcast time-delay.So as to after determining the difference between above-mentioned first reception delay and network delay, also need the difference It is added with the broadcast time-delay, can just obtains the system processing delay of the client, i.e. the time change factor of the client.

Wherein, the user terminal can obtain the broadcast time-delay of the webpage, example by calling the function of test webpage performance The Performance Timing letters of HTML5 (the 5th material alteration for applying HTML HTML) can such as be called Count to obtain the broadcast time-delay of the webpage, naturally it is also possible to obtain the broadcast time-delay of the webpage by other means, the present invention is real Example is applied not limit this.

Step 304：The video source server obtains the hair of the user terminal for each user terminal in the plurality of user terminal Send delay.

Wherein, the forward delay interval is sent by the plurality of user terminal according to the timestamp on the designated frame received Response message determines to obtain, and that is to say, the response message that the video source server can be sent according to multiple user terminals, it is determined that often The forward delay interval of individual user terminal.

In addition, when the response message that each user terminal is sent is the time change factor, the transmission for obtaining the user terminal is prolonged When process can include：The time change factor of the user terminal is obtained, the time change factor is used to indicate to take from video source Business device sends the system that the designated frame is played to the user terminal between the designated frame and handles delay, and the time change The factor is determined to obtain by the user terminal according to the timestamp on the designated frame received；According to the plurality of user terminal when Between transformation factor, determine the forward delay interval of the user terminal.

Wherein, according to the time change factor of the plurality of user terminal, determine that the process of the forward delay interval of the user terminal can be with Including：It is determined that send the time change factor, the transmission time change factor for the plurality of user terminal the time change factor in most The big time change factor or specified time transformation factor, the specified time transformation factor be more than the maximum time change because Son；Determine the difference between the transmission time change factor and the time change factor of the user terminal；Anaplasia during based on the transmission The difference changed between the factor and the time change factor of the user terminal, determine the forward delay interval of the user terminal.

It that is to say,, can should after the time change factor of the plurality of user terminal is got in the embodiment of the present invention The maximum time change factor is defined as sending the time change factor in the time change factor of multiple user terminals, can also be by greatly It is defined as sending the time change factor in a specified time transformation factor of the maximum time change factor, and then divides The difference between the transmission time change factor and the time change factor of each user terminal is not calculated.

Such as when the plurality of user terminal is 3 user terminals, and the time change factor of 3 user terminals be respectively 6s, When 16s, 26s, the video source server maximum of which time change factor 26s can be defined as send time change because Son, obtain the difference between the transmission time change factor and the time change factor of 3 user terminals be respectively 20s, 10s, 0s；Or the video source server 30s can also be defined as send the time change factor, obtain the transmission time change because Difference between son and the time change factor of 3 user terminals is respectively 24s, 14s, 4s.

Wherein, based on the difference between the transmission time change factor and the time change factor of the user terminal, it is determined that should The process of the forward delay interval of user terminal can include：By the time change factor of the transmission time change factor and the user terminal it Between difference be defined as the forward delay interval of the user terminal；Or the averaging network delay of the user terminal is obtained, by the transmission time Difference between transformation factor and the time change factor of the user terminal is added with the averaging network delay of the user terminal, is obtained To the forward delay interval of the user terminal.

It that is to say, in the embodiment of the present invention, obtaining the time change of the transmission time change factor and each user terminal After difference between the factor, the forward delay interval of each user terminal can be determined by following two modes：

In the first implementation, because network delay is general all smaller, substantially in the range of ms levels, user terminal is integrated The influence of delay is also smaller, therefore in the first way, can ignore the influence of network delay factor, and directly sends this Difference between the time change factor and the time change factor of the user terminal is defined as the forward delay interval of the user terminal.

For example, be based on the example above, when sending between the time change factor of transformation factor and 3 user terminals When difference is respectively 20s, 10s, 0s, then 20s, 10s, 0s can be defined as to the forward delay interval of 3 user terminals.

In second of implementation, in order to further improve accuracy, it can be influenceed in adjustment system processing delay factor On the basis of, the also influence to network delay factor is adjusted, but because network delay is a stochastic variable, therefore can To be adjusted according to averaging network delay to the reproduction time of user terminal.Specifically, the average net of the user terminal can be obtained Network is delayed, by being averaged for the difference between the transmission time change factor and the time change factor of the user terminal and the user terminal Network delay is added, and obtains the forward delay interval of the user terminal.

For example, be based on the example above, when sending between the time change factor of transformation factor and 3 user terminals Difference is respectively 20s, 10s, 0s, and when averaging network delay is respectively 100ms, 150ms, 200ms, then can by difference with it is right The averaging network delay answered is added, and the forward delay interval for obtaining 3 user terminals is respectively 20.1s, 10.15s, 0.2s.

Wherein, also include before obtaining the averaging network delay of the user terminal：Obtain the network delay of the plurality of user terminal； According to video playback mode, the plurality of user terminal is classified, obtains multiple user terminal types；For the plurality of user terminal class Each user terminal type in type, the average value of the network delay for the multiple user terminals for belonging to the user terminal type is defined as this The averaging network delay of user terminal type；By the delay pair of the averaging network of the plurality of user terminal type and the plurality of user terminal type It should be stored in averaging network delay corresponding relation；Correspondingly, obtaining the averaging network delay of the user terminal includes：Determine the use User terminal type belonging to the end of family；User terminal type according to belonging to the user terminal, it is delayed from the averaging network in corresponding relation, Obtain the averaging network delay of the user terminal.

For example, the video source server can obtain multiple user terminals by player client terminal playing live video stream Network delay, and the average value of the network delay of the plurality of user terminal is calculated, as live by player client terminal playing The averaging network delay of the user terminal of video flowing；Or obtain the flat of multiple user terminals that live video stream is played by webpage Equal network delay, and the average value of the network delay of the plurality of user terminal is calculated, play live video stream as by webpage The averaging network delay of user terminal.

Certainly, in order to improve accuracy, the video source server can also obtain the user terminal for each user terminal Multiple network delays, then calculate every kind of user terminal type averaging network delay, the embodiment of the present invention to calculate averaging network The mode of delay does not limit.

Step 305：The video source server sends live regard according to the forward delay interval of the user terminal to user terminal delay Frequency flows, so that the live video stream that the plurality of user terminal plays is synchronous.

, can be respectively according to the forward delay interval of each user terminal in the plurality of user terminal, to right in the embodiment of the present invention The user terminal delay answered sends live video stream so that the plurality of user terminal plays the time delay basic phase of the live video stream Together, it thereby may be ensured that the live video stream that the plurality of user terminal plays can be synchronous.

For example, when the forward delay interval of 3 user terminals is respectively 20s, 10s, 0s, then can be respectively to 3 user terminals Postpone 20s, 10s, 0s and send live video stream, because the time change factor of 3 user terminals is respectively 6s, 16s, 26s, neglect The slightly influence factor of network delay, i.e. aggregate delay time are also respectively substantially 6s, 16s, 26s, and respectively to 3 users After end delay 20s, 10s, 0s send live video stream, 3 user terminals will could all play this after 26s is postponed and live regard Frequency flows, so as to ensure that the synchronization of the live video stream of 3 user terminals broadcastings.

It should be noted is that the embodiment of the present invention is only to be sent from unified video source server to multiple user terminals Illustrated exemplified by live video stream, and in practical application, due to live video stream corresponding to the user terminal of every kind of broadcasting type Processing mode it is different, the interface between video source server is also different accordingly, therefore can also be in video source server After multiple issue source servers are set, each issue source service corresponds to a kind of user terminal for playing type, and in audio video synchronization During, every kind of user terminal for playing type can send the time change factor of determination via corresponding issue source server To video source server, and video source server is after the forward delay interval of each user terminal is determined, can be according to forward delay interval Live video stream is sent to corresponding issue source server delays, or forward delay interval is sent to corresponding issue source service Device, postpone transmission live video stream, the embodiment of the present invention pair to corresponding user terminal according to forward delay interval from issue source server This is not limited.

It can correspond to issue source server 1 for example, participating in Fig. 3 B, PC ends 21, and the time change factor of determination sent out The issue source server 1 is delivered to, to receive the live video stream after the adjustment time of the issue source server 1 transmission；Cellular network Page end 22 be can correspond to issue source server 2, and the time change factor of determination is sent to the issue source server 2, with Receive the live video stream after the adjustment time of the issue source server 2 transmission；PC page ends 23 can correspond to issue source clothes Business device 3, and the time change factor of determination is sent to the issue source server 3, to receive the issue source server 3 transmission Live video stream after adjustment time, so as to ensure that the PC ends 21, the mobile phone web pages end 22 and the PC page ends 23 play straight Broadcasting video flowing can be synchronous.

Further, in order to improve synchronization accuracy, also need to set time each issue source server with video source server, So that the system time of the system time and video source server of each issue source server is consistent.Mode can be with specific pair With reference to above-mentioned associated description, the embodiment of the present invention will not be repeated here.

In summary, current live broadcast system is substantially open cycle system, can not receive user terminal broadcasting feedback, to The information monitoring deficiencies such as the delay of family end reception live video stream, the play quality of audio frequency and video, so that also can not be according to user terminal Broadcast state live effect is adjusted, and in the embodiment of the present invention, user terminal add network test the speed, network pair When, network delay measuring and calculating, video frame time stamp contrast etc. function, so as to user terminal can by indicate system processing delay time Changed factor feeds back the video source server so that video source server can send live video stream to different user terminals When, different delays is set in advance, to ensure that the audio/video information that each user terminal plays can be synchronous.

A kind of video living transmission system of closed loop provided in an embodiment of the present invention, there will be weight in the application of following Internet of Things Meaning, and video synchronization method provided in an embodiment of the present invention are wanted, in Real-Time Scheduling control, information issue are done by audio frequency and video The live video that the heart plays to each user terminal is done in the scenes such as synchronous detection, network direct broadcasting ballot, will be played a significant role.

Need to illustrate on the other hand, the embodiment of the present invention be only with after the response message of multiple user terminals is received, The time that live video stream is sent to the plurality of user terminal is adjusted, to ensure that the plurality of live video stream plays at same time point Video pictures synchronization exemplified by illustrate,, can be with after the response message of multiple user terminals is received and in practical application The time shown where adjusting the frame of video of live video stream on video pictures so that the plurality of user terminal plays the frame of video When, the time shown where the frame of video on video pictures is the system time of each user terminal, to ensure that multiple user terminals exist The time synchronized shown on the live video stream of broadcasting.

For example, so that the response message is the time change factor as an example, ensure live video stream of multiple user terminals in broadcasting The mode of the time synchronized of upper display can include any of in the following manner：

The first implementation：After the time change factor for obtaining the user terminal, shown when in the live video stream During the first system time, first object frame of video, the video where the first object frame of video are obtained from the live video stream The first system time is shown in picture, the first system time is the system time of the video source server and when being standard Between；The first system time is added with the time change factor of the user terminal, obtains the second system time；It will be sent to The first system time shown in video pictures where the first object frame of video of the user terminal replaces with the second system Time.

In this kind of mode, when be sent to shown having time in the frame of video of live video stream of the user terminal when, can So that the time of the display is replaced with into the second system time obtained after the time change factor plus the user terminal so that the use After family termination receives the live video stream, the second system time can be shown on the live video stream of broadcasting, now this The two system time is the system time of the user terminal.

For example, when the time change factor of the user terminal is 10s, ignore network delay, the comprehensive delay of the user terminal As 10s, therefore when video source server is sending live video stream in 10 seconds 30 minutes at 12 points to the user terminal, the live video 12 can be shown on the first object frame of stream：30：10, but because the user terminal has 10s comprehensive delay, therefore the user terminal The first object frame could be played at 12: 20 30:, now still shows 12 on video pictures where the first object frame： 30：10, so as to which the time shown on the live video stream of user terminal broadcasting and the system time of user terminal are inconsistent.

And in the embodiment of the present invention, when sending first object frame to the user terminal within 10 seconds 30 minutes at 12 points, can by this The time shown in video pictures where one target video frame replaces with 12：30：20, so as to the user terminal 12 points 20 seconds 30 minutes When playing the first object frame, the time shown in video pictures where the first object frame is 12：30：20, it ensure that use The system time of time for showing and user terminal is consistent on the live video stream that family end plays.

Second of implementation：After the time change factor for obtaining the user terminal, when not shown in the live video stream When having the first system time, the second target video frame is obtained from the live video stream, the second target video frame is live for this Any frame of video in video flowing, the first system time are the system time of the video source server and are the standard time； When sending the second target video frame to the user terminal, the second target video frame is sent into time and the time of the user terminal Transformation factor is added, and obtains the second system time；Addition should in the second target video frame for be sent to the user terminal The second system time.

In this kind of mode, when be sent to do not show having time in the frame of video of live video stream of the user terminal when, can To add the second system time on the second target video frame to be sent so that the user terminal receives the live video stream Afterwards, the second system time can be shown on the live video stream of broadcasting, now the second system time is the user terminal System time.

It should be noted that under above two mode, in order to ensure the synchronization accuracy of time, it is also necessary to when adjusting display Between before, video source server and each user terminal are set time so that the system time of the video source server and each user terminal It it is the standard time, mode may be referred to above-mentioned associated description at specific pair, and the embodiment of the present invention will not be repeated here.

, can be according to the response message of each user terminal in the plurality of user terminal, to be sent under above two mode Frame of video where time for showing on video pictures be adjusted, thereby may be ensured that the video pictures that each user terminal plays The time of upper display can be consistent with the system time of the user terminal, and then ensure that the plurality of user terminal regarding in broadcasting The temporal information shown on frequency picture can be synchronous, can be shown so as not to same user in synchronization according on video pictures Time set time, improve synchronizing information effect.

In summary, in the embodiment of the present invention, video source server can send live video stream to multiple user terminals During, add timestamp on the designated frame of live video stream so that each user terminal in the plurality of user terminal Response message can be sent to video server according to the timestamp on the designated frame received, so as to the video source service Device can determine the forward delay interval of each user terminal according to the response message that the plurality of user terminal is sent, and respectively according to each The forward delay interval of user terminal sends live video stream to corresponding client delay, to ensure live the regarding of the plurality of user terminal broadcasting Frequency flows synchronous.That is, the video source server can receive the delay of designated frame according to different user end, set respectively Put the delay that live video stream is sent to different user terminals so that the live video stream that different user end plays can be synchronous, So as to solve the problems, such as that the live video stream that different user end plays can not be synchronous, live effect is improved.

Fig. 4 is a kind of video synchronization device block diagram provided in an embodiment of the present invention, and referring to Fig. 4, the device includes：

First add module 401, for multiple user terminals send live video stream during, in live video stream Designated frame on add timestamp, the timestamp is used to indicate transmission time of the designated frame；

First acquisition module 402, for for each user terminal in the plurality of user terminal, obtaining the transmission of the user terminal Delay, the sound that the forward delay interval is sent by the multiple user terminal according to the timestamp on the designated frame received Information is answered to determine to obtain；

Sending module 403, for the forward delay interval according to the user terminal, postpone to send live video stream to the user terminal, So that the live video stream that the plurality of user terminal plays is synchronous.

Alternatively, the sending module 403, including：

Acquiring unit, for obtaining the time change factor of the user terminal, the time change factor be used to indicating from Video source server sends the system processing that the designated frame is played to the user terminal between the designated frame and prolonged When, and the time change factor is determined by the user terminal according to the timestamp on the designated frame received Arrive；

Determining unit, for the time change factor according to the multiple user terminal, determine that the transmission of the user terminal is prolonged When.

Alternatively, the determining unit includes：

First determination subelement, for determining to send the time change factor, the transmission time change factor is the plurality of use The maximum time change factor or specified time transformation factor in the time change factor at family end, the specified time transformation factor More than the maximum time change factor；

Second determination subelement, for determining between the transmission time change factor and the time change factor of the user terminal Difference；

3rd determination subelement, for based between the transmission time change factor and the time change factor of the user terminal Difference, determine the forward delay interval of the user terminal.

Alternatively, the device also includes：

Second acquisition module, for when showing the first system time in the live video stream, from the live video stream It is middle to obtain first object frame of video, the first system time is shown in the video pictures where the first object frame of video, should The first system time is the system time of the video source server and is the standard time；

First computing module, for the first system time to be added with the time change factor of the user terminal, obtain To the second system time；

Replacement module, should for what is shown in video pictures where being sent to the first object frame of video of the user terminal The first system time replaces with the second system time.

3rd acquisition module, for when not showing the first system time in the live video stream, from the live video The second target video frame is obtained in stream, the second target video frame be the live video stream in any frame of video, first system The system time is the system time of the video source server and is the standard time；

Second computing module, for when sending the second target video frame to the user terminal, by second target video The transmission time of frame is added with the time change factor of the user terminal, obtains the second system time；

Second add module, during for adding the second system in the second target video frame for being sent to the user terminal Between.

Fig. 5 is a kind of video synchronization device block diagram provided in an embodiment of the present invention, and referring to Fig. 5, the device includes：

Receiving module 501, the designated frame in live video stream for receiving the transmission of video source server, this is specified Timestamp is added with frame of video, the timestamp is used for the transmission time for indicating the designated frame；

Sending module 502, for according to the timestamp, response message to be sent to the video server.

Alternatively, the sending module 502 includes：

Determining unit, for according to the timestamp, determining the time change factor of user terminal, the time change factor is used for Indicate that sending the designated frame from the video source server plays to the user terminal system processing the designated frame Delay；

Transmitting element, for the time change factor to be sent to the video source server.

Alternatively, the determining unit includes：

First obtains subelement, for when the user terminal is by the player client terminal playing live video stream, obtaining Time indicated by the timestamp；

Second obtains subelement, and for obtaining the reception time of the designated frame, the reception time terminates for the user Receive the system time during designated frame, and the reception time by the user terminal when with the video source server pair after really Surely obtain；

First determination subelement, for by the difference between the time indicated by the reception time and the timestamp, it is determined that For the first reception delay of the user terminal；

3rd obtains subelement, for obtaining the network delay between the user terminal and the video source server；

Second determination subelement, for by the difference between first reception delay and the network delay, being defined as the visitor The time change factor at family end.

Alternatively, the determining unit includes：

4th obtains subelement, for when the user terminal plays the live video stream by webpage, obtaining the timestamp The indicated time；

5th obtains subelement, and for obtaining the reception time of the designated frame, the reception time is that the user terminal exists Receive the standard network time obtained during the designated frame；

3rd determination subelement, for by the difference between the time indicated by the reception time and the timestamp, it is determined that For the first reception delay of the user terminal；

6th obtains subelement, for obtaining the network delay between the user terminal and the video source server；

4th determination subelement, for by the difference between first reception delay and the network delay, being defined as the use Second reception delay at family end；

7th obtains subelement, and the broadcast time-delay of the live video stream is played for obtaining the user terminal by the webpage, The broadcast time-delay be the user terminal by the webpage from receive the designated frame to play the designated frame prolong The slow time；

Computing unit, for second reception delay to be added with the broadcast time-delay, obtain the time of the user terminal Transformation factor.

It should be noted that：Above-described embodiment provide video synchronization device in the live video stream of synchronous user terminal, , can be as needed and by above-mentioned function distribution only with the division progress of above-mentioned each functional module for example, in practical application Completed by different functional modules, i.e., the internal structure of equipment is divided into different functional modules, it is described above to complete All or part of function.In addition, the video synchronization device that above-described embodiment provides belongs to same with video synchronization method embodiment One design, its specific implementation process refer to embodiment of the method, repeated no more here.

Fig. 6 is a kind of server architecture schematic diagram of video synchronization device provided in an embodiment of the present invention.The server can To be the server in background server cluster.Specifically：

Server 600 includes CPU (CPU) 601 including random access memory (RAM) 602 and read-only deposited The system storage 604 of reservoir (ROM) 603, and connection system storage 604 and the system bus of CPU 601 605.Server 600 also includes the basic input/output (I/O of transmission information between each device in help computer System) 606, and the mass-memory unit for storage program area 613, application program 614 and other program modules 615 607。

Basic input/output 606 includes for the display 608 of display information and inputs information for user The input equipment 609 of such as mouse, keyboard etc.Wherein display 608 and input equipment 609 is all by being connected to system bus 605 IOC 610 is connected to CPU 601.Basic input/output 606 can also include defeated Enter o controller 610 for receiving and handling from the defeated of multiple other equipments such as keyboard, mouse or electronic touch pen Enter.Similarly, IOC 610 also provides output to display screen, printer or other kinds of output equipment.

Mass-memory unit 607 is connected by being connected to the bulk memory controller (not shown) of system bus 605 To CPU 601.Mass-memory unit 607 and its associated computer-readable medium provide for server 600 Non-volatile memories.That is, mass-memory unit 607 can include such as hard disk or CD-ROM drive etc Computer-readable medium (not shown).

Without loss of generality, computer-readable medium can include computer-readable storage medium and communication media.Computer stores Medium is included for any of the information such as storage computer-readable instruction, data structure, program module or other data The volatibility and non-volatile, removable and irremovable medium that method or technique is realized.Computer-readable storage medium include RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storages its technologies, CD-ROM, DVD or other optical storages, cassette, magnetic Band, disk storage or other magnetic storage apparatus.Certainly, skilled person will appreciate that computer-readable storage medium is not limited to State several.Above-mentioned system storage 604 and mass-memory unit 607 may be collectively referred to as memory.

According to various embodiments of the present invention, server 600 can also pass through the network connections such as internet to network On remote computer operation.Namely server 600 can be by the NIU 611 that is connected on system bus 605 Network 612 is connected to, in other words, other kinds of network or long-range meter can also be connected to using NIU 611 Calculation machine system (not shown).

Above-mentioned memory also includes one or more than one program, and one or more than one program storage are in storage In device, it is configured to be performed by CPU.One or more than one program bag contain be used for carry out it is provided in an embodiment of the present invention such as The instruction of lower described video synchronization method, including：

According to the forward delay interval of the user terminal, postpone to send live video stream to the user terminal, so that the multiple The live video stream that user terminal plays is synchronous.

Alternatively, the forward delay interval for obtaining the user terminal, including：

The time change factor of the user terminal is obtained, the time change factor is used to indicate to send out from video source server The system for sending the designated frame to be played to the user terminal between the designated frame handles delay, and it is described when anaplasia The factor is changed to determine to obtain according to the timestamp on the designated frame received by the user terminal；

According to the time change factor of the multiple user terminal, the forward delay interval of the user terminal is determined.

Alternatively, the time change factor according to the multiple user terminal, the forward delay interval of the user terminal is determined, Including：

It is determined that send the time change factor, it is described send the time change factor for the multiple user terminal time change because The maximum time change factor or specified time transformation factor in son, the specified time transformation factor are more than described maximum The time change factor；

Based on the difference between the transmission time change factor and the time change factor of the user terminal, it is determined that described The forward delay interval of user terminal.

When showing the first system time in the live video stream, first object is obtained from the live video stream Frame of video, the first system time, the first system are shown in the video pictures where the first object frame of video Time is the system time of the video source server and is the standard time；

The first system time is added with the time change factor of the user terminal, when obtaining second system Between；

First system that will be shown in video pictures where the first object frame of video for being sent to the user terminal The system time replaces with the second system time；

When not showing the first system time in the live video stream, the second mesh is obtained from the live video stream Frame of video is marked, the second target video frame is any frame of video in the live video stream, and the first system time is The system time of the video source server and be the standard time；

When sending the second target video frame to the user terminal, by the transmission time of the second target video frame It is added with the time change factor of the user terminal, obtains the second system time；

Fig. 7 is a kind of terminal structure schematic diagram of video synchronization device provided in an embodiment of the present invention.Referring to Fig. 7, terminal 700 can include communication unit 710, the memory 720 for including one or more computer-readable recording mediums, input Unit 730, display unit 740, sensor 750, voicefrequency circuit 760, WIFI (Wireless Fidelity, Wireless Fidelity) mould Block 770, include the part such as one or the processor 780 of more than one processing core and power supply 790.Art technology Personnel are appreciated that the restriction of the terminal structure shown in Fig. 7 not structure paired terminal, can include more more or less than illustrating Part, either combine some parts or different parts arrangement.Wherein：

Communication unit 710 can be used for receive and send messages or communication process in, the reception and transmission of signal, the communication unit 710 Can be RF (Radio Frequency, radio frequency) circuit, router, modem, etc. network communication equipment.Especially, when When communication unit 710 is RF circuits, after the downlink information of base station is received, transfer at one or more than one processor 780 Reason；In addition, it is sent to base station by up data are related to.Usually as communication unit RF circuits include but is not limited to antenna, At least one amplifier, tuner, one or more oscillators, subscriber identity module (SIM) card, transceiver, coupler, LNA (Low Noise Amplifier, low-noise amplifier), duplexer etc..In addition, communication unit 710 can also be by wireless Communication communicates with network and other equipment.The radio communication can use any communication standard or agreement, include but is not limited to GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet radio service), CDMA (Code Division Multiple Access, code Point multiple access), WCDMA (Wideband Code Division Multiple Access, WCDMA), LTE (Long Term Evolution, Long Term Evolution), Email, SMS (Short Messaging Service, Short Message Service) etc.. Memory 720 can be used for storage software program and module, and processor 780 is stored in the software journey of memory 720 by operation Sequence and module, so as to perform various function application and data processing.Memory 720 can mainly include storing program area and deposit Store up data field, wherein, storing program area can storage program area, the application program needed at least one function (for example broadcast by sound Playing function, image player function etc.) etc.；Storage data field can store uses created data (such as sound according to terminal 700 Frequency evidence, phone directory etc.) etc..In addition, memory 720 can include high-speed random access memory, can also include non-volatile Property memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.Correspondingly, deposit Reservoir 720 can also include Memory Controller, to provide the access of processor 780 and input block 730 to memory 720.

Input block 730 can be used for the numeral or character information for receiving input, and generation is set with user and function Control relevant keyboard, mouse, action bars, optics or the input of trace ball signal.Preferably, input block 730 may include to touch Sensitive surfaces 731 and other input equipments 732.Touch sensitive surface 731, also referred to as touch display screen or Trackpad, collect and use Family on or near it touch operation (such as user using any suitable object or annex such as finger, stylus in touch-sensitive table Operation on face 731 or near touch sensitive surface 731), and corresponding attachment means are driven according to formula set in advance.It is optional , touch sensitive surface 731 may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus detection is used The touch orientation at family, and the signal that touch operation is brought is detected, transmit a signal to touch controller；Touch controller is from touch Touch information is received in detection means, and is converted into contact coordinate, then gives processor 780, and can reception processing device 780 The order sent simultaneously is performed.Furthermore, it is possible to using polytypes such as resistance-type, condenser type, infrared ray and surface acoustic waves Realize touch sensitive surface 731.Except touch sensitive surface 731, input block 730 can also include other input equipments 732.Preferably, Other input equipments 732 can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), One or more in trace ball, mouse, action bars etc..

Display unit 740 can be used for display by the information of user's input or be supplied to the information and terminal 700 of user Various graphical user interface, these graphical user interface can be made up of figure, text, icon, video and its any combination. Display unit 740 may include display panel 741, optionally, can use LCD (Liquid Crystal Display, liquid crystal Show device), the form such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) configure display panel 741.Further, touch sensitive surface 731 can cover display panel 741, when touch sensitive surface 731 detects touching on or near it After touching operation, processor 780 is sent to determine the type of touch event, is followed by subsequent processing type of the device 780 according to touch event Corresponding visual output is provided on display panel 741.Although in the figure 7, touch sensitive surface 731 and display panel 741 are conducts Two independent parts come realize input and input function, but in some embodiments it is possible to by touch sensitive surface 731 with display Panel 741 is integrated and realizes input and output function.

Terminal 700 may also include at least one sensor 750, such as optical sensor, motion sensor and other sensings Device.Optical sensor may include ambient light sensor and proximity transducer, wherein, ambient light sensor can be according to the bright of ambient light Secretly adjust the brightness of display panel 741, proximity transducer can close display panel 741 when terminal 700 is moved in one's ear And/or backlight.As one kind of motion sensor, gravity accelerometer can detect in all directions (generally three axles) and add The size of speed, size and the direction of gravity are can detect that when static, application (such as the horizontal/vertical screen available for identification mobile phone posture Switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；As for terminal 700 The other sensors such as the gyroscope that can also configure, barometer, hygrometer, thermometer, infrared ray sensor, will not be repeated here.

Voicefrequency circuit 760, loudspeaker 761, microphone 762 can provide the COBBAIF between user and terminal 700.Audio Electric signal after the voice data received conversion can be transferred to loudspeaker 761, sound is converted to by loudspeaker 761 by circuit 760 Sound signal exports；On the other hand, the voice signal of collection is converted to electric signal by microphone 762, after being received by voicefrequency circuit 760 Voice data is converted to, then after voice data output processor 780 is handled, it is such as another to be sent to through communication unit 710 Terminal, or voice data is exported to memory 720 further to handle.Voicefrequency circuit 760 is also possible that earplug is inserted Hole, to provide the communication of peripheral hardware earphone and terminal 700.

In order to realize radio communication, wireless communication unit 770 can be configured with the terminal, the wireless communication unit 770 It can be WIFI module.WIFI belongs to short range wireless transmission technology, and terminal 700 can be helped by wireless communication unit 770 User sends and receive e-mail, browses webpage and access streaming video etc., and it has provided the user wireless broadband internet and accessed. Although showing wireless communication unit 770 in figure, but it is understood that, it is simultaneously not belonging to must be configured into for terminal 700, complete It can be omitted as needed in the essential scope for do not change invention entirely.

Processor 780 is the control centre of terminal 700, utilizes various interfaces and each portion of connection whole mobile phone Point, by running or performing the software program and/or module that are stored in memory 720, and call and be stored in memory 720 Interior data, the various functions and processing data of terminal 700 are performed, so as to carry out integral monitoring to mobile phone.Optionally, processor 780 may include one or more processing cores；Preferably, processor 780 can integrate application processor and modem processor, Wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor mainly handles nothing Line communicates.It is understood that above-mentioned modem processor can not also be integrated into processor 780.

Terminal 700 also includes the power supply 790 (such as battery) to all parts power supply, it is preferred that power supply can pass through electricity Management system and processor 780 are logically contiguous, so as to realize management charging, electric discharge and power consumption by power-supply management system The functions such as management.Power supply 760 can also include one or more direct current or AC power, recharging system, power supply event The random component such as barrier detection circuit, power supply changeover device or inverter, power supply status indicator.

Although being not shown, terminal 700 can also include camera, bluetooth module etc., will not be repeated here.

In the present embodiment, terminal also includes one or more than one program, this or more than one journey Sequence is stored in memory, and is configured to by one or more than one computing device, it is one or more than one Program bag contains the instruction for being used for carrying out video synchronization method as described below provided in an embodiment of the present invention, including：

According to the timestamp, response message is sent to the video server.

Alternatively, it is described according to the timestamp, response message is sent to the video server, including：

According to the timestamp, the time change factor of user terminal is determined, the time change factor is for indicating from institute State video source server and send the designated frame to the system processing between the user terminal broadcasting designated frame Delay；

The time change factor is sent to the video source server.

Alternatively, it is described according to the timestamp, the time change factor of user terminal is determined, including：

When the user terminal is by live video stream described in player client terminal playing, obtain indicated by the timestamp Time；

The reception time of the designated frame is obtained, the reception time receives described specify for the user terminal and regarded System time during frequency frame, and it is described reception the time by the user terminal when with the video source server pair after determine Arrive；

By the difference between the time indicated by the reception time and the timestamp, it is defined as the of the user terminal One reception delay；

By the difference between first reception delay and the network delay, it is defined as the time change of the client The factor.

The reception time of the designated frame is obtained, the reception time is that the user terminal is receiving described specify The standard network time obtained during frame of video；

By the difference between first reception delay and the network delay, be defined as the user terminal second receives Delay；

The broadcast time-delay that the user terminal plays the live video stream by the webpage is obtained, the broadcast time-delay is The user terminal is by the webpage from the designated frame is received to when playing the delay the designated frame Between；

Second reception delay is added with the broadcast time-delay, obtain the time change of the user terminal because Son.

The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.

One of ordinary skill in the art will appreciate that hardware can be passed through by realizing all or part of step of above-described embodiment To complete, by program the hardware of correlation can also be instructed to complete, described program can be stored in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only storage, disk or CD etc..

The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and Within principle, any modification, equivalent substitution and improvements made etc., it should be included in the scope of the protection.

Claims

1. a kind of video synchronization method, it is characterised in that methods described includes：

During live video stream is sent to multiple user terminals, the time is added on the designated frame of live video stream Stamp, the timestamp are used for the transmission time for indicating the designated frame；

For each user terminal in the multiple user terminal, obtain the forward delay interval of the user terminal, the forward delay interval by The response message that the multiple user terminal is sent according to the timestamp on the designated frame received determines to obtain；

According to the forward delay interval of the user terminal, postpone to send live video stream to the user terminal, so that the multiple user Hold the live video stream played synchronous.

2. the method as described in claim 1, it is characterised in that the forward delay interval for obtaining the user terminal, including：

The time change factor of the user terminal is obtained, the time change factor is used to indicate to send institute from video source server State the system that designated frame is played to the user terminal between the designated frame and handle delay, and the time change because Son is determined to obtain by the user terminal according to the timestamp on the designated frame received；

3. method as claimed in claim 2, it is characterised in that the time change factor according to the multiple user terminal, The forward delay interval of the user terminal is determined, including：

It is determined that sending the time change factor, the time change factor that sends is in the time change factor of the multiple user terminal The maximum time change factor or specified time transformation factor, the specified time transformation factor is more than the maximum time Transformation factor；

Based on the difference between the transmission time change factor and the time change factor of the user terminal, the user is determined The forward delay interval at end.

4. method as claimed in claim 2, it is characterised in that after the time change factor for obtaining the user terminal, Also include：

When showing the first system time in the live video stream, first object video is obtained from the live video stream Frame, the first system time, the first system time are shown in the video pictures where the first object frame of video System time for the video source server and be the standard time；

During the first system that will be shown in video pictures where the first object frame of video for being sent to the user terminal Between replace with the second system time；

When not showing the first system time in the live video stream, the second target is obtained from the live video stream and is regarded Frequency frame, the second target video frame are any frame of video in the live video stream, and the first system time is described The system time of video source server and be the standard time；

When sending the second target video frame to the user terminal, by the transmission time of the second target video frame and institute The time change factor for stating user terminal is added, and obtains the second system time；

5. a kind of video synchronization method, it is characterised in that methods described includes：

The designated frame in the live video stream that video source server is sent is received, having time is added on the designated frame Stamp, the timestamp are used for the transmission time for indicating the designated frame；

According to the timestamp, response message is sent to the video server.

6. method as claimed in claim 5, it is characterised in that it is described according to the timestamp, sent out to the video server Response message is sent, including：

According to the timestamp, the time change factor of user terminal is determined, the time change factor is used to indicate to regard from described Frequency source server sends the system that the designated frame is played to the user terminal between the designated frame and handles delay；

The time change factor is sent to the video source server.

7. method as claimed in claim 6, it is characterised in that it is described according to the timestamp, determine the when anaplasia of user terminal The factor is changed, including：

When the user terminal is by live video stream described in player client terminal playing, obtain indicated by the timestamp when Between；

The reception time of the designated frame is obtained, the reception time is that the user terminal receives the designated frame When system time, and it is described reception the time by the user terminal when with the video source server pair after determine to obtain；

By the difference between the time indicated by the reception time and the timestamp, be defined as the user terminal first connects Receive delay；

By the difference between first reception delay and the network delay, be defined as the time change of the client because Son.

8. method as claimed in claim 6, it is characterised in that it is described according to the timestamp, determine the when anaplasia of user terminal The factor is changed, including：

The reception time of the designated frame is obtained, the reception time is that the user terminal is receiving the designated The standard network time obtained during frame；

By the difference between first reception delay and the network delay, the second reception for being defined as the user terminal is prolonged When；

The broadcast time-delay that the user terminal plays the live video stream by the webpage is obtained, the broadcast time-delay is described User terminal is by the webpage from the designated frame is received to the time delay played the designated frame；

9. a kind of video synchronization device, it is characterised in that described device includes：

First add module, for multiple user terminals send live video stream during, live video stream specify Timestamp is added in frame of video, the timestamp is used for the transmission time for indicating the designated frame；

First acquisition module, for for each user terminal in the multiple user terminal, obtaining the user terminal forward delay interval, The response that the forward delay interval is sent by the multiple user terminal according to the timestamp on the designated frame received is believed Breath determination obtains；

Sending module, for the forward delay interval according to the user terminal, postpone to send live video stream to the user terminal, so that The live video stream that the multiple user terminal plays is synchronous.

10. method as claimed in claim 9, it is characterised in that the sending module, including：

Acquiring unit, for obtaining the time change factor of the user terminal, the time change factor is used to indicate from video Source server sends the system that the designated frame is played to the user terminal between the designated frame and handles delay, and The time change factor is determined to obtain by the user terminal according to the timestamp on the designated frame received；

Determining unit, for the time change factor according to the multiple user terminal, determine the forward delay interval of the user terminal.

11. device as claimed in claim 10, it is characterised in that the determining unit includes：

First determination subelement, for determining to send the time change factor, the transmission time change factor is the multiple use The maximum time change factor or specified time transformation factor in the time change factor at family end, specified time conversion because Son is more than the maximum time change factor；

12. device as claimed in claim 10, it is characterised in that described device also includes：

Second acquisition module, for when showing the first system time in the live video stream, from the live video stream It is middle to obtain first object frame of video, when showing the first system in the video pictures where the first object frame of video Between, the first system time is the system time of the video source server and is the standard time；

Replacement module, for the institute shown in video pictures where being sent to the first object frame of video of the user terminal Stating the first system time replaces with the second system time；

3rd acquisition module, for when not showing the first system time in the live video stream, from the live video The second target video frame is obtained in stream, the second target video frame is any frame of video in the live video stream, described The first system time is the system time of the video source server and is the standard time；

Second computing module, for when sending the second target video frame to the user terminal, second target to be regarded The transmission time of frequency frame is added with the time change factor of the user terminal, obtains the second system time；

Second add module, for adding the second system in the second target video frame for being sent to the user terminal Time.

13. a kind of video synchronization device, it is characterised in that described device includes：

Receiving module, the designated frame in live video stream for receiving the transmission of video source server, the designated Timestamp is added with frame, the timestamp is used for the transmission time for indicating the designated frame；

14. device as claimed in claim 13, it is characterised in that the sending module includes：

Determining unit, for according to the timestamp, determining the time change factor of user terminal, the time change factor is used for Instruction sends the designated frame to the user terminal broadcasting designated frame from the video source server System processing delay；

15. device as claimed in claim 14, it is characterised in that the determining unit includes：

First obtains subelement, for when the user terminal is by live video stream described in player client terminal playing, obtaining Time indicated by the timestamp；

Second obtains subelement, and for obtaining the reception time of the designated frame, the reception time is the user terminal Receive the system time during designated frame, and the reception time by the user terminal with the video source service Determine to obtain after during device pair；

First determination subelement, for by it is described reception the time and the timestamp indicated by time between difference, it is determined that For the first reception delay of the user terminal；

Second determination subelement, it is described for by the difference between first reception delay and the network delay, being defined as The time change factor of client.

16. device as claimed in claim 14, it is characterised in that the determining unit includes：

4th obtains subelement, for when the user terminal plays the live video stream by webpage, obtaining the time The stamp indicated time；

5th obtains subelement, and for obtaining the reception time of the designated frame, the reception time is the user terminal The standard network time obtained when receiving the designated frame；

3rd determination subelement, for by it is described reception the time and the timestamp indicated by time between difference, it is determined that For the first reception delay of the user terminal；

4th determination subelement, it is described for by the difference between first reception delay and the network delay, being defined as Second reception delay of user terminal；

7th obtains subelement, is prolonged for obtaining the user terminal by the broadcasting of the webpage broadcasting live video stream When, the broadcast time-delay is that the user terminal is regarded by the webpage from the designated frame is received to described specify of broadcasting Time delay between frequency frame；

Computing unit, for second reception delay to be added with the broadcast time-delay, obtain the user terminal when Between transformation factor.