WO2013189435A2

WO2013189435A2 - Processing method, system, and related device based on play state information synchronization

Info

Publication number: WO2013189435A2
Application number: PCT/CN2013/082300
Authority: WO
Inventors: 于涛
Original assignee: 中兴通讯股份有限公司
Priority date: 2012-12-17
Filing date: 2013-08-26
Publication date: 2013-12-27
Also published as: CN103874014A; WO2013189435A3

Abstract

Disclosed is a processing method based on play state information synchronization, comprising: a synchronization server determining play state information reporting frequency parameters according to play state information of synchronization clients, and sending the play state information reporting frequency parameters to the synchronization clients; the synchronization clients adjusting reporting frequencies according to the play state information reporting frequency parameters, and reporting play state information to the synchronization server. Also disclosed are a processing system, a synchronization server, and a synchronization client based on play state information synchronization. By adopting the solutions of the present invention, a synchronization server controls, according to a practical situation, a frequency of reporting play state information of media packet data by a synchronization client, so that in a good synchronization condition, the synchronization client does not need to implement a synchronization process for each piece of media packet data. Therefore, overhead and communication data volume of synchronization processing can be reduced, and resources are saved.

Description

Processing method, system and related device based on synchronization of playing state information

The present invention relates to the field of multimedia communications, and in particular, to a processing method, system, and related apparatus based on synchronization of playback state information. Background technique

With the development of technology and user needs, media terminals based on TV, computer and mobile phones are gradually beginning to realize the integration of services and content. The most typical application scenario is that users can put on-demand content of interactive Internet TV (IPTV). "Copying" to another terminal (such as a mobile phone, tablet) for simultaneous playback, or in other distributed multimedia systems, the same video content needs to be displayed on multiple devices, such as Social TV Content recommendation function.

In practical applications, due to various reasons such as device capability, network status, and clock drift, media packet data inevitably generates delays, jitters, etc. during packet and transmission, resulting in multiple media streams. Lost synchronization, resulting in a bad user experience. Therefore, corresponding measures are needed to eliminate the effects of delays and the like, and to restore synchronization between multiple media streams.

The playback state information synchronization is a commonly used synchronization technology, that is, the media packet data is added with the play status information in time sequence, and the media packet data of the same play status information is simultaneously expressed. Generally, the media sender as the synchronization server will media. The packet data is sent to multiple receivers, and after being processed by the receiver of the synchronization client, the playback status information such as the actual playing time of each media packet data is uploaded to the synchronization server, and the synchronization server compares the actual playing time of the synchronization client, and selects the delay. The largest synchronization client acts as a synchronous reference client, and then sends the actual playback time (ie, reference time information) of the reference client to each synchronization client. Each synchronization client can obtain the playback time difference between itself and the reference client according to the actual playback time of the received reference client, and then perform corresponding processing (such as pause playback, etc.) to achieve the purpose of synchronous display.

The shortcoming of the above-mentioned synchronization method based on the playback state information is that: the synchronization client performs the above-mentioned synchronization process for each media packet data, so that the overhead of reading and writing and synchronization processing of the playback state information and the amount of communication data are large, and resources are wasted. . Moreover, when the playback state reaches the synchronization, the client also needs to continuously report the status information, resulting in waste of resources. Summary of the invention

In view of this, the main objective of the embodiments of the present invention is to provide a processing method, system, and related apparatus based on synchronization of playback state information, which can reduce the overhead of synchronization processing and the amount of communication data, and save resources.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

A processing method based on synchronization of playback state information, comprising:

The synchronization server determines the playback status information reporting frequency parameter according to the playback status information of each synchronization client, and sends the playback status information reporting frequency parameter to each synchronization client; each synchronization client adjusts and reports the frequency parameter according to the playback status information. Frequency, reporting playback status information to the synchronization server.

The playing status information of the synchronization client includes at least one of the following: a current playing time, a playing time offset, and a frequency at which the offset occurs.

The synchronization client adjusts the reporting frequency according to the playback status information reporting frequency parameter: the synchronization client only reports the playback status information of the media packet data whose sequence number is an integer multiple of the playback status information reporting frequency parameter, or synchronizes the client. The time interval between the two reports of the terminal is the frequency parameter reported by the playing state information, or the media parameter data of the frequency parameter is reported by the playing state information between the two reporting times of the synchronization client.

The method further includes: synchronizing the server to set a time difference threshold; After receiving the play status information of the same media packet data reported by each synchronization client, the synchronization server determines, according to the play status information, a client with the largest play delay from the synchronization clients as a reference synchronization client. And comparing the playing time in the playing state information of the reference synchronization client and the non-reference synchronization client, and obtaining a difference;

When the synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and the at least one non-reference synchronization client is not less than the time difference threshold, the reference synchronization client side reference time information is sent to each synchronization client. ;

The non-reference synchronization client performs synchronization processing according to the reference time information.

The synchronization server sets a time difference threshold:

The synchronization server sets a time difference threshold according to at least one of the following: a code rate of the currently playing media, a frame rate, and a dynamic degree of the picture.

The synchronization server sets a time difference threshold of 20 to 100 milliseconds.

The method also includes:

When the synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and the at least one non-reference synchronization client is not less than the time difference threshold, the synchronization server increases or maintains the frequency of reporting the playback status information of the synchronization client;

When the synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and each non-reference synchronization client is less than the time difference threshold, the synchronization server reduces or maintains the frequency of reporting the playback status information of the synchronization client.

The method also includes:

The synchronization server sets a value range for the playback status information reporting frequency parameter by setting a maximum value and a minimum value, where the maximum value indicates the maximum packet data interval or the maximum interval time at which the synchronization client needs to report the playback status information. The minimum value indicates the minimum packet data reporting interval or the minimum interval time at which the synchronization client needs to report the playing status information. The non-reference synchronization client performs synchronization processing according to the reference time information: the non-reference synchronization client acquires a play time difference between itself and the reference synchronization client according to the reference time information, and performs a pause operation according to the play time difference or Slow release operation.

The method also includes:

The synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and each non-reference synchronization client is less than the time difference threshold, and does not send the reference time to each synchronization client.

A synchronization server, comprising: a first determining module and a first sending module; wherein, the first determining module is configured to determine a play status information reporting frequency parameter according to playing state information of each synchronous client;

The first sending module is configured to send the play status information reporting frequency parameter determined by the first determining module to each synchronization client.

The synchronization server further includes: a setting module, a receiving module, a second determining module, a comparing module, a determining module, and a second sending module;

The setting module is configured to set a time difference threshold;

The receiving module is configured to receive playing state information of the same media packet data reported by each synchronization client;

The second determining module is configured to determine, according to the playing state information received by the receiving module, a client with the largest playing delay from each synchronous client as a reference synchronization client;

The comparing module is configured to compare playing time in the playing state information of the reference synchronization client and the non-reference synchronization client, and obtain a difference;

The determining module is configured to determine whether a difference between the playing time in the playing state information of the reference synchronization client and the non-reference synchronization client is smaller than a time difference threshold set by the setting module; the second sending module is configured to be in the The determining module determines that the difference between the playing time in the playing state information of the reference synchronization client and the at least one non-reference synchronization client is not less than When the time difference threshold is described, the playback time of the reference synchronization client side, that is, the reference time information, is sent to each synchronization client.

The setting module is configured to set a time difference threshold according to at least one of the following: a code rate of the current playing media, a frame rate, and a dynamic degree of the picture.

The setting module is configured to set a time difference threshold of 20 to 100 milliseconds.

A synchronization client includes: a first receiving module and a reporting module; wherein

The first receiving module is configured to receive a play status information reporting frequency parameter from the synchronization server;

The reporting module is configured to adjust the reporting frequency according to the playback status information reporting frequency parameter, and report the playing status information to the synchronization server.

The reporting module is configured to report only the playing status information of the media packet data whose sequence number is an integer multiple of the frequency parameter reported by the playing status information, or control the time interval between the two times to be the playing status information. The frequency parameter is reported, or the media parameter data of the frequency parameter is reported by the play status information between the two reports.

The synchronization client further includes: a second receiving module and a synchronization processing module; wherein the second receiving module is configured to receive reference time information from the synchronization server; the synchronization processing module is configured to be configured according to the reference time information Obtaining a play time difference between itself and the reference synchronization client, and performing a pause operation or a slow release operation according to the play time difference.

A processing system based on playback state information synchronization, comprising a synchronization server and at least two synchronization clients; wherein

The synchronization server is the synchronization server described above;

The synchronization client is the synchronization client described above.

The embodiment of the invention provides a method, a system and a related device for processing synchronization based on the playing state information. The synchronization server determines the playing state information reporting frequency parameter according to the playing state information of each synchronous client, and sends the playing state information reporting frequency parameter. For each sync client; Each synchronization client adjusts the reporting frequency according to the playback status information reporting frequency parameter, and reports the playback status information to the synchronization server. According to the solution of the embodiment of the present invention, the synchronization server controls the frequency of the playback status information of the media packet data reported by the synchronization client according to the actual situation, so that when the synchronization status is good, the synchronization client does not need to perform execution on each media packet data. The above-mentioned synchronization process is performed, and the reporting requirement is reduced in the case where the playback synchronization remains stable. Therefore, the overhead of the synchronization processing and the amount of communication data can be reduced, and resources are saved. DRAWINGS

1 is a flowchart of a method for processing synchronization based on playback state information according to an embodiment of the present invention; FIG. 2 is a schematic structural diagram of a synchronization server according to an embodiment of the present invention;

3 is a schematic structural diagram of another synchronization server according to an embodiment of the present invention; FIG. 4 is a schematic structural diagram of a synchronization client according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of another synchronization client according to an embodiment of the present invention; FIG. 6 is a schematic flowchart of Embodiment 1 of the present invention;

7 is a schematic flowchart of Embodiment 2 of the present invention;

FIG. 8 is a schematic flowchart of Embodiment 3 of the present invention. detailed description

In the embodiment of the present invention, the synchronization server determines the playback status information reporting frequency parameter according to the playback status information of each synchronization client, and sends the playback status information reporting frequency parameter to each synchronization client; each synchronization client plays according to the synchronization client. The status information reports the frequency parameter adjustment reporting frequency, and reports the playing status information to the synchronization server.

FIG. 1 is a flowchart of a method for processing synchronization based on playback state information according to an embodiment of the present invention. As shown in FIG. 1, the method includes:

Step 101: The synchronization server determines the playback status information reporting frequency parameter according to the playback status information of each synchronization client, and sends the playback status information reporting frequency parameter to each synchronization client. Account

Here, the play status information may include a current play time, a play time offset, a frequency at which an offset occurs, and the like. If the frequency at which the offset occurs gradually becomes higher, the synchronization server adjusts the reported frequency parameter to improve the reporting frequency of the synchronization client.

Step 102: The synchronization client adjusts the reporting frequency according to the playback status information reporting frequency parameter, and reports the playback status information to the synchronization server.

Here, when the playback time offset between the synchronization client and the reference terminal is gradually increased, the synchronization server adjusts the reporting frequency parameter to improve the frequency of reporting the playback status information of the synchronization client. Conversely, when the offset gradually becomes smaller, reaches a certain value, and can be maintained for a period of time, the synchronization client reporting frequency can be reduced.

Optionally, the playing state information of the synchronization client may include one or more of the following: a current playing time, a playing time offset, and a frequency at which the offset occurs. If the RTP/RTCP protocol is used, the playback status information of the synchronization client may further include: an NTP timestamp that receives the RTP packet, an RTP timestamp that receives the RTP packet, and a playback time of the RTP packet.

Optionally, the synchronization client adjusts the reporting frequency according to the playback status information reporting frequency parameter: the synchronization client only reports the playback status information of the media packet data whose sequence number is an integer multiple of the playback status information reporting frequency parameter, Here, the playback status information reporting frequency parameter is a positive integer; or, the time interval between the two reports of the synchronization client is the playback status information reporting frequency parameter, where the playback status information reporting frequency parameter is a time parameter; or The playback status information reports the frequency parameter media packet data between the two reports of the synchronization client. Here, the playback status information reporting frequency parameter is a positive integer.

For example, the synchronization server may send the play status information reporting frequency parameter to each synchronization client in the following form: The synchronization server uses a positive integer field with a value of N (N>0) in the report of the delivery reference time information to notify the synchronization client. When the sequence number of the media packet data is an integer multiple of N, the play time information of the packet is reported; if the field is empty or 0, the message is continuously sent. Send playback time information of each media packet data. The value of N is adjusted by the synchronization server according to the current playing state information. If the current network state is poor, and the playback time offset between the synchronization client and the reference terminal is gradually increased, the value of N is decreased. Increase the frequency of reporting the playback status information of the synchronization client; otherwise, increase the value of N.

In an embodiment, in order to limit the value of N to be too large or too small, thereby causing data loss or accuracy to achieve the desired effect, it is necessary to limit the value range of N, and then it is necessary to determine a maximum value and a minimum value of N. The maximum and minimum values are generally set according to network conditions, video sync difference, and video frame rate. In general, if N is a positive integer, you can choose a range of 1-100.

In an embodiment, N can also be used to represent a time parameter, that is, N can be a millisecond (ms) unit, for example, N is equal to 200 ms, which is expressed as reporting data once every 200 milliseconds of the synchronization client.

Accordingly, when the range is set, the value of N cannot exceed the range setting value.

Correspondingly, after receiving the reference time information sent by the synchronization server, the synchronization client extracts a field of a positive integer N, and adjusts the frequency of the media packet data playing state information. When the sequence number of the media packet data is an integer multiple of N, The playing status information of the media packet data is reported; if the field is empty or 0, the playing status information of each media packet data is continuously reported.

Optionally, the synchronization server sets a time difference threshold, and the method further includes:

After receiving the play status information of the same media packet data reported by each synchronization client, the synchronization server determines, according to the play status information, a client with the largest play delay from the synchronization clients as a reference synchronization client. And comparing the playing time in the playing state information of the reference synchronization client and the non-reference synchronization client, and obtaining a difference;

The synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and the at least one non-reference synchronization client is not less than the time difference threshold, and sends the playback time of the reference synchronization client side to each synchronization client. That is, the reference time information is determined; determining that the difference between the playback time in the playback status information of the reference synchronization client and each non-reference synchronization client is less than When the time difference threshold is described, the reference time information is not sent to each synchronization client;

Here, when a plurality of synchronization clients play the same media content, if the playback time difference is within the threshold value range, the user does not have a clear feeling of playing out of synchronization, so the synchronization operation may not be performed; if the time difference exceeds the difference threshold, Then you need to perform synchronization processing for each synchronization client. The difference threshold may be dynamically set by the synchronization server according to one or more of the following: one or more of the following: the code rate of the currently played content, the frame rate, the dynamic degree of the picture, and the like are dynamically set. Preferably, the time difference threshold is generally 20-100 milliseconds.

Optionally, the method further includes:

The synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and the at least one non-reference synchronization client is not less than the time difference threshold, and increases or maintains the frequency of reporting the playback status information of the synchronization client;

The synchronization server determines that the difference between the playback time in the playback status information of the reference synchronization client and each non-reference synchronization client is less than the time difference threshold, and reduces or maintains the frequency of reporting the playback status information of the synchronization client.

Optionally, the synchronization server sets a value range for the reporting frequency parameter by setting a maximum value and a minimum value, where the maximum value indicates a maximum packet data interval or a maximum interval time at which the synchronization client needs to report the playback state information. The minimum value indicates the minimum packet data reporting interval or the minimum interval time at which the synchronization client needs to report the playback status information.

Optionally, the non-reference synchronization client performs synchronization processing according to the reference time information: the non-reference synchronization client obtains a play time difference between itself and the reference synchronization client according to the reference time information, according to the play time difference. Perform a pause or slow release operation. Specifically, after receiving the reference time information sent by the synchronization server, the non-reference synchronization client may know the time when the reference synchronization client plays a certain media packet data, and the time is the same as the self-playing The time comparison of a media packet data obtains a difference in play time between itself and the reference synchronization client, and then performs synchronization processing according to the play time difference, including but not limited to pause, slow play, and the like.

It should be noted that, the synchronization server according to the embodiment of the present invention controls the synchronization client to report the frequency by using the playback status information reporting frequency parameter, and the synchronization server can independently apply the scheme for controlling the reference frequency information according to the time difference threshold. Can be combined with the application, can achieve the purpose of reducing the overhead of synchronization processing and communication data, saving resources.

The embodiment of the present invention further provides a synchronization server. As shown in FIG. 2, the synchronization server includes: a first determining module 21 and a first sending module 22;

The first determining module 21 is configured to determine, according to the playing state information of each synchronization client, the playing state information reporting frequency parameter;

The first sending module 22 is configured to send the play status information reporting frequency parameter determined by the first determining module 21 to each synchronization client.

Optionally, as shown in FIG. 3, the synchronization server further includes: a setting module 23, a receiving module 24, a second determining module 25, a comparing module 26, a determining module 27, and a second sending module 28;

The setting module 23 is configured to set a time difference threshold;

The receiving module 24 is configured to receive playing state information of the same media packet data reported by each synchronization client;

The second determining module 25 is configured to determine, according to the playing state information received by the receiving module 24, a client with the largest playing delay from each synchronous client as a reference synchronization client; the comparing module 26, configured Comparing the playing time in the playing state information of the reference synchronization client and the non-reference synchronization client, and obtaining a difference;

The determining module 27 is configured to determine whether a difference between the playing time in the playing state information of the reference synchronization client and the non-reference synchronization client is less than a time difference threshold set by the setting module; The second sending module 28 is configured to: when the determining module 27 determines that the difference between the playing time in the playing state information of the reference synchronization client and the at least one non-reference synchronization client is not less than the time difference threshold, Each synchronization client sends the playback time of the reference synchronization client side, that is, the reference time information.

Optionally, the setting module 23 is specifically configured to set a time difference threshold according to one or more of the following: a code rate of the currently playing media, a frame rate, and a dynamic degree of the picture.

Optionally, the setting module is specifically configured to set a time difference threshold of 20 to 100 milliseconds.

In a practical application, the first determining module, the setting module, the second determining module, the comparing module, and the determining module may be configured by a central processing unit (CPU) and a digital signal in a synchronization server. The processor (DSP, Digital Signal Processor) or a programmable logic array (FPGA) is implemented. The first sending module and the second sending module may be implemented by a transceiver in a synchronization server.

The embodiment of the present invention further provides a synchronization client. As shown in FIG. 4, the synchronization client includes: a first receiving module 41 and a reporting module 42;

The first receiving module 41 is configured to receive a play status information reporting frequency parameter from the synchronization server;

The reporting module 42 is configured to adjust the reporting frequency according to the playback status information reporting frequency parameter, and report the playing status information to the synchronization server.

Optionally, the upper module 42 is configured to report only the playing status information of the media packet data whose sequence number is an integer multiple of the frequency parameter reported by the playing status information, or to control the time interval between the two reporting times. And reporting the frequency parameter for the playing status information, or controlling the playback status information to report the frequency parameter media packet data between the two reporting intervals.

Optionally, as shown in FIG. 5, the synchronization client further includes: a second receiving module 43 and a synchronization processing module 44;

The second receiving module 43 is configured to receive reference time information from the synchronization server; The synchronization processing module 44 is configured to acquire a play time difference between itself and the reference synchronization client according to the reference time information, and perform a pause operation or a slow release operation according to the play time difference.

In actual application, the reporting module and the synchronization processing module may be implemented by a CPU, DSP or FPGA in the synchronization client; the first receiving module and the second receiving module may be implemented by a transceiver in the synchronization client.

The embodiment of the present invention further provides a processing system based on synchronization of playback state information, where the system includes a synchronization server and at least two synchronization clients;

The synchronization server is the synchronization server described above;

The synchronization client is the synchronization client described above.

The technical solution of the present invention will be further described in detail below with reference to specific embodiments.

Embodiment 1

This embodiment describes a scenario in which the synchronization server controls the synchronization client to report the frequency by using the playback state information reporting frequency parameter, and the scenario in which the synchronization server controls the reference frequency information to be delivered according to the time difference threshold. FIG. 6 is a schematic flowchart of the embodiment. As shown in Figure 6, the process includes:

Step 601: The synchronization server sets the time difference threshold.

Step 602: The media server delivers the media packet data to each synchronization client.

Step 603: Each synchronization client plays the media packet data and sends the playback status information to the synchronization server.

Step 604: The synchronization server determines the reference synchronization client, and compares the play time difference between the non-reference synchronization client and the reference synchronization client. If the play time difference exceeds the time difference threshold, step 605 is performed; otherwise, the synchronization server does not send the reference time value. Go back to step 603.

Step 605: The synchronization server delivers the reference time information and the playback status information to report the frequency parameter to the synchronization client. Step 606: The synchronization client adjusts the broadcast time information sending frequency according to the playback status information reporting frequency parameter, and the synchronization client only reports the playback status information of the media packet data whose sequence number meets the reporting frequency parameter, and the non-reference synchronization client according to the The reference time information is described for synchronization adjustment. Go back to step 603.

Embodiment 2

In this embodiment, the synchronization between the two terminals A and B is taken as an example. FIG. 7 is a schematic flowchart of Embodiment 2 of the present invention. As shown in FIG. 7, the process includes:

Step 701: The setting module of the synchronization server sets a time difference threshold according to the current content synchronization condition.

Step 702: Play the media stream.

Step 703: Each synchronization client reports packet playback time information to the synchronization server one by one. Step 704: After receiving the packet playback time information of each synchronization client, the synchronization server finds that the A terminal has the largest delay, and determines that the A terminal is set as the reference terminal.

Step 705: The judging module of the synchronization server determines whether the time difference between the broadcast time of the B terminal and the A terminal reaches the previously set time difference threshold. If not, the synchronization server does not process; if yes, step 706 is performed.

Step 706: The synchronization server sends the reference time information, that is, refers to the play time information of the terminal A terminal, and adds a field with a positive integer N to the reference time information sent by the synchronization client, and informs the synchronization client that the sequence number of the media packet data is When the integer multiple of N is used, the playback time information of the media packet data is reported; if the field is empty or 0, the synchronization client continuously reports the playback time information of each media packet data.

The value of N is adjusted by the synchronization server according to the current synchronization state. If the current network status is poor, and the non-synchronization occurs frequently, N is set to a smaller value; conversely, a larger value can be set.

When the value of N is set to a range, for example, the range of N is (1, 20), then the table It indicates that the playback status information needs to be reported once every 1 packet data, and it needs to be reported once every 20 packet data. The value cannot exceed this set range unless the sync server adjusts this report range.

Step 707: After receiving the reference time information, the B terminal can calculate the play time difference with the reference terminal A terminal, and adjust the play accordingly (including but not limited to pause play, slow play, etc.), and extract the integer N at the same time. The field of the media packet data is reported when the sequence number of the media packet data is an integer multiple of N; if the field is empty or 0, the play time information of each media packet data is continuously reported;

Correspondingly, after receiving the reference time information delivered by the A terminal, the A terminal does not perform synchronization processing because it is itself the reference terminal. At the same time, the field of the integer N is extracted, and the playing time information of the media packet data is reported when the sequence number of the media packet data is an integer multiple of N; if the field is empty or 0, the A terminal continuously reports the playing time of each media packet data. information.

Embodiment 3

FIG. 8 is a schematic flowchart of a third embodiment of the present invention. As shown in FIG. 8, the embodiment is similar to the second embodiment. The difference is that the value of N in this embodiment is a time parameter, for example, when setting When it is 200ms, it means that the data is reported every 200 milliseconds. As shown in Figure 8, the process includes:

Step 801: The setting module of the synchronization server sets a time difference threshold according to the current content synchronization condition.

Step 802: Play the media stream.

Step 803: Each synchronization client reports packet playback time information to the synchronization server one by one. Step 804: After receiving the information of the playback time of the packet reported by each synchronization client, the synchronization server finds that the delay of the A terminal is the largest, and determines that the A terminal is set as the reference terminal.

Step 805: The judging module of the synchronization server determines whether the time difference between the broadcast time of the B terminal and the A terminal reaches the previously set time difference threshold. If not, the synchronization server does not process; if yes, execute Step 806.

Step 806: The synchronization server sends the reference time information, that is, refers to the play time information of the terminal A terminal, and adds a field with a positive integer N to the reference time information, where N represents a time parameter, and the synchronization client is notified to the synchronization client. The time parameter N is used to report the playing time information of each media packet data. If the field is empty or 0, the synchronization client continuously reports the playing time information of each media packet data.

When the value of N is set to a range, for example, the value range of N is (1, 20), it means that the playback status information needs to be reported once every 1 packet data, and the maximum need to report every 20 packet data. once. The value cannot exceed this set range unless the sync server adjusts this report range.

Step 807: After receiving the reference time information, the B terminal can calculate the play time difference with the reference terminal A terminal, and adjust the play accordingly (including but not limited to pause play, slow play, etc.), and extract the integer N at the same time. The field, the parameter N, reports the playback time information of the media packet data; if the field is empty or 0, the playback time information of each media packet data is continuously reported, and the reference time information received by the A terminal is received. After that, since it is itself a reference terminal, it is not synchronized. At the same time, the field of the integer N is extracted, and the playing time information of the media packet data is reported every time parameter N; if the field is empty or 0, the A terminal continuously reports the playing time information of each media packet data.

The embodiment of the invention can reduce the overhead in the synchronization process and improve the synchronization efficiency by controlling the sending and receiving of the synchronization data and the frequency between the synchronization client and the synchronization server.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Range of protection.

Claims

claims

1. A processing method based on playback status information synchronization. The method includes:

The synchronization server determines the playback status information reporting frequency parameter based on the playback status information of each synchronization client, and sends the playback status information reporting frequency parameter to each synchronization client; each synchronization client adjusts the reporting frequency parameter according to the playback status information reporting frequency parameter Frequency, reporting playback status information to the synchronization server.

2. The method according to claim 1, wherein the playback status information of the synchronization client includes at least one of the following: current playback time, playback time offset, and offset occurrence frequency.

3. The method according to claim 1, wherein the synchronization client adjusts the reporting frequency according to the playback status information reporting frequency parameter to: the synchronization client only reports a serial number that is an integer multiple of the playback status information reporting frequency parameter. The playback status information of the media packet data, or, the time interval between the two reports of the synchronization client is the playback status information reporting frequency parameter, or, the interval between the two reports of the synchronization client is the playback status information reporting frequency parameter Parameter media packet data.

4. The method according to claim 1, wherein the method further includes:

The synchronization server sets a time difference threshold;

After receiving the playback status information of the same media packet data reported by each synchronization client, the synchronization server determines the client with the largest playback delay from each synchronization client as the reference synchronization client based on the playback status information. And compare the playback time in the playback status information of the reference synchronization client and the non-reference synchronization client, and obtain the difference;

When the synchronization server determines that the difference in playback time in the playback status information of the reference synchronization client and at least one non-reference synchronization client is not less than the time difference threshold, it sends the reference synchronization client side to each synchronization client. time information;

5. The method according to claim 4, wherein the synchronization server sets a time difference threshold for:

The synchronization server sets the time difference threshold based on at least one of the following: the code rate of the currently played media, the frame rate, and the dynamic degree of the picture.

6. The method according to claim 4, wherein the synchronization server sets the time difference threshold to 20-100 milliseconds.

7. The method according to claim 4, wherein the method further includes:

When the synchronization server determines that the difference in playback time in the playback status information of the reference synchronization client and at least one non-reference synchronization client is not less than the time difference threshold, increase or maintain the frequency of the synchronization client reporting playback status information;

When the synchronization server determines that the difference in playback time in the playback status information of the reference synchronization client and each non-reference synchronization client is less than the time difference threshold, reduce or maintain the frequency of the synchronization client reporting playback status information.

8. The method according to claim 7, wherein the method further includes:

The synchronization server sets a numerical range for the playback status information reporting frequency parameter by setting a maximum value and a minimum value. The maximum value represents the maximum number of packet data intervals or the maximum interval time that the synchronization client needs to report playback status information. , the minimum value represents the minimum number of packet data reporting intervals or the minimum interval time that the synchronization client needs to report playback status information.

9. The method according to claim 4, wherein the synchronization processing performed by the non-reference synchronization client according to the reference time information is: the non-reference synchronization client obtains itself and the reference synchronization client according to the reference time information. The playback time difference between the two terminals is used, and the pause operation or slow playback operation is performed according to the playback time difference.

10. The method according to claim 4, wherein the method further comprises:

The synchronization server determines that the difference in the playback time in the playback status information of the reference synchronization client and each non-reference synchronization client is less than the time difference threshold, and then does not provide the playback time to each synchronization client. Send reference time.

11. A synchronization server, the synchronization server includes: a first determination module and a first sending module; wherein,

The first determination module is configured to determine the playback status information reporting frequency parameter based on the playback status information of each synchronization client;

The first sending module is configured to send the playback status information reporting frequency parameter determined by the first determining module to each synchronization client.

12. The synchronization server according to claim 11, wherein the synchronization server further includes: a setting module, a receiving module, a second determination module, a comparison module, a judgment module and a second sending module; wherein,

The setting module is configured to set the time difference threshold;

The receiving module is configured to receive the playback status information of the same media group data reported by each synchronization client;

The second determination module is configured to determine the client with the largest playback delay from among the synchronization clients as the reference synchronization client based on the playback status information received by the receiving module;

The comparison module is configured to compare the playback time in the playback status information of the reference synchronization client and the non-reference synchronization client, and obtain a difference;

The judgment module is configured to judge whether the difference in playback time in the playback status information of the reference synchronization client and the non-reference synchronization client is less than the time difference threshold set by the setting module; the second sending module is configured to When the determination module determines that the difference in playback time in the playback status information of the reference synchronization client and at least one non-reference synchronization client is not less than the time difference threshold, the reference time of the reference synchronization client side is sent to each synchronization client. information.

13. The synchronization server according to claim 12, wherein,

The setting module is configured to set the time difference threshold based on at least one of the following: the code rate of the currently played media, the frame rate, and the dynamic degree of the picture.

14. The synchronization server according to claim 12, wherein,

The setting module is configured to set the time difference threshold to 20~100 milliseconds.

15. A synchronization client, the synchronization client includes: a first receiving module and a reporting module; wherein,

The first receiving module is configured to receive the playback status information reporting frequency parameter from the synchronization server;

The reporting module is configured to adjust the reporting frequency according to the playback status information reporting frequency parameter, and report the playback status information to the synchronization server.

16. The synchronization client according to claim 15, wherein,

The reporting module is configured to report only the playback status information of media packet data whose serial number is an integer multiple of the playback status information reporting frequency parameter, or to control the time interval between two uploads to be the playback status information. Report the frequency parameter, or control the interval between two reports to report the frequency parameter of the playback status information media packet data.

17. The synchronization client according to claim 15 or 16, wherein the synchronization client further includes: a second receiving module and a synchronization processing module; wherein,

The second receiving module is configured to receive reference time information from the synchronization server; the synchronization processing module is configured to obtain the playback time difference between itself and the reference synchronization client based on the reference time information, and perform a pause based on the playback time difference. operation or slow play operation.

18. A processing system based on playback status information synchronization, the system includes a synchronization server and at least two synchronization clients; wherein,

The synchronization server is the synchronization server described in any one of claims 11 to 14; the synchronization client is the synchronization client described in any one of claims 15 to 17.