CN111131272A

CN111131272A - Scheduling method, device and system of stream server, computing equipment and storage medium

Info

Publication number: CN111131272A
Application number: CN201911376399.2A
Authority: CN
Inventors: 沈水兴
Original assignee: Guangzhou Kugou Computer Technology Co Ltd
Current assignee: Guangzhou Kugou Computer Technology Co Ltd
Priority date: 2019-12-27
Filing date: 2019-12-27
Publication date: 2020-05-08
Anticipated expiration: 2039-12-27
Also published as: CN111131272B

Abstract

The disclosure discloses a scheduling method, a scheduling device and a scheduling system of a streaming server, a computing device and a storage medium, and belongs to the technical field of data processing. The method comprises the following steps: acquiring a first time delay in the process of sending a target data stream to a stream server by a data source terminal; acquiring a second time delay of the playing terminal in the process of acquiring the target data stream from the stream server; and determining a scheduling strategy for scheduling the stream server based on the first time delay and the second time delay. The method and the device enrich the information referred to when the stream server is scheduled, and effectively improve the efficiency of scheduling the stream server.

Description

Scheduling method, device and system of stream server, computing equipment and storage medium

Technical Field

The present disclosure relates to the field of data processing technologies, and in particular, to a method, an apparatus, a system, a computing device, and a storage medium for scheduling a streaming server.

Background

With the development of scientific technology, the application of streaming media technology is more and more extensive. For example, in the live broadcast process, the anchor terminal transmits data of a live broadcast video to the streaming server by using a streaming media technology, and the streaming server transmits the data of the live broadcast video to the playing terminal by using the streaming media technology, so that the audience can watch the live broadcast at the playing terminal. Among them, the streaming media technology is a technology for transmitting audio, video, and multimedia files in a network in a data streaming manner. At present, how to schedule a streaming server for transmitting data streams is an urgent problem to be solved.

Generally, when a playback terminal needs to acquire a data stream, the playback terminal needs to first send a pull request to a streaming server. After receiving the pull request, the streaming server may send the requested data stream to the playback terminal. Accordingly, the implementation process of the related art in scheduling the streaming server includes: the method comprises the steps that a scheduling server obtains the playing time of a playing terminal playing data streams received from a stream server, obtains the sending time of the playing terminal sending a pulling request to the stream server, determines the processing delay of the stream server according to the playing time and the sending time, and then schedules the stream server according to the processing delay.

However, the information referred to in the process of scheduling the streaming server is less, which results in a low efficiency of scheduling the streaming server.

Disclosure of Invention

The embodiment of the disclosure provides a scheduling method, a scheduling device and a scheduling system for a streaming server, a computing device and a storage medium, which can solve the problem of low efficiency of scheduling the streaming server. The technical scheme is as follows:

in a first aspect, an embodiment of the present disclosure provides a scheduling method for a streaming server, which is applied to a scheduling server, and the method includes:

acquiring a first time delay in the process of sending a target data stream to a stream server by a data source terminal;

acquiring a second time delay of the playing terminal in the process of acquiring the target data stream from the stream server;

and determining a scheduling strategy for scheduling the stream server based on the first time delay and the second time delay.

Optionally, before the first time delay in the process of obtaining the data source terminal and sending the target data stream to the stream server, the method further includes:

receiving information for reflecting a first time delay, wherein the information for reflecting the first time delay is obtained based on a first sending time stamp and a first receiving time stamp, the first sending time stamp is used for indicating the time when the data source terminal sends the target data stream to the stream server, and the first receiving time stamp is used for indicating the time when the stream server receives the target data stream;

the acquiring a first time delay in the process of sending the target data stream to the stream server by the data source terminal comprises the following steps:

and determining the first time delay based on the information for reflecting the first time delay.

Optionally, before the obtaining of the second time delay in the process of obtaining the target data stream from the stream server by the play terminal, the method further includes:

receiving information for reflecting a second time delay, wherein the information for reflecting the second time delay is obtained based on a second sending time stamp and a second receiving time stamp, the second sending time stamp is used for indicating the time when the streaming server sends the target data stream to the playing terminal, and the second receiving time stamp is used for indicating the time when the playing terminal receives the target data stream;

the obtaining of the second time delay of the playing terminal in the process of obtaining the target data stream from the streaming server includes:

and determining the second time delay based on the information for reflecting the second time delay.

Optionally, the obtaining a first time delay in the process of sending the target data stream from the data source terminal to the stream server includes:

receiving a data packet carrying the first time delay;

acquiring the first time delay from the data packet carrying the first time delay;

and/or, the obtaining of the second time delay in the process of obtaining the target data stream from the stream server by the playing terminal includes:

receiving a data packet carrying the second time delay;

and acquiring the second time delay from the data packet carrying the second time delay.

In a second aspect, an embodiment of the present disclosure provides a scheduling method for a streaming server, which is applied to a data source terminal, and the method includes:

generating a target data stream;

acquiring address information of a streaming server for transmitting the target data stream to a playing terminal;

and sending the target data stream and a first sending timestamp to the streaming server indicated by the address information so that the streaming server indicated by the address information sends the target data stream to the playing terminal, wherein the first sending timestamp is used for indicating the time when the data source terminal sends the target data stream to the streaming server.

In a third aspect, an embodiment of the present disclosure provides a scheduling method for a streaming server, which is applied to the streaming server, and the method includes:

receiving a target data stream and a first sending timestamp sent by a data source terminal, wherein the first sending timestamp is used for indicating the time when the data source terminal sends the target data stream to the stream server;

determining a first receiving timestamp of the target data stream, wherein the first receiving timestamp is used for indicating the moment when the streaming server receives the target data stream;

after receiving a request sent by a playing terminal for requesting to acquire the target data stream, sending the target data stream, a second sending timestamp and information for reflecting a first time delay to the playing terminal, wherein the first time delay is a time delay in a process of sending the target data stream to the stream server by the data source terminal, the information for reflecting the first time delay is obtained based on the first sending timestamp and the first receiving timestamp, and the second sending timestamp is used for indicating a time when the stream server sends the target data stream to the playing terminal.

Optionally, the information reflecting the first delay is a first delay determined based on the first receiving timestamp and the first sending timestamp;

or, the information for reflecting the first time delay includes: the first receive timestamp and the first transmit timestamp.

In a fourth aspect, an embodiment of the present disclosure provides a scheduling method for a streaming server, which is applied to a play terminal, and the method includes:

sending a request for requesting to acquire a target data stream to a stream server;

receiving the target data stream sent by the stream server, a second sending timestamp and information for reflecting a first time delay, wherein the second sending timestamp is used for indicating the time when the stream server sends the target data stream to the playing terminal, and the first time delay is a time delay in the process that a data source terminal sends the target data stream to the stream server;

determining a second receiving timestamp of the target data stream, where the second receiving timestamp is used for indicating a time when the target data stream is received by the playing terminal;

and sending the information for reflecting the first time delay and the information for reflecting the second time delay to a scheduling server, wherein the second time delay is the time delay of the playing terminal in the process of acquiring the target data stream from the stream server, and the information for reflecting the second time delay is obtained based on the second sending timestamp and the second receiving timestamp.

Optionally, the information reflecting the first time delay is a first time delay determined based on the first receiving time stamp and the first sending time stamp;

or, the information for reflecting the first time delay includes: the first receive timestamp and the first transmit timestamp;

the first sending timestamp is used for indicating a time when the data source terminal sends the target data stream to the streaming server, and the first receiving timestamp is used for indicating a time when the streaming server receives the target data stream.

Optionally, the information for reflecting the second time delay is a second time delay determined based on the second sending time stamp and the second receiving time stamp;

or, the information for reflecting the second time delay includes: the second transmit timestamp and the second receive timestamp.

In a fifth aspect, an embodiment of the present disclosure provides a scheduling apparatus for a streaming server, where the apparatus includes:

the acquisition module is used for acquiring a first time delay in the process that the data source terminal sends the target data stream to the stream server;

the obtaining module is further configured to obtain a second time delay in the process that the playing terminal obtains the target data stream from the stream server;

a determining module, configured to determine a scheduling policy for scheduling the streaming server based on the first delay and the second delay.

Optionally, the apparatus further comprises:

a receiving module, configured to receive information for reflecting a first time delay, where the information for reflecting the first time delay is obtained based on a first sending time stamp and a first receiving time stamp, the first sending time stamp is used to indicate a time when the data source terminal sends the target data stream to the stream server, and the first receiving time stamp is used to indicate a time when the stream server receives the target data stream;

the acquisition module is specifically configured to: and determining the first time delay based on the information for reflecting the first time delay.

Optionally, the receiving module is further configured to receive information for reflecting a second time delay, where the information for reflecting the second time delay is obtained based on a second sending time stamp and a second receiving time stamp, the second sending time stamp is used to indicate a time when the streaming server sends the target data stream to the playback terminal, and the second receiving time stamp is used to indicate a time when the playback terminal receives the target data stream;

the acquisition module is specifically configured to: and determining the second time delay based on the information for reflecting the second time delay.

Optionally, the obtaining module is specifically configured to:

receiving a data packet carrying the first time delay;

and/or the obtaining module is specifically configured to:

receiving a data packet carrying the second time delay;

In a sixth aspect, an embodiment of the present disclosure provides a scheduling apparatus for a streaming server, where the apparatus includes:

a generation module for generating a target data stream;

the acquisition module is used for acquiring address information of a stream server for transmitting the target data stream to a playing terminal;

a sending module, configured to send the target data stream and a first sending timestamp to the stream server indicated by the address information, so that the stream server indicated by the address information sends the target data stream to the playback terminal, where the first sending timestamp is used to indicate a time at which the data source terminal sends the target data stream to the stream server.

In a seventh aspect, an embodiment of the present disclosure provides a scheduling apparatus for a streaming server, where the apparatus includes:

a receiving module, configured to receive a target data stream and a first sending timestamp sent by a data source terminal, where the first sending timestamp is used to indicate a time when the data source terminal sends the target data stream to the stream server;

a determining module, configured to determine a first receiving timestamp of the target data stream, where the first receiving timestamp is used to indicate a time when the streaming server receives the target data stream;

the sending module is configured to send the target data stream, a second sending timestamp, and information for reflecting a first time delay to the play terminal after receiving a request sent by the play terminal to request acquisition of the target data stream, where the first time delay is a time delay in a process of sending the target data stream to the stream server by the data source terminal, the information for reflecting the first time delay is obtained based on the first sending timestamp and the first receiving timestamp, and the second sending timestamp is used to indicate a time when the stream server sends the target data stream to the play terminal.

In an eighth aspect, an embodiment of the present disclosure provides a scheduling apparatus for a streaming server, where the apparatus includes:

the sending module is used for sending a request for requesting to acquire the target data stream to the stream server;

a receiving module, configured to receive the target data stream sent by the streaming server, a second sending timestamp, and information for reflecting a first time delay, where the second sending timestamp is used to indicate a time when the streaming server sends the target data stream to the play terminal, and the first time delay is a time delay in a process of sending the target data stream from a data source terminal to the streaming server;

a determining module, configured to determine a second receiving timestamp of the target data stream, where the second receiving timestamp is used to indicate a time when the playing terminal receives the target data stream;

and the sending module is configured to send the information for reflecting the first time delay and the information for reflecting the second time delay to the scheduling server, where the second time delay is a time delay in a process that the playing terminal acquires the target data stream from the stream server, and the information for reflecting the second time delay is obtained based on the second sending timestamp and the second receiving timestamp.

In a ninth aspect, an embodiment of the present disclosure provides a scheduling system for a streaming server, where the system includes: the scheduling server of the first aspect, the data source terminal of the second aspect, the streaming server of the third aspect, and the playback terminal of the fourth aspect.

In a tenth aspect, the present disclosure provides a computer-readable storage medium, having stored therein instructions, which, when run on a computer, cause the computer to perform the scheduling method of the streaming server of the first aspect, or the scheduling method of the streaming server of the second aspect, or the scheduling method of the streaming server of the third aspect, or the scheduling method of the streaming server of the fourth aspect.

In an eleventh aspect, the present disclosure provides a computing device, including a memory and a processor, where the memory stores a computer program operable on the processor, and the processor, when executing the computer program, implements the scheduling method of the streaming server of the first aspect, or the scheduling method of the streaming server of the second aspect, or the scheduling method of the streaming server of the third aspect, or the scheduling method of the streaming server of the fourth aspect.

The technical scheme provided by the embodiment of the disclosure has the following beneficial effects:

according to the scheduling method, device and system of the stream server, the computing device and the storage medium provided by the embodiment of the disclosure, the first time delay of the target data stream in the transmission process between the data source terminal generating the target data stream and the stream server is obtained through the scheduling server, the second time delay of the target data stream in the transmission process between the stream server and the playing terminal is obtained, and then the stream server is scheduled according to the first time delay and the second time delay.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.

Fig. 1 is a schematic diagram of a scheduling system of a streaming server provided in an embodiment of the present disclosure;

fig. 2 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure;

fig. 3 is a flowchart of another scheduling method for a streaming server according to an embodiment of the present disclosure;

fig. 4 is a flowchart of a scheduling method of a streaming server according to another embodiment of the present disclosure;

fig. 5 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure;

fig. 6 is a flowchart of a scheduling method of a streaming server according to another embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of a scheduling apparatus of a streaming server according to an embodiment of the present disclosure;

fig. 8 is a schematic structural diagram of another scheduling apparatus of a streaming server according to an embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of a scheduling apparatus of a streaming server according to an embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a scheduling apparatus of another streaming server provided in an embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of a server according to an embodiment of the present disclosure.

Detailed Description

To make the objects, technical solutions and advantages of the present disclosure more apparent, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

The embodiment of the disclosure provides a scheduling system of a stream server. Fig. 1 is a schematic structural diagram of a scheduling system of a streaming server provided in an embodiment of the present disclosure. The scheduling system of the streaming server may include: dispatch server 01, streaming server 02, data source terminal 03 and cast terminal 04.

The scheduling server 01 and the streaming server 02 may be a server, a server cluster composed of a plurality of servers, or a cloud computing service center. The data source terminal 03 and the play terminal 04 may be various terminals such as a smart phone, a computer, a multimedia player with a display screen, and a wearable device with a display screen.

Connections can be established between the scheduling server 01 and the data source terminal 03, between the scheduling server 01 and the playing terminal 04, between the data source terminal 03 and the streaming server 02, and between the streaming server 02 and the playing terminal 04 through a wired network or a wireless network. Alternatively, the connection between the scheduling server 01 and the streaming server 02 may be established through a wired network or a wireless network.

The data source terminal 03 may generate a streaming media file by means of recording, shooting, and the like, and send a data stream in the streaming media file to the streaming server 02. After receiving the streaming media file sent by the data source terminal 03, the streaming server 02 may send a data stream in the streaming media file to the play terminal 04. The playing terminal 04 may play or display the streaming media file according to the data stream of the streaming media file sent to it by the streaming server 02. The scheduling server 01 is configured to schedule the streaming server 02 to the data source terminal 03, so that the data source terminal 03 sends the data stream in the generated streaming media file to the streaming server 02.

That is, in the whole process of playing the streaming media file, the data source terminal 03 is a producer of the streaming media file, the streaming server 02 is a carrier of the streaming media file, the playing terminal 04 is a consumer of the streaming media file, and the scheduling server 01 is a scheduler of the streaming server 02. The streaming media files are audio files, video files, multimedia files and other files transmitted in a data streaming mode. The functions of the scheduling server 01, the streaming server 02, the data source terminal 03, and the play terminal 04 will be described in detail in the following method embodiments.

The scheduling system of the streaming server provided by the embodiment of the disclosure is applicable to various scenes. For example, the implementation environment may be applicable to a live scene, in this case, the data source terminal 03 may host a terminal used by a broadcaster, the cast terminal 04 may be a terminal used by a viewer, the streaming server 02 may be a server that sends a live data stream to a terminal used by a viewer in the live scene, and the scheduling server 01 may schedule a server of a streaming server for a terminal used by a broadcaster in the live scene.

In this embodiment, the connection between the scheduling server 01 and the data source terminal 03, the connection between the scheduling server 01 and the playback terminal 04, the connection between the data source terminal 03 and the streaming server 02, and the connection between the streaming server 02 and the playback terminal 04 may be either direct connection or indirect connection. For example, the data source terminal 03 and the streaming server 02 may be communicatively connected through one or more forwarding servers connected in series, in which case, the connection between the data source terminal 03 and the streaming server 02 is an indirect connection. Similarly, the connection between the scheduling server 01 and the data source terminal 03, the connection between the scheduling server 01 and the playing terminal 04, and the connection between the streaming server 02 and the playing terminal 04 may all be implemented by a similar indirect connection manner, which is not specifically limited in the embodiment of the present disclosure.

The embodiment of the disclosure provides a scheduling method of a stream server. Fig. 2 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure, where as shown in fig. 2, the method is applied to a scheduling server, and the method may include:

step 201, acquiring a first time delay in the process of sending the target data stream to the stream server by the data source terminal.

Step 202, acquiring a second time delay in the process that the playing terminal acquires the target data stream from the stream server.

Step 203, determining a scheduling policy for scheduling the streaming server based on the first time delay and the second time delay.

To sum up, in the scheduling method for a streaming server provided in the embodiment of the present disclosure, a first time delay of a target data stream in a transmission process between a data source terminal that generates the target data stream and the streaming server is obtained through a scheduling server, a second time delay of the target data stream in the transmission process between the streaming server and a playing terminal is obtained, and then the streaming server is scheduled according to the first time delay and the second time delay.

The embodiment of the disclosure provides a scheduling method of a stream server. Fig. 3 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure, and as shown in fig. 3, the method is applied to a data source terminal, and the method may include:

step 301, generating a target data stream.

Step 302, obtaining address information of a streaming server for transmitting the target data stream to the playing terminal.

Step 303, sending the target data stream and the first sending timestamp to the streaming server indicated by the address information, so that the streaming server indicated by the address information sends the target data stream to the playing terminal.

The first sending time stamp is used for indicating the time when the data source terminal sends the target data stream to the stream server.

To sum up, according to the scheduling method for a streaming server provided by the embodiment of the present disclosure, a target data stream and a first sending timestamp are sent to the streaming server through a data source terminal, so that a first time delay of the target data stream in a transmission process between the data source terminal and the streaming server can be obtained according to the first sending timestamp, and the streaming server is scheduled according to the first time delay and a second time delay.

The embodiment of the disclosure provides a scheduling method of a stream server. Fig. 4 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure, where as shown in fig. 4, the method is applied to the streaming server, and the method may include:

step 401, receiving a target data stream and a first sending timestamp sent by a data source terminal.

Step 402, determining a first receive timestamp of the target data stream.

Wherein the first receiving timestamp is used for indicating the moment when the target data stream is received by the streaming server.

Step 403, after receiving the request for requesting to acquire the target data stream sent by the play terminal, sending the target data stream, the second sending timestamp, and the information for reflecting the first time delay to the play terminal.

The first time delay is the time delay in the process that the data source terminal sends the target data stream to the stream server. Information reflecting the first time delay is derived based on the first transmit timestamp and the first receive timestamp. The second transmission timestamp is used for indicating the time when the streaming server transmits the target data stream to the play terminal.

To sum up, according to the scheduling method of the stream server provided by the embodiment of the present disclosure, the stream server receives the target data stream and the first sending timestamp sent by the data source terminal, determines the first receiving timestamp of the target data stream, and sends the target data stream, the second sending timestamp, and the information for reflecting the first time delay to the play terminal, so as to conveniently obtain the first time delay according to the information for reflecting the first time delay, obtain the second time delay according to the second sending timestamp, and schedule the stream server according to the first time delay and the second time delay.

The embodiment of the disclosure provides a scheduling method of a stream server. Fig. 5 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure, and as shown in fig. 5, the method is applied to a play terminal, and the method may include:

step 501, sending a request for acquiring a target data stream to a streaming server.

Step 502, receiving a target data stream sent by the streaming server, a second sending timestamp, and information for reflecting the first delay.

The second sending timestamp is used for indicating the moment when the stream server sends the target data stream to the playing terminal, and the first time delay is the time delay in the process that the data source terminal sends the target data stream to the stream server.

Step 503, determining a second receiving time stamp of the target data stream.

And the second receiving time stamp is used for indicating the moment when the playing terminal receives the target data stream from the streaming server.

Step 504, sending information for reflecting the first time delay and information for reflecting the second time delay to the scheduling server.

And the second time delay is the time delay of the playing terminal in the process of acquiring the target data stream from the stream server. The information reflecting the second delay is obtained based on the second transmission time stamp and the second reception time stamp.

To sum up, according to the scheduling method of the streaming server provided by the embodiment of the present disclosure, the target data stream sent by the streaming server, the second sending timestamp, and the information for reflecting the first time delay are received by the play terminal, the second receiving timestamp is determined, and the information for reflecting the first time delay and the information for reflecting the second time delay are sent to the scheduling server, so that the first time delay can be conveniently obtained according to the information for reflecting the first time delay, the second time delay can be conveniently obtained according to the information for reflecting the second time delay, and then the streaming server is scheduled according to the first time delay and the second time delay.

The embodiment of the disclosure provides a scheduling method of a stream server. Fig. 6 is a flowchart of a scheduling method of a streaming server according to an embodiment of the present disclosure, where as shown in fig. 6, the method is applied to a terminal, and the method may include:

step 601, the data source terminal generates a target data stream.

The data source terminal can generate a streaming media file through modes of sound recording, image pickup and the like, and sends a data stream in the streaming media file to the streaming server, so that the streaming server provides the data stream to the playing terminal. The streaming media files are audio files, video files, multimedia files and other files transmitted in a data streaming mode. One or more data streams may be included in the streaming media file, and the target data stream is any data stream in the streaming media file. The manner of dividing the streaming media file into a plurality of data streams may be determined according to application requirements, for example, may be determined according to a rated bandwidth used when the data source terminal sends the data stream to the streaming server.

Step 602, the data source terminal requests the scheduling server to schedule a streaming server for transmitting the target data stream to the play terminal.

The data stream generated by the data source terminal is used for being played by the playing terminal, and the data stream can be transmitted to the playing terminal through the streaming server. Accordingly, the data source terminal may transmit a request to the scheduling server after generating the data stream to request the scheduling server to schedule thereto the streaming server for transmitting the data stream to the cast terminal.

Step 603, the scheduling server schedules the streaming server for the data source terminal and sends the address information of the scheduled streaming server to the data source terminal.

The scheduling server may manage a plurality of streaming servers. After the scheduling server receives the request for scheduling the streaming servers, the scheduling server may schedule the streaming servers according to the load conditions of the streaming servers. Therefore, after receiving a request sent by a data source terminal to schedule a stream server for transmitting a data stream to a playback terminal, the scheduling server may obtain load conditions of a plurality of stream servers managed by the scheduling server, select one stream server from the plurality of stream servers according to a specified scheduling policy, and send address information of the selected stream server to the data source terminal, so that the data source terminal sends the data stream to the stream server and sends the data stream to the playback terminal using the stream server. Alternatively, the address information of the streaming server may be an Internet Protocol (IP) address of the streaming server.

Step 604, the data source terminal sends the target data stream and the first sending timestamp to the streaming server indicated by the address information, so that the streaming server indicated by the address information sends the target data stream to the play terminal.

After receiving the address information of the streaming server scheduled by the scheduling server, the data source terminal may send the target data stream generated by the scheduling server to the streaming server, so that the streaming server can send the target data stream to the playing terminal. Before sending the target data stream to the streaming server, the data source terminal may encode the target data stream, and then send the encoded target data stream to the streaming server.

And the data source terminal may further send a first sending timestamp to the stream server, so as to determine a first time delay in a process that the data source terminal sends the target data stream to the stream server according to the first sending timestamp, and adjust a scheduling policy for the scheduling server to schedule the stream server according to the first time delay. The first sending time stamp is used for indicating the time when the data source terminal sends the target data stream to the stream server. The first time delay is the time delay in the process that the data source terminal sends the target data stream to the stream server.

As an implementation manner of sending the first sending timestamp, the data source terminal may generate a data packet with the first sending timestamp as a sending content according to a specified transmission protocol, and send the data packet carrying the first sending timestamp to the stream server. Wherein the specified transmission protocol can be determined according to application requirements. For example, the specified transmission protocol may be a Real Time Messaging Protocol (RTMP).

Alternatively, a stream pushing application may be installed in the data source terminal, and the data source terminal may transmit the target data stream and the first transmission timestamp to the streaming server indicated by the address information using the stream pushing application. In a live application scenario, the stream pushing application may be a live application used in a live process. The stream pushing refers to that a data source terminal sends a data stream of a streaming media file to a streaming server.

It should be noted that, when the streaming server is not the main body for determining the first time delay, the data source terminal may not send the first sending time stamp to the streaming server, but send the first sending time stamp to another server or a playing terminal in the scheduling system of the streaming server provided in the embodiment of the present disclosure, as long as the first sending time stamp can be sent to the main body for determining the first time delay, which is not specifically limited by the embodiment of the present disclosure. For example, when the scheduling server is used to determine the first time delay, the data source terminal may directly transmit the first transmission timestamp to the scheduling server, so that the scheduling server determines the first time delay according to the first transmission timestamp.

When the data source server transmits the first transmission time stamp to the body for determining the first delay, the address information of the streaming server for receiving the target data stream may be transmitted together to notify the body for determining the first delay of the streaming server for receiving the target data stream transmitted by the data source terminal.

Step 605, after receiving the target data stream and the first sending timestamp sent by the data source terminal, the streaming server determines a first receiving timestamp of the target data stream.

To facilitate determining the first time delay, after receiving the target data stream sent by the data source terminal, the streaming server may determine a first receiving timestamp of the target data stream, where the first receiving timestamp is used to indicate a time when the streaming server receives the target data stream. Optionally, after receiving the target data stream, the streaming server may query a time when the target data stream is received, where the time when the target data stream is received is the first receiving timestamp. And, after receiving the target data stream and the first sending timestamp, the streaming server may store the target data stream and the first sending timestamp for subsequent use.

Step 606, the playing terminal sends a request for requesting to acquire the target data stream to the streaming server.

When a user using the playing terminal needs to watch the streaming media file, a specified operation can be executed in the playing terminal to instruct the playing terminal to play the streaming media file. After the playing terminal receives the specified operation, a request for requesting to acquire the data stream in the streaming media file may be sent to the streaming server, so as to request the streaming server to send the data stream in the streaming media file to the playing terminal.

The request for requesting to acquire the target data stream may be a pull request, where the pull request carries a start time of the data stream required by the play terminal. For example, when the play terminal wants to acquire a data stream starting from the time point 15:15:21, the time point 15:15:21 may be carried with the stream server to request the stream server to send the data stream with the specified size starting from the time point 15:15:21 to the play terminal.

Optionally, a pull stream application may be installed in the playback terminal, and the playback terminal may send a pull request to the streaming server using the pull stream application. In a live application scenario, the pull stream application may be a live viewing application used by a viewer during a live session. The stream pulling refers to that the playing terminal acquires a data stream of the streaming media file from the streaming server.

Step 607, after receiving the request for requesting to acquire the target data stream sent by the playing terminal, the streaming server sends the target data stream, the second sending timestamp and information for reflecting the first time delay to the playing terminal, where the information for reflecting the first time delay is information obtained based on the first sending timestamp and the first receiving timestamp.

The stream server may send the target data stream to the play terminal after receiving a request for requesting to acquire the target data stream sent by the play terminal. And, in order to facilitate the determination of the first delay and the second delay, the streaming server may further transmit a second transmission timestamp and information reflecting the first delay to the cast terminal.

And the second time delay is the time delay of the playing terminal in the process of acquiring the target data stream from the stream server. The second sending timestamp is used to indicate a time when the streaming server sends the target data stream to the playback terminal, or the second sending timestamp may also be a time when the streaming server receives a request for requesting to acquire the target data stream, where the request is sent by the playback terminal.

In a first implementation of the information reflecting the first latency, the information reflecting the first latency may be the first latency determined based on the first receive timestamp and the first transmit timestamp. For example, the information reflecting the first latency may be a difference between the first reception timestamp and the first transmission timestamp. In a second implementation of the information for reflecting the first delay, the information for reflecting the first delay includes: a first receive timestamp and a first transmit timestamp.

As an implementation manner for sending the second sending timestamp and the information for reflecting the first delay, the stream server may generate a data packet for the sending content according to a specified transmission protocol by using the second sending timestamp and the information for reflecting the first delay, and send the data packet carrying the second sending timestamp and the information for reflecting the first delay to the play terminal. Wherein the specified transmission protocol can be determined according to application requirements. For example, the specified transport protocol may be RTMP.

In the live broadcasting process, since the generation process of the first streaming media file and the playing process of the streaming media by the playing terminal are performed synchronously, the second sending timestamp may be the time when the streaming server receives the target data stream sent by the data source terminal, that is, the second sending timestamp may be equal to the first receiving timestamp.

It should be noted that, when the play terminal is not a main body for determining the first delay and the second delay, the streaming server may not send the second sending timestamp and the information for reflecting the first delay to the play terminal, but send the second sending timestamp and the information for reflecting the first delay to other servers in the scheduling system of the streaming server provided in the embodiment of the present disclosure, as long as the second sending timestamp can be sent to the main body for determining the second delay, and the information for reflecting the first delay can be sent to the main body for determining the first delay, which is not specifically limited in the embodiment of the present disclosure. For example, when the scheduling server is configured to determine the first delay and the second delay, the streaming server may directly transmit the second transmission timestamp and the information for reflecting the first delay to the scheduling server, so that the scheduling server determines the second delay according to the second transmission timestamp and determines the first delay according to the information for reflecting the first delay.

When the streaming server transmits the information for reflecting the first delay to the body for determining the first delay and transmits the second transmission timestamp to the body for determining the second delay, the address information of the streaming server for receiving the target data stream may be transmitted together to notify the body for determining the first delay and the streaming server for receiving the target data stream transmitted by the data source terminal to the body for determining the second delay.

In addition, the streaming server may also determine the first time delay directly according to the first sending time stamp and the first receiving time stamp, and directly send the first time delay to the scheduling server. Or, after determining the first delay, the streaming server may also send the first delay to the play terminal, and send the first delay to the scheduling server through the play terminal.

Step 608, after the playing terminal receives the target data stream, the second sending timestamp, and the information for reflecting the first time delay, the playing terminal plays the target data stream, and determines a second receiving timestamp of the target data stream.

After receiving the target data stream, the playing terminal can play the target data stream in the playing terminal, so that a user using the playing terminal can watch the streaming media file to which the target data stream belongs.

In order to determine the second delay, after receiving the target data stream, the playback terminal may further determine a second receiving timestamp, where the second receiving timestamp is used to indicate a time when the playback terminal receives the target data stream from the streaming server. Optionally, after receiving the target data stream, the play terminal may query a time when the target data stream is received, where the time when the target data stream is received is the second receiving timestamp. And, after receiving the target data stream and the second transmission timestamp, the streaming server may store the target data stream and the second transmission timestamp for subsequent use.

Step 609, the playing terminal sends information for reflecting the first time delay and information for reflecting the second time delay to the scheduling server, wherein the information for reflecting the second time delay is information obtained based on the second sending time stamp and the second receiving time stamp.

In order to facilitate the scheduling server to determine the first delay and the second delay, the cast terminal may send information reflecting the first delay and information reflecting the second delay to the scheduling server.

In a first implementation of the information for reflecting the second delay, the information for reflecting the second delay may be the second delay determined based on the second sending timestamp and the second receiving timestamp. For example, the information reflecting the second delay may be a difference between the second reception time stamp and the second transmission time stamp. In a first implementation, the information reflecting the second delay may include: a second transmit timestamp and a second receive timestamp.

As an implementation manner for sending the information for reflecting the first delay and the information for reflecting the second delay, the playing terminal may generate a data packet for sending the information for reflecting the first delay and the information for reflecting the second delay according to a specified transmission protocol, and send the data packet carrying the information for reflecting the first delay and the information for reflecting the second delay to the playing terminal. Wherein the specified transmission protocol can be determined according to application requirements. For example, the specified transport protocol may be RTMP.

Step 610, the scheduling server obtains the first time delay in the process of sending the target data stream to the stream server by the data source terminal based on the information for reflecting the first time delay.

Corresponding to the first implementation manner of the information for reflecting the first delay provided in step 607, when the information for reflecting the first delay is the first delay determined based on the first receiving timestamp and the first transmitting timestamp, the scheduling server may directly determine the information for reflecting the first delay as the first delay.

Corresponding to the second implementation of the information for reflecting the first latency provided in step 607, when the information for reflecting the first latency includes the first receiving timestamp and the first transmitting timestamp, the scheduling server may determine a difference between the first receiving stream timestamp and the first transmitting timestamp as the first latency.

Step 611, the scheduling server obtains the second time delay in the process that the playing terminal obtains the target data stream from the stream server based on the information for reflecting the second time delay.

Corresponding to the first implementation manner of the information for reflecting the second delay provided in step 609, when the information for reflecting the second delay is the second delay determined based on the second sending timestamp and the second receiving timestamp, the scheduling server may directly determine the information for reflecting the second delay as the second delay.

Corresponding to the second implementation of the information for reflecting the second delay provided in step 609, when the information for reflecting the second delay includes a second sending timestamp and a second receiving timestamp, the scheduling server may determine a difference between the second receiving stream timestamp and the second sending timestamp as the second delay.

It should be noted that, in step 610 and step 611, the scheduling server may determine the first delay and the second delay by using a big data technique, so as to improve the efficiency of determining the first delay and the second delay. For example, a Spark calculation engine may be employed to determine the first delay and the second delay.

Step 612, the scheduling server determines a scheduling policy for the streaming server based on the first time delay and the second time delay.

Because the first time delay is the time delay in the process of sending the target data stream to the stream server by the data source terminal, the first time delay reflects the load of the stream server receiving the target data stream, when the first time delay is longer, the load of the stream server receiving the data stream is larger, and at this time, the scheduling server can adjust the scheduling strategy for scheduling the stream server. For example, when the scheduling server needs to schedule the streaming server to the data source terminal, the scheduling of the six servers may be reduced, so as to reduce the load of the streaming server for receiving the data stream, further reduce the delay of playing the data stream, and improve the playing experience of the user.

Correspondingly, the second time delay is the time delay in the process that the playing terminal acquires the target data stream from the streaming server, the second time delay reflects the load of the streaming server for sending the target data stream to the playing terminal, when the second time delay is larger, the load of the streaming server for sending the data stream is larger, and at this time, the scheduling server can adjust the scheduling strategy for scheduling the streaming server. For example, when the scheduling server needs to schedule the streaming server to the playing terminal, the scheduling for the six servers may be reduced, so as to reduce the load of the streaming server for sending the data stream, further reduce the delay of playing the data stream, and improve the playing experience of the user.

And when at least one of the first delay and the second delay is larger, the scheduling server can also send alarm information to the manager to prompt the manager to maintain the streaming server.

It should be noted that, the scheduling policy that the scheduling server adjusts according to the first delay and the second delay in the foregoing description is only used for illustration, and is not used to limit the embodiment of the present disclosure. In practical applications, the specific implementation manner of the scheduling policy may be adjusted according to application requirements.

It should be noted that the sequence of the steps of the scheduling method for the streaming server provided in the embodiment of the present disclosure may be appropriately adjusted, and the steps may also be correspondingly increased or decreased according to the situation. Any method that can be easily conceived by those skilled in the art within the technical scope of the present disclosure is covered by the protection scope of the present disclosure, and thus, the detailed description thereof is omitted.

The embodiment of the present disclosure provides a scheduling apparatus of a streaming server, and as shown in fig. 7, the scheduling apparatus 70 of the streaming server may include:

the obtaining module 701 is configured to obtain a first time delay in a process that a data source terminal sends a target data stream to a stream server.

The obtaining module 701 is further configured to obtain a second time delay in the process that the playing terminal obtains the target data stream from the stream server.

A determining module 702 is configured to determine a scheduling policy for scheduling the streaming server based on the first delay and the second delay.

Optionally, as shown in fig. 7, the scheduling apparatus 70 of the streaming server further includes:

the receiving module 703 is configured to receive information used for reflecting the first time delay, where the information used for reflecting the first time delay is obtained based on a first sending time stamp and a first receiving time stamp, the first sending time stamp is used to indicate a time when the data source terminal sends the target data stream to the stream server, and the first receiving time stamp is used to indicate a time when the stream server receives the target data stream.

The obtaining module 701 is specifically configured to: the first time delay is determined based on information reflecting the first time delay.

Optionally, the receiving module 703 is further configured to receive information for reflecting the second time delay, where the information for reflecting the second time delay is obtained based on a second sending time stamp and a second receiving time stamp, the second sending time stamp is used to indicate a time when the streaming server sends the target data stream to the playback terminal, and the second receiving time stamp is used to indicate a time when the playback terminal receives the target data stream.

The obtaining module 701 is specifically configured to: the second delay is determined based on the information reflecting the second delay.

Optionally, the obtaining module 701 is specifically configured to:

and receiving a data packet carrying a first time delay.

And acquiring the first time delay from the data packet carrying the first time delay.

And/or, the obtaining module 701 is specifically configured to:

and receiving the data packet carrying the second time delay.

To sum up, in the scheduling apparatus for a streaming server provided in the embodiment of the present disclosure, the obtaining module obtains a first time delay of a target data stream in a transmission process between a data source terminal that generates the target data stream and the streaming server, and obtains a second time delay of the target data stream in the transmission process between the streaming server and a playing terminal, and the determining module schedules the streaming server according to the first time delay and the second time delay.

The embodiment of the present disclosure provides a scheduling apparatus of a streaming server, and as shown in fig. 8, the scheduling apparatus 80 of the streaming server may include:

a generating module 801, configured to generate a target data stream.

An obtaining module 802, configured to obtain address information of a streaming server for transmitting the target data stream to the playback terminal.

A sending module 803, configured to send the target data stream and a first sending timestamp to the streaming server indicated by the address information, so that the streaming server indicated by the address information sends the target data stream to the playback terminal, where the first sending timestamp is used to indicate a time when the data source terminal sends the target data stream to the streaming server.

To sum up, the scheduling apparatus for a streaming server according to the embodiment of the present disclosure sends a target data stream and a first sending timestamp to the streaming server through a sending module, so that a first time delay of the target data stream in a transmission process between a data source terminal and the streaming server can be obtained according to the first sending timestamp, so as to schedule the streaming server according to the first time delay and a second time delay.

An embodiment of the present disclosure provides a scheduling apparatus of a streaming server, and as shown in fig. 9, the scheduling apparatus 90 of the streaming server may include:

a receiving module 901, configured to receive a target data stream sent by a data source terminal and a first sending timestamp, where the first sending timestamp is used to indicate a time when the data source terminal sends the target data stream to a stream server.

A determining module 902 is configured to determine a first receiving timestamp of the target data stream, where the first receiving timestamp is used to indicate a time when the streaming server receives the target data stream.

A sending module 903, configured to send, after receiving a request for requesting to acquire a target data stream sent by a play terminal, the target data stream, a second sending timestamp, and information for reflecting a first time delay to the play terminal, where the first time delay is a time delay in a process of sending the target data stream to a stream server by a data source terminal, the information for reflecting the first time delay is obtained based on the first sending timestamp and the first receiving timestamp, and the second sending timestamp is used for indicating a time when the stream server sends the target data stream to the play terminal.

Optionally, the information reflecting the first latency is a first latency determined based on the first receive timestamp and the first transmit timestamp.

Or, the information for reflecting the first time delay includes: a first receive timestamp and a first transmit timestamp.

To sum up, the scheduling apparatus for a streaming server provided in the embodiment of the present disclosure receives a target data stream and a first sending timestamp sent by a data source terminal through a receiving module, where the determining module determines the first receiving timestamp of the target data stream, and the sending module sends the target data stream, a second sending timestamp and information for reflecting a first time delay to a playing terminal, so as to obtain the first time delay according to the information for reflecting the first time delay, obtain a second time delay according to the second sending timestamp, and schedule the streaming server according to the first time delay and the second time delay.

An embodiment of the present disclosure provides a scheduling apparatus of a streaming server, and as shown in fig. 10, the scheduling apparatus 100 of the streaming server may include:

a sending module 1001, configured to send a request for requesting to obtain a target data stream to a stream server.

The receiving module 1002 is configured to receive a target data stream sent by a stream server, a second sending timestamp, and information for reflecting a first time delay, where the second sending timestamp is used to indicate a time when the stream server sends the target data stream to a playing terminal, and the first time delay is a time delay in a process that a data source terminal sends the target data stream to the stream server.

A determining module 1003, configured to determine a second receiving timestamp of the target data stream, where the second receiving timestamp is used to indicate a time when the playing terminal receives the target data stream.

A sending module 1001, configured to send, to the scheduling server, information used for reflecting the first time delay and information used for reflecting a second time delay, where the second time delay is a time delay in a process in which the playing terminal acquires the target data stream from the stream server, and the information used for reflecting the second time delay is obtained based on a second sending timestamp and a second receiving timestamp.

The first sending timestamp is used for indicating the time when the data source terminal sends the target data stream to the stream server, and the first receiving timestamp is used for indicating the time when the stream server receives the target data stream.

Optionally, the information for reflecting the second delay is a second delay determined based on the second transmission timestamp and the second reception timestamp.

Or, the information for reflecting the second time delay includes: a second transmit timestamp and a second receive timestamp.

To sum up, the scheduling apparatus for a streaming server provided in the embodiment of the present disclosure receives, by a receiving module, a target data stream sent by the streaming server, a second sending timestamp, and information for reflecting a first time delay, where a determining module determines the second receiving timestamp, and a sending module sends, to the scheduling server, the information for reflecting the first time delay and the information for reflecting a second time delay, so as to conveniently obtain the first time delay according to the information for reflecting the first time delay, obtain the second time delay according to the information for reflecting the second time delay, and schedule the streaming server according to the first time delay and the second time delay.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Embodiments of the present disclosure also provide a computer-readable storage medium, which may be a non-volatile computer-readable storage medium. The computer-readable storage medium has stored therein instructions, which when run on a computer, cause the computer to execute the scheduling method of the streaming server provided by the above-described method embodiment. For example, the scheduling method of the streaming server shown in any one of fig. 2 to 6 is performed.

The embodiment of the present disclosure further provides a computing device, which includes a memory and a processor, where the memory stores a computer program that can be run on the processor, and when the processor executes the computer program, the scheduling method of the streaming server provided in the foregoing method embodiment is implemented.

Alternatively, the computing device may be a terminal. For example, the terminal may be a play terminal or a data source terminal in the embodiments of the present disclosure. Fig. 11 shows a block diagram of a terminal 1100 according to an exemplary embodiment of the present disclosure. The terminal 1100 may be a portable mobile terminal such as: a smart phone, a tablet computer, an MP3 player (Moving Picture experts Group Audio Layer III, motion video experts compression standard Audio Layer 3), an MP4 player (Moving Picture experts Group Audio Layer IV, motion video experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 1100 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, and so forth.

In general, terminal 1100 includes: a processor 1101 and a memory 1102.

Processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1101 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 1101 may also include a main processor, which is a processor for processing data in an awake state, and a coprocessor, which is also called a Central Processing Unit (CPU). A coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit) that is responsible for rendering and drawing the content that the display screen needs to display. In some embodiments, the processor 1101 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.

Memory 1102 may include one or more computer-readable storage media, which may be non-transitory. Memory 1102 can also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer readable storage medium in the memory 1102 is used to store at least one instruction for execution by the processor 1101 to implement the scheduling method of the streaming server provided by the method embodiments in the present disclosure.

In some embodiments, the terminal 1100 may further include: a peripheral interface 1103 and at least one peripheral. The processor 1101, memory 1102 and peripheral interface 1103 may be connected by a bus or signal lines. Various peripheral devices may be connected to the peripheral interface 1103 by buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1104, display screen 1105, camera assembly 1106, audio circuitry 1107, positioning assembly 1108, and power supply 1109.

The peripheral interface 1103 may be used to connect at least one peripheral associated with I/O (Input/Output) to the processor 1101 and the memory 1102. In some embodiments, the processor 1101, memory 1102, and peripheral interface 1103 are integrated on the same chip or circuit board. In some other embodiments, any one or two of the processor 1101, the memory 1102 and the peripheral device interface 1103 may be implemented on separate chips or circuit boards, which is not limited by this embodiment.

The Radio Frequency circuit 1104 is used to receive and transmit RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuit 1104 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1104 converts an electric signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electric signal. Optionally, the radio frequency circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1104 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: the world wide web, metropolitan area networks, intranets, generations of mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuit 1104 may also include NFC (Near Field Communication) related circuits, which are not limited by this disclosure.

The display screen 1105 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1105 is a touch display screen, the display screen 1105 also has the ability to capture touch signals on or over the surface of the display screen 1105. The touch signal may be input to the processor 1101 as a control signal for processing. At this point, the display screen 1105 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display 1105 can be one, providing a front panel of terminal 1100. In other embodiments, display 1105 can be at least two, each disposed on a different surface of terminal 1100 or in a folded design. In still other embodiments, display 1105 can be a flexible display disposed on a curved surface or on a folded surface of terminal 1100. Even further, the display screen 1105 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The Display screen 1105 may be an LCD (Liquid Crystal Display) Display screen or an OLED (Organic Light-emitting diode) Display screen.

Camera assembly 1106 is used to capture images or video. Optionally, camera assembly 1106 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 1106 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

The audio circuitry 1107 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1101 for processing or inputting the electric signals to the radio frequency circuit 1104 to achieve voice communication. For stereo capture or noise reduction purposes, multiple microphones may be provided, each at a different location of terminal 1100. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 1101 or the radio frequency circuit 1104 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 1107 may also include a headphone jack.

Positioning component 1108 is used to locate the current geographic position of terminal 1100 for purposes of navigation or LBS (location based Service). The positioning component 1108 may be a positioning component based on the GPS (global positioning System) in the united states, the beidou System in china, or the galileo System in russia.

Power supply 1109 is configured to provide power to various components within terminal 1100. The power supply 1109 may be alternating current, direct current, disposable or rechargeable. When the power supply 1109 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, terminal 1100 can also include one or more sensors 1110. The one or more sensors 1110 include, but are not limited to: acceleration sensor 1111, gyro sensor 1112, pressure sensor 1113, fingerprint sensor 1114, optical sensor 1115, and proximity sensor 1116.

Acceleration sensor 1111 may detect acceleration levels in three coordinate axes of a coordinate system established with terminal 1100. For example, the acceleration sensor 1111 may be configured to detect components of the gravitational acceleration in three coordinate axes. The processor 1101 may control the touch display screen 1105 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1111. The acceleration sensor 1111 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 1112 may detect a body direction and a rotation angle of the terminal 1100, and the gyro sensor 1112 may cooperate with the acceleration sensor 1111 to acquire a 3D motion of the user with respect to the terminal 1100. From the data collected by gyroscope sensor 1112, processor 1101 may implement the following functions: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

Pressure sensor 1113 may be disposed on a side bezel of terminal 1100 and/or on an underlying layer of touch display screen 1105. When the pressure sensor 1113 is disposed on the side frame of the terminal 1100, the holding signal of the terminal 1100 from the user can be detected, and the processor 1101 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1113. When the pressure sensor 1113 is disposed at the lower layer of the touch display screen 1105, the processor 1101 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 1105. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 1114 is configured to collect a fingerprint of the user, and the processor 1101 identifies the user according to the fingerprint collected by the fingerprint sensor 1114, or the fingerprint sensor 1114 identifies the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the user is authorized by the processor 1101 to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. Fingerprint sensor 1114 may be disposed on the front, back, or side of terminal 1100. When a physical button or vendor Logo is provided on the terminal 1100, the fingerprint sensor 1114 may be integrated with the physical button or vendor Logo.

Optical sensor 1115 is used to collect ambient light intensity. In one embodiment, the processor 1101 may control the display brightness of the touch display screen 1105 based on the ambient light intensity collected by the optical sensor 1115. Specifically, when the ambient light intensity is high, the display luminance of the touch display screen 1105 is adjusted high. When the ambient light intensity is low, the display brightness of the touch display screen 1105 is turned down. In another embodiment, processor 1101 may also dynamically adjust the shooting parameters of camera assembly 1106 based on the ambient light intensity collected by optical sensor 1115.

Proximity sensor 1116, also referred to as a distance sensor, is typically disposed on a front panel of terminal 1100. Proximity sensor 1116 is used to capture the distance between the user and the front face of terminal 1100. In one embodiment, the touch display screen 1105 is controlled by the processor 1101 to switch from a bright screen state to a dark screen state when the proximity sensor 1116 detects that the distance between the user and the front face of the terminal 1100 is gradually decreasing. When the proximity sensor 1116 detects that the distance between the user and the front face of the terminal 1100 becomes gradually larger, the touch display screen 1105 is controlled by the processor 1101 to switch from a breath-screen state to a bright-screen state.

Those skilled in the art will appreciate that the configuration shown in fig. 11 does not constitute a limitation of terminal 1100, and may include more or fewer components than those shown, or may combine certain components, or may employ a different arrangement of components.

Alternatively, the computing device may be a server. For example, a streaming server or a number scheduling server in embodiments of the present disclosure may be used. Fig. 12 is a schematic diagram illustrating a configuration of a server according to an example embodiment. The server 1200 includes a Central Processing Unit (CPU)1201, a system memory 1204 including a Random Access Memory (RAM)1202 and a Read Only Memory (ROM)1203, and a system bus 1205 connecting the system memory 1204 and the central processing unit 1201. The server 1200 also includes a basic input/output system (I/O system) 1206, which facilitates transfer of information between devices within the computer, and a mass storage device 1207 for storing an operating system 1213, application programs 1214, and other program modules 1215.

The basic input/output system 1206 includes a display 1208 for displaying information and an input device 1209, such as a mouse, keyboard, etc., for user input of information. Wherein a display 1208 and an input device 1209 are connected to the central processing unit 1201 through an input-output controller 1210 coupled to the system bus 1205. The basic input/output system 1206 may also include an input/output controller 1210 for receiving and processing input from a number of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input-output controller 1210 also provides output to a display screen, a printer, or other type of output device.

The mass storage device 1207 is connected to the central processing unit 1201 through a mass storage controller (not shown) connected to the system bus 1205. The mass storage device 1207 and its associated computer-readable media provide non-volatile storage for the server 1200. That is, the mass storage device 1207 may include a computer-readable medium (not shown) such as a hard disk or CD-ROM drive.

Computer-readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that computer storage media is not limited to the foregoing. The system memory 1204 and mass storage device 1207 described above may be collectively referred to as memory.

According to various embodiments of the present disclosure, the server 1200 may also operate as a remote computer connected to a network through a network such as the internet. That is, the server 1200 may be connected to the network 1212 through a network interface unit 1211 connected to the system bus 1205, or the network interface unit 1211 may be used to connect to other types of networks or remote computer systems (not shown).

The memory further includes one or more programs, the one or more programs are stored in the memory, and the central processing unit 1201 implements the scheduling method of the streaming server provided by the above method embodiment by executing the one or more programs.

The embodiment of the present disclosure further provides a computer program product containing instructions, which when running on a server, causes the server to execute the scheduling method of the streaming server provided by the above method embodiment. For example, the scheduling method of the streaming server shown in any one of fig. 2 to 6 is performed.

It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the present disclosure and is not intended to limit the present disclosure, so that any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims

1. A scheduling method of a streaming server, which is applied to a scheduling server, the method comprising:

2. The method according to claim 1, wherein before the first time delay in the process of obtaining the target data stream from the data source terminal to the streaming server, the method further comprises:

3. The method according to claim 1 or 2, wherein before the second time delay in the process of acquiring the target data stream from the streaming server by the play terminal, the method further comprises:

4. The method of claim 1,

receiving a data packet carrying the first time delay;

receiving a data packet carrying the second time delay;

5. A scheduling method of a streaming server is applied to a data source terminal, and the method comprises the following steps:

generating a target data stream;

6. A scheduling method of a streaming server, which is applied to the streaming server, the method comprising:

7. The method of claim 6, wherein the information reflecting the first latency is a first latency determined based on the first receive timestamp and the first transmit timestamp;

8. A scheduling method of a streaming server is applied to a play terminal, and the method comprises the following steps:

9. The method of claim 8, wherein the information reflecting the first time delay is a first time delay determined based on a first receiving time stamp and a first transmitting time stamp;

10. The method according to claim 8 or 9, wherein the information reflecting the second delay is a second delay determined based on the second transmission time stamp and the second reception time stamp;

11. An apparatus for scheduling a streaming server, the apparatus comprising:

12. An apparatus for scheduling a streaming server, the apparatus comprising:

a generation module for generating a target data stream;

13. An apparatus for scheduling a streaming server, the apparatus comprising:

14. An apparatus for scheduling a streaming server, the apparatus comprising:

15. A scheduling system for a streaming server, the system comprising: the scheduling server of any one of claims 1 to 4, the data source terminal of claim 5, the streaming server of claim 6 or 7, and the playout terminal of any one of claims 8 to 10.

16. A computer-readable storage medium having instructions stored therein, which when run on a computer, cause the computer to perform the streaming server scheduling method of any one of claims 1 to 4, or the streaming server scheduling method of claim 5, or the streaming server scheduling method of claim 6 or 7, or the streaming server scheduling method of any one of claims 8 to 10.

17. A computing device comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, wherein the processor, when executing the computer program, implements the streaming server scheduling method of any of claims 1 to 4, or the streaming server scheduling method of claim 5, or the streaming server scheduling method of claim 6 or 7, or the streaming server scheduling method of any of claims 8 to 10.