CN113839829A

CN113839829A - Cloud game delay testing method, device and system and electronic equipment

Info

Publication number: CN113839829A
Application number: CN202010592413.9A
Authority: CN
Inventors: 吴旺邦; 沈显超
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2020-06-24
Filing date: 2020-06-24
Publication date: 2021-12-24

Abstract

The application discloses a cloud game delay testing method, a cloud game delay testing device, a cloud game delay testing system and electronic equipment, and relates to the technical field of the Internet. The method comprises the steps that a client side obtains delay test operation input by a user in the running process of a cloud game, sends a delay test request to a server, and determines the input time of the delay test operation as test starting time; the method comprises the steps that a server adds a corresponding preset identifier in a next frame of game updating picture sent to a client to obtain a game detection picture, the client receives the game updating pictures continuously issued by the server when the cloud game runs, the game detection picture carrying the preset identifier is determined from the game updating picture, the test ending time of a delay test is determined, and the delay time of the cloud game is obtained by utilizing the test ending time and the test starting time. According to the technical scheme, the delay time of responding to the user operation in the cloud game can be accurately tested, so that the performance of the cloud game system is improved to shorten the delay time, and the user experience is improved.

Description

Cloud game delay testing method, device and system and electronic equipment

Technical Field

The present disclosure relates to the field of internet technologies, and in particular, to a cloud game delay testing method, apparatus, and system, and further to an electronic device and a computer-readable storage medium.

Background

With the continuous development of computer technology, cloud games based on cloud computing are also becoming popular. In the application of cloud games, all games run on a cloud server, the cloud server compresses and packages audio and video images rendered by the games and transmits the compressed and packaged audio and video images to a client (such as a mobile phone, a tablet computer or a personal computer) of a user, and the client decodes, renders and displays the audio and video images. When playing games, the user operates the client, the client sends the operation information of the user to the cloud server, and the games are controlled through the cloud server. In the operation interaction process, the audio and video display picture of the game is delayed due to the influence of factors such as network transmission and the like.

In the existing delay test technology, a time difference between a certain game picture generated by a cloud server and the game picture received by a client is generally detected as a delay time of a cloud game. However, in the cloud game, a user performs an interactive operation on a game screen displayed by a client, such as attack, defense, and the like, to perform attack and defense simulating a game character, and the response time requirement on the user operation is higher, and the delay performance of responding to the user operation in the running process of the cloud game cannot be accurately detected by the delay test method.

Disclosure of Invention

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

In a first aspect, an embodiment of the present disclosure provides a cloud game delay testing method, where the method includes:

in the running process of the cloud game, obtaining delay test operation input by a user, sending a delay test request to a server according to the delay test operation, and determining the input time of the delay test operation as test starting time;

receiving game updating pictures continuously issued by the server when the cloud game runs, and determining a game detection picture carrying a preset identifier from the game updating pictures; the game detection picture is obtained by adding a preset identifier corresponding to the delay test request in a next frame of game updating picture sent to the client by the server according to the delay test request;

and determining the test ending time of the delay test according to the game detection picture, and obtaining the delay time of the cloud game according to the test ending time and the test starting time.

In a second aspect, an embodiment of the present disclosure further provides a cloud game delay testing method, including:

in the running process of the cloud game, receiving a delay test request sent by a client based on the delay test operation input by a user, and determining the input time of the delay test operation as the test starting time;

responding to the delay test request, adding a preset identifier corresponding to the delay test request in a next frame of game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously issued game updating pictures, and determines the delay time of the cloud game according to the test ending time and the test starting time of the delay test according to the game detection picture.

In a third aspect, an embodiment of the present disclosure further provides a cloud game delay testing apparatus, including:

the request sending module is used for acquiring the delay test operation input by a user in the running process of the cloud game, sending a delay test request to a server according to the delay test operation and determining the input time of the delay test operation as the test starting time;

the image receiving module is used for receiving game updating images continuously issued by the server when the cloud game runs and determining a game detection image carrying a preset identifier from the game updating images; the game detection picture is obtained by adding a preset identifier corresponding to the delay test request in a next frame of game updating picture sent to the client by the server according to the delay test request;

and the time determining module is used for determining the test ending time of the delay test according to the game detection picture and obtaining the delay time of the cloud game according to the test ending time and the test starting time.

In a fourth aspect, an embodiment of the present disclosure further provides a cloud game delay testing apparatus, including:

the request receiving module is used for receiving a delay test request sent by a client based on the delay test operation input by a user in the running process of the cloud game and determining the input time of the delay test operation as the test starting time;

and the picture issuing module is used for responding to the delay test request, adding a preset identifier corresponding to the delay test request into a next frame of game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously issued game updating pictures, determines the test ending time of the delay test according to the game detection picture, and determines the delay time of the cloud game according to the test ending time and the test starting time.

In a fifth aspect, an embodiment of the present disclosure further provides a cloud game delay testing system, including a client and a server; the client is in communication connection with the server;

the client is used for acquiring the delay test operation input by a user in the running process of the cloud game, sending a delay test request to the server according to the delay test operation and determining the input time of the delay test operation as the test starting time;

the server is used for receiving a delay test request sent by the client based on the delay test operation input by the user; responding to the delay test request, adding a preset identifier corresponding to the delay test request in a next frame of game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures;

the client is further configured to receive game update pictures continuously issued by the server when the cloud game runs, determine a game detection picture carrying a preset identifier from the game update pictures, determine a test ending time of the delay test according to the game detection picture, and determine the delay time of the cloud game according to the test ending time and the test starting time.

In a sixth aspect, an embodiment of the present disclosure further provides an electronic device, which includes:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: the cloud game delay testing method mentioned according to any of the above embodiments is performed.

In a seventh aspect, this disclosed embodiment further provides a computer-readable medium, on which a computer program is stored, where the computer program is executed by a processor to implement the cloud game delay testing method mentioned in any of the above embodiments.

According to the cloud game delay testing method, the cloud game delay testing device, the cloud game delay testing system, the electronic equipment and the computer readable medium, the client acquires the delay testing operation input by the user in the running process of the cloud game, sends the delay testing request to the server, and determines the input time of the delay testing operation as the testing starting time; the method comprises the steps that a server adds a corresponding preset identifier in a next frame of game updating picture sent to a client to obtain a game detection picture, the client receives the game updating pictures continuously issued by the server when a cloud game runs, the game detection picture carrying the preset identifier is determined from the game updating picture, the test ending time of a delay test is determined, and the delay time of the cloud game is obtained by utilizing the test ending time and the test starting time. According to the technical scheme, the delay time of responding to the user operation in the cloud game can be accurately tested, so that the performance of the cloud game system is improved to shorten the delay time, and the user experience is improved.

Additional aspects and advantages of the disclosure will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the disclosure.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.

FIG. 1 is a schematic diagram of a runtime system framework for cloud gaming;

fig. 2 is a schematic structural diagram of a cloud game delay test system according to an embodiment;

fig. 3 is a flowchart of a cloud game delay testing method according to an embodiment;

fig. 4 is another flowchart of a cloud game delay testing method according to an embodiment;

FIG. 5 is a timing diagram illustrating a cloud game latency testing method according to an embodiment;

fig. 6 is a schematic structural diagram of a cloud game delay testing apparatus according to an embodiment;

fig. 7 is another schematic structural diagram of a cloud game delay testing apparatus according to an embodiment

Fig. 8 is a schematic structural diagram of an electronic device for cloud game delay testing according to an embodiment.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing the devices, modules or units, and are not used for limiting the devices, modules or units to be different devices, modules or units, and also for limiting the sequence or interdependence relationship of the functions executed by the devices, modules or units.

It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

The present disclosure provides a cloud game delay testing method, apparatus, electronic device and computer-readable storage medium, which are intended to solve the above technical problems in the prior art.

The following describes the technical solutions of the present disclosure and how to solve the above technical problems in specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present disclosure will be described below with reference to the accompanying drawings.

The cloud game can become a game on demand, and is an online game technology based on a cloud computing technology. Cloud gaming technology enables client devices with relatively limited graphics processing and data computing capabilities to run high quality games. In a cloud game scene, a game is not played at a client used by a user for playing the game, but in a cloud server, the cloud server renders the game scene into audio and video streams, and the audio and video streams are transmitted to the client through a network. The client side does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring user input instructions and sending the instructions to the cloud server.

In order to better explain the technical solution of the present disclosure, a certain application environment to which the cloud game delay testing method of the present solution can be applied is shown below. As shown in fig. 1, fig. 1 is a schematic diagram of an operating system framework of a cloud game, the system framework includes a client 101 and a server 102, and the client 101 and the server 102 establish a communication connection through a network. The workflow of the running system of the cloud game can be as follows: the method comprises the steps that a user inputs control operation in a client 101, the client 101 generates an operation instruction according to the control operation input by the user and sends the operation instruction to a server 102, the server 102 analyzes the received operation instruction to obtain game data corresponding to the operation instruction, further, the server 102 conducts picture rendering according to the game data to generate corresponding video stream data, the video stream data are coded and then sent to the client 101 through network transmission, and the client 101 decodes the received video stream data to obtain a game picture and displays the game picture on a display interface of the client 101.

As can be seen from the above, in the current cloud game operation, the server mainly undertakes the operation work of the game, and the client only needs to acquire the video stream data related to the game sent by the server and display the game picture corresponding to the received video stream. Therefore, an operation instruction sent by a user at a client may be delayed due to the influence of a network environment where the cloud game system is located and the performance of the server, the operation instruction is sent from the user through the client 101 to the client 101, a game update picture related to the operation instruction issued by the server is received and displayed, decoding and rendering are performed, and the like, and processes of uplink data transmission of the user operation instruction, generation and encoding of a game picture by the server in response to operation, downlink data transmission of the game picture, decoding of the client and the like are required.

Based on this, the embodiment of the present disclosure provides a cloud game delay test scheme, which can accurately test the delay time of an operation performed by a user in the running process of a cloud game, and detect the delay performance of the cloud game, so that an operator can improve the delay performance of a cloud game system in time.

The present disclosure provides a cloud game delay testing system, as shown in fig. 2, fig. 2 is a schematic structural diagram of a cloud game delay testing system provided in an embodiment, where the cloud game delay testing system includes: a client 201 and a server 202. The client 201 and the server 202 are communicatively connected via a network.

In an embodiment, the client 201 may be a client such as a smart phone, a tablet computer, an e-reader, a desktop computer, or a notebook computer, which is not limited thereto. The client 201 is installed with an application program related to the cloud game, and the server 202 is a background server for providing a background service for the client device, and may be implemented by an independent server or a server cluster composed of a plurality of servers.

The client 201 is used for acquiring a delay test operation input by a user in the running process of the cloud game, sending a delay test request to the server 202 according to the delay test operation, and determining the input time of the delay test operation as the test starting time;

a server 202, configured to receive a delay test request sent by the client 201 based on a delay test operation input by the obtaining user; responding to the delay test request, adding a preset identifier corresponding to the delay test request to a next frame of game updating picture sent to the client 201 to obtain a game detection picture, and sending the game detection picture to the client 201 along with other game updating pictures;

the client 201 is further configured to receive game update pictures continuously issued by the server 202 when the cloud game runs, determine a game detection picture carrying a preset identifier from the game update pictures, and determine the delay time of the cloud game according to the determined test ending time of the delay test and the test starting time.

Based on the description of the embodiments of the cloud game delay testing system, the cloud game delay testing method of the present disclosure will be described in detail with reference to the following embodiments.

Fig. 3 is a flowchart of a cloud game latency testing method according to an embodiment, which may be executed in the cloud game latency testing system shown in fig. 2 and may be executed by a client.

Referring to fig. 3, the cloud game delay testing method may include the following steps:

s310, in the running process of the cloud game, obtaining delay test operation input by a user, sending a delay test request to a server according to the delay test operation, and determining the input time of the delay test operation as the test starting time.

In this embodiment, the delay test operation is a preset operation meeting the set condition, and in an embodiment, the user inputs the delay test operation by triggering a delay test key on the client, where the delay test key may be a virtual key on the display screen or an entity key arranged on the client, such as a "power key and volume +" combination key. In another embodiment, the user performs a preset touch operation on a set area on the touch screen, for example, performs a touch action of sliding, long pressing, double clicking, etc. on a left area of the touch screen to input a delay test operation.

Furthermore, according to the delay test operation input by the user, data related to the delay test operation, such as the current client identifier and the operation type identifier corresponding to the delay test operation, are packaged into a test data packet, so as to obtain the delay test request. In this embodiment, the client continuously sends a game operation instruction of the user to the server, so that the server renders a corresponding game update screen in real time according to the game operation instruction, where the game operation instruction refers to an operation instruction made by the user according to the current game screen, such as an operation instruction of "killing", "firing", "returning blood", and the like.

In one embodiment, the delay test request is sent to the server along with the game operation command sent by the client, that is, the delay test request and the game operation command are packaged into a data packet and sent to the server. In another embodiment, the delay test request may be packaged separately into an additional data packet, and then sent to the server following the game operation instruction made by the user.

In this embodiment, the time when the user inputs the delay test operation is determined as the test start time, and the test start time is recorded. Optionally, in another embodiment, the time when the delay test request is sent to the server may also be determined as the test start time.

S320, receiving game updating pictures continuously issued by the server when the cloud game runs, and determining a game detection picture carrying a preset identifier from the game updating pictures.

And the game detection picture is obtained by adding a preset identifier corresponding to the delay test request in the next frame of game updating picture sent to the client by the server according to the delay test request.

And in the running process of the cloud game, the server continuously issues game updating pictures to the client. The client receives the game updating picture for real-time dynamic refreshing, and optionally, the server sends the game updating picture to the client according to the frame rate of 50-60 frames per second.

And the server receives the operation instructions sent by the client and analyzes the operation instructions. And if the operation instruction comprises a delay test request or the operation instruction is an instruction corresponding to the delay test request, making a response action of the delay test request.

For example, the client receives a delay test operation input by a user, sends a data packet corresponding to a delay request to the server, where the data packet corresponding to the delay request carries a corresponding preset identifier, such as check _ id, and the server receives the data packet sent by the client, analyzes the data packet to obtain the check _ id in the data packet, and triggers a response action of the delay test request if the client initiates the delay test request.

Further, the response action of the delay test request by the server may be: when the server analyzes and obtains the delay test request, the current frame game updating picture is sent to the client, at the moment, the server obtains a preset identifier corresponding to the delay test request, Supplemental Enhancement Information (SEI) is generated according to the preset identifier, and SEI Information is inserted into the next frame game updating picture sent to the client and is coded to obtain a game detection picture.

For example, the server generates SEI information from the decoded check _ id, adds the SEI information to a next game update picture sent to the client to mark the next game update picture, performs RTC (Real-time Communications) encoding and packaging on the next game update picture and the SEI information carried by the next game update picture, and sends the video stream that transmits the game update picture to the client. In this embodiment, the game update picture carrying the preset identifier is determined as a game detection picture.

It should be noted that the SEI information provides a method for adding additional information to a video code stream, and is one of the characteristics of video compression standards such as h.264/h.265, and the related art may insert the SEI information in the video content, so that the SEI information is transmitted to a client along with the video content, but in this embodiment, customized SE information may be inserted in a game update picture by inserting the SEI information in various existing video streams to obtain a game detection picture, which is not described herein again.

In other embodiments, the server may further add the customization information to the corresponding game update screen in other manners to obtain the game detection screen, for example, add a preset identifier to a protocol header of a transmission protocol of a next frame of game update screen sent to the client, so as to mark the game update screen as the game detection screen; the game updating picture can be marked as a game detection picture by adding a preset identifier in the information description of the game updating picture.

And after receiving the game updating pictures, the client decodes one by one, detects whether each frame of game updating picture has a preset identifier, and finds out the game detection pictures with the preset identifiers.

S330, determining the test ending time of the delay test according to the game detection picture, and obtaining the delay time of the cloud game according to the test ending time and the test starting time.

In this embodiment, after receiving the game update screen, the client renders and displays the game update screen. In an embodiment, the time when the client detects the preset identifier is determined as the test end time, and in another embodiment, the time when the game detection screen is rendered and displayed on the display interface of the client may also be determined as the test end time.

The client side obtains the test ending time and the test starting time, calculates the time difference value between the test ending time and the test starting time, and determines the time difference value as the delay time of the cloud game, so that the delay time corresponding to the user operation in the running process of the cloud game is obtained.

The cloud game delay testing method provided by the embodiment is executed on a client, the client acquires delay testing operation input by a user in the running process of a cloud game, sends a delay testing request to a server, and determines the input time of the delay testing operation as the testing starting time; the method comprises the steps that a server adds a corresponding preset identifier in a next frame of game updating picture sent to a client to obtain a game detection picture, the client receives the game updating pictures continuously issued by the server when a cloud game runs, the game detection picture carrying the preset identifier is determined from the game updating picture, the test ending time of a delay test is determined, and the delay time of the cloud game is obtained by utilizing the test ending time and the test starting time, so that the delay time responding to user operation in the cloud game can be accurately tested, the performance of a cloud game system is improved, the delay time is shortened, and the user experience is improved.

Compared with the related art, the time difference between the game updating picture issued by the cloud game and the game updating picture received by the client side in the same frame is used as the delay time, the scheme provided by the embodiment takes the time difference between the time when the user performs the delay test operation and the time when the game updating picture carrying the preset identification corresponding to the delay test is received as the delay time, so that the delay test operation can more comprehensively relate to the application environment related to the operation of the cloud game by the user, and the delay time responding to the user operation in the cloud game can be more accurately tested.

In order to make the technical solution clearer and easier to understand, specific implementation processes and modes of a plurality of steps in the technical solution are described in detail below.

The receiving of the game update picture issued by the server when the cloud game runs in step S320, and determining the game detection picture carrying the preset identifier from the game update picture, may include the following steps:

s3201, in the running process of the cloud game, decoding each frame of game updating picture issued by the server, and identifying whether each frame of game updating picture carries a preset identification corresponding to the delay test request.

S3202, if the game updating picture carries the preset identification, determining the game updating picture carrying the preset identification as a game detection picture.

Optionally, in this embodiment, the client detects whether the current game update picture carries a preset identifier corresponding to the delay test request; if so, determining the game updating picture carrying the preset identifier as a game detection picture, and determining a test ending time according to the game detection picture, for example, determining the time for detecting the game detection picture as the test ending time, or determining the time for rendering the game detection picture as the test ending time, and if the current game updating picture does not carry the preset identifier corresponding to the delay test request, continuing to detect the next game updating picture.

For example, the client decodes each frame of game update picture issued by the server, and identifies whether each frame of game update picture carries SEI information, or whether the SEI information includes a preset identifier corresponding to the delay test request, and if it is detected that the SEI information includes the preset identifier, determines that the game update picture is a game detection picture generated by the server in response to the delay test request.

It should be noted that, in this embodiment, various existing manners of decoding video streams to identify SEI information may be adopted to implement that the client decodes the received game update picture to identify SEI information inserted by the server and determine that the game update picture is a game detection picture, which is not described herein again.

In an embodiment, the step S310 of obtaining the delay test operation input by the user, and sending the delay test request to the server according to the delay test operation may include the following steps:

s3101, obtaining the interactive operation input by the user, matching the interactive operation with a preset test operation, and determining the interactive operation as a delay test operation according to the matching result.

The user makes various types of interactive operation on the touch screen of the client to send different types of operation instructions, such as attack, interception, jumping, head dropping and the like. Each interaction corresponds to a unique operation instruction. In this embodiment, a test operation for a delay test is preconfigured, for example, a user presses the lower right corner area of a game interface for 2 seconds, and the like, and if the user performs the following interactive operations: and when the time in the lower right corner area of the game interface of the touch screen reaches 2 seconds, the client acquires the interactive operation, judges that the interactive operation is matched with the preset test operation, and determines that the user inputs the delay test operation.

S3102, generating a delay test request according to the delay test operation, and sending the delay test request to the server.

Further, the client responds to the delay test operation made by the user, generates a corresponding test identifier, such as check _ id, for identifying the delay test operation made by the user at this time, packages the corresponding delay test request, and sends the delay test request to the server through the network so as to inform the server of performing the delay test.

Fig. 4 is another flowchart of the cloud game delay testing method provided in an embodiment, and the method may be applied to the cloud game delay testing system shown in fig. 2 and may be executed by a server.

Referring to fig. 4, the cloud game delay testing method may include the following steps:

and S410, in the running process of the cloud game, receiving a delay test request sent by a client based on the delay test operation input by the user, and determining the input time of the delay test operation as the test starting time.

In this embodiment, the delay test operation is a preset operation meeting the set condition, and in an embodiment, the user inputs the delay test operation by triggering a corresponding delay test key on the client, where the delay test key may be a virtual key on the display screen or an entity key arranged on the client, such as a "power key and volume +" combination key. In another embodiment, the user performs a preset touch operation on a set area on the touch screen, for example, performs a touch action of sliding, long pressing, double clicking, etc. on a left area of the touch screen to input a delay test operation.

Furthermore, according to the delay test operation input by the user, data related to the delay test operation, such as the current client identifier and the operation type identifier corresponding to the delay test operation, are packaged into a test data packet, so as to obtain the delay test request.

In this embodiment, the server continuously receives a game operation instruction of the user sent by the client, and renders a corresponding game update screen in real time according to the game operation instruction, where the game operation instruction refers to an operation instruction made by the user according to the current game screen, such as an operation instruction of "killing", "firing", "returning blood", and the like.

S420, responding to the delay test request, adding a preset identifier corresponding to the delay test request to a next frame of game updating picture sent to the client to obtain a game detection picture, and sending the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously sent game updating pictures, and determines the delay time of the cloud game according to the determined test ending time and the test starting time of the delay test.

In this embodiment, the server cloud continuously issues game update pictures to the client during the running process of the game. The client receives the game updating picture for real-time dynamic refreshing, and optionally, the server sends the game updating picture to the client according to the frame rate of 50-60 frames per second.

For example, the server generates SEI information from the decoded check _ id, adds the SEI information to the next game update picture sent to the client to mark the next game update picture, performs RTC (Real-time Communications) encoding and packaging on the next game update picture and the SEI information carried by the next game update picture, and sends the video stream that transmits the game update picture to the client.

In this embodiment, the client determines the game update screen carrying the preset identifier as the game detection screen. The client decodes each frame of game updating picture issued by the server, and identifies whether each frame of game updating picture carries SEI information or not, or whether the SEI information comprises a preset identification corresponding to the delay test request, and if the SEI information is detected to comprise the preset identification, the game updating picture is determined to be a game detection picture generated by the server responding to the delay test request.

The cloud game delay testing method provided by the embodiment is executed on a server, and the server receives a delay testing request sent by a client based on a delay testing operation input by a user in the running process of the cloud game and determines the input time of the delay testing operation as the testing start time; and adding a preset identifier corresponding to the delay test request in the next game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously issued game updating pictures, and determines the delay time of the cloud game according to the determined test ending time and the test starting time of the delay test, thereby accurately testing the delay time of the user operation in the cloud game, facilitating the improvement of the performance of the cloud game system to shorten the delay time and further improving the user experience.

In order to explain the technical solution of the present application more clearly, the following description will be further made with reference to examples in several scenarios.

Fig. 5 is a timing diagram of a cloud game latency testing method according to an embodiment. In order to make the technical solutions provided by the embodiments of the present disclosure clearer, an example of a cloud game delay testing method is described below with reference to fig. 5.

S501, inputting a delay test operation by a user.

Optionally, in an embodiment, the user makes a touch action on the touch screen of the client to input the delay test operation; in another embodiment, the user inputs the delay test operation by clicking a preset delay test key, such as "delay test key", on the client.

S502, the client side obtains the delay test operation, generates a corresponding delay test request and sends the delay test request to the server.

The client generates a corresponding delay test request according to the delay test operation, initiates a detection data packet on a data Channel (data Channel), and sends the detection data packet to the server. The client records the current time as time1, and determines time1 as the test start time.

And S503, adding a preset identifier on the next game updating picture sent to the client by the server according to the delay test request to obtain a game detection picture.

And when the server receives the delay test request, acquiring a next frame of game updating picture to be sent to the client, marking the game updating picture, and if a preset identifier is added, marking the game updating surface as a game detection picture. Optionally, the preset identifier is transcoded to obtain SEI information, and the SEI information is encoded along with a video stream corresponding to the game update picture.

S504, the server continuously sends game updating pictures to the client.

And the server sequentially encodes the rendered game updating pictures and then sequentially transmits the encoded game updating pictures to the client, wherein the game detection pictures are also transmitted to the client along with the video stream where the game updating pictures are located.

And S505, the client receives the game updating picture, and searches the game detection picture carrying the preset identifier from the game updating picture.

S506, the client determines the test ending time and calculates the delay time of the cloud game.

The client analyzes to obtain the preset identification, renders and displays a game detection picture on a display interface, records the current time as time2, and determines time2 as the test ending time.

The client acquires the test ending time and the test starting time, calculates the time difference between the test ending time (time2) and the test starting time (time1), and determines the time difference as the delay time of the cloud game, so that the delay time corresponding to the user operation in the running process of the cloud game is obtained.

And S507, presenting the result of the delay test to the user.

The client calculates the delay time, returns the calculation result, and presents the result of the delay test to the user on a display interface, such as the delay time: 0.02 second.

In this embodiment, in the cloud game system, a delay test operation made by a user is performed in an interaction process between a client and a server, a delay test request is sent to a server through a network, the server responds to the delay test request and sends a game detection picture with a preset identifier to the client along with a video stream, the client detects the game detection picture to determine that a delay test is finished, the delay test operation relates to an environmental condition involved in game playing of the user, and the delay time of the user operation in the cloud game can be accurately tested, so that the performance of the cloud game system is improved to shorten the delay time, and the user experience is improved.

The above examples are merely used to assist in explaining the technical solutions of the present disclosure, and the drawings and specific flows related thereto do not constitute a limitation on the usage scenarios of the technical solutions of the present disclosure.

The following describes in detail a related embodiment of the cloud game delay testing apparatus.

Fig. 6 is a schematic structural diagram of an embodiment of a cloud game delay testing apparatus, and as shown in fig. 6, the cloud game delay testing apparatus 300 may include: a request transmission module 310, a picture reception module 320, and a time determination module 330.

The request sending module 310 is configured to, in the running process of the cloud game, obtain a delay test operation input by a user, send a delay test request to a server according to the delay test operation, and determine input time of the delay test operation as test start time;

the picture receiving module 320 is configured to receive game update pictures continuously issued by the server when the cloud game runs, and determine a game detection picture carrying a preset identifier from the game update pictures; the game detection picture is obtained by adding a preset identifier corresponding to the delay test request in the next frame of game updating picture sent to the client by the server according to the delay test request;

the time determining module 330 is configured to determine a test ending time of the delay test according to the game detection picture, and obtain the delay time of the cloud game according to the test ending time and the test starting time.

According to the cloud game delay testing device provided by the embodiment, the time of the delay testing operation input by the user is determined as the testing starting time, and the time of receiving the game updating picture with the preset identification sent by the server is determined as the testing ending time, so that the delay time of the cloud game can be accurately tested.

In one embodiment, the step of obtaining the game detection screen is performed by a game detection screen generation module in the server, and the game detection screen generation module includes: a supplementary enhancement information generating unit and a game detection screen obtaining unit;

the device comprises a time delay test request, a supplementary enhancement information generation unit and a time delay unit, wherein the supplementary enhancement information generation unit is used for acquiring a preset identifier corresponding to the time delay test request and generating supplementary enhancement information according to the preset identifier; and the game detection picture obtaining unit is used for inserting the supplementary enhancement information into the next frame of game updating picture sent to the client and coding the supplementary enhancement information to obtain a game detection picture.

In an embodiment, the picture receiving module 320 is configured to decode each frame of game update picture issued by the server in the running process of the cloud game, and identify whether each frame of game update picture carries a preset identifier corresponding to the delay test request; and if the game updating picture carries the preset identification, determining the game updating picture carrying the preset identification as a game detection picture.

In one embodiment, the request sending module 310 includes: an operation matching unit and a request generating unit;

the operation matching unit is used for acquiring interactive operation input by a user, matching the interactive operation with preset test operation and determining the interactive operation as delay test operation according to a matching result;

and the request generating unit is used for generating a delay test request according to the delay test operation and sending the delay test request to the server.

In an embodiment, the time determination module includes an end time determination unit, configured to render and display the game detection screen on a display interface, and determine a current time at which the game detection screen is rendered as the test end time.

In an embodiment, the time determining module includes a delay time obtaining unit, configured to calculate a time difference between the test ending time and the test starting time, and determine the time difference as the delay time of the cloud game.

Fig. 7 is another schematic structural diagram of a cloud game delay test apparatus according to an embodiment, where the cloud game delay test apparatus in this embodiment is applied to a server, and as shown in fig. 7, the cloud game delay test apparatus 400 includes: a request receiving module 410 and a screen issuing module 420.

The request receiving module 410 is configured to receive, in the running process of the cloud game, a delay test request sent by a client based on a delay test operation input by a user, and determine input time of the delay test operation as test start time;

the picture issuing module 420 is configured to, in response to the delay test request, add a preset identifier corresponding to the delay test request to a next game update picture sent to the client to obtain a game detection picture, and issue the game detection picture to the client along with other game update pictures, so that the client determines a game detection picture carrying the preset identifier from the continuously issued game update pictures, and determines the delay time of the cloud game according to the determined test ending time and the test starting time of the delay test.

In one embodiment, the screen issuing module 420 includes a game detection screen generating module, which includes: a supplementary enhancement information generating unit and a game detection screen obtaining unit;

The cloud game delay testing device of the embodiment of the present disclosure may execute the cloud game delay testing method provided by the embodiment of the present disclosure, and the implementation principle is similar, the actions executed by each module in the cloud game delay testing device in each embodiment of the present disclosure correspond to the steps in the cloud game delay testing method in each embodiment of the present disclosure, and for the detailed function description of each module of the cloud game delay testing device, reference may be specifically made to the description in the corresponding cloud game delay testing method shown in the foregoing, and details are not repeated here.

Referring now to fig. 8, fig. 8 is a schematic structural diagram of an electronic device for cloud game latency testing according to an embodiment, which shows a schematic structural diagram of an electronic device 700 (such as the client or the server shown in fig. 2) suitable for implementing an embodiment of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

The electronic device includes: a memory and a processor, wherein the processor may be referred to as the processing device 701 hereinafter, and the memory may include at least one of a Read Only Memory (ROM)702, a Random Access Memory (RAM)703 and a storage device 708 hereinafter, as shown in detail below:

as shown in fig. 8, electronic device 700 may include a processing means (e.g., central processing unit, graphics processor, etc.) 701 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)702 or a program loaded from storage 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data necessary for the operation of the electronic apparatus 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

Generally, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 707 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 708 including, for example, magnetic tape, hard disk, etc.; and a communication device 709. The communication means 709 may allow the electronic device 700 to communicate wirelessly or by wire with other devices to exchange data. While fig. 8 illustrates an electronic device 700 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such embodiments, the computer program may be downloaded and installed from a network via the communication means 709, or may be installed from the storage means 708, or may be installed from the ROM 702. The computer program, when executed by the processing device 701, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:

receiving game updating pictures continuously issued by the server when the cloud game runs, and determining a game detection picture carrying a preset identifier from the game updating pictures; the game detection picture is obtained by adding a preset identifier corresponding to the delay test request in the next frame of game updating picture sent to the client by the server according to the delay test request;

Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:

responding to the delay test request, adding a preset identifier corresponding to the delay test request in a next frame of game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously issued game updating pictures, and determines the delay time of the cloud game according to the determined test ending time and the test starting time of the delay test.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules or units described in the embodiments of the present disclosure may be implemented by software or hardware. The name of a module or a unit does not in some cases form a limitation on the unit itself, and for example, the request sending module may also be described as a "module sending a delay test request".

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing information. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a cloud game delay testing method, including:

According to one or more embodiments of the present disclosure, adding a preset identifier corresponding to the delay test request to a next game update picture sent to a client according to the delay test request to obtain a game detection picture includes:

acquiring a preset identifier corresponding to the delay test request, and generating supplementary enhancement information according to the preset identifier;

and inserting the supplementary enhancement information into the next frame of game updating picture sent to the client and coding to obtain a game detection picture.

According to one or more embodiments of the present disclosure, the step of receiving a game update picture issued by the server when the cloud game runs, and determining a game detection picture carrying a preset identifier from the game update picture includes:

in the running process of the cloud game, decoding each frame of game updating picture issued by the server, and identifying whether each frame of game updating picture carries a preset identifier corresponding to the delay test request;

and if the game updating picture carries the preset identification, determining the game updating picture carrying the preset identification as a game detection picture.

According to one or more embodiments of the present disclosure, the step of obtaining the delay test operation input by the user and sending the delay test request to the server according to the delay test operation includes:

acquiring interactive operation input by a user, matching the interactive operation with preset test operation, and determining the interactive operation as delay test operation according to a matching result;

and generating a delay test request according to the delay test operation, and sending the delay test request to the server.

According to one or more embodiments of the present disclosure, the step of determining the test end time of the delay test includes:

rendering and displaying the game detection picture on a display interface, and determining the current time of rendering the game detection picture as the test ending time.

According to one or more embodiments of the present disclosure, the obtaining of the delay time of the cloud game according to the test end time and the test start time includes:

and calculating a time difference value between the test ending time and the test starting time, and determining the time difference value as the delay time of the cloud game.

responding to the delay test request, adding a preset identifier corresponding to the delay test request in a next frame of game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously issued game updating pictures, determines the test ending time of the delay test according to the game detection picture, and determines the delay time of the cloud game according to the test ending time and the test starting time.

According to one or more embodiments of the present disclosure, the step of adding a preset identifier corresponding to the delay test request to a next game update picture sent to the client to obtain a game detection picture includes:

According to one or more embodiments of the present disclosure, a cloud game delay testing apparatus includes:

According to one or more embodiments of the present disclosure, the step of obtaining the game detection screen is performed by a game detection screen generation module in the server, the game detection screen generation module including: a supplementary enhancement information generating unit and a game detection screen obtaining unit;

a supplementary enhancement information generating unit, configured to obtain a preset identifier corresponding to the delay test request, and generate supplementary enhancement information according to the preset identifier;

and the game detection picture obtaining unit is used for inserting the supplementary enhancement information into the next frame of game updating picture sent to the client and coding the supplementary enhancement information to obtain a game detection picture.

According to one or more embodiments of the present disclosure, the picture receiving module is configured to decode each frame of game update picture issued by the server in a cloud game running process, and identify whether each frame of game update picture carries a preset identifier corresponding to the delay test request; and if the game updating picture carries the preset identification, determining the game updating picture carrying the preset identification as a game detection picture.

According to one or more embodiments of the present disclosure, a request transmission module includes: an operation matching unit and a request generating unit;

According to one or more embodiments of the present disclosure, the time determination module includes an end time determination unit, configured to render and display the game detection screen on a display interface, and determine a current time at which the game detection screen is rendered as a test end time.

According to one or more embodiments of the present disclosure, the time determination module includes a delay time obtaining unit, configured to calculate a time difference between the test ending time and the test starting time, and determine the time difference as a delay time of the cloud game.

and the picture issuing module is used for responding to the delay test request, adding a preset identifier corresponding to the delay test request into a next frame of game updating picture sent to the client to obtain a game detection picture, and issuing the game detection picture to the client along with other game updating pictures, so that the client determines the game detection picture carrying the preset identifier from the continuously issued game updating pictures, determines the test ending time of the delay test according to the game detection picture, and determines the delay time of the cloud game according to the test ending time and the test starting time of the delay test.

According to one or more embodiments of the present disclosure, a screen issuing module includes: a supplementary enhancement information generating unit and a game detection screen obtaining unit;

According to one or more embodiments of the present disclosure, a cloud game delay test system includes a client and a server; the client is in communication connection with the server;

the client is further configured to receive game update pictures continuously issued by the server when the cloud game runs, determine a game detection picture carrying a preset identifier from the game update pictures, determine a test ending time of a delay test according to the game detection picture, and determine a delay time of the cloud game according to the test ending time and the test starting time.

In accordance with one or more embodiments of the present disclosure, an electronic device includes:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: and executing the cloud game delay testing method.

According to one or more embodiments of the disclosure, a computer readable medium is stored with a computer program, wherein the computer program is executed by a processor to implement the cloud game delay testing method.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A cloud game delay testing method is characterized by comprising the following steps:

2. The cloud game delay test method of claim 1, wherein adding a preset identifier corresponding to the delay test request to a next game update picture sent to a client according to the delay test request to obtain a game detection picture comprises:

3. The cloud game delay test method according to claim 1, wherein the step of receiving a game update screen issued by the server when the cloud game runs, and determining a game detection screen carrying a preset identifier from the game update screen includes:

4. The cloud game delay test method according to claim 1, wherein the step of obtaining the delay test operation input by the user and sending the delay test request to the server according to the delay test operation includes:

5. The cloud game delay test method of claim 1, wherein the step of determining a test end time of the delay test comprises:

6. A cloud game delay testing method is characterized by comprising the following steps:

7. The cloud game delay test method according to claim 6, wherein the step of adding a preset identifier corresponding to the delay test request to a next game update screen sent to the client to obtain a game detection screen comprises:

8. A cloud game delay testing device is characterized by comprising:

9. A cloud game delay testing device is characterized by comprising:

10. A cloud game delay test system is characterized by comprising a client and a server; the client is in communication connection with the server;

11. An electronic device, comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: performing the cloud game latency testing method of any of claims 1-7.

12. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the cloud game latency testing method of any one of claims 1 to 7.