JP6715334B2 - GPU resource reconstruction method, user device, system and storage medium - Google Patents

Description

<Related application>
This application claims priority from Chinese Patent Application No. 201610067210.1 entitled "GPU Resource Reconstruction Method, User Device and System", filed with the National Intellectual Property Office of China on January 29, 2016. The entire content is incorporated herein by reference.
<Technical field>

The present disclosure relates to the technical field of cloud technology, and more particularly to methods, user devices and systems for reconfiguring resources.
<Background technology>

With the rapid development of network bandwidth and terminal technology in recent years, the maturity of cloud computing technology has promoted cloud interactive systems. Existing cloud interactive systems typically include a server and multiple user devices, which may be a cluster server, allowing multiple interactive applications to work in the interactive system. ..

So far, regarding the application of the image rendering in the cloud interactive system in the existing technology, it is the responsibility of the server to render the image and send the rendered image frame to the user device. After receiving the rendered image frame, the image frame is directly decoded and the image is displayed. In a cloud interactive system, the utilization state of GPU resources is not directly recorded on the user device displaying the image, and such behavior is not observed if the GPU resources are rebuilt after the loss of the GPU. Results in a failure to release and rebuild.

Embodiments of the present application provide a resource building method, a user device, a system, and a storage medium that ensure normal use of the system and improve the user experience.

A first aspect of the disclosure is to provide a method for reconfiguring resources. The method applies to cloud interactive systems. The cloud interactive system includes user devices and servers. The user device includes a graphics processing unit (GPU). GPU corresponds to the default resource pool.

The method comprises: a user device receiving rendering data sent by a server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions; The device records GPU resources built in the default resource pool according to the rendering resources as held resources in the default resource pool; , A step of determining whether or not the GPU is in the loss state according to the rendering command, and determining whether or not to execute the GPU recovery when the GPU is in the loss state; and executing the GPU recovery User device releases the held resources in the default resource pool, and based on the record of the held resources in the default resource pool, the user device releases the resources in the default resource pool. Including the step of reconstructing

A second aspect of the disclosure is to provide a user device. The user device is included in the cloud interactive system. The cloud interactive system also includes a server. The user device includes a graphics processing unit (GPU). GPU corresponds to the default resource pool.

A user device is: a receiving unit configured to receive rendering data sent by a server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions. A recording unit for recording the GPU resource constructed in the default resource pool according to the rendering resource as a resource held in the default resource pool; the rendering instruction indicates whether the GPU is in the loss state A determination unit that determines whether to execute GPU recovery when the GPU is in the loss state; and in the default resource pool when it is determined to execute GPU recovery And a rebuilding unit for releasing the held resources and rebuilding the resources in the default resource pool based on the records of the held resources in the default resource pool.

A third aspect of the present disclosure is to provide a cloud interactive system including a user device and a server. The user device is a user device according to the second aspect.

A fourth aspect of the present disclosure is to provide a non-volatile storage medium for storing computer readable instructions. When the instructions are executed by the computer, the computer executes the resource reconstruction method as described above.

Schematic of cloud game architecture.

6 is a schematic diagram of a method of reconfiguring GPU resources according to an embodiment of the present disclosure.

FIG. 6 is a specific schematic diagram of a cloud game architecture in a method of reconfiguring GPU resources according to embodiments of the present disclosure.

6 is a schematic diagram of a method of reconfiguring GPU resources according to another embodiment of the present disclosure.

1 is a schematic diagram of a user device according to an embodiment of the present disclosure.

3 is a schematic diagram of a user device according to another embodiment of the present disclosure. FIG.

Embodiments of the present disclosure provide a resource restructuring method, a user device, a system, and a storage medium that guarantee normal use of the system and improve user experience.

The technical solutions according to the embodiments of the present disclosure have been clearly and completely described with reference to the drawings according to the present disclosure, so that those skilled in the art can further understand the technical solutions according to the present disclosure. become. Apparently, the described embodiments are merely a few rather than all of the embodiments of the present disclosure. Any other embodiment ascertained by a person of ordinary skill in the art based on the embodiments according to the present disclosure without any creative effort shall fall within the protection scope of the present disclosure.

In the drawings, claims and specification of this disclosure, terms such as "first," "second," etc. (when they exist) refer to a particular order or priority thereof. It is not shown but merely used there to convey individual similar objects. It is to be understood that the terms used herein may be interchangeable with which the embodiments of the present disclosure may be implemented in other orders than those described herein. Furthermore, the terms "comprising," "having," or any other variation are intended to be non-exclusive. For example, a process, method, system, product or device that comprises a series of steps or units is not limited to the explicitly listed steps or units, and may include other steps or units not explicitly listed. , Method, product or device specific.

Hereinafter, embodiments of the method for reconstructing resources in the present disclosure will be described first.

As shown in FIG. 1, the method of reconstructing resources in the embodiments of the present disclosure is applied to a cloud interactive system. The cloud interactive system includes a user device and a server. There may be multiple user devices. The server may be a cluster server. It is possible for multiple interactive applications to work in a cloud interactive system. The user device may be a terminal device such as a personal computer (PC), laptop, or mobile phone. The server may be a dedicated game server. The data flow is now recorded by the server, compressed and then sent to the user device. The user device may replay (or execute) rendering instructions, play (or play) rendering resources, and reproduce the rendered image. The user device includes a graphics processing unit (GPU).

Direct3D is a three-dimensional (3D) graphic programming interface developed by Microsoft Corporation for Windows operating systems, which is the base library for Windows 3D game development. , And a GPU programming interface.

GPU resources managed by Direct 3D are classified into three types according to storage location. The three types are: resources in the management resource pool (management resources) and resources in the default resource pool (default resources). , And resources in the system memory resource pool (system memory resources). Resources in the management resource pool and resources in the system memory resource pool are not affected by GPU loss and do not need to be processed in case of GPU loss, but in the default resource pool. Resources need to be released and rebuilt when it is detected that the device is being restored after a GPU loss.

User devices correspond to resources in the default resource pool in embodiments of the present disclosure. User devices include smart terminals such as smartphones or tablet computers, MP3 players (MP3 stands for "Moving Picture Experts Group Audio Layer III"), MP4 players, laptop computers, in-car audio devices, It may be a desktop computer or the like.

With reference to FIG. 2, the method of reconfiguring resources in the embodiment of the present disclosure includes steps 201 to 205.

In step 201, the user device receives the rendering data sent from the server.

The rendering data includes rendering instructions and rendering resources corresponding to the rendering instructions. The data flow is recorded by the server, compressed, and then sent to the user device. The user device receives the rendering data sent by the server.

In step 202, the user device records the GPU resource built in the default resource pool according to the rendering resource as the resource held in the default resource pool.

When playing a rendering resource, the user device needs to build the corresponding GPU resource in the default resource pool. In this step, GPU resources built in the default resource pool in response to rendering resources are recorded as held resources in the default resource pool. If GPU resources that are built in the default resource pool according to their rendering resources are already recorded as retained resources in the default resource pool, they will not be recorded again as retained resources. Should be noted.

In step 203, the user device determines whether the GPU is in a loss state. Step 204 is executed when the GPU is in a loss state.

A GPU (graphics processing unit) is a microprocessor that performs graphics operations. Use rights of the GPU may be stripped when Direct 3D based games utilize the GPU, which leads to virtual rendering glitches and GPUs held by the application. Resources will also be released. This process is called GPU loss. Another condition associated with GPU loss is GPU recovery, where the application is subject to reallocation of GPU usage rights. The application cannot continue to render effectively if the GPU is lost, and if the device is restored, previously held GPU resources are released and rebuilt.

In an embodiment, the rendering instructions may have a first detection function that detects the current state of the GPU. In this case, the steps of the user device to determine if the GPU is in the loss state are: the user device replays the rendering instruction and obtains the first return value returned by the first detection function, The user device determines whether the GPU is in a loss state based on the first return value.

The first detection function may be a present function included in the rendering instruction. In case of GPU loss, the present function returns "D3DERR_DEVICELOST". If the returned value is obtained at this point, it can be determined whether the GPU is in loss.

In step 204, the user device determines whether to perform GPU recovery. Step 205 is executed if it is decided to perform GPU recovery.

In an embodiment, after determining that the GPU is in a loss state, the method may include the user device inserting a second detection function to determine whether to perform GPU recovery in the rendering instruction. It may further include. In this case, the step in which the user device decides whether to perform GPU recovery is that the user device replays the rendering instruction and obtains the second return value returned by the second detection function, and -The device may include determining whether to perform GPU recovery based on the second return value.

The second detection function may be a “Test Cooperative Level function”. When the return value of the test cooperation level function is acquired as "D3DERR_DEVICENOTRESET", it is determined to execute the GPU recovery.

In embodiments, the test cooperation level function may be used at step 203 to determine if there is a GPU loss condition. When the return value of the test cooperation level function includes “D3DERR_DEVICELOST”, whether the GPU is lost or not can be determined based on the obtained return value.

In step 205, the user device releases the held resources in the default resource pool and reconstructs the resources in the default resource pool based on the record of the held resources in the default resource pool. ..

Generally, if the application on the user device is a graphics processing unit (GPU), the right to use the GPU may be stripped, and the GPU resources held by the application are also released, this release is called GPU loss. Another condition related to GPU loss is GPU recovery, where the application is subject to reallocation of GPU usage rights. When the device is restored, previously held GPU resources are released and rebuilt.

This is due to the GPU losing contact with the graphics card in case of GPU loss, which causes all resources associated with the graphics card to become inaccessible by the device again Resources must be released and rebuilt. Generally, all resources that are rebuilt with the parameter "D3DPOOL_DEFAULT" (default resource pool) are memory resources allocated to the graphics card. Therefore, before resetting the device, it should be ensured that all resources of type "D3DPOOL_DEFAULT" (default resource pool) are released.

Therefore, when it is decided to perform GPU recovery, the user device releases the resources held in the default resource pool and based on the record of the resources held in the default resource pool, the default -Resources need to be rebuilt in the resource pool. In an embodiment, a reset function for handling device loss and recovery releases resources held in the default resource pool and records the held resources in the default resource pool. May be used by the user device to rebuild resources in the default resource pool based on.

In embodiments of the present disclosure, GPU resources that are constructed in the default resource pool according to the rendering resources are recorded as held resources in the default resource pool after receiving the rendering data sent by the server. ing. In GPU recovery, after a GPU loss, the resources held in the default resource pool are released and the resources in the default resource pool are rebuilt based on the records of the held resources in the default resource pool. , Which enables GPU recovery and avoids certain situations in interactive application systems, which are due to the fact that all data can only be obtained from the server after the loss of the GPU. However, the embodiment guarantees normal use of the system and improves the user experience.

Optionally, in the embodiments of the present disclosure, the GPU resource constructed in the default resource pool in response to the rendering instruction includes the target GPU resource, and the rendering instruction includes the life cycle information of the target GPU resource. The method comprises the steps of the user device releasing the target GPU resource after completing the life cycle of the target GPU resource and deleting the record that the target GPU resource is a held resource in the default resource pool. Is further included. That is, the GPU resource held in the default resource pool is released after the life cycle of the resource is finished, and the record that the resource is held in the default resource pool is deleted. Achieve more effective use of resources and avoid unnecessary resource reconstruction when reconstructing resources held in the default resource pool.

Optionally, in an embodiment of the present disclosure, after rebuilding the resources in the default resource pool based on a record of the resources held in the default resource pool, the method allows the user device to reset the default resource pool to the default resource pool. Determines whether all held resources in the resource pool have been successfully rebuilt, and not all held resources in the default resource pool have been successfully rebuilt. It may further include releasing resources held in the pool and reconstructing resources in the default resource pool based on a record of resources held in the default resource pool.

In one special case, it may happen that not all the resources held in the default resource pool have been successfully rebuilt, in which case the resources held in the default resource pool are The releasing and rebuilding steps are re-executed, which ensures that the resources held in the default resource pool are successfully reconstructed.

In the following, the above method of building resources will be explained together with a specific application scenario in which a cloud game client running on a user device is used as an example of a user device. Regarding Figure 3, the game is running on a cloud game server. The data flow is recorded by the cloud game server, compressed, and then sent to the cloud game client over the Internet. The cloud game client replays the rendering instructions, plays the rendering data, and recreates the rendered image. In an embodiment, a direct 3D state recorder is provided to the cloud game client to record GPU resources built in the default resource pool according to the rendering resources received from the cloud game server.

With reference to FIG. 4, the method of reconfiguring resources in another embodiment of the present disclosure includes steps 401 to 406.

In step 401, the cloud game client receives the rendering data sent by the cloud game server.

The rendering data includes rendering instructions and rendering resources corresponding to the rendering instructions.

In step 402, the cloud game client records, by the direct 3D state recorder, the GPU resource constructed by the direct resource according to the rendering resource as the resource held in the default resource.

The rendering instruction includes a present function.

In step 403, a test cooperation level function is inserted in the rendering instruction.

The test cooperation level function is used to determine whether to perform GPU recovery.

In step 404, the cloud game client replays the rendering instruction to determine if the GPU is in a loss state. Step 405 is executed when the GPU is in the loss state.

To determine whether the GPU is in a loss state, the step that the cloud game client replays the rendering instruction is performed by the cloud game client replaying the rendering instruction and returning the return value of the present function. Based on the above, a step of determining whether the GPU is in a loss state may be included. The present function returns “D3DERR_DEVICELOST” when the GPU is in the loss state, and whether the GPU is in the loss state can be determined when the return value is acquired.

In step 405, the cloud game client determines whether to perform GPU recovery.

If the return value obtained from the test cooperation level function is "D3DERR_DEVICENOTRESET", it is decided to perform GPU recovery.

In step 406, the cloud game client releases the resources held in the default resources and based on the record of the resources held in the default resource pool if it is determined to perform GPU recovery. And rebuild resources in the default resource pool.

In the following, embodiments of the user device will be described. The user device is included in the cloud interactive system. The cloud interactive system also includes a server. The server includes a graphics processing unit (GPU). GPU corresponds to the default resource pool.

With reference to FIG. 5, the user device 500 in the embodiment of the present disclosure includes a receiving unit 501, a recording unit 502, a determining unit 503, and a reconstructing unit 504.

The receiving unit 501 is configured to receive the rendering data sent by the server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions.

The rendering unit 502 is configured to record the GPU resources built in the default resource pool according to the rendering resources as resources held in the default resource pool.

The determining unit 503 is configured to determine whether the GPU is in the loss state and, if the GPU is in the loss state, determine whether to perform the GPU recovery.

The rebuilding unit 504 releases resources held in the default resource pool and, if it is determined to perform GPU recovery, based on the record of resources held in the default resource pool, Configured to rebuild resources in the default resource pool.

In the embodiments of the present disclosure, GPU resources constructed in the default resource pool according to the rendering resources are held in the default resource pool after receiving the rendering data sent by the server by the receiving unit 501. Recorded by the recording unit 502 as a resource. If the decision unit 503 decides to perform GPU recovery after a GPU loss, the resources held in the default resource pool are released and recorded in the record of resources held in the default resource pool. Based on a rebuilding unit 504, which provides GPU recovery and avoids certain situations in interactive application systems, where all data can only be obtained from the server. Due to, the GPU cannot be restored after the loss of the GPU, and the embodiment guarantees normal use of the system to improve the user experience.

Optionally, the rendering instructions include a first detect function that detects the current state of the GPU.

The determining unit 503 is configured to replay the rendering instruction, obtain a first return value returned by the first function, and based on the first return value, determine whether the GPU is in a loss state. It

Optionally, the user device further comprises an insertion unit.

The insertion unit is configured to insert a second detection function into the rendering instruction that detects whether to perform GPU recovery after it is determined that the GPU is in a loss state.

The determining unit 503 is further configured to replay the rendering instruction, obtain a second return value returned by the second detection function, and determine whether to perform GPU recovery based on the second return value. ..

Optionally, the GPU resource constructed in the default resource pool according to the rendering instruction includes a target GPU resource, and the rendering instruction includes life cycle information of the target GPU resource.

The user device further includes a deletion unit.

The delete unit is configured to release the target GPU resource after the end of the life cycle of the target GPU resource and delete the record that the target GPU resource is a held resource in the default resource pool. ..

After rebuilding the resources in the default resource based on the record of the held resources in the default resource pool, the rebuilding unit 504 can successfully rebuild all the held resources in the default resource pool. Further configured to determine whether or not all of the resources held in the default resource pool have been successfully rebuilt, the rebuilding unit 504 is held in the default resource pool. Configured to release the resource and reconstruct the resource in the default resource pool based on the record of the held resources in the default resource pool.

The user device in the embodiments of the present disclosure has been described in terms of the functional entities above, but is further described below in terms of hardware processing. With respect to Figure 6, the user device is applied to a cloud interactive system, which includes a server. The user device 600 in the embodiment of the present disclosure includes an input device 601, an output device 602, a processor 603, and a memory 604 (the number of the processors 603 may be one or more. One processor 603 is shown as an example). The user device further includes a GPU 605. GPU605 corresponds to the default resource pool. In some embodiments of the present disclosure, the input device 601, the output device 602, the processor 603, the memory 604, and the GPU 605 can be connected by a bus or other means. In FIG. 6, a bus connection is shown as an example.

User devices according to embodiments of the present disclosure may include more or less parts than those shown in FIG. 6, may combine two or more components, or configure or configure different parts. May have. Each component may be implemented in hardware, software, or a combination thereof, including one or more signal processing and/or application specific integrated circuits.

By calling the operation instructions stored in the memory 604, the processor 603 is used to perform the following steps, which receive via the input unit 601 the rendering data sent by the server: The rendering data includes rendering instructions and rendering resources corresponding to the rendering instructions; and defaulting GPU resources constructed in a default resource pool according to the rendering resources. A step of recording as a held resource in the resource pool.

By invoking an operation instruction stored in memory 604, GPU 605 is used to perform the following steps, which include: determining if the GPU is in a loss state and the GPU is in a loss state. If it is in a state, it decides whether to perform GPU recovery, and if it decides to perform GPU recovery, it releases the resources held in the default resource pool and Rebuilding resources in the default resource pool based on the record of resources held in the pool.

Optionally, the rendering instructions include a first detect function that detects the current state of the GPU. By invoking an operation instruction stored in memory 604, GPU 605 is used to perform the following steps, which replay the rendering instruction and obtain the first return value returned by the first detection function. Then, it is a step of judging whether or not the GPU is in the loss state based on the first return value.

Optionally, the GPU 605 is further used to perform the following steps by invoking an operation instruction stored in the memory 604, which step is performed after the GPU is determined to be in a loss state. It is a step of inserting a second detection function for detecting whether or not to execute recovery into the rendering instruction.

By invoking an operation instruction stored in the memory 604, the GPU 605 is further used to perform the following steps, which replays the rendering instruction and returns the second return value returned by the second detection function. Acquired,
This is a step of determining whether or not to execute GPU recovery based on the second return value.

Optionally, the GPU resource constructed in the default resource pool in response to the rendering resource includes the target GPU resource, and the rendering instruction includes life cycle information of the target GPU resource.

By invoking an operation instruction stored in memory 604, GPU 605 is further used to perform the following steps, which release the target GPU resource after the life cycle of the target GPU resource ends. , A step of deleting a record that the target GPU resource is a resource held in the default resource pool.

Optionally, by reconstructing resources in the default resource pool based on the records of resources held in the default resource pool, and then invoking operation instructions stored in memory 604, GPU 605 It is further used to perform a step, which determines whether all the resources held in the default resource pool have been successfully rebuilt, and all the resources held in the default resource pool. If the resource was not successfully rebuilt, it releases resources held in the default resource pool and, based on the record of resources held in the default resource pool, in the default resource pool. This is the step of rebuilding resources.

In embodiments, the memory 604 may be used to store software programs and modules, and the processor 603 may operate the software programs and modules stored in the memory 604 to perform various functional applications and data. Execute the process.

The memory 604 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, applications required by at least one function, and the like. The data storage area may be used to store data (for example, mirrored container data) created according to the use of the server. Further, the memory 604 may include high speed random access memory, and may be non-volatile memory such as at least one disk storage device and flash memory device, or other volatile solid state storage. -It may include a device.

The processor 603 may be an integrated circuit chip having signal processing capability. In some implementations, each step of the method may be completed by an integrated logic circuit, or software-type instructions within processor 603.

The processor 604 is a general purpose processor, digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete. Hardware components, which are capable of implementing or executing the methods, steps and logical block diagrams of public applications. A general purpose processor may be a microprocessor or any standard processor.

The steps of the methods disclosed in the embodiments of the present disclosure may be performed directly by a hardware decode processor or by a combination of hardware and software modules in the decode processor. Software modules are mature in the art such as random memory, flash memory, read only memory, programmable read only memory, electrically erasable programmable memory, registers, etc. It may exist in a storage medium. The storage medium may be located in the memory 604. Processor 603 reads the information in memory 604 and completes the above method steps with its hardware.

A computer storage medium is also provided in the embodiments of the present disclosure, and the computer storage medium stores a program. The program comprises all or part of the method steps of reconstructing a resource in the above method embodiments.

For ease of explanation, it will be apparent to those skilled in the art that in the above embodiments, the description of each embodiment has a particular emphasis. For details that are not detailed in one embodiment, reference may be made to the related descriptions in other embodiments.

It should be noted that the above method embodiments are described as a combination of a series of actions for the sake of clarity. Persons of ordinary skill in the art should understand that the present disclosure is not limited to the described order of actions, and that certain steps may be performed in a different order or concurrently with that according to the present disclosure. One of ordinary skill in the art should also understand that the embodiments described herein are all preferred embodiments and that the included actions and modules may not be necessary.

It should be appreciated that systems, devices and methods according to embodiments of the disclosure may be implemented in other forms. For example, the above-described device embodiments are merely exemplary. For example, the division of units is merely a logical functional division, and there may be other divisions in actual implementation means. For example, some units or components may be combined with each other, integrated into other systems, or some feature may be ignored or not implemented. Furthermore, the displayed or discussed interconnections or direct couplings or communication connections may be indirect couplings or communication connections via any interface, device or unit, electrical, mechanical or Other formats may be used.

Units described as discrete components may or may not be physically separated, and components shown as units may be physically located at one location or distributed across multiple network units. It may or may not be a unit. All or some units may be selected as needed to achieve the objectives of the present disclosure.

Further, the functional units in the embodiments according to the present disclosure may be integrated into one processing unit, or the units may be physically separate units, or two or more units may be combined. It may be integrated into one unit. The above integrated units may be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and is sold or used as an independent product, the integrated unit may be stored on a computer-readable storage medium. Based on such an understanding, the essence of the technical solution of the present disclosure, the part contributing to the prior art, or all or part of the technical solution may be realized in the form of a software product. The computer software product is stored on a storage medium and may be a computer device (personal computer, server, or web device) that performs all or part of the method steps described in the embodiments according to the present disclosure. ). The storage medium can store program code such as USB flash disk, removable hard disk, read only memory (ROM), random access memory (RAM), diskette or optical disk Any medium may be used.

The embodiments described above are merely examples and do not limit the technical solutions of the present disclosure. Although the detailed description has been made in connection with the above embodiments, modifications and alternatives may be made by those skilled in the art to the technical solutions or some technical features of the present disclosure. Any such modifications or equivalents do not constitute a technical solution that deviates from the spirit and scope of the technical solution of the embodiments of the present disclosure.

Claims (11)

A method of reconfiguring resources, the method being applied to a cloud interactive system having a user device and a server, wherein the user device is a graphics processing unit (GPU) corresponding to a default resource pool. ), the method is:
The user device receiving rendering data sent by the server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions;
The user device recording a GPU resource constructed in the default resource pool according to the rendering resource as a resource held in the default resource pool;
The user device determines whether the GPU is in a loss state according to the rendering instruction, and determines whether to perform a GPU recovery when the GPU is in a loss state. And a step of releasing the resources held in the default resource pool by the user device if it is determined to perform the GPU recovery. Rebuilding resources in the default resource pool based on records;
Have
GPU resources constructed in the default resource pool according to the rendering resources include target GPU resources, and the rendering instructions include life cycle information of the target GPU resources;
The method is:
The user device releases the target GPU resource after the end of the life cycle of the target GPU resource and deletes the record that the target GPU resource is a resource held in the default resource pool. Steps to do;
The method further comprising: A method of rebuilding resources, the method being applied to a cloud interactive system having a user device and a server, wherein the user device is a graphics processing unit (GPU) corresponding to a default resource pool. ), the method is:
Said user device receiving rendering data sent by said server, said rendering data comprising rendering instructions and rendering resources corresponding to said rendering instructions;
The user device recording GPU resources constructed in the default resource pool according to the rendering resources as resources held in the default resource pool;
The user device determines whether the GPU is in a loss state according to the rendering instruction, and determines whether to perform a GPU recovery when the GPU is in a loss state. And the user device releases resources held in the default resource pool and determines that resources held in the default resource pool are determined to be performed by the GPU recovery. Rebuilding resources in the default resource pool based on records;
Have
After rebuilding resources in the default resource pool based on a record of the resources held in the default resource pool, the method is:
The user device determines whether all the resources held in the default resource pool have been successfully rebuilt, and all the resources held in the default resource pool have been successfully rebuilt. If not, release resources held in the default resource pool and rebuild resources in the default resource pool based on a record of resources held in the default resource pool Steps to do;
The method further comprising: The rendering instruction includes a first detection function for detecting a current state of the GPU;
The user device determines whether the GPU is in a loss state according to the rendering instruction:
The user device replays the rendering instruction and obtains a first return value returned by the first detection function; and the user device loses the GPU based on the first return value. The step of determining whether or not
The method according to claim 1 or 2, comprising: After it is determined that the GPU is in a loss state, the method is:
The user device inserting a second detection function in the rendering instruction to detect whether to perform the GPU recovery;
And the step of determining whether the user device performs the GPU recovery includes:
The user device replaying a rendering instruction and obtaining a second return value returned by the second detection function; and the user device performing the GPU recovery based on the second return value Determining whether to do;
The method according to claim 1 or 2, comprising: A user device included in a cloud interactive system, the cloud interactive system also includes a server, the user device having a graphics processing unit (GPU) corresponding to a default resource pool. , Said user device is:
A receiving unit configured to receive rendering data sent by the server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions;
A recording unit for recording the GPU resource constructed in the default resource pool according to the rendering resource as a resource held in the default resource pool;
A determining unit that determines whether the GPU is in a loss state according to the rendering command, and determines whether to perform GPU recovery when the GPU is in a loss state; and the GPU Releasing a resource held in the default resource pool when it is determined to perform recovery, and based on a record of the resources held in the default resource pool, the default resource pool A reconstruction unit for reconstructing resources at:
Have
GPU resources constructed in the default resource pool according to the rendering resources include target GPU resources, and the rendering instructions include life cycle information of the target GPU resources;
The user device is:
Configured to release the target GPU resource after the life cycle of the target GPU resource has ended and delete the record that the target GPU resource is a held resource in the default resource pool Deletion unit;
A user device further comprising: A user device included in a cloud interactive system, the cloud interactive system also includes a server, the user device having a graphics processing unit (GPU) corresponding to a default resource pool. , Said user device is:
A receiving unit configured to receive rendering data sent by the server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions;
A recording unit for recording the GPU resource constructed in the default resource pool according to the rendering resource as a resource held in the default resource pool;
A determining unit that determines whether the GPU is in a loss state according to the rendering command, and determines whether to perform GPU recovery when the GPU is in a loss state; and the GPU Releasing a resource held in the default resource pool when it is determined to perform recovery, and based on a record of the resources held in the default resource pool, the default resource pool A reconstruction unit for reconstructing resources at:
Have
The reconstruction unit is
All resources held in the default resource pool have been successfully rebuilt after rebuilding resources in the default resource pool based on a record of held resources in the default resource pool And if not all the resources held in the default resource pool have been successfully rebuilt, release the held resources in the default resource pool, Rebuilding resources in the default resource pool based on a record of the resources held in the resource pool;
User device further configured. The rendering instruction includes a first detection function for detecting a current state of the GPU;
The determining unit replays the rendering instruction, obtains a first return value returned by the first detection function, and determines whether the GPU is in a loss state based on the first return value. Configured to:
The user device according to claim 5 or 6. An insertion unit configured to insert a second detection function into the rendering instruction to detect whether to perform the GPU recovery after it is determined that the GPU is in a loss state;
Further comprising, the determining unit replays the rendering instruction, obtains a second return value returned by the second detection function, and performs the GPU recovery based on the second return value. Further configured to determine whether;
The user device according to claim 5 or 6. A cloud interactive system having a user device and a server, wherein the user device is the user device according to any one of claims 5 to 8. A non-volatile storage medium for storing one or more computer programs, the computer programs having instructions to be executed by a processor having one or more memories, the instructions being executed by a computer. Causing the computer to perform an operation, the operation comprising:
Receiving rendering data sent by a server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions;
Recording a GPU resource constructed in a default resource pool according to the rendering resource as a resource held in the default resource pool;
A step of determining whether the GPU is in the loss state according to the rendering command, and determining whether to execute the GPU recovery when the GPU is in the loss state; and the GPU recovery Release resources held in the default resource pool when determined to execute, and resources in the default resource pool based on a record of resources held in the default resource pool Reconstructing;
Have
GPU resources constructed in the default resource pool according to the rendering resources include target GPU resources, and the rendering instructions include life cycle information of the target GPU resources;
The operation is:
The computer releasing the target GPU resource after the end of the life cycle of the target GPU resource and deleting the record that the target GPU resource is a held resource in the default resource pool; ;
A non-volatile storage medium further comprising: A non-volatile storage medium for storing one or more computer programs, the computer programs having instructions to be executed by a processor having one or more memories, the instructions being executed by a computer. Causing the computer to perform an operation, the operation comprising:
Receiving rendering data sent by a server, the rendering data including rendering instructions and rendering resources corresponding to the rendering instructions;
Recording a GPU resource constructed in a default resource pool according to the rendering resource as a resource held in the default resource pool;
A step of determining whether the GPU is in the loss state according to the rendering command, and determining whether to execute the GPU recovery when the GPU is in the loss state; and the GPU recovery Release resources held in the default resource pool when determined to execute, and resources in the default resource pool based on a record of resources held in the default resource pool Reconstructing;
Have
After rebuilding resources in the default resource pool based on the records of resources held in the default resource pool, the operations are:
The computer determines whether all the resources held in the default resource pool have been successfully rebuilt, and all the resources held in the default resource pool have been successfully rebuilt. If not, releasing resources held in the default resource pool and reconstructing resources in the default resource pool based on a record of resources held in the default resource pool. ;
A non-volatile storage medium further comprising:

Images