CN115412559A - Terminal cloud resource cooperation method, electronic equipment and readable storage medium - Google Patents

Abstract

The application discloses a terminal cloud resource coordination method, an electronic device and a readable storage medium, which comprise the following steps: receiving an end cloud resource cooperation request sent by a target terminal aiming at an original video, wherein the end cloud resource cooperation request carries video type information of the original video and video playing capacity information of the target terminal; according to the video type information and the video playing capability information, determining encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information; converting an original video into a corresponding target video code stream according to the coding and decoding parameters and the video preprocessing cooperative information; and sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to a target terminal together, so that the target terminal can convert the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information. The cloud game image management method and the cloud game image management system solve the technical problem that the cloud game image effect is poor due to poor service resource management effect of the cloud server.

Description

Device-cloud resource collaboration method, electronic device, and readable storage medium

technical field

The present application relates to the technical field of resource management, and in particular to a device-cloud resource collaboration method, electronic equipment, and a readable storage medium.

Background technique

With the continuous development of 5G technology, cloud games, a new type of game service structure, are becoming more and more widely used. It uses the computing resources of cloud servers to provide game terminal users with a better gaming experience. The running and rendering logic is migrated to the cloud server. The game terminal only needs to have video decoding and video playback capabilities. Currently, the service resources of the cloud server are shared by each game terminal. , the cloud server will perform a certain degree of content analysis and video pre-processing on the game screen frames, but because the resource information between the cloud server and each game terminal cannot communicate, the cloud server cannot customize resource allocation for each game terminal , and the service resources of the cloud server are limited, that is, the limited service resources of the cloud server have not been fully and effectively utilized, and the image quality experience of cloud games cannot be further improved due to the poor management of service resources of the cloud server, that is, The current cloud game screen effect is poor.

Contents of the invention

The main purpose of this application is to provide a device-cloud resource collaboration method, electronic equipment, and a readable storage medium, aiming to solve the technical problem in the prior art that the cloud game screen effect is poor due to poor service resource management of the cloud server .

In order to achieve the above purpose, this application provides a device-cloud resource coordination method, which is applied to a cloud server, and the device-cloud resource coordination method includes:

receiving a device-cloud resource coordination request sent by the target terminal for the original video, wherein the device-cloud resource coordination request carries video type information of the original video and video playback capability information of the target terminal;

According to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information;

converting the original video into a corresponding target video stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server to encode the original video, The video preprocessing coordination information is used by the cloud server to determine a video preprocessing strategy of the original video before encoding the original video;

jointly sending the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal, so that the target terminal can, according to the codec parameters and the video preprocessing coordination information, Converting the target video code stream into a corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination information is used for the target After decoding the target video code stream, the terminal determines the video preprocessing policy of the video to be played.

In order to achieve the above purpose, the present application also provides a device-cloud resource coordination method, which is applied to a target terminal, and the device-cloud resource coordination method includes:

Sending a terminal-cloud resource coordination request to the cloud server, wherein the terminal-cloud resource coordination request carries video type information of the target video and video playback capability information of the target terminal, for the cloud server to use according to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information, and convert the original video according to the codec parameters and the video preprocessing coordination information is the corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server to encode the original video Before determining the video preprocessing strategy of the original video;

receiving the codec parameters, the video preprocessing coordination information and the target video code stream sent by the cloud server;

Converting the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the target terminal to process the target video code stream For decoding, the video preprocessing coordination information is used for the target terminal to determine the video preprocessing policy of the video to be played after decoding the target video code stream.

In order to achieve the above purpose, the present application also provides a terminal-cloud resource coordination device, which is applied to a cloud server, and the terminal-cloud resource coordination device includes:

The first receiving module is configured to receive the device-cloud resource coordination request sent by the target terminal for the original video, wherein the device-cloud resource coordination request carries the video type information of the original video and the video playback capability of the target terminal information;

A determining module, configured to determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information according to the video type information and the video playback capability information;

The first conversion module is configured to convert the original video into a corresponding target video code stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server to The original video is encoded, and the video preprocessing coordination information is used by the cloud server to determine a video preprocessing strategy of the original video before encoding the original video;

The first sending module is configured to jointly send the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal for the target terminal to use according to the codec parameters and the The video preprocessing coordination information is used to convert the target video code stream into the corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing The coordination information is used by the target terminal to determine the video preprocessing policy of the video to be played after decoding the target video code stream.

To achieve the above purpose, the present application also provides a device-cloud resource coordination device, which is applied to a target terminal, and the device-cloud resource coordination device includes:

The second sending module is configured to send a device-cloud resource coordination request to the cloud server, wherein the device-cloud resource coordination request carries the video type information of the target video and the video playback capability information of the target terminal for the The cloud server determines the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information according to the video type information and the video playback capability information, and determines the codec parameters and the video preprocessing coordination information according to the codec parameters and the video preprocessing coordination information , converting the original video into a corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server to Determining a video preprocessing strategy for the original video before encoding the original video;

A second receiving module, configured to receive the codec parameters, the video preprocessing coordination information, and the target video code stream sent by the cloud server;

The second conversion module is configured to convert the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used for the target terminal The target video code stream is decoded, and the video preprocessing coordination information is used by the target terminal to determine a video preprocessing policy of the video to be played after decoding the target video code stream.

The present application also provides an electronic device, the electronic device includes: a memory, a processor, and a program of the device-cloud resource collaboration method stored on the memory and operable on the processor, the device-cloud When the program of the resource coordination method is executed by the processor, the steps of the above-mentioned device-cloud resource coordination method can be realized.

The present application also provides a computer-readable storage medium, where a program for implementing a device-cloud resource coordination method is stored on the computer-readable storage medium. When the program for the device-cloud resource coordination method is executed by a processor, the above-mentioned terminal Steps of a cloud resource collaboration method.

The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned device-cloud resource coordination method are implemented.

The present application provides a device-cloud resource coordination method, electronic equipment, and a readable storage medium, which are applied to a cloud server, that is, receiving a device-cloud resource coordination request sent by a target terminal for an original video, wherein the device-cloud The resource coordination request carries the video type information of the original video and the video playback capability information of the target terminal; then, according to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding The video preprocessing coordination information realizes the purpose of interactively determining the codec parameters corresponding to the target terminal and the corresponding video preprocessing coordination information through the information interaction between the cloud server and the target video for the target video; according to the codec parameters Cooperate with the video pre-processing information to convert the original video into a corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video pre-processing is coordinated The information is used for the cloud server to determine the video preprocessing strategy of the original video before encoding the original video; and send the codec parameters, the video preprocessing coordination information and the target video code stream together to the target terminal, so that the target terminal converts the target video code stream into a corresponding video to be played according to the codec parameter and the video preprocessing coordination information, wherein the codec parameter is used The target terminal decodes the target video code stream, and the video preprocessing coordination information is used for the target terminal to determine the video preprocessing strategy of the video to be played after decoding the target video code stream ; Since the video preprocessing coordination information is used to determine the task assignment of the video preprocessing task of the target video in the target terminal and the cloud server, and then the cloud server and the target terminal determine whether to perform preprocessing on the video preprocessing task according to the task assignment, Moreover, since the codec parameters are used to encode the target video into the target video code stream after the cloud server determines whether to co-process the target video according to the video preprocessing task, and the target terminal The preprocessing task determines whether to decode the target video code stream into the target video code before co-processing the target video, that is, even if there is a video preprocessing task in the cloud server or the target terminal, the video preprocessing of the target video is also It will be completed before encoding or after decoding the target video, which will not cause encoding distortion to affect the picture quality. At the same time, the allocation of video preprocessing tasks depends on the video playback capability information, that is, the When the service resources of the target video are sufficient to perform a certain degree of content analysis and video processing on the target video, the video preprocessing task assigned according to the video playback capability will use the target terminal service resources to perform video preprocessing on the target video instead of only through the cloud The server performs video content analysis and video preprocessing before video encoding, that is, the purpose of effectively utilizing the idle service resources of the target terminal is realized, and the limited service resources of the cloud server are also fully utilized, so It overcomes the technical defect that the video quality experience of the target video cannot be further improved due to the poor service resource management effect of the cloud server, that is, the video picture effect of the target video is improved, so the picture of the cloud game screen is also improved Effect.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.

FIG. 1 is a schematic flowchart of the first embodiment of the device-cloud resource coordination method of the present application;

FIG. 2 is a schematic diagram of a cloud game scene of the device-cloud resource collaboration method of the present application;

FIG. 3 is a flowchart of video content analysis performed by a cloud server of the device-cloud resource collaboration method of the present application;

FIG. 4 is a flow chart of video content analysis performed by a target terminal in the device-cloud resource collaboration method of the present application;

FIG. 5 is a schematic diagram of the second video enhancement task of the device-cloud resource collaboration method of the present application;

FIG. 6 is a schematic flowchart of the second embodiment of the device-cloud resource coordination method of the present application;

FIG. 7 is a schematic diagram of a third embodiment of the device-cloud resource coordination device of the present application;

FIG. 8 is a schematic diagram of a fourth embodiment of the device-cloud resource coordination device of the present application;

FIG. 9 is a schematic diagram of a device structure of a hardware operating environment involved in a device-cloud resource collaboration method in an embodiment of the present application.

The realization of the purpose, functions and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

In order to make the above objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Embodiment one

First of all, it should be understood that in the current video or image processing process in the cloud scene, the video is usually generated on the cloud server side, and then the video image of the video is collected and processed accordingly, and then the processed video The image is encoded, and then decoded by the user terminal to finally display the video image. That is, the current requirements for the user terminal are simplified to the video decoding capability and video playback capability. For some specific user terminals, it is only for the decoded Video images are post-processed, such as sharpening, blurring, or noise reduction. However, since the video pre-processing work is completed by the cloud server, the information between the cloud server and the user terminal cannot communicate, which leads to the cloud server performing video pre-processing. During processing, the processing parameters can only be preset according to the number of user terminals carried by the cloud server or the pre-processing of video images can be performed according to the established processing parameters. However, due to differences in service performance and computing resources of different user terminals, this leads to The video quality of different user terminals is good or bad. Therefore, the video quality of the user terminal does not match the user's expected video playback effect. In the worst case, at the same time, the idle computing resources of the user terminal are not fully utilized. Taking cloud games as an example, in order to reduce the impact of video encoding distortion on game quality, the cloud server needs to combine the visual characteristics of the human eye to Performing video content analysis and video pre-processing work on cloud game images before will undoubtedly further increase the computing resource overhead of the cloud server. Under the limited cloud server computing resources and the ebb and flow of computing resources, the cloud server cannot serve users. To provide a better picture quality experience of cloud games, there is an urgent need for a method to solve the poor picture quality of cloud games caused by the ineffective management of service resources of cloud servers.

The embodiment of the present application provides a device-cloud resource coordination method, which is applied to a cloud server. In the first embodiment of the device-cloud resource coordination method of the present application, referring to FIG. 1 , the device-cloud resource coordination method includes:

Step S10, receiving a device-cloud resource coordination request sent by the target terminal for the original video, wherein the device-cloud resource coordination request carries video type information of the original video and video playback capability information of the target terminal;

Step S20, according to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information;

In this embodiment, it should be noted that the communication connection between the target terminal and the cloud server, wherein the communication connection may be through a TCP (Transmission Control Protocol, communication transmission protocol) communication connection, so The above-mentioned target terminal is used to represent an intelligent terminal that requires terminal-cloud resource coordination, and may be an intelligent terminal that has idle computing resources or an intelligent terminal that does not have idle computing resources, specifically, a smart phone, a player game terminal, and a tablet computer. A cloud server is used to represent a cloud server that performs terminal-cloud resource collaboration. The terminal-cloud resource collaboration method is applied to the video or image processing process in the cloud scene, and is used for the interaction protocol and data format between the same cloud server and the target terminal. The cloud Specifically, the scene may be a real-time communication (Real-time Communications, RTC) scene, and the real-time communication scene includes but is not limited to many scenes such as remote call, remote office, interactive live broadcast, cloud game, and video conference. In the above, assuming that the real-time communication scene is a cloud game scene, even for a user terminal with relatively limited graphics processing and data computing capabilities, the cloud game technology of the cloud server can enable it to run high-quality games, refer to Figure 2, Figure 2 is A schematic diagram representing a cloud game scene, the user 11 interacts with the user terminal 12, and since the cloud server 12 and the user terminal 13 are connected by communication, and the game is running in the cloud server 12, the cloud server 12 collects game video images, and then the The game video image is encoded, and the code stream is transmitted to the user terminal 13 through network transmission. After the user terminal 13 decodes the code stream, it displays the video image according to the decoding result.

In addition, it should be noted that the original video is composed of original video frames, specifically videos that have not undergone video preprocessing and are waiting to be sent to the target terminal, and the original video frames are used to represent video key frames embodying video content, The device-cloud resource coordination request is used to coordinate the service resources of the target terminal and the service resources of the cloud server, that is, the target terminal sends the device-cloud resource coordination request, and the cloud server coordinates the service resources of the target terminal and the service resources of the cloud server Carry out collaborative management, and then deploy the video processing parameters that are most suitable for the characteristics of the target terminal through the cooperation and collaboration of the cloud server and the smart terminal. Therefore, when the target terminal device sends a request for device-cloud resource collaboration, The video type information of the target video and the video playback capability information of the target terminal will be carried, wherein the video playback capability information is used to characterize the video playback capability of the target video, and the video type information is used to characterize the video playback capability of the target video Video type, for example, in an implementable manner, assuming that the target video is a cloud game video, for cloud games corresponding to different cloud game videos, the requirements for game delay are different, that is, for cloud games The delay in the video encoding and decoding process is different. For cloud games with high game requirements, when the cloud game screen meets the user's expected playback effect, the delay in the encoding and decoding process should be minimized. For cloud games with low game requirements , when the delay of the encoding and decoding process is appropriate, the clarity of the cloud game screen can be fully ensured.

Additionally, it should be noted that the video playback capability information includes video codec capability information and video processing capability information, wherein the video codec capability information is used to characterize the video codec capability of the target terminal, and the The video codec capability is used to determine the codec parameters when the target video is transmitted over the network between the cloud server and the target terminal. (AOMedia Video 1, video coding format), multi-channel decoding, code stream SVC (Scalable Video Coding, layered video coding), code stream SCC (HEVC SCC Profile, screen content coding), YUV444, YUV422, HDR10 (High Dynamic Range 10 , high dynamic range imaging), high-performance mode, and low-latency mode, among others, YUV444 and YUV422 are the two data storage formats of uncompressed video, "Y" is used to represent the gray value, "U " and "V" are used to describe the color and saturation of the image, that is, the color of the specified pixel, where the three component samples of YUV444 are Y:U:V=4:4:4, and the three component samples of YUV422 are Y:U:V=4:1:1, YUV444 has more detailed and more accurate colors, the high-performance mode is a mode that can manually control the operating frequency of the chip to achieve higher performance, and the video processing capability information is used for To characterize the video processing capabilities of the target terminal, the video processing capabilities include video image processing capabilities, video post-processing capabilities, and resource management capabilities, wherein the image processing capabilities can be controlled by processing frame rates, processing smooth control, and image modes Specific information is embodied, for example, the processing frame rate can be 60fps or 120fps, etc., the processing smooth control can be whether to support the processing frame loss strategy, the image mode can be theater mode or vivid mode, etc., any image The mode is composed of specific parameter information such as contrast, brightness, and saturation. The video post-processing capability can be reflected by whether it supports black screen detection, video sharpening, HDR display, and video super-resolution. Among them, video super-resolution is passed Whether there are corresponding specified video super algorithm parameters is reflected. Video sharpening is reflected by whether there are corresponding specified sharpening areas and corresponding specified sharpening algorithm parameters. The resource management capability can be determined by the number of decoders, the number of decoding buffers, Specific information such as the number of SurfaceView instances, resource occupancy detection, CPU frequency changes, decoding chip capability changes, and device temperature changes are reflected.

In addition, it should be noted that the video processing capability is used to determine the video pre-processing coordination information, and the video pre-processing coordination information is used by the cloud server to determine the original A video preprocessing strategy for the video, and a video preprocessing strategy for the target terminal to determine the video to be played after decoding the target video code stream, the video preprocessing strategy is used to assign video preprocessing tasks , the video preprocessing tasks include that the video preprocessing tasks are all allocated to the cloud server, the video preprocessing tasks are all allocated to the target terminal, and the video preprocessing tasks are partially allocated to the cloud server and Part of it is allocated to the target terminal, that is, the video preprocessing coordination information is used to indicate the allocation of the most reasonable video preprocessing task between the cloud server and the target terminal according to the video processing capability of the target terminal, and then realize the cloud server and the target terminal. The terminals are respectively in the optimal video processing configuration for pre-processing the target video, which can realize more reasonable cooperation and collaboration between the cloud server and the smart terminal, thereby providing a further video experience.

In addition, it should be noted that determining that the target terminal does not have video processing capabilities means that the target terminal only has basic video decoding functions and video playback functions, and does not have video image processing capabilities realized by hardware configuration. The ability of the target terminal to have video processing means that the target terminal has not only the basic video playback capability, but also the video image processing capability implemented by hardware. According to the different video image processing capabilities, it can be divided into two situations. The first kind of situation Because at a given video frame rate, only partial area video image processing can be completed, and the whole image processing cannot be completed. The second type of situation is that at a given video frame rate, only part of the entire video image processing task can be completed. The entire process cannot be completed. For example, in a 1080p@60fps video application scenario, smart device A has a specific video sharpening algorithm implemented by hardware, but due to limited device performance, at a video frame rate of 60fps, it can only process The video size is 540p. At this time, it is determined that device A has partial video image processing capabilities. Having full video processing capabilities means that in addition to basic video playback functions, it also has specific video image processing capabilities implemented by hardware. Under a certain video frame rate, it can complete the video image processing of all regions and all processes.

As an example, steps S10 to S20 include: receiving a device-cloud resource coordination request sent by the target terminal for the target video, and obtaining the original video corresponding to the device-cloud resource coordination request, wherein the device-cloud resource coordination request Request the video type information of the target video and the video playback capability information of the target terminal; determine the corresponding codec parameters and corresponding video preprocessing of the original video according to the video type information and the video playback capability information collaborative information.

Wherein, the step of determining the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information according to the video type information and the video playback capability information includes:

Determine the codec parameters corresponding to the original video according to the video type information and the video codec capability information, and determine the video preprocessing coordination information corresponding to the original video according to the video processing capability information.

Step S30, converting the original video into a corresponding target video stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server to process the original video Encoding, the video preprocessing coordination information is used for the cloud server to determine the video preprocessing strategy of the original video before encoding the original video;

Step S40, sending the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal, so that the target terminal can use the codec parameters and the video preprocessing Coordination information, converting the target video code stream into a corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination information is used for After the target terminal decodes the target video code stream, it determines the video preprocessing policy of the video to be played.

In this embodiment, it should be noted that, according to the different device capabilities of the target terminal, the video preprocessing tasks assigned by the video preprocessing coordination information to the target terminal and the cloud server are also different. Taking a certain video image of the target video as an example , the target terminal may have the full video image processing capability of the video image, may also have the video image processing capability of the video image, or may not have the video image processing capability of the video image, when the target terminal has the full video image processing capability When the processing capacity is low, the cloud server is only responsible for sampling and encoding the video image, and then when the cloud server sends the encoded video image to the target terminal, the target terminal decodes and processes the encoded video image. When the target terminal does not have video image processing capabilities, the cloud server continues to be responsible for related logic such as running and rendering, while the target terminal is responsible for decoding and playing. When the target terminal has some video images, the corresponding processing tasks of the video images are reasonably Division, for the cloud server and the target terminal, wherein, the division of processing tasks can be based on the difference in video image processing capabilities of the cloud server and the target terminal, the video image is divided into regional image processing, for example, assuming that the video image is divided into A and B two Large areas, in which, area A is processed by the cloud server through its own video image processing capability, and area B is processed by the target terminal through its own video image processing, and for the target video, if the video preprocessing task is used to instruct the cloud If the server does not perform collaborative processing on all target video frames that make up the target video, it can be determined that the target terminal has full video processing capabilities. If the video preprocessing task is used to instruct the cloud server to perform collaborative processing on all target video frames that make up the target video , then it can be determined whether the target terminal does not have the video processing capability according to the processing method of the cloud server for each target video frame. It can be determined that the target terminal has some video processing capabilities; otherwise, it can be determined that the target terminal does not have video processing capabilities. Among them, the cloud server performs video image processing steps before the cloud server performs video encoding. That is, video In pre-preprocessing, the step of video image processing by the target terminal is completed after the target terminal performs video decoding, that is, video post-preprocessing.

As an example, steps S30 to S40 include: if the video preprocessing coordination information is to determine that there is first video preprocessing coordination information assigned to the cloud server for the video preprocessing task of the target video, then according to the A video preprocessing task corresponding to the first video preprocessing coordination information, performing video preprocessing on the target video, and encoding the target video after video preprocessing according to the codec parameters, to obtain the target video code stream, if the video preprocessing coordination information is to determine that there is no second video preprocessing coordination information assigned to the cloud server for the video preprocessing task of the target video, then according to the codec parameters, the video The preprocessed target video is encoded to obtain the target video code stream, wherein the video codec parameters may specifically be resolution, code rate, and frame rate, etc.; the codec parameters, the video preprocessing collaborative information And the target video code stream is jointly sent to the target terminal, so that the target terminal converts the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information , wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination information is used by the target terminal to determine the target video code stream after decoding the target video code stream. The video preprocessing strategy for the video to be played is described, wherein the collaborative processing method is to perform complete video image processing on all target video frames of the target video.

Wherein, the step of converting the original video into a corresponding target video code stream according to the codec parameters and the video preprocessing coordination information includes:

Step A10, according to the video preprocessing collaboration information, determine whether to collaboratively preprocess the original video;

Step A20, if yes, perform video preprocessing on the original video according to the video preprocessing coordination information to obtain the preprocessed original video;

Step A30, encoding the preprocessed original video according to the codec parameters to obtain the target video code stream;

Step A40, if not, encode the preprocessed original video according to the codec parameters to obtain the target video code stream.

As an example, steps A10 to A40 include: determining whether to cooperatively preprocess the original video according to the video preprocessing cooperation information; , performing video preprocessing on the original video to obtain the preprocessed original video; according to the codec parameters, encoding the preprocessed original video to obtain the target video code stream; if it is determined that there is no coordination Preprocessing the original video is encoding the preprocessed original video according to the codec parameters to obtain the target video code stream. When the cloud server does not cooperate to pre-process the original video, it means that the video playback capability information of the target terminal is sufficient to indicate that the target terminal has complete video processing capabilities, and then the video pre-processing task of the original video is completely handed over to the target terminal to complete. That is, at this time, not only the idle service resources of the target terminal are used, but also the service resources of the cloud server are saved, and the service resources between the cloud server and the target terminal are reasonably coordinated for the original video based on simple information interaction. Purpose.

Wherein, the preprocessed original video includes single-cooperative original video and multi-cooperative original video, and according to the video preprocessing collaboration information, video preprocessing is performed on the original video to obtain the preprocessed original video Steps include:

Step B10, determining a video preprocessing task corresponding to the video preprocessing collaborative information, wherein the video preprocessing task includes a video analysis task and a video enhancement task;

Step B20, if the collaborative processing task is a multi-cooperative preprocessing task, perform collaborative analysis on the original video according to the video analysis task to obtain collaborative analysis information;

Step B30, according to the video enhancement task, collaboratively enhance the target video to obtain the multi-cooperative original video;

Step B40, if the collaborative processing task is a single collaborative preprocessing task, according to the video enhancement task, collaboratively enhance the target video to obtain the single collaborative original video.

In this embodiment, it should be noted that the video preprocessing task includes a video enhancement task and a video analysis task, that is, the collaborative processing task includes a single cooperative preprocessing task and a multi-cooperative preprocessing task, and the single cooperative preprocessing task The processing task is a collaborative preprocessing task that only performs video image enhancement on the target video, the multi-cooperative preprocessing task is a collaborative preprocessing task that performs video content analysis and video image enhancement on the target video, and the single collaborative preprocessing task The original video is the target video after the cloud server only performs video image enhancement on the target video, and the multi-cooperative original video is the target video after the cloud server performs video image enhancement and video image analysis on the target video, wherein, If the collaborative processing task is a multi-coordinated processing task, the computing capability of the target terminal can be used to determine whether the terminal performing video content analysis is a cloud server or a target terminal, wherein the video content analysis is used to guide video processing coordination and Video codec collaboration, for example, in an implementable manner, refer to FIG. 3, which is a flow chart showing the cloud server performing video content analysis. When the cloud server performs video content analysis, that is, the target video is video During image analysis, its steps are before the step of video image enhancement to the target video. With reference to FIG. 4, FIG. 4 shows the flow chart of the target terminal performing video content analysis. During video image analysis, the step is before the step of performing video image enhancement on the target video.

As an example, steps B10 to B40 include: determining the video preprocessing task corresponding to the video preprocessing coordination information according to the computing capability of the target terminal, and if the computing capability is not greater than the preset computing capability threshold, then Determine that the collaborative processing task is a multi-cooperative preprocessing task, and if the computing capability is greater than the preset computing capability threshold, determine that the collaborative processing character is a single collaborative preprocessing task; if the collaborative processing task is a multi-cooperative The preprocessing task is to perform collaborative analysis on the original video according to the video analysis task to obtain collaborative analysis information, wherein the collaborative analysis information is used to guide the cloud server to cooperatively enhance the target video; according to the The video enhancement task is to cooperatively enhance the target video to obtain the multi-cooperative original video; if the cooperative preprocessing task is a single cooperative preprocessing task, then according to the video enhancement task, cooperatively enhance the target video to obtain the multi-cooperative original video. The description is coordinated with the original video.

Wherein, the single collaborative original video includes an overall collaborative enhanced original video and a partial collaborative enhanced original video, and the step of obtaining the single collaborative original video by collaboratively enhancing the target video according to the video enhancement task includes:

Step C10, if the video enhancement task is the first video enhancement task completely assigned to the cloud server by the video enhancement task, then according to the first video enhancement task, perform overall enhancement on the original video to obtain the The overall synergistic enhancement of the target video;

Step C20, if the video enhancement task is the first video enhancement task that the video enhancement task is completely assigned to the cloud server, perform overall enhancement on the original video according to the first video enhancement task to obtain the The overall collaborative enhancement of the target video is described.

In this embodiment, it should be noted that the first video enhancement task is used to represent that the cloud server performs overall video processing on all video images of the target video through the relevant algorithm and cooperative preprocessing tasks, and the second video enhancement task The task is used to represent that the video part of the video image of the target video is processed through part of the algorithm in cooperation with the preprocessing task, wherein the video part processing may be that the target video has a target video frame and is processed by the cloud server.

As an example, steps C10 to C20 include: if the video enhancement task is the first video enhancement task that the video enhancement task is fully assigned to the cloud server, according to the first video enhancement task, The overall enhancement of the original video is performed to obtain the overall collaborative enhancement target video, wherein the first video enhancement task is used to represent a video enhancement task that does not have a video enhancement subtask; if the video enhancement task is the video enhancement The task is completely assigned to the first video enhancement task of the cloud server, and the original video is overall enhanced according to the first video enhancement task to obtain the overall collaborative enhancement target video.

Wherein, the step of performing partial enhancement on the original video according to the second video enhancement task to obtain the partial collaborative enhancement of the original video includes:

Step D10, acquiring a video enhancement subtask corresponding to the second video enhancement task;

Step D20, according to the video enhancement sub-task, perform partial enhancement on the original video to obtain the partial cooperatively enhanced target video.

In this embodiment, it should be noted that the second video enhancement task is used to represent a video enhancement task with a video enhancement subtask, and the video enhancement subtask can be independently deployed on a cloud server or a target terminal according to an algorithm. For a task of separate enhancement, for example, in an implementable manner, refer to FIG. 5, which is a schematic diagram showing a second video enhancement task, wherein the second video enhancement task B consists of video enhancement subtask b, video The enhancement subtask c and the video enhancement subtask d are composed. The video enhancement subtask b processes the video image of the target video through the processing algorithm x, and the cooperative processing subtask c processes the video image of the target video through the processing algorithm y, and the cooperative processing Task d processes the video image of the target video through the processing algorithm z. If part of the video enhancement subtasks of the second enhanced video task run on the cloud server and part run on the target terminal, then according to the computing power of the target terminal, Distinguish whether the processing algorithm corresponding to the video enhancement subtask is running on the cloud server or the target terminal. When the second video enhancement task is deployed on the cloud server, the target terminal does not have the video processing capability at this time. When there is a video enhancement subtask Deployed on the cloud server, the target terminal has video processing capability at this time.

As an example, step D10 to step D40 include: obtaining the video enhancement subtask corresponding to the video preprocessing collaboration information; according to the video enhancement subtask, performing partial processing on the original video Enhanced to obtain the part of the collaboratively enhanced target video.

Wherein, after the step of jointly sending the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal, the device-cloud resource coordination method further includes:

Step E10, if the current running state parameter sent by the target terminal is received, predict whether to perform the codec parameter and the video preprocessing coordination information within the preset running time period according to the current running state parameter Adjustment;

Step E20, if the current running state parameter sent by the target terminal is received, predict whether to perform the codec parameter and the video preprocessing coordination information within the preset running time period according to the current running state parameter Adjustment.

In this embodiment, it should be noted that when the target terminal plays the target video, the target will eventually report its own running state to the cloud server in real time, so the current running state parameter is used to represent the current running state , the current running state parameters include CPU/GPU frequency information, hardware temperature information, power consumption information, etc. After receiving the current running state parameters, the cloud server will intelligently predict the probability of freezing in the future time period. If the hardware resources cannot meet the performance requirements, it can interact with the cloud server to dynamically adjust the codec parameters and video preprocessing coordination information to ensure the video quality experience.

As an example, step E10 to step E20 include: if the current operating state parameter sent by the target terminal is received, then determine whether the current operating state parameter is greater than the preset current operating state parameter threshold, and if it is greater, then predict the Adjusting the video playback coordination strategy within a preset running time period, wherein, when any running parameter can be set to be greater than a preset running parameter threshold, the running state parameter is determined to be greater than the preset current running state parameter threshold , the preset running time period is set by the user; if it is predicted that the video playback coordination strategy will be adjusted during the preset running time period, then adjust the codec parameters to obtain adjusted codec parameters, And adjust the video preprocessing coordination information, obtain the adjusted video preprocessing coordination information, and return to the execution step: convert the original video into a corresponding target according to the codec parameters and the video preprocessing coordination information For the video code stream, the adjustment manner may be an adjustment manner according to idle computing resources of the target terminal.

An embodiment of the present application provides a device-cloud resource coordination method, that is, receiving a device-cloud resource coordination request sent by a target terminal for an original video, wherein the device-cloud resource coordination request carries the video type of the original video information and the video playback capability information of the target terminal; then according to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information, and realize the For information interaction of the target video, the server and the target video interactively determine the codec parameters corresponding to the target terminal and the corresponding video preprocessing coordination information; according to the codec parameters and the video preprocessing coordination information, the The original video is converted into a corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server to encode the Determine the video preprocessing strategy of the original video before encoding the original video; send the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal for the target The terminal converts the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the target terminal to code the target video Stream decoding, the video preprocessing coordination information is used for the target terminal to determine the video preprocessing strategy of the video to be played after decoding the target video stream; since the video preprocessing coordination information is used to determine the target The task distribution of the video preprocessing task between the target terminal and the cloud server, and then the cloud server and the target terminal determine whether to preprocess the video preprocessing task according to the task distribution, and, because the codec parameters are used in the cloud server After determining whether to co-process the target video according to the video pre-processing task, encode the target video into the target video code stream, and determine whether to co-process the target video according to the video pre-processing task at the target terminal Before, the target video code stream is decoded into the target video encoding, that is, even if there is a video preprocessing task on the cloud server or the target terminal, the video preprocessing for the target video will be performed before encoding or after decoding the target video Complete, and then will not lead to the situation that the encoding distortion affects the image quality. At the same time, the allocation of video preprocessing tasks depends on the video playback capability information, that is, the service resources on the target terminal are sufficient to perform a certain degree of target video In the case of content analysis and video processing, the video preprocessing task assigned according to the video playback capability will use the target terminal service resources to perform video preprocessing on the target video, instead of only using the cloud server to perform video content analysis and video encoding before video encoding. The preprocessing work, that is, realizes the purpose of effectively utilizing the idle service resources of the target terminal, and then makes full use of the limited service resources of the cloud server, so it overcomes the service resource management efficiency of the cloud server. The technical defect that the video quality experience of the target video cannot be further improved due to poor results, that is, the video picture effect of the target video is improved, so the picture effect of the cloud game picture is also improved.

Embodiment two

Further, referring to FIG. 6 , in another embodiment of the present application, for content that is the same as or similar to the first embodiment above, reference may be made to the introduction above, and details will not be repeated hereafter. On this basis, applied to the target terminal, the device-cloud resource collaboration method further includes:

Step F10, sending a device-cloud resource coordination request to the cloud server, wherein the device-cloud resource coordination request carries the video type information of the target video and the video playback capability information of the target terminal, for the cloud server to use according to the specified The video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information, and according to the codec parameters and the video preprocessing coordination information, convert the The original video is converted into a corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server to encode the original video Determine the video preprocessing strategy of the original video before encoding the video;

Step F20, receiving the codec parameters, the video preprocessing coordination information and the target video code stream sent by the cloud server;

Step F30: Convert the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the target terminal to The video code stream is decoded, and the video preprocessing coordination information is used for the target terminal to determine the video preprocessing policy of the video to be played after decoding the target video code stream.

In this embodiment, it should be noted that the video display instruction is used to trigger the target terminal to automatically collect the video type information of the target video and the video playback capability information of the target terminal, and then generate a device-cloud resource coordination request, Specifically, it can be triggered by the user through voice or button. For the target video after collaborative processing, it can be transmitted to the display of the target terminal through the I/O interface, and then display and play based on the display. The target video decoded by the target terminal can be It is the target video that the cloud server has not performed the video analysis task and has not performed the video enhancement task, or the target video that has not performed the video analysis task but has performed the video enhancement task, or it can be the target video that has performed the video analysis task but has not performed the video enhancement task. The video enhancement task can be a first video enhancement task and a second video enhancement task. The video to be played is a video waiting to be played on the preset display interface of the target terminal. After obtaining the video to be played, it can be played by a video playback instruction The video to be played.

As an example, steps F10 to F40 include: if it is detected that the user inputs a video display instruction for the target video, sending a device-cloud resource coordination request to the cloud server, wherein the device-cloud resource coordination request carries the target The video type information of the video and the video playback capability information of the target terminal are used for the cloud server to determine the codec parameters corresponding to the original video and the corresponding video playback capability information according to the video type information and the video playback capability information. Preprocessing the coordination information, and converting the original video into a corresponding target video code stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server to The original video is encoded, and the video preprocessing coordination information is used by the cloud server to determine the video preprocessing strategy of the original video before encoding the original video; receiving the codec sent by the cloud server parameters, the video preprocessing coordination information, and the target video code stream; according to the codec parameters and the video preprocessing coordination information, convert the target video code stream into a corresponding video to be played, wherein the The codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination information is used by the target terminal to determine the video to be played after decoding the target video code stream video preprocessing strategy.

In an implementable manner, the task assignment of the video preprocessing tasks determined by the video preprocessing coordination information includes that the video preprocessing tasks are all assigned to the cloud server, and the video preprocessing tasks are all assigned to the cloud server. The target terminal and the video preprocessing task are partially allocated to the cloud server and partially allocated to the target terminal, and the specific steps for performing video preprocessing on the target video according to the video preprocessing task can refer to the cloud server according to the video The specific steps of the preprocessing task to perform video preprocessing on the target video will not be repeated here.

Wherein, after the step of converting the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, the device-cloud resource coordination method further includes:

Step G10, obtaining the current operating state parameters, and sending the current operating state parameters to the cloud server, so that the cloud server can predict whether the Codec parameters and the video preprocessing coordination information are adjusted.

As an example, step G10 includes: obtaining the current operating state parameters, and sending the current operating state parameters to the cloud server, so that the cloud server can predict the preset operating state according to the current operating state parameters. Whether to adjust the codec parameters and the video preprocessing coordination information within a time period, wherein the cloud server predicts whether to adjust the codec parameters within a preset operation time period according to the current operation state parameters For adjusting with the video pre-processing coordination information, refer to the specific steps from step E10 to step E20, which will not be repeated here.

An embodiment of the present application provides a device-cloud resource coordination method, which is applied to a target terminal, that is, a device-cloud resource coordination request is sent to a cloud server, wherein the device-cloud resource coordination request carries video type information of the target video and the video playback capability information of the target terminal, for the cloud server to determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information according to the video type information and the video playback capability information, and converting the original video into a corresponding target video stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server to encode the original video , the video preprocessing coordination information is used for the cloud server to determine the video preprocessing strategy of the original video before encoding the original video; receiving the codec parameters, the video Preprocessing the coordination information and the target video code stream; converting the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used The target terminal decodes the target video code stream, and the video preprocessing coordination information is used for the target terminal to determine the video preprocessing strategy of the video to be played after decoding the target video code stream . Since the video preprocessing coordination information is used to determine the task assignment of the video preprocessing task of the target video between the target terminal and the cloud server, and then the cloud server and the target terminal determine whether to perform preprocessing on the video preprocessing task according to the task assignment, and , because the codec parameters are used to encode the target video into the target video code stream after the cloud server determines whether to co-process the target video according to the video preprocessing task, and the target terminal The processing task determines whether to decode the target video code stream into the target video code before co-processing the target video, that is, even if there is a video preprocessing task on the cloud server or the target terminal, the video preprocessing of the target video will also It is completed before encoding or after decoding the target video, which will not cause encoding distortion to affect the picture quality. At the same time, the allocation of video preprocessing tasks depends on the video playback capability information, that is, the When the service resources are sufficient to perform a certain degree of content analysis and video processing on the target video, the video preprocessing task assigned according to the video playback capability will use the target terminal service resources to perform video preprocessing on the target video instead of only through the cloud server Perform video content analysis and video preprocessing before video encoding, that is, to achieve the purpose of effectively utilizing the idle service resources of the target terminal, and then make full use of the limited service resources of the cloud server. The poor service resource management effect of the cloud server leads to a technical defect that the video quality experience of the target video cannot be further improved, that is, the video picture effect of the target video is improved, so the picture effect of the cloud game picture is also improved.

Embodiment Three

The embodiment of the present application also provides a terminal-cloud resource coordination device, which is applied to a cloud server. Referring to FIG. 7, the device-cloud resource coordination device includes:

The first receiving module 101 is configured to receive a device-cloud resource coordination request sent by the target terminal for the original video, wherein the device-cloud resource coordination request carries the video type information of the original video and the video playback of the target terminal capability information;

A determining module 102, configured to determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information according to the video type information and the video playback capability information;

The first conversion module 103 is configured to convert the original video into a corresponding target video code stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server Encoding the original video, the video preprocessing coordination information is used by the cloud server to determine a video preprocessing strategy for the original video before encoding the original video;

The first sending module 104 is configured to jointly send the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal for the target terminal to use according to the codec parameters and The video preprocessing coordination information converts the target video code stream into a corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing The processing coordination information is used by the target terminal to determine a video preprocessing policy of the video to be played after decoding the target video code stream.

Optionally, the first conversion module 103 is also used for:

Determine whether to collaboratively preprocess the original video according to the video preprocessing collaboration information;

If so, perform video preprocessing on the original video according to the video preprocessing coordination information to obtain the preprocessed original video;

Encoding the preprocessed original video according to the codec parameters to obtain the target video code stream;

If not, encode the preprocessed original video according to the codec parameters to obtain the target video code stream.

Optionally, the preprocessed original video includes a single collaborative original video and multiple collaborative original videos, and the conversion module 103 is also used for:

Determine a video preprocessing task corresponding to the video preprocessing collaborative information, where the video preprocessing task includes a video analysis task and a video enhancement task;

If the collaborative processing task is a multi-cooperative preprocessing task, performing collaborative analysis on the original video according to the video analysis task to obtain collaborative analysis information;

According to the video enhancement task, cooperatively enhance the target video to obtain the multi-cooperative original video;

If the collaborative processing task is a single collaborative preprocessing task, the target video is collaboratively enhanced according to the video enhancement task to obtain the single collaborative original video.

Optionally, the first conversion module 103 is also used for:

If the video enhancement task is the first video enhancement task that the video enhancement task is completely assigned to the cloud server, then according to the first video enhancement task, the original video is overall enhanced to obtain the overall coordination Enhance target video;

If the video enhancement task is the second video preprocessing task assigned to the cloud server by the video enhancement task part, then according to the second video enhancement task, the original video is partially enhanced to obtain the part Cooperatively enhance raw video.

Optionally, the first conversion module 103 is also used for:

Obtain a video enhancement subtask corresponding to the second video enhancement task;

According to the video enhancement sub-task, partial enhancement is performed on the original video to obtain the partial cooperatively enhanced target video.

Optionally, the device-cloud resource coordination device is also used for:

If the current running state parameter sent by the target terminal is received, predict whether to adjust the codec parameter and the video preprocessing coordination information within a preset running time period according to the current running state parameter;

If so, use the adjusted codec parameters as the codec parameters, and use the adjusted video preprocessing coordination information as the video preprocessing coordination information, and return to the execution step: according to the codec parameters and the Video preprocessing cooperates with information to convert the original video into a corresponding target video code stream.

The terminal-cloud resource coordination device provided by the present invention adopts the terminal-cloud resource coordination method in the above-mentioned embodiments, and solves the technical problem of poor cloud game screen effect due to poor service resource management effect of the cloud server. Compared with the prior art, the beneficial effects of the device-cloud resource coordination device provided by the embodiment of the present invention are the same as those of the device-cloud resource coordination method provided by the above-mentioned embodiments, and other technical features of the device-cloud resource coordination device are the same as The features disclosed by the methods in the above embodiments are the same, and will not be repeated here.

Embodiment Four

The embodiment of the present application also provides a device-cloud resource coordination device, which is applied to a target terminal. Referring to FIG. 8, the device-cloud resource coordination device includes:

The second sending module 201 is configured to send a device-cloud resource coordination request to the cloud server, wherein the device-cloud resource coordination request carries the video type information of the target video and the video playback capability information of the target terminal for all The cloud server determines the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information according to the video type information and the video playback capability information, and determines the codec parameters and the video preprocessing coordination information according to the codec parameters and the video preprocessing coordination information. information to convert the original video into a corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server determining a video preprocessing strategy for the original video before encoding the original video;

The second receiving module 202 is configured to receive the codec parameters, the video preprocessing coordination information and the target video code stream sent by the cloud server;

The second conversion module 203 is configured to convert the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used for the target The terminal decodes the target video code stream, and the video preprocessing coordination information is used for the target terminal to determine the video preprocessing policy of the video to be played after decoding the target video code stream.

Optionally, the device-cloud resource coordination device is also used for:

Obtaining the current running state parameters, and sending the current running state parameters to the cloud server, so that the cloud server can predict whether to change the encoding and decoding parameters within the preset running time period according to the current running state parameters Adjust with the video preprocessing information.

The terminal-cloud resource coordination device provided by the present invention adopts the terminal-cloud resource coordination method in the above-mentioned embodiments, and solves the technical problem of poor cloud game screen effect due to poor service resource management effect of the cloud server. Compared with the prior art, the beneficial effects of the device-cloud resource coordination device provided by the embodiment of the present invention are the same as those of the device-cloud resource coordination method provided by the above-mentioned embodiments, and other technical features of the device-cloud resource coordination device are the same as The features disclosed by the methods in the above embodiments are the same, and will not be repeated here.

Embodiment five

An embodiment of the present invention provides an electronic device. The electronic device includes: at least one processor; and a memory connected to the at least one processor in communication; wherein, the memory stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor. The processor executes, so that at least one processor can execute the device-cloud resource collaboration method in the first embodiment above.

Referring now to FIG. 9 , it shows a schematic structural diagram of an electronic device suitable for implementing an embodiment of the present disclosure. The electronic equipment in the embodiment of the present disclosure may include but not limited to such as mobile phone, notebook computer, digital broadcast receiver, PDA (personal digital assistant), PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers and the like. The electronic device shown in FIG. 9 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

As shown in FIG. 9, the electronic device may include a processing device 1001 (such as a central processing unit, a graphics processing unit, etc.), which may be loaded into a random access memory according to a program stored in a read-only memory (ROM) 1002 or from a storage device 1003. (RAM) 1004 to execute various appropriate actions and processing. In RAM 1004, various programs and data necessary for the operation of the electronic device are also stored. The processing device 1001 , ROM 1002 , and RAM 1004 are connected to each other via a bus 1005 . An input/output (I/O) interface 1006 is also connected to the bus.

In general, the following systems can be connected to the I/O interface 1006: input devices 1007 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, an output device 1008 of a vibrator or the like; a storage device 1003 including, for example, a magnetic tape, a hard disk, or the like; and a communication device 1009 . A communication device may allow an electronic device to communicate with other devices wirelessly or by wire to exchange data. While an electronic device is shown with various systems in the figures, it should be understood that implementing or having all of the systems shown is not a requirement. More or fewer systems may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, where the computer program includes program codes for executing the methods shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from the network via the communication means 1009, or from the storage means 1003, or from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.

The electronic device provided by the present invention adopts the terminal-cloud resource coordination method in the above-mentioned embodiments, and solves the technical problem of poor cloud game picture effect due to poor service resource management effect of the cloud server. Compared with the prior art, the beneficial effect of the electronic device provided by the embodiment of the present invention is the same as that of the device-cloud resource coordination method provided by the above embodiment, and other technical features of the electronic device are the same as those disclosed by the method of the above embodiment The features are the same, and will not be repeated here.

It should be understood that various parts of the present disclosure may be implemented in hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in an appropriate manner.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Embodiment six

This embodiment provides a computer-readable storage medium, which has computer-readable program instructions stored thereon, and the computer-readable program instructions are used to execute the device-cloud resource collaboration method in the foregoing embodiments.

The computer-readable storage medium provided by the embodiments of the present invention may be, for example, a USB flash drive, but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, system, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, system or device. Program code embodied on a computer readable storage medium may be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

The above-mentioned computer-readable storage medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

The computer-readable storage medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device: receives a device-cloud resource coordination request sent by the target terminal for the original video, wherein the The device-cloud resource coordination request carries the video type information of the original video and the video playback capability information of the target terminal; according to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and corresponding video preprocessing coordination information; convert the original video into a corresponding target video stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used in the cloud The server encodes the original video, and the video preprocessing coordination information is used by the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; The video preprocessing coordination information and the target video code stream are jointly sent to the target terminal, so that the target terminal can convert the target video code stream according to the codec parameters and the video preprocessing coordination information is the corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination information is used by the target terminal to decode the target video code stream After the stream is decoded, the video preprocessing policy of the video to be played is determined.

Or send a terminal-cloud resource coordination request to the cloud server, wherein the terminal-cloud resource coordination request carries the video type information of the target video and the video playback capability information of the target terminal, so that the cloud server can Type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video pre-processing coordination information, and according to the codec parameters and the video pre-processing coordination information, convert the original video converted into a corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server to encode the original video Determining the video preprocessing strategy of the original video before encoding; receiving the codec parameters, the video preprocessing coordination information and the target video code stream sent by the cloud server; according to the codec parameters and the Video preprocessing coordination information, converting the target video code stream into a corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination The information is used for the target terminal to determine the video preprocessing policy of the video to be played after decoding the target video code stream.

Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or combinations thereof, including object-oriented programming languages—such as Java, Smalltalk, C++, and conventional Procedural Programming Language - such as "C" or a similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through an Internet service provider). Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code that contains one or more logical functions for implementing specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by a dedicated hardware-based system that performs the specified functions or operations , or may be implemented by a combination of dedicated hardware and computer instructions.

The modules involved in the embodiments described in the present disclosure may be implemented by software or by hardware. Wherein, the name of the module does not constitute a limitation of the unit itself under certain circumstances.

The computer-readable storage medium provided by the present invention stores computer-readable program instructions for executing the above-mentioned device-cloud resource collaboration method, and solves the technical problem of poor cloud game screen effects caused by poor service resource management of cloud servers. Compared with the prior art, the beneficial effect of the computer-readable storage medium provided by the embodiment of the present invention is the same as the beneficial effect of the device-cloud resource coordination method provided by the above-mentioned embodiment, and details are not repeated here.

Embodiment seven

The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned device-cloud resource coordination method are realized.

The computer program product provided by this application solves the technical problem of poor cloud game screen effects due to poor management of cloud server service resources. Compared with the prior art, the beneficial effect of the computer program product provided by the embodiment of the present invention is the same as the beneficial effect of the device-cloud resource coordination method provided by the above-mentioned embodiment, and details are not repeated here.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent processing scope of the present application in the same way.

Claims (10)

1. A device-cloud resource collaboration method, characterized in that it is applied to a cloud server, and the device-cloud resource collaboration method comprises: receiving a device-cloud resource coordination request sent by the target terminal for the original video, wherein the device-cloud resource coordination request carries video type information of the original video and video playback capability information of the target terminal; According to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information; converting the original video into a corresponding target video stream according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the cloud server to encode the original video, The video preprocessing coordination information is used by the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; jointly sending the codec parameters, the video preprocessing coordination information, and the target video code stream to the target terminal, so that the target terminal can, according to the codec parameters and the video preprocessing coordination information, Converting the target video code stream into a corresponding video to be played, wherein the codec parameters are used by the target terminal to decode the target video code stream, and the video preprocessing coordination information is used for the target After decoding the target video code stream, the terminal determines the video preprocessing policy of the video to be played. 2. The device-cloud resource coordination method according to claim 1, wherein the step of converting the original video into a corresponding target video stream according to the codec parameters and the video preprocessing coordination information include: Determine whether to collaboratively preprocess the original video according to the video preprocessing collaboration information; If so, perform video preprocessing on the original video according to the video preprocessing coordination information to obtain the preprocessed original video; Encoding the preprocessed original video according to the codec parameters to obtain the target video code stream; If not, encode the preprocessed original video according to the codec parameters to obtain the target video code stream. 3. The device-cloud resource collaboration method according to claim 2, wherein the preprocessed original video includes a single collaborative original video and a multi-collaborative original video, The step of performing video preprocessing on the original video according to the video preprocessing collaborative information, and obtaining the preprocessed original video includes: Determine a video preprocessing task corresponding to the video preprocessing collaborative information, where the video preprocessing task includes a video analysis task and a video enhancement task; If the collaborative processing task is a multi-cooperative preprocessing task, performing collaborative analysis on the original video according to the video analysis task to obtain collaborative analysis information; According to the video enhancement task, cooperatively enhance the target video to obtain the multi-cooperative original video; If the collaborative processing task is a single collaborative preprocessing task, the target video is collaboratively enhanced according to the video enhancement task to obtain the single collaborative original video. 4. The device-cloud resource collaboration method according to claim 3, wherein the single collaborative original video includes an overall collaborative enhanced original video and a partial collaborative enhanced original video, According to the video enhancement task, the steps of collaboratively enhancing the target video to obtain the single collaborative original video include: If the video enhancement task is the first video enhancement task that the video enhancement task is completely assigned to the cloud server, then according to the first video enhancement task, the original video is overall enhanced to obtain the overall coordination Enhance target video; If the video enhancement task is the second video preprocessing task assigned to the cloud server by the video enhancement task part, then according to the second video enhancement task, the original video is partially enhanced to obtain the part Cooperatively enhance raw video. 5. The device-cloud resource collaboration method according to claim 4, wherein the step of performing partial enhancement on the original video according to the second video enhancement task to obtain the partial collaborative enhancement of the original video comprises: Obtain a video enhancement subtask corresponding to the second video enhancement task; According to the video enhancement sub-task, partial enhancement is performed on the original video to obtain the partial cooperatively enhanced target video. 6. The device-cloud resource coordination method according to claim 1, wherein, when the codec parameters, the video preprocessing coordination information and the target video code stream are jointly sent to the target terminal After the steps, the terminal-cloud resource collaboration method also includes: If the current running state parameter sent by the target terminal is received, predict whether to adjust the codec parameter and the video preprocessing coordination information within a preset running time period according to the current running state parameter; If so, use the adjusted codec parameters as the codec parameters, and use the adjusted video preprocessing coordination information as the video preprocessing coordination information, and return to the execution step: according to the codec parameters and the Video preprocessing cooperates with information to convert the original video into a corresponding target video code stream. 7. A device-cloud resource collaboration method, characterized in that it is applied to a target terminal, and the device-cloud resource collaboration method comprises: Sending a terminal-cloud resource coordination request to the cloud server, wherein the terminal-cloud resource coordination request carries video type information of the target video and video playback capability information of the target terminal, for the cloud server to use according to the video type information and the video playback capability information, determine the codec parameters corresponding to the original video and the corresponding video preprocessing coordination information, and convert the original video according to the codec parameters and the video preprocessing coordination information is the corresponding target video code stream, wherein the codec parameters are used by the cloud server to encode the original video, and the video preprocessing coordination information is used by the cloud server to encode the original video Before determining the video preprocessing strategy of the original video; receiving the codec parameters, the video preprocessing coordination information and the target video code stream sent by the cloud server; Converting the target video code stream into a corresponding video to be played according to the codec parameters and the video preprocessing coordination information, wherein the codec parameters are used by the target terminal to process the target video code stream For decoding, the video preprocessing coordination information is used for the target terminal to determine the video preprocessing policy of the video to be played after decoding the target video code stream. 8. The device-cloud resource coordination method according to claim 7, wherein, according to the codec parameters and the video preprocessing coordination information, the target video code stream is converted into the corresponding video to be played After the step, the device-cloud resource collaboration method also includes: Obtaining the current running state parameters, and sending the current running state parameters to the cloud server, so that the cloud server can predict whether to change the encoding and decoding parameters within the preset running time period according to the current running state parameters Adjust with the video preprocessing information. 9. An electronic device, characterized in that the electronic device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform any of claims 1 to 6 or 7 to 8 A step of the device-cloud resource collaboration method described above. 10. A computer-readable storage medium, wherein a program for implementing a device-cloud resource collaboration method is stored on the computer-readable storage medium, and the program for implementing the device-cloud resource collaboration method is executed by a processor to implement the following: The steps of the device-cloud resource collaboration method described in any one of claims 1-6 or 7-8.

Images