CN115412559A

CN115412559A - Terminal cloud resource cooperation method, electronic equipment and readable storage medium

Info

Publication number: CN115412559A
Application number: CN202211042637.8A
Authority: CN
Inventors: 江�润; 宁秋梅
Original assignee: Shenzhen Skyworth RGB Electronics Co Ltd
Current assignee: Shenzhen Skyworth RGB Electronics Co Ltd
Priority date: 2022-08-29
Filing date: 2022-08-29
Publication date: 2022-11-29

Abstract

The application discloses a terminal cloud resource coordination method, an electronic device and a readable storage medium, which comprise the following steps: receiving an end cloud resource cooperation request sent by a target terminal aiming at an original video, wherein the end cloud resource cooperation request carries video type information of the original video and video playing capacity information of the target terminal; according to the video type information and the video playing capability information, determining encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information; converting an original video into a corresponding target video code stream according to the coding and decoding parameters and the video preprocessing cooperative information; and sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to a target terminal together, so that the target terminal can convert the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information. The cloud game image management method and the cloud game image management system solve the technical problem that the cloud game image effect is poor due to poor service resource management effect of the cloud server.

Description

Terminal cloud resource cooperation method, electronic device and readable storage medium

Technical Field

The present application relates to the technical field of resource management, and in particular, to a method for coordinating cloud resources on a terminal, an electronic device, and a readable storage medium.

Background

With the continuous development of the 5G technology, a novel game service structure of a cloud game is also applied more and more widely, and the cloud game provides a better game experience for a user of a game terminal by using computing resources of a cloud server, that is, logic such as operation and rendering of the cloud game is migrated to the cloud server, and the game terminal only needs to have a video decoding capability and a video playing capability.

Disclosure of Invention

The present application mainly aims to provide an end cloud resource coordination method, an electronic device, and a readable storage medium, and aims to solve the technical problem in the prior art that a cloud game picture effect is poor due to a poor service resource management effect of a cloud server.

In order to achieve the above object, the present application provides an end cloud resource coordination method, which is applied to a cloud server, and the end cloud resource coordination method includes:

receiving an end cloud resource cooperation request sent by a target terminal aiming at an original video, wherein the end cloud resource cooperation request carries video type information of the original video and video playing capacity information of the target terminal;

determining encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information according to the video type information and the video playing capability information;

converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperative information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video;

and sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to the target terminal together, so that the target terminal converts the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

In order to achieve the above object, the present application further provides an end cloud resource coordination method, which is applied to a target terminal, and the end cloud resource coordination method includes:

sending a cloud resource cooperation request to a cloud server, wherein the end cloud resource cooperation request carries video type information of the target video and video playing capability information of the target terminal, so that the cloud server determines encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperation information according to the video type information and the video playing capability information, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperation information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperation information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video;

receiving the encoding and decoding parameters, the video preprocessing cooperative information and the target video code stream sent by the cloud server;

and converting the target video code stream into a corresponding video to be played according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

In order to achieve the above object, the present application further provides an end cloud resource coordination device, which is applied to a cloud server, and the end cloud resource coordination device includes:

the terminal cloud resource coordination request comprises a first receiving module and a second receiving module, wherein the first receiving module is used for receiving a terminal cloud resource coordination request sent by a target terminal aiming at an original video, and the terminal cloud resource coordination request carries video type information of the original video and video playing capacity information of the target terminal;

a determining module, configured to determine, according to the video type information and the video playing capability information, encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information;

a first conversion module, configured to convert the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, where the encoding and decoding parameters are used by the cloud server to encode the original video, and the video preprocessing cooperative information is used by the cloud server to determine a video preprocessing policy of the original video before encoding the original video;

the first sending module is configured to send the coding and decoding parameters, the video preprocessing cooperative information, and the target video code stream to the target terminal together, so that the target terminal converts the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, where the coding and decoding parameters are used by the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used by the target terminal to determine a video preprocessing policy of the video to be played after decoding the target video code stream.

In order to achieve the above object, the present application further provides an end cloud resource coordination device, which is applied to a target terminal, and the end cloud resource coordination device includes:

a second sending module, configured to send a cloud resource coordination request to a cloud server, where the end cloud resource coordination request carries video type information of the target video and video playing capability information of the target terminal, so that the cloud server determines, according to the video type information and the video playing capability information, encoding and decoding parameters and corresponding video preprocessing coordination information corresponding to the original video, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing coordination information, where the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing coordination information is used for the cloud server to determine a video preprocessing policy of the original video before encoding the original video;

the second receiving module is used for receiving the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream which are sent by the cloud server;

and the second conversion module is used for converting the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after the target video code stream is decoded.

The present application further provides an electronic device, the electronic device including: the system comprises a memory, a processor and a program of the end cloud resource coordination method stored on the memory and capable of running on the processor, wherein the program of the end cloud resource coordination method can realize the steps of the end cloud resource coordination method when being executed by the processor.

The present application further provides a computer-readable storage medium, where a program for implementing the end cloud resource coordination method is stored, and when executed by a processor, the program for implementing the end cloud resource coordination method implements the steps of the end cloud resource coordination method.

The present application further provides a computer program product, including a computer program, which when executed by a processor, implements the steps of the cloud-end resource coordination method as described above.

The application provides an end cloud resource coordination method, electronic equipment and a readable storage medium, which are applied to a cloud server, namely, an end cloud resource coordination request sent by a target terminal aiming at an original video is received, wherein the end cloud resource coordination request carries video type information of the original video and video playing capacity information of the target terminal; further, according to the video type information and the video playing capability information, the encoding and decoding parameters corresponding to the original video and the corresponding video preprocessing cooperative information are determined, and the purpose of interactively determining the encoding and decoding parameters corresponding to the target terminal and the corresponding video preprocessing cooperative information through information interaction of the cloud server and the target video aiming at the target video is achieved; converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperative information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to the target terminal together, so that the target terminal can convert the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream; the video preprocessing cooperative information is used for determining the task allocation condition of a video preprocessing task of a target video at a target terminal and a cloud server, and then the cloud server and the target terminal determine whether to preprocess the video preprocessing task according to the task allocation condition, and the coding and decoding parameters are used for coding the target video into the target video code stream after the cloud server determines whether to cooperatively process the target video according to the video preprocessing task, and decoding the target video code stream into the target video code stream before the target terminal determines whether to cooperatively process the target video according to the video preprocessing task, i.e. even if the video preprocessing task exists at the cloud server or the target terminal, the video preprocessing of the target video is completed before or after the target video is coded, and further the condition that the video quality is influenced by coding distortion does not occur, meanwhile, the video preprocessing task allocation depends on the video playing capability information, and the video service allocated at the target terminal is sufficient for content analysis and video processing work of the target video to a certain degree, so that the video server can not effectively analyze the video resources of the target video and further improve the video quality of the target video resources, and further the cloud server can not effectively analyze the video resources of the target video resources. That is, the video picture effect of the target video is improved, so the picture effect of the cloud game picture is also improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.

Fig. 1 is a schematic flowchart of a first embodiment of a cloud resource coordination method at an application end;

FIG. 2 is a schematic diagram of a cloud game scene of the cloud resource coordination method at the application end;

fig. 3 is a flowchart of video content analysis performed by the cloud server according to the cloud resource coordination method at the application end;

fig. 4 is a flowchart illustrating video content analysis performed by a target terminal in the cloud resource coordination method at the application end;

fig. 5 is a schematic diagram of a second video enhancement task of the cloud resource coordination method at the application end;

fig. 6 is a flowchart illustrating a second embodiment of a cloud resource coordination method at an application end according to the present application;

fig. 7 is a schematic diagram of a cloud resource coordination apparatus according to a third embodiment of the present application;

fig. 8 is a schematic diagram of a fourth embodiment of a cloud resource coordination device at the application end;

fig. 9 is a schematic device structure diagram of a hardware operating environment related to the end cloud resource coordination method in the embodiment of the present application.

The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Example one

Firstly, it should be understood that, in the video or image processing process in the current cloud scene, a video is generally generated at a cloud server, and then a video image of the video is acquired and then correspondingly processed, and then the processed video image is encoded and then decoded by a user terminal, and finally the video image is displayed, that is, the requirements for the user terminal are simplified to the video decoding capability and the video playing capability, for some specific user terminals, only the decoded video image is subjected to post-processing, such as sharpening, blurring or noise reduction, but since the video preprocessing is completed by the cloud server, and the information of the cloud server and the user terminal cannot be intercommunicated, when the cloud server performs video preprocessing, the video image can be preprocessed only according to the preset processing parameters or the established processing parameters of the number of the user terminals carried by the cloud server, but the video image quality of different user terminals is not adapted to the video playing effect expected by the user due to the difference of the service performance and the computing resources of different user terminals, that is, the video image quality is poor due to the poor service resource management effect of the cloud server, and meanwhile, the idle computing resources of the user terminals are not fully utilized, taking the cloud game as an example, in order to reduce the influence of video coding distortion on the game image quality, the cloud server needs to combine with human visual characteristics, and perform video content analysis and video preprocessing work on the cloud game image before video coding, which undoubtedly further increases the computing resource overhead of the cloud server, under the trade-off of the limited computing resources of the cloud server and the computing resources, the cloud server cannot provide users with better quality image experience of the cloud game, so a method for solving the problem of poor picture effect of the cloud game caused by the poor service resource management effect of the cloud server is needed.

An embodiment of the present application provides an end cloud resource coordination method applied to a cloud server, where in a first embodiment of the end cloud resource coordination method of the present application, with reference to fig. 1, the end cloud resource coordination method includes:

step S10, receiving an end cloud resource cooperation request sent by a target terminal aiming at an original video, wherein the end cloud resource cooperation request carries video type information of the original video and video playing capacity information of the target terminal;

step S20, determining coding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information according to the video type information and the video playing capability information;

in this embodiment, it should be noted that the target terminal and the cloud server are communicatively connected through a TCP (Transmission Control Protocol), the target terminal is used to represent an intelligent terminal that needs to perform terminal cloud resource coordination, and may be an intelligent terminal that has computing idle resources or an intelligent terminal that does not have computing idle resources, such as a smart phone, a player game terminal, and a tablet computer, the cloud server is used to represent a cloud server that performs terminal cloud resource coordination, the terminal cloud resource coordination method is applied to a video or image processing process in a cloud scene, and is used for a same cloud server and target terminal interaction Protocol and data format, the cloud scene may be a Real-time communication (RTC) scene, which includes but is not limited to a remote call, a remote office, an interactive live broadcast, a cloud game, and a video conference, and many scenes, and other scenes, in an implementable manner, it is assumed that the Real-time communication scene is a video communication scene, even if the game terminal can process a game scene, the game terminal can process a game data, and the video game server can perform a video processing process on a video game scene, and a video stream, and a user code stream of the cloud server 2 is a user code stream, and a user code stream is displayed on a network, and a user terminal 12, and a user can be displayed on a network, and a user can be displayed on a user terminal 12, and displaying the video image according to the decoding result.

Additionally, it should be noted that the original video is composed of original video frames, specifically, a video that is not subjected to video preprocessing and is waiting to be sent to a target terminal, the original video frames are used for representing video key frames representing video content, the end cloud resource cooperation request is used for cooperating service resources of the target terminal and service resources of a cloud server, that is, the target terminal sends the end cloud resource cooperation request, the cloud server cooperatively manages the service resources of the target terminal and the service resources of the cloud server, and then allocates video processing parameters most suitable for characteristics of the target terminal through cooperation of the cloud server and an intelligent terminal, so when the target terminal device sends the end cloud resource cooperation request, the end cloud resource cooperation request carries video type information of the target video and video playing capability information of the target terminal, wherein the video playing capability information is used for representing video playing capability of the target video, the video type information is used for representing video types of the target video, for example, in an implementable manner, if the target video is assumed to be a video, video playing capability information corresponding to different videos is used for representing video types of the target video, and when the video playing requirements of the cloud resources are sufficiently delayed in a decoding process of the video are high, the cloud decoding requirements of the cloud video is met, and the expected in a decoding process, and when the cloud decoding process of the cloud resources is sufficiently delayed cloud resources of the cloud resources is delayed.

Additionally, it should be noted that the Video playing capability information includes Video Coding and decoding capability information and Video processing capability information, where the Video Coding and decoding capability information is used to represent a Video Coding and decoding capability of the target terminal, the Video Coding and decoding capability is used to determine a Coding and decoding parameter of the target Video during network transmission between the cloud server and the target terminal, and the Video Coding and decoding capability may be implemented by using H265 (High Efficiency Video Coding, high Efficiency Video compression Coding), AV1 (AOMedia Video 1, video Coding format), multi-channel decoding, stream SVC (Scalable Video Coding, layered Video Coding), stream SCC (HEVC Profile, screen content Coding), 444, YUV422, HDR10 (High Dynamic Range 10, high Dynamic Range imaging), high performance mode, and low latency mode, where YUV444 and YUV422 are two formats of uncompressed Video, and "Y" are used to represent "U" and "V" and are used to describe a pixel saturation level, and a color sampling component of the YUV444, where the YUV444 and the sampling component is designated as a gray value, and the sampling component is three components: u: v =4:4:4,yuv422 has three component samples Y: u: v = 4.

Additionally, it should be noted that the video processing capability is used to determine the video preprocessing cooperative information, the video preprocessing cooperative information is used to determine a video preprocessing policy of the original video by the cloud server before encoding the original video and is used to determine a video preprocessing policy of the video to be played by the target terminal after decoding the target video code stream, the video preprocessing policy is used to allocate video preprocessing tasks, the video preprocessing tasks include that the video preprocessing tasks are all allocated to the cloud server, the video preprocessing tasks are all allocated to the target terminal, and the video preprocessing tasks are partially allocated to the cloud server and partially allocated to the target terminal, that is, the video preprocessing cooperative information is used to instruct, according to the video processing capability of the target terminal, that the most reasonable video preprocessing tasks are allocated to the cloud server and the target terminal, so that the cloud server and the target terminal are respectively in the optimal video processing configuration for preprocessing the target video, and more reasonable cooperation between the cloud server and the intelligent terminal can be achieved, and further video experience can be provided.

In addition, it should be noted that, the identification of the target terminal as not having video processing capability means that the target terminal only has the basic video decoding function and the video playing function, and does not have the video image processing capability implemented by hardware configuration, the identification of the target terminal as having video processing capability means that the target terminal has the video image processing capability implemented by hardware in addition to the basic video playing capability, and the identification can be divided into two cases according to the difference of the video image processing capability, where the first case is that only partial area video image processing can be completed and full image processing cannot be completed at a given video frame rate, and the second case is that only partial sub-flow of the whole video image processing task can be completed and full flow cannot be completed at a given video frame rate, for example, in a video application scene of 1080p @60fps, the intelligent device a has a specific video sharpening algorithm implemented by hardware, but due to limited device performance, at a video frame rate of 60fps, only can process a video size of 540p, the device a has a partial video image processing capability, and the full video processing capability means that the video processing function and the video processing capability is also achieved by hardware at a given video image processing capability.

As an example, steps S10 to S20 include: receiving an end cloud resource cooperation request sent by a target terminal aiming at a target video, and acquiring an original video corresponding to the end cloud resource cooperation request, wherein the end cloud resource cooperation request comprises video type information of the target video and video playing capacity information of the target terminal; and determining encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information according to the video type information and the video playing capability information.

Wherein, the step of determining the encoding and decoding parameters corresponding to the original video and the corresponding video preprocessing cooperative information according to the video type information and the video playing capability information comprises:

and determining encoding and decoding parameters corresponding to the original video according to the video type information and the video encoding and decoding capability information, and determining video preprocessing cooperative information corresponding to the original video according to the video processing capability information.

Step S30, converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperative information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video;

step S40, sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to the target terminal together, so that the target terminal can convert the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

In this embodiment, it should be noted that, according to the different device capabilities of the target terminal, the video preprocessing coordination information is different for the video preprocessing tasks allocated by the target terminal and the cloud server, taking a certain video image of the target video as an example, the target terminal may have full video image processing capability for the video image, may also have partial video image processing capability for the video image, and may also not have video image processing capability for the video image, when the target terminal has full video image processing capability, the cloud server is only responsible for sampling and encoding the video image, and when the cloud server sends the encoded video image to the target terminal, the target terminal decodes and processes the encoded video image, when the target terminal does not have video image processing capability, the cloud server continues to be responsible for running and rendering related logic, and when the target terminal does not have partial video image processing capability, the target terminal is responsible for decoding and playing the video image, and when the target terminal does not have partial video image, the processing tasks corresponding to the video image are reasonably divided by dividing the video image into a video image processing area and B video image processing area, wherein the video image processing area is divided into a video image processing area by the video image processing area, and B, and the video image processing area is further indicated by the video image processing area B, and the video image processing area is divided by the video area B, and the video processing area of the video server, if the video preprocessing task is used for indicating the cloud server to perform cooperative processing on all target video frames forming the target video, whether the target terminal has no video processing capability can be judged according to the processing mode of the cloud server on each target video frame, if any region of any target frame exists in each target video frame and is processed through the video processing capability of the target terminal, the target terminal can be judged to have partial video processing capability, otherwise, the target terminal can be judged to have no video processing capability, wherein the step of performing video image processing by the cloud server is completed before performing video coding by the cloud server, namely preprocessing before video, the step of performing video image processing by the target terminal is completed after performing video decoding by the target terminal, namely preprocessing after video.

As an example, steps S30 to S40 include: if the video preprocessing cooperative information is the first video preprocessing cooperative information allocated to the cloud server for determining that the video preprocessing task of the target video exists, performing video preprocessing on the target video according to the video preprocessing task corresponding to the first video preprocessing cooperative information, and encoding the target video subjected to video preprocessing according to the encoding and decoding parameters to obtain the target video code stream, and if the video preprocessing cooperative information is the second video preprocessing cooperative information allocated to the cloud server for determining that the video preprocessing task of the target video does not exist, encoding the target video subjected to video preprocessing according to the encoding and decoding parameters to obtain the target video code stream, wherein the video encoding and decoding parameters specifically can be resolution, code rate, frame rate and the like; and sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to the target terminal together so that the target terminal can convert the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for decoding the target video code stream by the target terminal, the video preprocessing cooperative information is used for determining a video preprocessing strategy of the video to be played after the target video code stream is decoded by the target terminal, and the cooperative processing mode is that all target video frames of the target video are subjected to complete video image processing.

Wherein, the step of converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information comprises:

step A10, determining whether to cooperatively preprocess the original video according to the video preprocessing cooperative information;

step A20, if yes, performing video preprocessing on the original video according to the video preprocessing cooperative information to obtain a preprocessed original video;

step A30, encoding the preprocessed original video according to the encoding and decoding parameters to obtain the target video code stream;

and A40, if not, encoding the preprocessed original video according to the encoding and decoding parameters to obtain the target video code stream.

As an example, steps a10 to a40 include: determining whether to cooperatively preprocess the original video according to the video preprocessing cooperative information; if the original video is determined to be subjected to collaborative preprocessing, performing video preprocessing on the original video according to the video preprocessing collaborative information to obtain a preprocessed original video; according to the encoding and decoding parameters, encoding the preprocessed original video to obtain the target video code stream; and if the original video is determined not to be preprocessed in a cooperative manner, encoding the preprocessed original video according to the encoding and decoding parameters to obtain the target video code stream. When the cloud server does not cooperatively preprocess the original video, it indicates that the video playing capability information of the target terminal is enough to represent that the target terminal has complete video processing capability, and then the video preprocessing task of the original video is completely handed to the target terminal, that is, the idle service resources of the target terminal are utilized, the service resources of the cloud server are saved, and the purpose of reasonably coordinating the service resources between the cloud server and the target terminal for the original video based on simple information interaction is achieved.

The method comprises the following steps of preprocessing original video, obtaining video preprocessing collaborative information, and obtaining preprocessed original video, wherein the preprocessed original video comprises a single collaborative original video and a multi collaborative original video, and the video preprocessing is performed on the original video according to the video preprocessing collaborative information to obtain the preprocessed original video comprises the following steps:

step B10, determining a video preprocessing task corresponding to the video preprocessing cooperative information, wherein the video preprocessing task comprises a video analysis task and a video enhancement task;

step B20, if the cooperative processing task is a multi-cooperative preprocessing task, performing cooperative analysis on the original video according to the video analysis task to obtain cooperative analysis information;

step B30, cooperatively enhancing the target video according to the video enhancement task to obtain the multi-cooperative original video;

and B40, if the cooperative processing task is a single cooperative preprocessing task, cooperatively enhancing the target video according to the video enhancement task to obtain the single cooperative original video.

In this embodiment, it should be noted that the video preprocessing task includes a video enhancement task and a video analysis task, that is, the cooperative processing task includes a single cooperative preprocessing task and a multi cooperative preprocessing task, the single cooperative preprocessing task is a cooperative preprocessing task for only performing video image enhancement on the target video, the multi cooperative preprocessing task is a cooperative preprocessing task for performing video content analysis and video image enhancement on the target video, the single cooperative original video is a target video for only performing video image enhancement on the target video by the cloud server, the multi cooperative original video is a target video for performing video image enhancement and video image analysis on the target video by the cloud server, where if the cooperative processing task is the multi cooperative processing task, it may be determined whether a terminal performing video content analysis is a cloud server or a target terminal through a computing capability of the target terminal, where the video content analysis is used to guide the video processing cooperation and the video encoding and decoding cooperation, for example, in an implementable manner, fig. 3 is a diagram representing that the video content analysis is performed by the cloud server, when the video content analysis is performed by the cloud server, the video content analysis is performed before the target image analysis step, and when the target image analysis is performed on the target video content, the video processing step is performed before the target image analysis step 4, which is performed by the video processing step.

As an example, steps B10 to B40 include: determining a video preprocessing task corresponding to the video preprocessing cooperative information according to the computing capacity of the target terminal, if the computing capacity is not greater than a preset computing capacity threshold value, determining that the cooperative processing task is a multi-cooperative preprocessing task, and if the computing capacity is greater than the preset computing capacity threshold value, determining that the cooperative processing character is a single cooperative preprocessing task; if the cooperative processing task is a multi-cooperative preprocessing task, performing cooperative analysis on the original video according to the video analysis task to obtain cooperative analysis information, wherein the cooperative analysis information is used for guiding the cloud server to cooperatively enhance the target video; cooperatively enhancing the target video according to the video enhancement task to obtain the multi-cooperative original video; and if the cooperative preprocessing task is a single cooperative preprocessing task, cooperatively enhancing the target video according to the video enhancement task to obtain the single cooperative original video.

The single collaborative original video comprises an overall collaborative enhanced original video and a partial collaborative enhanced original video, and the step of obtaining the single collaborative original video by collaboratively enhancing the target video according to the video enhancement task comprises the following steps:

step C10, if the video enhancement task is a first video enhancement task which is completely distributed to the cloud server by the video enhancement task, integrally enhancing the original video according to the first video enhancement task to obtain the integral cooperative enhancement target video;

and step C20, if the video enhancement task is a first video enhancement task completely distributed to the cloud server by the video enhancement task, integrally enhancing the original video according to the first video enhancement task to obtain the integral cooperative enhancement target video.

In this embodiment, it should be noted that the first video enhancement task is used to represent that a cloud server performs video overall processing on all video images of the target video through a correlation algorithm in cooperation with a preprocessing task, and the second video enhancement task is used to represent that video partial processing is performed on video images of the target video through a partial algorithm in cooperation with a preprocessing task, where the video partial processing may be performed by the cloud server when a target video frame exists in the target video.

As an example, steps C10 to C20 include: if the video enhancement task is a first video enhancement task which is completely distributed to the cloud server by the video enhancement task, integrally enhancing the original video according to the first video enhancement task to obtain an integrally collaborative enhancement target video, wherein the first video enhancement task is used for representing the video enhancement task without a video enhancement task; and if the video enhancement task is a first video enhancement task in which the video enhancement task is completely distributed to the cloud server, integrally enhancing the original video according to the first video enhancement task to obtain the integral cooperative enhancement target video.

Wherein the step of performing partial enhancement on the original video according to the second video enhancement task to obtain the partially cooperatively enhanced original video includes:

step D10, acquiring a video enhancement task corresponding to the second video enhancement task;

and D20, performing partial enhancement on the original video according to the video enhancement task to obtain the partial cooperative enhancement target video.

In this embodiment, it should be noted that the second video enhancement task is used to represent a video enhancement task having a video enhancer task, and the video enhancer task may be independently deployed in a cloud server or a target terminal respectively according to an algorithm to perform an independent enhancement task, for example, in an implementable manner, referring to fig. 5, fig. 5 is a schematic diagram illustrating the second video enhancement task, where the second video enhancement task B is composed of a video enhancer task B, a video enhancer task c, and a video enhancer task d, the video enhancer task B processes a video image of a target video through a processing algorithm x, the cooperative processing sub task c processes a video image of a target video through a processing algorithm y, and the cooperative processing task d processes a video image of a target video through a processing algorithm z, and if part of the video enhancer task of the second video enhancement task runs on the cloud server and part runs on the target terminal, it may be distinguished according to a computing capability of the target terminal that a processing algorithm corresponding to the video enhancer task runs on the cloud server or the target terminal, and when the second video enhancement task is deployed on the cloud server, the target terminal does not have the video enhancement task capability of the video enhancement task.

As an example, steps D10 to D40 include: acquiring a video enhancer task corresponding to the video preprocessing cooperative information; and according to the video enhancer task, performing partial enhancement on the original video according to the video enhancer task to obtain the partial cooperative enhancement target video.

After the step of sending the encoding and decoding parameters, the video preprocessing cooperative information, and the target video code stream to the target terminal, the end cloud resource cooperative method further includes:

step E10, if receiving the current operation state parameter sent by the target terminal, predicting whether to adjust the coding and decoding parameters and the video preprocessing cooperative information within a preset operation time period according to the current operation state parameter;

and E20, if the current operation state parameters sent by the target terminal are received, predicting whether the coding and decoding parameters and the video preprocessing cooperative information are adjusted within a preset operation time period according to the current operation state parameters.

In this embodiment, it should be noted that when the target terminal plays the target video, the target terminal reports an operation state of the target terminal to the cloud server in real time, so that the current operation state parameter is used to represent the current operation state, the current operation state parameter includes CPU/GPU frequency information, hardware temperature information, power consumption information, and the like, after receiving the current operation state parameter, the cloud server intelligently predicts a probability that a jam may occur in a future time period, and when a hardware resource cannot meet a performance requirement, the cloud server may interact with the cloud server to dynamically adjust a coding and decoding parameter and video preprocessing cooperative information, so as to ensure video quality experience.

As an example, steps E10 to E20 include: if the current running state parameters sent by the target terminal are received, determining whether the current running state parameters are larger than a preset current running state parameter threshold value, if so, predicting to adjust the video playing cooperative strategy in a preset running time period, wherein when any running parameter is larger than the preset running parameter threshold value, the running state parameters are determined to be larger than the preset current running state parameter threshold value, and the preset running time period is set by a user; if the video playing cooperative strategy is predicted to be adjusted in the preset operation time period, adjusting the encoding and decoding parameters to obtain adjusted encoding and decoding parameters, adjusting the video preprocessing cooperative information to obtain adjusted video preprocessing cooperative information, and returning to the execution step: and converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the adjustment mode can be an adjustment mode according to idle computing resources of a target terminal.

The embodiment of the application provides an end cloud resource coordination method, namely, an end cloud resource coordination request sent by a target terminal aiming at an original video is received, wherein the end cloud resource coordination request carries video type information of the original video and video playing capacity information of the target terminal; further, according to the video type information and the video playing capability information, the encoding and decoding parameters corresponding to the original video and the corresponding video preprocessing cooperative information are determined, and the purpose of interactively determining the encoding and decoding parameters corresponding to the target terminal and the corresponding video preprocessing cooperative information through information interaction of the cloud server and the target video aiming at the target video is achieved; converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperative information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to the target terminal together, so that the target terminal converts the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream; since the video preprocessing cooperative information is used to determine the task allocation situation of the video preprocessing task of the target video at the target terminal and the cloud server, and then the cloud server and the target terminal determine whether to preprocess the video preprocessing task according to the task allocation situation, and since the encoding and decoding parameters are used to encode the target video into the target video code stream after the cloud server determines whether to cooperatively process the target video according to the video preprocessing task, and decode the target video code stream into the target video code stream before the target terminal determines whether to cooperatively process the target video according to the video preprocessing task, even if there is a video preprocessing task at the cloud server or the target terminal, the video preprocessing of the target video will be completed before or after encoding the target video, and thus there is no situation of encoding distortion influence, and at the same time, the video preprocessing task allocation depends on the video playing capability information, and the image quality of the video preprocessing task allocated according to the video playing capability is dependent on the video playing capability information, and the video preprocessing task allocated at the target terminal will not effectively utilize the video resources of the target video server, and thus the target video server can not effectively utilize the video resources of the target video server, and the target video resources can be further overcome the defects of the video preprocessing task that the video preprocessing task, and the video server can not effectively utilize the target video resources. That is, the video picture effect of the target video is improved, so the picture effect of the cloud game picture is also improved.

Example two

Further, referring to fig. 6, in another embodiment of the present application, the same or similar contents as those in the first embodiment may refer to the above description, and are not repeated herein. On this basis, the terminal cloud resource coordination method is applied to the target terminal, and further comprises the following steps:

step F10, sending a cloud resource cooperative request to a cloud server, wherein the end cloud resource cooperative request carries video type information of the target video and video playing capability information of the target terminal, so that the cloud server determines encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information according to the video type information and the video playing capability information, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperative information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video;

step F20, receiving the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream sent by the cloud server;

step F30, converting the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

In this embodiment, it should be noted that the video display instruction is used to trigger the target terminal to automatically collect video type information of the target video and video playing capability information of the target terminal, so as to generate an end cloud resource coordination request, and specifically, the video display instruction may be triggered by a user through a voice or a key, and for the target video after coordination processing, the target video may be transmitted to a display of the target terminal through an I/O interface, and then display and play processing is performed based on the display, the target video obtained by decoding the target terminal may be a target video that is not subjected to a video analysis task and is not subjected to a video enhancement task by the cloud server, or may be a target video that is not subjected to a video analysis task and is subjected to a video enhancement task, the video to be played may be a first video enhancement task and a second video enhancement task, the video to be played is a video that is to be played on a preset display interface of the target terminal, and after the video to be played is obtained, the video to be played may be played through the video playing instruction.

As an example, steps F10 to F40 include: if a video display instruction input by a user for a target video is detected, sending a cloud resource cooperation request to a cloud server, wherein the end cloud resource cooperation request carries video type information of the target video and video playing capacity information of a target terminal, so that the cloud server determines encoding and decoding parameters and corresponding video preprocessing cooperation information corresponding to the original video according to the video type information and the video playing capacity information, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperation information, wherein the encoding and decoding parameters are used for encoding the original video by the cloud server, and the video preprocessing cooperation information is used for determining a video preprocessing strategy of the original video by the cloud server before encoding the original video; receiving the encoding and decoding parameters, the video preprocessing cooperative information and the target video code stream sent by the cloud server; and converting the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

In an implementable manner, the task allocation condition of the video preprocessing task determined by the video preprocessing cooperative information includes that the video preprocessing tasks are all allocated to the cloud server, the video preprocessing tasks are all allocated to the target terminal, and the video preprocessing tasks are partially allocated to the cloud server and partially allocated to the target terminal.

After the step of converting the target video code stream into the corresponding video to be played according to the encoding and decoding parameters and the video preprocessing cooperative information, the end cloud resource cooperative method further includes:

and G10, acquiring current operation state parameters, and sending the current operation state parameters to the cloud server so that the cloud server can predict whether to adjust the encoding and decoding parameters and the video preprocessing cooperative information within a preset operation time period according to the current operation state parameters.

As an example, step G10 includes: acquiring a current operation state parameter, and sending the current operation state parameter to the cloud server, so that the cloud server predicts whether to adjust the coding and decoding parameters and the video preprocessing cooperative information within a preset operation time period according to the current operation state parameter, wherein the specific steps of step E10 to step E20 can be referred to for predicting whether to adjust the coding and decoding parameters and the video preprocessing cooperative information within the preset operation time period according to the current operation state parameter by the cloud server, and the detailed description is omitted here.

The embodiment of the application provides an end cloud resource coordination method, which is applied to a target terminal, that is, a cloud resource coordination request is sent to a cloud server, wherein the end cloud resource coordination request carries video type information of a target video and video playing capacity information of the target terminal, so that the cloud server determines encoding and decoding parameters and corresponding video preprocessing coordination information corresponding to an original video according to the video type information and the video playing capacity information, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing coordination information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing coordination information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; receiving the encoding and decoding parameters, the video preprocessing cooperative information and the target video code stream sent by the cloud server; and converting the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream. The video preprocessing cooperative information is used for determining the task allocation condition of a video preprocessing task of a target video at a target terminal and a cloud server, and then the cloud server and the target terminal determine whether to preprocess the video preprocessing task according to the task allocation condition, and the coding and decoding parameters are used for coding the target video into the target video code stream after the cloud server determines whether to cooperatively process the target video according to the video preprocessing task, and decoding the target video code stream into the target video code stream before the target terminal determines whether to cooperatively process the target video according to the video preprocessing task, i.e. even if the video preprocessing task exists at the cloud server or the target terminal, the video preprocessing of the target video is completed before or after the target video is coded, and further the condition that the video quality is influenced by coding distortion does not occur, meanwhile, the video preprocessing task allocation depends on the video playing capability information, and the video service allocated at the target terminal is sufficient for content analysis and video processing work of the target video to a certain degree, so that the video server can not effectively analyze the video resources of the target video and further improve the video quality of the target video resources, and further the cloud server can not effectively analyze the video resources of the target video resources. That is, the video picture effect of the target video is improved, so the picture effect of the cloud game picture is also improved.

EXAMPLE III

An embodiment of the present application further provides an end cloud resource coordination device, which is applied to a cloud server, and with reference to fig. 7, the end cloud resource coordination device includes:

a first receiving module 101, configured to receive an end cloud resource cooperation request sent by a target terminal for an original video, where the end cloud resource cooperation request carries video type information of the original video and video playing capability information of the target terminal;

a determining module 102, configured to determine, according to the video type information and the video playing capability information, a coding/decoding parameter corresponding to the original video and corresponding video preprocessing cooperative information;

a first conversion module 103, configured to convert the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, where the encoding and decoding parameters are used by the cloud server to encode the original video, and the video preprocessing cooperative information is used by the cloud server to determine a video preprocessing policy of the original video before encoding the original video;

a first sending module 104, configured to send the coding and decoding parameters, the video preprocessing cooperative information, and the target video code stream to the target terminal together, so that the target terminal converts the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, where the coding and decoding parameters are used by the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used by the target terminal to determine a video preprocessing policy of the video to be played after decoding the target video code stream.

Optionally, the first conversion module 103 is further configured to:

determining whether to cooperatively preprocess the original video according to the video preprocessing cooperative information;

if so, performing video preprocessing on the original video according to the video preprocessing cooperative information to obtain a preprocessed original video;

according to the encoding and decoding parameters, encoding the preprocessed original video to obtain the target video code stream;

if not, encoding the preprocessed original video according to the encoding and decoding parameters to obtain the target video code stream.

Optionally, the preprocessed original videos include a single collaborative original video and multiple collaborative original videos, and the conversion module 103 is further configured to:

determining a video preprocessing task corresponding to the video preprocessing cooperative information, wherein the video preprocessing task comprises a video analysis task and a video enhancement task;

if the cooperative processing task is a multi-cooperative preprocessing task, performing cooperative analysis on the original video according to the video analysis task to obtain cooperative analysis information;

cooperatively enhancing the target video according to the video enhancement task to obtain the multi-cooperative original video;

and if the cooperative processing task is a single cooperative preprocessing task, cooperatively enhancing the target video according to the video enhancement task to obtain the single cooperative original video.

Optionally, the first conversion module 103 is further configured to:

if the video enhancement task is a first video enhancement task which is completely distributed to the cloud server by the video enhancement task, integrally enhancing the original video according to the first video enhancement task to obtain the integral collaborative enhancement target video;

and if the video enhancement task is a second video preprocessing task in which the video enhancement task is partially distributed to the cloud server, partially enhancing the original video according to the second video enhancement task to obtain the partially cooperatively enhanced original video.

Optionally, the first conversion module 103 is further configured to:

acquiring a video enhancement task corresponding to the second video enhancement task;

and according to the video enhancer task, carrying out partial enhancement on the original video to obtain the partial cooperative enhancement target video.

Optionally, the end cloud resource coordination apparatus is further configured to:

if the current operation state parameter sent by the target terminal is received, predicting whether the coding and decoding parameters and the video preprocessing cooperative information are adjusted within a preset operation time period according to the current operation state parameter;

if so, taking the adjusted encoding and decoding parameters as the encoding and decoding parameters, taking the adjusted video preprocessing cooperative information as the video preprocessing cooperative information, and returning to the execution step: and converting the original video into a corresponding target video code stream according to the coding and decoding parameters and the video preprocessing cooperative information.

By adopting the terminal cloud resource coordination method in the embodiment, the terminal cloud resource coordination device provided by the invention solves the technical problem of poor cloud game picture effect caused by poor service resource management effect of the cloud server. Compared with the prior art, the beneficial effects of the end cloud resource coordination device provided by the embodiment of the invention are the same as those of the end cloud resource coordination method provided by the embodiment, and other technical features in the end cloud resource coordination device are the same as those disclosed by the embodiment method, which are not repeated herein.

Example four

An embodiment of the present application further provides an end cloud resource coordination apparatus, which is applied to a target terminal, and with reference to fig. 8, the end cloud resource coordination apparatus includes:

a second sending module 201, configured to send a cloud resource coordination request to a cloud server, where the end cloud resource coordination request carries video type information of the target video and video playing capability information of the target terminal, so that the cloud server determines, according to the video type information and the video playing capability information, encoding and decoding parameters and corresponding video preprocessing coordination information corresponding to the original video, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing coordination information, where the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing coordination information is used for the cloud server to determine a video preprocessing policy of the original video before encoding the original video;

a second receiving module 202, configured to receive the encoding and decoding parameter, the video preprocessing coordination information, and the target video code stream sent by the cloud server;

a second conversion module 203, configured to convert the target video code stream into a corresponding video to be played according to the encoding and decoding parameters and the video preprocessing cooperative information, where the encoding and decoding parameters are used by the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used by the target terminal to determine a video preprocessing policy of the video to be played after decoding the target video code stream.

Optionally, the end cloud resource coordination device is further configured to:

and acquiring current operation state parameters, and sending the current operation state parameters to the cloud server so that the cloud server can predict whether to adjust the coding and decoding parameters and the video preprocessing cooperative information within a preset operation time period according to the current operation state parameters.

The terminal cloud resource cooperation device provided by the invention adopts the terminal cloud resource cooperation method in the embodiment, and solves the technical problem of poor cloud game picture effect caused by poor service resource management effect of the cloud server. Compared with the prior art, the beneficial effects of the end cloud resource coordination device provided by the embodiment of the invention are the same as those of the end cloud resource coordination method provided by the embodiment, and other technical features in the end cloud resource coordination device are the same as those disclosed by the embodiment method, which are not repeated herein.

EXAMPLE five

An embodiment of the present invention provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the end cloud resource coordination method in the first embodiment.

Referring now to FIG. 9, shown is a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., car navigation terminals), and the like, and fixed terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 9 is only an example, and should not bring any limitation to the functions and the use range of the embodiment of the present disclosure.

As shown in fig. 9, the electronic device may include a processing means 1001 (e.g., a central processing unit, a graphic processor, etc.) which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1002 or a program loaded from a storage means 1003 into a Random Access Memory (RAM) 1004. In the RAM1004, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input/output (I/O) interface 1006 is also connected to the bus.

Generally, the following systems may be connected to the I/O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, or the like; output devices 1008 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, or the like; a storage device 1003 including, for example, a magnetic tape, a hard disk, or the like; and a communication device 1009. The communication means may allow the electronic device to communicate wirelessly or by wire with other devices to exchange data. While the figures illustrate an electronic device with various systems, it is to be understood that not all illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 1009, or installed from the storage means 1003, or installed from the ROM 1002. The computer program, when executed by the processing device 1001, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

The electronic device provided by the invention adopts the end cloud resource cooperation method in the embodiment, so that the technical problem of poor cloud game picture effect caused by poor service resource management effect of the cloud server is solved. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of the present invention are the same as those of the end cloud resource coordination method provided by the above embodiment, and other technical features of the electronic device are the same as those disclosed in the above embodiment method, which are not described herein again.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the foregoing description of embodiments, the particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Example six

The present embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for executing the end cloud resource coordination method in the above embodiments.

Embodiments of the present invention provide a computer readable storage medium, such as a USB flash drive, but are not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present embodiment, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer-readable storage medium may be embodied in an electronic device; or may be present alone without being incorporated into the electronic device.

The computer readable storage medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving an end cloud resource cooperation request sent by a target terminal aiming at an original video, wherein the end cloud resource cooperation request carries video type information of the original video and video playing capacity information of the target terminal; determining encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperative information according to the video type information and the video playing capability information; converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperative information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; and sending the coding and decoding parameters, the video preprocessing cooperative information and the target video code stream to the target terminal together, so that the target terminal converts the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

Or sending a cloud resource cooperation request to a cloud server, wherein the cloud resource cooperation request carries video type information of the target video and video playing capability information of the target terminal, so that the cloud server determines encoding and decoding parameters corresponding to the original video and corresponding video preprocessing cooperation information according to the video type information and the video playing capability information, and converts the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperation information, wherein the encoding and decoding parameters are used for the cloud server to encode the original video, and the video preprocessing cooperation information is used for the cloud server to determine a video preprocessing strategy of the original video before encoding the original video; receiving the encoding and decoding parameters, the video preprocessing cooperative information and the target video code stream sent by the cloud server; and converting the target video code stream into a corresponding video to be played according to the coding and decoding parameters and the video preprocessing cooperative information, wherein the coding and decoding parameters are used for the target terminal to decode the target video code stream, and the video preprocessing cooperative information is used for the target terminal to determine a video preprocessing strategy of the video to be played after decoding the target video code stream.

Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present disclosure may be implemented by software or hardware. Wherein the names of the modules do not in some cases constitute a limitation of the unit itself.

The computer-readable storage medium provided by the invention stores the computer-readable program instructions for executing the end cloud resource coordination method, and solves the technical problem of poor cloud game picture effect caused by poor service resource management effect of the cloud server. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiment of the present invention are the same as those of the cloud-end resource coordination method provided by the above embodiment, and are not described herein again.

EXAMPLE seven

The computer program product solves the technical problem that the cloud game picture effect is poor due to poor service resource management effect of a cloud server. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present invention are the same as those of the end cloud resource coordination method provided by the above embodiment, and are not described herein again.

The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.

Claims

1. An end cloud resource coordination method is applied to a cloud server, and comprises the following steps:

2. The method for coordinating peer cloud resources according to claim 1, wherein the step of converting the original video into the corresponding target video stream according to the encoding/decoding parameters and the video preprocessing coordination information comprises:

if not, the preprocessed original video is coded according to the coding and decoding parameters, and the target video code stream is obtained.

3. The peer cloud resource coordination method according to claim 2, wherein said preprocessed original video includes single coordination original video and multiple coordination original video,

the step of performing video preprocessing on the original video according to the video preprocessing cooperative information to obtain a preprocessed original video includes:

4. The cloud resource coordination method according to claim 3, wherein said single coordination original video comprises an entire coordination enhanced original video and a partial coordination enhanced original video,

the step of cooperatively enhancing the target video according to the video enhancement task to obtain the single cooperative original video comprises:

if the video enhancement task is a first video enhancement task which is completely distributed to the cloud server by the video enhancement task, integrally enhancing the original video according to the first video enhancement task to obtain an integrally cooperatively enhanced target video;

5. The method for collaboratively processing cloud resources according to claim 4, wherein the step of partially enhancing the original video according to the second video enhancement task to obtain the partially collaboratively enhanced original video comprises:

6. The method for coordinating peer cloud resources according to claim 1, wherein after the step of sending the encoding and decoding parameters, the video preprocessing coordination information, and the target video code stream to the target terminal, the method for coordinating peer cloud resources further comprises:

if so, taking the adjusted encoding and decoding parameters as the encoding and decoding parameters, taking the adjusted video preprocessing cooperative information as the video preprocessing cooperative information, and returning to the execution step: and converting the original video into a corresponding target video code stream according to the encoding and decoding parameters and the video preprocessing cooperative information.

7. An end cloud resource coordination method is applied to a target terminal, and comprises the following steps:

8. The end cloud resource coordination method according to claim 7, wherein after the step of converting the target video code stream into the corresponding video to be played according to the encoding and decoding parameters and the video preprocessing coordination information, the end cloud resource coordination method further comprises:

9. An electronic device, characterized in that the electronic device comprises:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the end cloud resource coordination method of any of claims 1 to 6 or 7 to 8.

10. A computer-readable storage medium, wherein a program for implementing an end cloud resource coordination method is stored on the computer-readable storage medium, and the program is executed by a processor to implement the steps of the end cloud resource coordination method according to any one of claims 1 to 6 or 7 to 8.