WO2023273772A1

WO2023273772A1 - Data processing method, cloud server, terminal and storage medium

Info

Publication number: WO2023273772A1
Application number: PCT/CN2022/096288
Authority: WO
Inventors: 杨洋
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-06-28
Filing date: 2022-05-31
Publication date: 2023-01-05
Also published as: CN115604524A

Abstract

A data processing method, a cloud server, a terminal and a storage medium. The data processing method is applied to a cloud server, and the cloud server is in communication connection with a terminal. The data processing method comprises: acquiring a video playing request sent by a terminal, and acquiring a target video according to the video playing request (S110); demultiplexing the target video to obtain a video stream to be processed (S120); determining a decoding parameter for said video stream, and sending the decoding parameter to the terminal, such that the terminal obtains a target decoding object according to the decoding parameter (S130); and forwarding said video stream to the terminal, such that the terminal decodes said video stream by means of the target decoding object, so as to obtain the target video, and plays the target video (S140).

Description

Data processing method, cloud server, terminal and storage medium

Cross References to Related Applications

This application is based on a Chinese patent application with application number 202110722681.2 and a filing date of June 28, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The present application relates to but not limited to the technical field of data processing, and in particular relates to a data processing method, a cloud server, a terminal, and a storage medium.

Background technique

With the development of big video services becoming more and more mature, in order to allow users to enjoy richer value-added services and have a better user interface (User Interface, UI) experience, cloud terminals based on cloud computing and virtualization technology have emerged as the times require. Playing video is one of the important functions of the terminal. For traditional cloud-based terminals, operations such as decoding and rendering during video playback are handled by the virtual machine of the cloud server, which takes up more virtual machine resources. How to reduce the virtual machine load when playing video? Load is the key to improving the load capacity of cloud servers.

A common practice is to transmit information such as the video playback address to the cloud terminal, and the cloud terminal obtains the video according to the video playback address and plays it, so that the resource-intensive operations are delegated to the cloud terminal for local execution. Although this reduces the burden on the virtual machine, different video application interfaces are different, and application developers may also perform secondary development on the player. Therefore, it is necessary to carry out integrated development of video applications on cloud terminals, and there are many video applications. In the case of , the development is very difficult.

Contents of the invention

The following is an overview of the topics described in detail in this article. This summary is not intended to limit the scope of the claims.

Embodiments of the present application provide a data processing method, a cloud server, a terminal, and a storage medium.

In the first aspect, the embodiment of the present application provides a data processing method, which is applied to a cloud server, and the cloud server communicates with a terminal. The data processing method includes: acquiring a video playback request sent by the terminal, and playing Requesting to obtain the target video; demultiplexing the target video to obtain a video stream to be processed; determining decoding parameters for the video stream to be processed, and sending the decoding parameters to the terminal, so that the terminal can obtain the video stream according to the Decoding parameters to obtain a target decoding object; forwarding the video stream to be processed to the terminal, so that the terminal decodes the video stream to be processed through the target decoding object to obtain a target video, and plays the target video.

In the second aspect, the embodiment of the present application provides a data processing method, which is applied to a terminal, and the terminal communicates with a cloud server, and the data processing method includes: sending a video playback request to the cloud server, so that the The cloud server obtains the target video according to the video playback request; obtains the decoding parameters sent by the cloud server, obtains the target decoding object according to the decoding parameters, and the decoding parameters are determined by the cloud server according to the video stream to be processed; Acquiring the video stream to be processed sent by the cloud server, the video stream to be processed is obtained by the cloud server by demultiplexing the target video; decoding the video stream to be processed by the target decoding object to obtain the target video , and play the target video.

In a third aspect, an embodiment of the present application provides a cloud server, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, when the processor executes the computer program, the following On the one hand, the data processing method described in any one of the embodiments

In a fourth aspect, an embodiment of the present application provides a terminal, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor executes the computer program to implement the second The data processing method described in any one embodiment of the aspect.

In the fifth aspect, the embodiments of the present application further provide a storage medium storing computer-executable instructions configured to execute the data processing method described in any one of the embodiments of the first aspect, or Execute the data processing method described in the embodiment of the second aspect.

Additional features and advantages of the application will be set forth in the description which follows, and, in part, will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Description of drawings

The accompanying drawings are used to provide a further understanding of the technical solution of the present application, and constitute a part of the specification, and are used together with the embodiments of the present application to explain the technical solution of the present application, and do not constitute a limitation to the technical solution of the present application.

Fig. 1 is a flow chart of steps of a data processing method provided by an embodiment of the present application;

FIG. 2 is a flow chart of steps for determining decoding parameters for a video stream to be processed provided by another embodiment of the present application;

FIG. 3 is a flow chart of steps for sending desktop streams provided by another embodiment of the present application;

FIG. 4 is a flow chart of steps for generating a desktop stream provided by another embodiment of the present application;

Fig. 5 is a flow chart of steps for obtaining preset color blocks provided by another embodiment of the present application;

FIG. 6 is a flow chart of steps of a data processing method provided in another embodiment of the present application;

FIG. 7 is a flow chart of steps for obtaining a target decoding object provided by another embodiment of the present application;

FIG. 8 is a flow chart of steps for obtaining desktop streams provided by another embodiment of the present application;

Fig. 9 is a flow chart of the steps of obtaining the target video provided by another embodiment of the present application;

FIG. 10 is a schematic diagram of modules of a cloud server and a terminal provided in another embodiment of the present application;

Fig. 11 is a flow chart of video playback provided by another embodiment of the present application;

Fig. 12 is a flowchart of a data processing method provided by another embodiment of the present application;

Fig. 13 is a schematic diagram of a cloud server provided by another embodiment of the present application;

Fig. 14 is a schematic diagram of a terminal provided by another embodiment of the present application.

detailed description

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

It should be noted that although the functional modules are divided in the schematic diagram of the device, and the logical sequence is shown in the flowchart, in some cases, it can be executed in a different order than the module division in the device or the flowchart in the flowchart. steps shown or described. The terms "first", "second" and the like in the specification, claims or the above drawings are used to distinguish similar objects, and not necessarily used to describe a specific order or sequence.

The present application provides a data processing method, a cloud server, a terminal, and a storage medium, wherein the data processing method is applied to the cloud server, and the cloud server communicates with the terminal. The data processing method includes: obtaining a video playback request sent by the terminal, and according to the Play the request to obtain the target video; demultiplex the target video to obtain the video stream to be processed; determine the decoding parameters for the video stream to be processed, and send the decoding parameters to the terminal so that the terminal can obtain the target decoding object according to the decoding parameters; convert the video stream to be processed The stream is forwarded to the terminal, so that the terminal decodes the video stream to be processed through the target decoding object to obtain the target video, and plays the target video. According to the solution provided by the embodiment of the present application, it is possible to effectively reduce the limitation of playing video on the cloud terminal and reduce the resource consumption of the virtual machine.

The embodiments of the present application will be further described below in conjunction with the accompanying drawings.

As shown in FIG. 1 , FIG. 1 is a flow chart of the steps of a data processing method provided by an embodiment of the present application. The data processing method is applied to a cloud server. The data processing method includes but is not limited to the following steps S110 to S140.

Step S110, acquire the video play request sent by the terminal, and acquire the target video according to the video play request.

It can be understood that when the cloud server receives the video playback request sent by the terminal, it obtains the target video according to the video playback request. It should be noted that the embodiment of the present application does not limit the specific content in the video playback request, which may include The address information of , will not be repeated here.

It should be noted that the embodiment of the present application does not limit the storage location of the target video. The target video may be video data stored locally on the cloud server, or video data that needs to be downloaded through the network, which will not be repeated here.

Step S120, demultiplexing the target video to obtain a video stream to be processed.

It can be understood that the target video obtained according to the video playback request can be video data downloaded through the network, and the target video needs to be demultiplexed to obtain the video stream to be processed. The video stream to be processed can be an H264 code stream. The specific content of processing the video stream is not limited. It can be understood that obtaining the video stream to be processed can provide a data basis for the terminal to play the target video.

Step S130, determine the decoding parameters for the video stream to be processed, and send the decoding parameters to the terminal, so that the terminal can obtain the target decoding object according to the decoding parameters.

It can be understood that since the video streams to be processed have many different data types, those skilled in the art have the motivation to determine different decoding parameters according to different types of video streams to be processed, so the embodiment of the present application does not specify the specific data of the decoding parameters Types are restricted.

It should be noted that the decoding parameters may include parameters for decoding the video stream to be processed, parameters for creating and configuring decoding objects, and it is only necessary for the terminal to obtain the target decoding object according to the decoding parameters, and there is no limitation here.

Step S140, forwarding the video stream to be processed to the terminal, so that the terminal decodes the video stream to be processed through the target decoding object to obtain the target video, and plays the target video.

It can be understood that the cloud server obtains the target video, demultiplexes the target video to obtain the video stream to be processed, and forwards the video stream to be processed to the terminal, so that the terminal can directly decode the video stream to be processed through the target decoding object to obtain the target video. Compared with the method of developing different interfaces on the terminal to match different video applications, and obtaining and playing the target video according to information such as the video playback address, the technical solution of this application can effectively reduce the limitation of cloud-based terminals playing videos, and Reduce resource consumption of cloud servers.

In addition, referring to FIG. 2 , in one embodiment, step S130 in the embodiment shown in FIG. 1 includes but not limited to the following steps S210 to S220 .

Step S210, create a reference decoding object according to the video stream to be processed, and determine decoding parameters according to the reference decoding object.

Step S220, sending the decoding parameters to the terminal, so that the terminal creates the same target decoding object as the reference decoding object, and configures the target decoding object through the decoding parameters.

It can be understood that the cloud server creates a reference decoding object based on the video stream to be processed, determines the decoding parameters according to the reference decoding object, and sends the decoding parameters to the terminal, so that the terminal creates the same target decoding object as the reference decoding object, and passes the decoding parameter Configure the target decoding object so that the terminal decodes and plays the target video through the target decoding object.

In addition, referring to FIG. 3 , in one embodiment, after step S140 in the embodiment shown in FIG. 1 , the data processing method further includes but not limited to the following step S310 .

Step S310, generate a desktop stream, and send the desktop stream to the terminal, so that the terminal decodes the desktop stream to obtain a desktop stream image, and the desktop stream image is used to synthesize a target video with the video image obtained by decoding the video stream to be processed.

It can be understood that the playback location of the target video is in the video display layer of the video application player, and the desktop stream can be advertisement pop-up windows, barrage data, and the user interface of the video application player that appear during video playback. The application embodiments are not limited here.

It can be understood that the cloud server generates the desktop stream and sends the desktop stream to the terminal, enabling the terminal to decode the desktop stream to obtain the desktop stream image, and synthesize the target video according to the desktop stream image and the video image obtained by decoding the video stream to be processed.

In addition, referring to FIG. 4 , in one embodiment, step S310 in the embodiment shown in FIG. 3 includes but is not limited to the following steps S410 to S440 .

Step S410, acquiring a preset color block;

Step S420, determine the playing area of the target video according to the reference decoding object;

Step S430, deleting the image information corresponding to the playing area in the preset color block to obtain the background information;

Step S440, acquiring desktop flow information, and obtaining desktop flow according to the desktop flow information and background information.

It can be understood that the preset color block is obtained, the playback area of the target video is determined according to the reference decoding object, the image information corresponding to the playback area is deleted in the preset color block, the background information is obtained, and the desktop stream information is obtained, according to The desktop stream information and background information are obtained from the desktop stream, which provides a data basis for the terminal to obtain the target video.

It can be understood that the embodiment of the present application does not limit the specific manner of obtaining the desktop stream according to the desktop stream information and the background information, and the desktop stream may be obtained by superimposing the desktop stream information and the background information.

It should be noted that the embodiment of the present application does not limit the specific color and size parameters of the preset color blocks, and those skilled in the art are motivated to select them according to the playing area parameters of the target video, and details are not repeated here.

In addition, referring to FIG. 5 , in an embodiment, step S410 in the embodiment shown in FIG. 4 includes but is not limited to the following step S510 .

Step S510, obtaining the preset color block from the feedback information obtained by the first interface, wherein the feedback information is obtained by polling the decoding data from the reference decoding object by the first interface.

It can be understood that the preset color block is obtained from the feedback information obtained by the first interface, wherein the feedback information is obtained by polling the decoding data from the reference decoding object by the first interface, so as to provide a data basis for generating the desktop stream. In order to explain in more detail how to obtain preset color blocks, an example is used below to illustrate, for example, for the cloud server of the Android system, a Mediacodec class is created on the cloud server side, which is the reference decoding object, and the reference decoding object will be created at the same time The parameters are sent to the terminal so that the terminal creates a Mediacodec class that is the same as the reference decoding object, that is, the target decoding object. The Mediacodec class on the cloud server side has a dequeueOutputBuffer interface, which is used to forward the pending video stream obtained after demultiplexing to the terminal. The terminal can decode the video stream to be processed through the target decoding object and play the target video. Although the cloud server redirects the operation of decoding the video stream to be processed to the terminal through the dequeueOutputBuffer interface, the Mediacodec class on the cloud server also includes the dequeueOutputBuffer interface. That is, the first interface, when the first interface polls the Mediacodec class on the cloud server for decoding data, the decoding data is not obtained, and abnormal phenomena such as error reporting will occur, which will affect the terminal to play the target video. In order to ensure that the target video is not played If an exception occurs, a piece of black data can be pre-set, that is, a preset color block, as feedback information for the Mediacodec class on the cloud server side to poll the decoded data.

As shown in FIG. 6 , FIG. 6 is a flow chart of the steps of a data processing method provided by an embodiment of the present application. The data processing method is applied to a terminal. The data processing method includes but is not limited to the following steps S610 to S640.

Step S610, sending a video play request to the cloud server, so that the cloud server acquires the target video according to the video play request.

In step S620, the decoding parameter sent by the cloud server is obtained, and the target decoding object is obtained according to the decoding parameter, and the decoding parameter is determined by the cloud server according to the video stream to be processed.

Step S630, acquire the video stream to be processed sent by the cloud server, and the video stream to be processed is obtained by the cloud server by demultiplexing the target video.

Step S640, decode the video stream to be processed through the target decoding object to obtain the target video, and play the target video.

It should be noted that, for specific steps and methods, refer to the description of the embodiment shown in FIG. 1 , which will not be repeated here. The difference between this embodiment and the embodiment shown in FIG. 1 lies in that the terminal is used as the execution subject in this embodiment to describe.

In addition, referring to FIG. 7 , in one embodiment, step S620 in the embodiment shown in FIG. 6 includes but not limited to the following steps S710 to S720 .

Step S710, creating a target decoding object, where the target decoding object is the same as the reference decoding object created by the cloud server according to the video stream to be processed.

Step S720, configure the target decoding object according to the decoding parameter, wherein the decoding parameter is determined according to the reference decoding object.

It should be noted that, for specific steps and methods, refer to the description of the embodiment shown in FIG. 2 , which will not be repeated here. The difference between this embodiment and the embodiment shown in FIG. 2 is that the terminal is used as the execution subject in this embodiment to describe.

In addition, referring to FIG. 8 , in one embodiment, after step S630 in the embodiment shown in FIG. 6 , the data processing method further includes, but is not limited to, the following step S810 .

Step S810, obtain the desktop stream sent by the cloud server, wherein the desktop stream is obtained by the cloud server according to the desktop stream information and background information, and the background information is deleted by the cloud server from the acquired preset color blocks corresponding to the playing area The image information is obtained, and the playback area is determined by the cloud server based on the reference decoding object.

It should be noted that, for specific steps and methods, reference may be made to the description of the embodiment shown in FIG. 3 and FIG. The example uses the terminal as the execution subject for description.

In addition, referring to FIG. 9 , in one embodiment, step S640 in the embodiment shown in FIG. 6 includes but is not limited to the following steps S910 to S930 .

In step S910, the desktop stream image is obtained by decoding the desktop stream.

In step S920, the video stream to be processed is decoded by the target decoding object to obtain a video image.

In step S930, the target video is obtained by synthesizing the desktop stream image and the video image.

It should be noted that, for specific steps and methods, reference may be made to the description of the embodiment shown in FIG. 3 , which will not be repeated here. The difference between this embodiment and the embodiment shown in FIG. 3 is that this embodiment takes the terminal as the execution subject to describe.

It should be noted that since the background information in the desktop stream is obtained by the cloud server by deleting the image information corresponding to the playback area in the acquired preset color block, the playback area is the playback area of the video image, so the desktop stream image Combining with video images does not affect the normal display of video images.

In addition, in order to describe the data processing method provided by the present application in more detail, the technical solutions of the present application are described below with three specific examples.

Example 1: Referring to FIG. 10, FIG. 10 is a block diagram of a cloud server 1010 and a terminal 1040 provided in another embodiment of the present application. In the cloud server 1010 shown in FIG. 1010 includes a front-end server 1020 and a virtual machine 1030, the front-end server 1020 includes a video stream channel 1021 and a desktop stream channel 1022, and the virtual machine 1030 includes a Vdagent interface 1031, a video application 1032, a video application player 1033, a cloud Mediacodec decoder 1034, and a surfaceflinger module 1035, a drm module 1036 and a qxl driver 1037; the terminal 1040 includes a video streaming player 1041, a desktop streaming player 1042 and a MediaCodec decoder 1043. Wherein, the video application 1032 is an application program installed in the cloud; the video application player 1033 is a player used by the application program installed in the cloud; the cloud Mediacodec decoder 1034 is an Android hardware decoding module; the front-end server 1020 is used to realize data interaction with the terminal 1040 ; The video stream player 1041, the desktop stream player 1042 and the MediaCodec decoder 1043 in the terminal 1040 are used for decoding, rendering, image synthesis, and image display of the desktop stream and video stream.

The main process of realizing the target video through the cloud server 1010 and the terminal 1040 is: the video application 1032 creates a player after receiving the video playback request from the terminal 1040; the video application player 1033 downloads and demultiplexes the target video source to obtain the video stream to be processed The cloud server 1010 creates a cloud Mediacodec decoder 1034, and sends the video stream to be processed after the decoder setting parameters and demultiplexing to the terminal 1040 through the video stream channel 1021 of the Vdagent interface 1031 and the front-end server 1020, so that the terminal 1040 can decode according to Create a MediaCodec decoder 1043 of a terminal 1040 by setting parameters of the device, and decode the video stream to be processed to obtain a video image through the decoder 1043; the cloud server 1010 generates a desktop stream through the surfaceflinger module 1035 and the drm module 1036, and drives 1037 and the front end through the qxl The desktop stream channel 1022 of the server 1020 sends the desktop stream to the desktop stream player 1042 of the terminal 1040; the terminal 1040 decodes and renders the desktop stream, and synthesizes it with the video stream image, and the desktop stream player 1042 plays the desktop stream data and video stream The player 1041 plays video images, and the desktop stream data is transparent to the area background of the video stream player 1041, so the video playback can be displayed normally.

Example 2: Referring to FIG. 11 , FIG. 11 is a flow chart of video playback provided by another embodiment of the present application. The video playback process includes the following steps S1110 to S1180 .

Step S1110, the terminal starts the video application of the cloud server.

Step S1120, the cloud server starts the player to download the film source.

Step S1130, the player decapsulates the video stream.

Step S1140, the cloud server detects whether the terminal supports Mediacodec hard decoding.

In step S1150, when the terminal does not support hard decoding, start a soft decoding process. It can be understood that the soft decoding process is well known to those skilled in the art, and will not be repeated here.

Step S1160, when the terminal supports hardware decoding, the cloud server creates a Mediacodec decoder.

Step S1170, sending the configuration parameters of the decoder and the decapsulated data to the terminal.

Step S1180, the terminal creates a Mediacodec decoder according to the configuration parameters, and decodes, renders and plays the decapsulated data.

It can be understood that this application does not limit the specific method for the cloud server to detect whether the terminal supports Mediacodec hard decoding. It can be determined by detecting whether the terminal calls the Mediacodec decoder abnormally. For example, the terminal calls the MediaCodec decoder normally to ensure that the terminal application recognizes The current MediaCodec decoder, confirm that the current terminal supports hard decoding.

Example 3: Referring to FIG. 12 , FIG. 12 is a flowchart of a data processing method provided by another embodiment of the present application. The data processing method includes the following steps S1201 to S1217.

In step S1201, the cloud video application receives a video playback instruction from a terminal.

Step S1202, the cloud video application creates a video application player.

Step S1203, the video application player downloads the source corresponding to the video play command, and demultiplexes the source to obtain video stream data, which includes h264 stream.

In step S1204, the video application player inquires whether the current terminal supports hard decoding.

Step S1205, when the terminal device supports hardware decoding, the video application player creates a MediaCodec decoder locally.

In step S1206, the MediaCodec decoder notifies the terminal to also create a MediaCodec decoder.

Step S1207, the video application player uses the cloud MediaCodec to set the interface.

Step S1208, sending the setting parameters to the terminal through the interface.

Step S1209, the video application player sets code stream data to be decoded to the cloud MediaCodec.

Step S1210, the cloud MediaCodec sends the set code stream data to the terminal through the interface.

Step S1211, the decoder of the terminal decodes the code stream data and plays the movie source.

Step S1212, the video application player polls the cloud MediaCodec decoder for decoded data.

Step S1213, the corresponding interface returns to the video application player a piece of preset decoded data, that is, black screen data.

Step S1214, the video application player renders the decoded data, synthesizes the rendered decoded data and the image inside the current virtual machine into a desktop stream, and sends the desktop stream to the front-end server through the QXL driver.

Step S1215, the front-end server judges the image in the virtual machine, cuts out the part of the playing area, sets the black screen area as transparent, and obtains the desktop stream.

Step S1216, sending the processed desktop stream to the terminal.

In step S1217, the terminal decodes and renders the desktop stream, and synthesizes the rendered desktop stream with the video stream image. Since the desktop stream is transparent to the background of the player area, the video playback can be displayed normally.

In addition, referring to FIG. 13 , an embodiment of the present application also provides a cloud server 1300, which includes: a memory 1310, a processor 1320, and a computer program stored on the memory 1310 and operable on the processor 1320 .

The processor 1320 and the memory 1310 may be connected through a bus or in other ways.

The non-transitory software programs and instructions required to implement the data processing method of the above-mentioned embodiment are stored in the memory 1310, and when executed by the processor 1320, the data processing method applied to the cloud server 1300 in the above-mentioned embodiment is executed, for example, Carry out method step S110 to method step S140 in Fig. 1 described above, method step S210 to method step S220 in Fig. 2, method step S310 in Fig. 3, method step S410 to method step S440 in Fig. 4, Fig. 5 Step S510 in the method.

In addition, referring to FIG. 14 , an embodiment of the present application also provides a terminal 1400 . The terminal 1400 includes: a memory 1410 , a processor 1420 , and a computer program stored in the memory 1410 and operable on the processor 1420 .

The processor 1420 and the memory 1410 may be connected through a bus or in other ways.

The non-transitory software programs and instructions required to implement the data processing method of the above-mentioned embodiment are stored in the memory 1410, and when executed by the processor 1420, the data processing method applied to the terminal 1400 in the above-mentioned embodiment is executed, for example, executing The method step S610 to method step S640 in FIG. 6 , the method step S710 to method step S720 in FIG. 7 , the method step S810 in FIG. 8 , and the method step S910 to method step S930 in FIG. 9 described above.

The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

The embodiment of the present application includes a data processing method, a cloud server, a terminal, and a storage medium, wherein the data processing method is applied to the cloud server, and the cloud server is connected to the terminal through communication, and the data processing method includes: acquiring the video sent by the terminal A playback request, obtaining a target video according to the video playback request; demultiplexing the target video to obtain a video stream to be processed; determining decoding parameters for the video stream to be processed, and sending the decoding parameters to the terminal, making the terminal obtain a target decoding object according to the decoding parameters; forwarding the video stream to be processed to the terminal, so that the terminal decodes the video stream to be processed through the target decoding object to obtain a target video , and play the target video. According to the solution provided by the embodiment of the present application, it is possible to effectively reduce the limitation of playing video on the cloud terminal and reduce the resource consumption of the virtual machine.

In addition, an embodiment of the present application also provides a storage medium, the readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by a processor 1320 or a controller, for example, by the above-mentioned cloud server 1300 Execution by a processor 1320 in the embodiment may cause the processor 1320 to execute the data processing method applied to the cloud server 1300 in the above embodiment, for example, execute the method steps S110 to S140 in FIG. 1 described above, Method step S210 to method step S220 in FIG. 2 , method step S310 in FIG. 3 , method step S410 to method step S440 in FIG. 4 , method step S510 in FIG. 5 . Those skilled in the art can understand that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware and an appropriate combination thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit . Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

The above is a specific description of some implementations of the present application, but the present application is not limited to the above-mentioned embodiments. Those skilled in the art can also make various equivalent deformations or replacements without violating the spirit of the present application. Any modification or substitution is included within the scope defined by the claims of the present application.

Claims

A data processing method applied to a cloud server, the cloud server being connected to a terminal in communication, the data processing method comprising:

Obtain a video play request sent by the terminal, and obtain the target video according to the video play request;

Demultiplexing the target video to obtain a video stream to be processed;

determining a decoding parameter for the video stream to be processed, and sending the decoding parameter to the terminal, so that the terminal obtains a target decoding object according to the decoding parameter;

Forwarding the video stream to be processed to the terminal, so that the terminal decodes the video stream to be processed through the target decoding object to obtain a target video, and plays the target video.
The method according to claim 1, wherein the determining is for the decoding parameters of the video stream to be processed, and the decoding parameters are sent to the terminal, so that the terminal can obtain the target decoding object according to the decoding parameters ,include:

Create a reference decoding object according to the video stream to be processed, and determine the decoding parameters according to the reference decoding object;

sending the decoding parameters to the terminal, so that the terminal creates a target decoding object identical to the reference decoding object, and configures the target decoding object through the decoding parameters.
The method according to claim 2, wherein, after the video stream to be processed is forwarded to the terminal, the method further comprises:

Generate a desktop stream, and send the desktop stream to the terminal, so that the terminal decodes the desktop stream to obtain a desktop stream image, and the desktop stream image is set as the video obtained by decoding the video stream to be processed Image synthesis of the target video.
The method according to claim 3, wherein said generating a desktop stream comprises:

Get the preset color block;

determining the playing area of the target video according to the reference decoding object;

Deleting image information at a position corresponding to the playback area in the preset color block to obtain background information;

Obtain desktop stream information, and obtain the desktop stream according to the desktop stream information and the background information.
The method according to claim 4, wherein said acquiring preset color blocks comprises:

The preset color block is obtained from feedback information obtained by the first interface, wherein the feedback information is obtained by the first interface polling the reference decoding object for decoding data.
A data processing method is applied to a terminal, the terminal is connected to a cloud server through communication, and the data processing method includes:

Sending a video playback request to the cloud server, so that the cloud server obtains the target video according to the video playback request;

Obtain the decoding parameters sent by the cloud server, and obtain the target decoding object according to the decoding parameters, and the decoding parameters are determined by the cloud server according to the video stream to be processed;

Obtaining the video stream to be processed sent by the cloud server, the video stream to be processed is obtained by the cloud server by demultiplexing the target video;

The video stream to be processed is decoded by the target decoding object to obtain a target video, and the target video is played.
The method according to claim 6, wherein said obtaining the target decoding object according to the decoding parameters comprises:

Create a target decoding object, wherein the target decoding object is identical to the reference decoding object created by the cloud server according to the video stream to be processed;

configuring the target decoding object according to the decoding parameter, wherein the decoding parameter is determined according to the reference decoding object.
The method according to claim 7, wherein, after acquiring the video stream to be processed sent by the cloud server, further comprising:

Obtaining the desktop stream sent by the cloud server, wherein the desktop stream is obtained by the cloud server according to desktop stream information and background information, and the background information is deleted by the cloud server from the acquired preset color block The image information of the position corresponding to the playback area is obtained, and the playback area is determined by the cloud server according to the reference decoding object.
The method according to claim 8, wherein said decoding the video stream to be processed by the target decoding object to obtain the target video comprises:

obtaining a desktop stream image by decoding the desktop stream;

Decoding the video stream to be processed by the target decoding object to obtain a video image;

The target video is obtained by synthesizing the desktop stream image and the video image.
A cloud server, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein, when the processor executes the computer program, any one of claims 1 to 5 is realized The data processing method described.
A terminal, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein, when the processor executes the computer program, the computer program described in any one of claims 6 to 9 is implemented. The data processing method described above.
A storage medium storing computer-executable instructions configured to execute the data processing method according to any one of claims 1-9.