WO2023066183A1

WO2023066183A1 - Data processing method and apparatus, device, and storage medium

Info

Publication number: WO2023066183A1
Application number: PCT/CN2022/125605
Authority: WO
Inventors: 黄勇; 刘俊云; 胡特; 张纪金
Original assignee: 北京百度网讯科技有限公司
Priority date: 2021-10-19
Filing date: 2022-10-17
Publication date: 2023-04-27
Also published as: CN113961289A

Abstract

The present application discloses a data processing method and apparatus, a device, and a storage medium. The data processing method comprises: obtaining a control event sent by an external terminal; converting the control event according to the event identifier of the control event to obtain a target event; and transmitting the target event to a desktop system in a cloud desktop container, so that the desktop system responds to the target event.

Description

Data processing method, device, device and storage medium

This application claims priority to a Chinese patent application with application number 202111215063.5 filed with the China Patent Office on October 19, 2021, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of computer technology, and to the field of cloud computing technology, for example, to a data processing method, device, device, and storage medium in a cloud desktop scenario.

Background technique

With the development of computer technology, cloud desktop technology is gradually emerging. Cloud desktop, also known as desktop virtualization or cloud computer, is a new model to replace traditional computers. Cloud desktop uses virtual technology to virtualize various physical devices (such as computer hosts), so that the utilization rate of resources is effectively improved.

Contents of the invention

The disclosure provides a data processing method, device, equipment and storage medium.

According to an aspect of the present disclosure, a data processing method is provided, including:

Obtain the control event sent by the external terminal;

According to the event identification of the control event, the control event is converted to obtain the target event;

The target event is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

According to another aspect of the present disclosure, a data processing device is also provided, including:

The event acquisition module is configured to acquire the control event sent by the external terminal;

The event conversion module is configured to convert the control event according to the event identification of the control event to obtain the target event;

The event transmission module is configured to transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

According to another aspect of the present disclosure, an electronic device is also provided, including:

at least one processor; and

memory communicatively coupled to at least one processor; wherein,

The memory stores instructions executable by at least one processor, and the instructions are executed by at least one processor, so that at least one processor can execute the above data processing method.

According to another aspect of the present disclosure, there is also provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the above data processing method.

According to another aspect of the present disclosure, there is also provided a computer program product, including a computer program, when the computer program is executed by a processor, the above data processing method is implemented.

Description of drawings

FIG. 1A is a flowchart of a data processing method provided by an embodiment of the present disclosure;

FIG. 1B is a schematic structural diagram of a cloud desktop container provided by an embodiment of the present disclosure;

FIG. 2 is a flow chart of another data processing method provided by an embodiment of the present disclosure;

Fig. 3 is a flowchart of another data processing method provided by an embodiment of the present disclosure;

Fig. 4 is a schematic diagram of a cloud desktop system construction method provided by an embodiment of the present disclosure;

Fig. 5 is a flowchart of another data processing method provided by an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of a data processing device provided by an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of an event conversion module provided by an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of another data processing device provided by an embodiment of the present disclosure;

FIG. 9 is a block diagram of an electronic device of an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. For clarity and conciseness, descriptions of well-known functions and constructions and functions and constructions that are less relevant to the embodiments described below are omitted from the following description.

The cloud desktop technology in the embodiments of the present disclosure is implemented based on containers. The electronic devices that provide cloud desktop services in the embodiments of the present disclosure are designed with low power consumption and high density in a rack-mounted server chassis with a set thickness. Integrated multi-way system chip (System on Chip, SOC), each way SOC has independent processors, memory, and storage, and based on this hardware, at least one available container is deployed on each way SOC, and in the available container Virtualize cloud desktop instances and provide cloud desktop resources. The cloud desktop container involved in this embodiment is an available container of a virtualizable cloud desktop instance.

FIG. 1A is a flowchart of a data processing method provided by an embodiment of the present disclosure, and FIG. 1B is a schematic structural diagram of a cloud desktop container provided by an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to the case of data processing when the cloud desktop technology is implemented based on the container, and are especially applicable to the case of processing the control event sent by the external terminal. The method can be executed by a data processing device, which can be implemented in the form of software and/or hardware, and can be integrated into an electronic device that provides cloud desktop services, such as information that can be integrated into a cloud desktop container deployed in an electronic device streaming service.

The information flow service can be deployed in the cloud desktop container, and is an intermediate service established to realize the interaction between the external terminal and the desktop system. For example, it may include real-time control flow services for processing control flow data, and video streaming services for processing audio and video data. Referring to the cloud desktop container shown in FIG. 1B , the information flow service deployed therein is a real-time control flow service. Optionally, in the cloud desktop container, the running system of the cloud desktop, that is, the desktop system, is also deployed. The desktop system is configured with at least one virtual module that can respond to the target event sent by the real-time control flow service, such as virtual mouse, virtual Keyboard, and system setting module, etc.

This embodiment can be executed by the real-time control flow service in the cloud desktop container shown in FIG. 1B . As shown in Figures 1A-1B, the data processing method provided in this embodiment may include:

S101. Obtain a control event sent by an external terminal.

The external terminal is an electronic device capable of forwarding control events or generating control events. For example, it may be any device other than an electronic device providing cloud desktop services, such as a thin client.

The control event is generated by the external terminal according to the user's operation on the external control device (such as mouse, keyboard, display screen or cloud desktop client, etc.). For example, the external terminal may determine the event identifier, control operation and event parameters corresponding to the operation according to the user's operation on the external control device, and generate a control event according to the event identifier, control operation and event parameters. The control events may include: mouse control events, keyboard control events, display screen control events, and setting events.

Optionally, in this embodiment, after the external terminal generates the control event, it needs to send the control event to the electronic device of the cloud desktop server. In an embodiment, the real-time control flow service in the cloud desktop container deployed in the electronic device will obtain the control event.

S102. Convert the control event according to the event identifier of the control event to obtain a target event.

The event identifier of the control event may be an identifier representing the type of the control event, for example, the same event identifier may be set for control events triggered by the same type of external control device. For example, all control events generated by the user operating the mouse have the same event ID. The event identifier may be an identifier of the external control device operated by the user, such as the name or number of the external device. It may also be a unique identifier sequentially generated for each type of control event according to preset rules.

Optionally, because the control event is generated by the external terminal according to its custom format, the versatility is poor, and the desktop system in the cloud desktop container cannot directly respond to the control event, so this embodiment requires the information flow service in the cloud desktop container , that is, the real-time control flow service to convert the control event sent by the external terminal into an event in a format supported by the desktop system, that is, the target event. Optionally, when the target events in this embodiment are classified according to the types of external control devices, they may include: mouse events, keyboard events, display events, and setting events.

In this embodiment, when the control event is converted according to the event identifier of the control event, the event identifier corresponding to the obtained control event may be determined first, for example, the obtained control event is analyzed, and the corresponding event identifier of the control event is directly obtained from the analysis result. An event identifier; the event identifier corresponding to the obtained control event may also be determined according to the analysis result and the association relationship between the locally recorded control event and the event identifier. After the event identifier is determined, the conversion logic corresponding to the control event is determined according to the preset relationship between the event identifier and the conversion logic, that is, the conversion logic between the format of the control event generated by the external terminal and the event format supported by the desktop system . And invoke the conversion logic to convert the control event to obtain the target event.

Exemplarily, as shown in FIG. 1B , the real-time stream control service of this embodiment includes a custom adaptation layer. In one embodiment, the custom adaptation layer is a custom device adaptation layer, and the custom device adaptation layer is used to perform conversion operations on control events to obtain target events, such as mouse events, keyboard events, or setting events, etc. .

S103. Transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

Optionally, after the information flow service in the cloud desktop container, that is, the real-time control flow service converts the control event to obtain the target event, it transmits the target event to the desktop system of the cloud desktop container. It is up to the desktop system to respond to the target event.

Exemplarily, after the real-time flow control service transmits the target event to the desktop system, the desktop system will first determine the virtual module that responds to the event according to the received target event, and transmit the target event to its corresponding virtual module, so that the virtual module to respond to target events. For example, as shown in FIG. 1B , if the target event is a mouse event, the desktop system will transmit the mouse event to the virtual mouse module, so that the virtual mouse module can respond to the mouse event. If the target event is a keyboard event module, the desktop system will transmit the keyboard event to the virtual keyboard module so that the virtual keyboard module can respond to the keyboard event; if the target event is a setting event, the desktop system will transmit the setting event to A system setting module, so that the system setting module responds to the setting event.

In the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event, converts it into a target event according to the event identifier of the control event, and then transmits it to the cloud The desktop system of the desktop container responds to the target event. This solution solves the problem that the desktop system in the cloud desktop container cannot directly process control events sent by external terminals when implementing cloud desktop technology based on containers, and provides a new solution for implementing cloud desktop technology based on containers.

Optionally, in this embodiment, when there are many control events acquired by the cloud desktop container, when performing the operation of transmitting the target event to the desktop system in the cloud desktop container, it may also include: adding the target event to the corresponding event identifier In the event queue of the event queue, the target event in the event queue is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

In this embodiment, a dedicated event queue may be set for a target event corresponding to at least one event identifier. For example, each event identifier may correspond to an event queue. After the target event is converted from the control event, the target event is first added to the event queue corresponding to the event ID of the target event. When transmitting the target event to the desktop system of the cloud desktop container, multiple event queues can be used to parallelly The target events contained in each queue are transmitted to the desktop system of the cloud desktop container. For example, the target event in each event queue can be transmitted in parallel to the virtual module in the desktop system that responds to the target event through multiple event queues. For example, as shown in FIG. 1B, the mouse event is added to the mouse event queue, and then the mouse event in the mouse event queue is transmitted to the virtual mouse module in the desktop system, and the virtual mouse module responds to the mouse event. The advantage of such setting in this embodiment is that when the cloud desktop container acquires many control events, the efficiency and accuracy of the cloud desktop container responding to the control events are improved.

Fig. 2 is a flow chart of another data processing method provided by the embodiment of the present disclosure. On the basis of the above embodiments, this embodiment discusses how to "convert the control event according to the event identifier of the control event to obtain the target event" Explain. As shown in Figure 2, the data processing method provided in this embodiment may include:

S201. Acquire a control event sent by an external terminal.

S202. Decode the control event, and acquire an event identifier of the control event from the decoding result.

Optionally, in order to ensure the security of the control event, when the external terminal generates the control event, it can first obtain the event attribute information required to generate the control event, such as the event identifier, control operation and event parameters, and then use the attribute information according to its own After the defined format (such as event identifier-control operation-event parameter) is combined and coded (such as binary code), the control event is obtained, and then the generated control event is sent to the cloud desktop container. At this time, the control event sent by the external terminal acquired in this embodiment is a coded result, not the original text of the required data. Therefore, in this embodiment, it is necessary to decode the received control event according to the decoding rule corresponding to the external terminal coded control event, and obtain the decoding result, that is, the attribute information of the control event combined according to a self-defined format, and then decode the decoding result Perform parsing to extract the event ID corresponding to the control event.

S203. Determine the conversion logic of the control event according to the event identifier.

The conversion logic of the control event may be a processing logic for converting the control event in a custom format generated by the external terminal into an event format supported by the desktop system.

Optionally, in this embodiment, the electronic device providing the cloud desktop service may pre-store associations between event identifiers of different external terminals and conversion logic. At this time, the conversion logic associated with the event identifier determined in S202 may be searched from the locally stored association relationship between the event identifier of the external terminal and the conversion logic, as the conversion logic of the received control event.

Optionally, if the electronic device does not locally store the association between the event identifier and the conversion logic, the electronic device may also communicate with other external devices (the external device may be an external terminal that sends a control event, or may not The external terminal that controls the event, which is not limited in this embodiment) interacts to obtain the conversion logic associated with the event identifier determined in S202 as the conversion logic of the received control event.

S204. Generate a target event according to the decoding result and conversion logic.

In this embodiment, based on the decoding result obtained by decoding the control event in S202, the conversion logic determined in S203 may be invoked to generate the target event.

S205. Transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

According to the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event, decodes the control event, and determines the conversion corresponding to the control event according to the decoding result logic, and based on the conversion logic and decoding results, a target event is generated and transmitted to the desktop system of the cloud desktop container, and the desktop system responds to the target event. In this solution, the event of interaction between the cloud desktop container and the external terminal is encoded data, not the original text of the data, which is not easy to be cracked, which improves the security of the control event. In addition, the encoded event can also minimize the amount of data transmission. Waste of resources is avoided.

Fig. 3 is a flowchart of another data processing method provided by an embodiment of the present disclosure. On the basis of the above embodiments, this embodiment discusses how to "convert the control event according to the event identifier of the control event to obtain the target event" Explain. As shown in Figure 3, the data processing method provided in this embodiment may include:

S301. Obtain a control event sent by an external terminal.

S302. When it is recognized that the attribute information of the control event is valid, convert the control event according to the event identifier of the control event to obtain a target event.

The attribute information of the control event may be relevant information characterizing the attribute of the control event, for example, may include: event identifier, control operation, event parameter, and so on. Wherein, the control operation is the user's operation on the external control device. For example, when the external control device is a mouse, the control operation can be operations such as left click, right click, and pulley; when the external control device is a keyboard, the control operation can be It is the operation of tapping different keys on the keyboard. Event parameters can include parameter values corresponding to different events, parameter length, and event generation time.

Optionally, in order to ensure the security and accuracy of the control event processed by the cloud desktop container, the information flow service in this embodiment needs to identify whether the attribute information of the received control event is Valid, for control events with valid attribute information, operations such as subsequent event conversion are performed; for control events with invalid attribute information, operations such as subsequent event conversion are not performed.

Optionally, in this embodiment, identifying that the attribute information of the control event is valid may include at least one of the following: identifying that the event identifier of the control event is a valid identifier; identifying that the control operation of the control event is a valid operation supported by the event identifier; An event parameter was identified for a control event that fits within the valid parameter range. In this embodiment, electronic devices supporting cloud desktop services can store preset valid event identifiers, valid operations supported by each type of event identifier, and valid parameter ranges (such as valid parameter value ranges, valid parameter length ranges and at least one of the effective event periods), correspondingly, the information flow service in the cloud desktop container, that is, the real-time flow control service, can be based on at least one of the above-mentioned effective information stored locally and the attribute information of the acquired control event. Identify the validity of captured control events. In this embodiment, the validity of the control event is verified through various types of attribute information, which improves the security and flexibility of the validity verification process.

S303. Transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

According to the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event, and when it is recognized that the attribute information of the control event is valid, according to the control event After the event identification is converted into a target event, it is transmitted to the desktop system of the cloud desktop container, and the desktop system responds to the target event. The cloud desktop container in this solution does not respond directly after receiving the control event, but first recognizes its validity and then responds, which improves the security and accuracy of event response.

FIG. 4 is a schematic diagram of a cloud desktop system construction method provided by an embodiment of the present disclosure. As shown in Figure 4, the cloud desktop system of the embodiment of the present disclosure is built in an advanced reduced instruction set processor (Advanced Reduced Instruction Set Computer Machines, ARM) chip server, the server includes: a central processing unit (Central Processing Unit, CPU) , Mali graphics processor (Graphics Processing Unit, GPU) and network interface controller (Network Interface Controller, NIC). The operating system of the server is a Linux operating system, such as an ubuntu operating system. Before using this operating system, you need to set Linux system parameters, such as namespace parameters (namespace), container parameters (cgroup), file system service parameters (overlayfs), mount file parameters (autofs), and bridge parameters (bridge), etc. In this embodiment, a container manager may be deployed in the ARM chip of the server, and the container manager is used to dynamically manage the deployment of the cloud desktop container in the ARM chip. For example, the number of containers deployed in the ARM chip server can be increased or decreased according to the running cloud desktop instances and the available resources of the current ARM chip server. In a cloud desktop container in this embodiment, the cloud desktop container runtime (that is, the operating environment of the cloud desktop), the information flow service (that is, the video streaming push service and the real-time control streaming service), and the desktop system are deployed. Third-party applications can be installed and run on the desktop system. In the embodiment of the present disclosure, the container manager can be used to dynamically deploy the cloud desktop container in the ARM chip server, and the number of cloud desktop containers can be adjusted according to actual usage requirements. The way of running the cloud desktop system improves the resource utilization of the server.

Fig. 5 is a flowchart of another data processing method provided by an embodiment of the present disclosure. Based on the cloud desktop system shown in FIG. 4 , this embodiment provides an example of a container-based data processing method for cloud desktop technology. As shown in Figure 5, the data processing method provided in this embodiment may include:

S501. The real-time control flow service obtains a control event sent by an external terminal.

S502. The real-time control flow service converts the control event according to the event identifier of the control event to obtain the target event.

S503, the real-time control flow service transmits the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.

S504, the video stream pushing service processes the collected audio and video data through the RAM configured on the local device.

The video streaming push service is a service for pushing audio and video data (ie, audio data and/or video data) to external devices. In this embodiment, processing the collected audio and video data may include: transcoding processing and encoding processing. And the video streaming streaming service of this embodiment is based on the Mali GPU that comes with the ARM to process the collected audio and video data.

The video streaming streaming service will collect audio data and/or video data currently to be displayed on the cloud desktop from the resource storage area of the cloud desktop service in real time during the running of the cloud desktop. Affected by factors such as data compression, transmission bandwidth, and playback format, it is usually necessary to transcode and encode video data (such as H264 video stream encoding) by the video streaming service using the Mali GPU that comes with ARM in the target container. operation to obtain a video code stream; perform operations such as encoding audio data to obtain an audio code stream, and then transmit the coded video code stream and/or audio code stream to an external terminal, such as a thin client. After receiving the video data, the external terminal decodes and transcodes the video code stream to obtain video data, which is displayed on the display device; decodes the audio code stream to obtain audio data, which is output through the sound output device.

Due to the excessive consumption of hardware resources by relying on the CPU for soft decoding, for cloud desktop application scenarios where computing resources are extremely precious, it is likely to cause desktop image transmission freezes, which directly affects the user experience of the operator. The embodiments of the present disclosure can perform hardware encoding and decoding based on the Mali GPU that comes with the ARM, and perform rendering and output of audio and video data, which greatly utilizes the hardware characteristics of the GPU, reduces desktop response delay, and reduces CPU resource consumption. The utilization rate of resources is improved, and the resource overhead for realizing cloud desktop is reduced.

On the basis of the above technical solution, the present disclosure also provides an optional embodiment of an execution device for realizing the above data processing method. Referring to a data processing apparatus 600 shown in FIG. 6 , it is configured in an electronic device that provides a cloud desktop service, for example, it may be configured in an information flow service in a cloud desktop container deployed in the electronic device. The apparatus 600 includes: an event acquisition module 601 , an event conversion module 602 and an event transmission module 603 . Wherein, the event acquiring module 601 is set to acquire the control event sent by the external terminal; the event conversion module 602 is set to convert the control event according to the event identification of the control event to obtain the target event; the event transmission module 603 is set to convert the target event The event is transmitted to the desktop system in the cloud desktop container so that the desktop system can respond to the target event.

According to the solution of the embodiment of the present disclosure, after the external terminal sends a control event to the cloud desktop container, the information flow service in the cloud desktop container obtains the control event, converts it into a target event according to the event identifier of the control event, and then transmits it to the cloud desktop The desktop system of the container responds to the target event. This solution solves the problem that the desktop system in the cloud desktop container cannot directly process control events sent by external terminals when implementing cloud desktop technology based on containers, and provides a new solution for implementing cloud desktop technology based on containers.

In one embodiment, the event conversion module 602 is set to:

The control event is decoded, and the event ID of the control event is obtained from the decoding result; the conversion logic of the control event is determined according to the event ID; and the target event is generated according to the decoding result and the conversion logic.

In one embodiment, as shown in FIG. 7, the event conversion module 602 includes:

The validity identification unit 701 is configured to identify whether the attribute information of the control event is valid; the event conversion unit 702 is configured to convert the control event according to the event identifier of the control event if the attribute information of the control event is identified as valid.

In an embodiment, the validity identification unit 701 is configured to perform at least one of the following:

The event identification of the identified control event is a valid identification; the control operation of the identified control event is a valid operation supported by the event identification; the event parameter of the identified control event conforms to the valid parameter range.

In one embodiment, the event transmission module 603 is set to:

Add the target event to the event queue corresponding to the event ID; transmit the target event in the event queue to the desktop system in the cloud desktop container.

In one embodiment, as shown in FIG. 8, the above-mentioned data processing device 600 further includes:

The video stream processing module 604 is configured to process the collected audio and video data through the advanced simplified instruction set processor configured on the local device.

The above-mentioned products can execute the method provided by any embodiment of the present disclosure, and have corresponding functional modules and effects for executing the method.

In the technical solution of the present disclosure, the acquisition, storage and application of control events and audio and video data involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.

According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

FIG. 9 shows a schematic block diagram of an example electronic device 700 that may be used to implement embodiments of the present disclosure. Electronic device 700 is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic device 700 may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

As shown in FIG. 9 , the electronic device 700 includes a computing unit 701, which can be loaded into a random access memory (Random Access Memory, RAM) according to a computer program stored in a read-only memory (Read-Only Memory, ROM) 702 or from a storage unit 708. ) 703 to perform various appropriate actions and processes. In the RAM 703, various programs and data necessary for the electronic device 700 to perform operations can also be stored. The computing unit 701, ROM 702, and RAM 703 are connected to each other through a bus 704. An input/output (Input/Output, I/O) interface 705 is also connected to the bus 704 .

Multiple components in the electronic device 700 are connected to the I/O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a magnetic disk, an optical disk etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 709 allows the electronic device 700 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

Computing unit 701 may be various general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a CPU, a graphics processing unit (Graphics Processing Unit, GPU), a variety of dedicated artificial intelligence (Artificial Intelligence, AI) computing chips, a variety of computing units that run machine learning model algorithms, digital Signal processor (Digital Signal Processing, DSP), and any suitable processor, controller, microcontroller, etc. The GPU in this embodiment is the Mali GPU that comes with the ARM chip. The calculation unit 701 executes various methods and processes described above, such as data processing methods. For example, in some embodiments, the data processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 708 . In some embodiments, part or all of the computer program can be loaded and/or installed on the electronic device 700 via the ROM 702 and/or the communication unit 709. When the computer program is loaded into RAM 703 and executed by computing unit 701, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to execute the data processing method in any other suitable manner (for example, by means of firmware).

Various implementations of the systems and technologies described above in this paper can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (Field Programmable GateArray, FPGA), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), dedicated Standard products (Application Specific Standard Parts, ASSP), SOC, complex programmable logic device (Complex Programmable Logic Device, CPLD), computer hardware, firmware, software, and/or their combination. Various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that can is a special-purpose or general-purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special purpose computer, or other programmable data processing devices, so that the program codes, when executed by the processor or controller, make the functions/functions specified in the flow diagrams and/or block diagrams Action is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, RAM, ROM, Erasable Programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM, or Flash memory) ), fiber optics, Compact Disc Read-Only Memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display ( Liquid Crystal Display (LCD) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which a user can provide input to the computer. Other types of devices may also be configured to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and may be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.

The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WideArea Network, WAN), blockchain networks, and the Internet.

A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the problems existing in traditional physical host and virtual private server (Virtual Private Server, VPS) services. The defects of difficult management and weak business expansion. The server can also be a server of a distributed system, or a server combined with a blockchain.

Artificial intelligence is a discipline that studies how to make computers simulate some human thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, and machine learning/depth Learning technology, big data processing technology, knowledge map technology and other major directions.

Cloud computing (cloud computing) refers to access to elastic and scalable shared physical or virtual resource pools through the network. Resources can include servers, operating systems, networks, software, applications, and storage devices, etc., and can be on-demand and self-service. A technical system that deploys and manages resources in a unique way. Through cloud computing technology, it can provide efficient and powerful data processing capabilities for artificial intelligence, blockchain and other technical applications and model training.

Steps can be reordered, added, or removed using the various forms of flow shown above. For example, multiple steps described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution disclosed in the present disclosure can be achieved, no limitation is imposed herein.

Claims

A data processing method, comprising:

Obtain the control event sent by the external terminal;

converting the control event according to the event identifier of the control event to obtain a target event;

The target event is transmitted to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.
The method according to claim 1, wherein said converting said control event according to the event identifier of said control event to obtain a target event comprises:

Decoding the control event, and obtaining the event identifier of the control event from the decoding result;

Determine the conversion logic of the control event according to the event identifier;

The target event is generated according to the decoding result and the conversion logic.
The method according to claim 1 or 2, wherein converting the control event according to the event identifier of the control event comprises:

If it is recognized that the attribute information of the control event is valid, the control event is converted according to the event identifier of the control event.
The method according to claim 3, wherein the attribute information identifying the control event is valid, comprising at least one of the following:

The event identifier identifying the control event is a valid identifier;

It is recognized that the control operation of the control event is a valid operation supported by the event identifier;

It is identified that the event parameter of the control event conforms to a valid parameter range.
The method according to any one of claims 1-4, wherein transmitting the target event to the desktop system in the cloud desktop container comprises:

adding the target event to an event queue corresponding to the event identifier;

Transmitting the target event in the event queue to the desktop system in the cloud desktop container.
The method according to claim 1, further comprising:

The collected audio and video data is processed through the advanced simplified instruction set processor configured on the local device.
A data processing device, comprising:

The event acquisition module is configured to acquire the control event sent by the external terminal;

The event conversion module is configured to convert the control event according to the event identifier of the control event to obtain the target event;

The event transmission module is configured to transmit the target event to the desktop system in the cloud desktop container, so that the desktop system responds to the target event.
The device according to claim 7, wherein the event conversion module is set to:

Decoding the control event, and obtaining the event identifier of the control event from the decoding result;

Determine the conversion logic of the control event according to the event identifier;

The target event is generated according to the decoding result and the conversion logic.
The device according to claim 7 or 8, wherein the event conversion module comprises:

a validity identification unit configured to identify whether the attribute information of the control event is valid;

The event conversion unit is configured to convert the control event according to the event identifier of the control event when it is recognized that the attribute information of the control event is valid.
The device according to claim 9, wherein the validity identifying unit is configured to perform at least one of the following:

The event identifier identifying the control event is a valid identifier;

It is recognized that the control operation of the control event is a valid operation supported by the event identifier;

It is identified that the event parameter of the control event conforms to a valid parameter range.
The device according to any one of claims 7-10, wherein the event transmission module is configured to:

adding the target event to an event queue corresponding to the event identifier;

Transmitting the target event in the event queue to the desktop system in the cloud desktop container.
The apparatus of claim 7, further comprising:

The video stream processing module is configured to process the collected audio and video data through the advanced simplified instruction set processor configured on the local device.
An electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1-6. data processing method.
The electronic device according to claim 13, wherein,

The at least one processor is an advanced reduced instruction set processor.
A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to make the computer execute the data processing method according to any one of claims 1-6.
A computer program product comprising a computer program which, when executed by a processor, implements the data processing method according to any one of claims 1-6.