WO2022142008A1

WO2022142008A1 - Data processing method and apparatus, electronic device, and storage medium

Info

Publication number: WO2022142008A1
Application number: PCT/CN2021/090293
Authority: WO
Inventors: 张俊克
Original assignee: 平安科技（深圳）有限公司
Priority date: 2020-12-30
Filing date: 2021-04-27
Publication date: 2022-07-07
Also published as: CN112698962A

Abstract

A data processing method and apparatus, an electronic device, and a storage medium. The method comprises: dividing a preset process pool into a first process pool of an input/output operation and a second process pool of a computation operation, and respectively creating a corresponding first work queue and a corresponding second work queue; when a data processing request is received, determining whether data to be processed is complete, and if yes, encapsulating the data to be processed as a computing task and storing same in the second work queue; determining whether an idle process is present in the second process pool, and if an idle process is present in the second process pool, using the idle process to read the computing task from the second work queue and then performing computation processing to obtain a computation result, and then storing the computation result in the first work queue; and determining whether an idle process is present in the first process pool, and if an idle process is present in the first process pool, using the idle process to read the computation result from the first work queue. According to the method, an adequate parallel processing capability can be provided, and the resource consumption of a system is reduced.

Description

Data processing method, device, electronic device and storage medium

This application claims the priority of the Chinese patent application with the application number CN202011622579.7 and the invention titled "Data Processing Method, Device, Electronic Device and Storage Medium", which was submitted to the China Patent Office on December 30, 2020, the entire content of which is approved by Reference is incorporated in this application.

technical field

The present application relates to data processing, and in particular, to a data processing method, apparatus, electronic device and storage medium.

Background technique

In the current computing service middleware system, the input and output of data and the calculation are in the same process or thread, and the input and output operations, computing operations and the acquisition of data to be calculated are all processed in the same process or thread.

technical problem

The inventor realized that since the resources used for input and output and computing are shared, when the performance of the input and output terminals is asymmetrical, the input and output processing will consume a large amount of computing resources, reducing the processing capacity of the system, and due to the difference between input and output and computing. Sharing, when a large amount of input and output needs to be processed in a unit time, the proportion of resources used by input and output will be much larger than the resources used by computing, and in the case of large concurrency, the system will allocate more resources to coordinate processes or threads. switch.

technical solutions

A data processing method comprising:

Creating step: divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. the corresponding second work queue;

Receiving step: receiving a data processing request sent by the client, obtaining the data to be processed in the request, and judging whether the data to be processed is complete based on a pre-configured data protocol, and when the data to be processed is complete, send the data to be processed. The data to be processed is encapsulated into a computing task, and the computing task is stored in the second work queue;

Processing steps: determine whether there is an idle process in the second process pool, when it is determined that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue; and

Feedback step: determine whether there is an idle process in the first process pool, when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.

A data processing device comprising:

Creation module: Divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. the corresponding second work queue;

Receiving module: receives the data processing request sent by the client, obtains the data to be processed in the request, and judges whether the data to be processed is complete based on the preconfigured data protocol. The data to be processed is encapsulated into a computing task, and the computing task is stored in the second work queue;

Processing module: determine whether there is an idle process in the second process pool, when it is determined that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue; and

Feedback module: determine whether there is an idle process in the first process pool, when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.

To achieve the above purpose, the present application also provides an electronic device, the electronic device comprising:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform the steps of:

To achieve the above purpose, the present application also provides a computer-readable storage medium, the computer-readable storage medium includes a data processing program, and when the data processing program is executed by a processor, the following steps are implemented:

The present application can reduce the consumption of system resources caused by the contention of locks.

Description of drawings

1 is a schematic diagram of a preferred embodiment of an electronic device for implementing a data processing method in the present application;

FIG. 2 is a schematic block diagram of a preferred embodiment of the data processing device of the present application;

3 is a flowchart of a preferred embodiment of the data processing method of the present application;

The realization, functional characteristics and advantages of the purpose of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Embodiments of the present invention

In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

Referring to FIG. 1 , it is a schematic diagram of a preferred embodiment of an electronic device 1 of the present application.

The electronic device 1 includes but is not limited to: a memory 11 , a processor 12 , a display 13 and a network interface 14 . The electronic device 1 is connected to the network through the network interface 14 to obtain original data. The network may be an intranet (Intranet), the Internet (Internet), a global system for mobile communications (Global System of Mobile communication, GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth (Bluetooth), Wi-Fi, call network and other wireless or wired networks.

Wherein, the memory 11 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static Random Access Memory (SRAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Programmable Read Only Memory (PROM), Magnetic Memory, Magnetic Disk, Optical Disk, etc. In some embodiments, the memory 11 may be an internal storage unit of the electronic device 1 , such as a hard disk or a memory of the electronic device 1 . In other embodiments, the memory 11 may also be an external storage device of the electronic device 1, for example, a plug-in hard disk equipped with the electronic device 1, a smart memory card (Smart Media Card, SMC), Secure Digital (SD) card, Flash Card (Flash Card), etc. Of course, the memory 11 may also include both an internal storage unit of the electronic device 1 and an external storage device thereof. In this embodiment, the memory 11 is generally used to store the operating system and various types of application software installed in the electronic device 1 , such as program codes of the data processing program 10 and the like. In addition, the memory 11 can also be used to temporarily store various types of data that have been output or will be output.

The processor 12 may be a central processing unit (Central Processing Unit) in some embodiments. Processing Unit, CPU), controller, microcontroller, microprocessor, or other data processing chip. The processor 12 is generally used to control the overall operation of the electronic device 1, such as performing data interaction or communication-related control and processing. In this embodiment, the processor 12 is configured to run the program code or process data stored in the memory 11 , for example, run the program code of the data processing program 10 and the like.

The display 13 may be referred to as a display screen or a display unit. In some embodiments, the display 13 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an organic light emitting diode (Organic Light Emitting Diode). Light-Emitting Diode, OLED) touch device, etc. The display 13 is used for displaying information processed in the electronic device 1 and for displaying a visual working interface, for example, displaying the results of data statistics.

The network interface 14 may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), and the network interface 14 is usually used to establish a communication connection between the electronic device 1 and other electronic devices.

Figure 1 only shows the electronic device 1 with components 11-14 and the data processing program 10, but it should be understood that implementation of all of the shown components is not required and that more or less components may be implemented instead.

Optionally, the electronic device 1 may further include a user interface, and the user interface may include a display (Display), an input unit such as a keyboard (Keyboard), and an optional user interface may further include a standard wired interface and a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an organic light-emitting diode (Organic Light-Emitting Diode, OLED) touch device, and the like. The display may also be appropriately called a display screen or a display unit, which is used for displaying information processed in the electronic device 1 and for displaying a visualized user interface.

The electronic device 1 may also include a radio frequency (Radio Frequency, RF) circuits, sensors and audio circuits, etc., and will not be repeated here.

In the above embodiment, when the processor 12 executes the data processing program 10 stored in the memory 11, the following steps may be implemented:

The storage device may be the memory 11 of the electronic device 1 , or may be other storage devices communicatively connected to the electronic device 1 .

For a detailed introduction of the above steps, please refer to the following description of the functional block diagram of the embodiment of the data processing apparatus 100 in FIG. 2 and the flowchart of the embodiment of the data processing method in FIG. 3 .

Referring to FIG. 2 , it is a functional block diagram of the data processing apparatus 100 of the present application.

The data processing apparatus 100 described in this application may be installed in an electronic device. According to the implemented functions, the data processing apparatus may include a creation module 110 , a reception module 120 , a processing module 130 and a feedback module 140 . The modules described in the present invention can also be called units, which refer to a series of computer program segments that can be executed by the electronic device processor and can perform fixed functions, and are stored in the memory of the electronic device.

In this embodiment, the functions of each module/unit are as follows:

The creating module 110 is configured to divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and respectively create a first work queue corresponding to the first process pool, and a second process pool for the first process pool. The second work queue corresponding to the second process pool.

In this embodiment, the process pool preconfigured by the electronic device is divided into a process pool for input and output operations and a process pool for computing operations, and a first work queue corresponding to the process pool for input and output operations is created, and a process pool corresponding to the process pool for computing operations is created. Second work queue. The input and output (IO) operations and computing operations are separated and processed separately, which can improve parallel processing capabilities and make full use of the multi-core parallel processing capabilities of modern processors. The divided process pool includes multiple processes. It is a running activity of a program in a computer on a data set, the basic unit of resource allocation and scheduling in the system, and the basis of the operating system structure. In a thread-oriented computer architecture, a process is a container for threads.

The receiving module 120 is configured to receive a data processing request sent by the client, obtain the data to be processed in the request, and judge whether the data to be processed is complete based on a preconfigured data protocol. When the data to be processed is complete, The to-be-processed data is encapsulated into a computing task, and the computing task is stored in the second work queue.

In this embodiment, the data processing request sent by the client is received, the data to be processed in the request is obtained, and whether the data to be processed is complete is judged based on the pre-configured data protocol, and when the data to be processed is complete, the data to be processed is encapsulated When the data to be processed is incomplete, the incomplete data will be stored in the first work queue. After the data is received completely, the complete data to be processed will be stored in the second work queue. Encapsulated into computational tasks. Wherein, judging whether the data to be processed is complete is judged according to a pre-configured data protocol. If there is no idle process in the process pool of the computing operation, the computing task may be stored in the second work queue corresponding to the process pool of the computing operation, thereby avoiding the consumption of locks.

In one embodiment, the receiving module is further configured to:

When it is judged that the data to be processed is incomplete, it is judged whether there is an idle process in the first process pool, and when it is judged that there is no idle process in the first process pool, the data to be processed is stored in the first process pool. A work queue, when it is determined that there is an idle process in the first process pool, the idle process is used to receive incomplete data corresponding to the data to be processed.

When the data to be processed is incomplete, and when there is no idle process in the process pool of the input and output operation, the data to be processed is stored in the first work queue, and the idle process in the process pool of input and output is actively and lock-free. The acquisition reduces the lock contention of process resources in the process pool of input and output processing to a lock-free state, avoiding the problem of low resource utilization caused by lock contention.

In one embodiment, the data processing apparatus 100 is further configured to:

Judging whether the first work queue stores data to be processed or calculation results to be fed back, when it is judged that the first work queue does not store data to be processed and calculation results to be fed back, the data in the first process pool is stored. The idle process is set to the default state. The preset state includes a sleep state.

The processing module 130 is configured to determine whether there is an idle process in the second process pool, and when it is determined that there is an idle process in the second process pool, use the idle process to read the calculation from the second work queue A task, performing calculation processing on the calculation task based on a preset processing rule to obtain a calculation result, and storing the calculation result in the first work queue.

In this embodiment, it is judged whether there is an idle process in the process pool of the computing operation, and when there is an idle process in the process pool of the computing operation, the idle process is used to read the computing task from the second work queue, and based on the pre- The set processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the obtained calculation results in the first work queue.

Due to the computationally intensive nature of computing operations, when the process pool of divided computing operations has complete data to be computed, a separate process can enable continuous processing of the computing pipeline without interruption, avoiding idle processes caused by the suspension or interruption of the computing pipeline. In the case of inability to provide services, it also avoids the problem of system resource consumption caused by frequent system resource scheduling caused by process suspension or interruption, and improves the utilization rate of system resources, among which system resources include: CPU resources, memory resources, network resources, etc.

Create a second work queue corresponding to the process of the calculation operation, store the calculation tasks that are ready for calculation in the second work queue, and the process of the calculation processing actively acquires the calculation tasks without locks, so that the process pool of the input and output operations is in the process pool. The lock contention of the process resources is reduced to a lock-free state, reducing the non-functional consumption of system resources due to lock contention. It should be noted that in the prior art, when multiple worker processes acquire tasks, in order to prevent repeated processing, certain locking processing needs to be performed when acquiring tasks to prevent inconsistency or duplication of resources.

Further, the calculation result obtained by performing calculation processing on the calculation task based on the preset processing rule includes:

The identifier of the computing task is acquired, the computing processing rule corresponding to the computing task is searched from a pre-configured mapping table based on the identifier, and a computing result is obtained by performing computing processing on the computing task based on the computing processing rule.

In one embodiment, the data processing apparatus 100 is further configured to:

Judging whether the second work queue stores computing tasks to be processed, and when judging that the second work queue does not store computing tasks to be processed, setting the idle processes in the second process pool to a preset state;

When judging that the second work queue stores computing tasks to be processed, the computing tasks to be processed are read from the second work queue based on idle processes in the second process pool, and the computing tasks are stored in the second work queue. Execute calculation processing. The preset state includes a sleep state.

The feedback module 140 is configured to judge whether there is an idle process in the first process pool, and when it is judged that there is an idle process in the first process pool, use the idle process to read the calculation from the first work queue result, and the calculation result is fed back to the client.

In this embodiment, it is judged whether there is an idle process in the process pool of input and output operations, and if so, the idle process is used to read the calculation result from the first work queue, and the calculation result is fed back to the client, which can eliminate the The process pool acquires the locks that need to be introduced due to concurrency when processing tasks, reducing resource consumption caused by lock contention.

Due to the waiting characteristics of input and output operations, the divided input and output operation process pool can be based on the asynchronous callback processing operation implemented by the asynchronous input and output supported by the asynchronous IO mechanism supported by the bottom layer of the operating system. The consumption of threads reduces the consumption of system resources caused by the frequent creation, destruction or scheduling of processes or threads under large concurrency, and improves the utilization rate of system resources by users in the system resources. It should be noted that non-asynchronous IO will wait indefinitely or put the process to sleep when the data transmission is not completed, and continue to perform subsequent operations when the data is received, which makes the process resources used by the current IO occupied. Asynchronous IO uses process or thread resources only after data is received.

On the divided process pool of input and output operations, set the corresponding first work queue, and store the calculation result of the input and output ready in the corresponding first work queue, and the input and output processing process will take the initiative and lock-free, The lock contention of the process or thread resources in the process pool of input and output processing is reduced to a lock-free state, which greatly reduces the low resource utilization rate caused by the lock contention.

In one embodiment, the feedback module is further used to:

When it is determined that there is no idle process in the first process pool, the calculation result is encapsulated into a transmission task, and the transmission task is stored in the first work queue until there is an idle process in the first process pool When the transfer operation is performed on the transfer task.

In addition, the present application also provides a data processing method. Referring to FIG. 3 , it is a schematic flowchart of a method according to an embodiment of the data processing method of the present application. When the processor 12 of the electronic device 1 executes the data processing program 10 stored in the memory 11, the following steps of the data processing method are implemented:

Step S10: Divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. The corresponding second work queue.

Step S20: Receive the data processing request sent by the client, obtain the data to be processed in the request, and judge whether the data to be processed is complete based on a preconfigured data protocol. The data to be processed is encapsulated into computing tasks, and the computing tasks are stored in the second work queue.

In one embodiment, step S20 further includes:

In one embodiment, the method further includes:

Judging whether the first work queue stores data to be processed or calculation results to be fed back, when it is judged that the first work queue does not store data to be processed and calculation results to be fed back, the data in the first process pool is stored. The idle process is set to the default state. Wherein, the preset state includes a sleep state.

Step S30: judging whether there is an idle process in the second process pool, and when judging that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue.

In one embodiment, after step S30, the method further includes:

Step S40: Determine whether there is an idle process in the first process pool, and when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.

In one embodiment, step S40 further includes:

In addition, an embodiment of the present application also proposes a computer-readable storage medium, which may be volatile or non-volatile, and the computer-readable storage medium may be a hard disk, a multimedia card, a Any of SD Card, Flash Card, SMC, Read Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), Portable Compact Disc Read Only Memory (CD-ROM), USB memory, etc. or any combination of several. The computer-readable storage medium includes a data processing program 10, and the data processing program 10 implements the following operations when executed by the processor:

The specific implementation of the computer-readable storage medium of the present application is substantially the same as the specific implementation of the above-mentioned data processing method, and will not be repeated here.

In another embodiment, in order to further ensure the privacy and security of the data to be processed and the computing tasks, the data to be processed and the computing tasks can also be stored in a node of a blockchain.

The blockchain referred to in this application is a new application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm. Blockchain, essentially a decentralized database, is a series of data blocks associated with cryptographic methods. Each data block contains a batch of network transaction information to verify its Validity of information (anti-counterfeiting) and generation of the next block. The blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer.

It should be noted that the above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments. And the terms "comprising", "comprising" or any other variation thereof herein are intended to encompass a non-exclusive inclusion such that a process, device, article or method comprising a list of elements includes not only those elements, but also includes no explicit Other elements listed, or those inherent to such a process, apparatus, article, or method are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, apparatus, article, or method that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or the parts that make contributions to the prior art. The computer software products are stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disk), including several instructions to make a terminal device (which may be a mobile phone, a computer, an electronic device, or a network device, etc.) to execute the methods described in the various embodiments of the present application.

The above are only the preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied in other related technical fields , are similarly included within the scope of patent protection of this application.

Claims

A data processing method, applied to electronic equipment, wherein the method comprises:

Creating step: divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. the corresponding second work queue;

Receiving step: receiving a data processing request sent by the client, obtaining the data to be processed in the request, and judging whether the data to be processed is complete based on a pre-configured data protocol, and when the data to be processed is complete, send the data to be processed. The data to be processed is encapsulated into a computing task, and the computing task is stored in the second work queue;

Processing steps: determine whether there is an idle process in the second process pool, when it is determined that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue; and

Feedback step: determine whether there is an idle process in the first process pool, when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.
The data processing method of claim 1, wherein the receiving step further comprises:

When it is judged that the data to be processed is incomplete, it is judged whether there is an idle process in the first process pool, and when it is judged that there is no idle process in the first process pool, the data to be processed is stored in the first process pool. A work queue, when it is determined that there is an idle process in the first process pool, the idle process is used to receive incomplete data corresponding to the data to be processed.
The data processing method of claim 2, wherein, after the feedback step, the method further comprises:

Judging whether the first work queue stores data to be processed or calculation results to be fed back, when it is judged that the first work queue does not store data to be processed and calculation results to be fed back, the data in the first process pool is stored. The idle process is set to the default state.
The data processing method of claim 1, wherein, after the processing step, the method further comprises:

Judging whether the second work queue stores computing tasks to be processed, and when judging that the second work queue does not store computing tasks to be processed, setting the idle processes in the second process pool to a preset state;

When judging that the second work queue stores computing tasks to be processed, the computing tasks to be processed are read from the second work queue based on idle processes in the second process pool, and the computing tasks are stored in the second work queue. Execute calculation processing.
The data processing method of claim 1, wherein the feedback step further comprises:

When it is determined that there is no idle process in the first process pool, the calculation result is encapsulated into a transmission task, and the transmission task is stored in the first work queue until there is an idle process in the first process pool When the transfer operation is performed on the transfer task.
The data processing method according to any one of claims 1 to 5, wherein the calculation result obtained by performing calculation processing on the calculation task based on a preset processing rule comprises:

The identifier of the computing task is acquired, the computing processing rule corresponding to the computing task is searched from a pre-configured mapping table based on the identifier, and a computing result is obtained by performing computing processing on the computing task based on the computing processing rule.
The data processing method of claim 4, wherein the preset state includes a sleep state.
A data processing device, wherein the device comprises:

Creation module: Divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. the corresponding second work queue;

Receiving module: receives the data processing request sent by the client, obtains the data to be processed in the request, and judges whether the data to be processed is complete based on the preconfigured data protocol. The data to be processed is encapsulated into computing tasks, and the computing tasks are stored in the second work queue;

Processing module: determine whether there is an idle process in the second process pool, when it is determined that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue; and

Feedback module: determine whether there is an idle process in the first process pool, when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.
An electronic device, wherein the electronic device comprises:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the steps of:

Creating step: divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. the corresponding second work queue;

Receiving step: receiving a data processing request sent by the client, obtaining the data to be processed in the request, and judging whether the data to be processed is complete based on a pre-configured data protocol, and when the data to be processed is complete, send the data to be processed. The data to be processed is encapsulated into computing tasks, and the computing tasks are stored in the second work queue;

Processing steps: determine whether there is an idle process in the second process pool, when it is determined that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue; and

Feedback step: determine whether there is an idle process in the first process pool, when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.
The electronic device of claim 9, wherein the receiving step further comprises:

When it is judged that the data to be processed is incomplete, it is judged whether there is an idle process in the first process pool, and when it is judged that there is no idle process in the first process pool, the data to be processed is stored in the first process pool. A work queue, when it is determined that there is an idle process in the first process pool, the idle process is used to receive incomplete data corresponding to the data to be processed.
11. The electronic device of claim 10, wherein, after the feedback step, the at least one processor further performs the steps of:

Judging whether the first work queue stores data to be processed or calculation results to be fed back, when it is judged that the first work queue does not store data to be processed and calculation results to be fed back, the data in the first process pool is stored. The idle process is set to the default state.
The electronic device of claim 9, wherein, after the processing step, the at least one processor further performs the following steps:

Judging whether the second work queue stores computing tasks to be processed, and when judging that the second work queue does not store computing tasks to be processed, setting the idle processes in the second process pool to a preset state;

When judging that the second work queue stores computing tasks to be processed, the computing tasks to be processed are read from the second work queue based on idle processes in the second process pool, and the computing tasks are stored in the second work queue. Execute calculation processing.
The electronic device of claim 9, wherein the feedback step further comprises:

When it is determined that there is no idle process in the first process pool, the calculation result is encapsulated into a transmission task, and the transmission task is stored in the first work queue until there is an idle process in the first process pool When the transfer operation is performed on the transfer task.
The electronic device according to any one of claims 9 to 13, wherein the calculation result obtained by performing calculation processing on the calculation task based on a preset processing rule comprises:

The identifier of the computing task is acquired, the computing processing rule corresponding to the computing task is searched from a pre-configured mapping table based on the identifier, and a computing result is obtained by performing computing processing on the computing task based on the computing processing rule.
The electronic device of claim 12, wherein the preset state comprises a sleep state.
A computer-readable storage medium, wherein the computer-readable storage medium includes a data processing program, and when the data processing program is executed by a processor, the following steps are implemented:

Creating step: divide the preset process pool into a first process pool for input and output operations and a second process pool for computing operations, and create a first work queue corresponding to the first process pool and the second process pool respectively. the corresponding second work queue;

Receiving step: receiving a data processing request sent by the client, obtaining the data to be processed in the request, and judging whether the data to be processed is complete based on a pre-configured data protocol, and when the data to be processed is complete, send the data to be processed. The data to be processed is encapsulated into computing tasks, and the computing tasks are stored in the second work queue;

Processing steps: determine whether there is an idle process in the second process pool, when it is determined that there is an idle process in the second process pool, use the idle process to read the computing task from the second work queue, based on The preset processing rule performs calculation processing on the calculation task to obtain calculation results, and stores the calculation results in the first work queue; and

Feedback step: determine whether there is an idle process in the first process pool, when it is determined that there is an idle process in the first process pool, use the idle process to read the calculation result from the first work queue, and The calculation result is fed back to the client.
The computer-readable storage medium of claim 16, wherein the receiving step further comprises:

When it is judged that the data to be processed is incomplete, it is judged whether there is an idle process in the first process pool, and when it is judged that there is no idle process in the first process pool, the data to be processed is stored in the first process pool. A work queue, when it is determined that there is an idle process in the first process pool, the idle process is used to receive incomplete data corresponding to the data to be processed.
The computer-readable storage medium of claim 17, wherein, after the feedback step, the data processing program further implements the following steps when executed by the processor:

Judging whether the first work queue stores data to be processed or calculation results to be fed back, when it is judged that the first work queue does not store data to be processed and calculation results to be fed back, the data in the first process pool is stored. The idle process is set to the default state.
The computer-readable storage medium of claim 16, wherein, after the processing step, the data processing program further implements the following steps when executed by the processor:

Judging whether the second work queue stores computing tasks to be processed, and when judging that the second work queue does not store computing tasks to be processed, setting the idle processes in the second process pool to a preset state;

When judging that the second work queue stores computing tasks to be processed, the computing tasks to be processed are read from the second work queue based on idle processes in the second process pool, and the computing tasks are stored in the second work queue. Execute calculation processing.
The computer-readable storage medium of claim 16, wherein the feedback step further comprises:

When it is determined that there is no idle process in the first process pool, the calculation result is encapsulated into a transmission task, and the transmission task is stored in the first work queue until there is an idle process in the first process pool When the transfer operation is performed on the transfer task.