CN116208615A - Network data processing method, processing module, array server and medium - Google Patents
Network data processing method, processing module, array server and medium Download PDFInfo
- Publication number
- CN116208615A CN116208615A CN202310204183.8A CN202310204183A CN116208615A CN 116208615 A CN116208615 A CN 116208615A CN 202310204183 A CN202310204183 A CN 202310204183A CN 116208615 A CN116208615 A CN 116208615A
- Authority
- CN
- China
- Prior art keywords
- core
- processing
- data packet
- data
- processing mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2425—Traffic characterised by specific attributes, e.g. priority or QoS for supporting services specification, e.g. SLA
- H04L47/2433—Allocation of priorities to traffic types
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the application discloses a network data processing method, a processing module, an array server and a computer readable storage medium. The method comprises the following steps: acquiring operation information and/or data packet information, wherein the operation information is used for indicating the occupancy rate of the first core and the second core, and the data packet information is generated by a network module for acquiring the data packet and is used for indicating the state of the data packet; determining a processing mode according to the operation information and/or the data packet information; and acquiring the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to the processing mode. Therefore, the method and the device can determine the optimal processing mode to distribute the data packet according to the operation information of the occupancy rate of each core of the processing module and/or the data packet information corresponding to the data packet before receiving the data packet. Therefore, the data packet can be distributed to the most suitable core for processing, and the throughput rate of the network data in the array server is improved.
Description
Technical Field
The application belongs to the technical field of data processing, and particularly relates to a network data processing method, a processing module, an array server and a computer readable storage medium.
Background
The array server comprises a plurality of processing modules for realizing data operation. The existing processing modules all realize data processing through a CPU (Central Processing Unit ), and the CPU is usually provided with a large core and a small core, and the large core and the small core respectively correspond to different processing tasks. For example, for heavy tasks, to large core processing; while the lighter, cumbersome task is handled by the corelet or the middlelet.
In the application scenario of a general user, the data processing requirement of network data throughput is not high, and the network data throughput is usually processed by a small core. In the application scenario of the array server, the throughput of the network data is extremely high, and the limited performance of the small core often leads to the blockage of a memory and a network channel when facing to huge network data flows, and meanwhile, the overload of the small core processes the huge data flows and also affects the service life of the small core. How to improve the processing efficiency of the network data stream of the array server is a technical problem to be solved by those skilled in the art.
The foregoing description is provided for general background information and does not necessarily constitute prior art.
Disclosure of Invention
In view of the foregoing, a network data processing method, a processing module, an array server, and a computer readable storage medium are provided that can improve throughput of network data within the array server.
The technical problem that this application solved is realized by adopting following technical scheme:
the application provides a network data processing method, which is applied to a processing module of an array server, wherein the processing module comprises a plurality of cores, each core comprises a first core and a second core, and the data processing capacity of the first core is higher than that of the second core, and the method comprises the following steps: acquiring operation information and/or data packet information, wherein the operation information is used for indicating the occupancy rate of the first core and the second core, and the data packet information is generated by a network module for acquiring the data packet and is used for indicating the state of the data packet; determining a processing mode according to the operation information and/or the data packet information; and acquiring the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to the processing mode.
In an alternative embodiment of the present application, determining a processing mode according to the operation information and/or the packet information includes: determining whether the first core and/or the second core is in an idle state according to the operation information; determining a first processing mode when both the first core and the second core are in an idle state, the first processing mode representing distributing the data packet to the first core and the second core for processing; when the first core is in an idle state and the second core is in a busy state, determining a second processing mode, wherein the second processing mode represents distributing the data packet to the first core for processing; when the second core is in an idle state and the first core is in a busy state, a third processing mode is determined, the third processing mode representing distributing the data packet to the second core for processing.
In an alternative embodiment of the present application, the packet information includes a data size; determining a processing mode according to the operation information and/or the data packet information comprises the following steps: if the data size is larger than the first threshold value, determining a first processing mode, wherein the first processing mode represents distributing the data packet to the first core and the second core for processing; if the data size is smaller than or equal to the first threshold value and larger than or equal to the second threshold value, determining a second processing mode, wherein the second processing mode represents distributing the data packet to the first core for processing; if the data size is smaller than the second threshold, determining a third processing mode, wherein the third processing mode represents distributing the data packet to the second core for processing.
In an optional embodiment of the present application, the packet information includes a priority, and when the processing module acquires a plurality of packets at the same time, determining a processing mode according to the operation information and/or the packet information includes: if the first core and the second core are determined to be in the idle state according to the operation information, determining a fourth processing mode, wherein the fourth processing mode indicates that the data packet with high priority is distributed to the first core, and the data packet with low priority is distributed to the second core; if the first core or the second core is determined to be in a busy state according to the operation information, determining a fifth processing mode, wherein the fifth processing mode is used for distributing the data packet with high priority to the first core and/or the second core first, and distributing the data packet with low priority to the first core and/or the second core after the data packet with high priority is processed.
In an alternative embodiment of the present application, determining a processing mode according to the operation information and/or the packet information includes: the weight of distributing the data packet to the first core is higher than the weight of distributing the data packet to the second core.
In an alternative embodiment of the present application, the processing module includes at least one first core and at least one second core; obtaining the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to the processing mode, wherein the method comprises the following steps: transmitting a confirmation instruction to the network module to acquire a data packet; the data packet is divided into at least one sub-packet and the sub-packets are distributed into the corresponding first core and/or second core according to the processing mode.
The application also provides a network data processing method, which is applied to the network module of the array server and comprises the following steps: in response to the data packet being acquired, data packet information is generated from the data packet and sent to the processing module to cause the processing module to perform the method as described above.
The application also provides a processing module comprising a processor and a memory: the processor is configured to execute the computer program stored in the memory to implement the method as described above.
The application also provides an array server, which comprises a processing module and a network module; the processing module is used for executing the method as described above; the network module is used for executing the method.
The present application also provides a computer readable storage medium storing a computer program which when executed by a processor implements a method as described above.
By adopting the embodiment of the application, the method has the following beneficial effects:
according to the method and the device, before receiving the data packet, the optimal processing mode can be determined according to the operation information of the occupancy rate of each core of the processing module and/or the data packet information corresponding to the data packet, and then the data packet is distributed according to the determined processing mode. Therefore, the data packet can be distributed to the most suitable core for processing, and the throughput rate of the network data in the array server is improved.
The foregoing description is only an overview of the technical solutions of the present application, and may be implemented according to the content of the specification, so that the foregoing and other objects, features and advantages of the present application can be more clearly understood, and the following detailed description of the preferred embodiments is given with reference to the accompanying drawings. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
FIG. 1 is a flow chart of a network data processing method according to an embodiment;
FIG. 2 is a schematic diagram of a processing module core structure according to an embodiment;
FIG. 3 is a schematic block diagram of a processing module according to one embodiment;
FIG. 4 is a schematic block diagram of an array server according to an embodiment;
fig. 5 is a timing flowchart of a network data processing method according to an embodiment.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The multi-core processing module provided in a mobile device or a personal computer is generally not much burdened with a network. Therefore, when network data is transmitted and received, the data is generally processed by a small core with weak processing power in the multi-core. However, in the application scenario of the network server, the throughput of the network data is huge, and if the normal core calling strategy is still adopted, the network data is blocked, and a scenario that one core has a difficult multi-core surrounding is generated. The present application provides a network data processing method based on how a processing module in a server needs to implement core call to optimize the processing efficiency of network data. In order to clearly describe the network data processing method provided in the present embodiment, which is applied to the processing module of the array server, please refer to fig. 1-2, including steps S110-S130.
Step S110: and acquiring operation information and/or data packet information, wherein the operation information is used for indicating the occupancy rate of the first core and the second core, and the data packet information is generated by a network module for acquiring the data packet and is used for indicating the state of the data packet.
In one embodiment, for the purpose of illustration, the processing module includes a plurality of cores, and the cores may be divided into a first core and a second core, where the first core has a higher data processing capability than the second core. Specifically, taking an ARM architecture array server as an example, the processing chip may be a high-pass cell 865 chip. The chip has 8 cores, and is set by adopting a small, medium and large core architecture. Table 1 may be referenced for naming and performance of the individual cores, while the architectural setup diagram may be referenced in FIG. 2.
TABLE 1
As shown in fig. 2, the CPU0 to CPU7 are a plurality of cores in the Gao Tongxiao-865 processing module, wherein the core processing capacities are different. The first core and the second core are only definitions of relative concepts in terms of the relative differences in the processing of the inter-core capabilities. For example, the large cores of CPU 4-CPU 7, the former is the first core and the latter is the second core compared with the CPU 0-CPU 3; if the calling policy is called between cores in CPU 4-CPU 6, if CPU4 has been called to handle other tasks, the performance is reduced, even between cores of the same kind, CPU4 belongs to the second core with respect to CPU5, 6, and CPU5, 6 belongs to the first core. As described above, under the normal core call policy, the response of the network packet is processed by CPU 0. The CPU0 is shown in the graph, is only a small core in the processing module, belongs to a low-power-consumption core, has limited processing capacity, and is concretely characterized in that the network throughput rate is not improved. Therefore, when the data arrives at the network module, how to call allocation to improve the processing efficiency of the network data, the operation efficiency and the operation information of the operation condition of each core of the processing module need to be obtained; and/or, carrying out comprehensive judgment on the data packet information for expressing the data packet state.
Step S120: the processing mode is determined based on the run information and/or the packet information.
In one embodiment, determining a processing mode based on the run information and/or the packet information includes: the weight of distributing the data packet to the first core is higher than the weight of distributing the data packet to the second core.
In an embodiment, it is noted that the method provided in the present application is applied to a processing module in an array server, and for the server, a large amount of network data needs to be processed, which is different from an application scenario of the processing module applied in a mobile terminal device. Therefore, the basis of the calling strategy of the method provided by the application is to preferentially call the core processing network data packet with better performance, and taking the high-pass Cells 865 as an example, the method is to preferentially call the CPU4 to the CPU7. The weight of distributing the data packet to the first core is higher than the weight of distributing the data packet to the second core when determining the processing mode. Therefore, when the array server processing module processes the network data packet, the first core with better performance can process the network data packet as much as possible, so that the processing rate is ensured, and the requirement of huge amount of network data in a server implementation scene is met.
In one embodiment, determining a processing mode based on the run information and/or the packet information includes: determining whether the first core and/or the second core is in an idle state according to the operation information; determining a first processing mode when both the first core and the second core are in an idle state, the first processing mode representing distributing the data packet to the first core and the second core for processing; when the first core is in an idle state and the second core is in a busy state, determining a second processing mode, wherein the second processing mode represents distributing the data packet to the first core for processing; when the second core is in an idle state and the first core is in a busy state, a third processing mode is determined, the third processing mode representing distributing the data packet to the second core for processing.
In one embodiment, the packet information includes a data size; determining a processing mode according to the operation information and/or the data packet information comprises the following steps: if the data size is larger than the first threshold value, determining a first processing mode, wherein the first processing mode represents distributing the data packet to the first core and the second core for processing; if the data size is smaller than or equal to the first threshold value and larger than or equal to the second threshold value, determining a second processing mode, wherein the second processing mode represents distributing the data packet to the first core for processing; if the data size is smaller than the second threshold, determining a third processing mode, wherein the third processing mode represents distributing the data packet to the second core for processing.
In one embodiment, the determinable processing mode may include three for a single packet, and may be determined from the state of the processing module and/or the state of the packet. For the running information representing the state of the processing module, the idle state of the respective first core, second core may be determined. The determination as to whether or not the processing module is in the idle state may be determined from multiple angles such as the occupancy rate, the processing time, the processing capacity, etc., and the determination may be arbitrarily set by the developer according to the capacity of each core of the processing module, and is not limited herein. In general, that is, which type of core is idle, the packet is divided into which type of core to process. That is, when the first core and the second core are both in the idle state, then the data packet is distributed to the first core and the second core for processing; when the first core is in an idle state and the second core is in a busy state, distributing the data packet to the first core for processing; when the second core is in an idle state and the first core is in a busy state, the data packet is distributed to the second core for processing. The three correspond to a first mode, a second mode and a third mode.
In one embodiment, the network data packets are of different sizes and different capacity requirements, so that the judgment can be performed from the perspective of the data packets. The developer may set the first threshold and the second threshold in advance according to the size of each core processing capability, corresponding to the volume size of the data packet. If the data size is larger than the first threshold value, distributing the data packet to the first core and the second core for processing; if the data size is smaller than or equal to the first threshold value and larger than or equal to the second threshold value, distributing the data packet to the first core for processing; if the data size is smaller than the second threshold value, the data packet is distributed to the second core for processing. The three correspond to a first mode, a second mode and a third mode. It is further noted that in both embodiments, the determination of the run information or the packet information is performed separately. In other embodiments, the determination may be performed by both, for example, for executing the first mode, where the first core and the second core are required to be in an idle state, and the data size is greater than the first threshold, and all other modes may refer to the first and second cores, and the results generated by the first and second modes may be numerous and not exhaustive. In practice, the developer may make a determination based on the correlation between the running information and the packet information to match the adapted call pattern, so that the packet can be distributed to the appropriate core for processing. The processing capacity of multiple cores in the processing module is balanced, the processing efficiency is improved, and the energy consumption is saved under the condition of approximate processing speed.
In one embodiment, the packet information includes a priority, and when the processing module acquires a plurality of packets at the same time, determining a processing mode according to the operation information and/or the packet information includes: if the first core and the second core are determined to be in the idle state according to the operation information, determining a fourth processing mode, wherein the fourth processing mode indicates that the data packet with high priority is distributed to the first core, and the data packet with low priority is distributed to the second core; if the first core or the second core is determined to be in a busy state according to the operation information, determining a fifth processing mode, wherein the fifth processing mode is used for distributing the data packet with high priority to the first core and/or the second core first, and distributing the data packet with low priority to the first core and/or the second core after the data packet with high priority is processed.
In one embodiment, the embodiments described above are all implementation scenarios for a single data packet. In a practical scenario, the processing module of the array server receives a plurality of data packets at the same time. How to equalize multiple data packets is also a determination of who is before whom the pattern needs to be processed. In this regard, the packet information may further include a priority level, where the priority level represents an emergency degree of the packet: for a data packet with high priority, that is to say, the data packet is loaded with important data, the data packet needs to be processed first; and for low priority packets, it can be processed later. However, it will be understood that, in principle, although it is said that the high-priority data packets need to be processed preferentially, in practical situations, the multiple cores of the processing module often process the data packets in parallel, and cannot be used to air the low-priority data packets for no processing. For this purpose, for determining the processing mode of the multiple data packets, a comprehensive determination of both the data packet information and the operation information is required. For the operation information, whether the first core and the second core are in an idle state needs to be determined, if the first core and the second core are determined to be in the idle state according to the operation information, it is indicated that the processing capability of the processing module is redundant, and the data packet can be processed in parallel. And determining a fourth processing mode for distributing the data packet with high priority to the first core and distributing the data packet with low priority to the second core. So that the high priority data packet can be processed by the first core with better performance, thereby accelerating the derivation of important data. If the first core or the second core is determined to be in a busy state according to the operation information, the processing module is limited in processing capacity, and multiple data packets cannot be or are difficult to process in parallel. Because the data packets have a priority order, the high priority data packets may be processed preferentially according to the fifth processing mode and forwarded to the first core and/or the second core for processing. And after the high-priority data packet starts to be processed or is processed, distributing the low-priority data packet to the first core and/or the second core for processing. In addition, it should be noted that, in the foregoing embodiments, the implementation of determining the processing mode for processing a single data packet and the technical solution of processing multiple data packets in this embodiment are not mutually conflicting scenarios, and may be implemented in combination. For example, in the case of multiple data packets, after determining the fourth or fifth processing mode according to the scheme provided in the present embodiment, one of the first, second or third processing modes may be determined in the determined core according to the steps described above. Because the first core and the second core described above are relative concepts, not absolute concepts. For example, taking the 8-core processing module of the high-pass cell 865 of fig. 2 as an example, when the processing module acquires a packet A1 with a high priority and a packet A2 with a low priority, all cores of the processing module are in an idle state, a fourth determining mode can be determined for this, that is, the A1 is allocated to the first core CPU4 to CPU7 for processing; and A2 is allocated to the processes in CPU0 to CPU 3. For A1, the data size is smaller than or equal to the first threshold value and larger than or equal to the second threshold value, which in turn can be determined as the second processing mode, i.e. allocated to the first core of CPU 4-CPU 7, i.e. processing in CPU7. Therefore, when the processing mode is determined by two times of judgment, the cores pointed by the first core and the second core are different, that is, the two embodiments can be matched with parallel processing, so that the processing flow of the data packet is optimized and perfected, and the throughput rate of network data is improved.
Step S130: and acquiring the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to the processing mode.
In an embodiment, the processing module includes at least one first core and at least one second core; obtaining the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to the processing mode, wherein the method comprises the following steps: transmitting a confirmation instruction to the network module to acquire a data packet; the data packet is divided into at least one sub-packet and the sub-packets are distributed into the corresponding first core and/or second core according to the processing mode.
In one embodiment, the array server further includes a network module, where the network module is configured to communicate with an external device, and is configured to send and receive data packets, and perform simple processing, such as generating data packet information according to the data packets when the data packets are acquired, and send the data packet information to the processing module. That is, the data packet is not received and transmitted by the processing module in advance, and only after the processing module determines the benefit mode, a confirmation instruction is sent to the network module to receive the data packet. And processing the data packet according to the determined processing module, for example, the data packet can be segmented into at least one sub-packet and correspondingly sent to the corresponding first core and/or second core for processing. The setting reduces the processing pressure of the processing module, and only acquires the data packet after determining the processing mode, thereby avoiding that the data packet occupies the bandwidth or the buffer space of the processing module for a long time, ensuring smoother data circulation and avoiding data accumulation.
Therefore, the method and the device can determine the optimal processing mode to distribute the data packet according to the operation information of the occupancy rate of each core of the processing module and/or the data packet information corresponding to the data packet before receiving the data packet. Therefore, the data packet can be distributed to the most suitable core for processing, and the throughput rate of the network data in the array server is improved.
In one embodiment, a processing module is provided that includes a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of: step S110: acquiring operation information and/or data packet information, wherein the operation information is used for indicating the occupancy rate of the first core and the second core, and the data packet information is generated by a network module for acquiring the data packet and is used for indicating the state of the data packet; step S120: determining a processing mode according to the operation information and/or the data packet information; step S130: and acquiring the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to the processing mode.
Figure 3 illustrates an internal block diagram of a processing module in one embodiment. As shown in fig. 3, the processing module includes a processor, a memory, and a network interface connected by a system bus. The memory includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium of the processing module stores an operating system, and may also store a computer program that, when executed by a processor, causes the processor to implement a network data processing method. The internal memory may also have stored therein a computer program which, when executed by the processor, causes the processor to perform the age identification method. It will be appreciated by those skilled in the art that the structure shown in fig. 3 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the processing modules to which the present application is applied, and that a particular processing module may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
FIG. 4 illustrates a block diagram of the architecture of an array server in one embodiment. Array server 40 includes at least one processing module 410 and a network module 420. The processing module 410 and the network module 420 may be connected according to a local area network constructed by the network module 420, so as to meet a large amount of data flow requirements in the data packet. The processing module 410 is configured to perform the method as described above; the method used by the network module 420 will be described in detail below, and is not expanded here.
Fig. 5 shows a timing flowchart of a network data processing method, which is applied to the network module 420 of the array server 40, and specifically includes steps S510 to S540.
Step S510: the network module responds to the acquired data packet, generates data packet information according to the data packet and sends the data packet information to the processing module.
In one embodiment, when the network module 420 obtains a data packet, packet information is first generated according to the data packet to indicate the status of the data packet. Such as data size, priority level, computational power requirements, etc. And sent to the processing module 410.
Step S520: the processing module obtains the running information in response to obtaining the data packet information.
Step S530: the processing module determines a processing mode according to the operation information and/or the data packet information.
In one embodiment, the process knows that a packet was received when packet information was obtained. Although the processing mode may be determined based on the packet information alone, in practice, the operational information of the processing module 410 should also be considered, where the operational information is used to indicate the current operating state of each core of the processing module 410, including but not limited to occupancy, processing time, processing power, etc. It should also be noted that in a practical scenario, the processing module 410 of the array server 40 may actually receive multiple data packets at the same time. The determining process mode may be divided into two determining processes, firstly, one of the fourth process mode or the fifth process mode is determined between the plurality of data packets according to the priority order and the idle state of the core. And then determining one of the first processing mode, the second processing mode or the third processing mode according to the operation information and/or the data packet information. For example, taking the example of the 8-core chip of the high-pass cell 865 of fig. 2, when the processing module 410 acquires a packet A1 with a high priority and a packet A2 with a low priority, all cores of the processing module 410 are in an idle state, a fourth determination mode may be determined for this, that is, A1 is allocated to the first core CPU4 to CPU7 for processing; and A2 is allocated to the processes in CPU0 to CPU 3. For A1, the data size is smaller than or equal to the first threshold value and larger than or equal to the second threshold value, which in turn can be determined as the second processing mode, i.e. allocated to the first core of CPU 4-CPU 7, i.e. processing in CPU7. Therefore, the data packets can be distributed to proper cores for processing, and the operation efficiency of the cores is improved.
Step S540: the network module sends the data packet to the processing module according to the control.
Step S550: the processing module distributes the data packet to the first core and/or the second core for processing according to the processing mode.
In one embodiment, the data packet is not previously received by the processing module 410, and only after the processing module 410 determines that the benefit mode is good, an acknowledgement command is sent to the network module 420 to receive the data packet. And processes the data packet according to the determined processing module 410, for example, the data packet may be split into at least one sub-packet and correspondingly sent to the corresponding first core and/or second core for processing. The arrangement reduces the processing pressure of the processing module 410, and only acquires the data packet after determining the processing mode, thereby avoiding that the data packet occupies the bandwidth or the buffer space of the processing module 410 in a long-time invalid manner, ensuring smoother data circulation and avoiding data accumulation.
Therefore, before receiving the data packet, the present application can determine an optimal processing mode according to the operation information of the occupancy rate of each core of the processing module 410 and/or the data packet information corresponding to the data packet, so as to distribute the data packet. Therefore, the data packet can be distributed to the most suitable core for processing, and the throughput rate of the network data in the array server is improved.
In one embodiment, the present application also proposes a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to perform the steps of the method as described above,
those skilled in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by a computer program for instructing relevant hardware, where the program may be stored in a non-volatile computer readable storage medium, and where the program, when executed, may include processes in the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples only represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the present application. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.
Claims (10)
1. A network data processing method, applied to a processing module of an array server, the processing module comprising a plurality of cores, the cores comprising a first core and a second core, the first core having a higher data processing capacity than the second core, comprising the steps of:
acquiring operation information and/or data packet information, wherein the operation information is used for indicating the occupancy rate of the first core and the second core, and the data packet information is generated by a network module for acquiring a data packet and is used for indicating the state of the data packet;
determining a processing mode according to the operation information and/or the data packet information;
and acquiring the data packet from the network module, and distributing the data packet to the first core and/or the second core for processing according to a processing mode.
2. The network data processing method according to claim 1, wherein said determining a processing mode based on said operation information and/or said packet information comprises:
determining whether the first core and/or the second core is in an idle state according to the running information;
determining a first processing mode when both the first core and the second core are in an idle state, the first processing mode representing distributing the data packet to processing in the first core and the second core;
determining a second processing mode when the first core is in an idle state and the second core is in a busy state, wherein the second processing mode represents distributing the data packet to the first core for processing;
when the second core is in an idle state and the first core is in a busy state, a third processing mode is determined, the third processing mode representing distributing the data packet into the second core for processing.
3. The network data processing method of claim 1, wherein the packet information includes a data size;
the determining a processing mode according to the operation information and/or the data packet information comprises the following steps:
if the data size is greater than a first threshold, determining a first processing mode, wherein the first processing mode represents distributing the data packet to the first core and the second core for processing;
if the data size is smaller than or equal to a first threshold value and larger than or equal to a second threshold value, determining a second processing mode, wherein the second processing mode represents distributing the data packet to the first core for processing;
and if the data size is smaller than a second threshold value, determining a third processing mode, wherein the third processing mode represents distributing the data packet to the second core for processing.
4. The network data processing method of claim 1, wherein the packet information includes a priority, and when the processing module acquires a plurality of packets simultaneously,
the determining a processing mode according to the operation information and/or the data packet information comprises the following steps:
if the first core and the second core are determined to be in an idle state according to the operation information, determining a fourth processing mode, wherein the fourth processing mode indicates that the data packet with high priority is distributed to the first core, and the data packet with low priority is distributed to the second core;
and if the first core or the second core is determined to be in a busy state according to the operation information, determining a fifth processing mode, wherein the fifth processing mode is used for distributing the data packet with high priority to the first core and/or the second core, and distributing the data packet with low priority to the first core and/or the second core after the data packet with high priority is processed.
5. The network data processing method according to any one of claims 1 to 4, wherein the determining a processing mode from the operation information and/or the packet information includes: the weight of distributing the data package to the first core is higher than the weight of distributing the data package to the second core.
6. The network data processing method of claim 1, wherein the processing module comprises at least one of the first core and at least one of the second core;
the method for obtaining the data packet from the network module and distributing the data packet to the first core and/or the second core for processing according to a processing mode comprises the following steps:
transmitting a confirmation instruction to the network module to acquire the data packet;
dividing the data packet into at least one sub-packet, and distributing the sub-packet into the corresponding first core and/or second core according to the processing mode.
7. The network data processing method is applied to a network module of an array server and is characterized by comprising the following steps of:
in response to acquiring a data packet, generating data packet information from the data packet and sending to a processing module, so that the processing module performs the steps of the method according to any one of claims 1 to 6.
8. A processing module comprising a processor and a memory;
the processor is configured to execute a computer program stored in the memory to implement the method of any one of claims 1 to 6.
9. An array server is characterized by comprising a processing module and a network module;
the processing module for performing the method of any of claims 1 to 6;
the network module is configured to perform the method of claim 7.
10. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements the method according to any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310204183.8A CN116208615A (en) | 2023-02-22 | 2023-02-22 | Network data processing method, processing module, array server and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310204183.8A CN116208615A (en) | 2023-02-22 | 2023-02-22 | Network data processing method, processing module, array server and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116208615A true CN116208615A (en) | 2023-06-02 |
Family
ID=86514489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310204183.8A Pending CN116208615A (en) | 2023-02-22 | 2023-02-22 | Network data processing method, processing module, array server and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116208615A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116894649A (en) * | 2023-09-11 | 2023-10-17 | 成都秦川物联网科技股份有限公司 | Industrial Internet of things main service platform data distribution system, method and medium |
-
2023
- 2023-02-22 CN CN202310204183.8A patent/CN116208615A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116894649A (en) * | 2023-09-11 | 2023-10-17 | 成都秦川物联网科技股份有限公司 | Industrial Internet of things main service platform data distribution system, method and medium |
| CN116894649B (en) * | 2023-09-11 | 2023-11-17 | 成都秦川物联网科技股份有限公司 | Industrial Internet of things main service platform data distribution system, method and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220342713A1 (en) | Information reporting method, apparatus and device, and storage medium | |
| CN110460534B (en) | Method, device, equipment and storage medium for reporting request message | |
| CN110532205B (en) | Data transmission method, data transmission device, computer equipment and computer readable storage medium | |
| WO2020019743A1 (en) | Traffic control method and device | |
| CN116208615A (en) | Network data processing method, processing module, array server and medium | |
| CN110995617B (en) | MQTT-based data transmission method and device, computer equipment and storage medium | |
| CN113141321B (en) | Data transmission method based on edge calculation and electronic equipment | |
| CN109002364B (en) | Method for optimizing inter-process communication, electronic device and readable storage medium | |
| CN111338779A (en) | Resource allocation method, device, computer equipment and storage medium | |
| CN111490963A (en) | Data processing method, system, equipment and storage medium based on QUIC protocol stack | |
| CN112422497A (en) | Message transmission method and device and computer equipment | |
| CN110838987B (en) | Queue current limiting method and storage medium | |
| CN111586140A (en) | Data interaction method and server | |
| US20230273833A1 (en) | Resource scheduling method, electronic device, and storage medium | |
| CN112799811B (en) | High concurrency thread pool task scheduling method for edge gateway | |
| CN110474924B (en) | Data transmission method and device, computer equipment and storage medium | |
| CN114691374B (en) | Request distribution method of virtual channel and related device | |
| CN114884862A (en) | Terminal service processing method and device | |
| CN111404726B (en) | Log processing method, device and system | |
| CN114040378A (en) | Application arranging method and device, computer equipment and storage medium | |
| CN113438274A (en) | Data transmission method and device, computer equipment and readable storage medium | |
| CN111194060A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN110865885A (en) | Task deployment device and method for distributed data processing and aggregation | |
| CN113849129B (en) | IO request forwarding method, device and equipment among storage controllers | |
| CN117201403B (en) | Cache control method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |