CN111859062A - DPDK-based network data processing method and device - Google Patents
DPDK-based network data processing method and device Download PDFInfo
- Publication number
- CN111859062A CN111859062A CN201910364260.XA CN201910364260A CN111859062A CN 111859062 A CN111859062 A CN 111859062A CN 201910364260 A CN201910364260 A CN 201910364260A CN 111859062 A CN111859062 A CN 111859062A
- Authority
- CN
- China
- Prior art keywords
- data
- network data
- control node
- generating
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a DPDK-based network data processing method and a DPDK-based network data processing device, wherein network data of a preset structural body is sent through the DPDK, the preset structural body is an Mbuf data structural body, then a preset functional area in the Mbuf data structural body is obtained, wherein the function area is provided with a tracking control node and a plurality of acquisition nodes, the tracking control node is provided with a state identifier, when the tracking control node is in a starting state, generating log data according to the network data collected by the collection node, then generating a processing path for the network data according to the log data, so as to record the path of data processing in a functional area of a preset structural body by carrying out transmission of the network data in a preset structural body mode and combining the characteristics of the preset structural body, the method can realize the tracking of the data, greatly simplifies the analysis process of the transmitted data and improves the processing efficiency of the network data problem.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a DPDK-based network data processing method and a DPDK-based network data processing apparatus.
Background
In an environment where a large amount of various service data is normally transmitted in a networking manner, tracking one of the data is a time-consuming and complicated process operation. The global counter structure classification statistics is needed, a plurality of functions and functional nodes are involved, and the process can be crossed, so that how to reasonably plan and track is always a tedious process.
For the traditional flow of data transmission of the transmission network, packet capturing is carried out at a data inlet or a data outlet through a mirror image of a switching device or statistics distributed in a software processing flow are analyzed. For the analysis of the captured data, it is necessary to be able to use professional tools and people with data network knowledge to screen the result data, and to study and judge the DPDK-based network data processing flow by combining with a counter.
However, the network data transmission needs to screen a large amount of original data and compare counters in a software processing process, and when the problem analysis efficiency needs to be improved, technical devices need to be added continuously, the expansibility is poor, and a professional needs to spend much time on analyzing and positioning, so that the efficiency of processing the network data transmission problem is low.
Disclosure of Invention
The embodiment of the invention provides a DPDK-based network data processing method, which aims to solve the problems that when network data are tracked, massive data need to be screened, and the data analysis efficiency is low.
Correspondingly, the embodiment of the invention also provides a DPDK-based network data processing device, which is used for ensuring the realization and the application of the method.
In order to solve the above problem, an embodiment of the present invention discloses a DPDK-based network data processing method, including:
sending network data of a preset structure body through the DPDK, wherein the preset structure body is an Mbuf data structure body;
acquiring a preset functional area in the Mbuf data structure body, wherein the functional area is provided with a tracking control node and a plurality of acquisition nodes, and the tracking control node is provided with a state identifier;
when the tracking control node is in a starting state, generating log data according to the network data acquired by the acquisition node;
and generating a processing path aiming at the network data according to the log data.
Optionally, when the tracking control node is in the start state, generating log data according to the network data acquired by the acquisition node includes:
Acquiring the domain position of the network data processing node;
generating set information by the acquisition node by adopting the domain position;
and when the network data is handed out from the functional area, generating the log data by adopting the set information through the tracking control node.
Optionally, the functional area further has a presentation control node, and the presentation control node has a state identifier, and the method further includes:
and when the display control node is in a starting state, acquiring trace information adapted to the set information through the display control node, and displaying the trace information, wherein the trace information comprises at least one of a source IP, a destination IP, a protocol number and a length.
Optionally, the generating a processing path for the network data according to the log data includes:
acquiring a mapping relation between the acquisition nodes and the functional areas, wherein the mapping relation comprises the sequence of the acquisition nodes;
and generating path information aiming at the network data by adopting the log data and the mapping relation.
The embodiment of the invention also discloses a DPDK-based network data processing device, which comprises:
The data transmission module is used for transmitting network data of a preset structure body through the DPDK, wherein the preset structure body is an Mbuf data structure body;
the functional area acquisition module is used for acquiring a preset functional area in the Mbauf data structure body, the functional area is provided with a tracking control node and a plurality of acquisition nodes, and the tracking control node is provided with a state identifier;
the log data generation module is used for generating log data according to the network data acquired by the acquisition node when the tracking control node is in a starting state;
and the data processing module is used for generating a processing path aiming at the network data according to the log data.
Optionally, the log data generating module includes:
a domain position obtaining submodule, configured to obtain a domain position of the network data processing node;
the setting information generation submodule is used for generating setting information by adopting the domain position through the acquisition node;
and the log generation submodule is used for generating the log data by adopting the set information through the tracking control node when the network data is handed out from the functional area.
Optionally, the functional area further has a display control node, and the display control node has a state identifier, and the apparatus further includes:
And the data display module is used for acquiring trace information matched with the set information through the display control node and displaying the trace information when the display control node is in a starting state, wherein the trace information comprises at least one of a source IP, a destination IP, a protocol number and a length.
Optionally, the data processing module includes:
the mapping relation obtaining submodule is used for obtaining the mapping relation between the acquisition nodes and the functional areas, and the mapping relation comprises the sequence of the acquisition nodes;
and the path information generating submodule is used for generating path information aiming at the network data by adopting the log data and the mapping relation.
The embodiment of the invention also discloses a device, which comprises:
one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform one or more methods as described above.
Embodiments of the invention also disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform one or more of the methods described above.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the network data of the preset structure body is sent through the DPDK, the preset structure body is an Mbuf data structure body, then a preset function area in the Mbuf data structure body is obtained, wherein the function area is provided with a tracking control node and a plurality of acquisition nodes, the tracking control node is provided with a state identifier, when the tracking control node is in a starting state, log data are generated according to the network data acquired by the acquisition nodes, and then a processing path aiming at the network data is generated according to the log data, so that the network data is transmitted in a preset structure body mode, and the path of data processing is recorded in the function area of the preset structure body by combining the characteristics of the preset structure body, so that the data tracking can be realized, the analysis process of the transmitted data is greatly simplified, and the processing efficiency of the network data problem is improved.
Drawings
Fig. 1 is a flowchart illustrating steps of an embodiment of a DPDK-based network data processing method according to the present invention;
fig. 2 is a schematic diagram of an Mbuf data structure provided in an embodiment of a DPDK-based network data processing method according to the present invention;
fig. 3 is a block diagram of an embodiment of a DPDK-based network data processing apparatus according to the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for processing network data based on DPDK according to the present invention is shown, and the method specifically includes the following steps:
for network devices, such as routers, switches, media gateways, SBCs, PS gateways, etc., a large amount of messages are often required to be sent and received instantly, so that, on a conventional network device, it can be seen that a special NP (network processing) processor, an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc. are configured. The special devices efficiently forward the message through a built-in hardware circuit (or a hardware circuit formed by programming), and CPU interference is required when the message needs to be deeply processed.
For application scenarios such as public cloud and NFV (Network Function Virtualization), the infrastructure uses cpu as an operation core, and often does not have a dedicated NP processor, and the operating system is mainly general Linux. In a virtualization environment, a network data receiving and sending path is long, and due to switching of a kernel mode and a user mode and multiple times of memory copying of a packet processing task, system consumption is increased, and a system with a CPU as a core has a large processing bottleneck. Therefore, to improve the packet processing performance in the universal server, Intel introduced DPDK technology serving ia (Intel architecture) systems.
DPDK, the Date Plane Development Kit, is a software library used to accelerate packet data processing. Compared with the traditional data packet processing, the DPDK has the following characteristics: 1. polling: avoiding the overhead of interrupting context switching during packet processing; 2. user state driving: unnecessary memory copy and system call are avoided, and rapid iterative optimization is facilitated; 3. affinity and exclusivity: specific tasks can be specified to work only on a certain core, so that frequent switching of threads among different cores is avoided, and more cache hits are guaranteed; 4. the access and storage overhead is reduced: the TLB miss is reduced by using the large page of the memory, and the effective bandwidth of the memory access is improved by using the multi-channel interleaving access of the memory; 5. software tuning: cache line alignment, data prefetching and multi-metadata batch operation.
In the embodiment of the invention, the DPDK frame is adopted to output the network data processing process. And encapsulating the data network frame content in a preset structure body so as to transmit network data by utilizing the DPDK.
In a specific implementation, the preset structure is an Mbuf (struct rte _ Mbuf) structure, and the DPDK may encapsulate the network data frame in the Mbuf structure for efficient data access. Referring to fig. 2, a schematic diagram of an Mbuf structure provided by the DPDK-based network data processing method of the present invention is shown, where an Mbuf structure header is carefully designed, and only 1 Cache Line is originally adjusted to 2 Cache lines to adapt to the situation of information increase carried by the Mbuf header, and in practical applications, basic and frequently accessed data may be placed in one Cache Line byte, and functionally extended data may be placed in a second Cache Line byte. The Mbuf header contains all the data needed for packet processing, and for a Jumbo Frame where a single Mbuf does not hold, the Mbuf also has pointers to the next Mbuf structure to form the Frame linked list structure.
In the concrete implementation, the network data of the Mbuf data structure is sent through the DPDK, after the network data frame is received, the network data frame can be placed into an abstracted Mbuf structure data memory pool, only limited modification of the pointer pointing content is carried out in the effective lifetime, large-block data memory movement is not carried out, and therefore data processing can be carried out on the message by concentrating cpu resources.
in the embodiment of the present invention, a functional area may be configured in the head (tail) room in the Mbuf data structure, and the functional area is used as a trace record of the network data processing process, so as to implement data tracing using DPDK.
In a specific implementation, a head room use pointer can be obtained by adding a sizeof (struct _ Mbuf) offset to a head pointer address of current data Mbuf, and a use range of a record is defined by starting a base address of the pointer, so that a functional region is extracted as a trace record of a message data processing process, wherein the functional region can be provided with a tracking control node, a display control node and a plurality of acquisition nodes, and each node has a corresponding state identifier.
In an example of the embodiment of the present invention, a 32-Bit functional area may be defined, where each Bit has a corresponding state identifier, and for example, the start state is 1, and the stop state is 0. Defining high 2Bit as the enabling of function control, for the rest Bit, each Bit represents the processing trace of a node, when the network data process the mapped function node, setting the corresponding Bit field to 1, as shown in the following table:
log represents a tracking control node, when the Bit value is 0, the tracking log is started, and each acquisition node can acquire the data in the network data processing process; when the Bit value is 1, it indicates that the data is the trace data, and the trace record may be written into a log or reported. The flag indicates that the control node is shown, and when the Bit value is 0, the node can jump to the storage information; when the Bit value is 1, the recorded log data may be printed and displayed. And the MarkTag represents an acquisition node, and when the Bit value is 1, the network data processing process is tracked and marked.
Wherein, an effective meaning can be defined for the Bit of each collection node in advance, and each node corresponds to a step of the network data processing process, such as:
#define Network_TraceNode_Step1 0x0000 0001
#define Network_TraceNode_Step2 0x0000 0002
#define Network_TraceNode_Step3 0x0000 0004
#define Network_TraceNode_Step4 0x0000 0008
#define Network_TraceNode_Step5 0x0000 0010
……
#define Network_TraceNode_Step29 0x2000 0000
In a specific implementation, a processing process of network data can be divided into a path and an end point, the path can correspond to a plurality of collection nodes, and on each collection node, setting can be performed according to a mapped unique Bit identifier, and a flag is checked to determine whether to output a print log print. At the end point, for the output endpoint, whether to write the trace record into the log can be decided by acquiring the state identification of the flags.
It should be noted that, in the present invention, the length of the functional area with 32 Bits is defined as an example, and it is understood that, a person skilled in the art may increase the length of the Bit area of the functional area according to the number of nodes, for example, the length is extended to 64Bits, 128Bits, etc., which is not limited by the present invention.
103, when the tracking control node is in a starting state, generating log data according to the network data acquired by the acquisition node;
in the embodiment of the present invention, when the Bit value of the tracking control node is 0, it indicates that the current state is a default state, the tracking control node controls all the acquisition nodes to only perform acquisition of the network data processing flow, and when the Bit value is 1, it indicates that the tracking control node is in a start state at this time, and can control all the acquisition nodes to perform acquisition of the network data processing flow, and generate corresponding acquisition log data according to the network data acquired by the acquisition nodes.
In the specific implementation, in the network data processing process, the Mbuf always runs through the process, the domain position of the network data processing node is obtained through the acquisition node, then the domain position is adopted to generate corresponding setting information, traces of the network data in the processing process are identified on the Mbuf, and when the network data are handed out from the functional area, the setting information can be adopted through the tracking control node to generate log data aiming at the network data processing process, so that the nodes for identifying the network data processing are tracked in real time, the abnormal flow of the network data is favorably inquired, and the network problem positioning period is shortened.
In an example of the embodiment of the present invention, at an entrance of each processing node function processing, a domain location related to a current processing node, for example, a message of IPv4, uses Network _ TraceNode _ Step5, and then sets a 5 th Bit value of a 32Bit area of a functional area corresponding to Mbuf of data to 1 (an initial default value is 0), so as to identify that the processing of the node has been performed. This allows traces of network data during processing to be identified on the Mbuf.
At an output end endpoint of a data processing path of the network, the identifier of the 31 st Bit position in the 32Bit area of the functional area corresponding to the Mbuf of the data can be judged, when the Bit value corresponding to the flag.
For the generally input endpoint, a judgment condition of trace may be added in the preprocessing stage of the data input, for example, in the external network port receiving processing function, a pre-judgment process is added: this judgment condition may be a global data trace enable switch (issued configuration and opened by Shell command); or may be specific information of the data, such as the protocol number of the data L3 or the destination IP of the data. And when the judgment condition is true, outputting the record trace on the corresponding Bit position from the received data to the processed output endpoint according to the Bit position 1 of the corresponding flag.
In addition, the identifier of the tracking control node can be configured to be set when the flow table entry is established and the data search flow is hit. For the application of the dropped endpoint, the control node can be directly tracked according to the configuration of the access parameter.
In another example of the embodiment of the present invention, in the process of processing the network data, a flags.dump Bit may be determined to determine whether to print trace information, where the flags.dump Bit is located at the 30 th Bit of the Field Bit Field, and when the corresponding Bits value is 1, a print function is called to obtain trace information adapted to the set information, and the trace information of the current node is displayed. Wherein, the trace information may include a source IP, a destination IP, a protocol number, a length, and the like.
If the program checks that the corresponding flags flag is 1 when the IPv4 entry message is processed, the program prints and displays the key information of the corresponding data, such as the source IP, the destination IP, the protocol number, and the length.
And 104, generating a processing path aiming at the network data according to the log data.
In the embodiment of the invention, a functional area with fixed Bit bits is divided in an Mbuf data structure body, a plurality of Bit bits are used as enabling of function control, and the rest Bit bits are used as acquisition nodes for acquiring the network data processing process, wherein the Bit of each acquisition node is predefined with effective meaning in advance, so that the sequence of each acquisition node in the functional area is fixed.
In specific implementation, processing path information for network data can be generated by acquiring a mapping relation between a collection node and a functional area and then adopting log data generated by a tracking control node and the mapping relation, so that a tracking function of a data service processing flow is realized by expanding functions of an Mbauf under a DPDK network data processing framework and combining the design of setting, recording and the like in the data processing flow, the skill requirement of maintenance manpower is reduced, and the problem positioning period is shortened.
In an example of the embodiment of the present invention, network data of a preset structure sent based on DPDK may be received, then a processing path of the network data may be analyzed by analyzing setting information of Bits in a functional region of the preset structure and combining a mapping relationship between an acquisition node and the functional region, so that an implementation process of data tracking may be optimized without additional consumption of global variables and without considering recorded memory management, which is beneficial to query an abnormal processing flow, and thus, a flow test and a transmission problem may be located more easily.
In the embodiment of the invention, the network data of the preset structure body is sent through the DPDK, the preset structure body is an Mbuf data structure body, then a preset function area in the Mbuf data structure body is obtained, wherein the function area is provided with a tracking control node and a plurality of acquisition nodes, the tracking control node is provided with a state identifier, when the tracking control node is in a starting state, log data are generated according to the network data acquired by the acquisition nodes, and then a processing path aiming at the network data is generated according to the log data, so that the network data is transmitted in a preset structure body mode, and the path of data processing is recorded in the function area of the preset structure body by combining the characteristics of the preset structure body, so that the data tracking can be realized, the analysis process of the transmitted data is greatly simplified, and the processing efficiency of the network data problem is improved.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 3, a block diagram of a structure of an embodiment of a DPDK-based network data processing apparatus according to the present invention is shown, which may specifically include the following modules:
a data sending module 301, configured to send network data of a preset structure through the DPDK, where the preset structure is an Mbuf data structure;
a functional area obtaining module 302, configured to obtain a preset functional area in the Mbuf data structure, where the functional area has a tracking control node and a plurality of acquisition nodes, and the tracking control node has a state identifier;
a log data generating module 303, configured to generate log data according to the network data acquired by the acquisition node when the tracking control node is in a start state;
A data processing module 304, configured to generate a processing path for the network data according to the log data.
In an optional embodiment of the present invention, the log data generating module may include:
a domain position obtaining submodule, configured to obtain a domain position of the network data processing node;
the setting information generation submodule is used for generating setting information by adopting the domain position through the acquisition node;
and the log generation submodule is used for generating the log data by adopting the set information through the tracking control node when the network data is handed out from the functional area.
In an optional embodiment of the present invention, the functional area further has a presentation control node, and the presentation control node has a state identifier, and the apparatus may further include:
and the data display module is used for acquiring trace information matched with the set information through the display control node and displaying the trace information when the display control node is in a starting state, wherein the trace information comprises at least one of a source IP, a destination IP, a protocol number and a length.
In an optional embodiment of the present invention, the data processing module may include:
The mapping relation obtaining submodule is used for obtaining the mapping relation between the acquisition nodes and the functional areas, and the mapping relation comprises the sequence of the acquisition nodes;
and the path information generating submodule is used for generating path information aiming at the network data by adopting the log data and the mapping relation.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
An embodiment of the present invention further provides an apparatus, including:
one or more processors; and
one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the apparatus to perform methods as described in embodiments of the invention.
Embodiments of the invention also provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the methods described in embodiments of the invention.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The network data processing method based on the DPDK and the network data processing apparatus based on the DPDK provided by the present invention are described in detail, and a specific example is applied in the text to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A DPDK-based network data processing method is characterized by comprising the following steps:
sending network data of a preset structure body through the DPDK, wherein the preset structure body is an Mbuf data structure body;
acquiring a preset functional area in the Mbuf data structure body, wherein the functional area is provided with a tracking control node and a plurality of acquisition nodes, and the tracking control node is provided with a state identifier;
when the tracking control node is in a starting state, generating log data according to the network data acquired by the acquisition node;
and generating a processing path aiming at the network data according to the log data.
2. The method according to claim 1, wherein the generating log data according to the network data collected by the collection node when the tracking control node is in the startup state comprises:
acquiring the domain position of the network data processing node;
generating set information by the acquisition node by adopting the domain position;
and when the network data is handed out from the functional area, generating the log data by adopting the set information through the tracking control node.
3. The method of claim 2, wherein the functional area further has a show control node having a status identifier, the method further comprising:
And when the display control node is in a starting state, acquiring trace information adapted to the set information through the display control node, and displaying the trace information, wherein the trace information comprises at least one of a source IP, a destination IP, a protocol number and a length.
4. The method of claim 1, wherein generating a processing path for the network data from the log data comprises:
acquiring a mapping relation between the acquisition nodes and the functional areas, wherein the mapping relation comprises the sequence of the acquisition nodes;
and generating path information aiming at the network data by adopting the log data and the mapping relation.
5. A DPDK-based network data processing apparatus, comprising:
the data transmission module is used for transmitting network data of a preset structure body through the DPDK, wherein the preset structure body is an Mbuf data structure body;
the functional area acquisition module is used for acquiring a preset functional area in the Mbauf data structure body, the functional area is provided with a tracking control node and a plurality of acquisition nodes, and the tracking control node is provided with a state identifier;
The log data generation module is used for generating log data according to the network data acquired by the acquisition node when the tracking control node is in a starting state;
and the data processing module is used for generating a processing path aiming at the network data according to the log data.
6. The apparatus of claim 5, wherein the log data generation module comprises:
a domain position obtaining submodule, configured to obtain a domain position of the network data processing node;
the setting information generation submodule is used for generating setting information by adopting the domain position through the acquisition node;
and the log generation submodule is used for generating the log data by adopting the set information through the tracking control node when the network data is handed out from the functional area.
7. The apparatus of claim 6, wherein the functional area further has a show control node having a status identifier, the apparatus further comprising:
and the data display module is used for acquiring trace information matched with the set information through the display control node and displaying the trace information when the display control node is in a starting state, wherein the trace information comprises at least one of a source IP, a destination IP, a protocol number and a length.
8. The apparatus of claim 5, wherein the data processing module comprises:
the mapping relation obtaining submodule is used for obtaining the mapping relation between the acquisition nodes and the functional areas, and the mapping relation comprises the sequence of the acquisition nodes;
and the path information generating submodule is used for generating path information aiming at the network data by adopting the log data and the mapping relation.
9. An apparatus, comprising:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of one or more of claims 1-4.
10. One or more machine readable media having instructions stored thereon that, when executed by one or more processors, cause the processors to perform the method of one or more of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910364260.XA CN111859062B (en) | 2019-04-30 | 2019-04-30 | Network data processing method and device based on DPDK |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910364260.XA CN111859062B (en) | 2019-04-30 | 2019-04-30 | Network data processing method and device based on DPDK |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111859062A true CN111859062A (en) | 2020-10-30 |
| CN111859062B CN111859062B (en) | 2023-09-22 |
Family
ID=72965143
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910364260.XA Active CN111859062B (en) | 2019-04-30 | 2019-04-30 | Network data processing method and device based on DPDK |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111859062B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112583722A (en) * | 2021-02-26 | 2021-03-30 | 紫光恒越技术有限公司 | Data processing method and device, cloud equipment and storage equipment |
| CN115242895A (en) * | 2022-07-19 | 2022-10-25 | 杭州迪普科技股份有限公司 | DPDK-based local access method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140310391A1 (en) * | 2013-04-16 | 2014-10-16 | Amazon Technologies, Inc. | Multipath routing in a distributed load balancer |
| CN107257352A (en) * | 2017-08-02 | 2017-10-17 | 赛尔网络有限公司 | The Redirectional system and method for URL certifications based on DPDK |
| CN108270676A (en) * | 2016-12-31 | 2018-07-10 | 普天信息技术有限公司 | A kind of network data processing method and device based on IntelDPDK |
| CN108366018A (en) * | 2017-01-26 | 2018-08-03 | 普天信息技术有限公司 | A kind of processing method of network data packets based on DPDK |
| CN108881425A (en) * | 2018-06-07 | 2018-11-23 | 中国科学技术大学 | A kind of data package processing method and system |
-
2019
- 2019-04-30 CN CN201910364260.XA patent/CN111859062B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140310391A1 (en) * | 2013-04-16 | 2014-10-16 | Amazon Technologies, Inc. | Multipath routing in a distributed load balancer |
| CN108270676A (en) * | 2016-12-31 | 2018-07-10 | 普天信息技术有限公司 | A kind of network data processing method and device based on IntelDPDK |
| CN108366018A (en) * | 2017-01-26 | 2018-08-03 | 普天信息技术有限公司 | A kind of processing method of network data packets based on DPDK |
| CN107257352A (en) * | 2017-08-02 | 2017-10-17 | 赛尔网络有限公司 | The Redirectional system and method for URL certifications based on DPDK |
| CN108881425A (en) * | 2018-06-07 | 2018-11-23 | 中国科学技术大学 | A kind of data package processing method and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112583722A (en) * | 2021-02-26 | 2021-03-30 | 紫光恒越技术有限公司 | Data processing method and device, cloud equipment and storage equipment |
| CN112583722B (en) * | 2021-02-26 | 2021-05-28 | 紫光恒越技术有限公司 | Data processing method and device, cloud equipment and storage equipment |
| CN115242895A (en) * | 2022-07-19 | 2022-10-25 | 杭州迪普科技股份有限公司 | DPDK-based local access method and device |
| CN115242895B (en) * | 2022-07-19 | 2023-04-18 | 杭州迪普科技股份有限公司 | DPDK-based local access method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111859062B (en) | 2023-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7903555B2 (en) | Packet tracing | |
| US9176848B2 (en) | Program debugger and program debugging | |
| CN109829287A (en) | Api interface permission access method, equipment, storage medium and device | |
| CN109766176B (en) | Scanning progress calculation method and device based on large-scale network space detection | |
| TW201331779A (en) | Program analysis/verification service providing system, method for controlling system, control program, control program for causing computer to operate, program analysis/verification device and program analysis/verification tool management device | |
| JP2009017298A (en) | Data analysis apparatus | |
| CN110413594A (en) | A kind of more example method for testing pressure of Redis and device | |
| CN111859062A (en) | DPDK-based network data processing method and device | |
| CN110825731A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN105592169A (en) | Terminal identification method and terminal identification device | |
| KR20170028218A (en) | Commucation device providing dynamic modbus protocol mapping | |
| CN110874216B (en) | Complete code generation method, device, equipment and storage medium | |
| CN113055420B (en) | HTTPS service identification method and device and computing equipment | |
| CN113360413A (en) | Code testing method and device | |
| CN106875765B (en) | Electronic classroom implementation method and device based on VDI | |
| CN114531345A (en) | Method, device and equipment for storing flow comparison result and storage medium | |
| CN116346649A (en) | Virtual service packet grabbing method and device of load balancing equipment | |
| CN116962348A (en) | Domain name resolution-based video flow processing method, system and electronic equipment | |
| US20160328200A1 (en) | Testing screens of a multi-screen device | |
| CN111651330B (en) | Data acquisition method, data acquisition device, electronic equipment and computer readable storage medium | |
| US11729246B2 (en) | Apparatus and method for determining types of uniform resource locator | |
| CN112181670B (en) | Inter-process communication method and device and Linux equipment | |
| Tang et al. | Internet of things security: Principles and practice | |
| US20090177928A1 (en) | Apparatus, Method and Computer Program Product for Generating Trace Data | |
| CN113626295A (en) | Pressure measurement data processing method and system and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |