CN113055243B - DPI interface data processing method and device - Google Patents
DPI interface data processing method and device Download PDFInfo
- Publication number
- CN113055243B CN113055243B CN202110124003.6A CN202110124003A CN113055243B CN 113055243 B CN113055243 B CN 113055243B CN 202110124003 A CN202110124003 A CN 202110124003A CN 113055243 B CN113055243 B CN 113055243B
- Authority
- CN
- China
- Prior art keywords
- data
- call ticket
- ticket data
- initial call
- initial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/02—Capturing of monitoring data
- H04L43/028—Capturing of monitoring data by filtering
Abstract
The invention discloses a DPI interface data processing method and a device, wherein the method comprises the following steps: obtaining DPI interface data; carrying out format conversion on the DPI interface data to obtain initial call ticket data; determining an interface type corresponding to the initial call ticket data; distributing the initial call ticket data to at least one synthetic association program according to the interface type, a preset area correspondence table and a preset distribution rule, so that the at least one synthetic association program generates target call ticket data based on the initial call ticket data; and outputting the target call ticket data. The invention can balance the data processing effect of the DPI interface with high flow and the hardware cost.
Description
Technical Field
The invention relates to the technical field of mobile communication, in particular to a DPI interface data processing method and device.
Background
At present, a DPI (Deep Packet Inspection) technology can implement various requirements such as service analysis and virus filtering by performing Inspection analysis on traffic and message content at key points of a network.
However, in practice it has been found that there are peak periods of traffic in the field of mobile communications. Data processing needs to be performed on high-flow DPI interface data in these periods, and a good processing effect needs to be achieved. In this case, the number of servers is often increased, so that a large number of servers can process a huge data stream. However, this process requires a high hardware cost.
In summary, how to balance the data processing effect of the DPI interface with high throughput and the hardware cost becomes a problem that needs to be solved urgently.
Disclosure of Invention
In view of the defects in the prior art, an object of the present invention is to provide a method and an apparatus for data processing of a DPI interface, so as to balance at least the data processing effect of a high-throughput DPI interface and the hardware cost.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
a DPI interface data processing method comprises the following steps: obtaining DPI interface data; carrying out format conversion on the DPI interface data to obtain initial call ticket data; determining an interface type corresponding to the initial call ticket data; distributing the initial call ticket data to at least one synthesis association program according to the interface type, a preset area corresponding table and a preset distribution rule; the at least one synthesis association program generates target call ticket data based on the initial call ticket data; and outputting the target call ticket data.
Further, after the step of performing format conversion on the DPI interface data to obtain the initial ticket data, the method further includes: configuring an initial call ticket catalog corresponding to the initial call ticket data; scanning the initial call ticket catalog according to a preset scanning period, detecting whether the initial call ticket data corresponding to the initial call ticket catalog meets a preset data condition, and reading the initial call ticket data if the initial call ticket data meets the preset data condition.
Further, the step of determining the interface type corresponding to the initial call ticket data includes: and determining the interface type corresponding to the initial call ticket data according to the first specified field in the initial call ticket data.
Further, the step of distributing the initial ticket data to at least one synthetic association program according to the interface type, a preset area mapping table and a preset distribution rule includes: determining the position information of the second designated field according to the interface type; searching an area corresponding to the position information in the area corresponding table to be used as an area where the initial call ticket data is located; determining at least one synthesis association program corresponding to the area where the initial call bill data is located according to the distribution rule; and distributing the records in the initial call ticket data to the at least one synthetic correlation program one by one.
Further, after the step of distributing the initial ticket data to at least one synthetic association program according to the interface type, a preset area mapping table and a preset distribution rule, so that the at least one synthetic association program generates target ticket data based on the initial ticket data, the method further includes: and performing format unification processing on the target call ticket data to update the target call ticket data.
According to another aspect of the embodiments of the present invention, there is also provided a DPI interface data processing apparatus, including: a data acquisition unit configured to acquire DPI interface data; the format conversion unit is configured to perform format conversion on the DPI interface data to obtain initial call ticket data; the type determining unit is configured to determine an interface type corresponding to the initial call ticket data; the distribution control unit is configured to distribute the initial ticket data to at least one synthesis association program according to the interface type, a preset area corresponding table and a preset distribution rule; a data generating unit configured to generate target call ticket data based on the initial call ticket data by the at least one synthetic correlation program; and the data output unit is configured to output the target ticket data.
Further, the above apparatus further comprises: the catalog configuration unit is configured to configure a corresponding initial call ticket catalog according to the initial call ticket data provided by the format conversion unit; and the scanning and reading unit is configured to scan the initial call ticket catalog according to a preset scanning period, detect whether the initial call ticket data corresponding to the initial call ticket catalog meets a preset data condition, and read the initial call ticket data if the initial call ticket data meets the preset data condition.
Further, the type determination unit is further configured to: and determining the interface type corresponding to the initial call ticket data according to the first specified field in the initial call ticket data.
Further, the above-mentioned distribution control unit is further configured to: determining the position information of the second designated field according to the interface type; searching an area corresponding to the position information in the area corresponding table to be used as an area where the initial call ticket data is located; determining at least one synthesis association program corresponding to the area where the initial call bill data is located according to the distribution rule; and distributing the records in the initial call ticket data to the at least one synthetic correlation program one by one.
Further, the above apparatus further comprises: and the data updating unit is configured to distribute the initial call ticket data to at least one synthesis association program according to the interface type, a preset area correspondence table and a preset distribution rule, so that after the target call ticket data is generated by the at least one synthesis association program based on the initial call ticket data, the target call ticket data is subjected to format unified processing to update the target call ticket data.
According to another aspect of the embodiments of the present invention, there is also provided a DPI interface data processing apparatus, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the DPI interface data processing method through the computer program.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, where the computer program is configured to execute the DPI interface data processing method when the computer program runs.
The invention has the following effects: by adopting the method, the DPI interface data with high flow can be distributed to at least one synthesis association program on the basis of not increasing the number of servers, and the data processing is carried out based on multithreading of each synthesis association program, so that the probability of data accumulation is reduced, the data processing effect is improved, and the data processing effect of the DPI interface data with high flow and the hardware cost are balanced.
Drawings
Fig. 1 is a flow chart of an alternative DPI interface data processing method according to an embodiment of the present invention;
figure 2 is a schematic diagram of an alternative DPI interface data processing method according to an embodiment of the present invention;
figure 3 is a schematic diagram of an alternative DPI interface data processing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an alternative DPI interface data processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical problems solved, the technical solutions adopted, and the technical effects achieved by the present invention clearer, the technical solutions of the embodiments of the present invention will be further described in detail with reference to the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
An embodiment of the present invention provides an optional DPI interface data processing method, and as shown in fig. 1, the DPI interface data processing method includes:
s101, DPI interface data are obtained.
In the embodiment of the invention, the execution main body (the electronic equipment such as the server and the like) can acquire the real-time signaling flow of each DPI interface by operating the signaling acquisition program. The real-time signaling flow of each DPI interface is also the DPI interface data. And the signaling acquisition program is used for converting the acquired real-time signaling stream into initial call ticket data with a specific format and performing floor processing on the initial call ticket data to obtain a floor call ticket.
And S102, carrying out format conversion on the DPI interface data to obtain initial call ticket data.
In the embodiment of the invention, the execution main body can perform signaling analysis on the DPI interface data (namely, the real-time signaling flow of each DPI interface) and complete format conversion to obtain the initial call ticket data with a specific format.
S103, determining the interface type corresponding to the initial call ticket data.
In the embodiment of the invention, the execution main body can identify the specified field in the initial call ticket data and acquire the interface type corresponding to the specified field.
As an optional implementation manner, after the step of performing format conversion on the DPI interface data to obtain the initial ticket data, the following steps may be further performed: configuring an initial call ticket catalog corresponding to the initial call ticket data; scanning an initial call ticket catalog according to a preset scanning period; and reading the initial call ticket data in response to the detection that the initial call ticket data meets the preset data condition.
In this implementation manner, the number of the initial list of tickets may be 1, or may be multiple, and is not limited herein. Further, the preset scanning period may be used to scan the initial ticket directory according to the scanning period, for example, when the scanning period is 5 seconds, the initial ticket directory may be scanned every five seconds. The method includes the steps that information of initial call ticket data can be obtained in the process of scanning the initial call ticket catalog, for example, the number of files and/or the size of the files of the initial call ticket data can be obtained, and the preset data condition is that the number of the files is larger than the preset number and/or the size of the files is larger than the preset size. And in response to the detection that the initial call ticket data meets the preset data condition, reading the initial call ticket data. Optionally, the name corresponding to the initial call ticket data may be obtained first, and after the interface type corresponding to the initial call ticket data is determined based on the name, the above steps may be performed to read the initial call ticket data. Further optionally, in the process of reading the initial call ticket data, each call ticket record in the initial call ticket data can be segmented.
By implementing the optional implementation mode, the initial call ticket data can be stored by setting different initial call ticket catalogues, and the data storage load is reduced. Furthermore, the initial ticket data can be efficiently read by setting a reasonable scanning period and data conditions and combining data processing capacity, and the data reading effect is improved.
As another optional implementation manner, the step of determining the interface type corresponding to the initial ticket data includes: and determining the interface type corresponding to the initial call ticket data according to the first specified field in the initial call ticket data.
In this implementation manner, the first specified field is a preset field for labeling an interface type, for example, when the name of the initial ticket data is "a _ IuCS-00083_1_2. Csv", the first specified field is "IuCS-00083", and based on the first specified field, the determined interface type is "IuCS". By implementing the optional implementation mode, the interface type can be determined by using field analysis, and the convenience of the interface type is improved.
And S104, distributing the initial call ticket data to at least one synthesis association program according to the interface type, the preset area corresponding table and the preset distribution rule.
In the embodiment of the invention, the corresponding relation between the designated field and the area is correspondingly stored in the preset area corresponding table. The preset distribution rule can dynamically regulate and control the synthetic association program distributed by the record in each initial call ticket data. The preset distribution rule may allocate the call tickets in different areas to different synthetic association programs for processing, and may also allocate the call tickets in different areas to the same synthetic association program for processing, which is not limited in the embodiment of the present invention.
As an optional implementation manner, the step of distributing the initial ticket data to at least one synthetic association program according to the interface type, the preset area mapping table and the preset distribution rule includes: determining the position information of the second specified field according to the interface type; searching a region corresponding to the position information in the region corresponding table, and taking the region as a region where the initial call ticket data is located; determining at least one synthetic association program corresponding to the area where the initial call ticket data is located according to a distribution rule; and distributing the records in the initial call ticket data to at least one synthesis association program one by one.
In this implementation manner, the step of distributing the initial ticket data to at least one synthetic association program may specifically be: the method comprises the steps of firstly determining the position information of a second specified field of each interface according to the interface type, wherein the second specified field is ECI and/or LAC, for example, the ECI field of a CALL CALL list of the IuCS interface type is 87, the LAC field is 86, the ECI field of an SMS CALL list is 53, and the LAC field is 52. The corresponding relation between each position information and the area can be stored in the area corresponding table, and the searched area can be used as the area where the initial call ticket data is located by searching the area corresponding to the position information in the area corresponding table. Furthermore, the distribution rule may store a corresponding relationship between the area where each initial call ticket data is located and the synthetic association program, and according to the corresponding relationship, each initial call ticket data may be distributed to the corresponding synthetic association program. Optionally, the distribution rule may store, in a finer granularity, a correspondence between an area where each record in each initial ticket data is located and the synthetic association program, and according to the correspondence, each record in each initial ticket data may be distributed to the corresponding synthetic association program.
By implementing the optional implementation mode, the specified area can be determined according to the interface type and the area corresponding table, and then records in the initial ticket data are distributed to at least one synthetic associated program corresponding to the specified area one by one for carrying out data processing in a multi-thread manner by utilizing each synthetic associated program, so that the probability of data accumulation is reduced, the data processing effect is improved, and the high-flow DPI interface data processing effect and the hardware cost are balanced.
As another optional implementation manner, after the step of distributing the initial ticket data to at least one synthetic association program according to the interface type, the preset area mapping table, and the preset distribution rule, so that the at least one synthetic association program generates the target ticket data based on the initial ticket data, the following steps may be further performed: and carrying out format unification processing on the target call ticket data so as to update the target call ticket data.
And S105, generating target call ticket data by at least one synthesis association program based on the initial call ticket data.
In the implementation mode, the synthesis association program can carry out synthesis, association and backfill operations on the distributed data, and then carry out format unified processing on the data after the operations are carried out, and the target ticket data is obtained by updating. Optionally, the format of the data after the above operations are performed may be processed uniformly, so as to generate XDR target ticket data. By implementing the optional implementation mode, the format unified processing of the target call ticket data can be realized, and the data uniformity is improved.
And S106, outputting the target call ticket data.
Referring to fig. 2, fig. 2 is a schematic diagram of an alternative DPI interface data processing method according to an embodiment of the present invention. As shown in fig. 2, the signaling collection program may receive signaling flows of each DPI interface, perform signaling analysis on the signaling flows, and complete format conversion, thereby obtaining initial ticket data. And then putting the initial call ticket data into a storage directory 1, a storage directory 2, a storage directory 3 and a storage directory n, and periodically scanning the storage directories to acquire the number of files and/or the size of the initial call ticket data in each directory. Then, the corresponding interface type can be determined based on the name of the initial call ticket data. Then, based on the interface type of the call ticket, identifying the position information of ECI and/or LAC fields, based on a preset area corresponding table, searching an area corresponding to the position information, determining the area as the area to which the initial call ticket data belongs, forwarding the call ticket according to a preset rule, and forwarding the call ticket to a synthesis association program 1, a synthesis association program 2, a synthesis association program 3, a synthesis association program 4 and a synthesis association program n. And (4) the step 1, the step 2, the step 3 and the step 4 are repeatedly executed, so that the distribution processing of the ticket data can be realized.
For example, the method can be applied to a 4G DPI system, and it is assumed that the system is composed of 7 acquisition servers and 3 associated synthesis servers, where S11 port, S1-U port, and S11-U port in a DPI interface are high-traffic DPI interfaces, and the DPI interface data processing method in the embodiment of the present invention is adopted for the 3 interfaces to perform data processing based on a multithreading manner. First, 2 synthesis association programs corresponding to the S11 port may be configured, 5 synthesis association programs are used for the S1U port and the S11-U ports, respectively, and 1 synthesis association program is used for the remaining interfaces. Secondly, a program can be configured to realize scanning of the directory, the scanning time limit can be configured to be 5 seconds, and the distribution starting threshold can be configured according to the number of files, for example, the threshold of the port S11 is 5, the threshold of the port S1-U is 10, and the threshold of the port S11-U is 5. And then, according to fields in the floor file name of the initial call ticket data, such as S6a, S11, S1U, sgs and the like, identifying the interface type, and segmenting each record in the initial call ticket data. Then, according to a preset area correspondence table and according to the file interface type, determining fields of the ECI and the LAC in the ticket file, such as: the ECI field of CALL CALL ticket of IUCS interface is 87 th, and the LAC field is 86 th; the ECI field of the SMS ticket is 53 th, and the LAC field is 52 th. And according to the area corresponding table, completing the area identification of each record in the initial call ticket data. Then, according to a preset distribution rule, distributing the S11 call ticket with the area A to a synthesis association program 1 for processing, and distributing the call tickets of other areas to a synthesis association thread 2 for processing; distributing the S1U ticket with the area A to an association program 3 for processing, distributing the S1U ticket with the area B to an association program 4 for processing, and distributing the S1U ticket with the area C, D to a synthesis association program 5 for processing; and distributing the S1U call ticket with the area of E, F, G to a synthesis association program 6 for processing, and distributing the S1U call tickets in other areas to a synthesis association program 7 for processing. And S11, the call ticket of the relevant city is distributed to 5 synthesis association programs for processing according to the mode. And the distribution program completes the distribution of each record in each initial ticket data in the 3 interfaces according to the distribution rule. Optionally, 20M may be used as a threshold to complete the cutting and landing of a single initial call ticket data. Further optionally, a new associated thread may be formed at any time according to the actual field traffic, and a distribution rule may be configured. Finally, the distributed files are synthesized, associated and backfilled through a synthesis association program, and the synthesized and associated files are uniformly formatted through a formatting output program to finally generate an XDR (X digital document) ticket file.
By adopting the method of the embodiment of the invention, high-flow DPI interface data can be distributed to at least one synthesis association program on the basis of not increasing the number of servers, and data processing is carried out based on multithreading of each synthesis association program, so that the probability of data accumulation is reduced, the data processing effect is improved, and the balance between the high-flow DPI interface data processing effect and the hardware cost is realized.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
According to another aspect of the embodiments of the present invention, there is also provided a DPI interface data processing apparatus for implementing the DPI interface data processing method, as shown in fig. 3, including:
a data acquiring unit 301 configured to acquire DPI interface data.
In the embodiment of the invention, the real-time signaling flow of each DPI interface can be acquired by operating a signaling acquisition program. The real-time signaling flow of each DPI interface is also the DPI interface data. And the signaling acquisition program is used for converting the acquired real-time signaling stream into initial call ticket data with a specific format and performing floor processing on the initial call ticket data to obtain a floor call ticket.
The format conversion unit 302 is configured to perform format conversion on the DPI interface data to obtain initial ticket data.
In the embodiment of the invention, the DPI interface data (namely the real-time signaling flow of each DPI interface) can be subjected to signaling analysis and format conversion is completed, so that the initial call ticket data with a specific format is obtained.
A type determining unit 303 configured to determine an interface type corresponding to the initial ticket data.
In the embodiment of the invention, the designated field in the initial call ticket data can be identified, and the interface type corresponding to the designated field can be obtained.
And the distribution control unit 304 is configured to distribute the initial ticket data to at least one synthesis association program according to the interface type, a preset area correspondence table and a preset distribution rule.
A data generating unit 305 configured to generate target ticket data based on the initial ticket data by at least one synthetic correlation procedure.
In the embodiment of the invention, the corresponding relation between the designated field and the area is correspondingly stored in the preset area corresponding table. The preset distribution rule can dynamically regulate and control the synthetic association program distributed by the record in each initial call ticket data. The preset distribution rule may allocate the call tickets in different areas to different synthetic association programs for processing, and may also allocate the call tickets in different areas to the same synthetic association program for processing, which is not limited in the embodiment of the present invention.
A data output unit 306 configured to output the target ticket data.
As an optional implementation, the apparatus further includes: a directory configuration unit configured to configure an initial call ticket directory corresponding to the initial call ticket data according to the initial call ticket data provided by the format conversion unit 302; and the scanning and reading unit is configured to scan the initial call ticket catalog according to a preset scanning period, detect whether the initial call ticket data corresponding to the initial call ticket catalog meets a preset data condition, and read the initial call ticket data if the initial call ticket data meets the preset data condition.
In this implementation manner, the number of the initial list of tickets may be 1, or may be multiple, and is not limited herein. Further, the preset scanning period may be used to scan the initial ticket directory according to the scanning period, for example, when the scanning period is 5 seconds, the initial ticket directory may be scanned every five seconds. The method includes the steps that information of initial call ticket data can be obtained in the process of scanning the initial call ticket catalog, for example, the number of files and/or the size of the files of the initial call ticket data can be obtained, and the preset data condition is that the number of the files is larger than the preset number and/or the size of the files is larger than the preset size. And reading the initial call ticket data in response to the detection that the initial call ticket data meets the preset data condition. Optionally, the name corresponding to the initial call ticket data may be obtained first, and after the interface type corresponding to the initial call ticket data is determined based on the name, the above steps may be performed to read the initial call ticket data. Further optionally, in the process of reading the initial call ticket data, each call ticket record in the initial call ticket data can be segmented.
As an optional implementation manner, the type determining unit 303 is further configured to: and determining the interface type corresponding to the initial call ticket data according to the first specified field in the initial call ticket data.
In this implementation manner, the first specified field is a preset field for labeling an interface type, for example, when the name of the initial ticket data is "a _ IuCS-00083_1_2. Csv", the first specified field is "IuCS-00083", and based on the first specified field, the determined interface type is "IuCS".
As an optional implementation, the distribution control unit 304 is further configured to: determining the position information of the second specified field according to the interface type; searching an area corresponding to the position information in the area corresponding table to be used as an area where the initial call ticket data is located; determining at least one synthesis association program corresponding to the area where the initial call bill data is located according to the distribution rule; and distributing the records in the initial call ticket data to the at least one synthetic correlation program one by one.
In this implementation manner, the step of distributing the initial ticket data to at least one synthetic association program may specifically be: the method comprises the steps of firstly determining the position information of a second specified field of each interface according to the interface type, wherein the second specified field is ECI and/or LAC, for example, the ECI field of a CALL CALL list of the IuCS interface type is 87, the LAC field is 86, the ECI field of an SMS CALL list is 53, and the LAC field is 52. The corresponding relation between each position information and the area can be stored in the area corresponding table, and the searched area can be used as the area where the initial call ticket data is located by searching the area corresponding to the position information in the area corresponding table. Furthermore, the distribution rule may store a corresponding relationship between the area where each initial call ticket data is located and the synthetic association program, and according to the corresponding relationship, each initial call ticket data may be distributed to the corresponding synthetic association program. Optionally, the distribution rule may store, in a finer granularity, a correspondence between an area where each record in each initial ticket data is located and the synthetic association program, and according to the correspondence, each record in each initial ticket data may be distributed to the corresponding synthetic association program.
As an optional implementation, the apparatus further includes: and the data updating unit is configured to distribute the initial call ticket data to at least one synthesis association program according to the interface type, a preset area correspondence table and a preset distribution rule, so that after the target call ticket data is generated by the at least one synthesis association program based on the initial call ticket data, the target call ticket data is subjected to format unified processing to update the target call ticket data.
In the implementation mode, the synthesis association program can carry out synthesis, association and backfill operations on the distributed data, and then carry out format unified processing on the data after the operations are carried out, and the target call ticket data is obtained by updating. Optionally, the format of the data after the above operations are performed may be processed uniformly, so as to generate XDR target ticket data.
By adopting the device provided by the embodiment of the invention, high-flow DPI interface data can be distributed to at least one synthesis association program on the basis of not increasing the number of servers, and data processing is carried out on the basis of multithreading of each synthesis association program, so that the probability of data accumulation is reduced, the data processing effect is improved, and the data processing effect and the hardware cost of the high-flow DPI interface data are balanced.
According to yet another aspect of an embodiment of the present invention, there is further provided a DPI interface data processing apparatus for implementing the DPI interface data processing method, as shown in fig. 4, the DPI interface data processing apparatus includes a memory 402 and a processor 404, the memory 402 stores therein a computer program, and the processor 404 is configured to execute the steps in any of the method embodiments described above through the computer program.
Optionally, in this embodiment, the DPI interface data processing device may be located in at least one network device of a plurality of network devices of a computer network.
Alternatively, in this embodiment, the processor may be configured to execute the DPI interface data processing method through a computer program.
Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 4 is only an illustration, and the DPI interface data processing device may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 4 is not intended to limit the structure of the DPI interface data processing apparatus.
The memory 402 may be configured to store software programs and modules, and the processor 404 executes various functional applications and data processing by running the software programs and modules stored in the memory 402, so as to implement the DPI interface data processing method described above. The memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. The memory 402 may further include a memory remotely located from the processor 404, wherein the memory 402 may be particularly, but not exclusively, used to store information such as operational instructions. As an example, as shown in fig. 4, the memory 402 may include, but is not limited to, a data acquisition unit 301, a format conversion unit 302, a type determination unit 303, a distribution control unit 304, a data generation unit 305, and a data output unit 306 in the DPI interface data processing apparatus.
Optionally, the transmission device 406 is used for receiving or sending data via a network. In addition, the DPI interface data processing apparatus further includes: a display 408 for displaying the display content; and a connection bus 410 for connecting the respective module components in the DPI interface data processing apparatus.
According to a further aspect of embodiments of the present invention, there is also provided a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above-mentioned method embodiments when executed.
Optionally, in this embodiment, all or part of the steps in the methods of the foregoing embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, read-Only memories (ROMs), random Access Memories (RAMs), magnetic or optical disks, and the like.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in the above computer-readable storage medium. Based on such understanding, the technical solution of the present invention may be substantially or partially implemented in the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, and including instructions for causing one or more computer devices (which may be personal computers, servers, or network devices) to execute all or part of the steps of the method according to the embodiments of the present invention.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be appreciated by those skilled in the art that the system and method of the present invention is not limited to the embodiments described in the detailed description, and that the foregoing detailed description is for the purpose of illustrating the invention and is not to be taken in a limiting sense. Other embodiments will be apparent to those skilled in the art from the following detailed description, which are also included in the scope of the invention as defined in the appended claims.
Claims (8)
1. A DPI interface data processing method is characterized by comprising the following steps:
obtaining DPI interface data;
carrying out format conversion on the DPI interface data to obtain initial call ticket data;
determining an interface type corresponding to the initial call ticket data;
distributing the initial call ticket data to at least one synthesis association program according to the interface type, a preset area corresponding table and a preset distribution rule;
the at least one synthetic correlation program generates target call ticket data based on the initial call ticket data;
outputting the target call ticket data;
after the step of performing format conversion on the DPI interface data to obtain initial ticket data, the method further includes:
configuring an initial call ticket catalog corresponding to the initial call ticket data;
scanning the initial call ticket catalog according to a preset scanning period, detecting whether the initial call ticket data corresponding to the initial call ticket catalog meets a preset data condition, and reading the initial call ticket data if the initial call ticket data meets the preset data condition;
the step of distributing the initial call ticket data to at least one synthesis association program according to the interface type, a preset area corresponding table and a preset distribution rule comprises the following steps:
determining the position information of the second specified field according to the interface type;
searching an area corresponding to the position information in the area corresponding table to be used as an area where the initial call ticket data is located;
determining at least one synthetic association program corresponding to the area where the initial call ticket data is located according to the distribution rule;
and distributing the records in the initial call ticket data to the at least one synthetic correlation program one by one.
2. The DPI interface data processing method of claim 1, wherein the step of determining the interface type corresponding to the initial ticket data comprises:
and determining the interface type corresponding to the initial call ticket data according to a first designated field in the initial call ticket data.
3. The DPI interface data processing method according to claim 1, wherein after the step of distributing the initial ticket data to at least one synthetic association program according to the interface type, a preset area mapping table and a preset distribution rule, so that the at least one synthetic association program generates target ticket data based on the initial ticket data, the DPI interface data processing method further comprises:
and carrying out format unification processing on the target call ticket data so as to update the target call ticket data.
4. A DPI interface data processing apparatus for performing data processing by using the DPI interface data processing method according to any of claims 1 to 3, comprising:
a data acquisition unit configured to acquire DPI interface data;
the format conversion unit is configured to perform format conversion on the DPI interface data to obtain initial call ticket data;
a type determining unit configured to determine an interface type corresponding to the initial ticket data;
the distribution control unit is configured to distribute the initial call ticket data to at least one synthesis association program according to the interface type, a preset area corresponding table and a preset distribution rule;
a data generation unit configured to generate target call ticket data based on the initial call ticket data by the at least one synthetic correlation program;
and the data output unit is configured to output the target ticket data.
5. A DPI interface data processing device according to claim 4, further comprising:
the catalog configuration unit is configured to configure a corresponding initial call ticket catalog according to the initial call ticket data provided by the format conversion unit;
and the scanning and reading unit is configured to scan the initial call ticket catalog according to a preset scanning period, detect whether the initial call ticket data corresponding to the initial call ticket catalog meets a preset data condition, and read the initial call ticket data if the initial call ticket data meets the preset data condition.
6. A DPI interface data processing device according to claim 5, wherein the type determination unit is further configured to:
and determining the interface type corresponding to the initial call ticket data according to a first designated field in the initial call ticket data.
7. A DPI interface data processing device according to claim 6, wherein the distribution control unit is further configured to:
determining the position information of the second specified field according to the interface type;
searching an area corresponding to the position information in the area corresponding table to be used as an area where the initial call ticket data is located;
determining at least one synthetic association program corresponding to the area where the initial call ticket data is located according to the distribution rule;
and distributing the records in the initial call ticket data to the at least one synthetic correlation program one by one.
8. A DPI interface data processing device according to claim 6, further comprising:
and the data updating unit is configured to distribute the initial call ticket data to at least one synthetic association program according to the interface type, a preset area correspondence table and a preset distribution rule, so that after the target call ticket data is generated by the at least one synthetic association program based on the initial call ticket data, the target call ticket data is subjected to format unified processing to update the target call ticket data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110124003.6A CN113055243B (en) | 2021-01-29 | 2021-01-29 | DPI interface data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110124003.6A CN113055243B (en) | 2021-01-29 | 2021-01-29 | DPI interface data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113055243A CN113055243A (en) | 2021-06-29 |
| CN113055243B true CN113055243B (en) | 2023-01-13 |
Family
ID=76508342
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110124003.6A Active CN113055243B (en) | 2021-01-29 | 2021-01-29 | DPI interface data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113055243B (en) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2538931B (en) * | 2014-03-27 | 2021-08-25 | Pismo Labs Technology Ltd | Methods and systems for identifying data sessions at a VPN gateway |
| CN111372209B (en) * | 2018-12-06 | 2022-04-08 | 中国移动通信集团辽宁有限公司 | Signaling data processing method, device, equipment and medium |
| CN111950657B (en) * | 2020-08-26 | 2021-05-18 | 上海数鸣人工智能科技有限公司 | DPI clustering and user expansion method |
-
2021
- 2021-01-29 CN CN202110124003.6A patent/CN113055243B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113055243A (en) | 2021-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829560B (en) | Data monitoring method and device, computer equipment and storage medium | |
| CN107040578B (en) | Data synchronization method, device and system | |
| CN113987074A (en) | Distributed service full-link monitoring method and device, electronic equipment and storage medium | |
| CN109981322B (en) | Method and device for cloud resource management based on label | |
| CN108632111A (en) | Service link monitoring method based on log | |
| CN110928851B (en) | Method, device and equipment for processing log information and storage medium | |
| CN109858441A (en) | A kind of monitoring abnormal state method and apparatus for construction site | |
| CN110928934A (en) | Data processing method and device for business analysis | |
| CN110780950B (en) | Interface metadata management method, device, computer equipment and storage medium | |
| CN109802842B (en) | Application topology generation method and related equipment | |
| CN113360413A (en) | Code testing method and device | |
| CN113055243B (en) | DPI interface data processing method and device | |
| CN112445861B (en) | Information processing method, device, system and storage medium | |
| CN114564856B (en) | Data sharing method based on FMEA and electronic equipment | |
| CN116204540A (en) | Operation log recording method, device, equipment and storage medium | |
| CN111092883B (en) | Method and device for automatically generating user access record, network equipment and storage medium | |
| CN113434585B (en) | Resource preservation method and equipment | |
| CN111030874B (en) | Service arranging method, equipment, storage medium and device | |
| CN113239251A (en) | Processing method of buried point data, related device and storage medium | |
| CN102521717A (en) | Method and device for carrying out statistics on configuration management resource library information | |
| CN113486222A (en) | Display method of power data display interface, user terminal, server and system | |
| CN113468446A (en) | Method, system and equipment for supporting identification of third-party two-dimensional code data | |
| CN114860847B (en) | Data link processing method, system and medium applied to big data platform | |
| CN113342861B (en) | Data management method and device in service scene | |
| CN113326004B (en) | Efficient log centralization method and device in cloud computing environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |