CN113691631B - Data cleaning method and device and electronic equipment - Google Patents
Data cleaning method and device and electronic equipment Download PDFInfo
- Publication number
- CN113691631B CN113691631B CN202110992057.4A CN202110992057A CN113691631B CN 113691631 B CN113691631 B CN 113691631B CN 202110992057 A CN202110992057 A CN 202110992057A CN 113691631 B CN113691631 B CN 113691631B
- Authority
- CN
- China
- Prior art keywords
- parameter information
- preset list
- message parameter
- message
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000004140 cleaning Methods 0.000 title claims abstract description 29
- 238000003860 storage Methods 0.000 claims abstract description 38
- 238000004590 computer program Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 13
- 230000032683 aging Effects 0.000 claims description 2
- 238000013461 design Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 230000004083 survival effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
Abstract
A method, a device and an electronic device for cleaning data, wherein the method comprises the following steps: acquiring a storage time when first message parameter information of a first message is stored in a first preset list, determining a storage time length of the first message parameter information in the first preset list according to the acquired current time and the storage time, judging whether the storage time length exceeds a preset time length, deleting the first message parameter information in the first preset list if yes, and reserving the first message parameter information in the first preset list if no. By the method, a first preset list is set for storing keys and storing time of the keys, and the keys are ordered according to the sequence of the storing time of the keys, so that the keys which exceed the preset time are arranged in front of the queue, and in each period, the keys which exceed the preset time can be deleted in sequence according to the ordering of the keys by the first preset list, so that the consumption of gateway computing resources is reduced, and the performance of the gateway is improved.
Description
Technical Field
The present disclosure relates to the field of computer network security, and in particular, to a method and an apparatus for data cleaning, and an electronic device.
Background
Currently, an application layer gateway ALG includes a trust map table, an ACL, and a NAT, where the trust map table is used to store an IP address and a port number of an IP packet, the IP address and the port number are a key, the ACL policy and the NAT policy are information as a value, a key and a value form a key value pair, the trust map table is formed by a plurality of key value pairs, where the value records a time of storing the key and a time-out time, and the sum of the time of storing and the time-out time is used as a timestamp, and the time-out time is a survival time preset in the ALG by the IP address and the port number.
In each period of the ALG timing cleaning task, because all key value pairs are stored unordered in time, the timing cleaning task needs to traverse all key value pairs to finish cleaning the timed out key value pairs, and the timed out key value pairs are key value pairs exceeding the time stamp recording time, when the number of the key value pairs in the ALG reaches the millions, cleaning the timed out key value pairs continuously consumes a large amount of gateway computing resources, so that the gateway performance is greatly reduced.
Disclosure of Invention
The application provides a data cleaning method, a data cleaning device and electronic equipment, wherein a first preset list is added, so that the rule of first-in first-out of the first preset list is utilized, all keys are prevented from being traversed, the consumption of gateway computing resources is reduced, and the performance of a gateway is improved.
In a first aspect, the present application provides a method for data cleansing, the method comprising:
acquiring a first message parameter information of a first message, wherein the first message parameter comprises a first IP address and a first port number, and the first message parameter information is stored in a first preset list;
determining the time length of the first message parameter information stored in the first preset list according to the acquired current time and the storing time;
judging whether the storage time length exceeds a preset time length;
if yes, deleting the first message parameter information in the first preset list, and continuing to clean from the next arrangement position of the first message parameter information;
if not, the first message parameter information is reserved in the first preset list, and cleaning is restarted from the starting position of the first preset list.
According to the method and the device, the first preset list is added, each key stored in the first preset list corresponds to one storing time, in the first preset list, the keys are arranged according to the sequence of the storing time, the first key of the first preset list is circularly checked and deleted according to the preset period, and as only the first key of the first preset list is checked, all keys in the gateway are prevented from being traversed, the consumption of the gateway to computing resources is reduced, and the problem that the performance of the gateway is greatly reduced is solved.
In one possible design, before the storing time when the first message parameter information of the first message is obtained and stored in the first preset list, the method includes:
receiving a first message sent by a first client and analyzing first message parameter information of the first message;
storing the first message parameter information into the first preset list and the second preset list, and recording the storing time of the first message parameter information into the first preset list;
and arranging all message parameter information in the first preset list from first to last according to the stored time sequence.
In one possible design, storing the first message parameter information in the first preset list and the second preset list, and recording the time of storing the first message parameter information includes:
matching whether the second preset list has the message parameter information consistent with the first message parameter information or not;
if yes, no treatment is carried out;
if not, the first message parameter information is put into the first preset list and the second preset list.
In one possible design, the placing the first message parameter information into the first preset list includes:
sorting the first message in the first preset list according to the storing time of the first message parameter;
and storing the first message parameters into the first preset list according to the sorting.
In a second aspect, the present application provides an apparatus for data cleansing, the apparatus comprising:
the device comprises an acquisition module, a storage module and a storage module, wherein the acquisition module is used for acquiring the storage time when the first message parameter information of a first message is stored in a first preset list, and the first message parameter comprises a first IP address and a first port number;
the determining module is used for determining the time length of the first message parameter information stored in the first preset list according to the acquired current time and the storing time;
the judging module is used for judging whether the storage time length exceeds a preset time length;
the processing module is used for deleting the first message parameter information in the first preset list, continuing to clean from the next arrangement position of the first message parameter information or reserving the first message parameter information in the first preset list, and restarting to clean from the initial position of the first preset list.
In one possible design, the obtaining module is specifically configured to receive a first message sent by a first client, analyze first message parameter information of the first message, store the first message parameter information in the first preset list and the second preset list, record a time of storing the first message parameter information in the first preset list, and arrange all message parameter information in the first preset list from first to second according to a time sequence of storing.
In one possible design, the obtaining module is further configured to match whether there is message parameter information consistent with the first message parameter information in the second preset list, if so, not perform any processing, and if not, place the first message parameter information in the first preset list and place the first message parameter information in the second preset list.
In one possible design, the obtaining module is further configured to sort the first packet in the first preset list according to a time of storing the first packet parameter, and store the first packet parameter in the first preset list according to the sorting.
In a third aspect, the present application provides an electronic device, including:
a memory for storing a computer program;
and the processor is used for realizing the method steps of data cleaning when executing the computer program stored in the memory.
In a fourth aspect, a computer readable storage medium has stored therein a computer program which, when executed by a processor, performs the method steps of a data cleaning as described above.
The technical effects of each of the first to fourth aspects and the technical effects that may be achieved by each aspect are referred to above for the technical effects that may be achieved by the first aspect or the various possible aspects of the first aspect, and are not repeated here.
Drawings
FIG. 1 is a flowchart of method steps for data cleansing provided herein;
fig. 2 is a schematic structural diagram of a device for data cleaning provided in the present application;
fig. 3 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail with reference to the accompanying drawings. The specific method of operation in the method embodiment may also be applied to the device embodiment or the system embodiment. It should be noted that "a plurality of" is understood as "at least two" in the description of the present application. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. A is connected with B, and can be represented as follows: both cases of direct connection of A and B and connection of A and B through C. In addition, in the description of the present application, the words "first," "second," and the like are used merely for distinguishing between the descriptions and not be construed as indicating or implying a relative importance or order.
At present, when the application layer gateway ALG performs a cleaning task, all key value pairs are traversed, so that key value pairs exceeding a preset duration can be deleted, and when the number of key value pairs reaches a million level, the application layer gateway ALG consumes a large amount of computing resources, so that the gateway performance is greatly reduced, and therefore, the gateway performance is reduced to be solved.
In order to solve the above problems, an embodiment of the present application provides a method for cleaning data, which is used to reduce consumption of computing resources of a gateway and improve performance of the gateway. The method and the device according to the embodiments of the present application are based on the same technical concept, and because the principles of the problems solved by the method and the device are similar, the embodiments of the device and the method can be referred to each other, and the repetition is not repeated.
Embodiments of the present application are described in detail below with reference to the accompanying drawings.
Referring to fig. 1, the present application provides a method for cleaning data, which timely cleans message parameter information, so as to reduce gateway resource waste and improve gateway performance, and the implementation flow of the method is as follows:
step S1: and acquiring the storage time when the first message parameter information of the first message is stored in the first preset list.
In this embodiment of the present application, it should be noted that one message parameter information is a key, and the first message parameter information includes a first IP address and a first port number, where the first IP address and the first port number are a sender IP address and a sender port number for sending the first message.
In this embodiment of the present application, after obtaining the message parameter information of a message, the message parameter information is stored in a first preset list, where the first preset list is shown in table 1:
| IP address | Port number | Time of deposit |
| 10.4.5.2 | 12345 | 2021, 8, 11, 14, 52 minutes and 38 seconds |
| 24.1.2.3 | 24354 | 2021 8, 11, 15, 42 minutes and 12 seconds |
| 12.3.4.5 | 25325 | 2021, 8, 11, 15, 52 minutes and 18 seconds |
| 10.5.4.3 | 53454 | 2021 8, 11, 15.53 minutes and 08 seconds |
TABLE 1
Storing first message parameter information into a first preset list, and recording the storing time of the first message parameter information, wherein all message parameter information in the first preset list is arranged from first to second according to the storing time sequence, and the first preset list can be used as an aging queue table for deleting message parameter information exceeding preset time length;
further, in the embodiment of the present application, in order to avoid repetition of the message parameter information in the first preset list, whether there is message parameter information consistent with the first message parameter information is matched in the second preset list;
if yes, no treatment is carried out;
if not, the first message parameter information is put into the first preset list and the second preset list.
Such as: storing the first message parameter information into a first preset list, wherein the stored time is 2021, 8 months, 10 days, 16 hours, 52 minutes and 38 seconds, and matching whether the message parameter information consistent with the first message parameter information exists in the second preset list.
If yes, no treatment is carried out;
if not, the first message parameter information is put into the first preset list and the second preset list.
By the method, the first message parameter information is stored in the first preset list, and the storage time of the first message parameter information is recorded, so that each message parameter information corresponds to one storage time, and the first preset list can be used for arranging the message parameter information according to the sequence of the storage time.
Step S2: and determining the time length of the first message parameter information stored in the first preset list according to the acquired current time and the storing time.
In order to determine whether the message parameter information stored in the first preset list needs to be cleaned, after the message parameter information is stored in the first preset list, the storing time of the first message parameter information is obtained, and the current time in the gateway system is read in real time.
And carrying out difference between the storing time and the current time to obtain the storing time.
Such as: the first message parameter information is: 12.2.2.4 and 13457, where the time of storing the first message parameter information is 2021, 8, 10, 16, 40 minutes and 40 seconds, and the current time is 2021, 8, 10, 16, 50 minutes and 40 seconds, and the time of storing is different from the current time, so as to obtain a storing duration of: and 10min.
By the method, the storage time length is obtained according to the storage time and the current time of the first message parameter information, and the existence time of the first message parameter information in the first preset list can be judged according to the storage time length, so that whether the first message parameter information exceeds the preset time length in the first preset list can be judged later.
And step S3, judging whether the storage time length exceeds a preset time length.
After confirming the storage time length of the first message parameter information in the first preset list, comparing the storage time length with a preset time length to judge whether the first message parameter information exceeds the preset time length in the first preset list, wherein the preset time length is the survival time of the message parameter information in an ALG.
Such as: the first message parameter information is: 12.2.2.4 and 13457, the preset duration of the gateway is 1min, the storage duration of the first message parameter information in the first preset list is 5min, and comparing 1min with 5min to judge whether the first message parameter information in the first preset list exceeds the preset duration.
If the storage time length exceeds the preset time length, executing the step S4; if the time length of the storage does not exceed the preset time length, executing step S5.
By the method, whether the first message parameter information exceeds the preset duration in the first preset list can be judged quickly.
Step S4: deleting the first message parameter information from the first preset list, and continuing to clean from the next arrangement position of the first message parameter information.
In order to realize the cyclic detection of the message parameter information and achieve the aim of deleting the message parameter information, a period is required to be preset, the message parameter information with the storage time exceeding the preset time is deleted in the first preset list, and the next arrangement position of the first message parameter information is cleaned continuously.
Step S5: and reserving the first message parameter information in the first preset list, and restarting cleaning from the starting position of the first preset list.
According to the method, the first preset list is set for storing the keys and the storing time of the keys, so that the stored keys correspond to one storing time, the keys are ordered according to the sequence of the storing time, the keys with shorter survival time are arranged in front of the keys with longer survival time, and after the storing time of the keys in the first preset list exceeds the preset time, the keys exceeding the preset time can be deleted in sequence according to the ordering of the keys in each period by the first preset list, so that the consumption of gateway computing resources is reduced, and the performance of the gateway is improved.
Based on the same inventive concept, the embodiment of the present application further provides a data cleaning device, where the data cleaning device is configured to implement a function of a data cleaning method, and referring to fig. 2, the device includes:
an obtaining module 201, configured to obtain a storing time when first message parameter information of a first message is stored in a first preset list, where the first message parameter includes a first IP address and a first port number;
a determining module 202, configured to determine a time length of the first message parameter information stored in the first preset list according to the obtained current time and the storing time;
a judging module 203, configured to judge whether the storage duration exceeds a preset duration;
the processing module 204 is configured to delete the first message parameter information from the first preset list, and continue to clean from a next arrangement position of the first message parameter information or reserve the first message parameter information in the first preset list, and restart to clean from a start position of the first preset list.
In one possible design, the obtaining module 201 is specifically configured to receive a first message sent by a first client and analyze first message parameter information of the first message, store the first message parameter information in the first preset list and in a second preset list, record a time of storing the first message parameter information in the first preset list, where the second preset list is used to check whether the message parameter information is repeated, and arrange all message parameter information in the first preset list from first to second according to a time sequence of storing.
In one possible design, the obtaining module 201 is further configured to match whether there is message parameter information consistent with the first message parameter information in the second preset list, if so, not perform any processing, and if not, place the first message parameter information in the arrangement of the first preset list according to the sequence of the storing time, and place the first message parameter information in the second preset list.
In one possible design, the obtaining module 201 is further configured to sort the first packet in the first preset list according to the time of storing the first packet parameter, and store the first packet parameter in the first preset list according to the sorting.
Based on the same inventive concept, the embodiment of the present application further provides an electronic device, where the electronic device may implement the function of the foregoing apparatus for data cleaning, and referring to fig. 3, the electronic device includes:
at least one processor 301, and a memory 302 connected to the at least one processor 301, in this embodiment of the present application, a specific connection medium between the processor 301 and the memory 302 is not limited, and in fig. 3, the connection between the processor 301 and the memory 302 through the bus 300 is taken as an example. Bus 300 is shown in bold lines in fig. 3, and the manner in which the other components are connected is illustrated schematically and not by way of limitation. The bus 300 may be divided into an address bus, a data bus, a control bus, etc., and is represented by only one thick line in fig. 3 for convenience of illustration, but does not represent only one bus or one type of bus. Alternatively, the processor 301 may be referred to as a controller, and the names are not limited.
In the embodiment of the present application, the memory 302 stores instructions executable by the at least one processor 301, and the at least one processor 301 may perform a method for cleaning data as described above by executing the instructions stored in the memory 302. Processor 301 may implement the functions of the various modules in the apparatus shown in fig. 2.
The processor 301 is a control center of the apparatus, and may connect various parts of the entire control device using various interfaces and lines, and by executing or executing instructions stored in the memory 302 and invoking data stored in the memory 302, various functions of the apparatus and processing data, thereby performing overall monitoring of the apparatus.
In one possible design, processor 301 may include one or more processing units, and processor 301 may integrate an application processor and a modem processor, where the application processor primarily processes operating systems, user interfaces, application programs, and the like, and the modem processor primarily processes wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 301. In some embodiments, processor 301 and memory 302 may be implemented on the same chip, and in some embodiments they may be implemented separately on separate chips.
The processor 301 may be a general purpose processor such as a Central Processing Unit (CPU), digital signal processor, application specific integrated circuit, field programmable gate array or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, which may implement or perform the methods, steps and logic blocks disclosed in embodiments of the present application. The general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a data cleaning method disclosed in connection with the embodiments of the present application may be directly embodied in a hardware processor for execution, or may be executed by a combination of hardware and software modules in the processor.
The memory 302 serves as a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The Memory 302 may include at least one type of storage medium, which may include, for example, flash Memory, hard disk, multimedia card, card Memory, random access Memory (Random Access Memory, RAM), static random access Memory (Static Random Access Memory, SRAM), programmable Read-Only Memory (Programmable Read Only Memory, PROM), read-Only Memory (ROM), charged erasable programmable Read-Only Memory (Electrically Erasable Programmable Read-Only Memory), magnetic Memory, magnetic disk, optical disk, and the like. Memory 302 is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to such. The memory 302 in the present embodiment may also be circuitry or any other device capable of implementing a memory function for storing program instructions and/or data.
By programming the processor 301, the code corresponding to a data cleaning method described in the foregoing embodiment may be cured into the chip, so that the chip can perform a data cleaning step of the embodiment shown in fig. 1 at run-time. How to design and program the processor 301 is a technology well known to those skilled in the art, and will not be described in detail herein.
Based on the same inventive concept, the embodiments of the present application also provide a storage medium storing computer instructions that, when executed on a computer, cause the computer to perform a data cleaning method as previously discussed.
In some possible embodiments, aspects of a method of data cleansing may also be implemented in the form of a program product comprising program code for causing a control apparatus to carry out the steps of a method of data cleansing according to various exemplary embodiments of the present application as described herein above when the program product is run on a device.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.
Claims (10)
1. A method of data cleaning comprising:
acquiring a first message parameter information of a first message, wherein the first message parameter comprises a first IP address and a first port number, and the first message parameter information is stored in a first preset list, and the first preset list is an aging queue list;
determining the time length of the first message parameter information stored in the first preset list according to the acquired current time and the storing time;
judging whether the storage time length exceeds a preset time length;
if yes, deleting the first message parameter information in the first preset list, and continuing to clean from the next arrangement position of the first message parameter information;
if not, the first message parameter information is reserved in the first preset list, and cleaning is restarted from the starting position of the first preset list.
2. The method of claim 1, comprising, prior to the storing time when the first message parameter information of the first message is obtained and stored in the first preset list:
receiving a first message sent by a first client and analyzing first message parameter information of the first message;
storing the first message parameter information into the first preset list and the second preset list, and recording the storing time of the first message parameter information into the first preset list;
and arranging all message parameter information in the first preset list from first to last according to the stored time sequence.
3. The method of claim 2, wherein storing the first message parameter information in the first preset list and in a second preset list comprises:
matching whether the second preset list has the message parameter information consistent with the first message parameter information or not;
if yes, no treatment is carried out;
if not, the first message parameter information is put into the first preset list and the second preset list.
4. The method of claim 3, wherein placing the first message parameter information into the first preset list comprises:
sorting the first message in the first preset list according to the storing time of the first message parameter;
and storing the first message parameters into the first preset list according to the sorting.
5. An apparatus for data cleansing, the apparatus comprising:
the device comprises an acquisition module, a storage module and a storage module, wherein the acquisition module is used for acquiring the storage time when the first message parameter information of a first message is stored in a first preset list, and the first message parameter comprises a first IP address and a first port number;
the determining module is used for determining the time length of the first message parameter information stored in the first preset list according to the acquired current time and the storing time;
the judging module is used for judging whether the storage time length exceeds a preset time length;
the processing module is used for deleting the first message parameter information in the first preset list, continuing to clean from the next arrangement position of the first message parameter information or reserving the first message parameter information in the first preset list, and restarting to clean from the initial position of the first preset list.
6. The apparatus of claim 5, wherein the obtaining module is specifically configured to receive a first message sent by a first client and parse first message parameter information of the first message, store the first message parameter information in the first preset list and a second preset list, record a time of storing the first message parameter information in the first preset list, and the second preset list is configured to check whether the message parameter information is repeated, and arrange all message parameter information in the first preset list from first to second according to a time sequence of storing.
7. The apparatus of claim 6, wherein the obtaining module is further configured to match whether there is message parameter information consistent with the first message parameter information in the second preset list, if so, not perform any processing, and if not, place the first message parameter information in the arrangement of the first preset list according to the sequence of the storing time, and place the first message parameter information in the second preset list.
8. The apparatus of claim 7, wherein the obtaining module is further configured to sort the first message in the first preset list according to a time of storing the first message parameter, and store the first message parameter in the first preset list according to the sorting.
9. An electronic device, comprising:
a memory for storing a computer program;
a processor for carrying out the method steps of any one of claims 1-4 when executing a computer program stored on said memory.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110992057.4A CN113691631B (en) | 2021-08-27 | 2021-08-27 | Data cleaning method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110992057.4A CN113691631B (en) | 2021-08-27 | 2021-08-27 | Data cleaning method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113691631A CN113691631A (en) | 2021-11-23 |
| CN113691631B true CN113691631B (en) | 2024-02-20 |
Family
ID=78583552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110992057.4A Active CN113691631B (en) | 2021-08-27 | 2021-08-27 | Data cleaning method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113691631B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114448573B (en) * | 2022-03-02 | 2024-02-23 | 新华三半导体技术有限公司 | Message processing method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3076283A1 (en) * | 2015-03-31 | 2016-10-05 | Advanced Digital Broadcast S.A. | System and method for managing content deletion |
| EP3282371A1 (en) * | 2016-08-11 | 2018-02-14 | Beijing Xiaomi Mobile Software Co., Ltd. | Data clearing method and apparatus, computer program and recording medium |
| CN107911389A (en) * | 2017-12-13 | 2018-04-13 | 东软集团股份有限公司 | Packet message processing method, device, computer and the storage medium of attack protection |
| CN109408469A (en) * | 2018-09-05 | 2019-03-01 | 中国平安人寿保险股份有限公司 | Stale data document handling method, device, electronic device and storage medium |
| CN110071847A (en) * | 2019-03-20 | 2019-07-30 | 深圳市飞比电子科技有限公司 | Message processing method, device, terminal device and storage medium |
| CN111400298A (en) * | 2020-04-17 | 2020-07-10 | Oppo广东移动通信有限公司 | Data processing method and device and computer readable storage medium |
-
2021
- 2021-08-27 CN CN202110992057.4A patent/CN113691631B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3076283A1 (en) * | 2015-03-31 | 2016-10-05 | Advanced Digital Broadcast S.A. | System and method for managing content deletion |
| EP3282371A1 (en) * | 2016-08-11 | 2018-02-14 | Beijing Xiaomi Mobile Software Co., Ltd. | Data clearing method and apparatus, computer program and recording medium |
| CN107911389A (en) * | 2017-12-13 | 2018-04-13 | 东软集团股份有限公司 | Packet message processing method, device, computer and the storage medium of attack protection |
| CN109408469A (en) * | 2018-09-05 | 2019-03-01 | 中国平安人寿保险股份有限公司 | Stale data document handling method, device, electronic device and storage medium |
| CN110071847A (en) * | 2019-03-20 | 2019-07-30 | 深圳市飞比电子科技有限公司 | Message processing method, device, terminal device and storage medium |
| CN111400298A (en) * | 2020-04-17 | 2020-07-10 | Oppo广东移动通信有限公司 | Data processing method and device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113691631A (en) | 2021-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113840012B (en) | Block chain-based screen recording evidence obtaining method and system and electronic equipment | |
| CN113691631B (en) | Data cleaning method and device and electronic equipment | |
| CN109710440A (en) | Abnormality eliminating method, device, storage medium and the terminal device of webpage front-end | |
| CN108923967B (en) | Duplication-removing flow recording method, duplication-removing flow recording device, server and storage medium | |
| CN108733543B (en) | Log analysis method and device, electronic equipment and readable storage medium | |
| CN112306411A (en) | Data storage method and device, nonvolatile storage medium and processor | |
| CN108255937B (en) | SDN-based resource cleaning method and device, storage medium and computer equipment | |
| CN104679794A (en) | Data difference analysis method and device | |
| CN115955332A (en) | Abnormal traffic filtering method and device for authentication system and electronic equipment | |
| CN114238052A (en) | Pressure measurement data filtering method and device, storage medium and computer equipment | |
| CN115269519A (en) | Log detection method and device and electronic equipment | |
| CN111523921B (en) | Funnel analysis method, analysis device, electronic device, and readable storage medium | |
| CN114157662A (en) | Cloud platform parameter adaptation method and device, terminal equipment and storage medium | |
| CN113655958A (en) | Application data storage method | |
| CN108924013B (en) | Network flow accurate acquisition method and device | |
| US20170010935A1 (en) | Dumping resources | |
| CN111124854A (en) | Method, system, terminal and storage medium for distributing smoking test cases | |
| CN112749304A (en) | Method for limiting calculation force of mining machine, mining machine and storage medium | |
| CN110740062A (en) | Breakpoint resume method and device | |
| CN117118824B (en) | Log data collection method and device | |
| CN115081233B (en) | Flow simulation method and electronic equipment | |
| CN113872954B (en) | Method for detecting data flow | |
| CN116846638A (en) | Unauthorized behavior detection method and device, electronic equipment and storage medium | |
| CN115238132A (en) | Matching method and device of pattern strings | |
| CN115065558A (en) | Attack flow tracing method and device for APT attack |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |