CN114579548A - Data cleaning system for data acquisition based on Internet of things - Google Patents
Data cleaning system for data acquisition based on Internet of things Download PDFInfo
- Publication number
- CN114579548A CN114579548A CN202210199219.3A CN202210199219A CN114579548A CN 114579548 A CN114579548 A CN 114579548A CN 202210199219 A CN202210199219 A CN 202210199219A CN 114579548 A CN114579548 A CN 114579548A
- Authority
- CN
- China
- Prior art keywords
- data
- sensor
- cleaning
- acquisition
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004140 cleaning Methods 0.000 title claims abstract description 141
- 238000012545 processing Methods 0.000 claims abstract description 6
- 238000013480 data collection Methods 0.000 claims description 9
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 6
- 238000003745 diagnosis Methods 0.000 claims description 5
- 230000007613 environmental effect Effects 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000005406 washing Methods 0.000 claims description 4
- 230000006855 networking Effects 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 7
- 238000000034 method Methods 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24564—Applying rules; Deductive queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Quality & Reliability (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a data cleaning system for data acquisition based on the Internet of things, relates to the technical field of data processing, and solves the technical problems that in the prior art, the data cleaning effect is poor and the cleaning efficiency is low due to the fact that the data of a cleaned sensor cannot be cleaned according to requirements in the data cleaning process; the invention comprises a data server, a plurality of edge processors and a plurality of acquisition sensors; the sensor types are reasonably divided, a reasonable number of edge processors are configured, and the sensor data are cleaned by the edge processors or the data server according to requirements and cleaning rules, so that the purposes of improving the data cleaning efficiency and the data cleaning effect are achieved; after the cleaning rule is updated, the data can be cleaned uniformly by the data processor, and the data can be cleaned respectively by the edge processor, so that the data cleaning efficiency is improved on the basis of ensuring the data cleaning quality.
Description
Technical Field
The invention belongs to the field of data processing, relates to a data cleaning technology for data acquisition based on the Internet of things, and particularly relates to a data cleaning system for data acquisition based on the Internet of things.
Background
With the development of the internet of things technology and various internet of things devices, the internet of things technology can be used for any object or process needing monitoring, connection and interaction to collect various required data, and therefore data cleaning in the internet of things technology is very critical.
In the prior art (patent application with document number CN 106933990A), different roles are configured for sensors in a system, and corresponding cleaning rules are obtained according to the roles of the sensors, so as to ensure the data cleaning efficiency; in the prior art, when data is cleaned, only data currently received by a sensor can be cleaned, and the cleaned sensor data cannot be cleaned according to requirements under the condition that a cleaning rule is changed, so that a data cleaning effect is poor; therefore, a data cleaning system for data acquisition based on the internet of things is urgently needed.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art; therefore, the invention provides a data cleaning system for data acquisition based on the Internet of things, which is used for solving the technical problems that the data cleaning effect is poor and the cleaning efficiency is low due to the fact that the data of the cleaned sensor cannot be cleaned according to requirements in the data cleaning process in the prior art.
The sensor data are cleaned according to the requirements and cleaning rules by reasonably dividing the sensor types and configuring a reasonable number of edge processors, and then the edge processors or the data server are used for cleaning the sensor data, so that the purposes of improving the data cleaning efficiency and the data cleaning effect are achieved.
In order to achieve the above object, a first aspect of the present invention provides a data cleaning system for data acquisition based on the internet of things, which includes a data server, a plurality of edge processors and a plurality of acquisition sensors, wherein the edge processors are respectively connected to the data server and the plurality of acquisition sensors;
a data server: setting an incidence relation between the edge processor and the acquisition sensor; setting a cleaning rule and distributing the cleaning rule to the corresponding edge processor; wherein the data server comprises a cloud server; and
storing the sensor data after the analysis data washing;
an edge processor: receiving sensor data acquired by an acquisition sensor in real time or at regular time; and after the sensor data is subjected to data preprocessing, cleaning the sensor data according to a cleaning rule.
Preferably, the data server is in communication and/or electrical connection with a plurality of the edge processors, and the edge processors are in communication and/or electrical connection with corresponding acquisition sensors in the association relationship; wherein, the acquisition sensor comprises sensor equipment and video acquisition equipment.
Preferably, the association relationship between the edge processor and the acquisition sensor is set based on the data type and/or the sensor usage; sensor applications include, among others, fault diagnosis and environmental monitoring.
Preferably, setting the association relationship based on the data type includes:
acquiring an acquisition sensor, and dividing the acquisition sensor according to the type of acquired data;
configuring an edge processor for the acquisition sensors corresponding to the same data type, and establishing an association relationship between the edge processor and the acquisition sensors.
Preferably, setting the association relation based on the sensor usage includes:
acquiring acquisition sensors and dividing the acquisition sensors according to the use of the sensors;
configuring an edge processor for the acquisition sensors corresponding to the same sensor application, and establishing an association relationship between the edge processor and the acquisition sensors.
Preferably, at least one edge processor is configured for the acquisition sensors corresponding to the same data type or the same sensor application; the number of the configured edge processors is determined according to the data processing amount;
when the number of the edge processors is not less than two, the edge processors cooperate with each other.
Preferably, the setting of the cleaning rule by the data server includes:
acquiring an incidence relation between an edge processor and an acquisition sensor;
and establishing a cleaning rule by combining the association relation with the cleaning requirement, and distributing the cleaning rule to the corresponding edge processor.
Preferably, the edge processor stores the sensor data after data cleaning, and regularly cleans the stored sensor data according to a cleaning cycle; wherein the cleaning cycle is set according to the update cycle of the cleaning rule.
Preferably, the edge processor performs data cleansing on the acquired sensor data, and the data cleansing includes:
and when the edge processor receives the sensor data, calling a cleaning rule to perform data cleaning on the sensor data, and sending the sensor data after the data cleaning to a data server.
Preferably, the data washing of the sensor data stored by the edge processor or the data server includes:
when the cleaning rule is updated, cleaning the sensor data stored in the edge processor or the data server according to the updated cleaning rule; and after the sensor data stored in the edge processor is subjected to data cleaning, the sensor data is sent to a data server for coverage updating.
Compared with the prior art, the invention has the beneficial effects that:
1. the sensor type is reasonably divided, the edge processors with reasonable quantity are configured, and the data of the sensor are cleaned by the edge processors or the data server according to requirements and cleaning rules, so that the purposes of improving the data cleaning efficiency and the data cleaning effect are achieved.
2. After the cleaning rule is updated, the data can be cleaned uniformly by the data processor, and the data can be cleaned respectively by the edge processor, so that the data cleaning efficiency is improved on the basis of ensuring the data cleaning quality.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of the working steps of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the following embodiments, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the prior art (patent application with document number CN 106933990A), different roles are configured for sensors in a system, and corresponding cleaning rules are obtained according to the roles of the sensors, so as to ensure the data cleaning efficiency; in the prior art, different roles are given to the sensor, different cleaning rules are adopted according to the different roles, the data cleaning efficiency can be improved, and the sensor data after data cleaning can meet requirements. However, in the prior art, under the condition of updating the cleaning rule, the cleaned sensor data is difficult to update and clean, and the data cleaning efficiency cannot be ensured.
The sensor data are cleaned according to the requirements and cleaning rules by reasonably dividing the sensor types and configuring a reasonable number of edge processors, and then the edge processors or the data server are used for cleaning the sensor data, so that the purposes of improving the data cleaning efficiency and the data cleaning effect are achieved.
Referring to fig. 1, an embodiment of the present application provides a data cleaning system for data acquisition based on the internet of things, including a data server, a plurality of edge processors, and a plurality of acquisition sensors, where the edge processors are respectively connected to the data server and the plurality of acquisition sensors;
a data server: setting an incidence relation between the edge processor and the acquisition sensor; setting a cleaning rule and distributing the cleaning rule to the corresponding edge processor; and storing the sensor data after the analysis data washing;
an edge processor: receiving sensor data acquired by an acquisition sensor in real time or at regular time; and after the sensor data is subjected to data preprocessing, cleaning the sensor data according to a cleaning rule.
The data server and the edge processors comprise a cloud server, a workstation and the like, the data server is in communication and/or electrical connection with the edge processors, and the edge processors are in communication and/or electrical connection with corresponding acquisition sensors in the association relationship.
In this application, the acquisition sensor includes data acquisition equipment such as sensor equipment, video acquisition equipment, and the acquisition sensor sets up according to different application scenes, like in the intelligent agriculture scene, the acquisition sensor includes sensors for environmental monitoring such as temperature sensor, humidity transducer, light intensity sensor to and sensors in equipment monitoring such as current sensor, voltage sensor.
In one embodiment, the association between the edge processor and the acquisition sensor is set based on the data type and/or sensor usage.
The purpose of the sensor in the embodiment is divided according to different scenes such as fault diagnosis, environmental monitoring and the like; the primary objective in this embodiment is to establish an association between the edge processor and the collection sensor to facilitate later sensor data collection and data cleansing of the sensor data.
In an optional embodiment, setting the association relationship based on the data type includes:
acquiring an acquisition sensor, and dividing the acquisition sensor according to the type of acquired data;
configuring an edge processor for the acquisition sensors corresponding to the same data type, and establishing an association relationship between the edge processor and the acquisition sensors.
The main purpose of this embodiment is to configure the edge processor according to the data type and establish the association between the edge processor and the acquisition sensor. The data types in this embodiment are mainly classifications of sensor data, such as: classifying sensor data corresponding to the analog signals into one class, and classifying sensor data corresponding to the digital signals into one class; alternatively, temperature sensors are classified into one type, humidity sensors are classified into one type, and light intensity sensors are classified into one type.
It can be understood that the data processing efficiency is improved by classifying the acquisition sensors according to the data types to ensure the consistency of the data processed by the corresponding edge processors; after the acquisition sensors are divided, an edge processor can be configured for the acquisition sensors, and an association relationship between the acquisition sensors and the edge processor is established.
In an alternative embodiment, the setting of the association relationship based on the sensor usage includes:
acquiring acquisition sensors and dividing the acquisition sensors according to the use of the sensors;
configuring an edge processor for the acquisition sensors corresponding to the same sensor application, and establishing an association relationship between the edge processor and the acquisition sensors.
The main purpose of this embodiment is to divide the acquisition sensor according to the purpose of the sensor, configure the edge processor according to the division result, and establish the association relationship. The sensor in this embodiment may be used for fault diagnosis, environmental monitoring, and the like, for example: the method comprises the steps of classifying current sensors and voltage sensors for fault diagnosis into one class, classifying temperature sensors, humidity sensors and light intensity sensors for environment monitoring into one class, respectively setting edge processors, and establishing an incidence relation.
It can be understood that the collection sensors are classified according to their purposes, and the sensor data in a specific scene can be cleaned quickly and timely, so as to improve the data cleaning efficiency.
It is noted that the data type and the sensor usage may be combined to realize the division of the acquisition sensor, for example, the acquisition sensor is divided according to the data type, and then the acquisition sensor is divided according to the sensor usage, and a plurality of edge processors may be configured.
In some preferred embodiments, at least one edge processor is configured for acquisition sensors corresponding to the same data type or the same sensor use;
when the number of the edge processors is not less than two, the edge processors cooperate with each other.
It can be understood that the number of configured edge processors is determined according to the data processing amount, and if the data amount corresponding to a certain data type is too large, a plurality of edge processors can be configured for the data type and cooperate with each other.
In one embodiment, setting the cleansing rule by the data server includes:
acquiring an incidence relation between an edge processor and an acquisition sensor;
and establishing a cleaning rule by combining the association relation with the cleaning requirement, and distributing the cleaning rule to the corresponding edge processor.
The cleaning requirements in this embodiment are artificially defined, and cleaning rules are established in combination with the cleaning requirements corresponding to different sensor data, and the cleaning rules are sent to the corresponding edge processors.
In one embodiment, the edge processor stores the sensor data after data cleaning, and periodically cleans the stored sensor data according to a cleaning cycle; wherein the cleaning cycle is set according to the update cycle of the cleaning rule.
The main purpose of this embodiment is to perform a secondary cleaning on the sensor data after the cleaning rule is updated; in this embodiment, after the data of the sensor data is cleaned, the edge processor sends the data to the data server, and stores the sensor data.
It can be understood that the sensor data has a limited storage time in the edge processor, and the storage space thereof needs to be cleaned periodically; in this embodiment, the cleaning cycle is set according to the update cycle of the cleaning rule, and if the average update cycle of the cleaning rule is one month, the cleaning cycle may be set to two months.
In a specific embodiment, the edge processor performs data cleansing on the collected sensor data, comprising:
and when the edge processor receives the sensor data, calling a cleaning rule to perform data cleaning on the sensor data, and sending the sensor data after the data cleaning to a data server.
In an alternative embodiment, the data cleansing of the sensor data stored by the edge processor or the data server comprises:
and when the cleaning rule is updated, performing data cleaning on the sensor data stored in the edge processor or the data server through the updated cleaning rule.
It is to be understood that the sensor data stored in the edge processor is sent to the data server for overlay update after data cleansing.
In this embodiment, after the cleaning rule is updated, data cleaning is performed on the sensor data (data cleaning has already been performed) in the data server, or data cleaning may be performed on the sensor data stored in the edge processor; when the data server is cleaned for the second time, the step of coverage updating is omitted, but when the data volume is large, the cleaning efficiency cannot meet the requirement, and the data can be cleaned separately through the edge processor, so that the data cleaning efficiency is improved. It can be understood that after the cleaning rule is updated, the sensor data which is subjected to data cleaning according to the original cleaning rule may not be processed according to actual requirements.
The working principle of the invention is as follows:
and setting an incidence relation between the edge processor and the acquisition sensor through the data server, setting a cleaning rule, and distributing the cleaning rule to the corresponding edge processor.
The edge processor receives sensor data acquired by the acquisition sensor in real time or at regular time, and after the sensor data is subjected to data preprocessing, the sensor data is cleaned according to a cleaning rule.
And after the cleaning rule is updated, the data server or the edge processor performs secondary cleaning on the sensor data according to the updated cleaning rule.
Although the present invention has been described in detail with reference to the preferred embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the spirit and scope of the present invention.
Claims (10)
1. The utility model provides a data cleaning system for data acquisition based on thing networking, includes data server, a plurality of edge processor and a plurality of kind of acquisition sensor, and edge processor is connected its characterized in that with data server, a plurality of kind of acquisition sensor respectively:
a data server: setting an incidence relation between the edge processor and the acquisition sensor; setting a cleaning rule and distributing the cleaning rule to the corresponding edge processor; and storing the sensor data after the analysis data washing;
an edge processor: receiving sensor data acquired by an acquisition sensor in real time or at regular time; and after the sensor data is subjected to data preprocessing, cleaning the sensor data according to a cleaning rule.
2. The data cleaning system for data collection based on the internet of things of claim 1, wherein the data server is in communication and/or electrical connection with a plurality of the edge processors, and the edge processors are in communication and/or electrical connection with corresponding collection sensors in association; wherein, the acquisition sensor comprises sensor equipment and video acquisition equipment.
3. The data cleaning system for data collection based on the internet of things as claimed in claim 1, wherein the association relationship between the edge processor and the collection sensor is set based on data type and/or sensor usage; sensor applications include, among others, fault diagnosis and environmental monitoring.
4. The data cleaning system for data collection based on the internet of things as claimed in claim 3, wherein setting an association relationship based on the data type comprises:
acquiring an acquisition sensor, and dividing the acquisition sensor according to the type of acquired data;
configuring an edge processor for the acquisition sensors corresponding to the same data type, and establishing an association relationship between the edge processor and the acquisition sensors.
5. The data cleaning system for data collection based on the internet of things as claimed in claim 3, wherein setting the association relationship based on the sensor usage comprises:
acquiring acquisition sensors and dividing the acquisition sensors according to the use of the sensors;
configuring an edge processor for the acquisition sensors corresponding to the same sensor application, and establishing an association relationship between the edge processor and the acquisition sensors.
6. The data cleaning system for data acquisition based on the Internet of things as claimed in claim 4 or 5, wherein at least one edge processor is configured for acquisition sensors corresponding to the same data type or the same sensor application; the number of the configured edge processors is determined according to the data processing amount;
when the number of the edge processors is not less than two, the edge processors cooperate with each other.
7. The data cleaning system for data collection based on the internet of things as claimed in claim 1, wherein the setting of the cleaning rule by the data server comprises:
acquiring an incidence relation between an edge processor and an acquisition sensor;
and establishing a cleaning rule by combining the association relation with the cleaning requirement, and distributing the cleaning rule to the corresponding edge processor.
8. The data cleaning system for data collection based on the internet of things of claim 1, wherein the edge processor stores the sensor data after the data cleaning, and periodically cleans the stored sensor data according to a cleaning cycle; wherein the cleaning cycle is set according to the update cycle of the cleaning rule.
9. The data cleaning system for data collection based on internet of things of claim 8, wherein the edge processor performs data cleaning on the collected sensor data, and the data cleaning system comprises:
and when the edge processor receives the sensor data, calling a cleaning rule to perform data cleaning on the sensor data, and sending the sensor data after the data cleaning to a data server.
10. The data cleaning system for data collection based on internet of things of claim 1 or 9, wherein the data cleaning of the sensor data stored in the edge processor or the data server comprises:
when the cleaning rule is updated, cleaning the sensor data stored in the edge processor or the data server according to the updated cleaning rule; and after the sensor data stored in the edge processor is subjected to data cleaning, the sensor data is sent to a data server for coverage updating.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210199219.3A CN114579548A (en) | 2022-03-02 | 2022-03-02 | Data cleaning system for data acquisition based on Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210199219.3A CN114579548A (en) | 2022-03-02 | 2022-03-02 | Data cleaning system for data acquisition based on Internet of things |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114579548A true CN114579548A (en) | 2022-06-03 |
Family
ID=81776618
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210199219.3A Pending CN114579548A (en) | 2022-03-02 | 2022-03-02 | Data cleaning system for data acquisition based on Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114579548A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106933992A (en) * | 2017-02-24 | 2017-07-07 | 北京华安普惠高新技术有限公司 | Distributed data purging system and method based on data analysis |
| CN107872823A (en) * | 2016-09-28 | 2018-04-03 | 维布络有限公司 | The method and system of communication operational mode in the mobile edge calculations environment of identification |
| WO2018120669A1 (en) * | 2016-12-31 | 2018-07-05 | 深圳市易特科信息技术有限公司 | Medical data query system and method based on big data association and storage |
| CN112486971A (en) * | 2020-12-08 | 2021-03-12 | 企查查科技有限公司 | Data cleaning method, equipment and storage medium with correction function |
| CN113836131A (en) * | 2021-09-29 | 2021-12-24 | 平安科技（深圳）有限公司 | Big data cleaning method and device, computer equipment and storage medium |
-
2022
- 2022-03-02 CN CN202210199219.3A patent/CN114579548A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107872823A (en) * | 2016-09-28 | 2018-04-03 | 维布络有限公司 | The method and system of communication operational mode in the mobile edge calculations environment of identification |
| WO2018120669A1 (en) * | 2016-12-31 | 2018-07-05 | 深圳市易特科信息技术有限公司 | Medical data query system and method based on big data association and storage |
| CN106933992A (en) * | 2017-02-24 | 2017-07-07 | 北京华安普惠高新技术有限公司 | Distributed data purging system and method based on data analysis |
| CN112486971A (en) * | 2020-12-08 | 2021-03-12 | 企查查科技有限公司 | Data cleaning method, equipment and storage medium with correction function |
| CN113836131A (en) * | 2021-09-29 | 2021-12-24 | 平安科技（深圳）有限公司 | Big data cleaning method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105205231B (en) | A kind of power distribution network Digital Simulation System based on DCOM | |
| CN111200528B (en) | Intelligent linkage method for smart city with edge cloud cooperation | |
| CN109102334A (en) | Market area partition method, apparatus and electronic equipment | |
| Fukatsu et al. | A web-based sensor network system with distributed data processing approach via web application | |
| CN109743356B (en) | Industrial internet data acquisition method and device, readable storage medium and terminal | |
| CN110287902B (en) | Livestock and poultry survival detection method, device, equipment and computer program product | |
| CN112804280A (en) | Electric power Internet of things system and data processing method thereof | |
| CN105527948B (en) | A kind of large-scale distributed data collecting system and method based on industrial process | |
| CN115842342B (en) | Topology identification method and device for distributed power distribution network | |
| CN112365366A (en) | Micro-grid management method and system based on intelligent 5G slice | |
| CN116231860B (en) | Cloud edge end cooperation-based intelligent power load identification system, method and equipment | |
| CN113724008A (en) | Data analysis method for new marketing big data | |
| CN112631754A (en) | Data processing method, data processing device, storage medium and electronic device | |
| CN110290467A (en) | The acquisition methods and device of dwell point, shopping centre service range, influence factor | |
| CN105357026B (en) | A kind of resource information collection method and calculate node | |
| CN114579548A (en) | Data cleaning system for data acquisition based on Internet of things | |
| WO2024066720A1 (en) | Indicator threshold determination method and apparatus, storage medium, and electronic apparatus | |
| CN115277789B (en) | Safety protection system and method for cascade hydropower station | |
| CN115860366A (en) | Community robot intelligent coordination control method and system and readable storage medium | |
| CN107346444A (en) | Intelligent chip based on high in the clouds big data deep learning | |
| CN115002226B (en) | Intelligent cable monitoring system capable of reporting sensor data in time-sharing mode | |
| CN115526737A (en) | Power grid energy management method and system based on digital twinning and terminal equipment | |
| CN212322281U (en) | Open type electric power AI application platform | |
| CN115660314A (en) | Shadow shielding diagnosis method and device, electronic equipment and storage medium | |
| CN109302723A (en) | A kind of multinode real-time radio pyroelectric monitor control system Internet-based and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |