CN106447163A - Automatic detection system of data quality on the basis of fine logic classification technology - Google Patents
Automatic detection system of data quality on the basis of fine logic classification technology Download PDFInfo
- Publication number
- CN106447163A CN106447163A CN201610767451.7A CN201610767451A CN106447163A CN 106447163 A CN106447163 A CN 106447163A CN 201610767451 A CN201610767451 A CN 201610767451A CN 106447163 A CN106447163 A CN 106447163A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- quality
- information
- evaluation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Detection And Prevention Of Errors In Transmission (AREA)
Abstract
The invention discloses an automatic detection system of data quality on the basis of a fine logic classification technology. The automatic detection system comprises a data acquisition module, a data classification module, a data evaluation module, a data storage module, a data correction module, a data transmission module, a data processing module, a database module, an anomaly warning module and a data display module. Through the data acquisition module, the data classification module, the data evaluation module, the data storage module, the data correction module and the data processing module, original data is detected, corrected and processed in sequence, the automatic detection and control of the data quality is realized, the data is stored, displayed and output, and the data quality of information is effectively improved.
Description
Technical field
The invention belongs to data quality checking field, particularly relate to a kind of data matter based on the logical division technology that becomes more meticulous
Amount automatic checkout system.
Background technology
Information data, as the extrusion of information industry and core, therefrom plays an important role, the quality of information data
Problem also becomes during information industry development process is converged the pressing issues being badly in need of being paid attention to and solving.Therefore, adopt an effective measure
Detecting and improving information data quality, the development and progress of promotion information industry that can be strong, the information that can give is produced
The new vitality of industry.
Content of the invention
It is an object of the invention to the problem above overcoming prior art to exist, provide a kind of based on the logical division that becomes more meticulous
The quality of data automatic checkout system of technology, the data quality problem that can there is information data China detects simultaneously automatically
Control, improves information data quality.
For realizing above-mentioned technical purpose, reaching above-mentioned technique effect, the present invention is achieved through the following technical solutions：
A kind of quality of data automatic checkout system based on the logical division technology that becomes more meticulous, including data acquisition module, number
According to sort module, data evaluation module, data memory module, data correction module, data transmission module, data processing module,
DBM, abnormal alarm module, data disaply moudle；
Described data acquisition module is used for gathering the initial data needed for user, and forms data set information transmission to data
Sort module；
Described data categorization module and is processed from the data set signal of data acquisition module for reception, is formed and divides
Class data message sends to data evaluation module；
Described data evaluation module from the assortment data information of data categorization module and carries out quality evaluation for reception,
Form data quality accessment information and be respectively sent to data memory module and data correcting module；
Described data memory module and is deposited from the data quality accessment information of data evaluation module for reception；
Described data correction module from the data quality accessment information of data evaluation module and carries out data for reception
Revise, form quality of data update information and send to data transmission module；
Described data transmission module sends to data processing module for the quality of data update information that will receive；
Described data processing module and is processed from the quality of data correcting module of data transmission module for reception,
Form the transmission of data exception alarm signal respectively and show mould to abnormal alarm module, formation data display signal transmission to data
Block, formation quality of data correcting process information send to DBM；
Described abnormal alarm module is used for receiving the data exception alarm signal from data processing module, and externally carries out
Warning is reminded；
Described data disaply moudle shows signal for the data receiving from data processing module, and externally carries out data
Quality update information shows；
Described DBM processes information for the quality of data receiving from data processing module and deposits.
Further, the quality evaluation of described data evaluation module includes to data redundancy, relevance, correctness, complete
Quan Xing, uniformity, compliance detect.
Further, described abnormal alarm module is provided with different early warning threshold values, when receiving data exception alarm signal
The early warning carrying out different ranks is reminded and notice.
Further, described data processing module is also associated with quality of data output module, and the report of the described quality of data is defeated
Go out module for printing conventional quality of data report.
The invention has the beneficial effects as follows：
The present invention is repaiied by data acquisition module, data categorization module, data evaluation module, data memory module, data
Initial data is carried out detecting, revises, processes by positive module, data processing module successively, it is achieved the automatic detection to the quality of data
And control, and carry out storing, show, export, effectively arrange the quality of data of raising information.
Brief description
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, this
Bright schematic description and description is used for explaining the present invention, is not intended that inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the system architecture diagram of the present invention.
Detailed description of the invention
Below with reference to the accompanying drawings and in conjunction with the embodiments, the present invention is described in detail.
A kind of quality of data automatic checkout system based on the logical division technology that becomes more meticulous as shown in Figure 1, including data
Acquisition module, data categorization module, data evaluation module, data memory module, data correction module, data transmission module, number
According to processing module, DBM, abnormal alarm module, data disaply moudle；
Data acquisition module is used for gathering the initial data needed for user, and forms data set information transmission to data classification
Module；
Data categorization module and is processed from the data set signal of data acquisition module for reception, forms classification number
It is believed that breath sends to data evaluation module；
Data evaluation module from the assortment data information of data categorization module and carries out quality evaluation for reception, is formed
Data quality accessment information is respectively sent to data memory module and data correcting module；
Data memory module and is deposited from the data quality accessment information of data evaluation module for reception；
Data correction module from the data quality accessment information of data evaluation module and carries out data correction for reception,
Form quality of data update information to send to data transmission module；
Data transmission module sends to data processing module for the quality of data update information that will receive；
Data processing module and is processed from the quality of data correcting module of data transmission module for reception, respectively
Form data exception alarm signal to send to abnormal alarm module, form data display signal transmission to data disaply moudle, shape
Quality of data correcting process information is become to send to DBM；
Abnormal alarm module is used for receiving the data exception alarm signal from data processing module, and externally warns
Remind；
Data disaply moudle shows signal for the data receiving from data processing module, and externally carries out the quality of data
Update information shows；
DBM processes information for the quality of data receiving from data processing module and deposits.
Wherein, the quality evaluation of data evaluation module includes to data redundancy, relevance, correctness, completeness, consistent
Property, compliance detect.
Wherein, abnormal alarm module is provided with different early warning threshold values, carries out difference when receiving data exception alarm signal
Rank early warning remind and notice.
Wherein, data processing module is also associated with quality of data output module, and quality of data report output module is for beating
The conventional quality of data report of print.
The present invention is repaiied by data acquisition module, data categorization module, data evaluation module, data memory module, data
Initial data is carried out detecting, revises, processes by positive module, data processing module successively, it is achieved the automatic detection to the quality of data
And control, and carry out storing, show, export, effectively arrange the quality of data of raising information.
General principle, principal character and the advantages of the present invention of the present invention have more than been shown and described.The technology of the industry
Personnel are it should be appreciated that the present invention is not restricted to the described embodiments, and the simply explanation described in above-described embodiment and specification is originally
The principle of invention, without departing from the spirit and scope of the present invention, the present invention also has various changes and modifications, and these become
Change and improvement both falls within scope of the claimed invention.
Claims (4)
1. the quality of data automatic checkout system based on the logical division technology that becomes more meticulous, it is characterised in that：Including data acquisition
Collection module, data categorization module, data evaluation module, data memory module, data correction module, data transmission module, data
Processing module, DBM, abnormal alarm module, data disaply moudle；
Described data acquisition module is used for gathering the initial data needed for user, and forms data set information transmission to data classification
Module；
Described data categorization module and is processed from the data set signal of data acquisition module for reception, forms classification number
It is believed that breath sends to data evaluation module；
Described data evaluation module from the assortment data information of data categorization module and carries out quality evaluation for reception, is formed
Data quality accessment information is respectively sent to data memory module and data correcting module；
Described data memory module and is deposited from the data quality accessment information of data evaluation module for reception；
Described data correction module from the data quality accessment information of data evaluation module and carries out data correction for reception,
Form quality of data update information to send to data transmission module；
Described data transmission module sends to data processing module for the quality of data update information that will receive；
Described data processing module and is processed from the quality of data correcting module of data transmission module for reception, respectively
Form data exception alarm signal to send to abnormal alarm module, form data display signal transmission to data disaply moudle, shape
Quality of data correcting process information is become to send to DBM；
Described abnormal alarm module is used for receiving the data exception alarm signal from data processing module, and externally warns
Remind；
Described data disaply moudle shows signal for the data receiving from data processing module, and externally carries out the quality of data
Update information shows；
Described DBM processes information for the quality of data receiving from data processing module and deposits.
2. a kind of quality of data automatic checkout system based on the logical division technology that becomes more meticulous according to claim 1, its
It is characterised by：The quality evaluation of described data evaluation module includes to data redundancy, relevance, correctness, completeness, consistent
Property, compliance detect.
3. a kind of quality of data automatic checkout system based on the logical division technology that becomes more meticulous according to claim 1, its
It is characterised by：Described abnormal alarm module is provided with different early warning threshold values, carries out difference when receiving data exception alarm signal
Rank early warning remind and notice.
4. a kind of quality of data automatic checkout system based on the logical division technology that becomes more meticulous according to claim 1, its
It is characterised by：Described data processing module is also associated with quality of data output module, and described quality of data report output module is used
Report in printing the conventional quality of data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610767451.7A CN106447163A (en) | 2016-08-29 | 2016-08-29 | Automatic detection system of data quality on the basis of fine logic classification technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610767451.7A CN106447163A (en) | 2016-08-29 | 2016-08-29 | Automatic detection system of data quality on the basis of fine logic classification technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106447163A true CN106447163A (en) | 2017-02-22 |
Family
ID=58090513
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610767451.7A Pending CN106447163A (en) | 2016-08-29 | 2016-08-29 | Automatic detection system of data quality on the basis of fine logic classification technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106447163A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107040608A (en) * | 2017-05-19 | 2017-08-11 | 宁波绮耘软件股份有限公司 | A kind of data processing method and system |
| CN107385745A (en) * | 2017-08-02 | 2017-11-24 | 台嘉玻璃纤维有限公司 | Electronic-grade glass yarn optimizes production system and its method |
| CN110515997A (en) * | 2019-08-22 | 2019-11-29 | 武汉东湖大数据交易中心股份有限公司 | A kind of big data intelligent analysis system |
| CN110727686A (en) * | 2019-10-23 | 2020-01-24 | 东莞理工学院城市学院 | Large data block structured storage method |
| CN117516868A (en) * | 2023-10-24 | 2024-02-06 | 江苏俊知传感技术有限公司 | Intelligent detection system of optical divider |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101110699A (en) * | 2007-08-07 | 2008-01-23 | 广州诚予国际市场信息研究有限公司 | System with network satisfaction degree estimation and early warning function and implementing method thereof |
| CN102708149A (en) * | 2012-04-01 | 2012-10-03 | 河海大学 | Data quality management method and system |
| CN103559551A (en) * | 2013-09-23 | 2014-02-05 | 北京中安健科安全技术咨询有限公司 | Production-enterprise-oriented potential safety hazard quantitative assessment and early warning system |
-
2016
- 2016-08-29 CN CN201610767451.7A patent/CN106447163A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101110699A (en) * | 2007-08-07 | 2008-01-23 | 广州诚予国际市场信息研究有限公司 | System with network satisfaction degree estimation and early warning function and implementing method thereof |
| CN102708149A (en) * | 2012-04-01 | 2012-10-03 | 河海大学 | Data quality management method and system |
| CN103559551A (en) * | 2013-09-23 | 2014-02-05 | 北京中安健科安全技术咨询有限公司 | Production-enterprise-oriented potential safety hazard quantitative assessment and early warning system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107040608A (en) * | 2017-05-19 | 2017-08-11 | 宁波绮耘软件股份有限公司 | A kind of data processing method and system |
| CN107385745A (en) * | 2017-08-02 | 2017-11-24 | 台嘉玻璃纤维有限公司 | Electronic-grade glass yarn optimizes production system and its method |
| CN110515997A (en) * | 2019-08-22 | 2019-11-29 | 武汉东湖大数据交易中心股份有限公司 | A kind of big data intelligent analysis system |
| CN110727686A (en) * | 2019-10-23 | 2020-01-24 | 东莞理工学院城市学院 | Large data block structured storage method |
| CN117516868A (en) * | 2023-10-24 | 2024-02-06 | 江苏俊知传感技术有限公司 | Intelligent detection system of optical divider |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106447163A (en) | Automatic detection system of data quality on the basis of fine logic classification technology | |
| CN110514675B (en) | Intelligent detection method and system for label | |
| CN103914680A (en) | Character image jet-printing, recognition and calibration system and method | |
| CN107514978B (en) | Recovery machine packing material shape identification method and system based on infrared grating detection | |
| CN113744244B (en) | Online visual detection system for measuring distance from edge of lithium battery pole piece to edge of pole lug | |
| CN104483243A (en) | Adhered-rice detection and segmentation method, device and system | |
| CN112884718A (en) | Method, device and system for detecting code spraying characters of package and storage medium | |
| WO2023226706A9 (en) | Defect detection method and apparatus | |
| CN112445321A (en) | Article processing method and device and electronic equipment | |
| CN109102049A (en) | A kind of product information retroactive method | |
| CN111582786A (en) | Express bill number identification method, device and equipment based on machine learning | |
| CN109444141B (en) | Grain kernel detection and counting method and device based on deep learning | |
| CN116051502A (en) | Large-tow carbon fiber defect detection method and system based on combination of image processing and deep learning | |
| CN116700183A (en) | Method for monitoring production of filled milk and management system | |
| CN106875146A (en) | The method and device that a kind of grain storage goods yard is reviewed | |
| CN102564560B (en) | Weighing identification method and system | |
| CN111709452B (en) | Method for evaluating surface defect model of wine bottle, electronic device and storage medium | |
| CN102152457A (en) | Embedded plastic mould protector based on histogram matching | |
| CN116703914A (en) | Welding defect detection method, equipment and medium based on generation type artificial intelligence | |
| CN115331795B (en) | Traditional Chinese medicine central pharmacy management system | |
| CN207882367U (en) | A kind of electron device testing instrument | |
| CN105225132A (en) | A kind of marketing method for anti-counterfeit based on cigarette Quick Response Code | |
| CN105892431B (en) | Automatic reading code method | |
| CN113592870A (en) | Printing defect detection method based on self-adaptive focal length | |
| CN113627549A (en) | Method, device and equipment for detecting abnormal time sequence hopping |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170222 |
|
| RJ01 | Rejection of invention patent application after publication |