CN102708149A - Data quality management method and system - Google Patents

Data quality management method and system Download PDF

Info

Publication number
CN102708149A
CN102708149A CN2012100985837A CN201210098583A CN102708149A CN 102708149 A CN102708149 A CN 102708149A CN 2012100985837 A CN2012100985837 A CN 2012100985837A CN 201210098583 A CN201210098583 A CN 201210098583A CN 102708149 A CN102708149 A CN 102708149A
Authority
CN
China
Prior art keywords
quality
data
user
storehouse
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012100985837A
Other languages
Chinese (zh)
Inventor
余宇峰
万定生
朱跃龙
张建新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hohai University HHU
Original Assignee
Hohai University HHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hohai University HHU filed Critical Hohai University HHU
Priority to CN2012100985837A priority Critical patent/CN102708149A/en
Publication of CN102708149A publication Critical patent/CN102708149A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • General Factory Administration (AREA)

Abstract

The invention discloses a data quality management method and a data quality management system. The data quality management method comprises the following steps: managing a quality knowledge library; analyzing the data quality characteristics, and presetting a quality problem domain, a quality dimension domain, a quality rule domain and a quality standard domain; collecting quality information: selecting the quality dimension and the quality rules required by a user from the quality knowledge library, and extracting a data set meeting the user requirements from the original data sets; evaluating the data quality: evaluating the data quality according to the collected quality information, and generating and submitting a data quality report to the user or a quality manager according to the quality problem domain and the quality standard domain in the quality knowledge library; and improving the data quality: correcting the data quality problem detected in the evaluation of the data quality for improvement. The data quality management method and the data quality management system are applied to monitoring, evaluating and continuously improving the data quality in the whole hydrology industry based on the whole data processing procedure of the hydrology industry.

Description

The data quality management method and system
Technical field
The present invention relates to the data quality management method and system, particularly hydrology industry data quality management method and system.
Background technology
S National Hydrologic Database is important national conditions basic database and strategic information resource database; Being the foundation of all water thing activity decision-makings in the development of the national economy and the social development, also is the main information product that hydrology industry is served fields such as society, economy, environment, ecology and national defence.For many years, because the data storage standard of lack of uniform makes that various places hydrology data storage form is different, the hydrological data bank present situation far can not satisfy the social development needs.Therefore, must accelerate the construction of s National Hydrologic Database, for the scientific research and the engineering construction of socio-economic development, the problem of paddling provides the informix service based on modern information technologies better.
The quality of s National Hydrologic Database directly influences the correctness of relevant decision-making, is the soul through s National Hydrologic Database construction operation overall process.Press for design for this reason and develop the data quality management that a special data quality management system supports hydrology industry comprehensively, thereby this provides wide application prospect for how hydrology industry supports the data quality management Continual Improvement quality of data with information-based means.
Summary of the invention
Goal of the invention: to the problem and shortage of above-mentioned prior art existence; The purpose of this invention is to provide a kind of data quality management method and system; Be based on hydrology industry data processing overall process, be devoted to monitoring, the assessment of the whole hydrology industry quality of data and continue improvement.
Technical scheme: for realizing the foregoing invention purpose, first kind of technical scheme that the present invention adopts is a kind of data quality management method, comprises the steps:
(1) quality KBM: the data quality characteristic is analyzed, quality problems storehouse, quality dimensions storehouse, quality rule storehouse and quality standard storehouse are set in advance;
(2) quality information collection: in the quality knowledge base, select the quality dimensions and the quality rule of user's request, and from the concentrated data set of meeting consumers' demand that extracts of raw data;
(3) data quality accessment: the quality information according to gathering, carry out data quality accessment, and according to quality problems in the quality knowledge base and quality standard, generate quality of data report and submit to user or quality control officer;
(4) quality of data is improved: detected data quality problem in the data quality evaluation is revised and improved.
Also can comprise the steps:
(5) quality objective is confirmed: judge that whether the quality of data after improving reaches user's request, if reaching user's request then generates target data set, otherwise returns step (3).
In the said step (4), can adopt automatic and manual dual mode to revise and improve, but also recording quality improve log information.
Second kind of technical scheme that the present invention adopts is a kind of data quality management system, comprising:
The quality base module is used for the analysis of data quality characteristic is provided with quality problems storehouse, quality dimensions storehouse, quality rule storehouse and quality standard storehouse in advance;
The quality information acquisition module is used for quality dimensions and quality rule in quality base module selection user's request, and from the concentrated data set of meeting consumers' demand that extracts of raw data;
The data quality accessment module is used for the quality information according to the collection of quality information acquisition module, carries out data quality accessment, and according to quality problems in the quality base module and quality standard, generates quality of data report and submit to user or quality control officer;
The quality of data is improved module, is used for the detected data quality problem of data quality assessment modules is revised and improved.
In the quality base module, the quality problems storehouse: can deposit with hydrology data quality management process in run into or all kinds of problems that possibly run into, problem can classification, differentiated control and maintenance;
Quality (assessment) dimension storehouse: can deposit accuracy, consistance, integrality, promptness, the property obtained isometry index that hydrology data quality management is paid close attention to;
The quality rule storehouse: but the store data quality evaluation technical regulation related with detection, and quality rule is set up according to quality problems and quality index;
Quality standard storehouse: can deposit the judgment criteria whether up-to-standard to data.
Also can comprise quality objective affirmation module, be used to judge whether the quality of data after the improvement reaches user's request, if reaching user's request then generates target data set, otherwise the return data quality assessment modules.
The said quality of data is improved module and can be adopted automatic and manual dual mode to revise and improve, but also recording quality improves log information.
Beneficial effect: the present invention can play useful facilitation effect towards hydrology industry data processing overall process to the comprehensive control and the lifting of the hydrology quality of data.Through data quality management provided by the invention system, thereby can guarantee that the data quality management Continual Improvement hydrology quality of data provides technical support for hydrology industry adopts information-based means.
Description of drawings
Fig. 1 is the structural framing figure according to the data quality management system of a specific embodiment of the present invention;
Fig. 2 is the data quality accessment process flow diagram according to a specific embodiment of the present invention;
Fig. 3 improves process flow diagram according to the quality of data of a specific embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing and specific embodiment; Further illustrate the present invention; Should understand these embodiment only be used to the present invention is described and be not used in the restriction scope of the present invention; After having read the present invention, those skilled in the art all fall within the application's accompanying claims institute restricted portion to the modification of the various equivalent form of values of the present invention.
The data stream of managing from the quality of data turns over journey, and system mainly ensures the quality of data in the s National Hydrologic Database through three aspects at present.
1, data source (collection, reorganization and typing) quality rule diagnosis;
2, the quality monitoring of data processing ETL (Extraction-Transformation-Loading, report, junction and dump) process;
3, each index rationality of data processing achievement, consistance are checked.
The data quality management system through to the inspection of data source (data acquisition, reorganization and typing), process (report, junction and dump), three aspects of processing achievement with check, realized monitoring to the whole process of data production process.After data were produced and accomplished, system can be according to assessment result automatically generated data quality report, and the structural framing of total system is as shown in Figure 1.
The quality knowledge base has comprised interior requiring of data on key elements such as quality problems, quality index, quality rule and quality standard, system constructing a comprehensive quality of data knowledge base, and carry out quality evaluation and quality improvement as the center.System has the assessment of automated quality information acquisition, automated quality, problem identification and quality report, automatically and the functions such as quality improvement that manually combine automatically, has greatly improved the efficient and the level of data quality management.This system adopts the infosystem instrument to carry out data quality management for hydrology industry and is with a wide range of applications.
The quality knowledge base through data quality characteristic analysis result is provided with in advance, comprises knowledge of Quality management such as data quality problem typelib, quality evaluation dimension storehouse, quality rule storehouse and quality standard storehouse by the quality control officer.
Information acquisition module is collected the user to original demands information such as data object and scope, quality of data index and quality of data requirements; And, in the quality knowledge base, select suitable evaluation index, Rules of Assessment and appraisal procedure, the data set of meeting consumers' demand that from raw data base, extracts according to user's request information; And above-mentioned information is passed to quality assessment modules as input carry out data quality accessment.
The data quality accessment module is the corn module of data quality management; This module is according to data set, assessment dimension, Rules of Assessment and the algorithm of information acquisition module and the transmission of quality knowledge base, and the quality evaluation standard of regularly carrying out in data quality accessment and the bond quality knowledge base generates the quality evaluation report; The data quality accessment report comprises the detailed bill and the quality improvement proposed projects of pending quality problems; The quality evaluation report is submitted to quality control officer or user with automated manner.
The quality of data is improved module and is comprised automatic and manual dual mode, and automated quality improves according to the quality improvement processing rule in the quality knowledge base and accomplishes the data quality problem processing automatically; Manually quality improvement bond quality assessment report adopts manual intervention patterns such as the expert appraises through discussion, user feedback, manually accomplishes the quality of data and improves processing; Recording quality problem improvement project and step.
Data quality management is a dynamic process, and therefore, the content of storing in the quality knowledge base will be carried out dynamic optimization with quality evaluation and QIP and upgraded.
The data quality management system mainly carries out quality management and monitoring from the different aspects such as form, content and effectiveness of data to data source (database, excel, text etc.), data converted products (Water Year Book, data warehouse, data cube etc.) and data handling procedure (data preparation and typing, data report and junction, data dump and Data Update, data backup and recovery etc.).
The quality knowledge base, is comprised through data quality characteristic analysis result is provided with in advance by the quality control officer:
Quality problems storehouse: the Problem Areas of sending out the type generation that produces data quality problem according to oneself;
The quality dimensions storehouse: data satisfy the fundamental characteristics tolerance of customer requirements and application target on form, content and effectiveness; Like integrality, consistance etc.;
The quality standard storehouse: data are in the judgment criteria of aspect quality grades such as form, content and effectiveness;
Quality rule storehouse: manage all quality of data relevant rules with quality evaluation, quality improvement and statistical study.These rules have contained form, content and the effectiveness requirement of data, and different quality metrics need adopt different grammers to come the describing mass rule.
Corresponding data hierarchy, quality metric, tolerance applicable object and scope, quality rule content and the instance of quality of data rule explained referring to shown in the table 1:
Table 1
Figure BDA0000150041810000051
The data quality accessment module is the core component in the data quality management system.To be the estimator be applied to the quality of data evaluation model target data or data set and finally obtain the series of steps of evaluation object quality state in quality of data evaluation procedure.The general flow that the hydrology quality of data is estimated is as shown in Figure 2.
The data quality accessment process is an iterative process, and the sequencing of each process is the active general sequence of expression phase only, and according to the quality decision of actual implementation status, some processes possibly repeat.
1), quality information collection: data quality accessment should be that guiding is carried out the quality evaluation analysis with user; Data resource is different from entity products; Have characteristics such as purposes personalization, variation, instability; Therefore, the user must be at first understood and assessment indicator system targetedly could be set up to also definite its evaluation object of the demand characteristic of particular data resource and scope thereof.
2), select the quality evaluation dimension: quality of data dimension is to carry out the concrete tolerance reflection of object in the quality activity; Like correctness, accuracy etc.; It is the main contents of control and evaluating data quality; Therefore, from the quality knowledge base, choose can survey, available quality dimensions are as evaluation index.Select the quality evaluation dimension should note level, the weight problem of each evaluation index, and with the collision problem of other same level index.
3), set up assessment models:,, select suitable quality evaluation algorithm to set up the quality evaluation model in conjunction with the characteristics of each evaluation object and evaluative dimension in definite its object range and after selecting the quality evaluation dimension.Quality evaluation algorithm commonly used has two kinds of quilitative method and quantivative approachs, and the former adopts method such as weight marking to carry out, and the latter carries out according to the specifications of quality one-level defective criterion in information each stage of production.
4), quality evaluation: data quality accessment is the active procedure that the quality object, quality object range and the quality evaluation model that utilize above-mentioned steps to confirm realized quality assessment.The method that should guarantee in the data quality accessment process to be adopted correct and objective; Avoid increasing the disturbing factor of quality assessment as far as possible; Farthest handle and realize, pursue comprehensively the objectively truth of the reflection quality of data by the robotization of computing machine and network technology.
5), assessment report: combine quality evaluation target in the knowledge base, analyze the quality requirements whether quality assessment result reaches the user, generate respective quality rank qualification result according to the quality discrimination standard; The data quality accessment report also comprises the detailed bill and the quality improvement proposed projects of pending quality problems; The quality evaluation report is submitted to quality control officer or user with automated manner.
Quality of data improvement technology relates generally to instance and two aspects of pattern.The mode layer quality of data improves and mainly to stress to understand data pattern and according to existing data instance design data pattern again; The common employing of instance layer quality of data raising data cleansing is through the improvement and the raising of repeating objects detection, missing data processing, abnormal data detection, logic error detection, the inconsistent data process etc. techniques realization quality of data.
The quality of data is improved module and is mainly paid close attention to the improvement of the instance layer quality of data, promptly accomplishes the quality of data through data scrubbing and improves, and the quality of data is improved and comprised automatic and manual dual mode.The improved general flow of the hydrology quality of data is as shown in Figure 3.
Automated quality improves according to the quality problems inventory that produces in the quality evaluation process, improves processing rule and the processing of quality improvement algorithm completion data quality problem from the knowledge base quality of match automatically.Automated quality is improved one's methods can accomplish duplicate record cleaning and check automatically, missing data cleans with fill up, quality problems such as logic error correction, inconsistent data processing; And quality of data improvement information write down into daily record storehouse.
Manually quality improvement bond quality assessment report adopts manual intervention patterns such as the expert appraises through discussion, user feedback, manually accomplishes the quality of data and improves processing, and quality of data improvement information is write down into daily record storehouse.Manually the quality improvement method is accomplished automated quality and is improved the quality problems that step can't be handled, and according to manual QIP, step and expertise, generates new quality improvement rule and algorithm and upgrades the quality knowledge base.
Quality improvement daily record storehouse is used to write down the information relevant with quality improvement, comprises the contents such as data relativity, quality improvement rule and algorithm of quality improvement front and back.
Hydrology data quality management is one and relates to application-dependent and use the independent dynamic change procedure.Therefore, in whole data life period, original data quality problem has solved, and finds to have new quality problems toward the contact meeting.Quality objective is confirmed module, is used to judge whether the data set quality of data after the improvement reaches user's request.If do not reach customer requirements through the improved quality of data, system returns the quality evaluation stage and carries out the next round quality control.

Claims (8)

1. a data quality management method comprises the steps:
(1) quality KBM: the data quality characteristic is analyzed, quality problems storehouse, quality dimensions storehouse, quality rule storehouse and quality standard storehouse are set in advance;
(2) quality information collection: in the quality knowledge base, select the quality dimensions and the quality rule of user's request, and from the concentrated data set of meeting consumers' demand that extracts of raw data;
(3) data quality accessment: the quality information according to gathering, carry out data quality accessment, and according to quality problems in the quality knowledge base and quality standard, generate quality of data report and submit to user or quality control officer;
(4) quality of data is improved: detected data quality problem in the data quality evaluation is revised and improved.
2. according to the said data quality management method of claim 1, it is characterized in that: also comprise the steps:
(5) quality objective is confirmed: judge that whether the quality of data after improving reaches user's request, if reaching user's request then generates target data set, otherwise returns step (3).
3. according to the said data quality management method of claim 1, it is characterized in that: in the said step (4), adopt automatic and manual dual mode to revise and improve.
4. according to the said data quality management method of claim 1, it is characterized in that: in the said step (4), go back recording quality and improve log information.
5. data quality management system comprises:
The quality base module is used for the analysis of data quality characteristic is provided with quality problems storehouse, quality dimensions storehouse, quality rule storehouse and quality standard storehouse in advance;
The quality information acquisition module is used for quality dimensions and quality rule in quality base module selection user's request, and from the concentrated data set of meeting consumers' demand that extracts of raw data;
The data quality accessment module is used for the quality information according to the collection of quality information acquisition module, carries out data quality accessment, and according to quality problems in the quality base module and quality standard, generates quality of data report and submit to user or quality control officer;
The quality of data is improved module, is used for the detected data quality problem of data quality assessment modules is revised and improved.
6. according to the said data quality management of claim 5 system; It is characterized in that: also comprise quality objective affirmation module; Be used to judge whether the quality of data after the improvement reaches user's request, if reaching user's request then generates target data set, otherwise the return data quality assessment modules.
7. according to the said data quality management of claim 5 system, it is characterized in that: the said quality of data is improved module and is adopted automatic and manual dual mode to revise and improve.
8. according to the said data quality management of claim 5 system, it is characterized in that: the said quality of data is improved also recording quality improvement log information of module.
CN2012100985837A 2012-04-01 2012-04-01 Data quality management method and system Pending CN102708149A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012100985837A CN102708149A (en) 2012-04-01 2012-04-01 Data quality management method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012100985837A CN102708149A (en) 2012-04-01 2012-04-01 Data quality management method and system

Publications (1)

Publication Number Publication Date
CN102708149A true CN102708149A (en) 2012-10-03

Family

ID=46900916

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012100985837A Pending CN102708149A (en) 2012-04-01 2012-04-01 Data quality management method and system

Country Status (1)

Country Link
CN (1) CN102708149A (en)

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103776431A (en) * 2014-01-23 2014-05-07 北京科技大学 Visualization method of navigation channel hydrologic monitoring information in multi-depth layers
CN104102875A (en) * 2014-07-22 2014-10-15 河海大学 Software service quality monitoring method and system based on weighted naive Bayes classifier
CN104866619A (en) * 2015-06-09 2015-08-26 北京京东尚科信息技术有限公司 Data monitoring method and system for data warehouse
CN105139296A (en) * 2015-10-12 2015-12-09 国家电网公司 Power grid business data full life cycle quality management system
CN105550511A (en) * 2015-12-11 2016-05-04 北京锐软科技股份有限公司 Data quality evaluation system and method based on data verification technique
CN105976120A (en) * 2016-05-17 2016-09-28 全球能源互联网研究院 Electric power operation monitoring data quality assessment system and method
CN106354799A (en) * 2016-08-26 2017-01-25 河海大学 Subject data set multi-layer facet filtration method and system based on data quality
CN106447163A (en) * 2016-08-29 2017-02-22 安徽美图信息科技有限公司 Automatic detection system of data quality on the basis of fine logic classification technology
CN106503097A (en) * 2016-10-14 2017-03-15 国政通科技股份有限公司 A kind of method and system for improving the quality of data
CN106570633A (en) * 2016-11-04 2017-04-19 中软信息系统工程有限公司 Index system evaluation method based on weight design
CN107368855A (en) * 2017-07-25 2017-11-21 齐鲁工业大学 A kind of knowledge flow network class management system
CN107633257A (en) * 2017-08-15 2018-01-26 上海数据交易中心有限公司 Data Quality Assessment Methodology and device, computer-readable recording medium, terminal
CN108170707A (en) * 2017-11-22 2018-06-15 国政通科技股份有限公司 A kind of method and system of data quality checking
CN108876146A (en) * 2018-06-14 2018-11-23 国网山东省电力公司聊城供电公司 A kind of electric network data class assets management method and system
CN109144986A (en) * 2018-07-30 2019-01-04 上海电气集团股份有限公司 A kind of importance appraisal procedure of industrial equipment data
CN109254959A (en) * 2018-08-17 2019-01-22 广东技术师范学院 A kind of data evaluation method, apparatus, terminal device and readable storage medium storing program for executing
CN109684321A (en) * 2018-12-25 2019-04-26 江苏满运软件科技有限公司 Data quality management method, device, electronic equipment, storage medium
CN109815224A (en) * 2019-01-30 2019-05-28 美林数据技术股份有限公司 Data quality checking and the method and apparatus of cleaning
CN110046235A (en) * 2019-03-18 2019-07-23 阿里巴巴集团控股有限公司 A kind of knowledge base appraisal procedure, device and equipment
CN110147966A (en) * 2019-05-28 2019-08-20 国网经济技术研究院有限公司 Enterprise operation data quality management method
CN110427361A (en) * 2019-08-01 2019-11-08 万达信息股份有限公司 A kind of method of quality control and system for medical data
CN110737515A (en) * 2018-07-19 2020-01-31 阿里巴巴集团控股有限公司 data task instruction processing method, computer device and storage medium
CN111143335A (en) * 2019-11-13 2020-05-12 深圳市华傲数据技术有限公司 Data quality problem discovery method
CN111143334A (en) * 2019-11-13 2020-05-12 深圳市华傲数据技术有限公司 Data quality closed-loop control method
CN111179022A (en) * 2019-12-10 2020-05-19 华能集团技术创新中心有限公司 Industrial and commercial data processing system and method
CN112396343A (en) * 2020-11-30 2021-02-23 北京中电普华信息技术有限公司 Data quality checking method and device
CN113127459A (en) * 2019-12-31 2021-07-16 贵州医渡云技术有限公司 Data governance implementation method and device, readable medium and electronic equipment
CN113239126A (en) * 2021-05-11 2021-08-10 中国银行保险信息技术管理有限公司 Business activity information standardization scheme based on BOR method
CN113435803A (en) * 2021-08-30 2021-09-24 中国电力科学研究院有限公司 Method and device for collecting quality data in equipment production process
CN113537824A (en) * 2021-08-03 2021-10-22 南方电网数字电网研究院有限公司 Power grid data full link monitoring system
CN113780767A (en) * 2021-08-25 2021-12-10 中国人民解放军军事科学院战争研究院 Coupling system for general survey data acquisition and quality evaluation
CN114168573A (en) * 2020-09-10 2022-03-11 广东电网有限责任公司东莞供电局 Data quality governance technology based on programmable assembly
CN115019914A (en) * 2022-07-19 2022-09-06 深圳市指南针医疗科技有限公司 Data quality evaluation method, device, equipment and storage medium
CN115050479A (en) * 2022-04-12 2022-09-13 江南大学附属医院 Data quality evaluation method, system and equipment for multi-center research

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103776431B (en) * 2014-01-23 2015-10-28 北京科技大学 A kind of navigation channel hydrologic monitoring information visuallization method of many degree of depth aspect
CN103776431A (en) * 2014-01-23 2014-05-07 北京科技大学 Visualization method of navigation channel hydrologic monitoring information in multi-depth layers
CN104102875A (en) * 2014-07-22 2014-10-15 河海大学 Software service quality monitoring method and system based on weighted naive Bayes classifier
CN104102875B (en) * 2014-07-22 2017-05-03 河海大学 Software service quality monitoring method and system based on weighted naive Bayes classifier
CN104866619A (en) * 2015-06-09 2015-08-26 北京京东尚科信息技术有限公司 Data monitoring method and system for data warehouse
CN105139296A (en) * 2015-10-12 2015-12-09 国家电网公司 Power grid business data full life cycle quality management system
CN105550511B (en) * 2015-12-11 2018-02-09 北京锐软科技股份有限公司 A kind of quality of data evaluation system and method based on data check technology
CN105550511A (en) * 2015-12-11 2016-05-04 北京锐软科技股份有限公司 Data quality evaluation system and method based on data verification technique
CN105976120A (en) * 2016-05-17 2016-09-28 全球能源互联网研究院 Electric power operation monitoring data quality assessment system and method
CN106354799A (en) * 2016-08-26 2017-01-25 河海大学 Subject data set multi-layer facet filtration method and system based on data quality
CN106447163A (en) * 2016-08-29 2017-02-22 安徽美图信息科技有限公司 Automatic detection system of data quality on the basis of fine logic classification technology
CN106503097A (en) * 2016-10-14 2017-03-15 国政通科技股份有限公司 A kind of method and system for improving the quality of data
CN106570633A (en) * 2016-11-04 2017-04-19 中软信息系统工程有限公司 Index system evaluation method based on weight design
CN107368855A (en) * 2017-07-25 2017-11-21 齐鲁工业大学 A kind of knowledge flow network class management system
CN107633257A (en) * 2017-08-15 2018-01-26 上海数据交易中心有限公司 Data Quality Assessment Methodology and device, computer-readable recording medium, terminal
CN107633257B (en) * 2017-08-15 2020-04-17 上海数据交易中心有限公司 Data quality evaluation method and device, computer readable storage medium and terminal
CN108170707A (en) * 2017-11-22 2018-06-15 国政通科技股份有限公司 A kind of method and system of data quality checking
CN108876146A (en) * 2018-06-14 2018-11-23 国网山东省电力公司聊城供电公司 A kind of electric network data class assets management method and system
CN110737515A (en) * 2018-07-19 2020-01-31 阿里巴巴集团控股有限公司 data task instruction processing method, computer device and storage medium
CN110737515B (en) * 2018-07-19 2024-04-09 阿里巴巴集团控股有限公司 Processing method of data task instruction, computer equipment and storage medium
CN109144986A (en) * 2018-07-30 2019-01-04 上海电气集团股份有限公司 A kind of importance appraisal procedure of industrial equipment data
CN109254959A (en) * 2018-08-17 2019-01-22 广东技术师范学院 A kind of data evaluation method, apparatus, terminal device and readable storage medium storing program for executing
CN109684321A (en) * 2018-12-25 2019-04-26 江苏满运软件科技有限公司 Data quality management method, device, electronic equipment, storage medium
CN109815224A (en) * 2019-01-30 2019-05-28 美林数据技术股份有限公司 Data quality checking and the method and apparatus of cleaning
CN110046235A (en) * 2019-03-18 2019-07-23 阿里巴巴集团控股有限公司 A kind of knowledge base appraisal procedure, device and equipment
CN110147966A (en) * 2019-05-28 2019-08-20 国网经济技术研究院有限公司 Enterprise operation data quality management method
CN110427361A (en) * 2019-08-01 2019-11-08 万达信息股份有限公司 A kind of method of quality control and system for medical data
CN111143335A (en) * 2019-11-13 2020-05-12 深圳市华傲数据技术有限公司 Data quality problem discovery method
CN111143334A (en) * 2019-11-13 2020-05-12 深圳市华傲数据技术有限公司 Data quality closed-loop control method
CN111179022A (en) * 2019-12-10 2020-05-19 华能集团技术创新中心有限公司 Industrial and commercial data processing system and method
CN113127459A (en) * 2019-12-31 2021-07-16 贵州医渡云技术有限公司 Data governance implementation method and device, readable medium and electronic equipment
CN113127459B (en) * 2019-12-31 2023-08-29 贵州医渡云技术有限公司 Implementation method and device for data management, readable medium and electronic equipment
CN114168573A (en) * 2020-09-10 2022-03-11 广东电网有限责任公司东莞供电局 Data quality governance technology based on programmable assembly
CN112396343A (en) * 2020-11-30 2021-02-23 北京中电普华信息技术有限公司 Data quality checking method and device
CN113239126A (en) * 2021-05-11 2021-08-10 中国银行保险信息技术管理有限公司 Business activity information standardization scheme based on BOR method
CN113537824A (en) * 2021-08-03 2021-10-22 南方电网数字电网研究院有限公司 Power grid data full link monitoring system
CN113780767A (en) * 2021-08-25 2021-12-10 中国人民解放军军事科学院战争研究院 Coupling system for general survey data acquisition and quality evaluation
CN113780767B (en) * 2021-08-25 2023-12-29 中国人民解放军军事科学院战争研究院 General survey data acquisition and quality evaluation coupling system
CN113435803A (en) * 2021-08-30 2021-09-24 中国电力科学研究院有限公司 Method and device for collecting quality data in equipment production process
CN115050479A (en) * 2022-04-12 2022-09-13 江南大学附属医院 Data quality evaluation method, system and equipment for multi-center research
CN115019914A (en) * 2022-07-19 2022-09-06 深圳市指南针医疗科技有限公司 Data quality evaluation method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN102708149A (en) Data quality management method and system
WO2021135177A1 (en) Construction method and apparatus for energy data warehouse system
CN109376924A (en) A kind of method, apparatus, equipment and the readable storage medium storing program for executing of material requirements prediction
CN109767032A (en) A kind of business finance operation digital management optimization system based on data analysis
CN107844914B (en) Risk management and control system based on group management and implementation method
CN107506863A (en) One kind is based on big data power network physical assets O&M cost of overhaul Forecasting Methodology
WO2021135727A1 (en) Energy data warehouse system
CN118037469B (en) Financial management system based on big data
Cao Measuring sustainable development efficiency of urban logistics industry
Chen [Retracted] Construction Project Cost Management and Control System Based on Big Data
CN113254517A (en) Service providing method based on internet big data
Luo et al. Supply Chain Flexibility Evaluation Based on Matter‐Element Extension
Bu Logistics engineering optimization based on machine learning and artificial intelligence technology
CN114493535A (en) Asset model-based data center system for data driving
CN102855354B (en) Industrial-enterprise-oriented online multi-dimensional energy consumption data statistics modeling method
CN115689386A (en) Enterprise operation monitoring method based on knowledge graph and FP (Fabry-Perot) growth algorithm
Anderson et al. A Bayesian hierarchical assessment of night shift working for offshore wind farms
Yuan et al. Quantifying the bullwhip effect in a reverse supply chain: The impact of different forecasting methods
CN106649880A (en) Electric power statistical management system and method
Dong et al. Evaluation of Input‐Output Efficiency of Sports Industry Based on SWOT‐PEST Model
Pang et al. Research on the Construction of Financial Risk Platform Based on Big Data
Gawin et al. Towards a proficient business intelligence for energy efficiency domain–prerequisites and data sources
Mathew et al. A water utility industry conceptual asset management data warehouse model
Huang Design of Logistics Economic Management Measures System in the Era of Internet of Things
TW201301187A (en) Optimal financial statement analysis and stock picking information system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20121003