CN103473672A - System, method and platform for auditing metadata quality of enterprise-level data center - Google Patents
System, method and platform for auditing metadata quality of enterprise-level data center Download PDFInfo
- Publication number
- CN103473672A CN103473672A CN2013104574000A CN201310457400A CN103473672A CN 103473672 A CN103473672 A CN 103473672A CN 2013104574000 A CN2013104574000 A CN 2013104574000A CN 201310457400 A CN201310457400 A CN 201310457400A CN 103473672 A CN103473672 A CN 103473672A
- Authority
- CN
- China
- Prior art keywords
- data
- quality
- checking
- check
- platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a system, method and platform for auditing metadata quality of an enterprise-level data center. The system comprises a task defining module, an operation monitor module and a quality analysis module, the task defining module is provided with an audited data object source, or being bound with an audited data object and a template rule by using an existing audit template, the operation monitor module sets a real-time or timed scheduling mode, the audit results of different layers are checked in an audit result view after tasks are executed, the quality analysis module checks quality analysis reports which are applied to the data center and an analysis system and generated from the execution results of all the audit tasks.
Description
Technical field
The invention belongs to the data check application, relate to the data resource unified management to checking, be specifically related to metadata quality audit system, the auditing method at a kind of Enterprise Data center and check platform.
Background technology
For improving the management application level of data assets, the potential value of performance data assets, on the basis of Constructing data center and enterprise data model construction, must control standard by formulating a set of metadata management, and continued to optimize, from the Primary Construction metadata management is controlled standard and platform, to the metadata management robotization, advance, finally realize the standardization of data assets management and using, bring into play to greatest extent the value of data assets.
Due to domestic information starting evening, quality of data management and control is also just to obtain more and more in recent years the concern of enterprise in addition, the degree of ripeness deficiency of product on the whole, and domestic case is less.But the powerful advantages that has quality of data management and control can not be ignored.
Summary of the invention
The invention discloses a kind of Enterprise Data center metadata quality audit system, comprising:
The task definition module, the source data object that configuration is checked, or utilize the existing template of checking, data object and pattern rule are checked in binding;
The operation monitoring module, arrange in real time or scheduling mode regularly, checks the result of checking of different aspects after tasks carrying in checking result view;
The quality analysis module, check the Quality Analysis Report from respectively checking that task action result produces for data center and analysis system application.
Wherein, the task definition module is configured and manages the connection of source data object database, the importing and the data that realize manual file read, support browses and selects the manual data table of tables of data in database and importing as checking object, various types of templates of checking are provided, by selecting existing template to realize that certain type checks the foundation of task, what according to the rule of configuration, rule application is arranged in the task of checking checks object, by a series of new flow of task of checking of interface definition, realizing the generation of task.
Wherein, the operation monitoring module can be carried out Classification Management and concentrate and browse the existing task of checking according to user's visual angle, check task with real-time or mode executing data quality regularly, gather the execution result of checking the task of checking, and check the managing detailed catalogue of execution result, can check the log information of checking tasks carrying, the reason that auxiliary specified data quality problems produce.
Wherein, the quality analysis module realizes multiple conceptual data quality report, see clearly the quality of data of overall importance of information center, realize all detailed report as a result and Classifying Sum reports of checking task, understand the quality condition of such problem, realize that quality report is screened and checks according to time dimension, verification object etc.
The invention also discloses and adopt above-mentioned Enterprise Data center metadata quality audit system to carry out the method that the metadata quality is checked, comprise the steps:
1) source data object of checking well from the task definition block configuration, or utilize the existing template of checking, data object and pattern rule are checked in binding;
2) start and check from the operation monitoring module, arrange in real time or scheduling mode regularly, check the result of checking of different aspects after tasks carrying in checking result view;
3) quality analysis module is checked the Quality Analysis Report from respectively checking that task action result produces for data center and analysis system application.
Wherein, in step 1), the task definition module realizes connection management, checks template, newly-builtly checks, revises and check four functions, for the operation monitoring module provides the function of task definition, modification; The operation monitoring module provides checks time configuration, operation task and checks function as a result; The quality analysis module provide check check example report, check the dimension summary report, the overall report of quality health status and this four kinds of quality analysis report of data object summary report.
The invention also discloses and a kind ofly based on Enterprise Data center metadata quality, check platform, comprise and represent layer, application layer, data Layer and origin system layer, wherein represent that layer is main describes the methods that all types of user visit data quality is checked platform; Application layer is mainly described function interface and the input and output that all types of user usage data quality is checked platform; Data Layer has been contained the related all data of platform; Origin system layer correspondence included the Various types of data source of platform management in.
Wherein, application level function is contained task definition, operation monitoring and the large nucleus module of quality analysis three, and platform base subsidiary function (user management, function of search); The basic procedure of checking has connected the function of three large nucleus modules: the source data object of first checking well from the task definition block configuration, or utilize the existing template of checking, data object and pattern rule are checked in binding; Start and check from the operation monitoring module, finally check and check result; The quality analysis module can be checked all kinds of summary report.
Wherein, data Layer has been contained the related all data of platform, comprises metadatabase, origin system is carried out to data buffer area, system configuration information storehouse, the verification rule base of platform, the quality of the quality of data while checking checks that carrying out script storehouse, all kinds of quality checks that result data and platform check the corresponding quality report template base of ability.
Wherein, origin system layer correspondence included the Various types of data source of platform management in, mainly comprises: practice operating system, as transaction system, marketing system etc.; Data center's related system, as data extract platform, data warehouse etc.; Analysis application system, as basic data or the operational indicator data of three large analysis systems etc.
Application of the present invention has great significance for promoting the effect of data center in enterprise.
The accompanying drawing explanation
Fig. 1 is that the quality of data is checked the platform feature Organization Chart.
Embodiment
Enterprise Data center metadata quality auditing method, its core is that the metadata quality is checked rule system, comprises totally 11 of following two aspects.
one, basic data quality aspect
1, data integrity: each attribute of entity has clear and definite value, does not have the attribute of " sky " or " the unknown ";
2, data dependence: for some entity in database, their existence depends on other entity possibly, to such entity, will meet the foreign key reference integrality;
3, data uniqueness: meet the major key unique constraints, the value of one group of attribute in table is unique;
4, data validity: data will meet codomain and the definition of data effective range, or meet data layout and related constraint, guarantee that the value of entity attribute will be within user-defined effective range;
5, data promptness: the submission of data or obtain and meet the time requirement of service application to data;
6, non-duplicate record: whether exist a plurality of records to show the phenomenon of same entity.
two, operational indicator quality aspect
7, index logic compliance: the computation rule of operational indicator or result meet business verification rule;
8, index computational logic accuracy: the computational logic of index is correct, deviation not in the calculating of data and transfer process;
9, index bore consistance: between analysis system or the bore of internal indicator be consistent;
10, index cross validation: by the cross validation of abstract data and combined data, or the cross validation of available data and reference data, the situation of the judge quality of data;
11, the abnormal and undulatory property inspection of index.
The basic procedure of checking has connected the function of three large nucleus modules:
1) source data object of first checking well from the task definition block configuration, or utilize the existing template of checking, data object and pattern rule are checked in binding;
2) start and check from the operation monitoring module, arrange in real time or scheduling mode regularly, can in checking result view, check the result of checking of different aspects after tasks carrying;
3) quality analysis module can be checked the Quality Analysis Report from respectively checking that task action result produces for data center and analysis system application.
Wherein the task definition module realizes connection management, checks template, newly-builtly checks, revises and check four functions, for the operation monitoring module provides the function of task definition, modification.The operation monitoring module provides the function of checking time configuration, operation task and checking result.The quality analysis module provide check check example report, check the dimension summary report, the overall report of quality health status and this four kinds of quality analysis report of data object summary report.
Below reaching with reference to the accompanying drawings concrete case study on implementation is described in further detail the present invention again.
Accompanying drawing 1 is checked and has been comprised the function structure of platform and represented layer, application layer, data Layer, origin system layer for the quality of data of developing based on Enterprise Data center metadata quality auditing method.
1, represent layer: mainly describe the methods that all types of user visit data quality is checked platform.According to North China Power Telecommunication Network informatization requirement, the single-sign-on function that all types of user will provide by the North China Power Telecommunication Network door enters the quality of data and checks platform, and access platform offers user's rich client application module.
2, application layer: mainly describe function interface and input and output that all types of user usage data quality is checked platform.This layer function is contained task definition, operation monitoring and the large nucleus module of quality analysis three, and platform base subsidiary function (user management, function of search).The basic procedure of checking has connected the function of three large nucleus modules: the source data object of first checking well from the task definition block configuration, or utilize the existing template of checking, data object and pattern rule are checked in binding; Start and check from the operation monitoring module, finally check and check result; The quality analysis module can be checked all kinds of summary report.
3, data Layer: contained the related all data of platform, comprised metadatabase, origin system is carried out to data buffer area, system configuration information storehouse, the verification rule base of platform, the quality of the quality of data while checking check that carrying out script storehouse, all kinds of quality checks that result data and platform check the corresponding quality report template base of ability.
4, origin system layer: correspondence is included the Various types of data source of platform management in, mainly comprises: practice operating system, as transaction system, marketing system etc.; Data center's related system, as data extract platform, data warehouse etc.; Analysis application system, as basic data or the operational indicator data of three large analysis systems etc.
This project completes by realizing following action the enforcement that the quality of data is checked platform construction:
the definition quality of data is checked model, collects quality of data verification rule
At first needed the quality of data present situation at based on data center is investigated and analyzed before platform is implemented, then based on the investigation situation definition quality of data, check model, the verification rule based on these models are collected and the disposal data quality is checked.
The quality of data is checked model definition: check that for the Data classification situation in the data area of platform application and the quality of data requirement definition checks data model, meet the needs that all application are checked the data quality.
Quality of data verification rule arranges: the based on data model, collect and arrange data and the rule that in model, every concrete quality of data is checked, set up the quality of data and check rule base, meet the reference needs that the developer is analyzed, realizes and manage the data demand of checking.
the quality of data is checked the platform realization
The based on data quality is checked demand, carries out exploitation and construction that the quality of data is checked platform, and the function that the current period need to realize is as follows:
Task definition module: can be configured the connection of source data object database and manage, realize that the importing of manual file and data read, support to browse and select the manual data table of tables of data in database and importing as checking object.Various types of templates of checking are provided, by selecting existing template to realize that certain type checks the foundation of task, what according to the rule of configuration, rule application is arranged in the task of checking checks object, realizes the generation of task by the flow process in a series of new tasks of checking of interface definition.
Operation monitoring module: can realize according to user's visual angle, the existing task of checking being carried out Classification Management and being concentrated and browse, can realize checking task with real-time or mode executing data quality regularly, can realize gathering the execution result of checking the task of checking, and check the managing detailed catalogue of execution result, can realize checking the log information of checking tasks carrying, the reason that auxiliary specified data quality problems produce.
Quality analysis module: can realize multiple conceptual data quality report, see clearly the quality of data of overall importance of information center, can realize all detailed report as a result and Classifying Sum reports of checking task, understand the quality condition of such problem, realize that quality report is screened and checks according to time dimension, verification object etc.
realization is integrated with the metadata management platform, realizes that the unification of quality of data report represents
The current period implementation content also plans to realize that the quality of data checks the integrated of platform and metadata management platform, makes the user check that the quality of data checks main contents and the quality report of platform by the metadata management platform.
Claims (10)
1. an Enterprise Data center metadata quality audit system, is characterized in that, comprising:
The task definition module, the source data object that configuration is checked, or utilize the existing template of checking, data object and pattern rule are checked in binding;
The operation monitoring module, arrange in real time or scheduling mode regularly, checks the result of checking of different aspects after tasks carrying in checking result view;
The quality analysis module, check the Quality Analysis Report from respectively checking that task action result produces for data center and analysis system application.
2. Enterprise Data center metadata quality audit system according to claim 1, it is characterized in that: the task definition module is configured and manages the connection of source data object database, the importing and the data that realize manual file read, support browses and selects the manual data table of tables of data in database and importing as checking object, various types of templates of checking are provided, by selecting existing template to realize that certain type checks the foundation of task, what according to the rule of configuration, rule application is arranged in the task of checking checks object, by in a series of new flow of task of checking of interface definition, realizing the generation of task.
3. Enterprise Data center metadata quality audit system according to claim 1 and 2, it is characterized in that: the operation monitoring module can be carried out Classification Management and concentrate and browse the existing task of checking according to user's visual angle, check task with real-time or mode executing data quality regularly, gather the execution result of checking the task of checking, and check the managing detailed catalogue of execution result, can check the log information of checking tasks carrying, the reason that auxiliary specified data quality problems produce.
4. according to the described Enterprise Data center metadata of claim 1-3 any one quality audit system, it is characterized in that: the quality analysis module realizes multiple conceptual data quality report, see clearly the quality of data of overall importance of information center, realize all detailed report as a result and Classifying Sum reports of checking task, understand the quality condition of such problem, realize that quality report is screened and checks according to time dimension, verification object etc.
5. adopt the described Enterprise Data center metadata of claim 1-4 any one quality audit system to carry out the method that the metadata quality is checked, it is characterized in that, comprise the steps:
1) source data object of checking well from the task definition block configuration, or utilize the existing template of checking, data object and pattern rule are checked in binding;
2) start and check from the operation monitoring module, arrange in real time or scheduling mode regularly, check the result of checking of different aspects after tasks carrying in checking result view;
3) quality analysis module is checked the Quality Analysis Report from respectively checking that task action result produces for data center and analysis system application.
6. adopt method claimed in claim 5, it is characterized in that, in step 1), the task definition module realizes connection management, checks template, newly-builtly checks, revises and check four functions, for the operation monitoring module provides the function of task definition, modification; The operation monitoring module provides checks time configuration, operation task and checks function as a result; The quality analysis module provide check check example report, check the dimension summary report, the overall report of quality health status and this four kinds of quality analysis report of data object summary report.
7. check platform based on Enterprise Data center metadata quality for one kind, it is characterized in that: comprise and represent layer, application layer, data Layer and origin system layer, wherein represent the methods that the main description of layer all types of user visit data quality is checked platform; Application layer is mainly described function interface and the input and output that all types of user usage data quality is checked platform; Data Layer has been contained the related all data of platform; Origin system layer correspondence included the Various types of data source of platform management in.
8. according to claim 7ly based on Enterprise Data center metadata quality, check platform; it is characterized in that: application level function is contained task definition, operation monitoring and the large nucleus module of quality analysis three, and platform base subsidiary function (user management, function of search); The basic procedure of checking has connected the function of three large nucleus modules: the source data object of first checking well from the task definition block configuration, or utilize the existing template of checking, data object and pattern rule are checked in binding; Start and check from the operation monitoring module, finally check and check result; The quality analysis module can be checked all kinds of summary report.
9. check platform according to claim 7 or 8 is described based on Enterprise Data center metadata quality, it is characterized in that: data Layer has been contained the related all data of platform, comprises metadatabase, origin system is carried out to data buffer area, system configuration information storehouse, the verification rule base of platform, the quality of the quality of data while checking checks that carrying out script storehouse, all kinds of quality checks that result data and platform check the corresponding quality report template base of ability.
10. describedly based on Enterprise Data center metadata quality, check platform according to claim 7 or 8 or 9, it is characterized in that: origin system layer correspondence included the Various types of data source of platform management in, mainly comprise: practice operating system, as transaction system, marketing system etc.; Data center's related system, as data extract platform, data warehouse etc.; Analysis application system, as basic data or the operational indicator data of three large analysis systems etc.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013104574000A CN103473672A (en) | 2013-09-30 | 2013-09-30 | System, method and platform for auditing metadata quality of enterprise-level data center |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013104574000A CN103473672A (en) | 2013-09-30 | 2013-09-30 | System, method and platform for auditing metadata quality of enterprise-level data center |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103473672A true CN103473672A (en) | 2013-12-25 |
Family
ID=49798514
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013104574000A Pending CN103473672A (en) | 2013-09-30 | 2013-09-30 | System, method and platform for auditing metadata quality of enterprise-level data center |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103473672A (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104766151A (en) * | 2014-12-29 | 2015-07-08 | 国家电网公司 | Quality management and control method for electricity transaction data warehouses and management and control system thereof |
| CN104991814A (en) * | 2015-06-19 | 2015-10-21 | 北京奇虎科技有限公司 | Task execution result acquiring method and system |
| CN105761010A (en) * | 2016-02-24 | 2016-07-13 | 国网山东省电力公司 | Method and system for real-time monitoring of group enterprise audit based on real-time data acquisition |
| CN105824870A (en) * | 2016-01-15 | 2016-08-03 | 优品财富管理有限公司 | Classification and quality inspection method and system based on verification rules |
| CN106407216A (en) * | 2015-07-31 | 2017-02-15 | 国网能源研究院 | Clue tracing audition system developed on basis of semantic net construction path and construction method of clue tracing audition system |
| CN107958049A (en) * | 2017-11-28 | 2018-04-24 | 航天科工智慧产业发展有限公司 | A kind of quality of data checking and administration system |
| CN110109900A (en) * | 2018-01-26 | 2019-08-09 | 北京京东尚科信息技术有限公司 | Data auditing method, system, electronic equipment and readable storage medium storing program for executing |
| CN110347741A (en) * | 2019-07-18 | 2019-10-18 | 普元信息技术股份有限公司 | The system and its control method of the outputting result quality of data are effectively promoted in big data treatment process |
| CN110457666A (en) * | 2019-08-19 | 2019-11-15 | 亿企赢网络科技有限公司 | A kind of report form generation method, system and electronic equipment and storage medium |
| CN110807025A (en) * | 2019-10-24 | 2020-02-18 | 北京中科捷信信息技术有限公司 | Automatic data quality analysis and audit system |
| CN110851426A (en) * | 2019-11-19 | 2020-02-28 | 重庆华龙网海数科技有限公司 | Data DNA visualization relation analysis system and method |
| CN111143335A (en) * | 2019-11-13 | 2020-05-12 | 深圳市华傲数据技术有限公司 | Data quality problem discovery method |
| CN111159171A (en) * | 2019-12-31 | 2020-05-15 | 中国铁塔股份有限公司 | Data auditing method and system |
| CN111198902A (en) * | 2018-11-16 | 2020-05-26 | 长鑫存储技术有限公司 | Metadata management method and device, storage medium and electronic equipment |
| CN111416740A (en) * | 2020-03-16 | 2020-07-14 | 北京思特奇信息技术股份有限公司 | Auditing method, auditing system and electronic equipment |
| CN111539633A (en) * | 2020-04-26 | 2020-08-14 | 北京思特奇信息技术股份有限公司 | Service data quality auditing method, system, device and storage medium |
| CN112000656A (en) * | 2020-09-01 | 2020-11-27 | 北京天源迪科信息技术有限公司 | Intelligent data cleaning method and device based on metadata |
| CN112214532A (en) * | 2020-10-13 | 2021-01-12 | 北京思特奇信息技术股份有限公司 | Service data auditing method and related device |
| CN112306997A (en) * | 2019-07-23 | 2021-02-02 | 杭州中软安人网络通信股份有限公司 | Data quality management system |
| CN113010502A (en) * | 2019-12-19 | 2021-06-22 | 阿里巴巴集团控股有限公司 | Data quality auditing method, device, equipment and storage medium |
| CN113094406A (en) * | 2019-12-23 | 2021-07-09 | 内蒙古电力（集团）有限责任公司电力营销服务与运营管理分公司 | Power marketing data management method and system |
| CN113535701A (en) * | 2021-07-20 | 2021-10-22 | 北京达佳互联信息技术有限公司 | Method, device, medium and product for inspecting quality of warehouse |
| CN113591485A (en) * | 2021-06-17 | 2021-11-02 | 国网浙江省电力有限公司 | Intelligent data quality auditing system and method based on data science |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1566758A1 (en) * | 2004-02-18 | 2005-08-24 | AT&T Corp. | Implementing data quality using rule bases and knowledge engineering |
| CN101582790A (en) * | 2008-05-15 | 2009-11-18 | 华为技术有限公司 | Method, device and system for dynamic data audit and service entity fault detection |
-
2013
- 2013-09-30 CN CN2013104574000A patent/CN103473672A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1566758A1 (en) * | 2004-02-18 | 2005-08-24 | AT&T Corp. | Implementing data quality using rule bases and knowledge engineering |
| CN101582790A (en) * | 2008-05-15 | 2009-11-18 | 华为技术有限公司 | Method, device and system for dynamic data audit and service entity fault detection |
Non-Patent Citations (2)
| Title |
|---|
| 叶宇航: "电信数据质量管理与稽核研究", 《电信科学》 * |
| 梁燕: "电信企业数据稽核过程模型及其应用", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104766151A (en) * | 2014-12-29 | 2015-07-08 | 国家电网公司 | Quality management and control method for electricity transaction data warehouses and management and control system thereof |
| CN104991814A (en) * | 2015-06-19 | 2015-10-21 | 北京奇虎科技有限公司 | Task execution result acquiring method and system |
| CN106407216A (en) * | 2015-07-31 | 2017-02-15 | 国网能源研究院 | Clue tracing audition system developed on basis of semantic net construction path and construction method of clue tracing audition system |
| CN105824870A (en) * | 2016-01-15 | 2016-08-03 | 优品财富管理有限公司 | Classification and quality inspection method and system based on verification rules |
| CN105761010A (en) * | 2016-02-24 | 2016-07-13 | 国网山东省电力公司 | Method and system for real-time monitoring of group enterprise audit based on real-time data acquisition |
| CN107958049A (en) * | 2017-11-28 | 2018-04-24 | 航天科工智慧产业发展有限公司 | A kind of quality of data checking and administration system |
| CN107958049B (en) * | 2017-11-28 | 2021-09-14 | 航天科工智慧产业发展有限公司 | Data quality inspection management system |
| CN110109900A (en) * | 2018-01-26 | 2019-08-09 | 北京京东尚科信息技术有限公司 | Data auditing method, system, electronic equipment and readable storage medium storing program for executing |
| CN111198902A (en) * | 2018-11-16 | 2020-05-26 | 长鑫存储技术有限公司 | Metadata management method and device, storage medium and electronic equipment |
| CN111198902B (en) * | 2018-11-16 | 2023-06-16 | 长鑫存储技术有限公司 | Metadata management method and device, storage medium and electronic equipment |
| CN110347741A (en) * | 2019-07-18 | 2019-10-18 | 普元信息技术股份有限公司 | The system and its control method of the outputting result quality of data are effectively promoted in big data treatment process |
| CN110347741B (en) * | 2019-07-18 | 2023-05-05 | 普元信息技术股份有限公司 | System for effectively improving output result data quality in big data processing process and control method thereof |
| CN112306997A (en) * | 2019-07-23 | 2021-02-02 | 杭州中软安人网络通信股份有限公司 | Data quality management system |
| CN110457666A (en) * | 2019-08-19 | 2019-11-15 | 亿企赢网络科技有限公司 | A kind of report form generation method, system and electronic equipment and storage medium |
| CN110457666B (en) * | 2019-08-19 | 2023-09-01 | 亿企赢网络科技有限公司 | Report generation method, system, electronic equipment and storage medium |
| CN110807025A (en) * | 2019-10-24 | 2020-02-18 | 北京中科捷信信息技术有限公司 | Automatic data quality analysis and audit system |
| CN111143335A (en) * | 2019-11-13 | 2020-05-12 | 深圳市华傲数据技术有限公司 | Data quality problem discovery method |
| CN110851426A (en) * | 2019-11-19 | 2020-02-28 | 重庆华龙网海数科技有限公司 | Data DNA visualization relation analysis system and method |
| CN113010502B (en) * | 2019-12-19 | 2023-12-26 | 阿里巴巴集团控股有限公司 | Data quality auditing method, device, equipment and storage medium |
| CN113010502A (en) * | 2019-12-19 | 2021-06-22 | 阿里巴巴集团控股有限公司 | Data quality auditing method, device, equipment and storage medium |
| CN113094406A (en) * | 2019-12-23 | 2021-07-09 | 内蒙古电力（集团）有限责任公司电力营销服务与运营管理分公司 | Power marketing data management method and system |
| CN111159171A (en) * | 2019-12-31 | 2020-05-15 | 中国铁塔股份有限公司 | Data auditing method and system |
| CN111416740B (en) * | 2020-03-16 | 2022-03-25 | 北京思特奇信息技术股份有限公司 | Auditing method, auditing system and electronic equipment |
| CN111416740A (en) * | 2020-03-16 | 2020-07-14 | 北京思特奇信息技术股份有限公司 | Auditing method, auditing system and electronic equipment |
| CN111539633A (en) * | 2020-04-26 | 2020-08-14 | 北京思特奇信息技术股份有限公司 | Service data quality auditing method, system, device and storage medium |
| CN112000656A (en) * | 2020-09-01 | 2020-11-27 | 北京天源迪科信息技术有限公司 | Intelligent data cleaning method and device based on metadata |
| CN112214532A (en) * | 2020-10-13 | 2021-01-12 | 北京思特奇信息技术股份有限公司 | Service data auditing method and related device |
| CN113591485A (en) * | 2021-06-17 | 2021-11-02 | 国网浙江省电力有限公司 | Intelligent data quality auditing system and method based on data science |
| CN113535701B (en) * | 2021-07-20 | 2022-11-04 | 北京达佳互联信息技术有限公司 | Method, device, medium and product for inspecting quality of warehouse |
| CN113535701A (en) * | 2021-07-20 | 2021-10-22 | 北京达佳互联信息技术有限公司 | Method, device, medium and product for inspecting quality of warehouse |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103473672A (en) | System, method and platform for auditing metadata quality of enterprise-level data center | |
| Ejsmont et al. | Towards ‘Lean Industry 4.0 ʹ–Current trends and future perspectives | |
| CN112685385A (en) | Big data platform for smart city construction | |
| US8924402B2 (en) | Generating a test workload for a database | |
| CN104598376B (en) | The layering automatization test system and method for a kind of data-driven | |
| CN110321113B (en) | Integrated assembly line system taking project batches as standards and working method thereof | |
| US8706684B2 (en) | System and method for managing enterprise data | |
| CN111159191A (en) | Data processing method, device and interface | |
| CN110334274A (en) | Information-pushing method, device, computer equipment and storage medium | |
| CN106682096A (en) | Method and device for log data management | |
| US20160154840A1 (en) | Avoid double counting of mapped database data | |
| CN109753596B (en) | Information source management and configuration method and system for large-scale network data acquisition | |
| Wu et al. | Concinnity: A generic platform for big sensor data applications | |
| CN107103064A (en) | Data statistical approach and device | |
| CN106708965A (en) | Data processing method and apparatus | |
| CN106682099A (en) | Data storage method and device | |
| Ziemba et al. | Integration of domain ontologies in the repository of website evaluation methods | |
| CN107153702A (en) | A kind of data processing method and device | |
| CN110837496A (en) | Data quality management method and system based on dynamic sql | |
| CN116541372A (en) | Data asset management method and system | |
| Moloney et al. | Quality data for strategic infrastructure decisions in Ireland | |
| KR101365481B1 (en) | System for generating and managing a portal for program management | |
| CN101576981A (en) | Scene-type service system | |
| US20150363711A1 (en) | Device for rapid operational visibility and analytics automation | |
| CN115496337A (en) | Data system for supporting brain of enterprise |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20131225 |
|
| RJ01 | Rejection of invention patent application after publication |