CN104766151A - Quality management and control method for electricity transaction data warehouses and management and control system thereof - Google Patents
Quality management and control method for electricity transaction data warehouses and management and control system thereof Download PDFInfo
- Publication number
- CN104766151A CN104766151A CN201410838222.0A CN201410838222A CN104766151A CN 104766151 A CN104766151 A CN 104766151A CN 201410838222 A CN201410838222 A CN 201410838222A CN 104766151 A CN104766151 A CN 104766151A
- Authority
- CN
- China
- Prior art keywords
- data
- verification
- time
- management
- task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000005611 electricity Effects 0.000 title claims abstract description 25
- 238000004458 analytical method Methods 0.000 claims abstract description 14
- 238000012795 verification Methods 0.000 claims description 76
- 238000007726 management method Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 13
- 230000002159 abnormal effect Effects 0.000 claims description 7
- 230000007246 mechanism Effects 0.000 claims description 7
- 230000004913 activation Effects 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 claims description 5
- 238000012423 maintenance Methods 0.000 claims description 5
- 230000002123 temporal effect Effects 0.000 claims description 5
- 238000013480 data collection Methods 0.000 claims description 4
- 238000013523 data management Methods 0.000 claims description 3
- 238000013461 design Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 2
- 230000008713 feedback mechanism Effects 0.000 abstract description 3
- 238000003908 quality control method Methods 0.000 abstract description 2
- 238000009472 formulation Methods 0.000 abstract 1
- 238000005065 mining Methods 0.000 abstract 1
- 239000000203 mixture Substances 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000013499 data model Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000009412 basement excavation Methods 0.000 description 1
- 230000008033 biological extinction Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a quality management and control method for electricity transaction data warehouses and a management and control system thereof. The method comprises the following steps: defining checking metadata and checking rules; setting checking tasks; performing checking service; releasing a data checking result; and handling and tracking quality problems. According to the technical scheme of the invention, the rationality, consistency, integrality and timeliness of data are judged by aiming at a data set and through flexible definition of the checking rules, statistical and historical trend analysis is made on four management and control indicators, and a problem handling and tracking feedback mechanism is designed to facilitate quality control measure formulation by management personnel. After implementation, the system, as an important part of an electricity market data warehouse, provides a data quality guarantee for advanced analysis and mining application of the market.
Description
Technical field
The present invention relates to a kind of quality of data management-control method and system thereof of field of electric power automation, specifically relate to a kind of quality management-control method for electricity transaction data warehouse and managing and control system thereof.
Background technology
Along with the construction of intelligent grid and the development of electricity market, transaction management and control and business decision are developed into by original information management in the location of transaction operation system.For many years, the mass data of accumulation becomes the valuable source that company carries out market strategy analysis to system cloud gray model.Based on data warehouse technology, build Electricity market analysis system, for supporting the senior utilizations such as transaction management and control, market aid decision making and Market Trend analysis.Wherein, high-quality data are the preconditions supporting the application such as powerful decision optimization.Therefore in data warehouse framework, should apply independent of actual analysis, by platform tools, management and control be unified to the quality of data.
Data quality management (Data Quality Management), to refer to data from plan, obtain, store, share, safeguard, application, extinction life cycle each stage the Various types of data quality problems that may cause, carry out identifying, measure, monitor, a series of management activity such as early warning, and by the management level improving tissue, the quality of data is obtained to improve further.
The quality management and control instrument of existing information system is all generally for certain application is customized, is difficult to depart from business datum and independently exist.It verifies, and rule is also relative with check logic solidifies, and can not meet the demand freely customized by business personnel.In addition, data check result, lacks the function of proactive dissemination and notice, also the feedback of no problem solution link and tracking, and the quality prison that part achieves data shows, does not almost consider the control of quality problems.
Summary of the invention
For solving above-mentioned deficiency of the prior art, the object of this invention is to provide a kind of quality management-control method for electricity transaction data warehouse and managing and control system thereof, for data set, by verifying rule definition flexibly, carry out the judgement of data rationality, consistance and integrality and promptness, and four management and control indexs are added up and historical trending analysis, design problem process following feedback mechanism, is convenient to managerial personnel and formulates quality control method.After system realizes, as the important component part of electricity market data warehouse, advanced analysis and excavation application for market provide the guarantee of the quality of data.
The object of the invention is to adopt following technical proposals to realize:
The invention provides a kind of quality management-control method for electricity transaction data warehouse, its improvements are, described method comprises the steps
(1) definition verification metadata and verification rule;
(2) verification task is set;
(3) validate service is performed;
(4) distributing data check results;
(5) tracking quality problem is processed.
Further, in described step (1), comprise metadata information and arrange; Data item refers to the codomain of Data Warehouse table, and whether its metadata comprises non-NULL verification, zero verification, carry out range check, maximal value, minimum value and quote range check; Data set refers to a table in data warehouse, and its metadata comprises data frequency, time format and data set and safeguards people's information; By metadata information, realize the plausibility check of data itself.
Further, in described step (1), comprise and verification rule is set; Based on database table domain name technology, realize data warehouse model selector switch, support the setting of selection to data intensive data and filtercondition, formative dynamics query statement; Connect dynamic queries statement by operational symbol, realize the definition of data check rule; Metadata verification is by verification rule settings, and do not need to arrange regular expression, system directly calls metadata information.
Further, in described step (1), the definition of verification rule comprises the timing definition of promptness verification; Temporal expression comprises time type and time value; Time type comprises absolute time and relative time, the form of absolute time be Year/Month/Day/time/point; Relative time by hour in units of; Temporal expression applies in verification rule.
Further, in described step (2), verification task and one or more verification rule association, share task execution time and perform frequency.
Further, in described step (3), verification task is by background process intermittent scanning, if meet execution time requirement, then triggering tasks, the regular also actuating logic of verification of resolving association judges, and records check results.
Further, in described step (4), check results, in conjunction with message mechanism, by mail or short message interface, is sent to the maintenance people of data set automatically, reminds maintainer to process as early as possible.
Further, in described step (5), be solution Process Design feedback and the follow-up mechanism of the quality of data, strengthen the control intelligent to quality problems.
The present invention also provides a kind of managing and control system of the quality management-control method for electricity transaction data warehouse, and its improvements are, described system comprises:
<1> verifies rule and arranges module: comprise metadata information and arrange module, verification rule configuration module and promptness timing definition module, for the data item of setting data collection itself, same data set data item between and different pieces of information collection data item between data check regular;
<2> verifies task management module: for arranging verification task parameters, and described verification task parameters comprises the verification rule of association, verification type, alarm level, task execution time, alarm notification mode and notice time; An one or more verification rule of task association, verification rule shares a set of verification task parameters;
<3> validate service execution module: by the validate service engine on backstage, intermittent scanning verification task, to the task of meeting time requirement, reads the verification rule of its association, resolve and perform data query script and logical operation, preserving check results; Simultaneously by message mechanism, check results is distributed to data management staff;
<4> check results statistical module: the check results of data query collection, the rationality of statistics collection, consistance, integrality and promptness index, Ordination and historical trending analysis are carried out to it, finds the data paid close attention to;
<5> issue handling tracking module: for the rule not by verifying, managing and control system automatic Generating Problems process event, require that maintainer is after dealing with problems, the solution of typing event and settling time, and application carries out data check again; Again verify and completed by manual activation by quality management and control specific responsibility; If passed through, then recording events confirms mark, by following the tracks of link, and monitoring dealing of abnormal data situation.
Compared with immediate prior art, the excellent effect that technical scheme provided by the invention has is:
The technical matters that the present invention solves defines based on the metadata of data set, in conjunction with data Model Selection device, formula operation and promptness timing definition, achieves the flexible definition of data check rule.Based on the interface with SMS platform, mailing system, achieve the timely issue of check results, shorten the processing time of quality problems.Based on issue track feedback mechanism, achieve the tracking to data quality problem and examination, promote the subjective initiative of Resolving probiems further.
Da ta warehouse quality management-control method provided by the invention and system, mainly address the problem:
(1) defined by metadata, in conjunction with data Model Selection device and formula editors, realize the flexible definition of data check rule.By verifying rule, the check logic between setting data item, between data set, between data set and original service data, realizes data rationality, consistance and promptness and checks.Adopt the verification rule of the method definition, via task scheduling and timing services, realize the timing scan of the quality of data on backstage.
(2) by message mechanism, in conjunction with SMS platform and mailing system, the system that realizes pushes verification abnormal information automatically.Response time of abnormal information and deadline are monitored, impels abnormal data to be processed in time, impel problem data to be processed timely and effectively, ensure the reliability of electricity market data warehouse applications.
Accompanying drawing explanation
Fig. 1 is functional sequence schematic diagram of the present invention provided by the invention;
Fig. 2 is the process flow diagram of the quality of data provided by the invention verification engine;
Fig. 3 is the promptness check results surface chart of specific embodiment provided by the invention;
Fig. 4 is the processing flow chart of issue handling tracking module provided by the invention.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in further detail.
Technical matters to be solved by this invention defines based on the metadata of data set, in conjunction with elastic regulation expression formula, proposes the flexible define method of data check rule.Adopt the verification rule of the method definition, via task scheduling, realize the intermittent scanning of the quality of data on backstage.Scanning result, through short message interface or mail interface, is sent to corresponding data maintenance personnel in time, impels problem data to be processed timely and effectively, ensures the reliability of electricity market data warehouse applications.
Functional flow diagram of the present invention as shown in Figure 1, comprises the steps:
(1) verification rule is set.The metadata information of setting data collection and data item, based on dynamic data retrieval statement and operational symbol definition verification rule, the configuration of the data check rule between the data item realizing the data item of data set itself, same data set, between the data item of different pieces of information collection.The range of choices of data set comprises the relation table of fact table, dimension table and service source system.
(2) verification task is managed.A task associates one or more rule.In task, setting target type, alarm level, task execution time, alarm notification time delay, alarm notification mode etc.Task execution time can be selected to meet and be postponed festivals or holidays.Festivals or holidays, parameter, was arranged in static parameter management.All tasks are called by validate service.The process flow diagram that validate service calls as shown in Figure 2.Verification type comprises " plausibility check ", " consistency desired result ", " completeness check " and " promptness verification ".Alarm level comprises " generally ", " alarm ", " seriously ".Alarm notification mode comprises note and mail, and the notice time comprises " immediately ", " point on the same day eight " or " the earliest working day eight point ".
(3) validate service is performed.All verification tasks are by backstage Resident Process intermittent scanning, if meet task execution time requirement, then triggering tasks, scans corresponding data, and result is stored in quality information table.According to alarm delay time and alarm notification mode, generating messages release tasks.When the time meets, by SMS platform interface or mailing system interface, by the verification rule name of in-problem dataset name and use, be sent to data management staff in time.
(4) check results statistical study.For check results, using " verification rule ", " time ", " data set ", " data maintenance people " etc. as analysis dimension, the most easily there is the link of quality problems from different angle analysis and displaying, help quality management specific responsibility to determine the data paid close attention to.
(5) issue handling is followed the tracks of.For the verification rule do not passed through, system automatic Generating Problems process event, after maintainer solves, the solution of typing event in systems in which and settling time, and application carries out data check again.Again verify and completed by manual activation by quality management and control specific responsibility.If verification is passed through, then typing " confirmation " marks.
The present invention also provides a kind of quality managing and control system for electricity transaction data warehouse, and described system comprises:
<1> verifies rule and arranges module: the data check between the data item for the data item of setting data collection itself, same data set, between the data item of different pieces of information collection is regular;
<2> verifies task management module: for arranging verification task parameters, and described verification task parameters comprises pointer type, alarm level, task execution time, alarm notification time delay and alarm notification mode; A task associates one or more rule;
<3> validate service execution module: for performing verification task, compiling and parsing verification rule, row operation of going forward side by side, preserves check results;
<4> check results statistical module: carry out statistical study to check results from multiple dimension, for finding the focal point of the quality of data.
<5> issue handling tracking module: system generates quality matter event automatically, requires solution and the settling time of recording events, and completes confirmation by manual activation verification task.By following the tracks of link, assist quality management and control specific responsibility, the efficiency of examination dealing of abnormal data.
Embodiment
1, the metadata information of data item is defined, for the plausibility check of data.Metadata information comprises " whether allowing sky ", " whether allowing zero ", " maximal value ", " minimum value ", " menu scope " isoparametric setting.The metadata of definition data set, comprises the parameters such as " data frequency ", " time format " verified for promptness, comprises the parameter of " the data set maintainer " for news release.
The extended metadata definition of table 1 data item
2, definition verification rule.Dynamic queries statement is connected by operational symbol.Data warehouse model selector switch is provided, based on database table domain name technology, realizes the selection of data set and data item.There is provided operational symbol sum functions selector switch, operational symbol comprises conventional mathematical operator, and function then provides conventional database syntax keyword, as " summation (", " grouping (" etc.After expression formula editor completes, system provides syntax check.
Example 1: power plant's electricity volume.Every 15 minutes data, should there be 96 data in a Tian Neiyige power plant.Verification Rule Expression is:
HAVING(D.v1)＝96
GROUP BY(to_char(D.t,’yyyymmdd’),D.p,D.a)
Example 2: total period electricity volume equal day part electricity volume and.
D.v1＝D.v2+D.v3+D.v4+D.v5
Where D.t=:param and D.a=' surfs the Net critical point electricity '
Illustrate: D represents data set, v1 represents the total electricity of data item, and v2 represents data item spike electricity, and v3 represents data item peak electricity, and v4 represents data item ordinary telegram amount, and v5 represents data item paddy electricity.In condition, the time major key of data set imports into when verifying tasks carrying, and the application of data set dimension major key is " online critical point electricity ".
3, promptness temporal expression is defined.Promptness checking time expression formula is according to fixed format set.The format specification of expression formula is as follows:
The explanation of table 2 promptness time format
Promptness expression formula example is as follows:
SbsResult.gen_time[null,null,’monthresult’]<＝
SbsResult.datatime[null,null,’monthresult’]+{1,’960H’} (1)；
SbsResult.gen_time[null,null,’monthresult’]<＝
{0,‘2014-11-0100:00:00’} (2)；
conResult.gen_time[null,null,’largeUser’]
<tradeResult.gen_time[null,null,’largeUser’]+{1,’240H’}
where conResult.trade_id＝tradeResult.trade_id (3)；
Formula (1) represents the generation time of data, should be less than+960 hours data service time.
The generation time of formula (2) registration certificate, must before the set time.
Formula (3) represents for same transaction, the rise time of contract, should after the transaction results rise time within 10 days.
4, verification task is managed.Newly-built verification task, for it associates one or more rule.Example is set to " checkout result completeness check task ".
● association verification rule: the record number=clearing unit number of monthly checkout result collection;
● pointer type: integrality;
● alarm level: alarm;
● task execution time: monthly ten days 2 points ,-1/-1/10/2/0;
● alarm notification mode: SMS notification;
● alarm notification time delay: the same day eight point;
5, validate service is performed.Background service was according to the interval of 1 hour, and all tasks of integral point scan round, if the execution time of the task of discovery is between last scan and present scan, or equal the present scan time, so triggering tasks performs.After being finished, continue next task of scanning, until all task scan terminate.
6, check results statistical module.Using " verification rule ", " time ", " data set ", " data maintenance people ", " pointer type " etc. as analysis dimension, the most easily there is the link of quality problems from different angle analysis and displaying, for finding the focal point of the quality of data.Such as, promptness check results surface chart as shown in Figure 3.
7, issue handling tracking module.System generates quality matter event automatically, the solution of recording events and settling time, and completes confirmation by manual activation verification task.By following the tracks of link, assist quality management and control specific responsibility, the efficiency of examination dealing of abnormal data.The processing flow chart of issue handling tracking module as shown in Figure 4.
Finally should be noted that: above embodiment is only in order to illustrate that technical scheme of the present invention is not intended to limit; although with reference to above-described embodiment to invention has been detailed description; those of ordinary skill in the field still can modify to the specific embodiment of the present invention or equivalent replacement; these do not depart from any amendment of spirit and scope of the invention or equivalent replacement, are all applying within the claims of the present invention awaited the reply.
Claims (9)
1. for a quality management-control method for electricity transaction data warehouse, it is characterized in that, described method comprises the steps:
(1) definition verification metadata and verification rule;
(2) verification task is set;
(3) validate service is performed;
(4) distributing data check results;
(5) tracking quality problem is processed.
2. quality management-control method as claimed in claim 1, is characterized in that, in described step (1), comprises metadata information and arranges; Data item refers to the codomain of Data Warehouse table, and whether its metadata comprises non-NULL verification, zero verification, carry out range check, maximal value, minimum value and quote range check; Data set refers to a table in data warehouse, and its metadata comprises data frequency, time format and data set and safeguards people's information; By metadata information, realize the plausibility check of data itself.
3. quality management-control method as claimed in claim 1, is characterized in that, in described step (1), comprises and arranges verification rule; Based on database table domain name technology, realize data warehouse model selector switch, support the setting of selection to data intensive data and filtercondition, formative dynamics query statement; Connect dynamic queries statement by operational symbol, realize the definition of data check rule; Metadata verification is by verification rule settings, and do not need to arrange regular expression, system directly calls metadata information.
4. quality management-control method as claimed in claim 1, is characterized in that, in described step (1), the definition of verification rule comprises the timing definition of promptness verification; Temporal expression comprises time type and time value; Time type comprises absolute time and relative time, the form of absolute time be Year/Month/Day/time/point; Relative time by hour in units of; Temporal expression applies in verification rule.
5. quality management-control method as claimed in claim 1, is characterized in that, in described step (2), verification task and one or more verification rule association, share task execution time and perform frequency.
6. quality management-control method as claimed in claim 1, is characterized in that, in described step (3), verification task by background process intermittent scanning, if meet execution time requirement, then triggering tasks, resolve the verification rule also actuating logic judgement of association, and record check results.
7. quality management-control method as claimed in claim 1, it is characterized in that, in described step (4), check results, in conjunction with message mechanism, by mail or short message interface, is sent to the maintenance people of data set automatically, reminds maintainer to process as early as possible.
8. quality management-control method as claimed in claim 1, is characterized in that, in described step (5), is solution Process Design feedback and the follow-up mechanism of the quality of data, strengthens the control intelligent to quality problems.
9. a managing and control system for the quality management-control method for electricity transaction data warehouse according to any one of claim 1-8, it is characterized in that, described system comprises:
<1> verifies rule and arranges module: comprise metadata information and arrange module, verification rule configuration module and promptness timing definition module, for the data item of setting data collection itself, same data set data item between and different pieces of information collection data item between data check regular;
<2> verifies task management module: for arranging verification task parameters, and described verification task parameters comprises the verification rule of association, verification type, alarm level, task execution time, alarm notification mode and notice time; An one or more verification rule of task association, verification rule shares a set of verification task parameters;
<3> validate service execution module: by the validate service engine on backstage, intermittent scanning verification task, to the task of meeting time requirement, reads the verification rule of its association, resolve and perform data query script and logical operation, preserving check results; Simultaneously by message mechanism, check results is distributed to data management staff;
<4> check results statistical module: the check results of data query collection, the rationality of statistics collection, consistance, integrality and promptness index, Ordination and historical trending analysis are carried out to it, finds the data paid close attention to;
<5> issue handling tracking module: for the rule not by verifying, managing and control system automatic Generating Problems process event, require that maintainer is after dealing with problems, the solution of typing event and settling time, and application carries out data check again; Again verify and completed by manual activation by quality management and control specific responsibility; If passed through, then recording events confirms mark, by following the tracks of link, and monitoring dealing of abnormal data situation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410838222.0A CN104766151A (en) | 2014-12-29 | 2014-12-29 | Quality management and control method for electricity transaction data warehouses and management and control system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410838222.0A CN104766151A (en) | 2014-12-29 | 2014-12-29 | Quality management and control method for electricity transaction data warehouses and management and control system thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104766151A true CN104766151A (en) | 2015-07-08 |
Family
ID=53647965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410838222.0A Pending CN104766151A (en) | 2014-12-29 | 2014-12-29 | Quality management and control method for electricity transaction data warehouses and management and control system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104766151A (en) |
Cited By (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105488632A (en) * | 2015-12-14 | 2016-04-13 | 国家电网公司 | Method and device for analyzing electric data based on dimensional model |
| CN105893214A (en) * | 2016-06-28 | 2016-08-24 | 国家电投集团河南电力有限公司技术信息中心 | Data quality centralized-monitoring method and device based on electric power enterprise ERP |
| CN105956036A (en) * | 2016-04-26 | 2016-09-21 | 中国银联股份有限公司 | Transaction quality analysis device and transaction quality analysis method |
| CN106549814A (en) * | 2015-09-17 | 2017-03-29 | 大唐移动通信设备有限公司 | The method of calibration and equipment of device parameter effectiveness |
| CN106600461A (en) * | 2016-12-15 | 2017-04-26 | 国网浙江宁波市鄞州区供电公司 | data verification method, device and equipment |
| CN107092694A (en) * | 2017-04-25 | 2017-08-25 | 杭州数梦工场科技有限公司 | The inspection task creating method and device of the quality of data |
| CN107609016A (en) * | 2017-08-03 | 2018-01-19 | 南京南瑞集团公司 | Electricity transaction data accuracy method of calibration based on expression parsing |
| CN107958049A (en) * | 2017-11-28 | 2018-04-24 | 航天科工智慧产业发展有限公司 | A kind of quality of data checking and administration system |
| CN108958899A (en) * | 2018-08-14 | 2018-12-07 | 安徽云才信息技术有限公司 | A kind of implementation method of micro services framework distributed transaction |
| CN108965384A (en) * | 2018-06-04 | 2018-12-07 | 温州市图盛科技有限公司 | A kind of electricity transaction management-control method and device based on block chain |
| CN109242445A (en) * | 2018-09-29 | 2019-01-18 | 广东中标数据科技股份有限公司 | System, the method and device of development management are carried out to data product lifecycle |
| CN109684321A (en) * | 2018-12-25 | 2019-04-26 | 江苏满运软件科技有限公司 | Data quality management method, device, electronic equipment, storage medium |
| CN109918271A (en) * | 2019-03-28 | 2019-06-21 | 上海中通吉网络技术有限公司 | Data quality monitoring method, system and storage medium |
| CN109978189A (en) * | 2019-03-26 | 2019-07-05 | 中国联合网络通信集团有限公司 | A kind of restorative procedure and device of mistake task |
| CN110008201A (en) * | 2019-04-09 | 2019-07-12 | 浩鲸云计算科技股份有限公司 | A kind of quality of data towards big data checks monitoring method |
| CN110019158A (en) * | 2017-11-13 | 2019-07-16 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of monitoring data quality |
| CN110245158A (en) * | 2019-06-10 | 2019-09-17 | 上海理想信息产业（集团）有限公司 | A kind of multi-source heterogeneous generating date system and method based on Flink stream calculation technology |
| CN110347741A (en) * | 2019-07-18 | 2019-10-18 | 普元信息技术股份有限公司 | The system and its control method of the outputting result quality of data are effectively promoted in big data treatment process |
| CN110427387A (en) * | 2019-08-12 | 2019-11-08 | 中国工商银行股份有限公司 | A kind of data consistency detection and device |
| CN110457371A (en) * | 2019-08-13 | 2019-11-15 | 杭州有赞科技有限公司 | Data managing method, device, storage medium and system |
| CN111553576A (en) * | 2020-04-20 | 2020-08-18 | 国电南瑞科技股份有限公司 | Data verification method, device and system suitable for electric power spot market |
| CN112015728A (en) * | 2020-09-08 | 2020-12-01 | 浙江惠瀜网络科技有限公司 | Method for automatically checking acquired data |
| CN112231312A (en) * | 2020-10-29 | 2021-01-15 | 山东超越数控电子股份有限公司 | Data quality verification method based on process |
| CN112231310A (en) * | 2020-10-15 | 2021-01-15 | 浪潮云信息技术股份公司 | Data checking and classifying processing system and method |
| CN112258175A (en) * | 2020-09-04 | 2021-01-22 | 国网浙江省电力有限公司 | Cloud platform-based electric power market electric charge settlement data supervision platform and use method thereof |
| CN112579578A (en) * | 2019-09-27 | 2021-03-30 | 中兴通讯股份有限公司 | Metadata-based data quality management method, device and system and server |
| CN112765138A (en) * | 2021-01-11 | 2021-05-07 | 北京洛塔信息技术有限公司 | Distributed service data verification system, method and device |
| CN113094406A (en) * | 2019-12-23 | 2021-07-09 | 内蒙古电力（集团）有限责任公司电力营销服务与运营管理分公司 | Power marketing data management method and system |
| CN114648337A (en) * | 2022-03-23 | 2022-06-21 | 中银金融科技有限公司 | Transaction data quality automatic analysis method and device |
| CN116069775A (en) * | 2023-04-06 | 2023-05-05 | 上海二三四五网络科技有限公司 | Data quality verification system and method for data warehouse |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101719237A (en) * | 2009-12-09 | 2010-06-02 | 南京联创科技集团股份有限公司 | Data quality monitoring method based on full service indicator rule allocation |
| CN101894319A (en) * | 2010-06-28 | 2010-11-24 | 中国烟草总公司湖南省公司 | Tobacco enterprise data quality management system and method |
| CN102799644A (en) * | 2012-06-28 | 2012-11-28 | 用友软件股份有限公司 | Dynamic database query system and method based on metadata |
| US20130055042A1 (en) * | 2011-08-31 | 2013-02-28 | Accenture Global Services Limited | Data quality analysis and management system |
| CN103473672A (en) * | 2013-09-30 | 2013-12-25 | 国家电网公司 | System, method and platform for auditing metadata quality of enterprise-level data center |
| CN103699693A (en) * | 2014-01-10 | 2014-04-02 | 中国南方电网有限责任公司 | Metadata-based data quality management method and system |
-
2014
- 2014-12-29 CN CN201410838222.0A patent/CN104766151A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101719237A (en) * | 2009-12-09 | 2010-06-02 | 南京联创科技集团股份有限公司 | Data quality monitoring method based on full service indicator rule allocation |
| CN101894319A (en) * | 2010-06-28 | 2010-11-24 | 中国烟草总公司湖南省公司 | Tobacco enterprise data quality management system and method |
| US20130055042A1 (en) * | 2011-08-31 | 2013-02-28 | Accenture Global Services Limited | Data quality analysis and management system |
| CN102799644A (en) * | 2012-06-28 | 2012-11-28 | 用友软件股份有限公司 | Dynamic database query system and method based on metadata |
| CN103473672A (en) * | 2013-09-30 | 2013-12-25 | 国家电网公司 | System, method and platform for auditing metadata quality of enterprise-level data center |
| CN103699693A (en) * | 2014-01-10 | 2014-04-02 | 中国南方电网有限责任公司 | Metadata-based data quality management method and system |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106549814A (en) * | 2015-09-17 | 2017-03-29 | 大唐移动通信设备有限公司 | The method of calibration and equipment of device parameter effectiveness |
| CN106549814B (en) * | 2015-09-17 | 2019-07-23 | 大唐移动通信设备有限公司 | The method of calibration and equipment of device parameter validity |
| CN105488632A (en) * | 2015-12-14 | 2016-04-13 | 国家电网公司 | Method and device for analyzing electric data based on dimensional model |
| CN105956036A (en) * | 2016-04-26 | 2016-09-21 | 中国银联股份有限公司 | Transaction quality analysis device and transaction quality analysis method |
| WO2017185977A1 (en) * | 2016-04-26 | 2017-11-02 | 中国银联股份有限公司 | Transaction quality analysis device and transaction quality analysis method |
| CN105893214A (en) * | 2016-06-28 | 2016-08-24 | 国家电投集团河南电力有限公司技术信息中心 | Data quality centralized-monitoring method and device based on electric power enterprise ERP |
| CN106600461A (en) * | 2016-12-15 | 2017-04-26 | 国网浙江宁波市鄞州区供电公司 | data verification method, device and equipment |
| CN107092694A (en) * | 2017-04-25 | 2017-08-25 | 杭州数梦工场科技有限公司 | The inspection task creating method and device of the quality of data |
| CN107609016A (en) * | 2017-08-03 | 2018-01-19 | 南京南瑞集团公司 | Electricity transaction data accuracy method of calibration based on expression parsing |
| CN110019158A (en) * | 2017-11-13 | 2019-07-16 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus of monitoring data quality |
| CN107958049A (en) * | 2017-11-28 | 2018-04-24 | 航天科工智慧产业发展有限公司 | A kind of quality of data checking and administration system |
| CN107958049B (en) * | 2017-11-28 | 2021-09-14 | 航天科工智慧产业发展有限公司 | Data quality inspection management system |
| CN108965384A (en) * | 2018-06-04 | 2018-12-07 | 温州市图盛科技有限公司 | A kind of electricity transaction management-control method and device based on block chain |
| CN108958899A (en) * | 2018-08-14 | 2018-12-07 | 安徽云才信息技术有限公司 | A kind of implementation method of micro services framework distributed transaction |
| CN109242445A (en) * | 2018-09-29 | 2019-01-18 | 广东中标数据科技股份有限公司 | System, the method and device of development management are carried out to data product lifecycle |
| CN109684321A (en) * | 2018-12-25 | 2019-04-26 | 江苏满运软件科技有限公司 | Data quality management method, device, electronic equipment, storage medium |
| CN109978189A (en) * | 2019-03-26 | 2019-07-05 | 中国联合网络通信集团有限公司 | A kind of restorative procedure and device of mistake task |
| CN109918271A (en) * | 2019-03-28 | 2019-06-21 | 上海中通吉网络技术有限公司 | Data quality monitoring method, system and storage medium |
| CN110008201A (en) * | 2019-04-09 | 2019-07-12 | 浩鲸云计算科技股份有限公司 | A kind of quality of data towards big data checks monitoring method |
| CN110245158A (en) * | 2019-06-10 | 2019-09-17 | 上海理想信息产业（集团）有限公司 | A kind of multi-source heterogeneous generating date system and method based on Flink stream calculation technology |
| CN110347741B (en) * | 2019-07-18 | 2023-05-05 | 普元信息技术股份有限公司 | System for effectively improving output result data quality in big data processing process and control method thereof |
| CN110347741A (en) * | 2019-07-18 | 2019-10-18 | 普元信息技术股份有限公司 | The system and its control method of the outputting result quality of data are effectively promoted in big data treatment process |
| CN110427387A (en) * | 2019-08-12 | 2019-11-08 | 中国工商银行股份有限公司 | A kind of data consistency detection and device |
| CN110457371A (en) * | 2019-08-13 | 2019-11-15 | 杭州有赞科技有限公司 | Data managing method, device, storage medium and system |
| CN112579578A (en) * | 2019-09-27 | 2021-03-30 | 中兴通讯股份有限公司 | Metadata-based data quality management method, device and system and server |
| CN113094406A (en) * | 2019-12-23 | 2021-07-09 | 内蒙古电力（集团）有限责任公司电力营销服务与运营管理分公司 | Power marketing data management method and system |
| CN111553576A (en) * | 2020-04-20 | 2020-08-18 | 国电南瑞科技股份有限公司 | Data verification method, device and system suitable for electric power spot market |
| CN111553576B (en) * | 2020-04-20 | 2022-06-07 | 国电南瑞科技股份有限公司 | Data verification method, device and system suitable for electric power spot market |
| CN112258175A (en) * | 2020-09-04 | 2021-01-22 | 国网浙江省电力有限公司 | Cloud platform-based electric power market electric charge settlement data supervision platform and use method thereof |
| CN112015728A (en) * | 2020-09-08 | 2020-12-01 | 浙江惠瀜网络科技有限公司 | Method for automatically checking acquired data |
| CN112231310A (en) * | 2020-10-15 | 2021-01-15 | 浪潮云信息技术股份公司 | Data checking and classifying processing system and method |
| CN112231312A (en) * | 2020-10-29 | 2021-01-15 | 山东超越数控电子股份有限公司 | Data quality verification method based on process |
| CN112765138A (en) * | 2021-01-11 | 2021-05-07 | 北京洛塔信息技术有限公司 | Distributed service data verification system, method and device |
| CN114648337A (en) * | 2022-03-23 | 2022-06-21 | 中银金融科技有限公司 | Transaction data quality automatic analysis method and device |
| CN116069775A (en) * | 2023-04-06 | 2023-05-05 | 上海二三四五网络科技有限公司 | Data quality verification system and method for data warehouse |
| CN116069775B (en) * | 2023-04-06 | 2023-08-22 | 上海二三四五网络科技有限公司 | Data quality verification system and method for data warehouse |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104766151A (en) | Quality management and control method for electricity transaction data warehouses and management and control system thereof | |
| CN102340415B (en) | Server cluster system and monitoring method thereof | |
| US9712385B2 (en) | Managing configurations of distributed devices | |
| US20120310906A1 (en) | Building Information Tracking System and Method of Use | |
| US10079721B2 (en) | Integrated digital network management platform | |
| US7418453B2 (en) | Updating a data warehouse schema based on changes in an observation model | |
| CN102289460B (en) | Method and system for performing report metadata synchronization on testing environments | |
| CN109960635B (en) | Monitoring and alarming method, system, equipment and storage medium of real-time computing platform | |
| CN104866619A (en) | Data monitoring method and system for data warehouse | |
| CN110457371A (en) | Data managing method, device, storage medium and system | |
| WO2019076001A1 (en) | Information updating method and device | |
| CN114841714A (en) | Product traceability system based on block chain | |
| CN116205396A (en) | Data panoramic monitoring method and system based on data center | |
| CN114416703A (en) | Method, device, equipment and medium for automatically monitoring data integrity | |
| CN111699484A (en) | System and method for data management | |
| CN108319638A (en) | A kind of application holds the dangerous material manufacturing execution system of inspection device | |
| CN111881126A (en) | Big data management system | |
| CN116366651A (en) | APP-based configuration management optimization method | |
| CN105139296A (en) | Power grid business data full life cycle quality management system | |
| Nguyen et al. | Life and death of software packages: an evolutionary study of Debian | |
| CN113987015A (en) | Equipment asset state management method, system, equipment and storage medium | |
| CN112396349A (en) | Data quality monitoring method based on business entity | |
| CN110768859A (en) | Application health automatic detection method based on time sequence data | |
| CN105653305A (en) | Application software automatic update method, server, client side and system of same | |
| CN109670978A (en) | Visualize wisdom agricultural system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20150928 Address after: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Applicant after: State Grid Corporation of China Applicant after: STATE GRID SHANXI ELECTRIC POWER CO., LTD. Applicant after: China Electric Power Research Institute Applicant after: Jiangsu Electric Power Company Applicant after: State Grid Chongqing Electric Power Company Address before: 100031 Xicheng District West Chang'an Avenue, No. 86, Beijing Applicant before: State Grid Corporation of China Applicant before: China Electric Power Research Institute Applicant before: Jiangsu Electric Power Company Applicant before: State Grid Chongqing Electric Power Company |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150708 |