CN110599056A - Power data quality management method and system - Google Patents
Power data quality management method and system Download PDFInfo
- Publication number
- CN110599056A CN110599056A CN201910887102.2A CN201910887102A CN110599056A CN 110599056 A CN110599056 A CN 110599056A CN 201910887102 A CN201910887102 A CN 201910887102A CN 110599056 A CN110599056 A CN 110599056A
- Authority
- CN
- China
- Prior art keywords
- data
- evaluation
- rule
- category
- constraint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 25
- 238000011156 evaluation Methods 0.000 claims abstract description 63
- 238000013507 mapping Methods 0.000 claims abstract description 16
- 239000000284 extract Substances 0.000 claims abstract description 4
- 238000013441 quality evaluation Methods 0.000 claims description 6
- 238000003326 Quality management system Methods 0.000 claims description 4
- 238000001303 quality assessment method Methods 0.000 claims description 4
- 238000012795 verification Methods 0.000 claims description 4
- 230000005611 electricity Effects 0.000 claims description 3
- 238000012937 correction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000009469 supplementation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- General Physics & Mathematics (AREA)
- Development Economics (AREA)
- Health & Medical Sciences (AREA)
- Educational Administration (AREA)
- Marketing (AREA)
- Entrepreneurship & Innovation (AREA)
- Theoretical Computer Science (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Game Theory and Decision Science (AREA)
- Public Health (AREA)
- Water Supply & Treatment (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a power data quality management method, which comprises the following steps: step S1, the system receives the evaluation request information sent by the client and extracts the corresponding first data type of the first data contained in the evaluation request information; step S2, determining a first evaluation rule corresponding to the first data according to the first data category and a preset mapping relation in the evaluation request information; step S3, generating a first evaluation index corresponding to the first data according to a first evaluation rule; and step S4, sending the first evaluation index and the violation data to a client. The invention can ensure scientific, objective and effective management and evaluation of the quality of the power data.
Description
Technical Field
The invention relates to the technical field of power data quality management, in particular to a power data quality management method.
Background
In recent years, electric marketing business data is an important strategic resource of a power grid, and high-quality marketing business data is a premise and a basis for normal operation and practicability of an information marketing system. With the progress of marketing information items, the quality of marketing basic business data needs to be improved urgently.
According to the overall arrangement of marketing data quality management work of the headquarters of the national grid, the aim of the special research on marketing data quality management is to understand a data model of core services such as marketing basic archives, business expansion, copy and check, charging, accounting and the like of an electric power enterprise, analyze reasons influencing marketing data quality according to the current situation of the marketing data quality of a company, provide relevant measures for improving the marketing data quality, and gradually establish a long-term marketing data quality management mechanism. Marketing data quality management is a complex system project and has the characteristics of multiple related departments, wide service range, long time span, high promotion difficulty and the like, so that the marketing data quality management process is preferably developed in a staged and step-by-step orderly manner to find one block, solve one block and consolidate one block.
However, the power data has problems of non-specification of information and missing or serious errors. Such as: the loss of the customer credit rating and the important information, the non-conformity of the electronic file and the field, the loss of the equipment model and the manufacturer nameplate information, the non-standardization of the input information and the like bring great troubles to the management and the application of the subsequent circuit data. Therefore, how to scientifically, objectively and effectively manage and evaluate the quality of the power data and perform feedback reminding according to the actual quality so as to facilitate timely error correction and shortage supplementation of the power company is an important and urgent problem for the power company.
Disclosure of Invention
In view of the above, the present invention provides a power data quality management method, which can ensure scientific, objective and effective management and evaluation of power data quality.
In order to achieve the purpose, the invention adopts the following technical scheme:
a power data quality management method includes the following steps:
step S1, the system receives the evaluation request information sent by the client and extracts the corresponding first data type of the first data contained in the evaluation request information;
step S2, determining a first evaluation rule corresponding to the first data according to the first data category and a preset mapping relation in the evaluation request information;
step S3, generating a first evaluation index corresponding to the first data according to a first evaluation rule;
and step S4, sending the first evaluation index and the violation data to a client.
Further, the first data category includes: the customer information data comprises one or more of customer reputation information data, customer importance level information data, customer electricity utilization profile information data, user identity information data and electrical equipment information data.
Further, the preset mapping relationship includes one or more of a category of the data, an evaluation dimension corresponding to the data in the category, a constraint rule, and a checking rule.
Further, the preset mapping relation is updated according to one or more of evaluation dimension, constraint rule and check rule adopted by the user for the first data category in a historical preset time period.
Further, the quality assessment dimension includes accuracy, specifically:
wherein Q is the data accuracy; n represents the number of the evaluated data tables;representing the number of data violating the constraint rule in the data i;the number of the evaluated fields of the data table i is represented;the number of records in the data table i after redundancy removal is shown.
A power data quality management system comprising:
the receiving module is used for receiving evaluation request information sent by the client; the evaluation request information includes a category of the first data;
the determining unit is used for determining one or more of an evaluation dimension, a constraint rule and a checking rule corresponding to first data according to the category and the preset mapping relation of the first data in the evaluation request information; the preset mapping relation comprises one or more of the category of the data, historical evaluation dimension corresponding to the data in the category, constraint rule and check rule;
the generating unit is used for generating a first evaluation index corresponding to the first data according to one or more of data quality evaluation dimensionality, constraint rules and verification rules;
and the sending module is used for sending the first evaluation index and the violation data to the client.
Compared with the prior art, the invention has the following beneficial effects:
the invention can ensure scientific, objective and effective management and evaluation of the quality of the power data, and carry out feedback reminding according to the actual quality, thereby facilitating the timely error correction of the power company.
Drawings
FIG. 1 is a diagram illustrating an implementation of the steps of a power data quality management method according to an embodiment of the present invention;
fig. 2 is a diagram of a power data quality management system according to an embodiment of the present invention.
Detailed Description
The invention is further explained below with reference to the drawings and the embodiments.
Referring to fig. 1, the present invention provides a power data quality management method, including the following steps:
step S1, the system receives the evaluation request information sent by the client and extracts the corresponding first data type of the first data contained in the evaluation request information;
step S2, determining a first evaluation rule corresponding to the first data according to the first data category and a preset mapping relation in the evaluation request information;
step S3, generating a first evaluation index corresponding to the first data according to a first evaluation rule;
and step S4, sending the first evaluation index and the violation data to a client. The violation data includes data missing, data error, data non-specification, and the like.
In this embodiment, the first data category includes: the customer information data comprises one or more of customer reputation information data, customer importance level information data, customer electricity utilization profile information data, user identity information data and electrical equipment information data.
In this implementation, the preset mapping relationship includes one or more of a data type, a data quality evaluation dimension corresponding to the data in the data type, a constraint rule, and a verification rule. And updating the preset mapping relation according to one or more of evaluation dimension, constraint rule and check rule adopted by the user for the first data category in a historical preset time period.
Wherein the data quality assessment dimension comprises: timeliness, accuracy, compliance, consistency, or any combination thereof.
The constraint rules comprise timeliness constraint rules, integrity constraint rules, contractual constraint rules, accuracy constraint rules and consistency constraint rules. The timeliness constraint rule specifies the timeliness requirement of data generation and circulation, the integrity specifies the completion degree of data volume, the contractual constraint rule specifies that the data type in the evaluated data set meets the requirement of a field type predefined by a service system, and the accuracy represents whether the data meets a certain range or a certain dependency relationship.
In this embodiment, the system may determine that the manner of the evaluation rule a (including one or more of the corresponding evaluation dimension, the constraint rule, and the check rule) for the type of data corresponding to the first data reaches a certain ratio threshold according to a history within a period of time, such as a history of one month, for example: and if the rate is more than 80%, recommending one or more of the evaluation dimension, the constraint rule and the check rule corresponding to the rule to the user, sending a prompt whether the recommended evaluation rule is adopted or not to the user, adopting the recommended evaluation rule after the user determines, and manually selecting the responsive evaluation rule (comprising one or more of the evaluation dimension, the constraint rule and the check rule) if the user does not confirm.
In this embodiment, the quality evaluation dimension includes accuracy, specifically:
wherein Q is the data accuracy; n represents the number of the evaluated data tables;representing the number of data violating the constraint rule in the data i;the number of the evaluated fields of the data table i is represented;the number of records in the data table i after redundancy removal is shown. Specifically, a constraint rule corresponding to the accuracy may be defined as whether the data satisfies a logical relationship (greater than, less than, equal to).
A power data quality management system comprising:
the receiving module is used for receiving evaluation request information sent by the client; the evaluation request information includes a category of the first data;
the determining unit is used for determining one or more of an evaluation dimension, a constraint rule and a checking rule corresponding to first data according to the category and the preset mapping relation of the first data in the evaluation request information; the preset mapping relation comprises one or more of the category of the data, historical evaluation dimension corresponding to the data in the category, constraint rule and check rule;
the generating unit is used for generating a first evaluation index corresponding to the first data according to one or more of data quality evaluation dimensionality, constraint rules and verification rules;
and the sending module is used for sending the first evaluation index and the violation data to the client.
The above description is only a preferred embodiment of the present invention, and all equivalent changes and modifications made in accordance with the claims of the present invention should be covered by the present invention.
Claims (8)
1. A power data quality management method is characterized by comprising the following steps:
step S1, the system receives the evaluation request information sent by the client and extracts the corresponding first data type of the first data contained in the evaluation request information;
step S2, determining a first evaluation rule corresponding to the first data according to the first data category and a preset mapping relation in the evaluation request information;
step S3, generating a first evaluation index corresponding to the first data according to a first evaluation rule;
and step S4, sending the first evaluation index and the violation data to a client.
2. A power data quality management method according to claim 1, characterized by: the first data category includes: the customer information data comprises one or more of customer reputation information data, customer importance level information data, customer electricity utilization profile information data, user identity information data and electrical equipment information data.
3. A power data quality management method according to claim 1, characterized by: the preset mapping relation comprises one or more corresponding relations among the category of the data, the data quality evaluation dimension corresponding to the data under the category, the constraint rule and the checking rule.
4. A power data quality management method according to claim 3, characterized by: the data quality assessment dimension includes: timeliness, accuracy, compliance, consistency, or any combination thereof.
5. A power data quality management method according to claim 3, characterized by: the constraint rules comprise timeliness constraint rules, integrity constraint rules, contractual constraint rules, accuracy constraint rules and consistency constraint rules.
6. A power data quality management method according to claim 1, characterized by: and updating the preset mapping relation according to one or more of evaluation dimension, constraint rule and check rule adopted by the user for the first data category in a historical preset time period.
7. A power data quality management method according to claim 1, characterized by: the quality assessment dimension includes accuracy, specifically:
wherein Q is the data accuracy; n represents the number of the evaluated data tables;representing the number of data violating the constraint rule in the data i;the number of the evaluated fields of the data table i is represented;the number of records in the data table i after redundancy removal is shown.
8. A power data quality management system, comprising:
the receiving module is used for receiving evaluation request information sent by the client; the evaluation request information includes a category of the first data;
the determining unit is used for determining one or more of an evaluation dimension, a constraint rule and a checking rule corresponding to first data according to the category and the preset mapping relation of the first data in the evaluation request information; the preset mapping relation comprises one or more of the category of the data, historical evaluation dimension corresponding to the data in the category, constraint rule and check rule;
the generating unit is used for generating a first evaluation index corresponding to the first data according to one or more of data quality evaluation dimensionality, constraint rules and verification rules;
and the sending module is used for sending the first evaluation index and the violation data to the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910887102.2A CN110599056A (en) | 2019-09-19 | 2019-09-19 | Power data quality management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910887102.2A CN110599056A (en) | 2019-09-19 | 2019-09-19 | Power data quality management method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110599056A true CN110599056A (en) | 2019-12-20 |
Family
ID=68861129
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910887102.2A Pending CN110599056A (en) | 2019-09-19 | 2019-09-19 | Power data quality management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110599056A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070050364A1 (en) * | 2005-09-01 | 2007-03-01 | Cummins Fred A | System, method, and software for implementing business rules in an entity |
| CN105976120A (en) * | 2016-05-17 | 2016-09-28 | 全球能源互联网研究院 | Electric power operation monitoring data quality assessment system and method |
| CN107545349A (en) * | 2016-06-28 | 2018-01-05 | 国网天津市电力公司 | A kind of Data Quality Analysis evaluation model towards electric power big data |
| CN108665184A (en) * | 2018-05-21 | 2018-10-16 | 国网陕西省电力公司咸阳供电公司 | A kind of power customer credit assessment method based on big data reference |
-
2019
- 2019-09-19 CN CN201910887102.2A patent/CN110599056A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070050364A1 (en) * | 2005-09-01 | 2007-03-01 | Cummins Fred A | System, method, and software for implementing business rules in an entity |
| CN105976120A (en) * | 2016-05-17 | 2016-09-28 | 全球能源互联网研究院 | Electric power operation monitoring data quality assessment system and method |
| CN107545349A (en) * | 2016-06-28 | 2018-01-05 | 国网天津市电力公司 | A kind of Data Quality Analysis evaluation model towards electric power big data |
| CN108665184A (en) * | 2018-05-21 | 2018-10-16 | 国网陕西省电力公司咸阳供电公司 | A kind of power customer credit assessment method based on big data reference |
Non-Patent Citations (1)
| Title |
|---|
| 赵宏伟 等: "以业务需求为导向的数据质量管理模式研究", 《软件》, vol. 40, no. 1, 31 January 2019 (2019-01-31), pages 78 - 81 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wang | A product perspective on total data quality management | |
| US20150081374A1 (en) | Client-selectable power source options for network-accessible service units | |
| CN111124917B (en) | Method, device, equipment and storage medium for managing and controlling public test cases | |
| CN109685669A (en) | A kind of policy information data processing method and system | |
| Xiao et al. | Optimal salesforce compensation with supply–demand mismatch costs | |
| CN109582346A (en) | The management method of facility information model and example in electric system | |
| CN107146166B (en) | Distribution network planning auxiliary system | |
| CN113806400A (en) | Financial data processing method and device, storage medium and electronic equipment | |
| CN112365362A (en) | Method for protecting existing IT domain asset data based on power grid by adopting block chain technology | |
| CN110599056A (en) | Power data quality management method and system | |
| CN115603321B (en) | Power load prediction system and method based on power consumption data | |
| Wang | Risk-based security-constrained optimal power flow: Mathematical fundamentals, computational strategies, validation, and use within electricity markets | |
| CN110689219A (en) | Big data-based user behavior evaluation display method, device, equipment and medium | |
| CN113362191A (en) | Equipment application data processing method and device, computer equipment and storage medium | |
| CN112507686A (en) | User electricity price file management method and system, computer device and storage medium | |
| CN112435002A (en) | Asset and data integrated management method based on block chain | |
| CN110322155A (en) | A kind of office resource allocation method, device, equipment and readable storage medium storing program for executing | |
| CN114564474B (en) | Photovoltaic ledger data automatic verification method and related device | |
| CN116594852A (en) | Experience measurement method and device | |
| CN115880068A (en) | Power processing method and device, computer readable storage medium and computer equipment | |
| Hird | Beyond Compliance | |
| CN116187946A (en) | Management method, management device, electronic equipment and storage medium | |
| CN115907156A (en) | Demand plan prediction method, device, equipment and storage medium | |
| CN117726192A (en) | Operation construction method and system for each professional domain | |
| Neubauer et al. | A case study on the multicriteria selection of software components |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191220 |
|
| RJ01 | Rejection of invention patent application after publication |