CN112732683A - Automatic supervision system and method based on power industry data standard - Google Patents
Automatic supervision system and method based on power industry data standard Download PDFInfo
- Publication number
- CN112732683A CN112732683A CN202011311461.2A CN202011311461A CN112732683A CN 112732683 A CN112732683 A CN 112732683A CN 202011311461 A CN202011311461 A CN 202011311461A CN 112732683 A CN112732683 A CN 112732683A
- Authority
- CN
- China
- Prior art keywords
- data
- standard
- module
- requirement
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/06—Electricity, gas or water supply
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
Abstract
The invention provides an automatic monitoring system and method based on power industry data standards. The invention can realize automatic monitoring of the full link, does not need much personnel to intervene in the process of auditing the data standard, realizes the unification of the global data standard, can provide standardized data for a data demand party, greatly improves the value of the data assets, and provides a solid foundation for the data assets to be changed.
Description
Technical Field
The invention relates to the field of power grid big data, in particular to an automatic supervision system and method based on power industry data standards.
Background
Because the whole data traffic of the power grid is huge, service systems are numerous, data are distributed in a large number of heterogeneous databases, the accumulated data volume is large and complicated, the garbage data and nonstandard data volume is huge, and in recent years, the Guangdong power grid mainly grasps the data quality problem.
The Chinese patent with the publication number of CN106685771A, the publication number of which is 05 and 17 in 2017, discloses a unified access method of a power marketing full-service channel, and relates to a channel access method. The traditional extensive customer service management mode is difficult to provide support for personalized and accurate novel customer service requirements, and various channels are complex in structure and have high safety risks. The invention comprises the following steps: using a distributed service application framework to carry out uniform channel service access; and (3) introducing authority mechanisms of registration, binding, real-name authentication and service password authentication to realize unified management of channel registration accounts and account authority, including unified account management and unified authority management. But does not solve the problem of irregular data standards.
Disclosure of Invention
The invention mainly aims to provide an automatic supervisory system based on the power industry data standard, which realizes the unification of the global data standard.
The invention further aims to provide an automatic supervision method based on the power industry data standard.
In order to solve the technical problems, the technical scheme of the invention is as follows:
the utility model provides an automatic supervisory systems based on electric power industry data standard, includes server, customer end and data standard process monitoring module, wherein:
the server side comprises a user management submodule, a permission management submodule, a data access requirement management submodule, a data requirement issuing module, a standard making module and a standard issuing module, wherein the user management submodule, the permission management submodule, the data access requirement management submodule, the data requirement issuing module, the standard making module and the standard issuing module run independently and exchange data with the client side through the interface management module;
the client comprises a user login module, a database configuration management module, a client standard management module, a data access requirement confirmation module, a data meta quality auditing module and an auditing result feedback module, and the user login module, the database configuration management module, the client standard management module, the data access requirement confirmation module, the data meta quality auditing module and the auditing result feedback module operate independently;
and the data standard process monitoring module carries out full link monitoring on data exchange between the server and the client.
Preferably, the user management module is used for managing creation management of the background login user, and performing addition, modification and logout operations, and the creation management of the client login user can be the addition, modification and logout operations; the authority management module is used for distributing and managing access function authority, operation authority and data authority for a management background user and a client login user.
Preferably, the data access requirement management module is configured to create a data requirement through the data access requirement management module when the data supplier receives the data requirement of the demander; the data access requirement issuing module issues the created requirement to a specified data provider client as a data provider to play a role in data management, but the source of the data needs to be output by a relevant business department, and issues the created requirement to the specified data provider client for the data provider to confirm.
Preferably, the data access requirement management module creates a data requirement, including a data directory, a data item, and a data authority.
Preferably, the standard making module comprises a data element standard management module and a data standard management module, and is used for uniformly establishing a data standard according to data requirements; and uniformly establishing a data standard, namely the data acquisition accuracy and the data standard capable of unifying the universe.
Preferably, the user login module is used for querying all permissions corresponding to the user when the client performs login access according to the account password distributed by the management terminal; the database configuration management module is used for analyzing data, appointing a data output database and configuring a database access address; the client standard management module is used for checking the standard corresponding to the data requirement.
Preferably, the data access requirement confirming module is used for checking data access requirements, confirming data sources, or failing to provide data, and rejecting data requests, and the data meta-quality auditing module is used for automatically auditing according to data meta-data standards through the specified data sources to form auditing results, and evaluating whether the results meet the standard requirements; the data quality auditing module automatically audits according to the data standard through the appointed data source to form an auditing result and evaluate whether the result meets the standard requirement.
Preferably, the audit result feedback module is configured to report the result of each quality audit.
An automatic supervision method based on power industry data standards is applied to the automatic supervision system based on power industry data standards, and comprises the following steps:
s1: a demand party creates demands at a client and establishes demand basic information;
s2: specifying a data element standard and a data standard, keeping the data element standard and the data standard consistent with a global data standard, and forming a unified standard system;
s3: issuing data access requirements to each service unit, and determining the requirements to be accessed from the issued service units;
s4: the service unit confirms whether the data requirement belongs to the service range of the department or not and feeds back information to the server side, the server side performs unified management, and if the requirement is negative, specific data items are determined not to meet the requirement;
s5: the server receives the requirement confirmation feedback of the client, rechecks the service department which does not meet the requirement to issue the data requirement, and then performs S4 again, if the service unit receives the requirement, the service unit is considered to be capable of providing the data in the requirement, and the confirmation result is fed back to the server;
s6: the server side uniformly issues the data element standard and the data standard to the client side to accept confirmation according to the data standard issuing rule;
s7: and performing standard auditing work, feeding the auditing result back to the server side, wherein an auditing failure phenomenon may occur in the combination process, after the auditing failure, processing the data by a data cleaning mode and the like, re-auditing the data until the data standard auditing is passed, and feeding the result back to the data standard process monitoring module for monitoring.
Preferably, the requirement basic information in step S1 includes data directory, data item, and specifies usage, time, period, and scope.
Compared with the prior art, the technical scheme of the invention has the beneficial effects that:
the scheme of the invention can realize full link automatic monitoring, the data standard auditing process does not need too much personnel intervention, the unification of global data standards is realized, and meanwhile, standardized data can be provided for data demand parties, thereby greatly improving the data asset value and providing a solid foundation for the data asset change.
Drawings
FIG. 1 is a schematic diagram of the system of the present invention.
FIG. 2 is a schematic flow chart of the method of the present invention.
Detailed Description
The drawings are for illustrative purposes only and are not to be construed as limiting the patent;
for the purpose of better illustrating the embodiments, certain features of the drawings may be omitted, enlarged or reduced, and do not represent the size of an actual product;
it will be understood by those skilled in the art that certain well-known structures in the drawings and descriptions thereof may be omitted.
The technical solution of the present invention is further described below with reference to the accompanying drawings and examples.
Example 1
The embodiment provides an automatic supervisory system based on power industry data standard, as shown in fig. 1, including a server, a client, an interface management module and a data standard process monitoring module, wherein:
the server side comprises a user management submodule, a permission management submodule, a data access requirement management submodule, a data requirement issuing module, a standard making module and a standard issuing module, wherein the user management submodule, the permission management submodule, the data access requirement management submodule, the data requirement issuing module, the standard making module and the standard issuing module run independently and exchange data with the client side through the interface management module;
the client comprises a user login module, a database configuration management module, a client standard management module, a data access requirement confirmation module, a data meta quality auditing module and an auditing result feedback module, and the user login module, the database configuration management module, the client standard management module, the data access requirement confirmation module, the data meta quality auditing module and the auditing result feedback module operate independently;
and the data standard process monitoring module carries out full link monitoring on data exchange between the server and the client.
The user management module is used for managing the creation management of the background login user and carrying out the operations of adding, modifying and logout; the authority management module is used for distributing and managing access function authority, operation authority and data authority for a management background user and a client login user.
The data access demand management module is used for creating data demands through the data access demand management module when a data supplier receives the data demands of a demander; and the data access requirement issuing module issues the created requirement to a specified data provider client.
The data access requirement management module creates data requirements including data directories, data items and data permissions.
The standard making module comprises a data element standard management module and a data standard management module and is used for uniformly establishing a data standard according to data requirements; the standard issuing module is used for the management end to issue the data source standard and the data standard to the client, and the client receives the standard and performs quality audit according to the standard when outputting the production data; therefore, the interface management module is used for managing all server-side and client-side interaction interfaces and monitoring the interaction condition of the interfaces.
The user login module is used for inquiring all permissions corresponding to the user when the client performs login access according to the account password distributed by the management terminal; the database configuration management module is used for analyzing data, appointing a data output database and configuring a database access address; the client standard management module is used for checking the standard corresponding to the data requirement.
The data access requirement confirming module is used for checking data access requirements, confirming data sources or being incapable of providing data and rejecting data requests, and the data metadata quality auditing module is used for automatically auditing according to data metadata standards through specified data sources to form an auditing result and evaluating whether the result meets the standard requirements or not; the data quality auditing module automatically audits according to the data standard through the appointed data source to form an auditing result and evaluate whether the result meets the standard requirement.
The audit result feedback module is used for reporting the result of each quality audit.
Example 2
The present embodiment provides an automatic supervision method based on power industry data standards, as shown in fig. 2, where the method is applied to the automatic supervision system based on power industry data standards described in embodiment 1, and the method includes the following steps:
s1: a demand party creates demands at a client and establishes demand basic information;
s2: specifying a data element standard and a data standard, keeping the data element standard and the data standard consistent with a global data standard, and forming a unified standard system;
s3: issuing data access requirements to each service unit, and determining the requirements to be accessed from the issued service units;
s4: the service unit confirms whether the data requirement belongs to the service range of the department or not and feeds back information to the server side, the server side performs unified management, and if the requirement is negative, specific data items are determined not to meet the requirement;
s5: the server receives the requirement confirmation feedback of the client, rechecks the service department which does not meet the requirement to issue the data requirement, and then performs S4 again, if the service unit receives the requirement, the service unit is considered to be capable of providing the data in the requirement, and the confirmation result is fed back to the server;
s6: the server side uniformly issues the data element standard and the data standard to the client side to accept confirmation according to the data standard issuing rule;
s7: and performing standard auditing work, feeding the auditing result back to the server side, wherein an auditing failure phenomenon may occur in the combination process, after the auditing failure, processing the data by a data cleaning mode and the like, re-auditing the data until the data standard auditing is passed, and feeding the result back to the data standard process monitoring module for monitoring.
The basic information required in step S1 includes data directory, data item, and specifies usage, time, period, and range.
The same or similar reference numerals correspond to the same or similar parts;
the terms describing positional relationships in the drawings are for illustrative purposes only and are not to be construed as limiting the patent;
it should be understood that the above-described embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the claims of the present invention.
Claims (10)
1. The utility model provides an automatic supervisory systems based on electric power industry data standard which characterized in that, includes server, customer end, interface management module and data standard process monitoring module, wherein:
the server side comprises a user management submodule, a permission management submodule, a data access requirement management submodule, a data requirement issuing module, a standard making module and a standard issuing module, wherein the user management submodule, the permission management submodule, the data access requirement management submodule, the data requirement issuing module, the standard making module and the standard issuing module run independently and exchange data with the client side through the interface management module;
the client comprises a user login module, a database configuration management module, a client standard management module, a data access requirement confirmation module, a data meta quality auditing module and an auditing result feedback module, and the user login module, the database configuration management module, the client standard management module, the data access requirement confirmation module, the data meta quality auditing module and the auditing result feedback module operate independently;
and the data standard process monitoring module carries out full link monitoring on data exchange between the server and the client.
2. The power industry data standard-based automatic supervisory system as claimed in claim 1, wherein the user management module is configured to manage creation management of background login users, perform addition, modification and logout operations; the authority management module is used for distributing and managing access function authority, operation authority and data authority for a management background user and a client login user.
3. The electric power industry data standard-based automated supervisory system as claimed in claim 1, wherein the data access requirement management module is configured to create a data requirement through the data access requirement management module when a data supplier receives the data requirement of a demander; and the data access requirement issuing module issues the created requirement to a specified data provider client.
4. The electric power industry data standard-based automated regulatory system of claim 3, wherein the data access requirement management module creates data requirements comprising data catalogs, data items, and data permissions.
5. The power industry data standard-based automatic supervision system according to claim 1, wherein the standard making module comprises a data metadata standard management module and a data standard management module, and is used for uniformly establishing data standards according to data requirements; the standard issuing module is used for the management end to issue the data source standard and the data standard to the client, and the client receives the standard and performs quality audit according to the standard when outputting the production data; therefore, the interface management module is used for managing all server-side and client-side interaction interfaces and monitoring the interaction condition of the interfaces.
6. The automatic supervision system based on the electric power industry data standard according to claim 1, wherein the user login module is used for inquiring all permissions corresponding to the user when the client performs login access according to the account password allocated by the management terminal; the database configuration management module is used for analyzing data, appointing a data output database and configuring a database access address; the client standard management module is used for checking the standard corresponding to the data requirement.
7. The automatic monitoring system based on the power industry data standard of claim 5, wherein the data access requirement confirming module is used for checking data access requirement, confirming data source, or failing to provide data, rejecting data request, the data meta-quality auditing module is used for automatically auditing through the specified data source according to data meta-data standard, forming auditing result, and evaluating whether the result meets the standard requirement; the data quality auditing module automatically audits according to the data standard through the appointed data source to form an auditing result and evaluate whether the result meets the standard requirement.
8. The system of claim 7, wherein the audit result feedback module is configured to report the result of each quality audit.
9. An automatic supervision method based on power industry data standard, which is applied to the automatic supervision system based on power industry data standard of any one of claims 1 to 8, and comprises the following steps:
s1: a demand party creates demands at a client and establishes demand basic information;
s2: specifying a data element standard and a data standard, keeping the data element standard and the data standard consistent with a global data standard, and forming a unified standard system;
s3: issuing data access requirements to each service unit, and determining the requirements to be accessed from the issued service units;
s4: the service unit confirms whether the data requirement belongs to the service range of the department or not and feeds back information to the server side, the server side performs unified management, and if the requirement is negative, specific data items are determined not to meet the requirement;
s5: the server receives the requirement confirmation feedback of the client, rechecks the service department which does not meet the requirement to issue the data requirement, and then performs S4 again, if the service unit receives the requirement, the service unit is considered to be capable of providing the data in the requirement, and the confirmation result is fed back to the server;
s6: the server side uniformly issues the data element standard and the data standard to the client side to accept confirmation according to the data standard issuing rule;
s7: and performing standard auditing work, feeding the auditing result back to the server side, wherein an auditing failure phenomenon may occur in the combination process, after the auditing failure, processing the data by a data cleaning mode and the like, re-auditing the data until the data standard auditing is passed, and feeding the result back to the data standard process monitoring module for monitoring.
10. The electric power industry data standard-based automatic supervision method according to claim 8, wherein the requirement basic information in step S1 includes data directory, data item, and explicit usage, time, period, and scope.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011311461.2A CN112732683B (en) | 2020-11-20 | 2020-11-20 | Automatic supervision system and method based on power industry data standard |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011311461.2A CN112732683B (en) | 2020-11-20 | 2020-11-20 | Automatic supervision system and method based on power industry data standard |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112732683A true CN112732683A (en) | 2021-04-30 |
| CN112732683B CN112732683B (en) | 2022-02-11 |
Family
ID=75597651
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011311461.2A Active CN112732683B (en) | 2020-11-20 | 2020-11-20 | Automatic supervision system and method based on power industry data standard |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112732683B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117151438A (en) * | 2023-10-31 | 2023-12-01 | 思创数码科技股份有限公司 | Data sharing quality analysis method, system, computer and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5878408A (en) * | 1996-12-06 | 1999-03-02 | International Business Machines Corporation | Data management system and process |
| CN105761010A (en) * | 2016-02-24 | 2016-07-13 | 国网山东省电力公司 | Method and system for real-time monitoring of group enterprise audit based on real-time data acquisition |
| CN106096903A (en) * | 2016-05-28 | 2016-11-09 | 张维秀 | A kind of standardization effort management platform |
| CN106685771A (en) * | 2016-12-14 | 2017-05-17 | 国网浙江省电力公司 | Unified access method for all service channels of electric power marketing |
| CN109829028A (en) * | 2019-01-30 | 2019-05-31 | 广州供电局有限公司 | A kind of electric power data management system based on normal address |
| CN110851426A (en) * | 2019-11-19 | 2020-02-28 | 重庆华龙网海数科技有限公司 | Data DNA visualization relation analysis system and method |
-
2020
- 2020-11-20 CN CN202011311461.2A patent/CN112732683B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5878408A (en) * | 1996-12-06 | 1999-03-02 | International Business Machines Corporation | Data management system and process |
| CN105761010A (en) * | 2016-02-24 | 2016-07-13 | 国网山东省电力公司 | Method and system for real-time monitoring of group enterprise audit based on real-time data acquisition |
| CN106096903A (en) * | 2016-05-28 | 2016-11-09 | 张维秀 | A kind of standardization effort management platform |
| CN106685771A (en) * | 2016-12-14 | 2017-05-17 | 国网浙江省电力公司 | Unified access method for all service channels of electric power marketing |
| CN109829028A (en) * | 2019-01-30 | 2019-05-31 | 广州供电局有限公司 | A kind of electric power data management system based on normal address |
| CN110851426A (en) * | 2019-11-19 | 2020-02-28 | 重庆华龙网海数科技有限公司 | Data DNA visualization relation analysis system and method |
Non-Patent Citations (1)
| Title |
|---|
| 郑瑛等: "配电变压器的实时监控", 《机械》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117151438A (en) * | 2023-10-31 | 2023-12-01 | 思创数码科技股份有限公司 | Data sharing quality analysis method, system, computer and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112732683B (en) | 2022-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101354696B (en) | Data integration and application service system based on electric communication field sharing information model | |
| CN105224351A (en) | Rapid configuration implementation method and rapid configuration server | |
| CN104200402A (en) | Publishing method and system of source data of multiple data sources in power grid | |
| CN111400382A (en) | Model-driven data integration middleware and implementation method | |
| CN101957865A (en) | Data exchange and sharing technology among heterogeneous systems | |
| CN105574640A (en) | Method for constructing unified and comprehensive management platform of application | |
| CN106354857A (en) | News tag management system | |
| CN110968629A (en) | Cross-hierarchy heterogeneous data aggregation-based unified information resource management method and system | |
| CN112148689A (en) | Data sharing and exchanging system for city-level data middling station | |
| CN112732683B (en) | Automatic supervision system and method based on power industry data standard | |
| CN114218218A (en) | Data processing method, device and equipment based on data warehouse and storage medium | |
| CN105516213A (en) | Enterprise-oriented efficient integrated management control system for enterprises | |
| CN103440302B (en) | The method and system of Real Data Exchangs | |
| CN105933396B (en) | A kind of each canalization interface of collaboration realizes the method and system of long flow | |
| CN112001539A (en) | High-precision passenger traffic prediction method and passenger traffic prediction system | |
| CN111552536A (en) | Management system and management method for electronic government affair self-service terminal | |
| CN114925343B (en) | Method and device for processing permission data | |
| CN114254165A (en) | System and method for managing authority of user data related to Internet of vehicles service | |
| CN101615272A (en) | A kind of approaches to IM and information management system | |
| CN111383749B (en) | Information management system and method | |
| Pholpabu et al. | A Model Web-enable for OLTP with Replication Realtime Distributed Database | |
| CN103957329A (en) | Enterprise telephone line management method and system and server | |
| CN111353755A (en) | Financial application supporting platform system | |
| CN117992528A (en) | Data interaction method and system of digital exhibition management platform | |
| CN116431611A (en) | Automatic data processing module development method based on custom rules |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |