CN106469149A - A kind of distribution automation planning and designing associated data extracts and collecting method - Google Patents

A kind of distribution automation planning and designing associated data extracts and collecting method Download PDF

Info

Publication number
CN106469149A
CN106469149A CN201510498326.6A CN201510498326A CN106469149A CN 106469149 A CN106469149 A CN 106469149A CN 201510498326 A CN201510498326 A CN 201510498326A CN 106469149 A CN106469149 A CN 106469149A
Authority
CN
China
Prior art keywords
data
integration
distribution automation
platform
management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510498326.6A
Other languages
Chinese (zh)
Inventor
曾强
李海涛
朱凌
邓惠华
邓景松
何奕枫
王晓光
杨霖
郭琳
肖培根
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huizhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Original Assignee
Huizhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huizhou Power Supply Bureau of Guangdong Power Grid Co Ltd filed Critical Huizhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Priority to CN201510498326.6A priority Critical patent/CN106469149A/en
Publication of CN106469149A publication Critical patent/CN106469149A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Monitoring And Control Of Power-Distribution Networks (AREA)

Abstract

The invention discloses a kind of distribution automation planning and designing associated data extracts and collecting method, by setting up data integration platform, data is extracted, cleaning, integrate, ensure the quality of data, reliability and maintainability, achieve to relevant database, Excel, text, xml, the access of the data sources such as Webservice, ensure that based on data base's middle database, the unified standard data output of data/address bus, support clustered deploy(ment), concurrent, efficiency high, data is accurate, practicality and the suitability are good, provide reliable basis for automatization's electrical network distribution process, it is particularly suitable for modernizing in electrical network distribution construction and management.

Description

A kind of distribution automation planning and designing associated data extracts and collecting method
Technical field
The present invention relates to a kind of data pick-up and collecting method, particularly to joining in a kind of electrical network distribution automation process of construction Automation planning and designing associated data extracts and collecting method.
Background technology
Electrical network distribution automation construction at present generally launches, but especially in distribution in terms of distribution automation planning construction The abstract science that the aspect shortage such as prison terminal reconnaissance, terminal Configuration Type, grid structure optimization has stronger directive significance is ground Study carefully, lack effective mathematical model and carry out situations such as grid structure of accurate description power distribution network, power load distributing, running status, do not have Systematic distribution automation intelligent Decision Technology supports system, instructs, supports distribution automation construction plan and intelligent decision Work.
The theoretical research of distribution automation intelligent decision and systemic software development, can re-recognize distribution with the height of methodology Automatic intelligent decision-making technic is supported, for the demand of power supply reliability, different load density is for power supply for analysis different user Weight shared by reliability index, the different degree of influence to power supply reliability index for the distribution automation technical scheme of further investigation, Blind investment phenomenon present in energy effectively solving current distribution automation construction plan, makes limited construction fund play maximum Effect, this is for improving distribution automation its construction level, hold distribution automation developing direction, improve distribution automation Economic and social benefit has significant role.
At present, the construction of distribution automation intelligent decision application system needs to integrate EMS, DMS, production, GIS, metering automatically Change, the information such as information integration are joined by battalion, system data need to carry out the calculating tasks such as reliability, economy and the quality of power supply, number According to source is numerous, various structures, data volume big, quality of data diversity is big, at present still not targetedly information model and Data platform is supported it is therefore desirable to set up data integration platform, data is carried out extracting, cleans, integrate, and ensures data matter Amount, improves data reliability and maintainability, for automatization's electrical network distribution process offer foundation with conveniently.
Content of the invention
In view of the foregoing and not enough, the present invention is intended to provide the distribution that a kind of suitability is good, easy to use, relatedness is strong is certainly Dynamicization planning and designing associated data extract and collecting method, with meet electrical network distribution needs it is ensured that distribution data support comprehensive Property, reliability and effective part.
The present invention is achieved through the following technical solutions:
A kind of distribution automation planning and designing associated data extracts and collecting method, including:
Step one, set up data integration platform, data is carried out extracting, cleans, integrate;Data integration platform includes data Access, Data Integration, panorama mathematical model, data storage, data publication shared service, quality of data monitoring data are put down Platform management and monitoring;
Step 2, using each system data warehouse or metadata platform as Data Source, by ETL or Data-Link mode to data Carry out extracting, clean, integrate after be loaded in data warehouse or Data Mart;
After step 3, the access through data and integration, data is stored, set up between the logical AND physical sequential of record Corresponding relation, determines storage address;
Step 4, based on service, data/address bus, the data full dose of data base's middle database technology, increment standard is unified issues altogether Enjoy service, distribution operation real-time condition data is issued, realizes data sharing;
Step 5, flexibly the quality of data is monitored using modes such as java script, regular expression, SQL statement and Fault-tolerant pretreatment, finds in time, analyzes and tracing management quality problems;
Step 6, reception are derived from the data of each big operation system, and are shown with the mode of data dynamic graphical, pictorialization Come, realize patterned management and monitoring function.
Described data integration platform adopt patterned Data Integration, monitoring, maintenance interface, realize data integration manage can Depending on changing.
A kind of distribution automation planning and designing associated data of the present invention extracts and collecting method, automatic by setting up distribution Change intelligent decision data integration platform a set of, under the support of information model data platform, source data is carried out extract, clearly Wash, integrate, ensure the quality of data, reliability and maintainable it is achieved that to relevant database, Excel, text, The data sources such as xml, Webservice access it is ensured that based on data base's middle database, Webservice, data/address bus system One normal data output, supports clustered deploy(ment), concurrent, efficiency high, accurately, practicality and the suitability are good, can for data There is provided reliable basis for automatization's electrical network distribution process.
Specific embodiment
Distribution automation planning and designing technical support the application system construction, needs to integrate EMS, DMS, production, GIS, metering Automatization, battalion join the data of information system such as information integration and carry out the calculating tasks such as reliability, economy and the quality of power supply, number According to source is numerous, various structures, data volume big, quality of data diversity is big, at present still not targetedly information model and Data platform is supported it is therefore desirable to set up data integration platform, data is carried out extracting, cleans, integrate, and ensures data matter Amount, reliability and maintainability.
Platform adopts patterned Data Integration, monitoring, maintenance interface, realizes the visualization of data integration management, improves system The ease for use of system;Support clustered deploy(ment) mode, improve the reliability of integrated platform;The integration process of big data quantity can be directed to Property setting concurrent thread, shorten process time, improve integration speed;Can conveniently access various relational databases, The data source such as Excel, text, XML, Webservice, can develop plug-in unit for special data source and be supported;Adopt Flexibly the quality of data is monitored and fault-tolerant pretreatment with modes such as java script, regular expression, SQL statement;Carry For the data subscription based on various ways such as data base, WebService, files, Push Service.
A kind of distribution automation planning and designing associated data of the present invention extracts and collecting method, including:
Step 1, set up data integration platform, data is carried out extracting, cleans, integrate;Data integration platform includes data and connects Enter, Data Integration, panorama mathematical model, data storage, data publication shared service, the quality of data monitor data platform Management and monitoring, data integration platform adopts patterned Data Integration, monitoring, maintenance interface, realizes data integration management Visualization.
Step 2, using each system data warehouse or metadata platform as Data Source, by ETL or Data-Link mode to data Carry out extracting, clean, integrate after be loaded in data warehouse or Data Mart;
After step 3, the access through data and integration, data is stored, set up between the logical AND physical sequential of record Corresponding relation, determines storage address;
Step 4, based on service, data/address bus, the data full dose of data base's middle database technology, increment standard unified issue shared Service, distribution operation real-time condition data is issued, is realized data sharing;
Step 5, flexibly the quality of data is monitored using modes such as java script, regular expression, SQL statement and holds Wrong pretreatment, finds in time, analyzes and tracing management quality problems;
Step 6, reception are derived from the data of each big operation system, and are shown with the mode of data dynamic graphical, pictorialization Come, realize patterned management and monitoring function.
In actual applications, power grid enterprises, the operation system based on computer and network technologies inside power supply enterprise, can divide Control great Qu and management information great Qu for producing.Produce control zone and management information area installing detects certification through national specific office The special horizontal one-way safety isolating device of electric power, realize the security isolation with electric power enterprise data network and public information network.? The professional system holding electrical network business be distributed in the production control zone of different safety class (I, II area) and information management area (III, IV area).Install forward and reverse isolating device between zones of different and enter row information isolation it is impossible to directly carry out information communication.
Distribution automation system is in production control zone, and power grid GIS system is in information management area, and both sides are exchanged by means of information Diversity between bus barrier Diao Liang area, realizes power grid GIS system integrated with the interconnection data of electrical power distribution automatization system.
In order to promote grid graph to share further, reduce repeated work, effectively carry out data integration, need to be by power distribution automation System, power grid GIS system carry out horizontal integrating data integration.By application integration mode, set up shared exchanging mechanism, Achieve the target of " electrical network " eventually.
By the construction of data integration platform, information integration etc. is joined by integration EMS, DMS, production, GIS, metering automation, battalion Data of information system carries out the calculating tasks such as reliability, economy and the quality of power supply, and catering to distribution automation intelligent decision should With system Construction, it is a set of to complete to be formed distribution automation intelligent decision panorama model, sets up distribution automation intelligent decision data Integrated platform is a set of.By the support of the data platform of information model, data is carried out extracting, cleans, integrate, ensure The quality of data, reliability and maintainability.Realize to relevant database, Excel, text, xml, Webservice etc. The access of data source, realize based on data base's middle database, Webservice, data/address bus unified standard data output.? Hold clustered deploy(ment), concurrent, it is integrated to complete monthly data in 1 day, achieves noticeable achievement.

Claims (2)

1. a kind of distribution automation planning and designing associated data extracts with collecting method it is characterised in that including:
Step one, set up data integration platform, data is carried out extracting, cleans, integrate;Data integration platform includes data Access, Data Integration, panorama mathematical model, data storage, data publication shared service, quality of data monitoring data are put down Platform management and monitoring;
Step 2, using each system data warehouse or metadata platform as Data Source, by ETL or Data-Link mode to data Carry out extracting, clean, integrate after be loaded in data warehouse or Data Mart;
After step 3, the access through data and integration, data is stored, set up between the logical AND physical sequential of record Corresponding relation, determines storage address;
Step 4, based on service, data/address bus, the data full dose of data base's middle database technology, increment standard is unified issues altogether Enjoy service, distribution operation real-time condition data is issued, realizes data sharing;
Step 5, flexibly the quality of data is monitored using modes such as java script, regular expression, SQL statement and Fault-tolerant pretreatment, finds in time, analyzes and tracing management quality problems;
Step 6, reception are derived from the data of each big operation system, and are shown with the mode of data dynamic graphical, pictorialization Come, realize patterned management and monitoring function.
2. a kind of distribution automation planning and designing associated data according to claim 1 extracts and collecting method, its feature It is, described data integration platform adopts patterned Data Integration, monitoring, maintenance interface, realize data integration management Visualization.
CN201510498326.6A 2015-08-14 2015-08-14 A kind of distribution automation planning and designing associated data extracts and collecting method Pending CN106469149A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510498326.6A CN106469149A (en) 2015-08-14 2015-08-14 A kind of distribution automation planning and designing associated data extracts and collecting method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510498326.6A CN106469149A (en) 2015-08-14 2015-08-14 A kind of distribution automation planning and designing associated data extracts and collecting method

Publications (1)

Publication Number Publication Date
CN106469149A true CN106469149A (en) 2017-03-01

Family

ID=58213530

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510498326.6A Pending CN106469149A (en) 2015-08-14 2015-08-14 A kind of distribution automation planning and designing associated data extracts and collecting method

Country Status (1)

Country Link
CN (1) CN106469149A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107862467A (en) * 2017-11-23 2018-03-30 国网辽宁省电力有限公司 A kind of electric network synthetic data target monitoring method and system based on big data platform
CN109656692A (en) * 2017-10-12 2019-04-19 中兴通讯股份有限公司 A kind of big data task management method, device, equipment and storage medium
CN111901158A (en) * 2020-07-14 2020-11-06 广东科徕尼智能科技有限公司 Intelligent home distribution network fault data analysis method, equipment and storage medium
CN112835717A (en) * 2021-02-05 2021-05-25 远光软件股份有限公司 Integrated application processing method and device for cluster
CN113157795A (en) * 2021-05-18 2021-07-23 国网宁夏电力有限公司 Power grid regulation and control operation multi-source data modeling and management system suitable for mobile application

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109656692A (en) * 2017-10-12 2019-04-19 中兴通讯股份有限公司 A kind of big data task management method, device, equipment and storage medium
CN109656692B (en) * 2017-10-12 2023-04-21 中兴通讯股份有限公司 Big data task management method, device, equipment and storage medium
CN107862467A (en) * 2017-11-23 2018-03-30 国网辽宁省电力有限公司 A kind of electric network synthetic data target monitoring method and system based on big data platform
CN111901158A (en) * 2020-07-14 2020-11-06 广东科徕尼智能科技有限公司 Intelligent home distribution network fault data analysis method, equipment and storage medium
CN112835717A (en) * 2021-02-05 2021-05-25 远光软件股份有限公司 Integrated application processing method and device for cluster
CN113157795A (en) * 2021-05-18 2021-07-23 国网宁夏电力有限公司 Power grid regulation and control operation multi-source data modeling and management system suitable for mobile application

Similar Documents

Publication Publication Date Title
CN102750606B (en) A kind of dispatching of power netwoks cloud system
CN106651633A (en) Power utilization information acquisition system and method based on big data technology
CN106469149A (en) A kind of distribution automation planning and designing associated data extracts and collecting method
CN105631764A (en) Smart power grid big data application system orienting smart city
CN104616121A (en) Regional energy comprehensive coordination management and control system
CN105574652A (en) Planning big data management and control system of smart power distribution network and method
CN103593422A (en) Virtual access management method of heterogeneous database
CN104915456A (en) Mass power utilization data mining method on the basis of data analysis system
CN102385739A (en) Integrated information management platform for county-level power supply enterprises
CN101751435A (en) Data exchanging system and method for electric power system
CN108052634A (en) A kind of power grid production control great Qu and the integrated approach of asset management great Qu multi information systems
CN103489139A (en) Comprehensive analysis and management system for urban distribution network planning
Lv et al. Design of cloud data warehouse and its application in smart grid
CN106056322A (en) Smart grid scheduling system based on cloud computing
CN104484734A (en) Low-carbon city energy optimized configuration data center architecture
CN202817897U (en) Power grid system for integrating grid distribution, scheduling and centralized control in one
Liu et al. Application and study of internet of things used in rural water conservancy project
Li et al. A novel design for data processing framework of park-level power system with data mesh concept
Li et al. A data warehouse architecture supporting energy management of intelligent electricity system
Wang et al. Discussion on industrial internet platform construction based on power internet of things
CN103955761B (en) A kind of low-carbon (LC) schedule information platform
Yongpan et al. Development of monitoring system of building energy consumption
CN106447061A (en) Distributed power supply constant volume addressing method
CN103020869A (en) Cloud-distribution power grid model version management system
Mikhnev et al. The introduction of intelligent electrical networks in Russia

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170301