CN106156936A - A kind of electric power system data analyzes method and system - Google Patents
A kind of electric power system data analyzes method and system Download PDFInfo
- Publication number
- CN106156936A CN106156936A CN201510198991.3A CN201510198991A CN106156936A CN 106156936 A CN106156936 A CN 106156936A CN 201510198991 A CN201510198991 A CN 201510198991A CN 106156936 A CN106156936 A CN 106156936A
- Authority
- CN
- China
- Prior art keywords
- data
- analysis
- electric power
- power system
- analyzes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a kind of electric power system data and analyze method and system, comprise the steps: to gather data message；According to the data message gathering, set up and analyze data source；By non-structured excavation and analysis method, described analysis data source is processed, excavated and analysis result；Output is excavated and analysis result.The present invention uses non-structured processing mode to excavate and analyzes, in a uniform manner the data of different sub-systems can be analyzed, do not need too much manual intervention, the flexibility of data mining and analysis can be improved, improve data mining and analysis efficiency, improve the reliability of data mining and analysis, reduce the cost of data mining and analysis.
Description
Technical field
The present invention relates to electric power system data analysis field, particularly relate to the electrical network in power automatic system
The data mining of dispatching automation and analytical technology.
Background technology
With the high speed development of intelligent grid, the big data age of electrical network has arrived.The big data of electric power are (also
The i.e. big data of electrical network) it is made up of structural data and destructuring, with intelligent grid construction and Internet of Things
Application, unstructured data presents the impetus of quick growth, and its quantity will substantially exceed structuring number
According to.The characteristic of the big data of electric power meets five characteristics of big data, one be data volume big (Volume), two
Be processing speed fast (Velocity), three be data type many (Variety), four be worth big (Value),
Five is that accuracy is high (Veracity).
The big data of electrical network bring the difficulty of data mining and analytical technology.Current electric grid scheduling data are typically logical
Cross various system or method excavate data and analyze, due to the agreement of each system
It or standard is different, is typically necessary and carrys out definition data structure according to the definition standard of each system, so in advance
Excavated by structural data afterwards and analyze.Structural data, at once data, be stored in database
In, can carry out, by bivariate table structure, the data that logical expression realizes.
But above-mentioned this mode exists a lot of drawback, too increase system and configurations difficult in the later stage, increase
Add the complexity of the process of analysis, poor for applicability, easily make mistakes during excavating and analyzing simultaneously,
Structure is difficult to full maintenance more, and therefore this mode is difficult to meet growing electrical network demand.
Therefore how to improve the excavation of network system further and analyze speed and accuracy always for this area
Technical staff is endeavoured the direction of research.
Content of the invention
It is an object of the invention to propose power automatic system uses unstructured data to excavate and analysis side
Method, can improve the flexibility of data mining and analysis, improves data mining and analysis efficiency, improves number
According to the reliability excavated and analyze, reduce the cost of data mining and analysis.
In order to realize above technique effect, the invention provides a kind of electric power system data and analyze method, mainly
Comprise the steps:
Gather data message；
According to the data message gathering, set up and analyze data source；
By non-structured excavation and analysis method, described analysis data source is processed, excavated
And analysis result；
Output is excavated and analysis result.
Above-mentioned electric power system data analyzes method, and wherein, described data message is the data of power system
Information.
Above-mentioned electric power system data analyzes method, wherein, described by non-structured excavation and analysis
Method carries out process to described analysis data source and includes:
Described analysis data source is excavated；
Filter out the data content meeting demand；
The data content filtering out is analyzed；
Draw analysis result.
Above-mentioned electric power system data analyzes method, wherein, carries out excavating specifically to described analysis data source
For: by default screening rule, described analysis data source is excavated.
Above-mentioned electric power system data analyzes method, wherein, described output excavate and analysis result particularly as follows:
Output is excavated and analysis result is to one or more user sides.
Above-mentioned electric power system data analyzes method, and wherein, described collection data message is particularly as follows: pass through
Supervisor control and data gathering system, EMS, Distribution Management System, electrical energy metering
Any one or more of system gathers data message.
Present invention also offers a kind of electric power system data simultaneously and analyze system, wherein, comprising:
Acquisition module, is used for gathering data message；
Memory module, for according to the data message gathering, sets up and analyzes data source；
Processing module, for being entered to described analysis data source by non-structured excavation and analysis method
Row is processed, and draws excavation and analysis result；
Output module, is used for exporting excavation and analysis result.
Above-mentioned electric power system data analyzes system, wherein, described by non-structured excavation and analysis
Method carries out process to described analysis data source and includes:
Described analysis data source is excavated；
Filter out the data content meeting demand；
The data content filtering out is analyzed；
Draw analysis result.
Above-mentioned electric power system data analyzes system, wherein, carries out excavating tool to described analysis data source
Body is: excavated described analysis data source by default screening rule.
Above-mentioned electric power system data analyzes system, and wherein, described collection data message is particularly as follows: pass through
Supervisor control and data gathering system, EMS, Distribution Management System, electrical energy metering
Any one or more of system gathers data message.The present invention uses non-structured processing mode
Carry out excavation and the analysis of data message, can in a uniform manner the data of different sub-systems be carried out point
Analysis, it is not necessary to too much manual intervention, can improve the flexibility of data mining and analysis, improves data
Excavate and analysis efficiency, improve the reliability of data mining and analysis, reduce the one-tenth of data mining and analysis
This.
Brief description
By reading the detailed description made non-limiting example with reference to the following drawings, the present invention and
Feature, profile and advantage will become more apparent upon.The identical portion of mark instruction identical in whole accompanying drawings
Point.It is not deliberately drawn to scale accompanying drawing, it is preferred that emphasis is the purport of the present invention is shown.
Fig. 1 analyzes the flow chart of method for a kind of electric power system data that the present invention provides；
Fig. 2 analyzes the composition figure of system for a kind of electric power system data that the present invention provides.
Detailed description of the invention
In the following description, a large amount of concrete details is given to provide to the present invention more thoroughly
Understand.It is, however, obvious to a person skilled in the art that the present invention can be not necessarily to one
Or multiple these details and be carried out.In other example, in order to avoid obscuring with the present invention,
Some technical characteristics well known in the art are not described.
In order to thoroughly understand the present invention, detailed step and detailed knot will be proposed in following description
Structure, in order to explaination technical scheme.Presently preferred embodiments of the present invention is described in detail as follows, but
In addition to these describe in detail, the present invention can also have other embodiments.
Embodiment one
The invention provides a kind of electric power system data and analyze method, in conjunction with shown in Fig. 1, the method is main
Comprise the steps:
Step S1, collection data message.
In an optional embodiment, the data message of collection is the data message of power system.For example
Can pass through based on supervisory control and data acquisition system (SCA-DA), EMS (EMS), join
Electric management system (DMS), any one or more of electric energy metering system (Metering System)
Gather the data message of power system.
Step S2, the data message according to collection, set up and analyze data source.
By by gather various data messages carry out concluding, integrate, and then formed for analyze data
Source.Wherein, so-called data source (Data Source) is to provide the device of data required for certain or original matchmaker
Body.
Step S3, by non-structured excavate and analysis method to analyze data source process,
To excavation and analysis result.
Wherein, step S3 specifically can comprise the following steps that
Excavate to analyzing data source；
Filter out the data content meeting demand；
The data content filtering out is analyzed；
First analysis data source is entered row filter by the present invention, selects part and meets the data letter of user's request
Breath carries out follow-up analysis, can effectively reduce the pressure of subsequent data analysis, it is possible to saves and analyzes
Time the accuracy that improve analysis.One optional but in unrestriced embodiment, above-mentioned to analysis
Data source carries out excavating concretely: excavated to analyzing data source by presetting a screening rule,
And then filter out the data content meeting demand.For example can be filtered out by Splunk instrument to meet is needed
The data content asked.Wherein, Splunk is the engine of machine data, uses Splunk can collect, index
Quick mobile with utilize all application programs, server and equipment (in physics, virtual and cloud) to generate
Type data, it is possible to achieve from a location finding and analyze all in real time and historical data.
Being different from conventional art, the present embodiment is to be come to analysis by non-structured excavation and analysis method
Data source and data content are processed, and this is capable of the data to different sub-systems in a uniform manner
It is analyzed, it is not necessary to too much manual intervention, the flexibility of data mining and analysis can be improved, carry
High data mining and analysis efficiency, improve the reliability of data mining and analysis, reduces data mining and divides
The cost of analysis.Wherein, so-called unstructured data storehouse refers to that its field length is variable, and each field
The database that can be made up of repeatable or unrepeatable son field again of record.
Step S4, output are excavated and analysis result.
After using non-structured processing mode to excavate and analyzing, by the data content after screening and corresponding
Analysis result export to one or more user side.
By said method, unstructured data is excavated and analysis method is applied to power automatic system,
The present embodiment, digs according to Splunk (data analysis engine) scanning system source data according to the demand of user
Output after the data of pick needs analysis.The present embodiment is adapted to different goal systems data, is not required to
It is to be understood that goal systems data structure, use non-structured processing mode to excavate and analyze, can be with system
The data to different sub-systems for the mode of are analyzed, it is not necessary to too much manual intervention, can improve
Data mining and the flexibility of analysis, improve data mining and analysis efficiency, improves data mining and analysis
Reliability, reduce the cost of data mining and analysis.
Embodiment two
Present invention also offers a kind of electric power system data simultaneously and analyze system, with reference to shown in Fig. 2, this is
System mainly includes: the 1st, acquisition module 1, is used for gathering data message；2nd, memory module 2, with collection
Module 1 connects, and for according to the data message gathering, sets up and analyzes data source；3rd, processing module 3,
Connect memory module 2, for being excavated and analysis method is to analyzing at data source by non-structured
Reason, draws excavation and analysis result；Wherein, come to analysis by non-structured excavation and analysis method
Data source carries out process and includes: excavate to analyzing data source；Filter out the data content meeting demand；
The data content filtering out is analyzed；Draw analysis result；4th, output module 4, connection processes mould
Block 3, is used for exporting excavation and corresponding analysis result, wherein, the Result of output and corresponding analysis
Result may be output to one or more user side.
The present invention one optional but in unrestriced embodiment, data that above-mentioned acquisition module 1 gathers
Information is the data message of power system.
The present invention one is optional but in unrestriced embodiment, above-mentioned acquisition module 1 is based on monitoring control
System and data gathering system, EMS, Distribution Management System, electric energy metering system any
One or more gather data message.
The present invention one is optional but in unrestriced embodiment, above-mentioned processing module 3 includes a record
Enter unit (not shown), by this typing unit by a screening rule typing preset to processing mould
Block 3, and excavate to analyzing data source by this screening rule, and then sieve in numerous data messages
Select the data content meeting demand.
The present invention one is optional but in unrestriced embodiment, above-mentioned processing module is Splunk instrument.
In sum, owing to present invention employs as above technical scheme, unstructured data is excavated and divides
Analysis method is applied to power automatic system, and present system (is swept according to Splunk according to the demand of user
Retouching system source data, mining analysis goes out the data output needing.Present system is adapted to different mesh
Mark system data, it is not necessary to know goal systems data structure, use non-structured processing mode to excavate
And analyze, can in a uniform manner the data of different sub-systems be analyzed, it is not necessary to too much people
Work is intervened, and can improve the flexibility of data mining and analysis, improves data mining and analysis efficiency, carries
High data mining and the reliability of analysis, reduce the cost of data mining and analysis.
Above presently preferred embodiments of the present invention is described.It is to be appreciated that the present invention not office
Being limited to above-mentioned particular implementation, the equipment and the structure that wherein do not describe in detail to the greatest extent are construed as using ability
Common mode in territory is practiced；Any those of ordinary skill in the art, without departing from skill of the present invention
In the case of art aspects, all may utilize the method for the disclosure above and technology contents to technical solution of the present invention
Making many possible variations and modification, or being revised as the Equivalent embodiments of equivalent variations, this has no effect on
The flesh and blood of the present invention.Therefore, every content without departing from technical solution of the present invention, according to the present invention
Technical spirit to any simple modification made for any of the above embodiments, equivalent variations and modification, all still fall within
In the range of technical solution of the present invention protection.
Claims (10)
1. an electric power system data analyzes method, it is characterised in that comprise the steps:
Gather data message；
According to the data message gathering, set up and analyze data source；
By non-structured excavation and analysis method, described analysis data source is processed, excavated
And analysis result；
Output is excavated and analysis result.
2. electric power system data as claimed in claim 1 analyzes method, it is characterised in that described data
Information is the data message of power system.
3. electric power system data as claimed in claim 1 analyzes method, it is characterised in that described pass through
Non-structured excavation and analysis method carry out process to described analysis data source and include:
Described analysis data source is excavated；
Filter out the data content meeting demand；
The data content filtering out is analyzed；
Draw analysis result.
4. electric power system data as claimed in claim 3 analyzes method, it is characterised in that to described point
Analysis data source carries out excavating particularly as follows: dug described analysis data source by default screening rule
Pick.
5. electric power system data as claimed in claim 1 analyzes method, it is characterised in that described output
Excavate and analysis result is particularly as follows: output is excavated and analysis result is to one or more user sides.
6. the electric power system data as described in one of claim 1 to 5 analyzes method, it is characterised in that
Described collection data message is particularly as follows: pass through supervisor control and data gathering system, energy management system
System, Distribution Management System, any one or more of electric energy metering system gather data message.
7. an electric power system data analyzes system, it is characterised in that include:
Acquisition module, is used for gathering data message；
Memory module, for according to the data message gathering, sets up and analyzes data source；
Processing module, for being entered to described analysis data source by non-structured excavation and analysis method
Row is processed, and draws excavation and analysis result；
Output module, is used for exporting excavation and analysis result.
8. electric power system data as claimed in claim 7 analyzes system, it is characterised in that described pass through
Non-structured excavation and analysis method carry out process to described analysis data source and include:
Described analysis data source is excavated；
Filter out the data content meeting demand；
The data content filtering out is analyzed；
Draw analysis result.
9. electric power system data as claimed in claim 8 analyzes system, it is characterised in that to described point
Analysis data source carries out excavating particularly as follows: dug described analysis data source by default screening rule
Pick.
10. the electric power system data as described in one of claim 7 to 9 analyzes system, it is characterised in that
Described collection data message is particularly as follows: pass through supervisor control and data gathering system, energy management system
System, Distribution Management System, any one or more of electric energy metering system gather data message.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510198991.3A CN106156936A (en) | 2015-04-23 | 2015-04-23 | A kind of electric power system data analyzes method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510198991.3A CN106156936A (en) | 2015-04-23 | 2015-04-23 | A kind of electric power system data analyzes method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106156936A true CN106156936A (en) | 2016-11-23 |
Family
ID=57347079
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510198991.3A Pending CN106156936A (en) | 2015-04-23 | 2015-04-23 | A kind of electric power system data analyzes method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106156936A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107293173A (en) * | 2017-06-06 | 2017-10-24 | 积成电子股份有限公司 | Distribution network failure emulation training modeling method based on isolation information battle array |
| CN107357818A (en) * | 2017-06-12 | 2017-11-17 | 安徽中控仪表有限公司 | The big data of energy monitor Optimal Management System excavates framework |
| CN107563721A (en) * | 2017-08-09 | 2018-01-09 | 国网上海市电力公司 | Electric power meter field test integrated information management system and management method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141370A (en) * | 2007-10-09 | 2008-03-12 | 南京财经大学 | Gridding service based electric power enterprise real-time data processing method |
| US20120113244A1 (en) * | 2010-08-13 | 2012-05-10 | Certusview Technologies, Llc | Methods, apparatus and systems for marking material color detection in connection with locate and marking operations |
| CN102945250A (en) * | 2012-10-11 | 2013-02-27 | 广西电网公司电力科学研究院 | Online infrared data processing method |
| CN104462314A (en) * | 2014-11-28 | 2015-03-25 | 国家电网公司 | Power grid data processing method and device |
-
2015
- 2015-04-23 CN CN201510198991.3A patent/CN106156936A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141370A (en) * | 2007-10-09 | 2008-03-12 | 南京财经大学 | Gridding service based electric power enterprise real-time data processing method |
| US20120113244A1 (en) * | 2010-08-13 | 2012-05-10 | Certusview Technologies, Llc | Methods, apparatus and systems for marking material color detection in connection with locate and marking operations |
| CN102945250A (en) * | 2012-10-11 | 2013-02-27 | 广西电网公司电力科学研究院 | Online infrared data processing method |
| CN104462314A (en) * | 2014-11-28 | 2015-03-25 | 国家电网公司 | Power grid data processing method and device |
Non-Patent Citations (1)
| Title |
|---|
| 施群等: "《油田电网规划与设计》", 31 March 2011 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107293173A (en) * | 2017-06-06 | 2017-10-24 | 积成电子股份有限公司 | Distribution network failure emulation training modeling method based on isolation information battle array |
| CN107293173B (en) * | 2017-06-06 | 2019-08-23 | 积成电子股份有限公司 | Distribution network failure emulation training modeling method based on isolation information battle array |
| CN107357818A (en) * | 2017-06-12 | 2017-11-17 | 安徽中控仪表有限公司 | The big data of energy monitor Optimal Management System excavates framework |
| CN107563721A (en) * | 2017-08-09 | 2018-01-09 | 国网上海市电力公司 | Electric power meter field test integrated information management system and management method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111131480A (en) | Cloud edge cooperative service system for smart power plant | |
| CN113435923B (en) | Power consumption prediction method and device and electronic equipment | |
| CN104899284B (en) | A kind of method and device for dispatching system based on metadata driven | |
| CN106156936A (en) | A kind of electric power system data analyzes method and system | |
| CN110135599A (en) | Unmanned plane electric inspection process point cloud intelligent processing and Analysis Service platform | |
| CN101883015A (en) | Method and system for filtering construction alarms | |
| CN104462456A (en) | Life data processing based big data system | |
| CN107526007A (en) | The recognition methods of fault type and device | |
| CN106980055A (en) | A kind of student dormitory based on data mining electrical equipment violating the regulations uses monitoring system | |
| CN106056233A (en) | Power load prediction method | |
| CN107679133B (en) | Mining method applicable to massive real-time PMU data | |
| CN116822754B (en) | Data specification analysis system based on modularized classification of enterprise service items | |
| CN113852204A (en) | Three-dimensional panoramic monitoring system and method for transformer substation with digital twin | |
| CN109271566A (en) | A kind of computer data processing system | |
| CN110413622B (en) | Data processing method based on electric power big data platform | |
| CN116128270A (en) | Power grid operation plan management method and device for multi-source data fusion | |
| CN115186935B (en) | Electromechanical device nonlinear fault prediction method and system | |
| CN106295144A (en) | A kind of medical data acquisition method of quality control | |
| CN205397912U (en) | Hoisting machinery control analytic system | |
| CN104301388A (en) | Large running system monitoring and analyzing management system | |
| CN104123584A (en) | Organization optimization method based on information system | |
| CN104200338A (en) | Line loss statistics and decision analysis system | |
| CN104123585A (en) | Service organization optimization analysis method based on service simulation | |
| CN107919998A (en) | Sensor-service end function test method and system based on JMeter | |
| CN211928020U (en) | Electric energy acquisition data analysis early warning device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161123 |
|
| RJ01 | Rejection of invention patent application after publication |