CN103412927A - Method for rapidly analyzing IEC61850 mass data - Google Patents
Method for rapidly analyzing IEC61850 mass data Download PDFInfo
- Publication number
- CN103412927A CN103412927A CN2013103558157A CN201310355815A CN103412927A CN 103412927 A CN103412927 A CN 103412927A CN 2013103558157 A CN2013103558157 A CN 2013103558157A CN 201310355815 A CN201310355815 A CN 201310355815A CN 103412927 A CN103412927 A CN 103412927A
- Authority
- CN
- China
- Prior art keywords
- data
- interface
- analysis
- mass
- preset range
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a method for rapidly analyzing IEC61850 mass data. According to the method, the mass data is rapidly traversed through a unified data management interface, abstracts and a locator, and only data in a preset range resides in a memory and is analyzed, so that rapid data analysis with the fixed memory regardless of the size of data is realized. According to the method, an optimized high-performance data management back end aiming at selection of different types of data can be realized based on the unified data management interface; moreover, the mass data can be rapidly traversed and analyzed under the condition of controllable low resources, the problem that conventional IEC61850 mass data cannot be processed is solved, and the method can serve as a reference or be directly used for processing novel types of mass data in the future.
Description
Technical field
The present invention relates to a kind of IEC61850 data analysing method, belong to the power automation technical field, particularly for the rapid analysis of IEC61850 mass network communication data.
Background technology
IEC61850 is power automation communication network and the systems technology standard that IEC TC57 formulates, in intelligent substation, generally applied, and by the communication definitions of transformer station, be 3 layers: station level, wall and process layer.Wherein, process layer is by the Internet Transmission digitized signal, as on off state, sampled value, with conventional electric power, communicating by letter, to compare digitized network communication data amount very large, just can reach the data volume of several TB in 1 day, the product of multi-compartment sampling such as the data-handling capacity of digitizing fault oscillograph, network recording instrument etc. have been proposed to new challenge.For the consideration of safe operation and fault diagnosis, need to record these communication datas, and retrieve and localization of fault based on these data, difficulty is large, because be for mass data processing.Intelligent substation exists characteristics and the trend of multiple application integration and data sharing, faces equally the processing of mass data.
At present a lot of products adopt and have improved network throughput as Computer Aided Designs such as FPGA, DSP aspect network insertion, can satisfy the demands; But aspect data management and analysis, there are several distinct issues: (1) all types of the data same way management, comprise storage, retrieval etc., management of performance is low, and improvement and expansion difficulty are large; (2) slow, the consumption internal memory of data retrieval analysis speed, even occur applying or the situation of system crash when data volume is very large.
In fact several data adopts a kind of mode to manage and is difficult to reach ideal effect, due to the difference of data characteristics, sometimes even because take into account too many, causes other effects undesirable; If in application process, certain data characteristics difference is excessive, and in the time of can't using the management of legacy data way to manage, the change of whole application system will be very large, may draw other as problems such as stability, compatibility.More the data with existing analysis is adopted the raw data terminate-and-stay-resident and increases the assistant analysis data, fast based on analysis and the traversal speed of internal memory like this, but consumption internal memory (being greater than at least original data volume), especially when data volume is very large, whole structure can descend (causing as the system virtualization memory mechanism) even because of low memory, collapse.These problems have directly affected the availability of application, and maintenance cost is high, has also reduced the work efficiency of operation maintenance, is potential safety and stability risk.Therefore, the management of mass data and analysis are current problem demanding prompt solutions.Along with the intelligentized development of intelligent substation, data volume can constantly increase, and namely the treatment technology of mass data needs constantly explore and improve.
Summary of the invention
In order to overcome the deficiency of above-mentioned prior art, the invention provides a kind of IEC61850 mass data rapid analysis.
The technical solution adopted in the present invention is:
A kind of IEC61850 mass data rapid analysis, described analytical approach is by the uniform data management interface, and summary and steady arm realize the quick traversal of mass data, only by the data terminate-and-stay-resident in preset range and analyze, it is characterized in that, described analytical approach comprises the following steps:
(1) in intelligent substation in the IEC61850 communication system, be identified for the common interface of data management, i.e. unified data management interface, this data management interface, by concrete data management back-end realization, supports to use several data management rear end; Data management interface comprises summarization generation interface, locating interface, obtains interface, analysis interface; Wherein:
Described summarization generation interface generates positional information and data key message by mass data by entry;
The summary info that described locating interface generates according to described summarization generation interface is realized the quick-searching of data key message and is determined corresponding positional information;
Described obtain interface according to described locating interface established data positional information from the data entry that is retrieved of quick obtaining mass data;
Described analysis interface will be obtained the data entry that interface obtains and be carried out labor and export analysis result by described.
(2) according to data management interface corresponding to step (1), generating mass data makes a summary and is stored as the summary storehouse, use the summarization generation interface according to the data key feature, to carry out express-analysis to mass data, generate the summary that comprises key message and Data Position information; The analysis of data key feature and the summarization generation Interface realization of acquisition in data management interface, described data key feature is as a part of content of summary, when locator data, from the summary storehouse, submit to locating interface by steady arm, then by the data management rear end, specifically processed;
(3) according to summary corresponding to step (2), obtain the data in preset range and analyze in location fast by steady arm; Steady arm has recorded the reference position of the current data of analyzing in mass data, the data entry number of preset range for analyzing at internal memory; After steady arm was realized fast moving location according to summary by locating interface, the data of the preset range started from the positioning instant reference position were loaded into internal memory by data acquisition interface, then by the data analysis interface, analyze;
(4) by mobile locator, realize the analysis to all mass datas; Steady arm moves and while navigating to reposition, data away from reposition in former preset range shift out internal memory, data near reposition move into internal memory, and data volume is no more than preset range all the time, thereby realize, rapid data analysis stable, that low-resource take irrelevant with the data volume size.
Compared with the prior art, the invention has the beneficial effects as follows: the design that data management interface of the present invention and back-end realization are separated has improved the data management performance, and is easy to improve and expansion, extends the product life cycle, reduces maintenance cost; By the mass data express-analysis that summary and steady arm are realized, significantly improved the availability of application, the efficiency of operation maintenance is provided.
The accompanying drawing explanation
The present invention is further described in more detail below in conjunction with drawings and the specific embodiments.
Fig. 1 is the level schematic diagram of IEC61850 mass data rapid analysis of the present invention.
Embodiment
The present invention is further described below in conjunction with drawings and Examples.
The application discloses a kind of IEC61850 mass data rapid analysis.The technical solution adopted in the present invention is: by the uniform data management interface, and summary and steady arm are realized the quick traversal of mass data, only by the data terminate-and-stay-resident in preset range analysis, thereby realize the rapid data the analysis no matter much required memories of data volume are fixed, comprise the following steps:
(1) general character of locating, obtaining, analyze according to data is determined unified data management interface.Feature, memory requirement, retrieval to the Various types of data in IEC61850 communication in intelligent substation are located, are obtained and analyze and carried out contrasting and summing up general character, determined the common interface for data management, comprised summarization generation interface, locating interface, obtain interface, analysis interface.Data management interface is by concrete data management back-end realization, support to use several data management rear end, thereby can manage rear end according to the high-performance data of concrete data characteristics design optimization, and improve fast data with existing management rear end and realize fast and deployment newtype data management rear end.
As shown in Figure 1, data management interface 10 of the present invention is that feature, memory requirement, the retrieval of the Various types of data in IEC61850 communication in to intelligent substation located, obtained and analyze and carried out contrasting and summing up general character, determined the common interface for data management, comprised summarization generation interface 11, locating interface 12, obtain interface 13, analysis interface 14.Data management rear end 20 is that of data management interface 10 realizes body, in real system application, a plurality of bodies of realizing can be arranged, and each realizes that body must realize the desired summarization generation 11 of data management interface 10, location 12, obtain 13 and analyze 14.This design, by actual data management rear end 20 and the decoupling zero of rapid data analytical approach, makes data management rear end 20 be easy to improve, expand, dispose, and is conducive to particular type data selection optimized high performance way to manage separately.The data characteristics of 3 kinds of communicate by letter MMS, GOOSE and SV of IEC61850 is widely different, can adopt different data management rear ends.Summarization generation interface 11 generates positional information and data key message by mass data 30 by entry, and is stored as summary 40; Data key message content and form are realized by concrete data management rear end 20, so the data key message of different pieces of information management rear end 20 may be different.The summary 40 that locating interface 12 generates according to summarization generation interface 11 is realized the quick-searching of data key message and is determined corresponding positional information.Obtain interface 13 according to locating interface 12 established data positional informations from the data entry that is retrieved of quick obtaining mass data 30.Analyzing 14 will carry out labor and export analysis result to internal memory by obtaining the 13 data entries of obtaining.
(2) according to data management interface corresponding to step (1), generate the mass data summary.Use the summarization generation interface according to the data key feature, to carry out express-analysis to mass data, generate the summary that comprises key message and Data Position information.The analysis of data key feature and acquisition, by concrete data management back-end realization, as a part of content of summary, are submitted to locating interface by steady arm from the summary storehouse when locator data, then by the data management rear end, specifically processed.
As shown in Figure 1, before carrying out the rapid data analysis, use the summary 40 of summarization generation interface 11 generated datas 30.The 40 disposable generations of making a summary, can, at mass data 30 rapidly locatings, obtain the data acquisition of interface 13 for locating interface 12 while being convenient to analyze.Summarization generation interface 11 should be able to fast processing data 30, and summary 40 data volumes that generate are little.A summary of summary 40 comprises positional information and the data key message of corresponding data entry in data 30, call format: the skew (64 integers) in data 30 forms positional information by data entry number (64 integers), data entry, and the data key message is a maximum 32 byte binary data.Summary info is only done call format, and the implication of specifying information is processed by concrete data management rear end 20, namely makes a summary 40 by 20 generations of data management rear end, when location, imports location 12 into and still by data management rear end 20, is processed.A summary summary of 40 can 30 1 data of corresponding data, corresponding one by one; Article one, summary also can corresponding one piece of data, i.e. the initial entry of many data, one-to-many; One by one at once can disposable accurate location, but it be 40 larger to make a summary; During one-to-many between two summaries fuzzy location, summary is 40 less, especially is applicable to the very large situation of data 30.
(3) according to summary corresponding to step (2), obtain the data in preset range and analyze in location fast by steady arm.Steady arm has recorded the reference position of the current data of analyzing in mass data.The data entry number of preset range for analyzing at internal memory.After steady arm was realized fast moving location according to summary by locating interface, the data of the preset range started from the positioning instant reference position were loaded into internal memory by data acquisition interface, then by the data analysis interface, analyze.
As shown in Figure 1, after summary 40 generates, just can use steady arm 50 to travel through location by locating 12 pairs of data 30.Steady arm 50 has recorded the reference position of the current data of just analyzing in internal memory in data 30, and namely the steady arm position 70.Data 30 are being traveled through to when location, steady arm 50 is obtained corresponding summary entries information from making a summary 40 and is imported location 12 into, and upgrades the steady arm position 70 of steady arm 50 at every turn.The traversal location is two-way, namely can, to the location, front of data 30, also can locate rearwards.Because summary 40 information that provide have been dwindled the traversal orientation range, so even data 30 are very large, the traversal location is also fast; On the other hand, if the summary info accuracy of data management rear end 20 and to locate 12 handling property relatively good, the traversal location can be faster.After steady arm 50 location are determined, just can from data 30, obtain data by obtaining 13, then by analyzing 14, in internal memory, analyze the data of obtaining.The concrete data of analyzing in internal memory are relevant with the steady arm position 70 of steady arm 50.Steady arm position 70 is the reference position of the data analyzed in internal memory, the Data Position in corresponding data 30, and the data that start from this position, be no more than preset range 60 are analyzed internal memory.The maximum data entry number of preset range 60 for analyzing in internal memory at one time, therefore no matter data 30 are much, and when traversal was analyzed, required maximum memory was fixed.Preset range 60 is configurable, and larger use internal memory is larger, but the fluency of analyzing is better.Preset range 60 is also attached a kind of mechanism simultaneously, when analyzing, be no more than preset range 60 in order to control the data entry number of analyzing simultaneously, before having new data to be acquired and preparing to analyze, at first the data of analyzing to be shifted out to 80 parts from internal memory, make remaining data and new data summation be no more than preset range 60.Take steady arm position 70 is benchmark, and in the former data of analyzing in internal memory, away from 80 internal memories that are moved out of of this benchmark, close is moved into 90; Alternate position spike before this benchmark and location is new data, and amount of new data determines, just can determine the data that will shift out and shift out according to preset range 60 and the data volume just analyzed in internal memory, then obtains new data and analyzes in internal memory.
(4) by mobile locator, realize the analysis to all mass datas.Steady arm moves and while navigating to reposition, data away from reposition in former preset range shift out internal memory, data near reposition move into internal memory, and data volume is no more than preset range all the time, thereby realize, rapid data analysis stable, that low-resource take irrelevant with the data volume size.All data traversals of data 30 are analyzed and worked in coordination with by above-mentioned data management interface 10, data management rear end 20, steady arm 50 and preset range 60.No matter data volume is much, can 40 dwindle the traversal orientation range by making a summary, and namely can travel through fast steady arm position 70 and obtain data; The data volume of analyzing in internal memory at one time is no more than preset range 60, depends on shifting out 80, moving into 90 mechanism of preset range 60, can the control analysis required memory, and also the data of analyzing are the sub-fraction in mass data, and analysis speed is fast.Integrate, method of the present invention has realized being easy to the high-performance data that improves, expands and dispose management, and has realized, rapid data analysis stable, that low-resource take irrelevant with the data volume size.
The embodiment more than provided is in order to illustrate the present invention and its practical application, and therefore make those skilled in the art can realize or use the present invention, or else those of ordinary skills can break away from the situation of invention thought of the present invention, above-described embodiment is made to various modifications or variation, thereby the present invention do not limit by above-described embodiment, and it should be the maximum magnitude that meets the novelty characteristic that claims mention.
Claims (4)
1. IEC61850 mass data rapid analysis, described analytical approach is by the uniform data management interface, and summary and steady arm realize the quick traversal of mass data, only by the data terminate-and-stay-resident in preset range and analyze, it is characterized in that, described analytical approach comprises the following steps:
(1) in intelligent substation in the IEC61850 communication system, be identified for the common interface of data management, i.e. unified data management interface, this data management interface is by concrete data management back-end realization, support to use several data management rear end, described data management interface comprises summarization generation interface, locating interface, obtains interface, analysis interface; Wherein:
Described summarization generation interface generates mass data the summary that comprises Data Position information and data key message by entry;
The summary info that described locating interface generates according to described summarization generation interface is realized the quick-searching of data key message and is determined the positional information of corresponding data;
Described obtain interface according to described locating interface established data positional information from the data entry that is retrieved of quick obtaining mass data;
Described analysis interface will be obtained the data entry that interface obtains and be carried out labor and export analysis result by described;
(2) according to data management interface corresponding to step (1), generate the summary of mass data and be stored as the summary storehouse: the summarization generation interface in the usage data management interface carries out express-analysis to mass data according to the data key feature, generates the summary that comprises key message and Data Position information.
(3) according to summary corresponding to step (2), obtain the data in preset range and analyze in location fast by steady arm;
(4) by mobile locator, realize the analysis to all mass datas.
2. IEC61850 mass data rapid analysis according to claim 1 is characterized in that:
In step (2), the analysis of data key feature and the summarization generation Interface realization of acquisition in data management interface, generate key message and the Data Position information a part of content as summary, when locator data, will be made a summary and be submitted to locating interface from the summary storehouse by steady arm, then the locating interface in data management interface is realized the positional information of quick-searching definite corresponding data of data key message.
3. IEC61850 mass data rapid analysis according to claim 1 is characterized in that:
In step (3), steady arm has recorded the reference position of the current data of analyzing in mass data, the data entry number of preset range for analyzing at internal memory; After steady arm was realized fast moving location according to summary by locating interface, the data of the preset range started from the positioning instant reference position were loaded into internal memory by data acquisition interface, then by the data analysis interface, analyze.
4. IEC61850 mass data rapid analysis according to claim 1 is characterized in that:
In step (4), steady arm moves and while navigating to reposition, data away from reposition in former preset range shift out internal memory, the data that are in new preset range move into internal memory, data volume is no more than preset range all the time, thereby realizes, rapid data analysis stable, that low-resource take irrelevant with the data volume size.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310355815.7A CN103412927B (en) | 2013-08-15 | 2013-08-15 | A kind of IEC61850 mass data rapid analysis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310355815.7A CN103412927B (en) | 2013-08-15 | 2013-08-15 | A kind of IEC61850 mass data rapid analysis method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103412927A true CN103412927A (en) | 2013-11-27 |
| CN103412927B CN103412927B (en) | 2016-05-25 |
Family
ID=49605939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310355815.7A Active CN103412927B (en) | 2013-08-15 | 2013-08-15 | A kind of IEC61850 mass data rapid analysis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103412927B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104283746A (en) * | 2014-09-26 | 2015-01-14 | 中国南方电网有限责任公司电网技术研究中心 | System and method for realizing integration of three networks of digital transformer substation by using FPGA |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201726415U (en) * | 2010-06-12 | 2011-01-26 | 广东电网公司茂名供电局 | IEC61850 communication-oriented network wave recorder |
| CN102158550A (en) * | 2011-03-03 | 2011-08-17 | 河南电力试验研究院 | IEC61850-based power quality transient data transmission method |
| US20130198245A1 (en) * | 2011-10-04 | 2013-08-01 | Electro Industries/Gauge Tech | Systems and methods for collecting, analyzing, billing, and reporting data from intelligent electronic devices |
-
2013
- 2013-08-15 CN CN201310355815.7A patent/CN103412927B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201726415U (en) * | 2010-06-12 | 2011-01-26 | 广东电网公司茂名供电局 | IEC61850 communication-oriented network wave recorder |
| CN102158550A (en) * | 2011-03-03 | 2011-08-17 | 河南电力试验研究院 | IEC61850-based power quality transient data transmission method |
| US20130198245A1 (en) * | 2011-10-04 | 2013-08-01 | Electro Industries/Gauge Tech | Systems and methods for collecting, analyzing, billing, and reporting data from intelligent electronic devices |
Non-Patent Citations (1)
| Title |
|---|
| 宋亚奇 等: "智能电网大数据处理技术现状与挑战", 《电网技术》, vol. 37, no. 4, 30 April 2013 (2013-04-30), pages 927 - 935 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104283746A (en) * | 2014-09-26 | 2015-01-14 | 中国南方电网有限责任公司电网技术研究中心 | System and method for realizing integration of three networks of digital transformer substation by using FPGA |
| CN104283746B (en) * | 2014-09-26 | 2017-07-28 | 中国南方电网有限责任公司电网技术研究中心 | System and method for realizing integration of three networks of digital transformer substation by using FPGA |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103412927B (en) | 2016-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103605805A (en) | Storage method of massive time series data | |
| CN104317800A (en) | Hybrid storage system and method for mass intelligent power utilization data | |
| CN102880854B (en) | Distributed processing and Hash mapping-based outdoor massive object identification method and system | |
| CN102968464B (en) | A kind of search method of the local resource quick retrieval system based on index | |
| CN103548004B (en) | The method and apparatus of dynamic data attemper is realized in file system | |
| CN103678603A (en) | Multi-source heterogeneous data efficient converging and storing frame system | |
| CN102164175A (en) | Cloud-storage-based electricity utilization information acquisition method and system | |
| CN102682051A (en) | Method for integrating time series database with intelligent grid scheduling technology support system | |
| CN104809246A (en) | Method and device for processing charging data | |
| Ghotiya et al. | Migration from relational to NoSQL database | |
| CN104571946B (en) | A kind of storage arrangement and its access method for supporting logic circuit quick search | |
| CN107704532A (en) | The method that instance document and criteria for classification are cached based on Redis | |
| CN103198126B (en) | Internet of Things Temporal-spatial data management method | |
| CN103412927A (en) | Method for rapidly analyzing IEC61850 mass data | |
| CN102685222B (en) | A kind of cloud SRM device for electric power system | |
| CN103226794A (en) | Data processing method of power transmission and distribution line | |
| CN105574027A (en) | On-line transaction processing/on-line analytical processing (OLTP/OLAP) hybrid application based multi-dimensional performance data storage method, device and system | |
| CN102521318A (en) | General data exchange device based on extensible markup language (XML) | |
| CN103713930A (en) | Method and device for graphically defining process map | |
| CN104537047B (en) | A kind of clothes basic pattern plate searching system based on Lucene | |
| CN104331426B (en) | A kind of method for quickly retrieving of the electric system searcher based on browser | |
| CN104572730A (en) | Method and device for importing and exporting digital resources | |
| CN205228473U (en) | Miniature navigational computer based on field programmable gate array | |
| CN102541908A (en) | Log database system sub-volume management method | |
| CN102945271A (en) | Simplified storing and backtracking method for several times of historical relation changes of single land parcel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |