CN103412927B - A kind of IEC61850 mass data rapid analysis method - Google Patents
A kind of IEC61850 mass data rapid analysis method Download PDFInfo
- Publication number
- CN103412927B CN103412927B CN201310355815.7A CN201310355815A CN103412927B CN 103412927 B CN103412927 B CN 103412927B CN 201310355815 A CN201310355815 A CN 201310355815A CN 103412927 B CN103412927 B CN 103412927B
- Authority
- CN
- China
- Prior art keywords
- data
- interface
- analysis
- mass
- locator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 44
- 238000013523 data management Methods 0.000 claims abstract description 48
- 230000015654 memory Effects 0.000 claims abstract description 30
- 238000007405 data analysis Methods 0.000 claims abstract description 10
- 238000013479 data entry Methods 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 10
- 241001269238 Data Species 0.000 claims description 5
- 238000000034 method Methods 0.000 abstract description 9
- 238000012545 processing Methods 0.000 abstract description 4
- 238000007726 management method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 230000008676 import Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 241000272814 Anser sp. Species 0.000 description 1
- 241000669618 Nothes Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011960 computer-aided design Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A kind of IEC61850 mass data rapid analysis method, method of the present invention is by uniform data management interface, and summary and locator are realized the quick traversal of mass data, only by the data terminate-and-stay-resident in preset range and analyze, thereby realize the no matter fixing rapid data analysis of the much required memories of data. By the use of the method, can select to realize optimized high-performance data management rear end for different types of data by the data management interface based on unified, and can in controlled low-resource situation, realize quick traversal and the analysis of mass data, not only solve the problem of existing IEC61850 mass data processing, also can be used as the reference of following newtype mass data processing or directly use.
Description
Technical field
The present invention relates to a kind of IEC61850 data analysing method, belong to power automation technical field, specialIt is the rapid analysis method for IEC61850 mass network communication data.
Background technology
IEC61850 is power automation communication network and the systems technology standard that IECTC57 formulates, in intelligenceCan in transformer station, generally be applied, be 3 layers by the communication definitions of transformer station: station level, wall and process layer.Wherein, process layer, by Internet Transmission digitized signal, as on off state, sampled value, is communicated by letter with conventional electric powerCompare digitized network communication data amount very large, within 1 day, just can reach the data volume of several TB, multi-compartment is adoptedThe product of sample has proposed new challenge as the data-handling capacity of digitlization fault oscillograph, network recording instrument etc.For the consideration of safe operation and fault diagnosis, need to record these communication datas, and enter based on these dataLine retrieval and fault location, difficulty is large, because be for mass data processing. Intelligent substation exists multipleThe feature of application integration and data sharing and trend, face the processing of mass data equally.
At present a lot of products adopt as the Computer Aided Design such as FPGA, DSP has improved network and handle up aspect network insertionAmount, can satisfy the demands; But aspect data management and analysis, there are several distinct issues: (1) all classesThe data acquisition of type is managed with same way, comprises storage, retrieval etc., and management of performance is low, improves and expansion difficultyDegree is large; (2), even there is application or be in slow, the consumption internal memory of data retrieval analysis speed in the time that data volume is very largeThe situation of system collapse.
In fact several data adopts a kind of mode to manage and is difficult to reach ideal effect, poor due to data characteristicsDifferent, sometimes even cause other effects undesirable because take into account too many; If in application process, certainPlant data characteristics difference excessive, cannot use the management of legacy data way to manage time, the change of whole application systemTo be very large, may draw other as the problem such as stability, compatibility. The many employings of data with existing analysis are by formerBeginning data terminate-and-stay-resident also increases assistant analysis data, and the analysis based on internal memory and traversal speed are fast like this, but consumptionInternal memory (being at least greater than original data volume), especially, in the time that data volume is very large, whole structure can decline (as beingSystem virtual memory mechanism causes) even because low memory collapses. These problems have directly affected the available of applicationProperty, maintenance cost is high, has also reduced the operating efficiency of operation maintenance, is potential safety and stability risk. Therefore,The management of mass data and analysis are current problem demanding prompt solutions. Along with intelligent substation intelligentized continuousExhibition, data volume can constantly increase, and the treatment technology of mass data needs constantly to explore and improve.
Summary of the invention
In order to overcome the deficiency of above-mentioned prior art, the invention provides a kind of IEC61850 mass data quickAnalytical method.
The technical solution adopted in the present invention is:
A kind of IEC61850 mass data rapid analysis method, described analytical method is managed and is connect by uniform dataMouthful, and summary and locator realize the quick traversal of mass data, only by resident the data in preset rangeDeposit and analyze, it is characterized in that, described analytical method comprises the following steps:
(1) in intelligent substation in IEC61850 communication system, be identified for data management common interface,I.e. unified data management interface, this data management interface, by concrete data management back-end realization, is supported to useSeveral data management rear end; Data management interface comprises summarization generation interface, locating interface, obtains interface,Analysis interface; Wherein:
Described summarization generation interface generates positional information and data key message by mass data by entry;
The summary info that described locating interface generates according to described summarization generation interface is realized data key messageQuick-searching is also determined corresponding positional information;
The described interface that obtains obtains from mass data fast according to described locating interface established data positional informationGet the data entry that is retrieved;
Described analysis interface will obtain that data entry that interface obtains is carried out labor and output is analyzed by describedResult.
(2) generate mass data according to data management interface corresponding to step (1) and make a summary and be stored as the storehouse of making a summary,Use summarization generation interface to carry out rapid analysis to mass data according to data key feature, generate and comprise crucial letterThe summary of breath and Data Position information; The analysis of data key feature and acquisition are by the summary in data management interfaceGenerate Interface realization, described data key feature as summary a part of content, in the time of locator data by locatingDevice is submitted to locating interface from summary storehouse, is then specifically processed by data management rear end;
(3) obtain the number in preset range in location according to summary corresponding to step (2) fast by locatorAccording to also analyzing; Locator has recorded the original position of the current data of analyzing in mass data, default modelEnclose the data entry number for analyzing at internal memory; Locator is realized fast moving according to summary by locating interfaceBehind location, in the data of the preset range starting from positioning instant original position are loaded into by data acquisition interfaceDeposit, then analyze by data analysis interface;
(4) realize the analysis to all mass datas by mobile locator; Locator moves and navigates to repositionTime, the data away from reposition in former preset range shift out internal memory, move into internal memory, number near the data of repositionAll the time be no more than preset range according to amount, thereby realization is that have nothing to do, stable with data volume size, low-resource takiesRapid data analysis.
Compared with the prior art, the invention has the beneficial effects as follows: data management interface of the present invention and back-end realizationThe design separating has improved data management performance, and is easy to improve and expansion, extends the product life cycle, reducesMaintenance cost; The mass data rapid analysis realizing by summary and locator, has significantly improved the available of applicationProperty, provides the efficiency of operation maintenance.
Brief description of the drawings
Below in conjunction with drawings and the specific embodiments, the present invention is further described in more detail.
Fig. 1 is the level schematic diagram of IEC61850 mass data rapid analysis method of the present invention.
Detailed description of the invention
Below in conjunction with drawings and Examples, the present invention is further described.
The application discloses a kind of IEC61850 mass data rapid analysis method. The technology used in the present inventionScheme is: by uniform data management interface, and summary and locator realize the quick traversal of mass data,Only, by the data terminate-and-stay-resident in preset range analysis, thereby realize, no matter the much required memories of data volume are fixedRapid data analysis, comprise the following steps:
(1) general character of locating, obtaining, analyze according to data is determined unified data management interface. To intelligenceThe feature of the Various types of data in transformer station in IEC61850 communication, memory requirement, retrieval are located, are obtained and divideAnalyse and carried out contrasting and sum up general character, determined the common interface for data management, comprise summarization generation interface,Locating interface, obtain interface, analysis interface. Data management interface, by concrete data management back-end realization, props upHold and use several data management rear end, thus can be according to the high-performance data of concrete data characteristics design optimizationManagement rear end, and improve fast data with existing management rear end and realize fast and dispose after newtype data managementEnd.
As shown in Figure 1, data management interface 10 of the present invention is IEC61850 communication in to intelligent substationIn Various types of data feature, memory requirement, retrieval location, obtain and analyze and carried out contrasting and summing up general character,Determine the common interface for data management, comprised summarization generation interface 11, locating interface 12, obtain and connectMouth 13, analysis interface 14. Data management rear end 20 is that of data management interface 10 realizes body, in realityIn the system applies of border, can have multiple bodies of realizing, each body of realizing must be realized 10 requirements of data management interfaceSummarization generation 11, location 12, obtain 13 and analyze 14. This design is by actual data management rear end20 with the decoupling zero of rapid data analytical method, make data management rear end 20 be easy to improve, expansion, dispose, favourableIn particular type data selection optimized high performance way to manage separately. 3 kinds of IEC61850 communication MMS,The data characteristics of GOOSE and SV is widely different, can adopt different data management rear ends. Summarization generation connectsMouth 11 generates positional information and data key message by mass data 30 by entry, and is stored as summary 40;Data key message content and form are realized by concrete data management rear end 20, so after different pieces of information managementThe data key message of end 20 may be different. The summary that locating interface 12 generates according to summarization generation interface 1140 realize the quick-searching of data key message and determine corresponding positional information. Obtain interface 13 according to locationInterface 12 established data positional informations quick obtaining from mass data 30 data entry that is retrieved. Analyze14 will carry out labor and export analysis result to internal memory by obtaining the 13 data entries of obtaining.
(2) generate mass data summary according to data management interface corresponding to step (1). Use summarization generationInterface carries out rapid analysis to mass data according to data key feature, generates and comprises key message and Data PositionThe summary of information. The analysis of data key feature and acquisition are by concrete data management back-end realization, as summaryA part of content, in the time of locator data by locator from summary storehouse submit to locating interface, then by data pipeSpecifically process reason rear end.
As shown in Figure 1, before carrying out rapid data analysis, use summarization generation interface 11 generated datas 30Summary 40. The 40 disposable generations of making a summary, can be fixed fast in mass data 30 for locating interface 12Bit data, obtains the data acquisition of interface 13 while being convenient to analyze. Summarization generation interface 11 should be able to fast processingData 30, and summary 40 data volumes that generate are little. A summary of summary 40 comprises corresponding data stripPositional information and the data key message of order in data 30, call format: positional information is by data entry number(64 integers), data entry skew (64 integers) composition in data 30, data key messageBe a maximum 32 byte binary data. Summary info only does call format, and the implication of specifying information is by toolProcess volume data management rear end 20, makes a summary 40 to be generated by data management rear end 20, and it is fixed in the time of location, to import intoPosition 12 is still processed by data management rear end 20. A summary summary of 40 can 30 1 data of corresponding data,Corresponding one by one; Article one, summary also can corresponding one piece of data, i.e. the initial entry of many data, one-to-many; OneA pair of at once can disposable accurate location, but summary 40 is larger; Fuzzy fixed between two summaries when one-to-manyPosition, summary 40 is less, is especially applicable to the very large situation of data 30.
(3) obtain the number in preset range in location according to summary corresponding to step (2) fast by locatorAccording to also analyzing. Locator has recorded the original position of the current data of analyzing in mass data. Default modelEnclose the data entry number for analyzing at internal memory. Locator is realized fast moving according to summary by locating interfaceBehind location, in the data of the preset range starting from positioning instant original position are loaded into by data acquisition interfaceDeposit, then analyze by data analysis interface.
As shown in Figure 1, after summary 40 generates, just can use locator 50 by the 12 pairs of data in location30 travel through location. Locator 50 has recorded current data of just analyzing in internal memory in data 30Original position, i.e. locator position 70. At every turn data 30 being traveled through to when location, locator 50 fromIn summary 40, obtain corresponding summary entries information and import location 12 into, and upgrade the locator position of locator 50Put 70. Traversal location is two-way, can, to the location above of data 30, also can locate rearwards.Because summary 40 information that provide have been dwindled traversal orientation range, so even if data 30 are very large,Traversal location is also fast; On the other hand, if the summary info accuracy of data management rear end 20 and fixedThe handling property of position 12 is relatively good, and traversal location can be faster. After locator 50 location are determined, just can lead toCross and obtain 13 and obtain data from data 30, then in internal memory, analyze by analyzing 14 the data of obtaining. InteriorDeposit the concrete data of middle analysis relevant with the locator position 70 of locator 50. Locator position 70 is interiorDeposit the original position of the data of middle analysis, the Data Position in corresponding data 30, start from this position, noThe data that exceed preset range 60 are analyzed in internal memory. Preset range 60 for analyzing at one time in internal memoryMaximum data entry number, therefore no matter data 30 are much, traversal analyze time, required maximum memory is fixed.Preset range 60 is configurable, and larger use internal memory is larger, but the fluency of analyzing is better. Preset range 60Simultaneously also subsidiary a kind of machine-processed, in the time analyzing, be no more than preset range in order to control the data entry number of analyzing simultaneously60, before having new data to be acquired and preparing to analyze, first the data of analyzing to be shifted out to 80 from internal memoryA part, makes remaining data and new data summation be no more than preset range 60. Taking locator position 70 asBenchmark, in the former data of analyzing in internal memory, away from 80 internal memories that are moved out of of this benchmark, close is moved into 90;Alternate position spike before this benchmark and location is new data, and amount of new data determines, according to preset range 60 and justThe data volume of analyzing in internal memory just can determine the data that will shift out and shift out, and then obtains new data and at internal memoryMiddle analysis.
(4) realize the analysis to all mass datas by mobile locator. Locator moves and navigates to newly, the data away from reposition in former preset range shift out internal memory when the position, move into internal memory near the data of reposition,Data volume is no more than preset range all the time, thereby realization is that have nothing to do, stable with data volume size, low-resource accounts forWith rapid data analysis. All data traversals to data 30 are analyzed by above-mentioned data management interface 10, numberWork in coordination with according to management rear end 20, locator 50 and preset range 60. No matter data volume is much, and total energy is logicalCrossing makes a summary 40 dwindles traversal orientation range, can travel through fast locator position 70 and obtain data; SameThe data volume that one time was analyzed in internal memory is no more than preset range 60, depend on preset range 60 shift out 80,Move into 90 mechanism, can control analysis required memory, and also the data of analyzing are one in mass dataFraction, analysis speed is fast. Integrate, method of the present invention realized be easy to improve, expansion and disposeHigh-performance data management, and realized with data volume size irrelevant, stable, low-resource takies fastData analysis.
The embodiment more than providing is in order to the practical application of the present invention and it to be described, and therefore makes this areaTechnical staff can realize or use the present invention, and or else those of ordinary skill in the art can depart from of the present inventionIn the situation of bright thought, above-described embodiment is made to various modifications or variation, thereby the present invention is not by above-mentioned realityExecute example institute and limit, and should be the maximum magnitude that meets the novelty characteristic that claims mention.
Claims (3)
1. an IEC61850 mass data rapid analysis method, described analytical method is managed by uniform dataInterface, and summary and locator realize the quick traversal of mass data, only by resident the data in preset rangeInternal memory is also analyzed, and it is characterized in that, described analytical method comprises the following steps:
(1) in intelligent substation in IEC61850 communication system, be identified for data management common interface,I.e. unified data management interface, this data management interface, by concrete data management back-end realization, is supported to useSeveral data management rear end, described data management interface comprises summarization generation interface, locating interface, obtains interface,Analysis interface; Wherein:
Described summarization generation interface generates mass data to comprise Data Position information and the crucial letter of data by entryThe summary of breath;
The summary info that described locating interface generates according to described summarization generation interface is realized data key messageThe positional information of quick-searching definite corresponding data;
The described interface that obtains obtains from mass data fast according to described locating interface established data positional informationGet the data entry that is retrieved;
Described analysis interface will obtain that data entry that interface obtains is carried out labor and output is analyzed by describedResult;
(2) generate the summary of mass data and be stored as summary according to data management interface corresponding to step (1)Storehouse: the summarization generation interface in usage data management interface carries out according to data key feature mass data fastAnalyze, generate the summary that comprises key message and Data Position information;
(3) obtain the number in preset range in location according to summary corresponding to step (2) fast by locatorAccording to also analyzing: locator has recorded the original position of the current data of analyzing in mass data, default modelEnclose the data entry number for analyzing at internal memory; Locator is realized fast moving according to summary by locating interfaceBehind location, in the data of the preset range starting from positioning instant original position are loaded into by data acquisition interfaceDeposit, then analyze by data analysis interface;
(4) realize the analysis to all mass datas by mobile locator.
2. IEC61850 mass data rapid analysis method according to claim 1, is characterized in that:
In step (2), the analysis of data key feature and acquisition are by the summarization generation in data management interfaceInterface realization, generates key message and the Data Position information a part of content as summary, in the time of locator dataBy locator, summary is submitted to locating interface from summary storehouse, then real by the locating interface in data management interfaceThe positional information of the quick-searching of existing data key message definite corresponding data.
3. IEC61850 mass data rapid analysis method according to claim 1, is characterized in that:
In step (4), when locator moves and navigates to reposition, in former preset range away from repositionData shift out internal memory, data in new preset range move into internal memory, data volume is no more than default all the timeScope, thus realize and the rapid data analysis that have nothing to do, stable, that low-resource takies of data volume size.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310355815.7A CN103412927B (en) | 2013-08-15 | 2013-08-15 | A kind of IEC61850 mass data rapid analysis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310355815.7A CN103412927B (en) | 2013-08-15 | 2013-08-15 | A kind of IEC61850 mass data rapid analysis method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103412927A CN103412927A (en) | 2013-11-27 |
| CN103412927B true CN103412927B (en) | 2016-05-25 |
Family
ID=49605939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310355815.7A Active CN103412927B (en) | 2013-08-15 | 2013-08-15 | A kind of IEC61850 mass data rapid analysis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103412927B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104283746B (en) * | 2014-09-26 | 2017-07-28 | 中国南方电网有限责任公司电网技术研究中心 | System and method for realizing integration of three networks of digital transformer substation by using FPGA |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201726415U (en) * | 2010-06-12 | 2011-01-26 | 广东电网公司茂名供电局 | IEC61850 communication-oriented network wave recorder |
| CN102158550A (en) * | 2011-03-03 | 2011-08-17 | 河南电力试验研究院 | IEC61850-based power quality transient data transmission method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150356104A9 (en) * | 2011-10-04 | 2015-12-10 | Electro Industries/Gauge Tech | Systems and methods for collecting, analyzing, billing, and reporting data from intelligent electronic devices |
-
2013
- 2013-08-15 CN CN201310355815.7A patent/CN103412927B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201726415U (en) * | 2010-06-12 | 2011-01-26 | 广东电网公司茂名供电局 | IEC61850 communication-oriented network wave recorder |
| CN102158550A (en) * | 2011-03-03 | 2011-08-17 | 河南电力试验研究院 | IEC61850-based power quality transient data transmission method |
Non-Patent Citations (1)
| Title |
|---|
| 宋亚奇 等.智能电网大数据处理技术现状与挑战.《电网技术》.2013,第37卷(第4期),第927-935页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103412927A (en) | 2013-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Holzschuher et al. | Performance of graph query languages: comparison of cypher, gremlin and native access in neo4j | |
| CN102855271B (en) | The storage of a kind of multi-version power grid model and traceable management method | |
| CN105045932B (en) | A kind of data page querying method based on descending storage | |
| CN103605805A (en) | Storage method of massive time series data | |
| CN102682051B (en) | Method for integrating time series database with intelligent grid scheduling technology support system | |
| CN102158550B (en) | IEC61850-based power quality transient data transmission method | |
| CN102013056A (en) | Configurable power report management system and operating method thereof | |
| CN102164175A (en) | Cloud-storage-based electricity utilization information acquisition method and system | |
| CN106649242A (en) | Method and system for generating report | |
| CN103412927B (en) | A kind of IEC61850 mass data rapid analysis method | |
| CN103226794A (en) | Data processing method of power transmission and distribution line | |
| CN104391947B (en) | Magnanimity GIS data real-time processing method and system | |
| CN109597575A (en) | A kind of storage of sectional type data and read method based on HDF5 | |
| CN109376120A (en) | Data file format conversion method and device for optimizing memory and storage medium | |
| CN101996251A (en) | Rapid processing method of large SCL (substation configuration language) document | |
| CN110134690B (en) | Method and system for rapidly storing oversized data of Oracle database | |
| CN104462588A (en) | Intellectual property retrieval system based on cloud database | |
| CN202364244U (en) | Processing device of distributed log analysis system | |
| CN108875218A (en) | A kind of transformer vortex field finite element solving method based on sinc function | |
| CN204694815U (en) | A kind of converters Sneak Circuits state acquisition device | |
| CN203643536U (en) | Distribution line power monitoring system | |
| CN208954631U (en) | A kind of distributed network storage organization | |
| Peng et al. | Research on Data Storage Mode and Storage Access Interface Design of TSDA Server | |
| Juntao et al. | Research on the Application of Digital Twin Technology in Power Grid Engineering | |
| CN202337098U (en) | File box |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |