CN102937956A - Method and device for storing real-time messages in intelligent substation - Google Patents

Method and device for storing real-time messages in intelligent substation Download PDF

Info

Publication number
CN102937956A
CN102937956A CN2012101231184A CN201210123118A CN102937956A CN 102937956 A CN102937956 A CN 102937956A CN 2012101231184 A CN2012101231184 A CN 2012101231184A CN 201210123118 A CN201210123118 A CN 201210123118A CN 102937956 A CN102937956 A CN 102937956A
Authority
CN
China
Prior art keywords
write
disk
message
disks
writing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012101231184A
Other languages
Chinese (zh)
Inventor
刘玮
高新华
陈炯聪
黄曙
胡春潮
汪溢
竹之涵
苏忠阳
马文霜
高学强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GUANGZHOU PTSWITCH COMPUTER TECHNOLOGY Co Ltd
Electric Power Research Institute of Guangdong Power Grid Co Ltd
Original Assignee
GUANGZHOU PTSWITCH COMPUTER TECHNOLOGY Co Ltd
Electric Power Research Institute of Guangdong Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GUANGZHOU PTSWITCH COMPUTER TECHNOLOGY Co Ltd, Electric Power Research Institute of Guangdong Power Grid Co Ltd filed Critical GUANGZHOU PTSWITCH COMPUTER TECHNOLOGY Co Ltd
Priority to CN2012101231184A priority Critical patent/CN102937956A/en
Publication of CN102937956A publication Critical patent/CN102937956A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses a method and a device for storing real-time messages in an intelligent substation. The method includes a write-in step, a deleting step and a sleep processing step, wherein the write-in step includes sequentially numbering free disks in a system, selecting two disks from the free disks to serve as write-in disks, and sequentially writing the messages in the two disks when the messages are to be written in; the deleting step includes detecting the disks when the write-in step is performed and deleting part of the oldest data in the disks if the disks are fully written so as to achieve the purpose of circularly using disk space; and the sleep processing step includes placing the other unselected disks in the system in a sleep state when the write-in disks are selected in the write-in step and waking up the disks to write in the messages when the other disks need to be selected to perform write-in. By means of the method, massive messages in the intelligent substation can be concisely and orderly stored, finding and extraction efficiencies of the messages in later periods are improved, and maintenance and management levels of the substation are further improved.

Description

The storage means of real-time packet and device thereof in a kind of intelligent substation
Technical field
The present invention relates to a kind of method for storing real-time data, relate in particular to a kind of storage means that real-time packet in the intelligent substation is adopted the tree structure cyclic redundancy.
Background technology
[0002] present, development along with intelligent grid, message data in the transformer station is concerned more and more, and the real-time packet storage system need to be processed a large amount of real time datas, and the data of magnanimity have proposed higher requirement to availability, reliability, the operating performance of system.Yet, existing method receive, often performance is low when storing, extracting these data, efficient is not high.And along with transformer station's time of putting into operation is more and more longer, the message amount of whole transformer station will increase gradually.Therefore, need to adopt a kind of reliable method that these magnanimity messages are stored, so as the later stage to the inquiry of message, call.
There are following problems in the packet storage mode of existing transformer station:
1, do not press the type of message classification: dissimilar message receives from a network interface, is stored in the identical file, brings difficulty for the message extraction of special packet type.
2, the TOC level of packet storage is simple: general message with a day all stores in the identical catalogue, if the message data that a period of time receives is excessive, will deposit a large amount of message files in the so single catalogue, causes the message retrieval inefficiency.
3, data have the risk of losing: if certain hard disk corruptions, so wherein the data of storage can be lost fully.
Summary of the invention
The object of the present invention is to provide the storage means of real-time packet in a kind of intelligent substation, this method can make in the intelligent substation message of magnanimity obtain succinct orderly storage, improve searching and extraction efficiency of later stage message, and then improve the maintenance and management level of transformer station.
Purpose of the present invention can realize by following technical measures:
The storage means of real-time packet comprises the steps: in a kind of intelligent substation
Write step: with the available disk number consecutively in the system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Delete step: in write step, disk is detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep treatment step: when choose in the write step write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
The message file that writes in the said write step in the disk adopts the tree structure store path, and the catalogue level in described path is followed successively by network interface numbering, the composite catalog name in root directory, the message source of disk number, the packet storage at packet storage place, the filename of message from top to bottom.
The filename of described message is according to this message capturing time and type of message name.
Adopt the English alphabet order to the disk number consecutively in the said write step.
Described predetermined threshold values is set to 90% disk total volume.
Another object of the present invention provides the memory storage of real-time packet in a kind of intelligent substation, comprising:
Writing module: be used for the available disk number consecutively with system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Removing module: be used in write step disk being detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep processing module: be used for when write step choose write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
The present invention contrasts prior art, have the following advantages: the present invention adopts a kind of dynamic pair of hard disk redundant storage message, the method had not only had the security of data of magnetic disk array storage but also can accomplish to only have and still has a hard disk to use in the system, and the memory function of system is not lost so.Improved greatly the availability of system.Like this, a large amount of real-time packets in the intelligent substation obtain reliable store and management, for the analysis of transformer station's fault provides Data support.In dynamically two hard disk redundant storage messages, adopt the method for message file tree structure store path, to store by the capture time generation catalogue of network interface numbering, type of message and message, the packet storage path is clear succinct; The message of storing in each catalogue is balanced to be distributed, and can reach the purpose of efficient retrieval message.
Description of drawings
Fig. 1 is the process flow diagram of message write step of the present invention;
Fig. 2 is the packet storage tree structure schematic diagram that adopts the inventive method.
Embodiment
The invention provides the storage means of real-time packet in a kind of intelligent substation, comprise the steps:
Write step: flow process as shown in Figure 1, available disk in the system is adopted English alphabet order (A, B, C, D, E etc.) number consecutively, and therefrom select two disks (such as A, B dish) as writing dish, fashionable when there being message to write, successively this message is written to simultaneously in two disks (A and B dish), the double plate redundancy writes; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values (for example be 90% disk total volume), perhaps, when any one disk breaks down, switchable disk then namely selects next disk (for example C dish) as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Delete step: in write step, disk is detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep treatment step: when choose in the write step write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
The message file that writes in the said write step in the disk adopts the tree structure store path, the catalogue level in this path is followed successively by the network interface numbering, composite catalog name, the capture time of catching date and time, message of message, the filename of message in root directory, the message source of disk number, the packet storage at packet storage place from top to bottom, and the filename of message can be named according to this message capturing time and type of message.
The tree-like storage structural representation in certain path as shown in Figure 2, its complete path representation is:
A:packets/01/ALL/2012-01-31/03/00/03-00-11-301.pcap.gz
Wherein the implication of each level is as follows:
A: the disk at packet storage place;
Packets: the root directory of packet storage;
01: this catalogue is stored below is that network interface is numbered the message that 1 network interface is caught;
ALL: all messages of receiving from network interface all are put into the ALL catalogue;
2012-01-31: the catching the date of message;
03: the capture time of message is 03 o'clock;
00: the message capturing time is 00 minute;
03-00-11-301.pcap.gz: the file of packet storage.Wherein, 03-00-11-301 represent the capture time of message in the file be 03: 00: 11 301 milliseconds; Pcap.gz represents that this file is the GZIP compressed file of a pcap form.
This by minute organizing the method for storage directory can guarantee when network traffic data is larger, the file number in each storage directory is not too large.Based on this kind storage organization, can inquire about message by network interface numbering, type of message, time very efficiently.
The method has following several advantage:
1. the double plate redundancy writes, and also can not lose if can guarantee when data writing the single disk data that write so that break down.
2. as long as also have a disk not to be out of order in the system, system still can continue to store data.
3. improve the life-span of disk.Toward two disk data writings the time, other disk can be placed sleep pattern, reduce system power dissipation, guarantee the life-span of disk.
4. the utilization factor of disk is high.Write fashionablely at message, select dynamically two disk redundancys to write, to guarantee the real-time reliable memory of message.After the epicycle message write and finishes, one of them disk save data entered into sleep pattern, and the another one disk participates in the message redundancy storage of next round.
Embodiments of the present invention are not limited to this; under the above-mentioned basic fundamental thought of the present invention prerequisite;, all drop within the rights protection scope of the present invention modification, replacement or the change of other various ways that content of the present invention is made according to the ordinary skill knowledge of this area and customary means.

Claims (6)

1. the storage means of real-time packet in the intelligent substation is characterized in that comprising the steps:
Write step: with the available disk number consecutively in the system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Delete step: in write step, disk is detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep treatment step: when choose in the write step write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
2. the storage means of real-time packet in the intelligent substation according to claim 1, it is characterized in that: the message file that writes in the said write step in the disk adopts the tree structure store path, and the catalogue level in described path is followed successively by network interface numbering, the composite catalog name in root directory, the message source of disk number, the packet storage at packet storage place, the filename of message from top to bottom.
3. the storage means of real-time packet in the intelligent substation according to claim 2 is characterized in that: the filename of described message is according to this message capturing time and type of message name.
4. the storage means of real-time packet to the described intelligent substation of 3 any one according to claim 1 is characterized in that: adopt the English alphabet order to the disk number consecutively in the said write step.
5. the storage means of real-time packet in the described intelligent substation of any one according to claim 4, it is characterized in that: described predetermined threshold values is set to 90% disk total volume.
6. the memory storage of real-time packet in the intelligent substation is characterized in that comprising:
Writing module: be used for the available disk number consecutively with system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Removing module: be used in write step disk being detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep processing module: be used for when write step choose write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
CN2012101231184A 2012-04-25 2012-04-25 Method and device for storing real-time messages in intelligent substation Pending CN102937956A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012101231184A CN102937956A (en) 2012-04-25 2012-04-25 Method and device for storing real-time messages in intelligent substation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012101231184A CN102937956A (en) 2012-04-25 2012-04-25 Method and device for storing real-time messages in intelligent substation

Publications (1)

Publication Number Publication Date
CN102937956A true CN102937956A (en) 2013-02-20

Family

ID=47696854

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012101231184A Pending CN102937956A (en) 2012-04-25 2012-04-25 Method and device for storing real-time messages in intelligent substation

Country Status (1)

Country Link
CN (1) CN102937956A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104049917A (en) * 2014-06-25 2014-09-17 北京思特奇信息技术股份有限公司 Data processing method and system
CN104426687A (en) * 2013-08-23 2015-03-18 南京南瑞继保电气有限公司 A network storm filtering method applicable for a digital substation secondary device
CN104461385A (en) * 2014-12-02 2015-03-25 国电南瑞科技股份有限公司 Multi-hard disk balanced storage method with self-adaptive port traffic
CN104516953A (en) * 2014-12-12 2015-04-15 国家电网公司 Black box system for mass power dispatching automation message
CN109474492A (en) * 2018-11-26 2019-03-15 许继集团有限公司 A kind of message capturing and localization method
CN109918952A (en) * 2019-03-08 2019-06-21 北京马尔马拉科技有限公司 A kind of safer cloud computing platform system and processing method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118508A (en) * 2007-08-24 2008-02-06 成都索贝数码科技股份有限公司 Safety storage method for data
CN101169705A (en) * 2007-11-30 2008-04-30 中兴通讯股份有限公司 Method for implementing file class mirror-image under multiple hard disk based on nude file system
CN101825992A (en) * 2010-04-08 2010-09-08 杭州华三通信技术有限公司 Saving method of data and device thereof
US20100328814A1 (en) * 2009-06-26 2010-12-30 Fujitsu Limited Control apparatus, method of controlling apparatus and computer-readable recording medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118508A (en) * 2007-08-24 2008-02-06 成都索贝数码科技股份有限公司 Safety storage method for data
CN101169705A (en) * 2007-11-30 2008-04-30 中兴通讯股份有限公司 Method for implementing file class mirror-image under multiple hard disk based on nude file system
US20100328814A1 (en) * 2009-06-26 2010-12-30 Fujitsu Limited Control apparatus, method of controlling apparatus and computer-readable recording medium
CN101825992A (en) * 2010-04-08 2010-09-08 杭州华三通信技术有限公司 Saving method of data and device thereof

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104426687A (en) * 2013-08-23 2015-03-18 南京南瑞继保电气有限公司 A network storm filtering method applicable for a digital substation secondary device
CN104049917A (en) * 2014-06-25 2014-09-17 北京思特奇信息技术股份有限公司 Data processing method and system
CN104461385A (en) * 2014-12-02 2015-03-25 国电南瑞科技股份有限公司 Multi-hard disk balanced storage method with self-adaptive port traffic
CN104516953A (en) * 2014-12-12 2015-04-15 国家电网公司 Black box system for mass power dispatching automation message
CN104516953B (en) * 2014-12-12 2016-03-09 国家电网公司 A kind of black box subsystem for power dispatching automation magnanimity message
CN109474492A (en) * 2018-11-26 2019-03-15 许继集团有限公司 A kind of message capturing and localization method
CN109918952A (en) * 2019-03-08 2019-06-21 北京马尔马拉科技有限公司 A kind of safer cloud computing platform system and processing method

Similar Documents

Publication Publication Date Title
CN102906751B (en) A kind of method of data storage, data query and device
CN102937956A (en) Method and device for storing real-time messages in intelligent substation
CN104317800A (en) Hybrid storage system and method for mass intelligent power utilization data
CN107045531A (en) A kind of system and method for optimization HDFS small documents access
CN104639658A (en) Realization method for accessing object storage by file system mounting
CN104008207B (en) The data external storage system and date storage method of the database based on CD
CN104035956A (en) Time-series data storage method based on distributive column storage
CN102508913A (en) Cloud computing system with data cube storage index structure
CN103198027A (en) Method and device for storing and providing files
CN103051671A (en) Repeating data deletion method for cluster file system
CN103198150A (en) Big data indexing method and system
CN107133331A (en) The automatic expansion method of database and device realized based on shell scripts
CN103198157B (en) A kind of compression storage processing method of telluric electricity field data
CN105005517B (en) The storage and backup system and method for call center's recording file
CN105005585A (en) Log data processing method and device
CN105787090A (en) Index building method and system of OLAP system of electric data
SG11201809827RA (en) Method for conducting statistics on insurance type state information of policy, terminal device and storage medium
CN102479211B (en) Mass data processing system and method on basis of database
CN112133080B (en) Storage method of metering data of power acquisition terminal, power acquisition terminal and power system
CN106844556A (en) A kind of intelligent grid time scale measurement date storage method based on HBase
CN103207916A (en) Metadata processing method and device
CN103281383B (en) A kind of time sequence information recording method of Based on Distributed data source
CN105095502A (en) Log collection method of cluster storage system
CN1905590B (en) Single chip information acquiring method
CN108121794A (en) Archive management system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130220