CN103744901A - Intelligent substation double-host history data synchronously-storing system and device - Google Patents
Intelligent substation double-host history data synchronously-storing system and device Download PDFInfo
- Publication number
- CN103744901A CN103744901A CN201310726208.7A CN201310726208A CN103744901A CN 103744901 A CN103744901 A CN 103744901A CN 201310726208 A CN201310726208 A CN 201310726208A CN 103744901 A CN103744901 A CN 103744901A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- scada
- logout
- supervisor control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S10/00—Systems supporting electrical power generation, transmission or distribution
- Y04S10/16—Electric power substations
Abstract
The invention discloses an intelligent substation double-host history data synchronously-storing system and device. The intelligent substation double-host history data synchronously-storing system and device mainly solves the problem of improving the operation performance of an intelligent substation station control level automation system. The device comprises a main monitoring host, an auxiliary monitoring host, a main data server and an auxiliary data server. The main monitoring host and the auxiliary monitoring host are connected through network, and the main data server and the auxiliary data server synchronously store history data transmitted from the main monitoring host and the auxiliary monitoring host. The intelligent substation double-host history data synchronously-storing system also comprise a real-time library module, the real-time library module comprises an event data module, a standard interior data format module, a main data collecting and monitoring control system module and an auxiliary data collecting and monitoring control system module. Compared with the prior art, the intelligent substation double-host history data synchronously-storing system completes storing through the real-time library module, guarantees the accuracy of synchronous storing of the two hosts, enhances the capability of processing large amounts of history data, guarantees the reliability of synchronous history data storing of the two hosts and improves the operation performance of the intelligent substation station control level automation system.
Description
Technical field
The present invention relates to a kind of system and device of intelligent substation storage data, particularly a kind of system and device of station level storage data.
Background technology
China's intelligent grid enters the all-round construction stage at present.Along with the continuous progress of intelligent substation technology, the data volume being linked in transformer station's station level automated system (supervisory system) will become increasing, supervisory system not only will be faced large capacity history data store, and adopting in the dual systems of master and slave server, need to solve historical data two-shipper stores synchronized problem.The method of the most of monitoring system of electric substation data processing of prior art is: supervisory system has gathered in transformer station after data message is processed, directly by these data sync storage in the database of supervisory system.But when data volume is very large, by supervisory system complete paired data sampling simultaneously, processing and storage, can be had a strong impact on the runnability of supervisory system, comprise the execution efficiency of supervisory system data sampling and processing, and supervisory system CPU, network and disk that stored data base causes are loaded; Complete again the stores synchronized task of two-shipper data, will further reduce the runnability of supervisory system, affect the use function of supervisory system.
Summary of the invention
The object of this invention is to provide a kind of system and device of intelligent substation two-shipper stores synchronized historical data, the problem that solve is to improve the runnability of intelligent substation station level automated system.
The present invention is by the following technical solutions: a kind of device of intelligent substation two-shipper stores synchronized historical data, the device of described intelligent substation two-shipper stores synchronized historical data is provided with main monitoring host computer and from monitoring host computer, master data server and from data server, described main monitoring host computer and be simultaneously connected to intelligent substation measure and control device from monitoring host computer, main monitoring host computer with from monitoring host computer, by network, be connected, described master data server and from the main monitoring host computer of data server stores synchronized and the historical data of sending from monitoring host computer.
A kind of system of intelligent substation two-shipper stores synchronized historical data, the system of described intelligent substation two-shipper stores synchronized historical data is provided with real-time library module, and in real time storehouse is provided with event data module, standard internal data format module, master data collection and supervisor control module and from data acquisition and supervisor control module;
The not confirmed that described event data module receives from the historical events generation module of intelligent substation measure and control device and the event data not being eliminated, make data structure conversion process and obtain the self-defining event data form of internal system, send to standard internal data format module;
Described standard internal data format module receives the event data that event data module is sent, as data structure, be converted to logout, synchronously to master data collection and supervisor control (SCADA) module with from data acquisition and supervisor control (SCADA) module, send;
Described master data collection and supervisor control (SCADA) resume module event data, logout synchronization distribution is arrived from data acquisition and supervisor control (SCADA) module, the logout coming according to master data collection and supervisor control (SCADA) module synchronization distribution from data acquisition and supervisor control (SCADA) module, generates the logout with supervisor control (SCADA) module needs from data acquisition; Master and slave data acquisition and supervisor control (SCADA) module is stored in logout respectively in the commercial data base of master and slave data server.
The master data collection of system of the present invention and supervisor control module with from the interruption of data acquisition and supervisor control module communication, master data collection and supervisor control module are kept at the information of logout in the logout cache table of master data collection and supervisor control module, during communication recovery, from data acquisition and supervisor control module according to the content of the logout cache table of master data collection and supervisor control module by logout synchronization distribution to from data acquisition and supervisor control module, after synchronization distribution is confirmed, corresponding record in the logout cache table of deletion master data collection and supervisor control module.
The master data collection of system of the present invention and supervisor control resume module event data, comprise the following steps:
One, master data collection and supervisor control module monitors, from the logout cache table of data acquisition and supervisor control module, are inquired about the content from the logout cache table of data acquisition and supervisor control module by the frequency timing of 1 beat/min;
Two, from the logout cache table of data acquisition and supervisor control module, be empty, master data collection and supervisor control module are checked the event data record value of the up-to-date generation of standard internal data format module, if exceed event data value scope, generate a logout, send to from data acquisition and supervisor control module.
System of the present invention from the logout cache table of data acquisition and supervisor control module, be non-NULL, master data collection and the inquiry of supervisor control module are from the not logout of confirmation of synchronization of logout cache table of data acquisition and supervisor control module, upgrade the corresponding event record that master data collection and supervisor control module exist, will delete with logout corresponding supervisor control module logout cache table from data acquisition.
The logout coming according to master data collection and supervisor control module synchronization distribution from data acquisition and supervisor control module of system of the present invention, generates the logout with supervisor control module needs from data acquisition, comprises the following steps:
One,, from the logout cache table of data acquisition and supervisor control module monitors master data collection and supervisor control module, by the frequency timing of 1 beat/min, inquire about the content in the logout cache table of master data collection and supervisor control module;
Two, in the logout cache table of master data collection and supervisor control module, be empty, from data acquisition and supervisor control module, for the logout receiving from master data collection and supervisor control module, line up, be divided into newly-increased logout and confirm logout, the logout coming of synchronizeing with supervisor control module from master data collection is newly-increased logout, for newly-increased logout, from data acquisition and supervisor control module, directly according to event data, increase an event data record newly, be saved in from the historical data base of data server, for confirming logout, from data acquisition and supervisor control module, change the acknowledgement indicator of event history corresponding corresponding master data collection and supervisor control module logout cache table.
In the logout cache table of the master data collection of system of the present invention and supervisor control module, it is non-NULL, from the not logout of confirmation of synchronization of logout cache table of data acquisition and supervisor control module inquiry master data collection and supervisor control module, renewal, from the corresponding event record of data acquisition and the existence of supervisor control module, is deleted master data collection with logout corresponding in supervisor control module logout cache table.
The sampled data of the historical events generation module of system of the present invention is stored in the commercial data base of data server through data bus by normal structure query language or binary format, in the mode of file, through data bus, is stored in the file directory of data server.
The sampled data of system of the present invention is: remote measurement sampled value data, remote signalling sampled value data, the out-of-limit related data of remote measurement, remote control related data, failure wave-recording file, Power Management Unit sampled data file and alarm bulletin file.
The event data of system of the present invention is: sequence of events recording, displacement record, the out-of-limit record of remote measurement, protection logout, operation note, self-inspection record, failure wave-recording record, record of examination, definite value record, system information record, sequencing control record, voltage power-less control record (VQC) and switch status monitor record.
The present invention compared with prior art, history data store can be stored in the commercial data base of data server, also on the data server that can store by the mode of file, wherein the Data support relevant to commercial data base stored in common standard SQL statement mode with in the mode of scale-of-two blob data, storage is finished the work by special real-time library module, guarantee the correctness of two-shipper stores synchronized, improve the ability of processing a large amount of historical datas, guarantee the reliability of two-shipper stores synchronized historical data, improve the runnability of transformer station's station level automated system.
Accompanying drawing explanation
Fig. 1 is the structure drawing of device of intelligent substation two-shipper stores synchronized historical data of the present invention.
Fig. 2 is historical data general flow direction figure of the present invention.
Fig. 3 is master data collection of the present invention and supervisor control resume module logout process flow diagram.
Fig. 4 is of the present invention from data acquisition and supervisor control resume module logout process flow diagram.
Fig. 5 is that data bus of the present invention is processed commercial data base data flowchart.
Fig. 6 is that data bus of the present invention is processed file data flow process figure.
Fig. 7 is the bibliographic structure figure of data bus cache file of the present invention.
Embodiment
Below in conjunction with drawings and Examples, the present invention is described in further detail.The historical data of intelligent substation two-shipper stores synchronized is the basic event data of intelligent substation and sampled data.
The system (system) of intelligent substation two-shipper stores synchronized historical data of the present invention, is provided with real-time library module.In real-time library module, the event data of preserving not confirmed and not being eliminated.
As shown in Figure 1, the device of intelligent substation two-shipper stores synchronized historical data of the present invention, is provided with main monitoring host computer and from monitoring host computer, master data server and from data server.Main monitoring host computer with from monitoring host computer, by network, be connected, main monitoring host computer and make master and slave stand-by heat from monitoring host computer is connected to intelligent substation measure and control device simultaneously, receives the historical data (not confirmed and the event data not being eliminated) of intelligent substation.Master data server and from the main monitoring host computer of data server stores synchronized and the historical data of sending from monitoring host computer.The system of intelligent substation two-shipper stores synchronized historical data is arranged on main monitoring host computer and from monitoring host computer, the logout of the event data being generated by the system of intelligent substation two-shipper stores synchronized historical data, is synchronously saved in master data server and from data server.Sampled data is directly saved in master data server and from data server.In the present embodiment, main monitoring host computer and from monitoring host computer adopt the server NP3560 of Langchao Yingxin, master data server and from data server adopt the server NP3560 of Langchao Yingxin.
Event data is: sequence of events recording SOE, displacement are recorded COS, the out-of-limit record of remote measurement, protected logout, operation note, self-inspection record, failure wave-recording record, record of examination, definite value record, system information record, sequencing control record, voltage power-less control to record VQC, switch status monitor record.The logout of described event data is kept in the historical data base (commercial data base) of two data servers, every kind of record is corresponding corresponding database table.
Sampled data is: remote measurement sampled value data, remote signalling sampled value data, the out-of-limit related data of remote measurement, remote control related data, failure wave-recording file, Power Management Unit PMU sampled data file and alarm bulletin file.
Sampled data is with normal structure query language SQL(Structured Query Language) or scale-of-two BLOB form be stored in the commercial data base on data server, with the mode of file be stored in data server arrange file directory in.Sampled data deposits in master and slave data server through data bus data_bus with stsndard SQL, scale-of-two BLOB and file.
The file name form " XXXXXXXX.YYY " of failure wave-recording file, " XXXXXXXX " part is in order to indicate record name (such as FAULT1 or TEST-2), " .YYY " part is in order to logo file type with as expanding: " .HDR " is for header files, " .CFG " is for configuration file, " .DAT ", for data file, " .INF " is for message file.The form of Power Management Unit PMU sampled data file name is " YYYYMMDDHHmm.XXX ", and " YYYY " is the time, and " MM " is month, and " DD " be day, and " HH " is hour, and " mm " is minute, and " XXX " is configuration file lop or data file dyn.The form of alarm bulletin file name is " plant stand name _ interval name _ primary equipment title _ alarm grade _ signal name _ alarm name _ date _ Hour Minute Second _ millisecond .xml ".
The sampled data being stored in commercial data base is: remote measurement sampled value data, remote signalling sampled value data, the out-of-limit related data of remote measurement and remote control related data, be stored in sampled data in commercial data base directly completes sampled data warehouse-in by carrying out common standard SQL statement and deposit (operation) in.Take the sampled data of file storage as failure wave-recording file, PMU sampled data file and alarm bulletin file.File is stored on data server in the mode of file transfer protocol (FTP) FTP by data bus data_bus.
Remote measurement sampled value data, remote signalling sampled value data, the out-of-limit related data of remote measurement and remote control related data, by stsndard SQL storage or press the storage of scale-of-two BLOB form.Remote signalling sampled data, the out-of-limit related data of remote measurement and remote control related data are with stsndard SQL storage when commercial data base table structure, and remote measurement sampled value data are with the storage of scale-of-two BLOB form when commercial data base table structure.
As shown in Figure 2, in real time storehouse is provided with event data module, standard internal data format module, master data collection and supervisor control SCADA module and from data acquisition and supervisor control SCADA module.Main SCADA module is arranged in main monitoring host computer, from SCADA module, is arranged on from monitoring host computer.
In event data module, preserve the not confirmed receiving from the historical events generation module of intelligent substation measure and control device and the event data not being eliminated, the data of master and slave monitoring host computer must be in full accord, therefore the event data in the SCADA module of master and slave monitoring host computer also must be consistent, at master and slave monitoring host computer, carried out after two-shipper blocked operation like this, the event data in storehouse can not get muddled in real time.
Described confirming as for newly-generated event data, the SCADA module of master and slave monitoring host computer is stored in master and slave data server, and this event data is put to " confirmation " sign.Described removing is for confirmed event data, and the SCADA module of master and slave monitoring host computer is removed event data from event data module.Historical events generation module is arranged in intelligent substation measure and control device.
The not confirmed that event data module receives from historical events generation module and the event data not being eliminated, make data structure conversion process and obtain the self-defining event data form of internal system, sends to standard internal data format module.Not confirmed and the event data form not being eliminated are CFifoEvent, and the self-defining event data form of internal system is CEventLog.
CFifoEvent definition:
CEventLog definition:
Standard internal data format module receives the event data that event data module is sent, make data structure conversion process and obtain self-defining event data form, standard internal data format module is only that a main SCADA module sends event data to state, then state be main SCADA module synchronization distribution event data to state be from SCADA module.Self-defining event data form is CEventLog.
In master and slave monitoring host computer, only have main SCADA module to from SCADA module Distribution Events record, master and slave SCADA module can be switched exchange principal and subordinate role by two-shipper.Main SCADA module generates logout by standard internal data format, and logout synchronization distribution is arrived from SCADA module; The logout coming according to main SCADA module synchronization distribution from SCADA module generates the logout needing from SCADA module; Last master and slave SCADA module is stored in logout respectively in the commercial data base of master and slave data server.Synchronization distribution (synchronously) refers to that main SCADA module sends to the module from SCADA by network by logout.Standard internal data format is CEventLog.
Main SCADA module and from the network service of passing through between SCADA module, if main SCADA module and from the communication disruption between SCADA module, cause main SCADA module synchronization distribution logout to arrive from SCADA module failure (synchronization failure), so main SCADA module is just kept at the information of logout in the logout cache table HTModifyInfo of main SCADA module for the time being, when communication recovery, from SCADA module can be according to the content of the logout cache table HTModifyInfo of main SCADA module by the logout synchronization distribution of synchronization distribution failure before to from SCADA module, after synchronization distribution completes and confirms, delete corresponding record in the logout cache table HTModifyInfo of main SCADA module.Equally, master and slave SCADA module is switched after exchange principal and subordinate role by two-shipper, main SCADA module can be processed the logout from SCADA module logout cache table HTModifyInfo with same method, and now previous main SCADA module has switched to the module from SCADA.
Logout cache table HTModifyInfo is provided with three fields, is respectively TableID, RecordID, IsAck, represents respectively whether event (event data) type i D, corresponding logout ID, logout are identified.The described logout of confirming as in main SCADA module HTModifyInfo is synchronized to the module from SCADA, or the logout from SCADA module HTModifyInfo is synchronized to main SCADA module.
Event type ID numeral event type, as being labeled as: 1 represents the out-of-limit record of remote measurement, 2 presentation of events journal SOE; COS is recorded in 3 expression displacements, and 4 represent protection logouts, and 5 represent operation notes; 6 represent self-inspection record; 7 represent failure wave-recording record, and 8 represent record of examination, and 9 represent definite value record; 10 represent system information record; 11 representation program control records, VQC is recorded in 12 expression voltage power-less controls, and 13 represent switch status monitor records.
Corresponding logout ID has shown content, the address of logout information in database table.
Whether logout is identified and is labeled as 0 or 1,0 presentation of events and records not confirmed, and 1 presentation of events record is identified.
As shown in Figure 3, main SCADA resume module event data, comprises the following steps:
One, main SCADA module monitors, from the logout cache table HTModifyInfo of SCADA module, is inquired about the content from the logout cache table HTModifyInfo of SCADA module by the frequency timing of 1 beat/min.If be empty, directly enter step 4 from the logout cache table HTModifyInfo of SCADA module.If be non-NULL, enter step 2 from the logout cache table HTModifyInfo of SCADA module.
Two, main SCADA module inquiry is non-NULL from the logout cache table HTModifyInfo of SCADA module, and whether logout ID (RecordID), the logout of inquiring about three fields in every record: event type ID (TableID) in this logout cache table HTModifyInfo, correspondence are identified (IsAck).
If IsAck is 0, thinking need to be at the newly-increased not synchronous logout of main SCADA.If IsAck is 1, already present main SCADA module not confirmed logout need to be changed to confirmed logout.
According to TableID, be confirmed to be and belong to which kind of event type, then according to TableID, can confirm corresponding event database table, as TableID=1 can confirm the out-of-limit table of database remote measurement HTBreakLimitLog, TableID=2 can confirm database SOE table HTSoeLog.
Finally according to RecordID, carry out the content of logout corresponding in Query Database table, inquire the not logout of confirmation of synchronization, the corresponding event record that the main SCADA module of content update (synchronously) of the logout that main SCADA module obtains according to inquiry exists.Described renewal (synchronously) is at the newly-increased logout that content is identical of main SCADA module.
Three, after synchronous complete the bar logout of main SCADA module, logout corresponding from SCADA module logout cache table HTModifyInfo is deleted, in order to avoid repeat synchronous.
Four, main SCADA module is except needs are processed the logout of synchronization failure from SCADA module HTModifyInfo, also will be according to the event data value scope of setting, check the event data record value of the up-to-date generation of standard internal data format module, if exceed event data value scope, generate a logout, send to the module from SCADA.
If the real-time telemetry value in main SCADA module is not within the limit value of setting, so corresponding this remote measurement value can produce the out-of-limit event of corresponding remote measurement (the out-of-limit related data of remote measurement), or having there is displacement operation when switch or the disconnecting link of supervisory system collection signal, main SCADA module can correspondingly generate displacement record SOE or remote signalling displacement event.Real-time telemetry value in main SCADA module is that 61850 data messages that send on 61850 client modules reception measure and control devices obtain.
Main SCADA module is received after a need event data to be processed, this event data can be saved in the historical data base (commercial data base) of master data server, main SCADA module can be saved in event data 1 time in the historical data base of master data server by 100 milliseconds of frequencies, to guarantee event data, can put in storage smoothly, then this event data is added distribution queue to send to by network and send to the module from SCADA, and receive from the confirmation of SCADA module; When event data is stored into local historical data base, if deposit failure in, can be at main SCADA module buffer memory, master and slave SCADA module can not stop to attempt to deposit the event data in buffer memory separately in historical data base subsequently, if success can be deleted event data from buffer memory.If event sends continuously 10 all failures or do not receive from the confirmation of SCADA module, according to logout generation TableID, RecordID and IsAck record, be kept in the logout cache table HTModifyInfo of main SCADA module, start to process next newly-increased event data.If event data sends successfully, from SCADA module, receiving that event data information, a confirmation is replied in meeting, then main SCADA module is deleted this logout from transmit queue, the historical data base that starts to process next event data and be saved in master data server, sends to the module from SCADA.
For have unacknowledged event data in master and slave SCADA module, if user carries out and confirms operation this event event data, through user's verification, event data is put to acknowledgement indicator, so main SCADA module can send to confirmation the module from SCADA.
As shown in Figure 4, the logout coming according to main SCADA module synchronization distribution from SCADA module, generates the logout needing from SCADA module and processes event data, comprises the following steps:
One,, from the logout cache table HTModifyInfo of the main SCADA module of SCADA module monitors, by the frequency timing of 1 beat/min, inquire about the content in the logout cache table HTModifyInfo of main SCADA module.If be empty in the logout cache table HTModifyInfo of main SCADA module, directly enter step 4.If be non-NULL in the logout cache table HTModifyInfo of main SCADA module, enter step 2.
Two, from SCADA module, inquiring about the logout cache table HTModifyInfo of main SCADA module is non-NULL, inquires about three fields in every record: event type ID (TableID) in this logout cache table HTModifyInfo, whether corresponding logout ID (RecordID), logout is identified (IsAck).
If IsAck is 0, thinking need to be at the newly-increased not synchronous logout of main SCADA.If IsAck is 1, already present main SCADA module not confirmed logout need to be changed to confirmed logout.
According to TableID, be confirmed to be and belong to which kind of event type, then according to TableID, can confirm corresponding event database table, as TableID=1 can confirm the out-of-limit table of database remote measurement HTBreakLimitLog, TableID=2 can confirm database SOE table HTSoeLog.
Finally according to RecordID, carry out the content of logout corresponding in Query Database table, inquire the not logout of confirmation of synchronization, the corresponding event record that the main SCADA module of content update (synchronously) of the logout that main SCADA module obtains according to inquiry exists.Described renewal (synchronously) is at the newly-increased logout that content is identical of main SCADA module.
Three, after synchronous complete the bar logout of SCADA module, logout corresponding in main SCADA module logout cache table HTModifyInfo is deleted, in order to avoid repeat synchronous.
Four, from SCADA module, for the logout receiving from main SCADA module, line up, be divided into newly-increased logout and confirm logout, the logout synchronously coming from main SCADA module is newly-increased logout, for newly-increased logout, from SCADA module, directly according to the newly-increased event data record of event data, be saved in the historical data base (commercial data base) from data server.For confirming logout, from SCADA module, according to event type and logout ID, change the acknowledgement indicator of event history corresponding corresponding main SCADA module logout cache table HTModifyInfo.Then process the next event data newly receiving.From SCADA module, for the logout receiving from main SCADA module, line up directly to finish from SCADA module event data treatment scheme for sky.
Data bus data_bus is arranged on master and slave data server, and master and slave monitoring host computer all can be by data bus to master and slave data server store sample data.
As shown in Figure 5, the sampled data being stored in commercial data base through data bus is: remote measurement sampled value data, remote signalling sampled value data, the out-of-limit related data of remote measurement and remote control related data, be stored in sampled data in commercial data base and by carrying out common standard SQL statement, directly complete the in-stockroom operation of sampled data, comprise the following steps:
One, sampled data module generates the stsndard SQL statement conforming with the regulations, and then the interface of calling data bus sends to data bus by stsndard SQL statement;
Sampled data module reaches principal and subordinate's data server by the stsndard SQL statement of generation through data bus, if there are many stsndard SQL statements to need to carry out, carrying out the order of SQL statement is also determined by sampled data module, data bus adopts the principle of temporal sequence of " arrive first first and carry out ", guarantees that stsndard SQL statement is finished in strict accordance with order.
Sampled data module is used stsndard SQL statement to have increase, modification and deletion three generic operations to the storage operation of commercial data base historical data;
Two, data bus has judged whether SQL cache file; If data bus judgement has cache file to exist, carry out step 3;
If data bus judgement does not have cache file, just enter step 6 after so this stsndard SQL statement directly being added to processing queue afterbody;
Data bus is receiving after SQL statement, can not carry out at once, this be due to data bus carry out SQL statement " arrive first first and to carry out " and principle, cache file is that data bus is used for the interim file of carrying out failed stsndard SQL statement of preserving, use the Another reason of cache file to guarantee that exactly data do not lose, even exit because extraneous other reasons causes data bus, data bus still can be finished the stsndard SQL statement of correctly not carrying out before after restarting so;
As shown in Figure 7, data bus judges that the catalogue of SQL cache file is sync/sql/I or sync/sql/II, as for which catalogue is judged, the interface that offers sampled data module with data bus judges, and data bus is used different cache files to principal and subordinate's data server, data bus can be enabled two threads these two cache files are judged respectively and simultaneously;
Three, data bus writes cache file afterbody by stsndard SQL statement in the mode of text, to guarantee the strictly execution in order of stsndard SQL statement; The form of SQL cache file is text, and no matter length all only takies a line to each stsndard SQL statement;
Four, data bus is read all stsndard SQL statements in SQL cache file, then deletes SQL cache file;
Five, data bus adds the stsndard SQL statement of reading the processing queue of data bus cleanup standard SQL statement in order;
Described data bus carries out unified processing to the SQL statement in queue, for principal and subordinate's data server, respectively has a processing queue corresponding with it, and stores processor is carried out respectively in two thread alignment (synchronously) of data bus simultaneously;
Six, sampled data module judges whether in execution, line up Plays SQL statement runs succeeded;
Data bus is carried out processing in order to the stsndard SQL statement in two processing queue, whenever the stsndard SQL statement of correct execution queue head, just queue heads ministerial standard SQL statement is deleted from queue, if when all stsndard SQL statements are finished in order, processing queue is empty and returns to step 1;
If run into a wherein stsndard SQL statement in implementation, carry out unsuccessfully, enter next step;
Seven, data bus writes remaining all stsndard SQL statements in processing queue in order in newly-built SQL cache file and empties processing queue.Newly-built SQL cache file will preferentially be processed at next circulation time.
In above flow process, data bus is all that the common interface that calls commercial data base and provide carries out to the execution of stsndard SQL statement, and what use as native system is the OCI interface of ORACLE.After this data bus just again circulates and carries out above flow process.In above-mentioned treatment scheme, data bus adopts different data processing queue and cache file to the commercial data base history data store of principal and subordinate's data server, any situation that no matter may occur in the face of data server or data bus, data bus finally can be correct by the commercial data base that stores data server into synchronous historical data.
The flow process that the treatment scheme that data bus adopts to the commercial data library storage scale-of-two blob data of data server adopts with processing stsndard SQL statement is basically identical, unique different place is exactly unified interface and the buffer memory file data form that data bus provides, and data bus storage scale-of-two blob data all adopts the more mode of newer field to process.The basic interface that storage scale-of-two blob data is used imports parameter difference into, the need protection positional information of scale-of-two blob data storage of the data of parameter, and the data structure of importing data into is:
Wherein table_name has represented the title of the database table at scale-of-two BLOB field place, field_name represents the title of scale-of-two BLOB field, filter is the filtercondition that upgrades database table field, what buff represented is the data that need to store scale-of-two BLOB field into, and length is the effective length of data buff.Data bus can use above data message by Data Update to meeting in the field field_name of record of database table table_name of filter condition.If the processing of scale-of-two BLOB order failure, data bus just writes cache file by order so, cache file is binary data file, the unified little endian mode that adopts of data is stored, the data layout of cache file is just the data layout of CBlobCommand order, write cache file and just a CBlobCommand order be appended to scale-of-two cache file afterbody, read data in cache file read at every turn a CBlobCommand order length data until in file all data be all read out.The file directory of data bus service processing scale-of-two BLOB cache file is sync/blob/I or sync/blob/II.
As shown in Figure 6, data bus deal with data file, comprises the following steps:
One, sampled data module is sampled data data writing file, and this data file is sent to data bus processes;
Data bus deal with data file is used file transfer protocol (FTP) FTP that data file synchronized transmission is stored in the file system of principal and subordinate's data server.Data bus offers in the interface of sampled data module, and sampled data module need to be imported file name into and comprise absolute path and principal and subordinate's data server file destination directory path.Data bus receives after the data of sampled data module, and unified use CFtpFileData order is processed, and the data structure definition of order is as follows:
Wherein filetype representation file type, sampled data module may need to transmit multiple different file data, it is carried out to unique differentiation with filetype, filename is the file name of local data file, comprised absolute path, destdir is that data file is stored in the target directory path on principal and subordinate's data server.
Two, the catalogue of data bus processing CFtpFileData order cache file is sync/ftpfile, and data bus can first judge whether that before processing a CFtpFileData order cache file exists;
If not, directly CFtpFileData is added to processing queue afterbody, enter step 6 etc. pending;
If have cache file to exist, enter step 3;
Three, data bus writes cache file afterbody by CFtpFileData order;
Four, data bus reads in order CFtpFileData orders all in cache file and deletes cache file simultaneously;
Five, data bus adds processing queue afterbody etc. pending all CFtpFileData orders of reading;
Data bus is processed the order in processing queue in order, and every correct order of queue head of carrying out is just deleted head order from queue;
Six, judging whether all orders of processing in lining up are all correctly finished, is to empty queue; If have command execution failure in process, enter step 7;
Seven, data bus writes remaining all orders in processing queue in order in newly-built cache file and empties command queue.Newly-built ftp caching file will be processed in preferential the arriving of next circulation time.
The data layout of cache file adopts the form of CFtpFileData order to store, data pattern employing little endian mode, the writing with to read same scale-of-two BLOB cache file method identical of cache file data; Data bus is realized FTP function and is completed by libcURL storehouse.After this data bus circulation re-executes above flow process.Data bus has two mission threads respectively cache file and processing queue to be processed simultaneously to principal and subordinate's data server, no matter principal and subordinate's data server has occurred that any problem causes transmitting unsuccessfully, all there is different cache files corresponding with it, guaranteed that like this file data synchronous driving is to principal and subordinate's data server.
As shown in Figure 7, the bibliographic structure of data bus processing cache file is divided into three kinds: SQL cache file, scale-of-two BLOB cache file and CFtpFileData order cache file.In intelligent substation growing today, transformer station is inner can access more and more eurypalynous data, and for these data are effectively classified, transformer station can carry out partition management, to can the various data in transformer station be had and be browsed more intuitively.In intelligent substation, mainly data are divided into two classes at present; one class is the data that traditional transformer station gathers; comprise protection information, observing and controlling information, integrated observing and controlling device information, integrated logout analytical equipment information, integrated power supply information and other intelligent apparatus information etc., another kind of information comprises primary equipment on-line monitoring information, power quality monitoring information, fire information, video and management for environment monitor information etc.The data of subregion need to gather respectively and storage respectively, conventionally be all to use different databases, therefore data bus needs subregion processing when processing cache file, the SQL statement cache file relevant to commercial data base and BLOB order cache file just need to divide HeII district, I district, and FTPFILE order cache file (processing history data file) only need to be saved in the different file directorys of data server file system, can directly to data bus, specify the catalogue that history data file is stored into data server.
System of the present invention has met the feature of intelligent substation data diversity, can synchronously preserve dissimilar data, data synchronous operation is processed by independent system and device completely simultaneously, has improved efficiency and the stability of intelligent substation.
Claims (10)
1. the device of an intelligent substation two-shipper stores synchronized historical data, it is characterized in that: the device of described intelligent substation two-shipper stores synchronized historical data is provided with main monitoring host computer and from monitoring host computer, master data server and from data server, described main monitoring host computer and be simultaneously connected to intelligent substation measure and control device from monitoring host computer, main monitoring host computer with from monitoring host computer, by network, be connected, described master data server and from the main monitoring host computer of data server stores synchronized and the historical data of sending from monitoring host computer.
2. the system of an intelligent substation two-shipper stores synchronized historical data, it is characterized in that: the system of described intelligent substation two-shipper stores synchronized historical data is provided with real-time library module, in real time storehouse is provided with event data module, standard internal data format module, master data collection and supervisor control (SCADA) module and from data acquisition and supervisor control (SCADA) module;
The not confirmed that described event data module receives from the historical events generation module of intelligent substation measure and control device and the event data not being eliminated, make data structure conversion process and obtain the self-defining event data form of internal system, send to standard internal data format module;
Described standard internal data format module receives the event data that event data module is sent, as data structure, be converted to logout, synchronously to master data collection and supervisor control (SCADA) module with from data acquisition and supervisor control (SCADA) module, send;
Described master data collection and supervisor control (SCADA) resume module event data, logout synchronization distribution is arrived from data acquisition and supervisor control (SCADA) module, the logout coming according to master data collection and supervisor control (SCADA) module synchronization distribution from data acquisition and supervisor control (SCADA) module, generates the logout with supervisor control (SCADA) module needs from data acquisition; Master and slave data acquisition and supervisor control (SCADA) module is stored in logout respectively in the commercial data base of master and slave data server.
3. the system of intelligent substation two-shipper stores synchronized historical data according to claim 2, it is characterized in that: described master data collection and supervisor control (SCADA) module with from the interruption of data acquisition and supervisor control (SCADA) module communication, master data collection and supervisor control (SCADA) module is kept at the information of logout in the logout cache table (HTModifyInfo) of master data collection and supervisor control (SCADA) module, during communication recovery, from data acquisition and supervisor control (SCADA) module according to the content of the logout cache table (HTModifyInfo) of master data collection and supervisor control (SCADA) module by logout synchronization distribution to from data acquisition and supervisor control (SCADA) module, after synchronization distribution is confirmed, corresponding record in the logout cache table (HTModifyInfo) of deletion master data collection and supervisor control (SCADA) module.
4. the system of intelligent substation two-shipper stores synchronized historical data according to claim 2, is characterized in that: described master data collection and supervisor control (SCADA) resume module event data, comprises the following steps:
One, master data collection and supervisor control (SCADA) module monitors, from the logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module, is inquired about the content from the logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module by the frequency timing of 1 beat/min;
Two, from the logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module, be empty, master data collection and supervisor control (SCADA) module is checked the event data record value of the up-to-date generation of standard internal data format module, if exceed event data value scope, generate a logout, send to from data acquisition and supervisor control (SCADA) module.
5. the system of intelligent substation two-shipper stores synchronized historical data according to claim 4, it is characterized in that: described be non-NULL from the logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module, the inquiry of master data collection and supervisor control (SCADA) module is from the not logout of confirmation of synchronization of logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module, upgrade the corresponding event record that master data collection and supervisor control (SCADA) module exist, to delete with logout corresponding supervisor control (SCADA) module logout cache table (HTModifyInfo) from data acquisition.
6. the system of intelligent substation two-shipper stores synchronized historical data according to claim 2, it is characterized in that: the described logout coming according to master data collection and supervisor control (SCADA) module synchronization distribution from data acquisition and supervisor control (SCADA) module, generation, from the logout of data acquisition and supervisor control (SCADA) module needs, comprises the following steps:
One,, from the logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module monitors master data collection and supervisor control (SCADA) module, by the frequency timing of 1 beat/min, inquire about the content in the logout cache table (HTModifyInfo) of master data collection and supervisor control (SCADA) module;
Two, in the logout cache table (HTModifyInfo) of master data collection and supervisor control (SCADA) module, be empty, from data acquisition and supervisor control (SCADA) module, for the logout receiving from master data collection and supervisor control (SCADA) module, line up, be divided into newly-increased logout and confirm logout, the logout coming of synchronizeing with supervisor control (SCADA) module from master data collection is newly-increased logout, for newly-increased logout, from data acquisition and supervisor control (SCADA) module, directly according to event data, increase an event data record newly, be saved in from the historical data base of data server, for confirming logout, from data acquisition and supervisor control (SCADA) module, change the acknowledgement indicator of event history corresponding corresponding master data collection and supervisor control (SCADA) module logout cache table (HTModifyInfo).
7. the system of intelligent substation two-shipper stores synchronized historical data according to claim 6, it is characterized in that: in the logout cache table (HTModifyInfo) of described master data collection and supervisor control (SCADA) module, be non-NULL, from the not logout of confirmation of synchronization of logout cache table (HTModifyInfo) of data acquisition and supervisor control (SCADA) module inquiry master data collection and supervisor control (SCADA) module, renewal is from the corresponding event record of data acquisition and the existence of supervisor control (SCADA) module, master data collection is deleted with logout corresponding in supervisor control (SCADA) module logout cache table (HTModifyInfo).
8. the system of intelligent substation two-shipper stores synchronized historical data according to claim 2, it is characterized in that: the sampled data of described historical events generation module is stored in the commercial data base of data server through data bus by normal structure query language (SQL) or scale-of-two (BLOB) form, in the mode of file, through data bus, is stored in the file directory of data server.
9. the system of intelligent substation two-shipper stores synchronized historical data according to claim 8, is characterized in that: described sampled data is: remote measurement sampled value data, remote signalling sampled value data, the out-of-limit related data of remote measurement, remote control related data, failure wave-recording file, Power Management Unit (PMU) sampled data file and alarm bulletin file.
10. the system of intelligent substation two-shipper stores synchronized historical data according to claim 2, is characterized in that: described event data is: sequence of events recording (SOE), displacement record (COS), the out-of-limit record of remote measurement, protection logout, operation note, self-inspection record, failure wave-recording record, record of examination, definite value record, system information record, sequencing control record, voltage power-less control record (VQC) and switch status monitor record.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310726208.7A CN103744901B (en) | 2013-12-25 | 2013-12-25 | The system and device of intelligent substation double-host history data synchronously-storinsystem |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310726208.7A CN103744901B (en) | 2013-12-25 | 2013-12-25 | The system and device of intelligent substation double-host history data synchronously-storinsystem |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103744901A true CN103744901A (en) | 2014-04-23 |
| CN103744901B CN103744901B (en) | 2017-07-25 |
Family
ID=50501919
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310726208.7A Active CN103744901B (en) | 2013-12-25 | 2013-12-25 | The system and device of intelligent substation double-host history data synchronously-storinsystem |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103744901B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107295057A (en) * | 2016-04-12 | 2017-10-24 | Ls 产电株式会社 | Device for the relay data transmission in SCADA system |
| CN107885492A (en) * | 2017-11-14 | 2018-04-06 | 中国银行股份有限公司 | The method and device of data structure dynamic generation in main frame |
| CN108093010A (en) * | 2016-11-23 | 2018-05-29 | 成都阜特科技股份有限公司 | A kind of industrial real-time data system and its data processing method |
| CN109218096A (en) * | 2018-09-19 | 2019-01-15 | 新智能源系统控制有限责任公司 | A kind of SCADA real-time database access system based on master-slave redundancy |
| CN110727733A (en) * | 2019-09-25 | 2020-01-24 | 许昌许继软件技术有限公司 | Main and standby server system and data synchronization method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5638378A (en) * | 1994-12-22 | 1997-06-10 | Motorola, Inc. | Method of operating a communication system |
| CN102360357A (en) * | 2011-09-29 | 2012-02-22 | 南京国电南自轨道交通工程有限公司 | Data synchronization component of network relation database nodes of SCADA (Supervisory Control and Data Acquisition) system |
-
2013
- 2013-12-25 CN CN201310726208.7A patent/CN103744901B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5638378A (en) * | 1994-12-22 | 1997-06-10 | Motorola, Inc. | Method of operating a communication system |
| CN102360357A (en) * | 2011-09-29 | 2012-02-22 | 南京国电南自轨道交通工程有限公司 | Data synchronization component of network relation database nodes of SCADA (Supervisory Control and Data Acquisition) system |
Non-Patent Citations (1)
| Title |
|---|
| 崔嵩 等: "变电站SCADA系统双机热备的研究与实现", 《PLC&FA》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107295057A (en) * | 2016-04-12 | 2017-10-24 | Ls 产电株式会社 | Device for the relay data transmission in SCADA system |
| CN108093010A (en) * | 2016-11-23 | 2018-05-29 | 成都阜特科技股份有限公司 | A kind of industrial real-time data system and its data processing method |
| CN107885492A (en) * | 2017-11-14 | 2018-04-06 | 中国银行股份有限公司 | The method and device of data structure dynamic generation in main frame |
| CN107885492B (en) * | 2017-11-14 | 2021-03-12 | 中国银行股份有限公司 | Method and device for dynamically generating data structure in host |
| CN109218096A (en) * | 2018-09-19 | 2019-01-15 | 新智能源系统控制有限责任公司 | A kind of SCADA real-time database access system based on master-slave redundancy |
| CN110727733A (en) * | 2019-09-25 | 2020-01-24 | 许昌许继软件技术有限公司 | Main and standby server system and data synchronization method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103744901B (en) | 2017-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103744901A (en) | Intelligent substation double-host history data synchronously-storing system and device | |
| CN103226483B (en) | The dual-machine hot backup system and method thereof that realize is stored based on SOA, cloud | |
| CN103914485A (en) | System and method for remotely collecting, retrieving and displaying application system logs | |
| CN109933632B (en) | Data migration method, device and equipment for database | |
| CN101594256A (en) | Disaster recovery method, device and system | |
| CN103067230A (en) | Method for achieving hyper text transport protocol (http) service monitoring through embedding monitoring code | |
| CN107302569B (en) | Cloud platform-oriented security monitoring data acquisition and storage method | |
| CN104252485A (en) | Database management platform | |
| CN103488793A (en) | User behavior monitoring method based on information retrieval | |
| CN105045533A (en) | Disk heartbeat transmitting and receiving method suitable for dual-control high-availability memory system | |
| CN103037203A (en) | Method and device for index recovery based on block storage | |
| CN103839195A (en) | Power quality management server side and data processing method thereof | |
| CN110019469A (en) | Distributed data base data processing method, device, storage medium and electronic device | |
| CN110727733B (en) | Master-slave server system and data synchronization method | |
| CN108877188A (en) | A kind of environment protection digital concurrently acquires and Multi net voting dissemination method and device | |
| CN107436904B (en) | Data acquisition method, data acquisition device, and computer-readable storage medium | |
| CN108111355B (en) | Data communication gateway machine and method, device and medium for synchronizing data thereof | |
| CN111913933B (en) | Power grid historical data management method and system based on unified support platform | |
| CN104516953B (en) | A kind of black box subsystem for power dispatching automation magnanimity message | |
| CN103778024A (en) | Server system and message processing method thereof | |
| CN110418403B (en) | 35kV transformer substation data recording system and method based on wireless network | |
| CN106407264A (en) | High-availability and high-consistency database cluster system and command processing method thereof | |
| CN111241044A (en) | Method, device and equipment for building heterogeneous database and readable storage medium | |
| CN109302480A (en) | A kind of method of data collecting instrument Remote configuration | |
| CN114296954A (en) | Data acquisition management system and method applied to industrial field |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |