CN102750371B - Parallel real-time database system and data management method thereof for power system - Google Patents
Parallel real-time database system and data management method thereof for power system Download PDFInfo
- Publication number
- CN102750371B CN102750371B CN201210201765.2A CN201210201765A CN102750371B CN 102750371 B CN102750371 B CN 102750371B CN 201210201765 A CN201210201765 A CN 201210201765A CN 102750371 B CN102750371 B CN 102750371B
- Authority
- CN
- China
- Prior art keywords
- real
- local
- manager
- time
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000013523 data management Methods 0.000 title abstract 4
- 238000004891 communication Methods 0.000 claims abstract description 5
- 238000009434 installation Methods 0.000 claims description 30
- 230000009471 action Effects 0.000 claims description 6
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 abstract description 21
- 230000006870 function Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000008439 repair process Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 230000000699 topical effect Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a real-time data management technique in the technical field of power system control, in particular to a parallel real-time database system and a data management method thereof for a power system. The database system comprises N real-time database nodes and a metadata management subsystem, wherein the N real-time database nodes are connected with the metadata management subsystem through a communication network, and the metadata management subsystem is used for storing and managing distribution modes of the parallel real-time database system. According to the parallel real-time database system and the data management method thereof, the data manipulation performance of the parallel real-time database system can be remarkably improved under the condition that the database nodes are enough.
Description
Technical field
The present invention relates to the real time data administrative skill in a kind of control technique in power system field, be specifically related to a kind of parallel and real-time database system towards electric system and data managing method thereof.
Background technology
In existing power scheduling technology support system, use the real time datas such as real-time data base storage and management remote measurement amount, remote signalling amount.Along with the development of electrical network, it is large that real-time measurement data volume constantly becomes, and the real-time data base efficiency that existing dispatch automated system is used and the bottleneck of storage are more and more significant:
1. the larger table of pair data volume, the efficiency of carrying out some accessing operation is lower, for example, the table of certain 200,000 row is carried out to conditional information retrieval operation.
2. existing real-time data base is used shared drive as storage medium, and can only be arranged on a machine the inevitable like this restriction that is subject to unit internal memory and cpu load.The real-time data base that current dispatching automation back-up system is used there is no method and breaks through this restriction.
At present some company has developed the real-time dataBase system of oneself, as Guodian Nannui Tech Co., Ltd discloses a kind of patent No., is 201110172234.0 large grid distributed real-time database system.
Summary of the invention
For the deficiencies in the prior art, the invention provides a kind of parallel and real-time database system towards electric system and data managing method thereof, this system and data managing method thereof are in the situation that real-time data base number of nodes is abundant, and parallel real-time data base will improve data manipulation performance significantly.
The object of the invention is to adopt following technical proposals to realize:
Towards a parallel and real-time database system for electric system, its improvements are, described parallel and real-time database system comprises N real-time data base node and metadata management subsystem; Described N real-time data base node is connected by communication network with metadata management subsystem;
Described metadata management subsystem, for storing and manage the distribution pattern of described parallel and real-time database system.
Preferably, each described real-time data base node comprises real-time data base server;
Described real-time data base server comprises:
Local base management system in real time, for developing and managing local real-time data base;
Overall situation rdal-time DBMS: for carrying out global transaction management and concurrent control, coordinate described local rdal-time DBMS and complete global application (global application refers to the application of calling global access interface);
Contact manager transmits message and data between described N real-time data base node;
Local real-time data base, leaves (real time data of local real-time data base leaves in the machine internal memory) in internal memory in as the working version of local data base.
More preferably, the real-time base management system in described this locality comprises:
Local data Operation Processor, for receiving the data operation request from global data Operation Processor;
Local daily record, for recording local data manipulation processor, local installation manager, local manager and the local data deleted copies and the daily record of work of Sync Manager;
The local manager of deleting: for receiving the installation request of deleting manager from the overall situation, local real-time data base is carried out to deletion action, by described contact manager, operating result is sent to overall installation manager;
Local installation manager: for receiving the installation request from overall installation manager, local real-time data base is carried out to fitting operation, by contact manager, operating result is sent to overall installation manager;
Local data copies and Sync Manager: for receiving from global data, copy and the copying and synchronization request of Sync Manager, local real-time data base is copied and synchronous operation, by contact manager, send to global data to copy and Sync Manager operating result.
More preferably, described overall rdal-time DBMS comprises:
Global access interface: for receiving the data operation request from user, carry out after semanteme transforms being transmitted to global data Operation Processor, treat that the execution of global data Operation Processor finishes, and is shown to user by execution result;
Global data Operation Processor: for realizing data manipulation processing;
Overall situation installation manager: for realizing user's database, the installation of table;
The overall situation is deleted manager: for realizing user's database, the deletion of table;
Global data copies and Sync Manager: for realizing user's the copying and synchronize of database, table, record;
Overall situation daily record: delete manager and global data and copy and the daily record of work of Sync Manager for recording described global data Operation Processor, overall installation manager, the overall situation.
The present invention is based on the data managing method of a kind of parallel and real-time database system towards electric system that another object provides, its improvements are, described method comprises the steps:
A, global application are called described global access interface;
B, described global access interface are passed to described global data Action Manager by data operation request and parameter;
C, described global data Operation Processor and metadata management subsystem carry out alternately, obtaining the IP address of local real-time data base node;
D, described global data Operation Processor, according to the IP address of local real-time data base node, by contact manager, send to the local data Operation Processor on local real-time data base node by data operation request and parameter;
After E, described local data Operation Processor EO, will return results by contact manager and send to global data Operation Processor;
F, described global data Operation Processor will return results and pass to global access interface.
Preferably, described parameter comprises data state, application, table and record.
Compared with the prior art, the beneficial effect that the present invention reaches is:
Parallel and real-time database system towards electric system provided by the invention and data managing method thereof, in the situation that real-time data base number of nodes is abundant, parallel real-time data base will improve data manipulation performance significantly; And, provide under the prerequisite of local real-time data access function not affecting local storehouse in real time, based on real-time storehouse, this locality system, form parallel real-time data base, overall real-time data access function is provided.By parallel and real-time database system provided by the invention and data managing method thereof, can, in the situation that not affecting standalone version supporting system technology local computing, on upper strata, form global access interface, effectively support global calculation.
Accompanying drawing explanation
Fig. 1 is the parallel and real-time database system structural drawing towards electric system provided by the invention;
Fig. 2 is the system construction drawing of local rdal-time DBMS provided by the invention;
Fig. 3 is the system construction drawing of overall rdal-time DBMS provided by the invention;
Fig. 4 is the process flow diagram of the data managing method of the parallel and real-time database system towards electric system provided by the invention.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in further detail.
Parallel and real-time database system towards electric system provided by the invention is formed by connecting by communication network by N real-time data base node and a metadata relationship subsystem, and wherein each real-time data base node has a real-time data base server.N is natural number.Provided by the invention towards the parallel real-time data base architecture of electric system as shown in Figure 1.
Each real-time data base server comprises an overall rdal-time DBMS, a real-time base management system in this locality, a contact manager and a local real-time data base.
1. contact manager: transmit message and data between each node of parallel and real-time database system, reliable communication service function is provided.
2. local rdal-time DBMS: develop and manage local real-time data base, Site autonomy ability is provided, carry out the child-operation of topical application and global operation, realize local matter and process and concurrent control, control local recovery function.
3. overall rdal-time DBMS: distribution transparency is provided, coordinate the execution of global transaction, coordinate each local rdal-time DBMS to complete global application, guarantee the global coherency of database, carry out global transaction management and concurrent control, realize and upgrading synchronously, coordinate each local rdal-time DBMS to realize global repair function.
4. local real-time data base: leave in internal memory as the working version of local data base, all local data bases form the parallel real-time data base of the overall situation of logic jointly.
5. metadata management subsystem: the distribution pattern of storage and the parallel real-time data base of management, the i.e. corresponding relation of state, application, table, record and physical location.The principle of distribution pattern based on load balancing between node set up.
I, local rdal-time DBMS:
Fig. 2 has provided the system architecture of local rdal-time DBMS, as shown in Figure 2:
Local data Operation Processor: be responsible for receiving the data operation request from global data Operation Processor, data manipulation is carried out in real-time storehouse, this locality, by contact manager, result is sent to global data Operation Processor.
Local daily record: be responsible for recording local data manipulation processor, local installation manager, local manager and the local data deleted copies and the daily record of work of Sync Manager.
Local installation manager: be responsible for receiving the installation request from overall installation manager, fitting operation is carried out in real-time storehouse, this locality, by contact manager, operating result is sent to overall installation manager.
The local manager of deleting: be responsible for receiving the installation request of deleting manager from the overall situation, deletion action is carried out in real-time storehouse, this locality, by contact manager, operating result is sent to overall installation manager.
Local data copies and Sync Manager: be responsible for receiving from global data and copy and the copying and synchronization request of Sync Manager, real-time storehouse, this locality is copied and synchronous operation, by contact manager, send to global data to copy and Sync Manager operating result.
II, overall rdal-time DBMS:
Overall situation rdal-time DBMS is coordinated each local rdal-time DBMS to complete global application, guarantee the global coherency of database, carry out global transaction management and concurrent control, realize and upgrading synchronously, coordinate each local rdal-time DBMS to realize global repair function.
Fig. 3 has provided the system architecture of overall rdal-time DBMS, as shown in Figure 3:
Global access interface: be responsible for receiving from user's database manipulation request of (comprising terminal user, application programmer and data base administrator), carry out after semanteme transforms being transmitted to global data Operation Processor, treat that the execution of global data Operation Processor finishes, and is shown to user by corresponding executed result.
Global data Operation Processor: be responsible for realizing data manipulation processing.According to the distribution pattern of metadata management subsystem stores, by contact manager, database manipulation request is distributed to each corresponding local data Operation Processor, after local data operational processes finishes, reception returns results from local data Operation Processor, and carries out the integration of result.
Overall situation installation manager: be responsible for the installation of fulfillment database, table.According to the distribution pattern of metadata management subsystem stores, by contact manager, installing DB request is distributed to each corresponding local data Operation Processor.
The overall situation is deleted manager: be responsible for the deletion of fulfillment database, table.According to the distribution pattern of metadata management subsystem stores, by contact manager, database removal request is distributed to each corresponding local data Operation Processor.
Global data copies and Sync Manager: be responsible for copying and synchronizeing of fulfillment database, table, record.According to the distribution pattern of metadata management subsystem stores, by contact manager, database replication and synchronization request are distributed to each corresponding local data and copy and Sync Manager.
Overall situation daily record: be responsible for recording global data Operation Processor, overall installation manager, the overall situation and delete manager and global data and copy and the daily record of work of Sync Manager.
The present invention also provides towards the data managing method of the parallel and real-time database system of electric system, and Fig. 4 provides towards the data managing method of the parallel and real-time database system of electric system, and as shown in Figure 4, data managing method comprises the steps:
A, global application are called global access interface;
B, global access interface are passed to global data Action Manager by data operation request and parameter;
C, global data Operation Processor by state, application, show, record these parameters and metadata management subsystem carries out alternately, obtaining the IP address of local real-time data base node;
D, global data Operation Processor, according to the IP address of local real-time data base node, by contact manager, send to the local data Operation Processor on local real-time data base node by data operation request and parameter;
After E, local data Operation Processor EO, will return results by contact manager and send to global data Operation Processor;
F, global data Operation Processor will return results passes to global access interface.
Finally should be noted that: above embodiment is only in order to illustrate that technical scheme of the present invention is not intended to limit, although the present invention is had been described in detail with reference to above-described embodiment, those of ordinary skill in the field are to be understood that: still can modify or be equal to replacement the specific embodiment of the present invention, and do not depart from any modification of spirit and scope of the invention or be equal to replacement, it all should be encompassed in the middle of claim scope of the present invention.
Claims (2)
1. towards a parallel and real-time database system for electric system, it is characterized in that, described parallel and real-time database system comprises N real-time data base node and metadata management subsystem; Described N real-time data base node is connected by communication network with metadata management subsystem;
Described metadata management subsystem, for storing and manage the distribution pattern of described parallel and real-time database system;
Each described real-time data base node comprises real-time data base server;
Described real-time data base server comprises:
Local base management system in real time, for developing and managing local real-time data base;
Overall situation rdal-time DBMS: for carrying out global transaction management and concurrent control, coordinate described local rdal-time DBMS and complete global application;
Contact manager transmits message and data between described N real-time data base node;
Local real-time data base, leaves in internal memory as the working version of local data base;
The real-time base management system in described this locality comprises:
Local data Operation Processor, for receiving the data operation request from global data Operation Processor;
Local daily record, for recording local data manipulation processor, local installation manager, local manager and the local data deleted copies and the daily record of work of Sync Manager;
The local manager of deleting: for receiving the installation request of deleting manager from the overall situation, local real-time data base is carried out to deletion action, by described contact manager, operating result is sent to overall installation manager;
Local installation manager: for receiving the installation request from overall installation manager, local real-time data base is carried out to fitting operation, by contact manager, operating result is sent to overall installation manager;
Local data copies and Sync Manager: for receiving from global data, copy and the copying and synchronization request of Sync Manager, local real-time data base is copied and synchronous operation, by contact manager, send to global data to copy and Sync Manager operating result;
Described overall rdal-time DBMS comprises:
Global access interface: for receiving the data operation request from user, carry out after semanteme transforms being transmitted to global data Operation Processor, treat that the execution of global data Operation Processor finishes, and is shown to user by execution result;
Global data Operation Processor: for realizing data manipulation processing;
Overall situation installation manager: for realizing user's database, the installation of table;
The overall situation is deleted manager: for realizing user's database, the deletion of table;
Global data copies and Sync Manager: for realizing user's the copying and synchronize of database, table, record;
Overall situation daily record: delete manager and global data and copy and the daily record of work of Sync Manager for recording described global data Operation Processor, overall installation manager, the overall situation.
2. a data managing method that is applied to the parallel and real-time database system towards electric system as claimed in claim 1, is characterized in that, described method comprises the steps:
A, global application are called described global access interface;
B, described global access interface are passed to described global data Action Manager by data operation request and parameter;
C, described global data Operation Processor and metadata management subsystem carry out alternately, obtaining the IP address of local real-time data base node;
D, described global data Operation Processor, according to the IP address of local real-time data base node, by contact manager, send to the local data Operation Processor on local real-time data base node by data operation request and parameter;
After E, described local data Operation Processor EO, will return results by contact manager and send to global data Operation Processor;
F, described global data Operation Processor will return results and pass to global access interface;
Described parameter comprises state, application, table and record.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210201765.2A CN102750371B (en) | 2012-06-15 | 2012-06-15 | Parallel real-time database system and data management method thereof for power system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210201765.2A CN102750371B (en) | 2012-06-15 | 2012-06-15 | Parallel real-time database system and data management method thereof for power system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102750371A CN102750371A (en) | 2012-10-24 |
| CN102750371B true CN102750371B (en) | 2014-05-07 |
Family
ID=47030556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210201765.2A Active CN102750371B (en) | 2012-06-15 | 2012-06-15 | Parallel real-time database system and data management method thereof for power system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102750371B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049527B (en) * | 2012-12-20 | 2016-01-20 | 中国电力科学研究院 | A kind of parallel real-time database active-standby switch management system towards bulk power grid |
| CN103095806B (en) * | 2012-12-20 | 2016-01-20 | 中国电力科学研究院 | A kind of load balancing management system of the real-time dataBase system towards bulk power grid |
| CN104102741A (en) * | 2014-07-31 | 2014-10-15 | 浪潮通信信息系统有限公司 | Method for scheduling real-time data in monitoring system |
| CN107341250A (en) * | 2017-07-07 | 2017-11-10 | 天津天大求实电力新技术股份有限公司 | A kind of quick-searching Database Systems suitable for the planning of extensive power grid |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751394B (en) * | 2008-12-16 | 2011-11-16 | 青岛海信传媒网络技术有限公司 | Method and system for synchronizing data |
| CN102033930A (en) * | 2010-12-17 | 2011-04-27 | 北京世纪互联工程技术服务有限公司 | Distributed memory database system |
| CN102214228B (en) * | 2011-06-24 | 2013-03-13 | 国电南瑞科技股份有限公司 | Large-grid distributed real-time database system and data management method thereof |
-
2012
- 2012-06-15 CN CN201210201765.2A patent/CN102750371B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN102750371A (en) | 2012-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102955845B (en) | Data access method, device and distributed data base system | |
| CN103116661B (en) | A kind of data processing method of database | |
| CN101334797B (en) | Distributed file systems and its data block consistency managing method | |
| CN102999584B (en) | The cross-platform spatial data services method and system of electric power GIS | |
| CN104252485A (en) | Database management platform | |
| CN104011717A (en) | Data selection for data storage backup | |
| CN108848132B (en) | Power distribution scheduling main station system based on cloud | |
| CN103049482B (en) | The implementation method that in a kind of distributed heterogeneous system, data fusion stores | |
| CN104657497A (en) | Mass electricity information concurrent computation system and method based on distributed computation | |
| CN102508886B (en) | Extensive makeup language (XML)-based method for synchronously updating increment of spatial data | |
| CN102843418A (en) | Resource dispatching system | |
| CN103516802A (en) | Method and device for achieving seamless transference of across heterogeneous virtual switch | |
| CN102750371B (en) | Parallel real-time database system and data management method thereof for power system | |
| CN101901275A (en) | Distributed storage system and method thereof | |
| CN103955510A (en) | Massive electricity marketing data integration method uploaded by ETL cloud platform | |
| JP2004227169A (en) | Distributed database system | |
| CN103491155A (en) | Cloud computing method and system for achieving mobile computing and obtaining mobile data | |
| CN108228755A (en) | The data of MySQL database based on daily record analytic technique to Hadoop platform synchronize clone method | |
| CN103902405A (en) | Quasi-continuity data replication method and device | |
| CN102404411A (en) | Data synchronization method of cloud storage system | |
| CN109299056A (en) | A kind of method of data synchronization and device based on distributed file system | |
| CN103428288B (en) | Based on the copies synchronized method of subregion state table and coordinator node | |
| CN103365740B (en) | A kind of data cold standby method and device | |
| CN106056322A (en) | Smart grid scheduling system based on cloud computing | |
| CN105930380A (en) | Chart monitor method and device based on HADOOP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: STATE ELECTRIC NET CROP. Effective date: 20130424 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130424 Address after: 100192 Beijing city Haidian District Qinghe small Camp Road No. 15 Applicant after: China Electric Power Research Institute Applicant after: State Grid Corporation of China Address before: 100192 Beijing city Haidian District Qinghe small Camp Road No. 15 Applicant before: China Electric Power Research Institute |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |