Towards parallel and real-time database system and the data managing method thereof of electric system
Technical field
The present invention relates to the real time data administrative skill in a kind of control technique in power system field, be specifically related to a kind of parallel and real-time database system towards electric system and data managing method thereof.
Background technology
In existing power scheduling technology support system, use the real time datas such as real-time data base storage and management remote measurement amount, remote signalling amount.Along with the development of electrical network, it is large that real-time measurement data volume constantly becomes, and the real-time data base efficiency that existing dispatch automated system is used and the bottleneck of storage are more and more significant:
1. the larger table of pair data volume, the efficiency of carrying out some accessing operation is lower, for example, the table of certain 200,000 row is carried out to conditional information retrieval operation.
2. existing real-time data base is used shared drive as storage medium, and can only be arranged on a machine the inevitable like this restriction that is subject to unit internal memory and cpu load.The real-time data base that current dispatching automation back-up system is used there is no method and breaks through this restriction.
At present some company has developed the real-time dataBase system of oneself, as Guodian Nannui Tech Co., Ltd discloses a kind of patent No., is 201110172234.0 large grid distributed real-time database system.
Summary of the invention
For the deficiencies in the prior art, the invention provides a kind of parallel and real-time database system towards electric system and data managing method thereof, this system and data managing method thereof are in the situation that real-time data base number of nodes is abundant, and parallel real-time data base will improve data manipulation performance significantly.
The object of the invention is to adopt following technical proposals to realize:
Towards a parallel and real-time database system for electric system, its improvements are, described parallel and real-time database system comprises N real-time data base node and metadata management subsystem; Described N real-time data base node is connected by communication network with metadata management subsystem;
Described metadata management subsystem, for storing and manage the distribution pattern of described parallel and real-time database system.
Preferably, each described real-time data base node comprises real-time data base server;
Described real-time data base server comprises:
Local base management system in real time, for developing and managing local real-time data base;
Overall situation rdal-time DBMS: for carrying out global transaction management and concurrent control, coordinate described local rdal-time DBMS and complete global application (global application refers to the application of calling global access interface);
Contact manager transmits message and data between described N real-time data base node;
Local real-time data base, leaves (real time data of local real-time data base leaves in the machine internal memory) in internal memory in as the working version of local data base.
More preferably, the real-time base management system in described this locality comprises:
Local data Operation Processor, for receiving the data operation request from global data Operation Processor;
Local daily record, for recording local data manipulation processor, local installation manager, local manager and the local data deleted copies and the daily record of work of Sync Manager;
The local manager of deleting: for receiving the installation request of deleting manager from the overall situation, local real-time data base is carried out to deletion action, by described contact manager, operating result is sent to overall installation manager;
Local installation manager: for receiving the installation request from overall installation manager, local real-time data base is carried out to fitting operation, by contact manager, operating result is sent to overall installation manager;
Local data copies and Sync Manager: for receiving from global data, copy and the copying and synchronization request of Sync Manager, local real-time data base is copied and synchronous operation, by contact manager, send to global data to copy and Sync Manager operating result.
More preferably, described overall rdal-time DBMS comprises:
Global access interface: for receiving the data operation request from user, carry out after semanteme transforms being transmitted to global data Operation Processor, treat that the execution of global data Operation Processor finishes, and is shown to user by execution result;
Global data Operation Processor: for realizing data manipulation processing;
Overall situation installation manager: for realizing user's database, the installation of table;
The overall situation is deleted manager: for realizing user's database, the deletion of table;
Global data copies and Sync Manager: for realizing user's the copying and synchronize of database, table, record;
Overall situation daily record: delete manager and global data and copy and the daily record of work of Sync Manager for recording described global data Operation Processor, overall installation manager, the overall situation.
The present invention is based on the data managing method of a kind of parallel and real-time database system towards electric system that another object provides, its improvements are, described method comprises the steps:
A, global application are called described global access interface;
B, described global access interface are passed to described global data Action Manager by data operation request and parameter;
C, described global data Operation Processor and metadata management subsystem carry out alternately, obtaining the IP address of local real-time data base node;
D, described global data Operation Processor, according to the IP address of local real-time data base node, by contact manager, send to the local data Operation Processor on local real-time data base node by data operation request and parameter;
After E, described local data Operation Processor EO, will return results by contact manager and send to global data Operation Processor;
F, described global data Operation Processor will return results and pass to global access interface.
Preferably, described parameter comprises data state, application, table and record.
Compared with the prior art, the beneficial effect that the present invention reaches is:
Parallel and real-time database system towards electric system provided by the invention and data managing method thereof, in the situation that real-time data base number of nodes is abundant, parallel real-time data base will improve data manipulation performance significantly; And, provide under the prerequisite of local real-time data access function not affecting local storehouse in real time, based on real-time storehouse, this locality system, form parallel real-time data base, overall real-time data access function is provided.By parallel and real-time database system provided by the invention and data managing method thereof, can, in the situation that not affecting standalone version supporting system technology local computing, on upper strata, form global access interface, effectively support global calculation.
Accompanying drawing explanation
Fig. 1 is the parallel and real-time database system structural drawing towards electric system provided by the invention;
Fig. 2 is the system construction drawing of local rdal-time DBMS provided by the invention;
Fig. 3 is the system construction drawing of overall rdal-time DBMS provided by the invention;
Fig. 4 is the process flow diagram of the data managing method of the parallel and real-time database system towards electric system provided by the invention.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in further detail.
Parallel and real-time database system towards electric system provided by the invention is formed by connecting by communication network by N real-time data base node and a metadata relationship subsystem, and wherein each real-time data base node has a real-time data base server.N is natural number.Provided by the invention towards the parallel real-time data base architecture of electric system as shown in Figure 1.
Each real-time data base server comprises an overall rdal-time DBMS, a real-time base management system in this locality, a contact manager and a local real-time data base.
1. contact manager: transmit message and data between each node of parallel and real-time database system, reliable communication service function is provided.
2. local rdal-time DBMS: develop and manage local real-time data base, Site autonomy ability is provided, carry out the child-operation of topical application and global operation, realize local matter and process and concurrent control, control local recovery function.
3. overall rdal-time DBMS: distribution transparency is provided, coordinate the execution of global transaction, coordinate each local rdal-time DBMS to complete global application, guarantee the global coherency of database, carry out global transaction management and concurrent control, realize and upgrading synchronously, coordinate each local rdal-time DBMS to realize global repair function.
4. local real-time data base: leave in internal memory as the working version of local data base, all local data bases form the parallel real-time data base of the overall situation of logic jointly.
5. metadata management subsystem: the distribution pattern of storage and the parallel real-time data base of management, the i.e. corresponding relation of state, application, table, record and physical location.The principle of distribution pattern based on load balancing between node set up.
I, local rdal-time DBMS:
Fig. 2 has provided the system architecture of local rdal-time DBMS, as shown in Figure 2:
Local data Operation Processor: be responsible for receiving the data operation request from global data Operation Processor, data manipulation is carried out in real-time storehouse, this locality, by contact manager, result is sent to global data Operation Processor.
Local daily record: be responsible for recording local data manipulation processor, local installation manager, local manager and the local data deleted copies and the daily record of work of Sync Manager.
Local installation manager: be responsible for receiving the installation request from overall installation manager, fitting operation is carried out in real-time storehouse, this locality, by contact manager, operating result is sent to overall installation manager.
The local manager of deleting: be responsible for receiving the installation request of deleting manager from the overall situation, deletion action is carried out in real-time storehouse, this locality, by contact manager, operating result is sent to overall installation manager.
Local data copies and Sync Manager: be responsible for receiving from global data and copy and the copying and synchronization request of Sync Manager, real-time storehouse, this locality is copied and synchronous operation, by contact manager, send to global data to copy and Sync Manager operating result.
II, overall rdal-time DBMS:
Overall situation rdal-time DBMS is coordinated each local rdal-time DBMS to complete global application, guarantee the global coherency of database, carry out global transaction management and concurrent control, realize and upgrading synchronously, coordinate each local rdal-time DBMS to realize global repair function.
Fig. 3 has provided the system architecture of overall rdal-time DBMS, as shown in Figure 3:
Global access interface: be responsible for receiving from user's database manipulation request of (comprising terminal user, application programmer and data base administrator), carry out after semanteme transforms being transmitted to global data Operation Processor, treat that the execution of global data Operation Processor finishes, and is shown to user by corresponding executed result.
Global data Operation Processor: be responsible for realizing data manipulation processing.According to the distribution pattern of metadata management subsystem stores, by contact manager, database manipulation request is distributed to each corresponding local data Operation Processor, after local data operational processes finishes, reception returns results from local data Operation Processor, and carries out the integration of result.
Overall situation installation manager: be responsible for the installation of fulfillment database, table.According to the distribution pattern of metadata management subsystem stores, by contact manager, installing DB request is distributed to each corresponding local data Operation Processor.
The overall situation is deleted manager: be responsible for the deletion of fulfillment database, table.According to the distribution pattern of metadata management subsystem stores, by contact manager, database removal request is distributed to each corresponding local data Operation Processor.
Global data copies and Sync Manager: be responsible for copying and synchronizeing of fulfillment database, table, record.According to the distribution pattern of metadata management subsystem stores, by contact manager, database replication and synchronization request are distributed to each corresponding local data and copy and Sync Manager.
Overall situation daily record: be responsible for recording global data Operation Processor, overall installation manager, the overall situation and delete manager and global data and copy and the daily record of work of Sync Manager.
The present invention also provides towards the data managing method of the parallel and real-time database system of electric system, and Fig. 4 provides towards the data managing method of the parallel and real-time database system of electric system, and as shown in Figure 4, data managing method comprises the steps:
A, global application are called global access interface;
B, global access interface are passed to global data Action Manager by data operation request and parameter;
C, global data Operation Processor by state, application, show, record these parameters and metadata management subsystem carries out alternately, obtaining the IP address of local real-time data base node;
D, global data Operation Processor, according to the IP address of local real-time data base node, by contact manager, send to the local data Operation Processor on local real-time data base node by data operation request and parameter;
After E, local data Operation Processor EO, will return results by contact manager and send to global data Operation Processor;
F, global data Operation Processor will return results passes to global access interface.
Finally should be noted that: above embodiment is only in order to illustrate that technical scheme of the present invention is not intended to limit, although the present invention is had been described in detail with reference to above-described embodiment, those of ordinary skill in the field are to be understood that: still can modify or be equal to replacement the specific embodiment of the present invention, and do not depart from any modification of spirit and scope of the invention or be equal to replacement, it all should be encompassed in the middle of claim scope of the present invention.