CN102750371A - Parallel real-time database system and data management method thereof for power system - Google Patents
Parallel real-time database system and data management method thereof for power system Download PDFInfo
- Publication number
- CN102750371A CN102750371A CN2012102017652A CN201210201765A CN102750371A CN 102750371 A CN102750371 A CN 102750371A CN 2012102017652 A CN2012102017652 A CN 2012102017652A CN 201210201765 A CN201210201765 A CN 201210201765A CN 102750371 A CN102750371 A CN 102750371A
- Authority
- CN
- China
- Prior art keywords
- real
- local
- data
- time
- manager
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to a real-time data management technique in the technical field of power system control, in particular to a parallel real-time database system and a data management method thereof for a power system. The database system comprises N real-time database nodes and a metadata management subsystem, wherein the N real-time database nodes are connected with the metadata management subsystem through a communication network, and the metadata management subsystem is used for storing and managing distribution modes of the parallel real-time database system. According to the parallel real-time database system and the data management method thereof, the data manipulation performance of the parallel real-time database system can be remarkably improved under the condition that the database nodes are enough.
Description
Technical field
The present invention relates to the real time data administrative skill in a kind of control technique in power system field, be specifically related to a kind of parallel real-time dataBase system and data managing method thereof towards electric system.
Background technology
In existing power scheduling technology support system, use real-time data base storage and real time datas such as management remote measurement amount, remote signalling amount.Along with the development of electrical network, it is big that the real-time measurement data volume constantly becomes, the bottleneck more and more significant of existing employed real-time data base efficient of dispatch automated system and storage:
1. the table bigger to data volume, the efficient of carrying out some accessing operation is lower, and for example the table to certain 200,000 row carries out the conditional information retrieval operation.
2. existing real-time data base uses shared drive as storage medium, and can only be installed on the machine the inevitable like this restriction that receives unit internal memory and cpu load.The present employed real-time data base of dispatching automation back-up system still can't be broken through this restriction.
At present some company has developed the real-time dataBase system of oneself, and disclosing a kind of patent No. like Guodian Nannui Tech Co., Ltd is 201110172234.0 big grid distribution formula real-time dataBase system.
Summary of the invention
Deficiency to prior art; The present invention provides a kind of parallel real-time dataBase system and data managing method thereof towards electric system; This system and data managing method thereof are under the abundant situation of real-time data base number of nodes, and parallel real-time data base will improve data manipulation performance significantly.
The objective of the invention is to adopt following technical proposals to realize:
A kind of parallel real-time dataBase system towards electric system, its improvements are that said parallel real-time dataBase system comprises N real-time data base node and metadata management subsystem; Said N real-time data base node is connected through communication network with the metadata management subsystem;
Said metadata management subsystem, the distribution pattern that is used to store and manage said parallel real-time dataBase system.
Preferably, each said real-time data base node comprises the real-time data base server;
Said real-time data base server comprises:
Local base management system in real time is used to develop and manage local real-time data base;
Overall situation rdal-time DBMS: be used to carry out global transaction management and concurrent control, coordinate said local rdal-time DBMS and accomplish global application (global application refers to the application of calling the global access interface);
Contact manager transmits message and data between said N real-time data base node;
Local real-time data base leaves (real time data of local real-time data base leaves in this machine internal memory) in the internal memory in as the working version of local data base.
More preferably, the real-time base management system in said this locality comprises:
The local data Operation Processor is used to receive the data operation request from the global data Operation Processor;
Local daily record is used to write down local data manipulation processor, local installation manager, local deletion manager and local data and duplicates the daily record of work with Sync Manager;
Local deletion manager: be used to receive install request, local real-time data base is carried out deletion action, operating result is sent to overall installation manager through said contact manager from overall situation deletion manager;
Local installation manager: be used to receive install request, local real-time data base is carried out fitting operation, operating result is sent to overall installation manager through contact manager from overall installation manager;
Local data duplicates and Sync Manager: be used to receive from global data and duplicate and the duplicating and synchronization request of Sync Manager; Local real-time data base is duplicated and synchronous operation, operating result is sent to that global data is duplicated and Sync Manager through contact manager.
More preferably, said overall rdal-time DBMS comprises:
Global access interface: be used for receiving, carry out being transmitted to the global data Operation Processor after semanteme transforms, treat that the execution of global data Operation Processor finishes, and is shown to the user with execution result from the user's data operation requests;
Global data Operation Processor: be used to realize the data manipulation processing;
Overall situation installation manager: be used to realize the installation of user's data storehouse, table;
Overall situation deletion manager: be used to realize the deletion of user's data storehouse, table;
Global data is duplicated and Sync Manager: be used to realize duplicating with synchronously of user's data storehouse, table, record;
Overall situation daily record: be used to write down said global data Operation Processor, overall installation manager, overall situation deletion manager and global data and duplicate the daily record of work with Sync Manager.
The data managing method of a kind of parallel real-time dataBase system towards electric system that the present invention is based on that another purpose provides, its improvements are that said method comprises the steps:
A, global application are called said global access interface;
B, said global access interface are passed to said global data Action Manager with data operation request and parameter;
C, said global data Operation Processor and metadata management subsystem carry out obtaining local real-time data base IP addresses of nodes alternately;
D, said global data Operation Processor through contact manager, send to local data Operation Processor local real-time data base node on data operation request and parameter according to local real-time data base IP addresses of nodes;
Behind E, the said local data Operation Processor EO, return results is sent to the global data Operation Processor through contact manager;
F, said global data Operation Processor pass to the global access interface with return results.
Preferably, said parameter comprises data attitude, application, table and record.
With the prior art ratio, the beneficial effect that the present invention reaches is:
Parallel real-time dataBase system and data managing method thereof towards electric system provided by the invention, under the abundant situation of real-time data base number of nodes, parallel real-time data base will improve data manipulation performance significantly; And, providing under the prerequisite of local real-time data access function not influencing local storehouse in real time, system forms parallel real-time data base based on real-time storehouse, this locality, and overall real-time data access function is provided.Through parallel real-time dataBase system provided by the invention and data managing method thereof, can form the global access interface on the upper strata not influencing under the local situation about calculating of standalone version dispatching technique back-up system, effectively support global calculation.
Description of drawings
Fig. 1 is the parallel real-time dataBase system structural drawing towards electric system provided by the invention;
Fig. 2 is the system construction drawing of local rdal-time DBMS provided by the invention;
Fig. 3 is the system construction drawing of overall rdal-time DBMS provided by the invention;
Fig. 4 is the process flow diagram of the data managing method of the parallel real-time dataBase system towards electric system provided by the invention.
Embodiment
Do further to specify below in conjunction with the accompanying drawing specific embodiments of the invention.
Parallel real-time dataBase system towards electric system provided by the invention is formed by connecting through communication network N real-time data base node and a metadata relationship subsystem, and wherein each real-time data base node all has a real-time data base server.N is a natural number.Provided by the invention as shown in Figure 1 towards the parallel real-time data base architecture of electric system.
Each real-time data base server comprises an overall rdal-time DBMS, the real-time base management system in this locality, a contact manager and a local real-time data base.
1. contact manager: between each node of parallel real-time dataBase system, transmit message and data, reliable communication service function is provided.
2. local rdal-time DBMS: develop and manage local real-time data base, the node capacity of self-government is provided, carry out the child-operation of topical application and global operation, realize local matter processing and concurrent control, control local recovery function.
3. overall rdal-time DBMS: distribution transparency is provided; Coordinate the execution of global transaction; Coordinate each local rdal-time DBMS to accomplish global application, guarantee the global coherency of database, carry out global transaction management and concurrent control; Realize upgrading synchronously, coordinate each local rdal-time DBMS to realize overall restore funcitons.
4. local real-time data base: the working version as local data base leaves in the internal memory, and all local data bases constitute the parallel real-time data base of the overall situation of logic jointly.
5. metadata management subsystem: the distribution pattern of storage and the parallel real-time data base of management, the i.e. corresponding relation of attitude, application, table, record and physical location.Distribution pattern is set up based on the principle of load balancing between node.
I, local rdal-time DBMS:
Fig. 2 has provided the system architecture of local rdal-time DBMS, and is as shown in Figure 2:
Local data Operation Processor: be responsible for receiving data operation request, data manipulation is carried out in real-time storehouse, this locality, the result is sent to the global data Operation Processor through contact manager from the global data Operation Processor.
Local daily record: the local data manipulation processor of responsible record, local installation manager, local deletion manager and local data duplicate the daily record of work with Sync Manager.
Local installation manager: be responsible for receiving install request, fitting operation is carried out in real-time storehouse, this locality, operating result is sent to overall installation manager through contact manager from overall installation manager.
Local deletion manager: be responsible for receiving install request, deletion action is carried out in real-time storehouse, this locality, operating result is sent to overall installation manager through contact manager from overall situation deletion manager.
Local data duplicates and Sync Manager: be responsible for to receive from global data and duplicate and the duplicating and synchronization request of Sync Manager; Real-time storehouse, this locality is duplicated and synchronous operation, operating result is sent to that global data is duplicated and Sync Manager through contact manager.
II, overall rdal-time DBMS:
Overall situation rdal-time DBMS is coordinated each local rdal-time DBMS to accomplish global application; Guarantee the global coherency of database; Carry out global transaction management and concurrent control, realize upgrading synchronously, coordinate each local rdal-time DBMS to realize overall restore funcitons.
Fig. 3 has provided the system architecture of overall rdal-time DBMS, and is as shown in Figure 3:
Global access interface: be responsible for receiving from user's database manipulation request of (comprising terminal user, application programmer and data base administrator); Carry out being transmitted to the global data Operation Processor after semanteme transforms; Treat that the execution of global data Operation Processor finishes, and is shown to the user with corresponding executed result.
Global data Operation Processor: be responsible for realizing the data manipulation processing.Distribution pattern according to the metadata management subsystem stores; Through contact manager the database manipulation request is distributed to each corresponding local data Operation Processor; After treating that the local data operational processes finishes; Reception is from the return results of local data Operation Processor, and carries out result's integration.
Overall situation installation manager: be responsible for the installation of fulfillment database, table.According to the distribution pattern of metadata management subsystem stores, the database install request is distributed to each corresponding local data Operation Processor through contact manager.
Overall situation deletion manager: be responsible for the deletion of fulfillment database, table.According to the distribution pattern of metadata management subsystem stores, database deletion request is distributed to each corresponding local data Operation Processor through contact manager.
Global data is duplicated and Sync Manager: be responsible for duplicating with synchronously of fulfillment database, table, record.According to the distribution pattern of metadata management subsystem stores, through contact manager database replication and synchronization request are distributed to each corresponding local data and duplicate and Sync Manager.
Overall situation daily record: responsible record global data Operation Processor, overall installation manager, overall situation deletion manager and global data are duplicated the daily record of work with Sync Manager.
The present invention also provides towards the data managing method of the parallel real-time dataBase system of electric system, and Fig. 4 provides towards the data managing method of the parallel real-time dataBase system of electric system, and as shown in Figure 4, data managing method comprises the steps:
A, global application are called the global access interface;
B, global access interface are passed to the global data Action Manager with data operation request and parameter;
C, global data Operation Processor through attitude, application, table, write down these parameters and the metadata management subsystem carries out obtaining local real-time data base IP addresses of nodes alternately;
D, global data Operation Processor through contact manager, send to local data Operation Processor local real-time data base node on data operation request and parameter according to local real-time data base IP addresses of nodes;
Behind E, the local data Operation Processor EO, return results is sent to the global data Operation Processor through contact manager;
F, global data Operation Processor are passed to the global access interface with return results.
Should be noted that at last: above embodiment is only in order to technical scheme of the present invention to be described but not to its restriction; Although the present invention has been carried out detailed explanation with reference to the foregoing description; Under the those of ordinary skill in field be to be understood that: still can specific embodiments of the invention make amendment or be equal to replacement; And do not break away from any modification of spirit and scope of the invention or be equal to replacement, it all should be encompassed in the middle of the claim scope of the present invention.
Claims (6)
1. the parallel real-time dataBase system towards electric system is characterized in that, said parallel real-time dataBase system comprises N real-time data base node and metadata management subsystem; Said N real-time data base node is connected through communication network with the metadata management subsystem;
Said metadata management subsystem, the distribution pattern that is used to store and manage said parallel real-time dataBase system.
2. parallel real-time dataBase system as claimed in claim 1 is characterized in that, each said real-time data base node comprises the real-time data base server;
Said real-time data base server comprises:
Local base management system in real time is used to develop and manage local real-time data base;
Overall situation rdal-time DBMS: be used to carry out global transaction management and concurrent control, coordinate said local rdal-time DBMS and accomplish global application;
Contact manager transmits message and data between said N real-time data base node;
Local real-time data base leaves in the internal memory as the working version of local data base.
3. parallel real-time dataBase system as claimed in claim 2 is characterized in that, the real-time base management system in said this locality comprises:
The local data Operation Processor is used to receive the data operation request from the global data Operation Processor;
Local daily record is used to write down local data manipulation processor, local installation manager, local deletion manager and local data and duplicates the daily record of work with Sync Manager;
Local deletion manager: be used to receive install request, local real-time data base is carried out deletion action, operating result is sent to overall installation manager through said contact manager from overall situation deletion manager;
Local installation manager: be used to receive install request, local real-time data base is carried out fitting operation, operating result is sent to overall installation manager through contact manager from overall installation manager;
Local data duplicates and Sync Manager: be used to receive from global data and duplicate and the duplicating and synchronization request of Sync Manager; Local real-time data base is duplicated and synchronous operation, operating result is sent to that global data is duplicated and Sync Manager through contact manager.
4. parallel real-time dataBase system as claimed in claim 2 is characterized in that, said overall rdal-time DBMS comprises:
Global access interface: be used for receiving, carry out being transmitted to the global data Operation Processor after semanteme transforms, treat that the execution of global data Operation Processor finishes, and is shown to the user with execution result from the user's data operation requests;
Global data Operation Processor: be used to realize the data manipulation processing;
Overall situation installation manager: be used to realize the installation of user's data storehouse, table;
Overall situation deletion manager: be used to realize the deletion of user's data storehouse, table;
Global data is duplicated and Sync Manager: be used to realize duplicating with synchronously of user's data storehouse, table, record;
Overall situation daily record: be used to write down said global data Operation Processor, overall installation manager, overall situation deletion manager and global data and duplicate the daily record of work with Sync Manager.
5. the data managing method towards the parallel real-time dataBase system of electric system is characterized in that, said method comprises the steps:
A, global application are called said global access interface;
B, said global access interface are passed to said global data Action Manager with data operation request and parameter;
C, said global data Operation Processor and metadata management subsystem carry out obtaining local real-time data base IP addresses of nodes alternately;
D, said global data Operation Processor through contact manager, send to local data Operation Processor local real-time data base node on data operation request and parameter according to local real-time data base IP addresses of nodes;
Behind E, the said local data Operation Processor EO, return results is sent to the global data Operation Processor through contact manager;
F, said global data Operation Processor pass to the global access interface with return results.
6. data managing method as claimed in claim 5 is characterized in that said parameter comprises attitude, application, table and record.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210201765.2A CN102750371B (en) | 2012-06-15 | 2012-06-15 | Parallel real-time database system and data management method thereof for power system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210201765.2A CN102750371B (en) | 2012-06-15 | 2012-06-15 | Parallel real-time database system and data management method thereof for power system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102750371A true CN102750371A (en) | 2012-10-24 |
| CN102750371B CN102750371B (en) | 2014-05-07 |
Family
ID=47030556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210201765.2A Active CN102750371B (en) | 2012-06-15 | 2012-06-15 | Parallel real-time database system and data management method thereof for power system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102750371B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049527A (en) * | 2012-12-20 | 2013-04-17 | 中国电力科学研究院 | Large power grid oriented parallel real-time database master and slave switching management system |
| CN103095806A (en) * | 2012-12-20 | 2013-05-08 | 中国电力科学研究院 | Load balancing management system of large-power-network real-time database system |
| CN104102741A (en) * | 2014-07-31 | 2014-10-15 | 浪潮通信信息系统有限公司 | Method for scheduling real-time data in monitoring system |
| CN107341250A (en) * | 2017-07-07 | 2017-11-10 | 天津天大求实电力新技术股份有限公司 | A kind of quick-searching Database Systems suitable for the planning of extensive power grid |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751394A (en) * | 2008-12-16 | 2010-06-23 | 青岛海信传媒网络技术有限公司 | Method and system for synchronizing data |
| CN102033930A (en) * | 2010-12-17 | 2011-04-27 | 北京世纪互联工程技术服务有限公司 | Distributed memory database system |
| CN102214228A (en) * | 2011-06-24 | 2011-10-12 | 国电南瑞科技股份有限公司 | Large-grid distributed real-time database system and data management method thereof |
-
2012
- 2012-06-15 CN CN201210201765.2A patent/CN102750371B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751394A (en) * | 2008-12-16 | 2010-06-23 | 青岛海信传媒网络技术有限公司 | Method and system for synchronizing data |
| CN102033930A (en) * | 2010-12-17 | 2011-04-27 | 北京世纪互联工程技术服务有限公司 | Distributed memory database system |
| CN102214228A (en) * | 2011-06-24 | 2011-10-12 | 国电南瑞科技股份有限公司 | Large-grid distributed real-time database system and data management method thereof |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049527A (en) * | 2012-12-20 | 2013-04-17 | 中国电力科学研究院 | Large power grid oriented parallel real-time database master and slave switching management system |
| CN103095806A (en) * | 2012-12-20 | 2013-05-08 | 中国电力科学研究院 | Load balancing management system of large-power-network real-time database system |
| CN103095806B (en) * | 2012-12-20 | 2016-01-20 | 中国电力科学研究院 | A kind of load balancing management system of the real-time dataBase system towards bulk power grid |
| CN103049527B (en) * | 2012-12-20 | 2016-01-20 | 中国电力科学研究院 | A kind of parallel real-time database active-standby switch management system towards bulk power grid |
| CN104102741A (en) * | 2014-07-31 | 2014-10-15 | 浪潮通信信息系统有限公司 | Method for scheduling real-time data in monitoring system |
| CN107341250A (en) * | 2017-07-07 | 2017-11-10 | 天津天大求实电力新技术股份有限公司 | A kind of quick-searching Database Systems suitable for the planning of extensive power grid |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102750371B (en) | 2014-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103116661B (en) | A kind of data processing method of database | |
| CN103116596B (en) | System and method of performing snapshot isolation in distributed databases | |
| CN101334797B (en) | Distributed file systems and its data block consistency managing method | |
| CN102955845B (en) | Data access method, device and distributed data base system | |
| CN101997823B (en) | Distributed file system and data access method thereof | |
| Rao et al. | Performance issues of heterogeneous hadoop clusters in cloud computing | |
| CN104252485A (en) | Database management platform | |
| CN108848132B (en) | Power distribution scheduling main station system based on cloud | |
| CN102843418A (en) | Resource dispatching system | |
| CN103064927A (en) | Data access method and device of distributed file system | |
| CN104081354A (en) | Managing partitions in a scalable environment | |
| CN104081353A (en) | Dynamic load balancing in a scalable environment | |
| CN103491155A (en) | Cloud computing method and system for achieving mobile computing and obtaining mobile data | |
| CN108292235A (en) | Use the Network Attached Storage of selective resource migration | |
| CN105426427A (en) | MPP database cluster replica realization method based on RAID 0 storage | |
| CN105849715B (en) | Efficient resource in data center utilizes | |
| CN104270412A (en) | Three-level caching method based on Hadoop distributed file system | |
| CN112163039A (en) | Data resource standardization management system based on enterprise-level data middling analysis domain | |
| CN102750371B (en) | Parallel real-time database system and data management method thereof for power system | |
| CN106446268A (en) | Database lateral extension system and method | |
| CN105404565B (en) | A kind of dual-active data guard method and device | |
| CN106021593A (en) | Copying processing method in take-over process of first database and second database | |
| CN103023996A (en) | Cloud data storage system | |
| CN104484131A (en) | Device and corresponding method for processing data of multi-disk servers | |
| CN106056322A (en) | Smart grid scheduling system based on cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: STATE ELECTRIC NET CROP. Effective date: 20130424 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130424 Address after: 100192 Beijing city Haidian District Qinghe small Camp Road No. 15 Applicant after: China Electric Power Research Institute Applicant after: State Grid Corporation of China Address before: 100192 Beijing city Haidian District Qinghe small Camp Road No. 15 Applicant before: China Electric Power Research Institute |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |