CN102508881B - Method for clustering multiple nodes of memory database of power information system - Google Patents
Method for clustering multiple nodes of memory database of power information system Download PDFInfo
- Publication number
- CN102508881B CN102508881B CN201110316662.6A CN201110316662A CN102508881B CN 102508881 B CN102508881 B CN 102508881B CN 201110316662 A CN201110316662 A CN 201110316662A CN 102508881 B CN102508881 B CN 102508881B
- Authority
- CN
- China
- Prior art keywords
- service
- data
- node
- module
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title abstract description 9
- 238000004891 communication Methods 0.000 claims description 12
- 230000002688 persistence Effects 0.000 claims description 5
- 230000001360 synchronised effect Effects 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000007547 defect Effects 0.000 abstract 1
- 238000007726 management method Methods 0.000 description 12
- 238000012545 processing Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000013500 data storage Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000002195 synergetic effect Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a technology for clustering multiple nodes of a memory database of a power information system. Memory database server nodes are formed by encapsulating the memory database, and can coordinatively supply database service. A uniform access service interface is used for performing external services and simultaneously managing and scheduling the coordination and operation of the memory database nodes in a cluster. According to the technology, the defects of low access speed, instable memory database and the like of the conventional relational data are effectively overcome, and a high-efficiency and stable memory database cluster is realized. By utilizing the method, three modes of mutual backup, expansion and mutual backup and expansion are supported, so that the method is suitable for scenes with different demands.
Description
Technical field
The multinode Clustering that the present invention relates to a kind of memory database, is applied to power information system.
Background technology
Power information system generally all adopts traditional relevant database, traditional Relational DBMS is mainly emphasized the integrality of service data, consistance, stability, the general mode that adopts physical disk storage, due to disk access, the data transmission of interior external memory, buffer management, the delay of waiting in line and lock etc. makes database I/O can not meet the application demand of all kinds of real time data processings, if whole data base management system (DBMS) is put into internal memory, each affairs I/O is consumed and become extremely short, for high-speed data is processed and the application scenarios of storage provides strong support.
In order to guarantee the security of data, traditional Relational DBMS all adopts multinode trunking mode to guarantee multinode storage and the data security of data substantially.If Main Memory Database Management System also can be realized multinode clustered deploy(ment), can solve data backup and the safety problem of memory database.
The present invention has realized the memory database system that can support that multinode trunking mode is disposed, has improved greatly the ability of the high-speed data processing of database in the integrality, consistance and the stability that guarantee data.
Summary of the invention
The object of the invention is to the weakness existing for traditional relational data base management system (DBMS), a kind of high-speed internal memory data base cluster system of proposition.System is by the access interface service encapsulates of memory database is provided, and service end is by mutually standby clustered deploy(ment), guarantees data standby mutually of multinode, improve the security of data, service end, by expansion clustered deploy(ment), improves the capacity of internal memory in logic, eliminates the little storage constraint bringing of physical memory; The storage of data, management are all placed in internal memory, improve the I/O speed of database.
Service end of the present invention provides data initialization and physical disk persistent storage function for memory database, service end is regularly saved to the data in internal memory in disk with the form of file, the storage file of each memory database node is unified version information, the unloading phase of memory database, service end is carried out internal storage data initialization to the storage file of all memory database node service ends (comprising self node) request latest edition, guarantee that memory database starts integrality and the consistance of rear data, between the each node of run duration, carry out heartbeat synchronous, guarantee the timing synchronization of data.
Access interface service of the present invention is accessed for memory database cluster provides network ICP/IP protocol safety certification, when receiving connection request, access interface service and requesting party connect, carry out affairs and register backward service end and carry out request of data, access interface service is carried out node selection according to the affairs loading condition of the each node of cluster, and node is selected and issued transaction is undertaken by mutually standby cluster and two kinds of patterns of expansion cluster:
1. mutually standby cluster mode
Mutually standby cluster need to guarantee integrality and the consistance of multinode data, and access interface service is divided into two classes according to the feature of affairs and processes:
(1) inquiry transaction
Access interface service distributes inquiry transaction according to the affairs situation of enlivening of each node according to enlivening the minimum principle of affairs;
(2) revise affairs
Revise affairs and generally comprise newly-increased data, Update Table and three kinds of situations of deletion data, access interface service is distributed to all memory database nodes by data modification affairs and synchronously processes, as node affairs are wherein carried out unsuccessfully, all nodes all carry out transaction rollback, to guarantee data consistency.
2. expansion cluster mode
Expansion cluster need to be expanded the capacity of physical memory in logic, the internal memory of all nodes residue situation in access interface service registration cluster, according to the priority distribute data storage of each node configuration, access interface service is divided into two class affairs according to the feature of expansion cluster mode and processes:
(1) data query, modification, deletion affairs
Access interface service is sent to by data query affairs the service end that has data in clustered node and processes, and returning results of all node service ends is merged to rear unification and return to requesting party;
(2) the newly-increased affairs of data
Access interface service is according to the internal memory residue situation of registered all clustered nodes, newly-increased data affairs submitted to priority the highest and still have the node of free memory.
3. mix cluster mode
Access interface service is carried out node grouping according to configured clustered node pattern, and the mutually standby clustered node group after combination and superset group node group realize mixes cluster mode.
Accompanying drawing explanation
Fig. 1. service end modular structure figure of the present invention;
Fig. 2. service end cluster relation structure diagram of the present invention;
Fig. 3. access interface service module structural drawing of the present invention;
Fig. 4. service end processing flow chart of the present invention;
Fig. 5. the mutually standby cluster mode processing flow chart of access interface service of the present invention;
Fig. 6. access interface service extension cluster mode processing flow chart of the present invention;
Fig. 7. the mutually standby cluster mode deployment architecture figure of the present invention;
Fig. 8. the present invention expands cluster mode deployment architecture figure;
Fig. 9. the present invention's mixing cluster mode deployment architecture figure.
Embodiment
Below in conjunction with accompanying drawing, the realization of memory database multinode cluster of the present invention is described further.
Figure 1 shows that service end modular structure figure, service end is made up of communication interface modules, synthetic operation service, data, services, management and running service, memory database and data this several parts of filing.Communication interface modules mainly completes network service and instruction parsing work.Synthetic operation service mainly completes collaborative with other nodes, comprises that task cooperation and data collaborative and sequential are collaborative.Task cooperation mainly comprises that result that the data, services that provides identical, identical data persistence operation and instruction carry out is collaborative etc.; The synchronous synergetic of the versions of data of each node when data collaborative mainly completes internal storage data library initialization, collaborative operation heartbeat, instruction sequencing and the time synchronized that mainly completes each node of sequential.Data, services and management and running service mainly provides the data I/O service of database and completes the management role such as backup persistence of database under the management of synthetic operation service.
Fig. 2 is under multinode cluster mode, the relational structure schematic diagram of the each module of service end, and each node carries out real-time physical communication by communication interface, the cluster operation of all service ends of synthetic operation service logic control.
Fig. 3 is access interface service module structural drawing of the present invention, and access interface service is made up of correspondence with foreign country service, task manager, SQL resolver, policy manager, node manager, clustered node communication service.The services request of response request side is responsible in correspondence with foreign country service, task manager is responsible for requesting party's built vertical affairs to carry out registration and management, the SQL literary composition that SQL resolver is responsible for requesting party to submit to is resolved, policy manager carries out according to the current running status of all nodes in cluster node is selected and instruction issues strategy customization, node manager is responsible for the current information of all nodes in cluster to carry out registration and management, clustered node communication service be responsible for and cluster in all nodes communicate.
Fig. 4 is the startup flow process of service end of the present invention, first service end starts built-in memory database, the information of live-vertex in node manager after completing in service end queried access interface service, and send versions of data request to all live-vertexs, comparing up-to-date data files, read latest edition data in cluster by data, services and file to carry out memory database data initialization, after completing, service end continues to start the data, services that management and running service is carried out regular data persistence task and provided memory database data I/O to serve, finally come and other node cooperative works by starting synthetic operation service, when after the normal startup of all services of service end, service end is to this nodal information of access interface service registry, to represent that this node has possessed conditions of service.
Fig. 5,6 is access interface service of the present invention standby and expansion cluster mode treatment flow process mutually, the emphasis that the mutual key distinction standby and mode of extension is mutually standby pattern need to guarantee the consistance of data, and therefore the emphasis of the inquiry of divided data and two kinds of processing policies of modification, mode of extension is the extendability that need to guarantee data storage.Therefore divided data storage application (data update) and two kinds of processing policies of non-data storage application.
Fig. 7 is the mutually standby cluster mode deployment architecture figure of the present invention, mutual communication coordinated between all nodes, and access interface service distributes inquiry transaction according to the loading condition of each node, at the bottom of the high node of load distributes the priority of affairs.
Fig. 8 is that the present invention expands cluster mode deployment architecture figure, a more jumbo memory database service of the collaborative composition of all nodes, and access interface service is inserted affairs according to the memory priority level of each node and storage condition distribute data.
Fig. 9 is the present invention's mixing cluster mode deployment architecture figure, and this pattern is in conjunction with the advantage of mutually standby pattern and mode of extension, and the inner expansion cluster mode that adopts of expanding node group, adopts mutually standby cluster mode between expanding node group.
Claims (1)
1. a multinode group system for power information system memory database, is characterized in that: this group system is made up of access interface service module and database service end module, wherein:
Access interface service module is by correspondence with foreign country service module, task manager, SQL resolver, policy manager, node manager, clustered node communication service module composition, correspondence with foreign country service module and requesting party set up network service, what task manager pair had established with requesting party be connected affairs carries out registration and management, the SQL that SQL resolver is submitted to requesting party resolves, policy manager is determined cluster and the node usage policy of clustered node, three kinds of cluster modes are provided, node manager is responsible for the operation to node in cluster, storage information is carried out registration and management, clustered node communication service module be responsible for cluster in node carry out network service,
Database service end module is filed and is formed by module communication interface module, synthetic operation service module, data service module, management and running service module, memory database and data, communication interface modules be responsible for communicating by letter with access interface service module and and other node database service end module communications, synthetic operation service module for other node synthetic operation service modules between operation collaborative and move heartbeat and time synchronized, realization control data service module and management and running service module in multiple node synthetic operations; The provide support memory database service of stsndard SQL access of data service module, during management and running service module is responsible for regularly data persistence in memory database being filed to data, database service end module provides standby, expansion mutually, mixes the data-base cluster service of three kinds of patterns; Described mutually standby cluster mode, refers to that the low clustered node of load provides data query service, and Data Update action need is carried out at all clustered nodes; Expansion cluster mode, refers to that data update only carries out in having the highest memory priority level and having the clustered node of enough storage spaces, and other action needs are carried out at all clustered nodes; Mixing cluster mode is comprehensive standby a kind of pattern with expanding two kinds of patterns mutually, and it forms superset group node group by multiple clustered nodes according to mode of extension, adopts mutually for cluster mode between multiple superset group node groups;
When database service end module starts, first start memory database, the information of live-vertex in node manager after completing in database service end module queried access interface service module, and send versions of data request to all live-vertexs, comparing up-to-date data files, read the data of latest edition in group system and file to carry out the data initialization of memory database by data service module, after completing, database service end module continues to start the data, services that management and running service module carries out regular data persistence task and the data I/O service of memory database is provided, finally come and other node cooperative works by starting synthetic operation service module, when after the normal startup of all services of database service end module, database service end module is registered this nodal information to access interface service module, to represent that this node has possessed conditions of service.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110316662.6A CN102508881B (en) | 2011-10-18 | 2011-10-18 | Method for clustering multiple nodes of memory database of power information system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110316662.6A CN102508881B (en) | 2011-10-18 | 2011-10-18 | Method for clustering multiple nodes of memory database of power information system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102508881A CN102508881A (en) | 2012-06-20 |
| CN102508881B true CN102508881B (en) | 2014-07-02 |
Family
ID=46220967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110316662.6A Active CN102508881B (en) | 2011-10-18 | 2011-10-18 | Method for clustering multiple nodes of memory database of power information system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102508881B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104424275A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Database system and data synchronization method |
| CN105389284B (en) * | 2015-12-22 | 2018-05-29 | 新疆信息产业有限责任公司 | Electric power industry power trade multinode information intelligent transfer device and its application method |
| CN107977417A (en) * | 2017-11-22 | 2018-05-01 | 江苏翼企云通信科技有限公司 | A kind of ultralight amount framework method accessed towards big data content high frequency |
| CN110019345A (en) * | 2017-12-28 | 2019-07-16 | 北京京东尚科信息技术有限公司 | Data processing method, device, system and medium |
| CN110096596B (en) * | 2019-05-08 | 2023-05-05 | 广东工业大学 | Multi-view text clustering method, device and equipment based on concept decomposition |
| CN113127557B (en) * | 2019-12-31 | 2022-12-13 | 中国移动通信集团四川有限公司 | Data persistence method and device based on redis performance and electronic equipment |
| CN111367950B (en) * | 2020-02-28 | 2023-08-08 | 上海欣巴自动化科技股份有限公司 | Distributed AGV scheduling system and scheduling method based on Kubernetes |
| CN113157808B (en) * | 2021-04-27 | 2023-02-03 | 北京计算机技术及应用研究所 | Configuration file synchronization system and method based on memory and lightweight database |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102142008A (en) * | 2010-12-02 | 2011-08-03 | 华为技术有限公司 | Method and system for implementing distributed memory database, token controller and memory database |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8892558B2 (en) * | 2007-09-26 | 2014-11-18 | International Business Machines Corporation | Inserting data into an in-memory distributed nodal database |
-
2011
- 2011-10-18 CN CN201110316662.6A patent/CN102508881B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102142008A (en) * | 2010-12-02 | 2011-08-03 | 华为技术有限公司 | Method and system for implementing distributed memory database, token controller and memory database |
Non-Patent Citations (2)
| Title |
|---|
| 基于读写任务分发的数据库集群服务器的实现;孙婷婷等;《电脑知识与技术》;20090331;第5卷(第7期);第1541-1543页 * |
| 孙婷婷等.基于读写任务分发的数据库集群服务器的实现.《电脑知识与技术》.2009,第5卷(第7期),第1541-1543页. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102508881A (en) | 2012-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102508881B (en) | Method for clustering multiple nodes of memory database of power information system | |
| WO2019080335A1 (en) | Method for micro-service transformation of electricity trading function | |
| US11068499B2 (en) | Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching | |
| CN102075580A (en) | Method and system for storing synchronous data in distributive network equipment | |
| WO2014135011A1 (en) | Database system and data synchronization method | |
| CN109639773A (en) | A kind of the distributed data cluster control system and its method of dynamic construction | |
| CN105353988A (en) | Metadata reading and writing method and device | |
| CN103428288B (en) | Based on the copies synchronized method of subregion state table and coordinator node | |
| CN111240737B (en) | Redis-based dynamic service parameter configuration method | |
| CN109361777A (en) | Synchronous method, synchronization system and the relevant apparatus of distributed type assemblies node state | |
| CN101252464B (en) | Dual system and dual system online upgrading method | |
| CN102651696B (en) | The method and system that a kind of network management system interface coexisted to multi version is managed | |
| CN112783694B (en) | Long-distance disaster recovery method for high-availability Redis | |
| CN101610225B (en) | Method, system and device for synchronous processing | |
| CN113297159A (en) | Data storage method and device | |
| CN101201769B (en) | Synchronous system and method for multiple equipment document | |
| CN104052799A (en) | Method for achieving high availability storage through resource rings | |
| CN101751292B (en) | Method for realizing consistency function of multimachine core data in ATC (automatic timing corrector) system | |
| CN112667440A (en) | Long-distance disaster recovery method for high-availability MySQL | |
| CN103780433A (en) | Self-healing type virtual resource configuration management data architecture | |
| CN111124293B (en) | Partial replication method in address space conversion algorithm | |
| CN102999463B (en) | A kind of method of power distribution network interexchange bus plug and play | |
| CN103152380A (en) | Distributed type simulation communication framework and communication effectiveness calculating method | |
| Stage | Synchronization and replication in the context of mobile applications | |
| de Juan-Marín et al. | Recovery strategies for linear replication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: NANJING NARI CO., LTD. STATE ELECTRIC NET CROP. Free format text: FORMER OWNER: NANJING NARI CO., LTD. Effective date: 20130206 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130206 Address after: Nan Shui Road Gulou District of Nanjing city of Jiangsu Province, No. 8 210003 Applicant after: State Grid Electric Power Research Insititute Applicant after: Nanjing Nari Co., Ltd. Applicant after: State Grid Corporation of China Address before: Nan Shui Road Gulou District of Nanjing city of Jiangsu Province, No. 8 210003 Applicant before: State Grid Electric Power Research Insititute Applicant before: Nanjing Nari Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20171116 Address after: 211106 Jiangning City, Nanjing Province, the integrity of the road No. 19, Co-patentee after: NARI Technology Development Co., Ltd. Patentee after: State Grid Electric Power Research Insititute Co-patentee after: State Grid Corporation of China Address before: Nan Shui Road Gulou District of Nanjing city of Jiangsu Province, No. 8 210003 Co-patentee before: Nanjing Nari Co., Ltd. Patentee before: State Grid Electric Power Research Insititute Co-patentee before: State Grid Corporation of China |