CN102508881A - Method for clustering multiple nodes of memory database of power information system - Google Patents
Method for clustering multiple nodes of memory database of power information system Download PDFInfo
- Publication number
- CN102508881A CN102508881A CN2011103166626A CN201110316662A CN102508881A CN 102508881 A CN102508881 A CN 102508881A CN 2011103166626 A CN2011103166626 A CN 2011103166626A CN 201110316662 A CN201110316662 A CN 201110316662A CN 102508881 A CN102508881 A CN 102508881A
- Authority
- CN
- China
- Prior art keywords
- service
- node
- data
- cluster
- memory database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a technology for clustering multiple nodes of a memory database of a power information system. Memory database server nodes are formed by encapsulating the memory database, and can coordinatively supply database service. A uniform access service interface is used for performing external services and simultaneously managing and scheduling the coordination and operation of the memory database nodes in a cluster. According to the technology, the defects of low access speed, instable memory database and the like of the conventional relational data are effectively overcome, and a high-efficiency and stable memory database cluster is realized. By utilizing the method, three modes of mutual backup, expansion and mutual backup and expansion are supported, so that the method is suitable for scenes with different demands.
Description
Technical field
The present invention relates to a kind of multinode Clustering of memory database, be applied to power information system.
Background technology
Power information system generally all adopts traditional relevant database; Traditional Relational DBMS is mainly stressed integrality, consistance, the stability of service data; The general mode that adopts the physical disk storage; Owing to data transfer, the buffer management of disk access, interior external memory, wait in line and the delay of locking etc. makes database I/O can not satisfy the application demand of all kinds of real time data processings; If the entire database management system is put into internal memory, each affairs I/O is consumed become extremely short, the application scenarios of then handling and storing for high-speed data provides strong support.
In order to guarantee safety of data, traditional Relational DBMS all adopts the multinode trunking mode to guarantee the multinode storage and the data security of data basically.If the main memory DBM system also can realize the multinode clustered deploy(ment), then can solve the data backup and the safety problem of memory database.
The present invention has realized supporting the memory database system of multinode trunking mode deployment, in the integrality that guarantees data, consistance and stability, has improved the high-speed data ability of processing of database greatly.
Summary of the invention
The objective of the invention is to weakness, a kind of high-speed internal memory data-base cluster method of proposition to the existence of traditional relational data base management system (DBMS).System is through providing the access interface service encapsulates of memory database, and service end guarantees that through being equipped with clustered deploy(ment) mutually the mutual of data of multinode is equipped with; Improve safety of data; Service end improves the capacity of internal memory in logic through the expansion clustered deploy(ment), eliminates the storage constraint that physical memory brings for a short time; Storage, the management of data all are placed in the internal memory, improve the I/O speed of database.
Service end of the present invention is that memory database provides data initialization and physical disk persistent storage function; Service end regularly is saved to the form of the data in the internal memory with file in the disk; The storage file of each memory database node is unified version information; The unloading phase of memory database, service end is carried out the internal storage data initialization to the storage file of all memory database node service end (comprising self node) request latest editions, guarantees that memory database starts the integrality and the consistance of back data; It is synchronous to carry out heartbeat between each node of run duration, guarantees that the sequential of data is synchronous.
Access interface service of the present invention provides the visit of network ICP/IP protocol safety certification for the memory database cluster; When receiving connection request; Access interface service and requesting party connect, carry out affairs registration back and carry out request of data to service end; The access interface service is carried out the node selection according to the affairs loading condition of each node of cluster, and node selection and issued transaction are by being equipped with cluster mutually and expanding two kinds of patterns of cluster and carry out:
1. be equipped with cluster mode mutually
Be equipped with mutually integrality and the uniformity that cluster need guarantee the multinode data, the access interface service is divided into two types based on the characteristics of affairs and handles:
(1) inquiry transaction
The access interface service distributes inquiry transaction according to the affairs situation of enlivening of each node according to enlivening the minimum principle of affairs;
(2) revise affairs
Revising affairs generally comprises newly-increased data, revises data and three kinds of situation of deleted data; The access interface service is distributed to all memory database nodes with the data modification affairs and carries out synchronous processing; As wherein node affairs are carried out failure; All nodes all carry out transaction rollback, to guarantee data consistency.
2. expansion cluster mode
The expansion cluster need be expanded the capacity of physical memory in logic; The internal memory of all nodes residue situation in the access interface service registration cluster; According to the priority data storage of each node configuration, the access interface service is divided into two types of affairs according to the characteristics of expanding cluster mode and handles:
(1) data query, modification, deletion affairs
The access interface service is sent to the service end that has data in the clustered node with the data query affairs and handles, and the return results of all node service ends is merged the back is unified to return to the requesting party;
(2) the newly-increased affairs of data
Access interface service is according to the internal memory residue situation of registered all clustered nodes, and it is the highest and still have the node of free memory that the newly-increased affairs of data are submitted to priority.
3. mixing cluster mode
The access interface service is carried out node grouping according to the clustered node pattern that is disposed, and be equipped with mutually clustered node group and superset group node group after the combination realize mixing cluster mode.
Description of drawings
Fig. 1. service end modular structure figure of the present invention;
Fig. 2. service end cluster relation structure diagram of the present invention;
Fig. 3. access interface service module structural drawing of the present invention;
Fig. 4. service end processing flow chart of the present invention;
Fig. 5. access interface service of the present invention is equipped with the cluster mode processing flow chart mutually;
Fig. 6. access interface service extension cluster mode processing flow chart of the present invention;
Fig. 7. the present invention is equipped with cluster mode deployment architecture figure mutually;
Fig. 8. the present invention expands cluster mode deployment architecture figure;
Fig. 9. the present invention's mixing cluster mode deployment architecture figure.
Embodiment
Below in conjunction with accompanying drawing, the realization of memory database multinode cluster of the present invention is further specified.
Shown in Figure 1 is service end modular structure figure, and service end is made up of these several parts of communication interface modules, synthetic operation service, data, services, management and running service, memory database and data archiving.Communication interface modules is mainly accomplished network service and instruction parsing work.The main completion of synthetic operation service is collaborative with other nodes, comprises that task cooperation and data collaborative and sequential are collaborative.Task cooperation comprises that mainly result that the data, services that provides identical, identical data persistence operation and instruction carry out is collaborative etc.; The synchronous synergetic of the versions of data of each node when data collaborative is mainly accomplished the internal storage data library initialization, collaborative main operation heartbeat, instruction sequencing and the time synchronized of accomplishing each node of sequential.Data, services and management and running service mainly provide management roles such as data of database I/O service and completion Database Backup persistence under the management of synthetic operation service.
Fig. 2 is under the multinode cluster mode, the relational structure synoptic diagram of each module of service end, and each node carries out real-time physical communication through communication interface, the cluster operation of all service ends of synthetic operation service logic control.
Fig. 3 is an access interface service module structural drawing of the present invention, and the access interface service is made up of correspondence with foreign country service, task manager, SQL resolver, policy manager, node manager, clustered node communication service.The services request of response request side is responsible in the correspondence with foreign country service; Task manager is responsible for requesting party's the affairs of setting up are carried out registration and management; The SQL resolver is responsible for the SQL literary composition that the requesting party submits to is resolved; Policy manager carries out node is selected and instruction issues strategy customization, node manager according to the current running status of all nodes in the cluster to be responsible for the current information of all nodes in the cluster is carried out registration and management, the clustered node communication service be responsible for cluster in all nodes communicate.
Fig. 4 is the startup flow process of service end of the present invention; At first service end start built-in memory database, accomplish after the information of live-vertex in the node manager in the service end queried access interface service; And to all live-vertexs transmission versions of data requests, the up-to-date data archiving of comparison; Through data, services read latest edition data archiving in the cluster carry out the memory database data initialization, accomplish the back service end continue to start the management and running service carry out regular data persistence task and provide the data, services of memory database data I/O service, at last through start that the synthetic operation service comes and other node cooperative works, after the normal startup of all services of service end; Service end has possessed conditions of service to this nodal information of access interface service registry to represent this node.
Fig. 5,6 is equipped with for access interface service of the present invention is mutual and expansion cluster mode treatment flow process; Be equipped with mutually the key distinction with mode of extension and be the consistance that the emphasis that is equipped with pattern mutually need guarantee data, so the inquiry of divided data and the emphasis of revising two kinds of processing policies, mode of extension are the extendabilities that needs the assurance data storage.Therefore divided data storage application (data are inserted and operated) and two kinds of processing policies of non-data storage application.
Fig. 7 is equipped with cluster mode deployment architecture figure mutually for the present invention, mutual communication coordinated between all nodes, and the access interface service distributes inquiry transaction according to the loading condition of each node, and the high node of load distributes at the bottom of the priority of affairs.
Fig. 8 expands cluster mode deployment architecture figure for the present invention, more jumbo memory database service of the collaborative composition of all nodes, and the access interface service is inserted affairs according to the memory priority level and the storage condition distribute data of each node.
Fig. 9 is the present invention's mixing cluster mode deployment architecture figure, and this pattern is in conjunction with the advantage that is equipped with pattern and mode of extension mutually, and the inner expansion cluster mode that adopts of expanding node group adopts between the expanding node group to be equipped with cluster mode mutually.
Claims (4)
1. the multinode cluster method of a power information system memory database, it is characterized in that: this Clustering is made up of access interface service and database service end two parts software; Wherein, The access interface service software provides external network connection, transaction response management, node visit tactical management and node operational management function; Database service end software comprises a memory database and data are filed; And a cover management software, management software carries out management and running, provides mutually fully, expands, mixes three kinds of mode database cluster service with the database service end synthetic operation of other nodes memory database and data archiving.
2. the multinode cluster method of a kind of power information system memory database according to claim 1 is characterized in that: the access interface service software is made up of correspondence with foreign country service module, task manager, SQL resolver, policy manager, node manager, clustered node communication service; Correspondence with foreign country service module and requesting party set up network service; Task manager pair carries out registration and management with the affairs that are connected that the requesting party has set up; The SQL resolver is resolved the SQL that the requesting party submits to, and policy manager is confirmed the cluster and the node usage policy of clustered node, and three kinds of cluster modes are provided; Node manager is responsible for operation, the canned data of node in the cluster are carried out registration and management, the clustered node communication service be responsible for cluster in node carry out network service.
3. the multinode cluster method of a kind of power information system memory database according to claim 1; It is characterized in that, it is characterized in that: database service end software is made up of communication interface modules, synthetic operation service module, data service module, management and running service module, memory database and data archiving; Communication interface modules is responsible for and access interface service software and other node database service end software communications; The synthetic operation service module be used for and other node synthetic operation service modules between operation collaborative and operation heartbeat and time synchronized, realize control data service and the synthetic operation in a plurality of nodes of management and running service module; The provide support memory database service of standard SQL visit of data service module, management and running service module are responsible for regularly data persistence in the memory database in data archiving.
4. according to the multinode cluster method of the said a kind of power information system memory database of claim 1, it is characterized in that: be equipped with under the cluster mode mutually, the low clustered node of load provides the data query service, and the Data Update action need is carried out at all clustered nodes; Under the expansion cluster mode, data are inserted operation and are only carried out having the highest memory priority level and have in the clustered node of enough storage spaces, and other action needs are carried out at all clustered nodes; Mixing cluster is the comprehensive a kind of pattern that is equipped with and expands two kinds of patterns mutually, and it forms superset group node group with a plurality of clustered nodes according to mode of extension, adopts between a plurality of superset group node groups to be equipped with cluster mode mutually.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110316662.6A CN102508881B (en) | 2011-10-18 | 2011-10-18 | Method for clustering multiple nodes of memory database of power information system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110316662.6A CN102508881B (en) | 2011-10-18 | 2011-10-18 | Method for clustering multiple nodes of memory database of power information system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102508881A true CN102508881A (en) | 2012-06-20 |
| CN102508881B CN102508881B (en) | 2014-07-02 |
Family
ID=46220967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110316662.6A Active CN102508881B (en) | 2011-10-18 | 2011-10-18 | Method for clustering multiple nodes of memory database of power information system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102508881B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104424275A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Database system and data synchronization method |
| CN105389284A (en) * | 2015-12-22 | 2016-03-09 | 新疆信息产业有限责任公司 | Intelligent transfer device for multi-node information of electric power transaction in the electric power industry and use method thereof |
| CN107977417A (en) * | 2017-11-22 | 2018-05-01 | 江苏翼企云通信科技有限公司 | A kind of ultralight amount framework method accessed towards big data content high frequency |
| CN110019345A (en) * | 2017-12-28 | 2019-07-16 | 北京京东尚科信息技术有限公司 | Data processing method, device, system and medium |
| CN110096596A (en) * | 2019-05-08 | 2019-08-06 | 广东工业大学 | A kind of multiple view Text Clustering Method, device and equipment based on concept separating |
| CN111367950A (en) * | 2020-02-28 | 2020-07-03 | 上海欣巴自动化科技股份有限公司 | Kubernetes-based distributed AGV (automatic guided vehicle) scheduling system and scheduling method |
| CN113127557A (en) * | 2019-12-31 | 2021-07-16 | 中国移动通信集团四川有限公司 | Data persistence method and device based on redis performance and electronic equipment |
| CN113157808A (en) * | 2021-04-27 | 2021-07-23 | 北京计算机技术及应用研究所 | Configuration file synchronization system and method based on memory and lightweight database |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090083276A1 (en) * | 2007-09-26 | 2009-03-26 | Barsness Eric L | Inserting data into an in-memory distributed nodal database |
| CN102142008A (en) * | 2010-12-02 | 2011-08-03 | 华为技术有限公司 | Method and system for implementing distributed memory database, token controller and memory database |
-
2011
- 2011-10-18 CN CN201110316662.6A patent/CN102508881B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090083276A1 (en) * | 2007-09-26 | 2009-03-26 | Barsness Eric L | Inserting data into an in-memory distributed nodal database |
| CN102142008A (en) * | 2010-12-02 | 2011-08-03 | 华为技术有限公司 | Method and system for implementing distributed memory database, token controller and memory database |
Non-Patent Citations (1)
| Title |
|---|
| 孙婷婷等: "基于读写任务分发的数据库集群服务器的实现", 《电脑知识与技术》, vol. 5, no. 7, 31 March 2009 (2009-03-31), pages 1541 - 1543 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104424275A (en) * | 2013-08-29 | 2015-03-18 | 中兴通讯股份有限公司 | Database system and data synchronization method |
| CN105389284A (en) * | 2015-12-22 | 2016-03-09 | 新疆信息产业有限责任公司 | Intelligent transfer device for multi-node information of electric power transaction in the electric power industry and use method thereof |
| CN105389284B (en) * | 2015-12-22 | 2018-05-29 | 新疆信息产业有限责任公司 | Electric power industry power trade multinode information intelligent transfer device and its application method |
| CN107977417A (en) * | 2017-11-22 | 2018-05-01 | 江苏翼企云通信科技有限公司 | A kind of ultralight amount framework method accessed towards big data content high frequency |
| CN110019345A (en) * | 2017-12-28 | 2019-07-16 | 北京京东尚科信息技术有限公司 | Data processing method, device, system and medium |
| CN110096596A (en) * | 2019-05-08 | 2019-08-06 | 广东工业大学 | A kind of multiple view Text Clustering Method, device and equipment based on concept separating |
| CN113127557A (en) * | 2019-12-31 | 2021-07-16 | 中国移动通信集团四川有限公司 | Data persistence method and device based on redis performance and electronic equipment |
| CN113127557B (en) * | 2019-12-31 | 2022-12-13 | 中国移动通信集团四川有限公司 | Data persistence method and device based on redis performance and electronic equipment |
| CN111367950A (en) * | 2020-02-28 | 2020-07-03 | 上海欣巴自动化科技股份有限公司 | Kubernetes-based distributed AGV (automatic guided vehicle) scheduling system and scheduling method |
| CN111367950B (en) * | 2020-02-28 | 2023-08-08 | 上海欣巴自动化科技股份有限公司 | Distributed AGV scheduling system and scheduling method based on Kubernetes |
| CN113157808A (en) * | 2021-04-27 | 2021-07-23 | 北京计算机技术及应用研究所 | Configuration file synchronization system and method based on memory and lightweight database |
| CN113157808B (en) * | 2021-04-27 | 2023-02-03 | 北京计算机技术及应用研究所 | Configuration file synchronization system and method based on memory and lightweight database |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102508881B (en) | 2014-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102508881A (en) | Method for clustering multiple nodes of memory database of power information system | |
| CN101751415B (en) | Metadata service system, metadata synchronized method and writing server updating method | |
| US11068499B2 (en) | Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching | |
| CN104376062A (en) | Heterogeneous database platform data synchronization method | |
| CN104239439A (en) | Selective database replication | |
| CN102201010A (en) | Distributed database system without sharing structure and realizing method thereof | |
| CN102025550A (en) | System and method for managing data in distributed cluster | |
| US10498854B2 (en) | Method and controller for clustering applications in a software-defined network | |
| CN109639773A (en) | A kind of the distributed data cluster control system and its method of dynamic construction | |
| CN113315710A (en) | Middle station API gateway management configuration and extension method based on asynchronous dynamic routing | |
| CN102937964A (en) | Intelligent data service method based on distributed system | |
| WO2014135011A1 (en) | Database system and data synchronization method | |
| CN103428288B (en) | Based on the copies synchronized method of subregion state table and coordinator node | |
| CN110764918A (en) | Method for managing main nodes in container cluster | |
| CN103546572A (en) | Cloud storage device and multi-cloud storage networking system and method | |
| CN101344882B (en) | Data query method, insertion method and deletion method | |
| CN101997726A (en) | Method and device for storing and managing telecommunication network user data | |
| CN101610225B (en) | Method, system and device for synchronous processing | |
| CN101751292B (en) | Method for realizing consistency function of multimachine core data in ATC (automatic timing corrector) system | |
| CN105723365A (en) | Method for optimizing index, master database node and subscriber database node | |
| CN103281383A (en) | Timing sequence recording method for distributed-type data source | |
| CN110850956B (en) | Distributed operation cluster dynamic energy consumption management method based on data coverage set | |
| CN102999463B (en) | A kind of method of power distribution network interexchange bus plug and play | |
| CN112966047B (en) | Method for realizing table copying function based on distributed database | |
| KR20050026306A (en) | Shared-nothing database cluster server system and on-line scaling method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: NANJING NARI CO., LTD. STATE ELECTRIC NET CROP. Free format text: FORMER OWNER: NANJING NARI CO., LTD. Effective date: 20130206 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130206 Address after: Nan Shui Road Gulou District of Nanjing city of Jiangsu Province, No. 8 210003 Applicant after: State Grid Electric Power Research Insititute Applicant after: Nanjing Nari Co., Ltd. Applicant after: State Grid Corporation of China Address before: Nan Shui Road Gulou District of Nanjing city of Jiangsu Province, No. 8 210003 Applicant before: State Grid Electric Power Research Insititute Applicant before: Nanjing Nari Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20171116 Address after: 211106 Jiangning City, Nanjing Province, the integrity of the road No. 19, Co-patentee after: NARI Technology Development Co., Ltd. Patentee after: State Grid Electric Power Research Insititute Co-patentee after: State Grid Corporation of China Address before: Nan Shui Road Gulou District of Nanjing city of Jiangsu Province, No. 8 210003 Co-patentee before: Nanjing Nari Co., Ltd. Patentee before: State Grid Electric Power Research Insititute Co-patentee before: State Grid Corporation of China |