CN109639773B - Dynamically constructed distributed data cluster control system and method thereof - Google Patents

Dynamically constructed distributed data cluster control system and method thereof Download PDF

Info

Publication number
CN109639773B
CN109639773B CN201811417178.0A CN201811417178A CN109639773B CN 109639773 B CN109639773 B CN 109639773B CN 201811417178 A CN201811417178 A CN 201811417178A CN 109639773 B CN109639773 B CN 109639773B
Authority
CN
China
Prior art keywords
data
node
cluster
service
nodes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811417178.0A
Other languages
Chinese (zh)
Other versions
CN109639773A (en
Inventor
胡前进
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
716th Research Institute of CSIC
Original Assignee
716th Research Institute of CSIC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 716th Research Institute of CSIC filed Critical 716th Research Institute of CSIC
Priority to CN201811417178.0A priority Critical patent/CN109639773B/en
Publication of CN109639773A publication Critical patent/CN109639773A/en
Application granted granted Critical
Publication of CN109639773B publication Critical patent/CN109639773B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0654Management of faults, events, alarms or notifications using network fault recovery
    • H04L41/0659Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a dynamically constructed distributed data cluster control system and a method thereof. According to the method, the data are submitted to the database together, the central main node immediately informs other nodes to update the data, and the update of the nodes is sent to the central node when the transaction is submitted, so that the low-delay index of data synchronization and the timeliness index of data update are improved, and data conflict is avoided. The invention can provide dynamically configurable data node addition and removal, and performs data management service on the data nodes through the client device and the server device, thereby improving the processing efficiency and level of distributed data, ensuring the data consistency among the data nodes and providing low-delay service for data reading and writing. The invention can solve the problems of dynamic construction of distributed data clusters, large data synchronization data volume and the like in the scenes of data consistency and low data synchronization delay.

Description

Dynamically constructed distributed data cluster control system and method thereof
Technical Field
The invention belongs to the field of distributed control systems, and particularly relates to a dynamically constructed distributed data cluster control system and a method thereof.
Background
At present, with the development of technologies such as big data technology, cloud technology, artificial intelligence and the like, the data volume is larger and larger, and the storage and processing of data are concerned more. In order to better provide system services and data processing, distributed clustering becomes a better technical architecture and implementation scheme. The distributed cluster provides support for data distribution, local caching, copy redundancy backup, fault tolerance, transaction, concurrency control and the like for system application, ensures data consistency in the processes of data migration, fault tolerance and concurrent reading and writing, and simultaneously provides storage access support and data synchronization of a remote central database for the application. At present, under the condition that the existing distributed cluster can not provide stable data service scenes, the distributed data cluster is dynamically constructed, dynamic addition and dynamic removal of data nodes are realized, and the flexibility of the distributed cluster data service is reduced. Meanwhile, with the high concurrency characteristic of a data service scene, how to improve the low delay index of the data service also becomes an important research direction in the field of distributed clusters at present.
The following 2 problems exist in the current distributed cluster in specific application:
(1) how to dynamically construct a distributed data cluster and ensure the consistency of data. The dynamic establishment of the distributed data cluster is composed of two conditions of newly adding a data node and removing a fault data node, and on the basis of ensuring that the existing data node provides stable and reliable service, the dynamic establishment of the new data cluster by adopting which strategy is one of important research directions in the current distributed field.
(2) The method and the device solve the problems that under the scenes that the number of distributed data cluster data nodes is large and the data communication traffic is large, the communication efficiency among the data nodes is improved, the data synchronization efficiency is improved, and the data management meets the requirement of low delay.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a dynamically constructed distributed data cluster control system and a method thereof, wherein the system can provide dynamically configurable data node addition and removal, ensure the data consistency among data nodes and provide low-delay service for data reading and writing.
The technical solution for realizing the purpose of the invention is as follows: a dynamically constructed distributed data cluster control system comprises a server device, a management device and N client devices, wherein the server device is simultaneously connected with the client devices and the management device; the server device comprises a plurality of service data node instances, all the service data node instances form a service node cluster, each service data node instance is called a service node, one service node serves as a central main node of the service node cluster, and the rest service nodes are data slave nodes;
the server device is used for analyzing and loading the network and basic configuration information of the distributed data cluster nodes;
the management end device provides an interface for managing the distributed data cluster for a user, and the user can inquire the state and data information of the distributed data cluster through a query language and can initialize data and update the data; the cluster state is that the service node works normally or fails;
and the client device is used for inquiring the central main node, establishing connection and executing data synchronization and data updating operation.
A dynamically constructed distributed data cluster control method based on the system comprises the following steps:
step 1, a user analyzes configuration information of a distributed data cluster through a server device; the method specifically comprises cluster node configuration information, cluster node network configuration information, data storage configuration information and log record configuration information;
step 2, running distributed data cluster nodes with parameters, and orderly adding newly added nodes into a cluster data queue one by one;
step 3, sequencing the service nodes into an ordered ring according to the size of the Hash value of each service node in the server device; then, each service node is connected with the right side node which is closest to the service node and normally works to form a stable ordered closed loop, and a dynamic distributed data cluster is constructed;
step 4, the management end device establishes connection with the server end device;
step 5, comparing the data versions of the management end device and the server end device, and if the data version of the server end device is newer than the data version of the management end device, executing data synchronization operation to update the data version of the management end device;
step 6, the management end device cannot acquire the data version of the server end device, namely the distributed data cluster of the server end device is shown as a newly constructed cluster, and the database table structure of the management end device initializes the data of the server end device;
step 7, the client device establishes connection with the server device for communication, and acquires a central main node for connection; the client device continuously detects the connection state of the client device and the central main node, and if the central main node fails, a new central main node is obtained for connection;
step 8, the server device has new data information and informs the client device to carry out data synchronization operation;
step 9, the client device inquires the data inside the server device to provide data service under the condition that the server device has no data updating notice;
step 10, the management terminal device inquires the state and the data state of each node of the distributed data cluster in the server terminal device;
step 11, the management terminal device queries the data version of the server terminal device through a data query language;
step 12, after respective data versions of the management side device and the client side device are updated, synchronously updating the data versions into a database of the server side device;
and step 13, the server side device distributes the new version data to the management side device and the client side device for data synchronization.
Compared with the prior art, the invention has the following remarkable advantages: 1) when the data node receives a plurality of data updates, the data nodes are put into one transaction and submitted to the database together, so that the low-delay index of data synchronization is improved; 2) according to the invention, the data updating is registered through the central main node, and other nodes are immediately informed of the data updating, so that the timeliness index of the data updating is improved; 3) the invention saves the continuous data updating in the memory of the central main node in an incremental mode for a certain time, thereby reducing the data processing amount; 4) the data nodes in the invention update the data through the central node, thereby ensuring the consistency of the data.
The present invention is described in further detail below with reference to the attached drawing figures.
Drawings
Fig. 1 is a schematic structural diagram of a dynamically constructed distributed data cluster control system according to the present invention.
FIG. 2 is a flow chart of a dynamically constructed distributed data cluster control method according to the present invention.
FIG. 3 is a flow chart of data synchronization in the dynamically constructed distributed data cluster control method of the present invention.
FIG. 4 is a flowchart of data update in the dynamically constructed distributed data cluster control method according to the present invention.
Detailed Description
With reference to fig. 1, the dynamically constructed distributed data cluster control system of the present invention is characterized in that the system includes a server device 1, a management device 2, and N client devices 3, where the server device 1 is connected to the client devices 3 and the management device 2 at the same time; the server device 1 comprises a plurality of service data node instances, all the service data node instances form a service node cluster, each service data node instance is called a service node, one service node serves as a central main node of the service node cluster, and the rest service nodes are data slave nodes;
the server device 1 is configured to parse and load network and basic configuration information of the distributed data cluster nodes, where the basic configuration information includes distributed cluster data node configuration information, distributed cluster data node network configuration information, data storage configuration information, and log record configuration information.
The management end device 2 provides an interface for managing the distributed data cluster for a user, and the user can inquire the state and the data information of the distributed data cluster through a query language and can initialize data and update the data; the cluster state is that the service node works normally or fails. Before the distributed data cluster runs, the management-side device 2 initializes the data structure, that is, establishes a database table structure.
And the client device 3 is used for inquiring the central main node and establishing connection, and executing data synchronization and data updating operation.
Further, one service node is used as a central host node of the service node cluster, and the specific process of selecting the central host node is as follows:
1) presetting a priority for each service node in the service node cluster, wherein the priorities corresponding to the service nodes are the same or different;
2) sorting the priority in descending order;
3) if only one service node corresponding to the maximum priority is available, taking the service node as a central main node; if a plurality of service nodes corresponding to the maximum priority are available, one service node is randomly selected as a central main node through a Hash method;
4) the client device 3 sends heartbeat packets to the server device at regular time, if a certain service node fails to receive the heartbeat packets within the set time, namely the service node fails, the service node is removed from the service node cluster, the data of the service node is copied to other service nodes, and if the central main node is removed, the steps 2) and 3) are repeated to reselect the central main node from the rest service nodes.
With reference to fig. 2, the dynamically constructed distributed data cluster control method of the present invention includes the following steps:
step 1, a user analyzes configuration information of a distributed data cluster through a server device 1; the method specifically comprises cluster node configuration information, cluster node network configuration information, data storage configuration information and log record configuration information;
step 2, running distributed data cluster nodes with parameters, and orderly adding newly added nodes into a cluster data queue one by one;
step 3, sequencing the service nodes into an ordered ring according to the size of the Hash value of each service node in the server device 1; then, each service node is connected with the right side node which is closest to the service node and normally works to form a stable ordered closed loop, and a dynamic distributed data cluster is constructed;
step 4, the management end device 2 establishes connection with the server end device 1;
step 5, comparing the data versions of the management terminal device 2 and the server terminal device 1, and if the data version of the server terminal device 1 is newer than the data version of the management terminal device 2, executing data synchronization operation to update the data version of the management terminal device 2;
step 6, the management end device 2 does not obtain the data version of the server end device 1, namely, the distributed data cluster of the server end device 1 is shown as a newly constructed cluster, and the database table structure of the management end device 2 initializes the data of the server end device 1;
step 7, the client device 3 establishes connection with the server device 1 for communication, and acquires a central main node for connection; the client device 3 continuously detects the connection state between the client device and the central main node, and if the central main node fails, a new central main node is obtained for connection;
step 8, the server device 1 has new data information and notifies the client device 3 to perform data synchronization operation as shown in fig. 3, which specifically includes:
step 8-1, the data of one client device 3 is updated and registered by the central main node of the server device 1;
step 8-2, the central main node informs other data slave nodes of the server side device 1 to update data;
if the data of the plurality of client devices 3 are updated in sequence, the central master node registers in sequence according to the updating sequence and stores the data for a certain time in the memory of the central master node to obtain a data updating packet, submits the data updating packet to the database of the server device 1, and then notifies other data slave nodes to update the data;
step 9, the client device 3 queries the internal data of the server device 1 under the condition that the server device does not have a data updating notice so as to provide data service, so that the service responsiveness is improved;
step 10, the management terminal device 2 queries the state and data state of each node of the distributed data cluster in the server device 1;
step 11, the management terminal device 2 queries the data version of the server terminal device 1 through the data query language;
step 12, after the respective data versions of the management device 2 and the client device 3 are updated, they are all updated into the database of the server device 1 in synchronization as shown in fig. 4, specifically:
step 12-1, a certain data node, namely the management end device 2 or a certain client end device 3, writes the update of the data into a memory to form a data packet;
step 12-2, when the transaction is submitted, the data packet is sent to a central main node;
and step 12-3, analyzing data conflicts:
1) at any time, the data states of the central nodes are the final states of the data;
2) when the data of the data node lags behind the central node, the data can still be updated, but:
1) the data node cannot add an entry that already exists on the central node. Wherein the items are determined by primary keys, identical primary keys being considered to be identical items;
2) the data node cannot delete entries that do not exist on the central node;
3) the data node can not modify the modified entry on the central node, namely when the entry of the central node is inconsistent with the entry of the data node, the data node can not modify the entry;
3) when the data of the data node lags behind the data of the central main node and causes update conflict, the data is rolled back and cannot be submitted to a database of the data node;
4) when the data of the data node lags behind the data of the central main node and leads to update conflict, the data node is actively synchronized with the central main node;
step 12-4, the central master node writes the received data packet into a database of the central master node, immediately sends the data packet to other data nodes, namely the management end device 2 or the client end device 3, and simultaneously puts the data packet into a memory queue to queue and write the data packet into persistent storage, so that the data packet does not need to be returned after the completion of disk IO operation, and the disk IO delay is reduced; and if the data node receives a plurality of data packets at the same time, submitting the data packets to the database of the data node for updating.
Step 13, the server device 1 distributes the new version data to the management device 2 and the client device 3 to perform data synchronization.
Further, the connection between the management device 2 and the server device 1 in step 4 and the connection between the client device 3 and the server device 1 in step 7 are both established as TCP communication connections.
Further, the data packet is sent to the central main node in the step 12-2 in a TCP _ NODELAY mode, so that the data packet is sent immediately when being forced to be transmitted, and the network delay is reduced.
Further, after the data packet is immediately sent to other data nodes in step 12-4, the data nodes will communicate with the central host node regularly to query the data state, and when the data nodes update data conflicts, the data nodes are immediately updated.
In summary, by using the technical scheme of the invention, a distributed data cluster can be dynamically constructed in a stable data service scene, and functional supports such as data distribution, local cache, copy redundancy backup, fault tolerance, transaction, concurrency control and the like are provided; the consistency of data is ensured in the processes of data migration, fault tolerance and concurrent reading and writing, and the storage access support and the data synchronization of a remote central database are provided for the application; aiming at the problems of calculation delay, network delay, disk IO delay and the like of a processor, a low-delay guarantee technology of data management is adopted, and the response timeliness of data updating and synchronization is improved.

Claims (9)

1. A dynamically constructed distributed data cluster control system is characterized by comprising a server device (1), a management device (2) and N client devices (3), wherein the server device (1) is connected with the client devices (3) and the management device (2) at the same time; the server device (1) comprises a plurality of service data node instances, all the service data node instances form a service node cluster, each service data node instance is called a service node, one service node serves as a central main node of the service node cluster, and the rest service nodes are data slave nodes;
the server device (1) is used for analyzing and loading network and basic configuration information of the distributed data cluster nodes;
the management end device (2) provides an interface for managing the distributed data cluster for a user, and the user can inquire the state and data information of the distributed data cluster through a query language, initialize data and update the data; the cluster state is that the service node works normally or fails;
the client device (3) is used for inquiring the central main node, establishing connection and executing data synchronization and data updating operation;
the service node is used as a central main node of the service node cluster, and the specific process of selecting the central main node is as follows:
1) presetting a priority for each service node in the service node cluster, wherein the priorities corresponding to the service nodes are the same or different;
2) sorting the priority in descending order;
3) judging the number of service nodes corresponding to the maximum priority, and if only one service node corresponding to the maximum priority exists, taking the service node as a central main node; if a plurality of service nodes corresponding to the maximum priority are available, one service node is randomly selected as a central main node through a Hash method;
4) the client device (3) sends heartbeat packets to the server device at regular time, if a certain service node fails to receive the heartbeat packets within set time, namely the service node fails, the service node is removed from the service node cluster, data of the service node is copied to other service nodes, and if the central main node is removed, the step 2) and the step 3) are repeated to reselect the central main node from the rest service nodes until the normally working central main node is selected;
running distributed data cluster nodes with parameters, and orderly adding newly added nodes into a cluster data queue one by one; sequencing the service nodes into an ordered ring according to the size of the Hash value of each service node in the service end device (1); and then each service node is connected with the right side node which is closest to the service node and normally works to form a stable ordered closed loop, and a dynamic distributed data cluster is constructed.
2. The dynamically constructed distributed data cluster control system of claim 1, wherein the base configuration information comprises distributed cluster data node configuration information, distributed cluster data node network configuration information, data storage configuration information, logging configuration information.
3. The dynamically constructed distributed data cluster control system according to claim 1, wherein before the distributed data cluster is operated, the management-side device (2) initializes a data structure to establish a database table structure.
4. A dynamically constructed distributed data cluster control method based on the system of claim 3, comprising the steps of:
step 1, analyzing the configuration information of the distributed data cluster through a server device (1); the method specifically comprises cluster node configuration information, cluster node network configuration information, data storage configuration information and log record configuration information;
step 2, running distributed data cluster nodes with parameters, and orderly adding newly added nodes into a cluster data queue one by one;
step 3, sequencing the service nodes into an ordered ring according to the size of the Hash value of each service node in the service end device (1); then, each service node is connected with the right side node which is closest to the service node and normally works to form a stable ordered closed loop, and a dynamic distributed data cluster is constructed;
step 4, the management end device (2) establishes connection with the server end device (1);
step 5, comparing the data versions of the management terminal device (2) and the server terminal device (1), and if the data version of the server terminal device (1) is newer than the data version of the management terminal device (2), executing data synchronization operation to update the data version of the management terminal device (2);
step 6, the management end device (2) cannot acquire the data version of the server end device (1), namely, the distributed data cluster of the server end device (1) is a newly constructed cluster, and the database table structure of the management end device (2) initializes the data of the server end device (1);
step 7, the client device (3) establishes connection with the server device (1) for communication, and acquires a central main node for connection; the client device (3) uninterruptedly detects the connection state between the client device and the central main node, and acquires a new central main node for connection if the central main node fails;
step 8, the server device (1) has new data information and informs the client device (3) to carry out data synchronization operation;
step 9, the client device (3) queries the data inside the server device (1) under the condition that the server device does not have a data updating notice so as to provide data service;
step 10, the management end device (2) queries the state and the data state of each node of the distributed data cluster in the server end device (1);
step 11, the management terminal device (2) queries the data version of the server terminal device (1) through a data query language;
step 12, after respective data versions of the management terminal device (2) and the client terminal device (3) are updated, synchronously updating the data versions to a database of the server terminal device (1);
and step 13, the server device (1) distributes the new version data to the management device (2) and the client device (3) for data synchronization.
5. The dynamically constructed distributed data cluster control method according to claim 4, wherein the connection between the management device (2) and the server device (1) in step 4, and the connection between the client device (3) and the server device (1) in step 7 are both established by establishing a TCP communication connection.
6. The dynamically constructed distributed data cluster control method according to claim 4 or 5, wherein the server device (1) has new data information in step 8, and notifies the client device (3) to perform data synchronization operation, specifically:
step 8-1, updating data of one client device (3), and registering by a central main node of the server device (1);
step 8-2, the central main node informs other data slave nodes of the server side device (1) to update data;
if the data of the client devices (3) are updated in sequence, the central main node registers in sequence according to the updating sequence and stores the data for a certain time in the memory of the central main node to obtain a data updating packet, and submits the data updating packet to the database of the server device (1), and then notifies other data slave nodes to update the data.
7. The dynamically constructed distributed data cluster control method according to claim 4 or 5, wherein, after the respective data versions of the management-side device (2) and the client-side device (3) are updated in step 12, both the data versions are synchronously updated into the database of the server-side device (1), specifically:
step 12-1, a certain data node, namely the management end device (2) or a certain client end device (3), writes the update of the data into a memory to form a data packet;
step 12-2, when the transaction is submitted, the data packet is sent to a central main node;
and step 12-3, analyzing data conflicts:
1) when the data of the data node lags behind the data of the central main node and causes update conflict, the data is rolled back and cannot be submitted to a database of the data node;
2) when the data of the data node lags behind the data of the central main node and leads to update conflict, the data node is actively synchronized with the central main node;
step 12-4, the central main node writes the received data packet into a database of the central main node, and immediately sends the data packet to other data nodes, namely, a management end device (2) or a client device (3); and if the data node receives a plurality of data packets at the same time, submitting the data packets to the database of the data node for updating.
8. The dynamically constructed distributed data cluster control method of claim 7, wherein the step 12-2 of sending the data packet to the central master node is in a TCP _ NODELAY manner.
9. The dynamically constructed distributed data cluster control method according to claim 7, wherein after the data packet is sent to other data nodes in step 12-4, the data nodes will periodically communicate with the central master node to query the data state, and when the data node update data conflicts, the data node update is performed immediately.
CN201811417178.0A 2018-11-26 2018-11-26 Dynamically constructed distributed data cluster control system and method thereof Active CN109639773B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811417178.0A CN109639773B (en) 2018-11-26 2018-11-26 Dynamically constructed distributed data cluster control system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811417178.0A CN109639773B (en) 2018-11-26 2018-11-26 Dynamically constructed distributed data cluster control system and method thereof

Publications (2)

Publication Number Publication Date
CN109639773A CN109639773A (en) 2019-04-16
CN109639773B true CN109639773B (en) 2021-04-13

Family

ID=66069181

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811417178.0A Active CN109639773B (en) 2018-11-26 2018-11-26 Dynamically constructed distributed data cluster control system and method thereof

Country Status (1)

Country Link
CN (1) CN109639773B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111163176A (en) * 2020-01-02 2020-05-15 山东超越数控电子股份有限公司 VirtualBox-based cluster management system
CN111460030A (en) * 2020-03-18 2020-07-28 紫光云技术有限公司 ZooKeeper-based distributed data exchange system
CN112532625B (en) * 2020-11-27 2022-09-13 杭州安恒信息安全技术有限公司 Network situation awareness evaluation data updating method and device and readable storage medium
CN113783921A (en) * 2021-01-27 2021-12-10 北京京东振世信息技术有限公司 Method and device for creating cache component
CN115329391B (en) * 2022-10-18 2023-01-24 成都卫士通信息产业股份有限公司 Text database protection method, device, equipment and medium
CN117851459A (en) * 2024-03-08 2024-04-09 江苏金恒信息科技股份有限公司 Data processing method based on multi-level cache under industrial data acquisition

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102025550A (en) * 2010-12-20 2011-04-20 中兴通讯股份有限公司 System and method for managing data in distributed cluster
CN103475566A (en) * 2013-07-10 2013-12-25 北京发发时代信息技术有限公司 Real-time message exchange platform and distributed cluster establishment method
CN104753994A (en) * 2013-12-27 2015-07-01 杭州海康威视系统技术有限公司 Method and device for data synchronization based on cluster server system
CN105824810A (en) * 2015-01-04 2016-08-03 中国移动通信集团河北有限公司 Hadoop cluster system and data processing method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9998544B2 (en) * 2014-08-11 2018-06-12 Sas Institute Inc. Synchronization testing of active clustered servers

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102025550A (en) * 2010-12-20 2011-04-20 中兴通讯股份有限公司 System and method for managing data in distributed cluster
CN103475566A (en) * 2013-07-10 2013-12-25 北京发发时代信息技术有限公司 Real-time message exchange platform and distributed cluster establishment method
CN104753994A (en) * 2013-12-27 2015-07-01 杭州海康威视系统技术有限公司 Method and device for data synchronization based on cluster server system
CN105824810A (en) * 2015-01-04 2016-08-03 中国移动通信集团河北有限公司 Hadoop cluster system and data processing method

Also Published As

Publication number Publication date
CN109639773A (en) 2019-04-16

Similar Documents

Publication Publication Date Title
CN109639773B (en) Dynamically constructed distributed data cluster control system and method thereof
CN109783438B (en) Distributed NFS system based on librados and construction method thereof
US7457835B2 (en) Movement of data in a distributed database system to a storage location closest to a center of activity for the data
EP2062125B1 (en) System and method for providing high availability data
US8108623B2 (en) Poll based cache event notifications in a distributed cache
US7693882B2 (en) Replicating data across the nodes in a cluster environment
CN113535656B (en) Data access method, device, equipment and storage medium
US20020131423A1 (en) Method and apparatus for real-time parallel delivery of segments of a large payload file
US11068499B2 (en) Method, device, and system for peer-to-peer data replication and method, device, and system for master node switching
US20140156586A1 (en) Big-fast data connector between in-memory database system and data warehouse system
US20120278817A1 (en) Event distribution pattern for use with a distributed data grid
CN111694865A (en) Four-layer structure data acquisition method and device based on distributed system
CN110858194A (en) Method and device for expanding database
CN112199427A (en) Data processing method and system
EP3347815B1 (en) Action-based routing of a transaction in an online transaction processing system
CN110807039A (en) Data consistency maintenance system and method in cloud computing environment
WO2014177085A1 (en) Distributed multicopy data storage method and device
CN115114374B (en) Transaction execution method and device, computing equipment and storage medium
CN112948178A (en) Data processing method, device, system, equipment and medium
CN115964444B (en) Cloud native distributed multi-tenant database implementation method and system
CN109992447B (en) Data copying method, device and storage medium
CN111382132A (en) Medical image data cloud storage system
JP2024514467A (en) Geographically distributed hybrid cloud cluster
CN112966047B (en) Method for realizing table copying function based on distributed database
CN114138810B (en) Access flow statistical method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder

Address after: 222001 No.18 Shenghu Road, Lianyungang City, Jiangsu Province

Patentee after: The 716th Research Institute of China Shipbuilding Corp.

Address before: 222001 No.18 Shenghu Road, Lianyungang City, Jiangsu Province

Patentee before: 716TH RESEARCH INSTITUTE OF CHINA SHIPBUILDING INDUSTRY Corp.

CP01 Change in the name or title of a patent holder