CN105472024A - Cross-region data synchronizing method based on message pushing mode - Google Patents

Cross-region data synchronizing method based on message pushing mode Download PDF

Info

Publication number
CN105472024A
CN105472024A CN201511001080.3A CN201511001080A CN105472024A CN 105472024 A CN105472024 A CN 105472024A CN 201511001080 A CN201511001080 A CN 201511001080A CN 105472024 A CN105472024 A CN 105472024A
Authority
CN
China
Prior art keywords
data
message
data center
local
center
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201511001080.3A
Other languages
Chinese (zh)
Other versions
CN105472024B (en
Inventor
王振宇
周游
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING SCISTOR TECHNOLOGY Co Ltd
Original Assignee
BEIJING SCISTOR TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING SCISTOR TECHNOLOGY Co Ltd filed Critical BEIJING SCISTOR TECHNOLOGY Co Ltd
Priority to CN201511001080.3A priority Critical patent/CN105472024B/en
Publication of CN105472024A publication Critical patent/CN105472024A/en
Application granted granted Critical
Publication of CN105472024B publication Critical patent/CN105472024B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/55Push-based network services

Abstract

The invention provides a cross-region data synchronizing method based on message pushing mode which is used for carrying out remote backup and recovery to the data of different data centers and belongs to the mass data management field. The method comprises that: every data centre configures the IP address deployed by the message component of every data centre in a cluster, the message is transmitted in pushing mode; remote configuration strategies are set aiming at different data centers, the data centers or the combination of the data centers needed to be synchronized; bottom transmission adopts HTTP protocols and user-defined serialized deserialized frames; the data are synchronized or updated, recovered and removed basing on the message components, an error retry mechanism is used in the realization process. The invention can realize real time transmission and treatment of the message, realizes synchronous data pushing, recovering and deleting of one point and multi-point, ensures the uniformity of updated and deleted data, ensures cross-region synchronizing reliability and safety of the data.

Description

A kind of cross-region method of data synchronization of Effect-based operation push mode
Technical field
The invention belongs to Mass Data Management field, relate to a kind of cross-region data synchronization management method of Effect-based operation push mode.
Background technology
Along with business activity more and more depends on network; increasing enterprise is in a kind of more powerful data center architecture of searching; the structure of this High Availabitity can reduce the impact even eliminated normal and improper shutdown and cause service availability; namely the interruption of network or the maintenance shut-downs of server no matter whether is had; or even abnormal machine of delaying, mission critical applications system can both be created the output value incessantly and improve the operational sustainability bottom line of company.Set up multiple data center and become inevitable choice to the disaster tolerance realizing business.It is to realize the high availability applied that user sets up the main purpose that multiple data center carrys out bearer service system, and the data syn-chronization therefore carrying out cross-region according to the relation between data center just becomes an important realization link.
Along with the explosive growth of data volume, the increasing pressure that data store is obvious, and because of information data, to lose the loss caused also increasing, and concern also gets more and more.Accordingly, the data center of different geographical generally needs dedicated network or the Internet to carry out the transmission of data, and under current network context, multiple business shares a network often, and the loading condition of network link is not expected.In addition upper-layer service system is all generally run for 7 × 24 hours, and the generation of data is real-time, and the size of quantity and Single document is usually all larger.How to ensure to carry out synchronously between the data center of different cross-regions in mass data, ensure the consistency of global data, the real-time of transfer of data, reduce to minimum by the system pressure caused because of data syn-chronization, this just needs to provide a kind of data synchronization management method that can ensure data transmission efficiency simultaneously.
Summary of the invention
The invention provides a kind of cross-region method of data synchronization of Effect-based operation push mode, for realizing synchronous to mass data cross-region and recovering, guarantee Data Update, delete the data consistency of the rear overall situation, the Information Security of enhancing system, the stability of guarantee system, the maintenance cost of effective reduction system.
The cross-region method of data synchronization of Effect-based operation push mode of the present invention, implementation comprises following aspect:
First aspect: the IP address disposed in each data center configuration cluster Nei Ge data center message components, adopts propelling movement mode to carry out message transfer;
Described message components comprises transmission message module and receipt message module, and send message module and send a message to the data center specified according to business scenario, receipt message module only monitors local message; Message adopts Producer-consumer model to manage.
Second aspect: the heart arranges other place configure strategy in the data;
Described other place configure strategy refers to for different data centers, arranges the combination needing synchronous data center or data center; Each data center, according to the other place configure strategy of self, structure message is sent to and needs synchronous data center.
The third aspect: bottom transmission adopts HTTP (HyperTextTransferProtocol) agreement and custom list unserializing framework;
Before bottom data transmission, use self-defining serializing and unserializing assembly to carry out serializing operation to data waiting for transmission, form binary system array; Http protocol is used to carry out Internet Transmission binary system array; Identical serializing and unserializing assembly is used to carry out unserializing operation to data waiting for transmission, to obtain the data content of transmission at receiving terminal.
Fourth aspect: realize data synchronous, recover or remove;
(3.1) data syn-chronization or renewal is realized: mark source data center is A, data center A obtains data to be synchronized, other place configure policy selection according to self needs synchronous data center, if the data center chosen is unavailable, then next available according to other place configure policy selection data center, then structure message Msg is sent to and wants synchronous data center; Message Msg is expressed as key, center:from:A, type:newOrUpdate}, wherein key is the data unique identifier needing to send, and center:from represents data are from which data center, and type represents action type, newly-increased or renewal; After target data center receives message by receipt message module, according to the data center specified in message, using the mode pulled that data to be synchronized are downloaded to this locality, then by sending message module, treatment state being informed data center A; After data center A receives the return state at all target data centers, mark these data and complete synchronously, otherwise continue the data center of the non-return state message of retry.
(3.2) date restoring is realized: after certain data center A obtains local data key failure, trigger the local recovery flow process to corrupt data, state status corresponding for local data key is modified as needRecovery, needRecovery represents to be needed to recover, local timed task scans the data that local status is needRecovery, a data center non-indigenous is selected to carry out data acquisition according to local message synchronous recording, request of data is sent to selected data center by bottom transmission assembly (HTTP), obtains data; By the data write local data center obtained, the state status that Update Table key is corresponding is simultaneously that ok, ok represent that data are normal;
(3.3) realize data to delete: after any one data center receives the removal request of data key, trigger the deletion action of cross-region; First, state status corresponding for the data key of this locality is modified as needDelete, needDelete represents to be needed to delete, and local timed task scans the data that local status is needDelete, obtains data list; The data center of all records is selected to carry out the structure of data deletion message according to local message synchronous recording; Deletion message is sent to all data centers by this locality; Data are deleted from local data center after receiving and deleting message by each data center, delete corresponding metadata, and feedback message gives the data center of deleting and initiating; Delete the feedback message that the data center initiated waits for all data centers, if all completed, then complete deletion, remove local metadata and corresponding task, if there is at least one data center to be not yet sent completely message, then continue to wait for, exceeding the stand-by period then carries out retry.
Relative to prior art, cross-region method of data synchronization tool of the present invention has the following advantages and good effect:
(1) the inventive method uses propelling movement mode to carry out the transmission of message, can realize real-time transmission and the process of message, and can find the state of message sink point before message sends, and then effectively carries out fault-tolerant processing;
(2) the inventive method supports other place configure strategy flexibly, can realize a point, multiple some data-pushing simultaneously, recovery and deletion, and support wrong retry mechanism, ensure the reliability that the cross-region of data is synchronous further;
(3) http agreement and custom list unserializing framework is adopted, the reliability of assuring data security, transmission and speed during the transmission of the inventive method bottom.
By the method proposed in the present invention, achieve synchronous to mass data cross-region and recover, guarantee Data Update, delete the data consistency of the rear overall situation, the Information Security of enhancing system, the stability of guarantee system, the maintenance cost of effective reduction system, is with a wide range of applications in Mass Data Management field.
Accompanying drawing explanation
Fig. 1 is the cross-region data syn-chronization schematic flow sheet of Effect-based operation push mode in the present invention;
Fig. 2 is the message push notice flow chart in the inventive method;
Fig. 3 is the flow chart of the bottom data transmission in the inventive method;
Fig. 4 is the flow chart of cross-region data syn-chronization in the inventive method or renewal;
Fig. 5 is the flow chart of the cross-region date restoring in the inventive method;
Fig. 6 is the flow chart that the cross-region data in the inventive method are deleted.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, technical scheme of the present invention is further described.
The cross-region method of data synchronization of Effect-based operation push mode of the present invention, entirety as shown in Figure 1, the following describes the technical scheme of carrying out to realize the inventive method and arranges.
First aspect, in the IP address information that each data center configuration cluster Nei Ge data center message components is disposed, adopts propelling movement mode to carry out message transfer.Adopt the notice problem in massage pattern solution transmitting procedure, concrete the present invention adopts propelling movement mode, to promote the response time.
Each data center in cluster is all configured with message components, and message components comprises transmission message and receipt message two functional modules.Message push notification principles provided by the invention and flow process, as depicted in figs. 1 and 2.First the IP information that data center's message components is disposed in each data center configuration cluster, in the initiation message service of each data center, realized by transmission message module and receipt message module, send message module and send a message to the data center specified according to business scenario, receipt message module then only monitors local message.For Liang Ge data center A, B.First in the IP information that A, B data center configuration A, B data center message components are disposed; Then, initiation message service, message adopts Producer-consumer model to manage.Send message and namely produce corresponding message, message is joined in the processing queue of consumer.The mode of use message groups specifies the informed source handled by different producers and consumers, and the message components of each data center is all run with the form of background service.When a certain data center A needs to notify the relevant upper-layer service logic of other data center B process, the message then using this data center B to provide produces interface, transmission message module is used to send a message to in the message queue of data center B, the receipt message module of B has listened to new information and has entered local message queue, then Trigger message processing logic, completes message push to the task of other data center.
As can be seen from the flow process of message push, use the mode of message push can avoid the blindness of active pull, improve the fault-tolerant processing ability before message transmission, save the time, improve efficiency.Same this mode supports other place configure strategy flexibly, can realize the data-pushing while of a point, multiple point and recovery.
Second aspect, the heart arranges other place configure strategy in the data.
The inventive method supports other place configure strategy flexibly, can realize the data-pushing while of a point, multiple point and recovery.In order to support by data send one or more different regions, in different data centers, employ a set of based on program with or other place configure strategy, as follows:
E [operator (| or &) E] | E=(T [operator (| or &) T]), T=data center }.
Wherein, " | " represent or, " & " represent with, E is the combination of data center.E be used for describe want synchronous data center.
Such as, existing D1, D2, D3, D4 tetra-data centers, in the data in heart D1, the other place configure strategy that can select is as follows:
D2, namely only carries out synchronously to D2 data center;
D2|D3, selects some data centers in D2 or D3 to carry out synchronously;
D2 & D3, carries out data syn-chronization to D2 and D3 data center;
D2 & (D3|D4), synchronous to D2, from D3 or D4, select a data center to carry out synchronously simultaneously;
(D2 & D3) | D4, synchronous to D4, or to the synchronous A of D2 and D3.
When data are loaded into after in data center D1, data center D1 is pushed to other data centers according to set other place configure strategy.When occurring extremely to need to recover, such as D1 goes wrong, and now, needs the data center from other, such as D2, is come by data syn-chronization.
Fourth aspect, bottom transmission adopts http protocol and custom list unserializing framework.
3rd aspect of the present invention, bottom transmission adopts http protocol and custom list unserializing framework, the reliability of assuring data security, transmission and speed.As shown in Figure 3, Avro system can be selected to carry out sequence number.Before bottom data transmission, use self-defining serializing and unserializing assembly to carry out serializing operation to data waiting for transmission, form binary system array; Use http protocol to carry out Internet Transmission binary system array, send message to be transmitted to target data center notice data; At receiving terminal by HTTP request URI (Uniform Resource Identifier), realize far-end and send request pulling data, then identical serializing and unserializing assembly is used to carry out unserializing operation to data waiting for transmission, to obtain the data content of transmission.Adopt the mode of serializing can avoid on the one hand because the different difference caused of service environment, such as operating system, programming language etc., improve the portability of data; On the other hand, adopt self-defining serializing unserializing method, data can be avoided to be intercepted and captured in transmitting procedure, be even tampered, ensure the fail safe of transmission.
Fourth aspect, realize data synchronous, recover or remove.
Cross-region data syn-chronization provided by the invention or more new technological process are as shown in Figure 4, certain data center A obtains data to be synchronized, select to need synchronous data center according to the data synchronization strategy of its this locality, if the data center chosen is unavailable, then select next available data center according to collocation strategy, structure message is sent to and needs synchronous data center.The message Msg constructed can be expressed as: { key, center:from:A, Type:newOrUpdate}, wherein key is the data unique identifier needing to send, center:from represents data are from which data center, type represents this type operated, and will increase newly and more new capital uses same treatment mode herein.After target data center receives message by receipt message module, according to the data center specified in message, use the mode pulled that data to be synchronized are downloaded to this locality, after completing, treatment state is informed source data center by sending message module by target data center, after source data receive centre to the return state at all target data centers, mark these data to complete synchronously, otherwise continue the data center of the non-return state message of retry.
Cross-region Data Recovery Process provided by the invention as shown in Figure 5, certain data center, as data center A, after obtaining local data key failure, trigger the local recovery flow process to corrupt data, be modified as by state status corresponding for the data key of this locality and need to recover needRecovery, simultaneously local timed task scans the data that local status is needRecovery.Select a back end to carry out data acquisition according to local message synchronous recording situation, select a data center non-indigenous to carry out data acquisition.The local message synchronous recording of data center A is expressed as { data center such as key, center:from:A, center:to:B, C, D, status:update}.Select a data center non-indigenous to carry out data acquisition, for local node A, from data center B, C, D, select one carry out data acquisition.Same as B or C or D corrupted data, need to select a data center from A or C or D according to message synchronization record.In a word, select a data center non-indigenous to carry out data acquisition, in this example, select data center C.Request of data is sent to target data center by bottom transmission assembly (HTTP), obtains data.Write local data center, the state status that Update Table key is corresponding is simultaneously ok.
Cross-region data provided by the invention delete flow process as shown in Figure 6, after any one data center receives the removal request of data key, trigger the deletion action of cross-region, status corresponding for the data key of this locality is modified as needDelete, needDelete represents to be needed to delete; Simultaneously local timed task scans the data that local status is needDelete, obtains data list.Select all data centers to carry out the structure of data deletion message according to local message synchronous recording situation, deletion message is sent to all data centers.Local message synchronous recording is that { key, center:from:A, center:to:B, C, D..., status:ok}, by the deletion action of the enterprising row data key of all data centers recorded in this record.Data are deleted from local data center after receiving and deleting message by each data center, delete corresponding metadata information, and feedback message are sent to the data center of deleting and initiating.Delete the feedback message that the data center initiated waits for all data centers, if all completed, then complete deletion, remove local metadata information and corresponding mission bit stream, if there is at least one data center to be not yet sent completely message, then continue to wait for, exceeding the stand-by period then carries out retry.
Mistake retry mechanism all has and relates in above-mentioned three flow processs, adopt the mode of timed task, abortive retry is carried out in the time of implementation timing of formulating according to configuration, the retry interval time increases along with the prolongation of time, that avoids blindness carries out invalid operation, affects the normal operation of other modules.
By the method proposed in the present invention, realize to mass data cross-region synchronous with recover, guarantee the data consistency after Data Update, deletion, the Information Security of enhancing system, the stability of guarantee system, the maintenance cost of effective reduction system, is with a wide range of applications in Mass Data Management field.
It should be noted that and understand, when not departing from the spirit and scope of the present invention required by accompanying claim, various amendment and improvement can be made to the present invention of foregoing detailed description.Therefore, the scope of claimed technical scheme is not by the restriction of given any specific exemplary teachings.

Claims (2)

1. a cross-region method of data synchronization for Effect-based operation push mode, is characterized in that, comprise the steps:
First aspect: the IP address disposed in each data center configuration cluster Nei Ge data center message components, adopts propelling movement mode to carry out message transfer;
Described message components comprises transmission message module and receipt message module, and send message module and send a message to the data center specified according to business scenario, receipt message module only monitors local message; Message adopts Producer-consumer model to manage;
Second aspect: the heart arranges other place configure strategy in the data;
Described other place configure strategy refers to for different data centers, arranges the combination needing synchronous data center or data center; Each data center, according to the other place configure strategy of self, structure message is sent to and needs synchronous data center;
The third aspect: bottom transmission adopts http protocol and custom list unserializing framework;
Before bottom data transmission, use self-defining serializing and unserializing assembly to carry out serializing operation to data waiting for transmission, form binary system array; Http protocol is used to carry out Internet Transmission binary system array; Identical serializing and unserializing assembly is used to carry out unserializing operation to data waiting for transmission, to obtain the data content of transmission at receiving terminal;
Fourth aspect: realize data synchronous, recover or remove;
(3.1) data syn-chronization or renewal is realized: mark source data center is A, data center A obtains data to be synchronized, other place configure policy selection according to self needs synchronous data center, if the data center chosen is unavailable, then next available according to other place configure policy selection data center, then structure message Msg is sent to and wants synchronous data center; Message Msg is expressed as key, center:from:A, type:newOrUpdate}, wherein key is the data unique identifier needing to send, and center:from represents data are from which data center, and type represents action type, newly-increased or renewal; After target data center receives message by receipt message module, according to the data center specified in message, using the mode pulled that data to be synchronized are downloaded to this locality, then by sending message module, treatment state being informed data center A; After data center A receives the return state at all target data centers, mark these data and complete synchronously, otherwise continue the data center of the non-return state message of retry;
(3.2) date restoring is realized: after certain data center A obtains local data key failure, trigger the local recovery flow process to corrupt data, state status corresponding for local data key is modified as needRecovery, needRecovery represents to be needed to recover, local timed task scans the data that local status is needRecovery, a data center non-indigenous is selected to carry out data acquisition according to local message synchronous recording, request of data is sent to selected data center by bottom transmission assembly, obtains data; By the data write local data center obtained, the state status that Update Table key is corresponding is simultaneously that ok, ok represent that data are normal;
(3.3) realize data to delete: after any one data center receives the removal request of data key, trigger the deletion action of cross-region; First, state status corresponding for the data key of this locality is modified as needDelete, needDelete represents to be needed to delete, and local timed task scans the data that local status is needDelete, obtains data list; The data center of all records is selected to carry out the structure of data deletion message according to local message synchronous recording; Deletion message is sent to all data centers by this locality; Data are deleted from local data center after receiving and deleting message by each data center, delete corresponding metadata, and feedback message gives the data center of deleting and initiating; Delete the feedback message that the data center initiated waits for all data centers, if all completed, then complete deletion, remove local metadata and corresponding task, if there is at least one data center to be not yet sent completely message, then continue to wait for, exceeding the stand-by period then carries out retry.
2. the cross-region method of data synchronization of Effect-based operation push mode according to claim 1, it is characterized in that, in described first aspect, in each data center's initiation message service, when data center A needs notification data center B process upper-layer service logic, the message that data center's A usage data center B provides produces interface, transmission message module is used to send a message to in the message queue of data center B, the receipt message module of data center B has listened to new information when entering local message queue, Trigger message processing logic.
CN201511001080.3A 2015-12-28 2015-12-28 A kind of cross-region method of data synchronization based on message push mode Active CN105472024B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201511001080.3A CN105472024B (en) 2015-12-28 2015-12-28 A kind of cross-region method of data synchronization based on message push mode

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201511001080.3A CN105472024B (en) 2015-12-28 2015-12-28 A kind of cross-region method of data synchronization based on message push mode

Publications (2)

Publication Number Publication Date
CN105472024A true CN105472024A (en) 2016-04-06
CN105472024B CN105472024B (en) 2018-09-28

Family

ID=55609287

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201511001080.3A Active CN105472024B (en) 2015-12-28 2015-12-28 A kind of cross-region method of data synchronization based on message push mode

Country Status (1)

Country Link
CN (1) CN105472024B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107231308A (en) * 2017-06-07 2017-10-03 北京神舟航天软件技术有限公司 A kind of cross-site basic data intelligence learning and the pre- lookup method of link
CN109194720A (en) * 2018-08-15 2019-01-11 京信通信系统(中国)有限公司 Standby machine method of data synchronization, device and computer equipment
CN109753511A (en) * 2018-12-28 2019-05-14 北京东方国信科技股份有限公司 A kind of the cross-region real-time synchronization method and system of big data platform
WO2019218763A1 (en) * 2018-05-17 2019-11-21 华为技术有限公司 Communication method, system and apparatus
CN110865985A (en) * 2018-08-28 2020-03-06 阿里巴巴集团控股有限公司 Data synchronization method and device, electronic equipment and storage medium
CN111858098A (en) * 2020-07-24 2020-10-30 成都成信高科信息技术有限公司 Data exchange method based on mass data
CN113301091A (en) * 2020-07-31 2021-08-24 阿里巴巴集团控股有限公司 Message processing method and device for distributed system, electronic equipment and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011112750A2 (en) * 2010-03-12 2011-09-15 Microsoft Corporation Memory cache data center
CN102880475A (en) * 2012-10-23 2013-01-16 上海普元信息技术股份有限公司 Real-time event handling system and method based on cloud computing in computer software system
CN104184209A (en) * 2014-08-15 2014-12-03 国家电网公司 User-side distributed energy power generation management system
CN104462192A (en) * 2011-12-01 2015-03-25 中国核工业二三建设有限公司 Data synchronization technology device and method based on nuclear power construction multi-project management
CN104935668A (en) * 2015-06-26 2015-09-23 四川长虹电器股份有限公司 Distributed file system and data synchronization method therefor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011112750A2 (en) * 2010-03-12 2011-09-15 Microsoft Corporation Memory cache data center
CN104462192A (en) * 2011-12-01 2015-03-25 中国核工业二三建设有限公司 Data synchronization technology device and method based on nuclear power construction multi-project management
CN102880475A (en) * 2012-10-23 2013-01-16 上海普元信息技术股份有限公司 Real-time event handling system and method based on cloud computing in computer software system
CN104184209A (en) * 2014-08-15 2014-12-03 国家电网公司 User-side distributed energy power generation management system
CN104935668A (en) * 2015-06-26 2015-09-23 四川长虹电器股份有限公司 Distributed file system and data synchronization method therefor

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
JIANXUN ZHANG: "Performance evaluation of data-push thread on commercial CMP platform", 《NETWORKED COMPUTING (INC), 2010 6TH INTERNATIONAL CONFERENCE ON》 *
李林,王竹,呼延正勇,赵明明,曹津,朱德海;: "田间数据传输同步策略与中间件研究", 《农业机械学报》 *
汪洋; 谢江; 王振宇: "基于事件的发布-订阅系统模型", 《计算机科学》 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107231308A (en) * 2017-06-07 2017-10-03 北京神舟航天软件技术有限公司 A kind of cross-site basic data intelligence learning and the pre- lookup method of link
CN107231308B (en) * 2017-06-07 2020-07-31 北京神舟航天软件技术有限公司 Cross-site basic data intelligent learning and link pre-searching method
WO2019218763A1 (en) * 2018-05-17 2019-11-21 华为技术有限公司 Communication method, system and apparatus
US11689606B2 (en) 2018-05-17 2023-06-27 Huawei Technologies Co., Ltd. Communication method, system and apparatus
CN109194720A (en) * 2018-08-15 2019-01-11 京信通信系统(中国)有限公司 Standby machine method of data synchronization, device and computer equipment
CN110865985A (en) * 2018-08-28 2020-03-06 阿里巴巴集团控股有限公司 Data synchronization method and device, electronic equipment and storage medium
CN110865985B (en) * 2018-08-28 2024-04-16 阿里巴巴新加坡控股有限公司 Data synchronization method, device, electronic equipment and storage medium
CN109753511A (en) * 2018-12-28 2019-05-14 北京东方国信科技股份有限公司 A kind of the cross-region real-time synchronization method and system of big data platform
CN109753511B (en) * 2018-12-28 2020-12-04 北京东方国信科技股份有限公司 Cross-region real-time synchronization method and system for big data platform
CN111858098A (en) * 2020-07-24 2020-10-30 成都成信高科信息技术有限公司 Data exchange method based on mass data
CN111858098B (en) * 2020-07-24 2023-11-17 成都成信高科信息技术有限公司 Data exchange method based on mass data
CN113301091A (en) * 2020-07-31 2021-08-24 阿里巴巴集团控股有限公司 Message processing method and device for distributed system, electronic equipment and medium

Also Published As

Publication number Publication date
CN105472024B (en) 2018-09-28

Similar Documents

Publication Publication Date Title
CN105472024A (en) Cross-region data synchronizing method based on message pushing mode
AU2019236685B2 (en) Distributed file system using consensus nodes
EP2651075B1 (en) Backup method and device for tcp connection
EP2356753B1 (en) Link data transmission method, node and system
WO2010106991A1 (en) Method and system for data replication management
CN110601903B (en) Data processing method and device based on message queue middleware
WO2017181872A1 (en) Data processing system and method
US10892839B2 (en) Method for fast reconfiguration of GM clocks in the TSN network by means of an explicit teardown message
CN103870570A (en) HBase (Hadoop database) data usability and durability method based on remote log backup
CN107623703B (en) Synchronization method, device and system for Global Transaction Identifier (GTID)
CN105721582A (en) Multi-node file backup system
EP3713195B1 (en) Log processing method, related device, and system
WO2011063725A1 (en) Method and system for active-standby synchronization
CN106817387B (en) Data synchronization method, device and system
WO2011109049A1 (en) Method and apparatus of backing-up subversion repository
CN108390919A (en) A kind of message synchronization system and method for highly reliable two-node cluster hot backup
CN104821889B (en) A kind of processing method and equipment of backup message
CN105812492A (en) Data synchronizing method and system
KR101192896B1 (en) Distributed synchronization method and apparatus for fault tolerance
CN111241200B (en) Master-slave synchronous processing method and device based on SQLite database
CN103166847A (en) Method and device for ensuring graceful restart
CN102281159A (en) Recovery method for cluster system
JP5344712B2 (en) Data matching method and service providing apparatus
JP2015057685A (en) Monitoring system
Kim Group communication in real-time computing systems: Issues and directions

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant