CN104618219A - Cross-machine-room data synchronizing method and device - Google Patents
Cross-machine-room data synchronizing method and device Download PDFInfo
- Publication number
- CN104618219A CN104618219A CN201410844631.1A CN201410844631A CN104618219A CN 104618219 A CN104618219 A CN 104618219A CN 201410844631 A CN201410844631 A CN 201410844631A CN 104618219 A CN104618219 A CN 104618219A
- Authority
- CN
- China
- Prior art keywords
- machine room
- storage side
- storage
- data
- sides
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses cross-machine-room data synchronizing method and device which are applied to a distributed message system. The method comprises the steps of receiving one a plurality of data by one or a plurality of first storage sides in a second machine room from one or a plurality of distribution sides in a first machine room; storing in local second machine room; synchronizing the one or plurality of data into one or a plurality of second storage sides in a third machine room through the one or plurality of second storage sides; storing in local third machine room for transferring of one or a plurality of subscription sides in the third machine room. With the adoption of the method and device, the problem of repeatedly transmitting data between the first storage side in the second machine room and the subscription side in the third machine room can be avoided, and thus the network delay can be greatly reduced.
Description
Technical field
The present invention relates to field of computer technology, particularly relate to a kind of method and apparatus carried out across machine room data syn-chronization.
Background technology
Distributed information system is the system adopting distributed treatment to carry out news release and subscription, and typical distributed information system comprises kafka, RabbitMQ, ActiveMQ, QBus etc.
The distributed information system of QBus to be a kind of with kafka be prototype, it forms primarily of the unit such as publisher (Producer), subscriber (Consumer), storage side (Broker), coordination side (Zookeeper), agent (Agent).In QBus system, three dominant roles of message system are storage side, publisher and subscriber, wherein, publisher and subscriber full decoupled, not perception each other.In QBus system, these three roles have greater probability to be deployed in different data centers, comprise the data center of wide apart on geographical position, such as Beijing, Zhengzhou and Guangzhou.This just may cause subscriber when consuming the data in storage side, needs to bear larger network delay, especially obvious in the application of this Publish-subscribe at message system.
Summary of the invention
In view of the above problems, propose the present invention, to provide a kind of a kind of method and apparatus carried out across machine room data syn-chronization overcoming the problems referred to above or solve the problem at least in part.
According to an aspect of of the present present invention, provide a kind of method of carrying out across machine room data syn-chronization, be applied to distributed information system, comprise: the one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality; And described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, described portion or many numbers comprise according to the step being synchronized to one or more second the storages sides being positioned at the 3rd machine room by described one or more first storage side further: described portion or many numbers certificate are synchronized to described one or more second storage side by the mode of the orderly poll of described one or more first storage side's employing.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, described portion or many numbers comprise according to the step being synchronized to one or more second sides of storageing being positioned at the 3rd machine room by described one or more first storage side further: for wherein each number certificate, and one or more Partial synchronizations of described a data store to a described second storage side as one or more part by the mode of the orderly poll of described one or more first storage side's employing.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, the second machine room, the 3rd machine room are positioned at different positions.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, described second machine room and described 3rd machine room carry out telecommunication.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, in described distributed information system, described publisher is Producer, described first storage side and the second storage side are Broker, and described subscriber is Consumer.
According to a further aspect in the invention, provide a kind of method of carrying out across machine room data syn-chronization, be applied to distributed information system, comprise: the one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality; Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room; And the one or more subscribers being positioned at the 3rd machine room obtain described portion or many numbers certificate from described one or more second storage side.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, in described one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after the step being stored in the 3rd machine room this locality, described method also comprises: described one or more second storage side exceedes the portion of predefined very first time threshold value or many numbers according to deletion by being stored in the 3rd machine room this locality.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, in described one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after the step being stored in the 3rd machine room this locality, described method also comprises: when the described portion or many numbers certificate that are stored in the 3rd machine room this locality exceed predefined size, described one or more second storage side by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, exceed the portion of described predefined size or many numbers according to deletion.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, also comprise: the described one or more publisher being positioned at described first machine room by a or many numbers according to being sent to the one or more first storage sides being positioned at the second machine room.
Alternatively, in the method for carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, in described distributed information system, described publisher is Producer, described first storage side and the second storage side are Broker, and described subscriber is Consumer.
According to another aspect of the invention, provide a kind of device carried out across machine room data syn-chronization, be applied to distributed information system, comprise: receive and memory module, receive a or many number certificates for one or more first the storages sides by being positioned at the second machine room from the one or more publishers being positioned at the first machine room and be stored in second machine room this locality; And synchronization module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, described synchronization module adopts the mode of orderly poll by described portion or many numbers according to being synchronized to described one or more second storage side by described one or more first storage side.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, described synchronization module, for wherein each number certificate, adopts the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data by described one or more first storage side.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, the second machine room, the 3rd machine room are positioned at different positions.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, described second machine room and described 3rd machine room carry out telecommunication.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, in described distributed information system, described publisher is Producer, described first storage side and the second storage side are Broker, and described subscriber is Consumer.
In accordance with a further aspect of the present invention, provide a kind of device carried out across machine room data syn-chronization, be applied to distributed information system, comprise: receive and memory module, receive a or many number certificates for one or more first the storages sides by being positioned at the second machine room from the one or more publishers being positioned at the first machine room and be stored in second machine room this locality; Synchronization module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room; And acquisition module, obtain described portion or many numbers certificate for the one or more subscribers by being positioned at the 3rd machine room from described one or more second storage side.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, also comprise the first removing module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room at described synchronization module by described one or more first storage side, after being stored in the 3rd machine room this locality, exceed the portion of predefined very first time threshold value or many numbers according to deletion by described one or more second storage side by being stored in the 3rd machine room this locality.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, also comprise the second removing module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room at described synchronization module by described one or more first storage side, after being stored in the 3rd machine room this locality, when the described portion or many numbers certificate that are stored in the 3rd machine room this locality exceed predefined size, by described one or more second storage side by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, exceed the portion of described predefined size or many numbers according to deletion.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, also comprising sending module, for the described one or more publisher by being positioned at described first machine room, a or many number certificates being sent to the one or more first storage sides being positioned at the second machine room.
Alternatively, in the device of carrying out according to the abovementioned embodiments of the present invention across machine room data syn-chronization, in described distributed information system, described publisher is Producer, described first storage side and the second storage side are Broker, and described subscriber is Consumer.
The invention provides above-mentioned carrying out and, across the method and apparatus of machine room data syn-chronization, be applied to distributed information system.According to embodiments of the invention, the one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality; Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.Because the data publisher issued to be synchronized to one or more second storage sides of the 3rd machine room being arranged in one or more subscriber this locality from one or more first storage sides of the second machine room, avoid and repeatedly between the first storage side of the second machine room and the subscriber of the 3rd machine room, transmit data, greatly reduce both network delay.According to an alternative embodiment of the invention, adopt the mode of orderly poll to carry out data syn-chronization, farthest can adapt to the different topology structure of each machine room, can also keep or change the metamessage of data neatly; In addition, take expiration policies, decrease the burden of the local memory space of machine room.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of specification, and can become apparent, below especially exemplified by the specific embodiment of the present invention to allow above and other objects of the present invention, feature and advantage.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Fig. 1 is the schematic flow sheet of carrying out according to an embodiment of the present across the method for machine room data syn-chronization;
Fig. 2 is that a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment is by the schematic diagram of data syn-chronization to the second storage side;
Fig. 3 is that a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment is by the schematic diagram of one or more Partial synchronizations of a data to the second storage side;
Fig. 4 is that carrying out according to an embodiment of the present is across the mutual schematic diagram in the device of machine room data syn-chronization between modules;
Fig. 5 is the schematic flow sheet of carrying out according to an embodiment of the present across the method for machine room data syn-chronization; And
Fig. 6 is that carrying out according to an embodiment of the present is across the mutual schematic diagram in the device of machine room data syn-chronization between modules.
Embodiment
Below with reference to accompanying drawings exemplary embodiment of the present disclosure is described in more detail.Although show exemplary embodiment of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment set forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
According to a first aspect of the invention, provide a kind of method 100 of carrying out across machine room data syn-chronization, be applied to distributed information system.In an embodiment of the present invention, distributed information system can be the system adopting distributed treatment to carry out news release and subscription, such as, comprise kafka, RabbitMQ, ActiveMQ, QBus etc.Hereinafter, for QBus system, principle of the present invention will be described in detail, understand principle of the present invention better to help reader.But it will be appreciated by those skilled in the art that scope of the present invention is not limited to QBus system, but go for any distributed information system.
QBus system forms primarily of the unit such as publisher (Producer), subscriber (Consumer), storage side (Broker), coordination side (Zookeeper), agent (Agent).Hereinafter, principle of the present invention is illustrated for the transfer of data between publisher, storage side, subscriber by main, equally, scope of the present invention is not limited thereto, but the transfer of data be equally applicable in distributed information system (such as, QBus system) between other unit.
Fig. 1 shows the schematic flow sheet of carrying out according to an embodiment of the present across the method 100 of machine room data syn-chronization.As shown in Figure 1, described method 100 starts from step S110, and wherein, the one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality.That is, issued portion or many numbers certificate can be sent to the one or more first storage sides being positioned at the second machine room by the one or more publishers being positioned at the first machine room.
After step silo, perform step S120, wherein, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.According to above-mentioned steps S110 and S120, by the transfer of data flow process of publisher's (the first machine room) → the first storage side (the second machine room) → second storage side (the 3rd machine room) → subscriber (the 3rd machine room), achieve the application of Publish-subscribe.
According to embodiments of the invention, in described distributed information system (such as, QBus system), described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
According to embodiments of the invention, the second machine room, the 3rd machine room are positioned at different positions.In one embodiment, what described second machine room and described 3rd machine room carried out is telecommunication.First machine room also can be positioned at different positions from the second machine room and the 3rd machine room, also can carry out telecommunication with the second machine room and the 3rd machine room.Because the data publisher issued to be synchronized to one or more second storage sides of the 3rd machine room being arranged in one or more subscriber this locality from one or more first storage sides of the second machine room, when the subscriber of the 3rd machine room needs described data, avoid and repeatedly between the first storage side of the second machine room and the subscriber of the 3rd machine room, transmit data, but obtain described data from this locality, greatly reduce both network delay.
According to embodiments of the invention, above-mentioned steps S120 comprises: described one or more first storage side adopts the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side.See Fig. 2, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of data syn-chronization to the second storage side.As shown in Figure 2, for 6 the storage sides being positioned at the second machine room by data syn-chronization to 4 the storage sides being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, first storage side 1 of the second machine room is by the second storage side 1 of data syn-chronization to the 3rd machine room, first storage side 2 of the second machine room is by the second storage side 2 of data syn-chronization to the 3rd machine room, first storage side 3 of the second machine room is by the second storage side 3 of data syn-chronization to the 3rd machine room, first storage side 4 of the second machine room is by the second storage side 4 of data syn-chronization to the 3rd machine room, first storage side 5 of the second machine room is by the second storage side 1 of data syn-chronization to the 3rd machine room, first storage side 6 of the second machine room is by the second storage side 2 of data syn-chronization to the 3rd machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to embodiments of the invention, above-mentioned steps S120 comprises: for wherein each number certificate, and described one or more first storage side adopts the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data.See Fig. 3, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of one or more Partial synchronizations of a data to the second storage side.As shown in Figure 3, for the first storage side being positioned at the second machine room by five data Partial synchronizations to three data divisions in the second storage side being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, for the data division of 5 in a data, data division 1 is synchronized to the data division 1 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 2 is synchronized to the data division 2 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 3 is synchronized to the data division 3 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 4 is synchronized to the data division 1 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 5 is synchronized to the data division 2 of the second storage side of the 3rd machine room by the first storage side of the second machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to a second aspect of the invention, corresponding with said method 100, provide a kind of device 400 carried out across machine room data syn-chronization, be applied to distributed information system.In an embodiment of the present invention, distributed information system can be the system adopting distributed treatment to carry out news release and subscription, such as, comprise kafka, RabbitMQ, ActiveMQ, QBus etc.Hereinafter, for QBus system, principle of the present invention will be described in detail, understand principle of the present invention better to help reader.But it will be appreciated by those skilled in the art that scope of the present invention is not limited to QBus system, but go for any distributed information system.QBus system forms primarily of the unit such as publisher (Producer), subscriber (Consumer), storage side (Broker), coordination side (Zookeeper), agent (Agent).Hereinafter, principle of the present invention is illustrated for the transfer of data between publisher, storage side, subscriber by main, equally, scope of the present invention is not limited thereto, but the transfer of data be equally applicable in distributed information system (such as, QBus system) between other unit.
Fig. 4 shows carrying out according to an embodiment of the present across the mutual schematic diagram in the device 400 of machine room data syn-chronization between modules.Described device 400 comprises reception and memory module 410 and synchronization module 420.As shown in Figure 4, described reception and memory module 410 can by one or more first storage sides of being positioned at the second machine room from the one or more publishers being positioned at the first machine room receive a or many numbers according to and to be stored in the second machine room local.That is, issued portion or many numbers certificate can be sent to the one or more first storage sides being positioned at the second machine room by the one or more publishers being positioned at the first machine room.
Subsequently, described portion or many numbers certificate can be synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side by described synchronization module 420, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.According to the aforesaid operations of described reception and memory module 410 and described synchronization module 420, by the transfer of data flow process of publisher's (the first machine room) → the first storage side (the second machine room) → second storage side (the 3rd machine room) → subscriber (the 3rd machine room), achieve the application of Publish-subscribe.
According to embodiments of the invention, in described distributed information system (such as, QBus system), described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
According to embodiments of the invention, the second machine room, the 3rd machine room are positioned at different positions.In one embodiment, described second machine room and described 3rd machine room carry out telecommunication.First machine room also can be positioned at different positions from the second machine room and the 3rd machine room, also can carry out telecommunication with the second machine room and the 3rd machine room.Data publisher issued due to described synchronization module 420 have been synchronized to one or more second storage sides of the 3rd machine room being arranged in one or more subscriber this locality from one or more first storage sides of the second machine room, when the subscriber of the 3rd machine room needs described data, avoid and repeatedly between the first storage side of the second machine room and the subscriber of the 3rd machine room, transmit data, but obtain described data from this locality, greatly reduce both network delay.
According to embodiments of the invention, described synchronization module 420 can adopt the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side by described one or more first storage side.See Fig. 2, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of data syn-chronization to the second storage side.As shown in Figure 2, for 6 the storage sides being positioned at the second machine room by data syn-chronization to 4 the storage sides being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, described synchronization module 420 can by the first storage side 1 of the second machine room by the second storage side 1 of data syn-chronization to the 3rd machine room, by the first storage side 2 of the second machine room by the second storage side 2 of data syn-chronization to the 3rd machine room, by the first storage side 3 of the second machine room by the second storage side 3 of data syn-chronization to the 3rd machine room, by the first storage side 4 of the second machine room by the second storage side 4 of data syn-chronization to the 3rd machine room, by the first storage side 5 of the second machine room by the second storage side 1 of data syn-chronization to the 3rd machine room, by the first storage side 6 of the second machine room by the second storage side 2 of data syn-chronization to the 3rd machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to embodiments of the invention, for wherein each number certificate, described synchronization module 420 can adopt the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data by described one or more first storage side.See Fig. 3, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of one or more Partial synchronizations of a data to the second storage side.As shown in Figure 3, for the first storage side being positioned at the second machine room by five data Partial synchronizations to three data divisions in the second storage side being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, for the data division of 5 in a data, data division 1 can be synchronized to the data division 1 of the second storage side of the 3rd machine room by described synchronization module 420 by the first storage side of the second machine room, by the first storage side of the second machine room, data division 2 is synchronized to the data division 2 of the second storage side of the 3rd machine room, by the first storage side of the second machine room, data division 3 is synchronized to the data division 3 of the second storage side of the 3rd machine room, by the first storage side of the second machine room, data division 4 is synchronized to the data division 1 of the second storage side of the 3rd machine room, by the first storage side of the second machine room, data division 5 is synchronized to the data division 2 of the second storage side of the 3rd machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to a third aspect of the invention we, provide a kind of method 500 of carrying out across machine room data syn-chronization, be applied to distributed information system.In an embodiment of the present invention, distributed information system can be the system adopting distributed treatment to carry out news release and subscription, such as, comprise kafka, RabbitMQ, ActiveMQ, QBus etc.Hereinafter, for QBus system, principle of the present invention will be described in detail, understand principle of the present invention better to help reader.But it will be appreciated by those skilled in the art that scope of the present invention is not limited to QBus system, but go for any distributed information system.QBus system forms primarily of the unit such as publisher (Producer), subscriber (Consumer), storage side (Broker), coordination side (Zookeeper), agent (Agent).Hereinafter, principle of the present invention is illustrated for the transfer of data between publisher, storage side, subscriber by main, equally, scope of the present invention is not limited thereto, but the transfer of data be equally applicable in distributed information system (such as, QBus system) between other unit.
Fig. 5 shows the schematic flow sheet of carrying out according to an embodiment of the present across the method 500 of machine room data syn-chronization.As shown in Figure 5, described method 500 starts from step S510, and wherein, the one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality.That is, a or many number certificates are sent to the one or more first storage sides being positioned at the second machine room by the described one or more publisher being positioned at described first machine room.
After step S510, perform step S520, wherein, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room.Subsequently, in step S530, the one or more subscribers being positioned at the 3rd machine room obtain described portion or many numbers certificate from described one or more second storage side.
According to above-mentioned steps S510, S520, S530, by the transfer of data flow process of publisher's (the first machine room) → the first storage side (the second machine room) → second storage side (the 3rd machine room) → subscriber (the 3rd machine room), achieve the application of Publish-subscribe.
According to embodiments of the invention, in described distributed information system (such as, QBus system), described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
According to embodiments of the invention, the second machine room, the 3rd machine room are positioned at different positions.Alternatively, described second machine room and described 3rd machine room carry out telecommunication.First machine room also can be positioned at different positions from the second machine room and the 3rd machine room, also can carry out telecommunication with the second machine room and the 3rd machine room.Because the data publisher issued to be synchronized to one or more second storage sides of the 3rd machine room being arranged in one or more subscriber this locality from one or more first storage sides of the second machine room, when the subscriber of the 3rd machine room needs described data, avoid and repeatedly between the first storage side of the second machine room and the subscriber of the 3rd machine room, transmit data, but obtain described data from this locality, greatly reduce both network delay.
According to embodiments of the invention, alternatively, after above-mentioned steps S520, namely, in one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after being stored in the 3rd machine room this locality, described method 500 can also comprise optional step: described one or more second storage side exceedes the portion of predefined very first time threshold value or many numbers according to deletion by being stored in the 3rd machine room this locality.In the above-described embodiments, take expiration policies, deleting being stored in the local data exceeding predefined very first time threshold value of the 3rd machine room, avoiding the data that longer-term storage does not re-use or utilization rate is very low, decreasing the burden of the local memory space of the 3rd machine room.The size of described predefined very first time threshold value can be set according to actual needs.
According to embodiments of the invention, alternatively, after above-mentioned steps S520, namely, in one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after being stored in the 3rd machine room this locality, described method 500 can also comprise optional step: when the described portion or many numbers certificate that are stored in the 3rd machine room this locality exceed predefined size, described one or more second storage side by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, exceed the portion of described predefined size or many numbers according to deletion.In the above-described embodiments, take expiration policies, by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, the portion that exceeds described predefined size or many numbers be according to deletion, the data stored in the 3rd machine room this locality are made to be equal to or less than described predefined size, avoid the data that longer-term storage does not re-use or utilization rate is very low, decrease the burden of the local memory space of the 3rd machine room.Described predefined size can be set according to actual needs.
According to embodiments of the invention, above-mentioned steps S520 comprises: described one or more first storage side adopts the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side.See Fig. 2, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of data syn-chronization to the second storage side.As shown in Figure 2, for 6 the storage sides being positioned at the second machine room by data syn-chronization to 4 the storage sides being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, first storage side 1 of the second machine room is by the second storage side 1 of data syn-chronization to the 3rd machine room, first storage side 2 of the second machine room is by the second storage side 2 of data syn-chronization to the 3rd machine room, first storage side 3 of the second machine room is by the second storage side 3 of data syn-chronization to the 3rd machine room, first storage side 4 of the second machine room is by the second storage side 4 of data syn-chronization to the 3rd machine room, first storage side 5 of the second machine room is by the second storage side 1 of data syn-chronization to the 3rd machine room, first storage side 6 of the second machine room is by the second storage side 2 of data syn-chronization to the 3rd machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to embodiments of the invention, above-mentioned steps S520 comprises: for wherein each number certificate, and described one or more first storage side adopts the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data.See Fig. 3, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of one or more Partial synchronizations of a data to the second storage side.As shown in Figure 3, for the first storage side being positioned at the second machine room by five data Partial synchronizations to three data divisions in the second storage side being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, for the data division of 5 in a data, data division 1 is synchronized to the data division 1 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 2 is synchronized to the data division 2 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 3 is synchronized to the data division 3 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 4 is synchronized to the data division 1 of the second storage side of the 3rd machine room by the first storage side of the second machine room, data division 5 is synchronized to the data division 2 of the second storage side of the 3rd machine room by the first storage side of the second machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to a forth aspect of the invention, corresponding with said method 500, provide a kind of device 600 carried out across machine room data syn-chronization, be applied to distributed information system.In an embodiment of the present invention, distributed information system can be the system adopting distributed treatment to carry out news release and subscription, such as, comprise kafka, RabbitMQ, ActiveMQ, QBus etc.Hereinafter, for QBus system, principle of the present invention will be described in detail, understand principle of the present invention better to help reader.But it will be appreciated by those skilled in the art that scope of the present invention is not limited to QBus system, but go for any distributed information system.QBus system forms primarily of the unit such as publisher (Producer), subscriber (Consumer), storage side (Broker), coordination side (Zookeeper), agent (Agent).Hereinafter, principle of the present invention is illustrated for the transfer of data between publisher, storage side, subscriber by main, equally, scope of the present invention is not limited thereto, but the transfer of data be equally applicable in distributed information system (such as, QBus system) between other unit.
Fig. 6 has gone out carrying out according to an embodiment of the present across the mutual schematic diagram in the device 600 of machine room data syn-chronization between modules.Described device 600 comprises reception and memory module 610, synchronization module 620, acquisition module 630.
First, described reception and memory module 610 by one or more first storage sides of being positioned at the second machine room from the one or more publishers being positioned at the first machine room receive a or many numbers according to and to be stored in the second machine room local.That is, a or many number certificates are sent to the one or more first storage sides being positioned at the second machine room by the described one or more publisher being positioned at described first machine room.
Subsequently, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side by described synchronization module 620, local to be stored in the 3rd machine room.Subsequently, described acquisition module obtains described portion or many numbers certificate by the one or more subscribers being positioned at the 3rd machine room from described one or more second storage side.
According to the operation of above-mentioned each module, by the transfer of data flow process of publisher's (the first machine room) → the first storage side (the second machine room) → second storage side (the 3rd machine room) → subscriber (the 3rd machine room), achieve the application of Publish-subscribe.
According to embodiments of the invention, in described distributed information system (such as, QBus system), described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
According to embodiments of the invention, the second machine room, the 3rd machine room are positioned at different positions.In one embodiment, described second machine room and described 3rd machine room carry out telecommunication.First machine room also can be positioned at different positions from the second machine room and the 3rd machine room, also can carry out telecommunication with the second machine room and the 3rd machine room.Because the data publisher issued to be synchronized to one or more second storage sides of the 3rd machine room being arranged in one or more subscriber this locality from one or more first storage sides of the second machine room, when the subscriber of the 3rd machine room needs described data, avoid and repeatedly between the first storage side of the second machine room and the subscriber of the 3rd machine room, transmit data, but obtain described data from this locality, greatly reduce both network delay.
According to embodiments of the invention, alternatively, described device 600 can also comprise optional module: the first removing module (not shown in Figure 6), for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room at described synchronization module 620 by one or more first storage side, after being stored in the 3rd machine room this locality, exceed the portion of predefined very first time threshold value or many numbers according to deletion by described one or more second storage side by being stored in the 3rd machine room this locality.In the above-described embodiments, described first removing module takes expiration policies, delete being stored in the local data exceeding predefined very first time threshold value of the 3rd machine room, avoid the data that longer-term storage does not re-use or utilization rate is very low, decrease the burden of the local memory space of the 3rd machine room.The size of described predefined very first time threshold value can be set according to actual needs.
According to embodiments of the invention, alternatively, described device 600 can also comprise optional module: the second removing module (not shown in Figure 6), for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room at described synchronization module 620 by one or more first storage side, after being stored in the 3rd machine room this locality, when the described portion or many numbers certificate that are stored in the 3rd machine room this locality exceed predefined size, described one or more second storage side by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, exceed the portion of described predefined size or many numbers according to deletion.In the above-described embodiments, described second removing module takes expiration policies, by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, the portion that exceeds described predefined size or many numbers be according to deletion, the data stored in the 3rd machine room this locality are made to be equal to or less than described predefined size, avoid the data that longer-term storage does not re-use or utilization rate is very low, decrease the burden of the local memory space of the 3rd machine room.Described predefined size can be set according to actual needs.
According to embodiments of the invention, described synchronization module 620 can adopt the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side by described one or more first storage side.See Fig. 2, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of data syn-chronization to the second storage side.As shown in Figure 2, for 6 the storage sides being positioned at the second machine room by data syn-chronization to 4 the storage sides being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, described synchronization module 620 can by the first storage side 1 of the second machine room by the second storage side 1 of data syn-chronization to the 3rd machine room, by the first storage side 2 of the second machine room by the second storage side 2 of data syn-chronization to the 3rd machine room, by the first storage side 3 of the second machine room by the second storage side 3 of data syn-chronization to the 3rd machine room, by the first storage side 4 of the second machine room by the second storage side 4 of data syn-chronization to the 3rd machine room, by the first storage side 5 of the second machine room by the second storage side 1 of data syn-chronization to the 3rd machine room, by the first storage side 6 of the second machine room by the second storage side 2 of data syn-chronization to the 3rd machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
According to embodiments of the invention, for wherein each number certificate, described synchronization module 620 can adopt the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data by described one or more first storage side.See Fig. 3, wherein schematically illustrate a kind of according to an embodiment of the invention mode of the orderly poll of employing of embodiment by the schematic diagram of one or more Partial synchronizations of a data to the second storage side.As shown in Figure 3, for the first storage side being positioned at the second machine room by five data Partial synchronizations to three data divisions in the second storage side being positioned at the 3rd machine room, adopt the mode of orderly poll, namely, for the data division of 5 in a data, data division 1 can be synchronized to the data division 1 of the second storage side of the 3rd machine room by described synchronization module 620 by the first storage side of the second machine room, by the first storage side of the second machine room, data division 2 is synchronized to the data division 2 of the second storage side of the 3rd machine room, by the first storage side of the second machine room, data division 3 is synchronized to the data division 3 of the second storage side of the 3rd machine room, by the first storage side of the second machine room, data division 4 is synchronized to the data division 1 of the second storage side of the 3rd machine room, by the first storage side of the second machine room, data division 5 is synchronized to the data division 2 of the second storage side of the 3rd machine room.Above-mentioned example is only a kind of example taking orderly poll synchrodata between multiple storage sides of two machine rooms, scope of the present invention is not limited thereto, and those skilled in the art can adopt other order and corresponding relation to carry out the data syn-chronization of orderly polling mode.
Above-mentioned various embodiment is applicable to, according to whole four aspects of the present invention, repeat no longer one by one.
The invention provides above-mentioned carrying out and, across the method and apparatus of machine room data syn-chronization, be applied to distributed information system.According to embodiments of the invention, the one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality; Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.Because the data publisher issued to be synchronized to one or more second storage sides of the 3rd machine room being arranged in one or more subscriber this locality from one or more first storage sides of the second machine room, when the subscriber of the 3rd machine room needs described data, avoid and repeatedly between the first storage side of the second machine room and the subscriber of the 3rd machine room, transmit data, but obtain described data from this locality, greatly reduce both network delay.According to an alternative embodiment of the invention, adopt the mode of orderly poll to carry out data syn-chronization, farthest can adapt to the different topology structure of each machine room, can also keep or change the metamessage of data neatly; In addition, take expiration policies, decrease the burden of the local memory space of machine room.
Intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment at this method and apparatus provided.Various general-purpose system also can with use based on together with this teaching.According to description above, the structure constructed required by this kind of device is apparent.In addition, the present invention is not also for any certain programmed language.It should be understood that and various programming language can be utilized to realize content of the present invention described here, and the description done language-specific is above to disclose preferred forms of the present invention.
In specification provided herein, describe a large amount of detail.But can understand, embodiments of the invention can be put into practice when not having these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand in each inventive aspect one or more, in the description above to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes.But, the method for the disclosure should be construed to the following intention of reflection: namely the present invention for required protection requires feature more more than the feature clearly recorded in each claim.Or rather, as the following claims reflect, all features of inventive aspect disclosed single embodiment before being to be less than.Therefore, the claims following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.
Those skilled in the art are appreciated that and adaptively can change the module in the device in embodiment and they are arranged in one or more devices different from this embodiment.Some block combiner in embodiment can be become a module or unit or assembly, and multiple submodule or subelement or sub-component can be put them in addition.Except at least some in such feature and/or process or module be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) can by providing identical, equivalent or similar object alternative features replaces.
In addition, those skilled in the art can understand, although embodiments more described herein to comprise in other embodiment some included feature instead of further feature, the combination of the feature of different embodiment means and to be within scope of the present invention and to form different embodiments.Such as, in detail in the claims, the one of any of embodiment required for protection can use with arbitrary compound mode.
Each device embodiment of the present invention with hardware implementing, or can realize with the software module run on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that the some or all functions that microprocessor or digital signal processor (DSP) can be used in practice to realize according to the some or all modules in the device of the embodiment of the present invention.The present invention can also be embodied as part or all the device program (such as, computer program and computer program) for performing method as described herein.Realizing program of the present invention and can store on a computer-readable medium like this, or the form of one or more signal can be had.Such signal can be downloaded from internet website and obtain, or provides on carrier signal, or provides with any other form.
The present invention will be described instead of limit the invention to it should be noted above-described embodiment, and those skilled in the art can design alternative embodiment when not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " or " comprising " is not got rid of existence and do not arrange element in the claims or step.Word "a" or "an" before being positioned at element is not got rid of and be there is multiple such element.The present invention can by means of including the hardware of some different elements and realizing by means of the computer of suitably programming.In the unit claim listing some devices, several in these devices can be carry out imbody by same hardware branch.Word first, second and third-class use do not represent any order.Can be title by these word explanations.
The invention also discloses:
A1. carry out across a method for machine room data syn-chronization, be applied to distributed information system, comprise:
The one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality; And
Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.
A2. the method as described in claim A1, described portion or many numbers comprise according to the step being synchronized to the one or more second storage sides being positioned at the 3rd machine room by wherein said one or more first storage side further: described one or more first storage side adopts the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side.
A3. the method as described in claim A1, described portion or many numbers comprise according to the step being synchronized to the one or more second storage sides being positioned at the 3rd machine room by wherein said one or more first storage side further:
For wherein each number certificate, described one or more first storage side adopts the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data.
A4. the method as described in any one in claim A1 to A3, wherein the second machine room, the 3rd machine room are positioned at different positions.
A5. the method as described in any one in claim A1 to A3, wherein said second machine room and described 3rd machine room carry out telecommunication.
A6. the method as described in any one in claim A1 to A3, wherein in described distributed information system, described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
B7. carry out across a method for machine room data syn-chronization, be applied to distributed information system, comprise:
The one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality;
Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room; And
The one or more subscribers being positioned at the 3rd machine room obtain described portion or many numbers certificate from described one or more second storage side.
B8. the method as described in claim B7, wherein in described one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after the step being stored in the 3rd machine room this locality, described method also comprises:
Described one or more second storage side exceedes the portion of predefined very first time threshold value or many numbers according to deletion by being stored in the 3rd machine room this locality.
B9. the method as described in claim B7, wherein in described one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after the step being stored in the 3rd machine room this locality, described method also comprises:
When being stored in the described portion of the 3rd machine room this locality or many numbers according to when exceeding predefined size, described one or more second side of storageing by be stored in memory time in the portion of the 3rd machine room this locality or many numbers certificate the longest, the portion that exceeds described predefined size or many numbers be according to deletion.
B10, method as described in any one in claim B7 to B9, also comprise:
A or many number certificates are sent to the one or more first storage sides being positioned at the second machine room by the described one or more publisher being positioned at described first machine room.
B11. the method as described in any one in claim B7 to B9, wherein in described distributed information system, described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
C12. carry out across a device for machine room data syn-chronization, be applied to distributed information system, comprise:
Receive and memory module, receive a or many number certificates for one or more first the storages sides by being positioned at the second machine room from the one or more publishers being positioned at the first machine room and be stored in second machine room this locality; And
Synchronization module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.
C13. the device as described in claim C12, wherein said synchronization module adopts the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side by described one or more first storage side.
C14. the device as described in claim C12, wherein said synchronization module, for wherein each number certificate, adopts the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data by described one or more first storage side.
C15. the device as described in any one in claim C12 to C14, wherein the second machine room, the 3rd machine room are positioned at different positions.
C16. the device as described in any one in claim C12 to C14, wherein said second machine room and described 3rd machine room carry out telecommunication.
C17. the device as described in any one in claim C12 to C14, wherein in described distributed information system, described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
D18. carry out across a device for machine room data syn-chronization, be applied to distributed information system, comprise:
Receive and memory module, receive a or many number certificates for one or more first the storages sides by being positioned at the second machine room from the one or more publishers being positioned at the first machine room and be stored in second machine room this locality;
Synchronization module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room; And
Acquisition module, obtains described portion or many numbers certificate for the one or more subscribers by being positioned at the 3rd machine room from described one or more second storage side.
D19. the device as described in claim D18, also comprise the first removing module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room at described synchronization module by described one or more first storage side, after being stored in the 3rd machine room this locality, exceed the portion of predefined very first time threshold value or many numbers according to deletion by described one or more second storage side by being stored in the 3rd machine room this locality.
D20. the device as described in claim D18, also comprise the second removing module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room at described synchronization module by described one or more first storage side, after being stored in the 3rd machine room this locality, when the described portion or many numbers certificate that are stored in the 3rd machine room this locality exceed predefined size, by described one or more second storage side by be stored in the portion of the 3rd machine room this locality or many numbers according in memory time the longest, exceed the portion of described predefined size or many numbers according to deletion.
D21, device as described in any one in claim D18 to D20, also comprising sending module, for the described one or more publisher by being positioned at described first machine room, a or many number certificates being sent to the one or more first storage sides being positioned at the second machine room.
D22. the device as described in any one in claim D18 to D20, wherein in described distributed information system, described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
Claims (10)
1. carry out across a method for machine room data syn-chronization, be applied to distributed information system, comprise:
The one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality; And
Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.
2. the method for claim 1, described portion or many numbers comprise according to the step being synchronized to the one or more second storage sides being positioned at the 3rd machine room by wherein said one or more first storage side further: described one or more first storage side adopts the mode of orderly poll that described portion or many numbers certificate are synchronized to described one or more second storage side.
3. the method for claim 1, described portion or many numbers comprise according to the step being synchronized to the one or more second storage sides being positioned at the 3rd machine room by wherein said one or more first storage side further:
For wherein each number certificate, described one or more first storage side adopts the mode of orderly poll to be stored to a described second storage side as one or more part by one or more Partial synchronizations of described a data.
4. the method as described in any one in claims 1 to 3, wherein the second machine room, the 3rd machine room are positioned at different positions.
5. the method as described in any one in claims 1 to 3, wherein said second machine room and described 3rd machine room carry out telecommunication.
6. the method as described in any one in claims 1 to 3, wherein in described distributed information system, described publisher is Producer, and described first storage side and the second storage side are Broker, and described subscriber is Consumer.
7. carry out across a method for machine room data syn-chronization, be applied to distributed information system, comprise:
The one or more first storage sides being positioned at the second machine room receive a or many number certificates from the one or more publishers being positioned at the first machine room and are stored in second machine room this locality;
Described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room; And
The one or more subscribers being positioned at the 3rd machine room obtain described portion or many numbers certificate from described one or more second storage side.
8. method as claimed in claim 7, wherein in described one or more first storage side, described portion or many numbers certificate are synchronized to the one or more second storage sides being positioned at the 3rd machine room, after the step being stored in the 3rd machine room this locality, described method also comprises:
Described one or more second storage side exceedes the portion of predefined very first time threshold value or many numbers according to deletion by being stored in the 3rd machine room this locality.
9. carry out across a device for machine room data syn-chronization, be applied to distributed information system, comprise:
Receive and memory module, receive a or many number certificates for one or more first the storages sides by being positioned at the second machine room from the one or more publishers being positioned at the first machine room and be stored in second machine room this locality; And
Synchronization module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, call for the one or more subscribers being positioned at the 3rd machine room to be stored in the 3rd machine room this locality.
10. carry out across a device for machine room data syn-chronization, be applied to distributed information system, comprise:
Receive and memory module, receive a or many number certificates for one or more first the storages sides by being positioned at the second machine room from the one or more publishers being positioned at the first machine room and be stored in second machine room this locality;
Synchronization module, for described portion or many numbers certificate being synchronized to the one or more second storage sides being positioned at the 3rd machine room by described one or more first storage side, local to be stored in the 3rd machine room; And
Acquisition module, obtains described portion or many numbers certificate for the one or more subscribers by being positioned at the 3rd machine room from described one or more second storage side.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410844631.1A CN104618219A (en) | 2014-12-30 | 2014-12-30 | Cross-machine-room data synchronizing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410844631.1A CN104618219A (en) | 2014-12-30 | 2014-12-30 | Cross-machine-room data synchronizing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104618219A true CN104618219A (en) | 2015-05-13 |
Family
ID=53152507
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410844631.1A Pending CN104618219A (en) | 2014-12-30 | 2014-12-30 | Cross-machine-room data synchronizing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104618219A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105610933A (en) * | 2015-12-25 | 2016-05-25 | 北京奇虎科技有限公司 | Information management method and device |
| CN109309698A (en) * | 2017-07-28 | 2019-02-05 | 北京京东尚科信息技术有限公司 | Data processing system, method and apparatus |
| CN110309231A (en) * | 2019-07-12 | 2019-10-08 | 焦点科技股份有限公司 | A kind of method of data synchronization and system across computer room |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050060405A1 (en) * | 2002-09-16 | 2005-03-17 | Guy Nathan | Digital downloading jukebox system with central and local music servers |
| CN101291304A (en) * | 2008-06-13 | 2008-10-22 | 清华大学 | Transplantable network information sharing method |
| CN101453624A (en) * | 2008-12-30 | 2009-06-10 | 青岛华威视通数字传媒有限公司 | Playing on demand system for video |
| CN101576934A (en) * | 2009-01-05 | 2009-11-11 | 北京中加国道科技有限公司 | Permanent filing system of network academic resources |
| CN102740122A (en) * | 2012-05-25 | 2012-10-17 | 深圳市华曦达科技股份有限公司 | Method and system for hotel room internet film and television on demand |
| CN102760126A (en) * | 2011-04-26 | 2012-10-31 | 阿里巴巴集团控股有限公司 | Data synchronization method in distributive system, and distributive system |
| CN103036934A (en) * | 2012-09-13 | 2013-04-10 | 曙光信息产业(北京)有限公司 | Wide area network clustered deployment system and method based on mirror image |
| CN103095769A (en) * | 2011-11-04 | 2013-05-08 | 阿里巴巴集团控股有限公司 | Cross-machine-room data synchronism method and system |
-
2014
- 2014-12-30 CN CN201410844631.1A patent/CN104618219A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050060405A1 (en) * | 2002-09-16 | 2005-03-17 | Guy Nathan | Digital downloading jukebox system with central and local music servers |
| CN101291304A (en) * | 2008-06-13 | 2008-10-22 | 清华大学 | Transplantable network information sharing method |
| CN101453624A (en) * | 2008-12-30 | 2009-06-10 | 青岛华威视通数字传媒有限公司 | Playing on demand system for video |
| CN101576934A (en) * | 2009-01-05 | 2009-11-11 | 北京中加国道科技有限公司 | Permanent filing system of network academic resources |
| CN102760126A (en) * | 2011-04-26 | 2012-10-31 | 阿里巴巴集团控股有限公司 | Data synchronization method in distributive system, and distributive system |
| CN103095769A (en) * | 2011-11-04 | 2013-05-08 | 阿里巴巴集团控股有限公司 | Cross-machine-room data synchronism method and system |
| CN102740122A (en) * | 2012-05-25 | 2012-10-17 | 深圳市华曦达科技股份有限公司 | Method and system for hotel room internet film and television on demand |
| CN103036934A (en) * | 2012-09-13 | 2013-04-10 | 曙光信息产业(北京)有限公司 | Wide area network clustered deployment system and method based on mirror image |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105610933A (en) * | 2015-12-25 | 2016-05-25 | 北京奇虎科技有限公司 | Information management method and device |
| CN105610933B (en) * | 2015-12-25 | 2019-03-05 | 北京奇虎科技有限公司 | Approaches to IM and equipment |
| CN109309698A (en) * | 2017-07-28 | 2019-02-05 | 北京京东尚科信息技术有限公司 | Data processing system, method and apparatus |
| US20200204624A1 (en) * | 2017-07-28 | 2020-06-25 | Beijing Jingdong Shangke Information Technology Co., Ltd. | Data processing system, method and apparatus |
| US11588890B2 (en) * | 2017-07-28 | 2023-02-21 | Beijing Jingdong Shangke Information Technology Co., Ltd. | System, method and apparatus having a redundant cluster for processing data |
| CN110309231A (en) * | 2019-07-12 | 2019-10-08 | 焦点科技股份有限公司 | A kind of method of data synchronization and system across computer room |
| CN110309231B (en) * | 2019-07-12 | 2022-07-29 | 焦点科技股份有限公司 | Cross-machine-room data synchronization method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104092719B (en) | Document transmission method, device and distributed cluster file system | |
| CN104731956A (en) | Method and system for synchronizing data and related database | |
| CN103312732A (en) | Method and device for data file transmission | |
| CN103561049A (en) | Method for processing terminal scheduling request, system thereof and device thereof | |
| CN102882985A (en) | File sharing method based on cloud storage | |
| CN104348859B (en) | File synchronisation method, device, server, terminal and system | |
| CN105162879B (en) | Realize the method, apparatus and system of multimachine room data consistency | |
| CN103412786A (en) | High performance server architecture system and data processing method thereof | |
| CN102857578A (en) | File uploading method and file uploading system of network drive and network drive client | |
| CN110502572A (en) | A kind of method and server that data are synchronous | |
| CN103530255A (en) | Distributed asynchronous event processing method and system | |
| CN104462483A (en) | Data synchronizing method, device and system | |
| CN109309736A (en) | The generation method and generating means of globally unique ID | |
| CN105553832A (en) | Message sending and receiving method and device | |
| CN105550246A (en) | System and method for loading network picture under Android platform | |
| CN104618219A (en) | Cross-machine-room data synchronizing method and device | |
| CN109783564A (en) | Support the distributed caching method and equipment of multinode | |
| EP3506599B1 (en) | Method for synchronizing contact information, apparatus and medium | |
| CN110659124A (en) | Message processing method and device | |
| CN101771718A (en) | Clipboard synchronous method and system | |
| CN105302486A (en) | Virtual offline desktop block device storage synchronization method | |
| CN106936917A (en) | A kind of cloud storage method and device, electronic equipment | |
| US9137331B2 (en) | Adaptive replication | |
| CN109600423A (en) | Method of data synchronization, device, electronic equipment and storage medium | |
| CN105721179A (en) | Log collection system and data transmission method and local server therein |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150513 |
|
| RJ01 | Rejection of invention patent application after publication |