Summary of the invention
It is high that technical problem to be solved by this invention is to provide a kind of efficiency of transmission, low and impact to business on server line data back up method and the system that little intranet and extranet penetrate distance data transmission to server requirement.
The object of the invention is to be achieved through the following technical solutions: a kind of intranet and extranet penetrate the data back up method of distance data transmission, comprise the following steps:
The data that A1, locking will be backed up, are synchronized to the transmission preparation module of local Intranet by the Backup Data that source server will transmit;
A2, by described transmission preparation module, data are transferred to the destination server of opposite end by outer net.
Preferably, before described steps A 2, also comprise steps A 0: the bandwidth of continuous surveillance source server end and destination server end and internet I/O service condition, according to network resource utilization arrangement transmission time slot; In described steps A 2: the transmission time slot arranged according to the monitored results of described steps A 0, in source server local network idle, first by data conversion storage to locally buffered module, in correspondent network busy, the data of described locally buffered module are in the transmission wait stage; When correspondent network idle, module of just transfer of data in locally buffered module to the object of correspondent network being plugged into, and unloading is to destination server.
Preferably, in described steps A 2, also comprise steps A 21: when object is plugged into after module receives the data that source server end transmits, first by data conversion storage to storing preparation module; And steps A 22: according to the continuous surveillance result of described steps A 0, when the Intranet of destination server end is in idle, the data in described storage preparation module are write described destination server.
Preferably, in described steps A 2, object is plugged into before module receives the data that source server end transmits and is also comprised steps A 20: carry out Windowingly being divided into the small-sized packet with encapsulation numbering and being temporarily stored in described locally buffered module by queue to data, and described small-sized packet is transferred to described object by the transmission time slot arranged according to described steps A 0 plugs into module.
Preferably, in described steps A 21, when described storage preparation module receive described object plug into module transfer small-sized data protection after, in described storage preparation module, described small-sized packet is packaged simultaneously.
Preferably, in described steps A 2, plug into from described locally buffered module transfer to the object process of module of data described small-sized data is wrapped in correspondent network idle send by described queue sequence and customized number, and described customized number is the quantitative value increased progressively.
Preferably, described customized number is for increase progressively one at every turn.
Intranet and extranet penetrate a source server system for distance data transmission, comprising:
Source server;
The transmission preparation module be connected by local Intranet with source server, described transmission preparation module comprises: first storage device; And first synchronizer for the data syn-chronization to described first storage device that source server will be backed up transmission; And one for transferring to the transmitting device of destination server end by outer net by data by described transmission preparation module.
Preferably, also comprise for continuous surveillance source server end and the bandwidth of destination server end and the monitoring module of internet I/O service condition.
For receiving a destination server system for source server system transfers data described above, comprising:
Destination server;
The storage preparation module be connected by local Intranet with destination server,
Described storage preparation module comprises: second storage device, for receive data that described source server end sends and unloading to the receiving system of described second storage device, and one for by second synchronizer of the data syn-chronization of the second storage device to destination server.
The present invention is due in data transmission procedure, at source server end, transmission preparation module is set, before transfer of data to destination server, first by source server end Intranet, data are directly synchronized in transmission preparation module, like this, shorten the direct range that source server end data copies, the network overhead of source server end can be reduced, meanwhile, reduce the overhead of source server, decrease the impact to business on line.
Embodiment
Below in conjunction with accompanying drawing and preferred embodiment, the invention will be further described.
Embodiment one
As shown in Figure 3, the invention provides the data backup system that a kind of intranet and extranet penetrate distance data transmission, this system comprises source server system and destination server system respectively, and wherein, source server system comprises: source server 100; The transmission preparation module 104 be connected by local Intranet with source server 100, described transmission preparation module 104 is provided with first storage device 103, first synchronizer 105 for the data syn-chronization to described first storage device 103 that source server 100 will be backed up transmission, and one for transferring to the transmitting device 102 of destination server end by outer net by data by described transmission preparation module; Described transmitting device 102 is provided with locally buffered module.In data transmission procedure, source server 100 locks the data that will back up, do not allow normal process revise described in the data that will back up, by source server end Intranet, data are directly synchronized to transmission preparation module 104 to keep in, like this, shorten the direct range that source server end data copies, the network overhead of source server end can be reduced, meanwhile, reduce the overhead of source server 100, decrease the impact to business on line.
Corresponding, destination server system comprises: destination server 200; The storage preparation module 214 be connected by local Intranet with destination server 200, described storage preparation module 214 comprises: second storage device 213, one for receive data that described source server end sends and unloading to the receiving system 212 of described second storage device 213, and one for by second synchronizer 206 of the data syn-chronization of the second storage device 213 to destination server 200, described receiving system 212 is provided with object and plugs into module.Store preparation module 212 for keeping in data at destination server end, when Intranet idle or the destination server 200 business idle of destination server end, data syn-chronization to destination server device 200, is completed the backup procedure of data by storage preparation module 212.Can reduce like this and the business of destination server is impacted, also can reduce the overhead of destination server.
As further improvement of this embodiment, this data backup system also includes one for continuous surveillance source server end and the bandwidth of destination server end and the monitoring module 300 of internet I/O (INPU/OUTPUT) service condition simultaneously, described monitoring module 300 is while the service condition monitoring bandwidth and internet I/O, calculate and discharge transmission time slot, simultaneously, this monitoring module 300 is provided with communication module 301 in order to carry out command between source server end and destination server end, instruction scheduling is carried out between source server 100 and destination server 200, the transmission of data is dispatched, the transmission quantity of control data and transmission time, guarantee to cause burden to the regular traffic of system in transmitting procedure.
Based on above-mentioned data backup system, as shown in Figure 2, composition graphs 3, the backup method of described data is as follows:
A0: the bandwidth of continuous surveillance source server end and destination server end and internet I/O service condition, according to network resource utilization arrangement transmission time slot;
The data that A1, locking will be backed up, are synchronized to the transmission preparation module 104 of local Intranet by the Backup Data that source server 100 will transmit;
A2, by described transmission preparation module 104, data are transferred to the destination server 200 of opposite end by outer net.
Described steps A 2 can specifically be split as:
Steps A 20: carry out Windowingly being divided into the small-sized packet with encapsulation numbering and being temporarily stored in described locally buffered module 106 (transmitting device) by queue in transmission preparation module 104 pairs of data, and described small-sized packet is transferred to described object by the transmission time slot arranged according to described steps A 0 plugs into module 206 (receiving system);
Steps A 21: when object is plugged into after module 206 receives the small-sized packet that source server end transmits, first by data conversion storage to storing preparation module 214 and packaging;
Data in described storage preparation module 214, when the Intranet of destination server end is in idle, are write described destination server 200 by steps A 22: according to the continuous surveillance result of described steps A 0.
The carrying out of above steps A 20 to A22, that the transmission time slot arranged according to the monitored results of described steps A 0 carries out, in source server end local network idle, first by data conversion storage to locally buffered module 106, in correspondent network busy, the data of described locally buffered module 104 are in the transmission wait stage; When correspondent network idle, just the transfer of data in locally buffered module 104 to the object of correspondent network to be plugged into module 206, and unloading is to described storage preparation module 214, when destination server end local network idle, described storage preparation module 214 by data syn-chronization to destination server 200.
More than the specific descriptions to one embodiment of the invention and introduction, below, for above-described embodiment, conducted further description by a concrete transmitting procedure of Backup Data.
When backing up beginning, first source server 100 locks the data that will back up, normal process is not allowed to revise or data to back up, after receiving dispatch command, by data syn-chronization in transmission preparation module 104, when total data enters transmission preparation module 104, namely full backup data off-line is thought, source server 100 completes backup tasks, and remaining task source server no longer participates in, and can reduce the overhead of source server like this; Monitoring module 300 is set up instruction at source server end with destination server end and is connected, between two servers only directly transmitting and scheduling command information in order to the transmission of data dispatching, in described monitoring module 300 built-in poor time work sequence, can the local and far-end bandwidth of intelligent computation and internet I/O service condition, according to network resource utilization arrangement transmission time slot; When local network idle is to be transmitted to locally buffered module 106 etc. by data conversion storage, when being in opposite end net busy, data are in the transmission wait stage, when bipartite network idle, monitoring module 300 can initiate ready instruction to transmission preparation module 104, policybased routing in the locally buffered module 106 of data separate selects the plug into gateway of module 206 of gateway and object to connect, and data are imported into opposite end object by Choice encryption link plugs into module 206; Same monitoring module 300 also calculates the Internet usage situation of opposite end Intranet at any time, then calls transmission engine data are write destination server 200 by storing preparation module 214 when opposite end (destination server end) Intranet is in idle.
By transmission preparation module 104 and the data buffering storing preparation module 214, transfer of data is reduced server performance requirement, transmission process in can be few take server and Internet resources, through multi-buffer in the process of long range propagation, transmission time slot is designed by monitoring module 300, make it reduce network degree of dependence, and the normal work of service environment Intranet can not be affected.In addition, source server and destination server do not need directly to set up session connection, but the session connection at two ends is realized by monitoring module, and directly carry out instruction scheduling, avoid occurring that remote session keeps the situation of interrupting, it also avoid once occur interrupting complicated for experience to re-establish process, just avoid simultaneously and extend the data Replica time and add maintenance difficulties.
As shown in Figure 4, in the present embodiment data transmission procedure:
Described steps A 20 pairs of data carry out Windowing segmentation, are first to be divided into the 8k with encapsulation numbering to wrap data according to Internet Transmission window, then subpackage queue are stored in locally buffered module 106 and wait for sending of transmitting and scheduling; In object plugs into subpackage queue that module 206 receives, the unpack group packet protocol built-in according to dispatch layer is chosen corresponding bag and is packaged, and this behavior completes in storage preparation module, and the data after completing are partial data and through completeness check.
Monitoring module 300 can be monitored network, when network be in idle use customized based on priority algorithm strategy by the small-sized packet of 8k in order and customized number send, customized number can be arranged in dispatching control desk, the present embodiment acquiescence increases progressively by 1, as the transmission time slot that network idle arranges according to monitoring module 300, leading transmission 8k packet, then two 8k packets are sent as network is still unimpeded, still unimpeded then simultaneously send three 8k packets, by that analogy, increase progressively a small-sized packet at every turn, until monitoring module 300 monitors and again runs into network busy hour and then exit transmit queue, it is to be sent that the packet do not sent reenters local buffer Bao Chi etc.
Dispatch layer in monitoring module 300 is in beyond transmission channel, parallel with transmission channel, belong to monitor bypass and switch control rule class function, can monitor local buffer and object controlled area in transmission controls, and the network busy degree intelligence of comprehensive two end points makes transmission judgement simultaneously; Monitor function also bears the functions such as production environment survival inspection and corresponding recovery instruction except monitoring network; Except monitoring, the administrative mechanism of dispatch layer is also applied to be disassembled group bag to data and waits operation, the agreement support that this generic operation has both-end to permit, ensure that the safety of data and complete.
Embodiment two
The present embodiment is based on the further improvement of above-described embodiment, and above-described embodiment is mainly the optimization to data transmission procedure, and the present embodiment is mainly to be optimized the structure of Backup Data.
As shown in Figure 7, and composition graphs 6, concrete steps are as follows:
S1, source server end confirm whether backup is back up first, if back up first, generate full backup data, and carry out encrypted transmission to destination server end; Otherwise, upper backup basis once generates incremental backup data, and carries out encrypted transmission to destination server end.
It is back up first that S2, destination server end carry out judging whether after receiving Backup Data, if so, then backs up first as section backup data store;
S3 if not back up first, is then decrypted the incremental backup received, and, is decrypted the incremental backup data of last time meanwhile;
S4, the incremental backup data after deciphering and last Backup Data of cut into slices are combined to form new section Backup Data at destination server end this locality off-line, wherein, off-line combination is the process data convert of incremental backup being formed new slice of data to last section Backup Data, and it is the same for reducing with existing incremental backup;
S5, by combination after new section Backup Data re-start cryptographic storage.
The present embodiment can obtain again the full dose data before any historical time stamp when there is bust or some specific demand while of can recovering nearest incremental data.
For above-mentioned data back up method, the present embodiment provides the method for date restoring simultaneously, comprises the following steps:
S6, timestamp according to section Backup Data, select the section Backup Data including all previous incremental backup content that will recover;
S7, by the section Backup Data direct-reduction of destination server end selected in step a to source server end.
If destination server end forms section Backup Data to the last incremental backup and stores, then restoration methods is as follows:
A1, timestamp according to section Backup Data, select the section Backup Data including the last incremental backup content that will recover;
B1, by the section Backup Data direct-reduction of destination server selected in step a1 to source server.
For said method, as shown in Figure 6, the present embodiment provides corresponding transfer of data standby system simultaneously, comprise: source server system 110 and destination server system 210, wherein, the source server of source server system 110 generates incremental backup data or backs up full dose data first, and be encrypted and transfer to destination server system 210, data store after destination server system 210 combines.
Concrete, destination server system 210 comprises: for receive incremental backup data that source server end sends or full backup data receiver module 211, for store the last section Backup Data section back-up storage module 215 and for incremental backup data and last Backup Data of cutting into slices being combined to form new section Backup Data at local off-line and being stored to the section group bag module 212 of described section back-up storage module 215.
In order to ensure fail safe and the integrality of transfer of data, the present embodiment be also provided with simultaneously data are encrypted and decrypted encrypting module and deciphering module 214, be provided with the data after to deciphering simultaneously and carry out the interim analogue data storehouse 213 stored.
For incremental backup, after receiver module 211 receives the next incremental backup data of source server end 100 transmission, first receiver module 211 is decrypted this incremental backup data, moves into section group bag module 212 afterwards; Simultaneously, backup logic recalls the last time section Backup Data in section back-up storage module 215, by deciphering module 214, this section Backup Data is decrypted, and the integrality of teaching and research data, move into afterwards in analogue data storehouse 213, this system bin can only pass through administrative staff's identification data health degree, cannot carry out any operation outside system bin to data; New section Backup Data is synthesized by carrying out offline group with incremental backup data in the section Backup Data immigration section group bag module 212 after deciphering after slice group bag module 212 is ready, afterwards new section Backup Data is moved into encrypting module 214 pairs of data to be encrypted, then in section back-up storage module 215, carry out cycle static storage.
Same, recover the process of data, first select the section Backup Data needing to recover according to timestamp, recall from section back-up storage module 215 and decipher in deciphering module 214, then directly returning to source server end.
Above content is in conjunction with concrete preferred implementation further description made for the present invention, can not assert that specific embodiment of the invention is confined to these explanations.For general technical staff of the technical field of the invention, without departing from the inventive concept of the premise, some simple deduction or replace can also be made, all should be considered as belonging to protection scope of the present invention.