CN101394424A - Hard disc stage network data backup system and method - Google Patents
Hard disc stage network data backup system and method Download PDFInfo
- Publication number
- CN101394424A CN101394424A CNA2008102249418A CN200810224941A CN101394424A CN 101394424 A CN101394424 A CN 101394424A CN A2008102249418 A CNA2008102249418 A CN A2008102249418A CN 200810224941 A CN200810224941 A CN 200810224941A CN 101394424 A CN101394424 A CN 101394424A
- Authority
- CN
- China
- Prior art keywords
- backup
- data
- recovery agent
- storage device
- agent device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a method and a system for disk-level network data backup. The method comprises the following steps: (1) transmitting a backup task to a backup recovery agent device of a terminal corresponding to the backup terminal by a centralized control device, and receiving the backup task by the backup recovery agent device; (2) determining the data amount of the backup by the backup recovery agent device, and applying a storage management device for a storage resource for the backup; (3) allocating the storage resources by the storage management device, and returning the information of the storage resources to the backup recovery agent device; (4) reading the backup data after the backup recovery agent device acquires the information of the storage resources, and transmitting the backup data to a backup server device of an appointed storage device; and (5) receiving the backup data by the backup server device, and writing the backup data to a storage medium of the storage device.
Description
Technical field
The present invention relates to the data backup field, relate in particular to a kind of system and method field of hard disc stage network data backup.
Background technology
Along with the continuous development of computer technology and improving constantly of the level of informatization, people are more and more higher to the degree of dependence of information.The high concentration of information in the IT environment stored, and improved the automation of information and data management to a great extent, improved efficiency of operation, reduced cost.But simultaneously, risk is also in continuous increase, and the loss of data that the disaster generation is caused may cause tremendous loss.
For fear of the adverse effect that disaster is brought, need carry out regularly or real-time backup data.But present calamity is equipped with technology and exists with the service application logical interdependency is too strong, construction cost is high and build up back problem difficult in maintenance, and these problems cause disaster recovery and backup systems can't satisfy the current large-scale market demand.Based on the problems referred to above, both at home and abroad manufacturer begins to pay close attention to the research and development of the low-cost disaster recovery and backup systems of structure-irrelevant, and how primary study reduces the construction cost of disaster recovery and backup systems and build difficulty; At safeguarding difficult problem, engendered at present the demand that the 3rd calamity is equipped with service both at home and abroad, third party's calamity is equipped with the scale in market in continuous expansion, yet present calamity is equipped with technology and can't supports really that third party's calamity is equipped with the construction in market, therefore, to support the low-cost network calamity of third party's disaster recovery and backup systems construction to be equipped with technology be the important trend that present calamity is equipped with technical development in research and development.
Summary of the invention
For addressing the above problem, the invention discloses a kind of system and method for hard disc stage network data backup, by adopting the multiple users share calamity to be equipped with data storage facility, full dose repeatedly increment combines, and provide a kind of and can carry out method of data backup and system at the system of various application terminals based on the efficient data recovery technology of stack, be equipped with the construction that technology and product exist, the problem that maintenance is expensive, versatility is low to overcome calamity.
The invention discloses a kind of method of hard disc stage network data backup, comprising:
Step 1, central control device sends described backup tasks to the backup recovery agent device of the terminal of backup tasks correspondence, and described backup recovery agent device receives described backup tasks;
Step 2, described backup recovery agent device is determined the data volume of data to be backed up according to described backup tasks, is used to back up the storage resources of described data to be backed up to the memory management unit application according to the data volume of described data to be backed up;
Step 3, described memory management unit distributes described storage resources, and gives described backup recovery agent device with the information-reply of the storage resources that distributes;
Step 4, after described backup recovery agent device obtains the information of storage resources of described distribution, read the Backup Data of described terminal, described Backup Data is sent to backup services end device in the storage device, and described storage device is the specified storage device of information of the storage resources of described distribution;
Step 5, described backup services end device receives described Backup Data, described Backup Data is write the storage medium of described storage device.Also comprise after the described step 5:
Step 21, described central control device sends described recovery tasks to the backup recovery agent device of the terminal of recovery tasks correspondence, and described backup recovery agent device receives described recovery tasks;
Step 22, described backup recovery agent device are inquired the memory location of described restore data to described memory management unit;
Step 23, described memory management unit find described restore data corresponding Backup Data in some or a plurality of storage devices, give described backup recovery agent device with the information-reply of described storage device; Step 24, described backup recovery agent device sends recovery request to the backup services end device of described restore data place storage device, to obtain restore data;
Step 25, described backup services end device reads restore data according to described recovery request from the storage medium of described storage device, and sends to described backup recovery agent device;
Step 26, described backup recovery agent device write the restore data that receives the disk of described terminal.
Also comprise between described step 1 and the described step 2:
Step 31, when described backup tasks was incremental backup, described backup recovery agent device judged whether the increment monitored results is complete, if, then obtain monitoring snapshot table, otherwise, to the memory location of described memory management unit inquiry Backup Data;
Step 32, described memory management unit is given described backup recovery agent device with the information-reply of Backup Data place storage device;
Step 33, described backup recovery agent device sends check request to the backup services end device of described storage device;
Step 34, described backup services end device reads Backup Data according to described check request from the storage medium of described storage device, and the calculation check value sends to described backup recovery agent device with described check value;
Step 35, described backup recovery agent device are calculated on the disk of described terminal the check value with the data of described Backup Data correspondence, and two check values are compared, and comparative result is recorded in the verification snapshot table.
Backup recovery agent device described in the described step 31 judges that whether complete the increment monitored results further for after described backup recovery agent device judges last incremental backup, whether described terminal did not stop, if, then described increment monitored results is finished, otherwise described increment monitoring result is imperfect;
The information-reply of the storage device that the last backup that described step 32 further will find for described memory management unit is used is given described backup recovery agent device.
Also comprise between the described step 1 and described 2:
Step 51, when described backup tasks was full backup, described backup recovery agent device was obtained the disk snapshot table.
Determine described in the described step 2 that the backed up data amount is further for to determine the backed up data amount according to described monitoring snapshot table, described verification snapshot table or described disk snapshot table.
Central control device sends described backup tasks to the backup recovery agent device of the terminal of backup tasks correspondence and further is in the described step 1,
Step 71 reads configuration information, sets up task list;
Step 72 is checked the task in the described task list one by one, satisfies schedulable condition in checked task, and described task is when being backup tasks, sends described task to the backup recovery agent device of the terminal of described task correspondence.
Central control device described in the described step 21 sends described recovery tasks to the backup recovery agent device of the terminal of recovery tasks correspondence,
Step 81 reads configuration information, sets up task list;
Step 82 is checked the task in the described task list one by one, satisfies schedulable condition in checked task, and described task is when being recovery tasks, sends described task to the backup recovery agent device of the terminal of described task correspondence.
Described memory management unit memory allocated resource in the described step 3 further is:
Step 91, described memory management unit judge whether described terminal did not carry out backup, if then the storage medium of allocation space maximum is as the storage resources of described terminal; Otherwise, distribute the storage resources of the storage medium of described terminal Last Backup use as described terminal.
Also comprise in the described step 5:
Reading restore data according to described recovery request from the storage medium of described storage device in the described step 25 further is,
Step 111, the data directory of point merges to recovery time of described recovery request appointment, generates the new data index, reads restore data according to described new data index from the storage medium of described storage device.
Backup services end device described in the described step 34 reads Backup Data according to described check request from the storage medium of described storage device,
Step 121, the data directory of point merges to recovery time of described check request appointment, generates the new data index, reads Backup Data according to described new data index from the storage medium of described storage device.
Described step 3 comprises that also described memory management unit is safeguarded a bivariate table, the storage device of record Backup Data and described Backup Data correspondence;
Described step 23 further is, described memory management unit is searched described bivariate table, obtains the information of storage device at the Backup Data place of described restore data correspondence, gives described backup recovery agent device with the information-reply of described storage device.
The invention also discloses a kind of system of hard disc stage network data backup, comprise a plurality of terminals and be used for being connected the communication network that described system installs, described terminal comprises disk, described terminal also comprises backup recovery agent device, described system also comprises: central control device, memory management unit and a plurality of storage device, described storage device comprises storage medium and the backup services end device that is used for store backup data
Described central control device is used for sending described backup tasks to the backup recovery agent device of the terminal of backup tasks correspondence;
Described backup recovery agent device, be used for receiving described central control device behind the backup tasks of its transmission, determine the data volume of data to be backed up according to described backup tasks, be used to back up the storage resources of described data to be backed up according to the data volume of described data to be backed up to the memory management unit application; After the information of the storage resources that obtains described memory management unit distribution, the Backup Data of terminal under reading, described Backup Data is sent to backup services end device in the storage device, and described storage device is the specified storage device of information of the storage resources of described distribution;
Described memory management unit is used to backup to distribute described storage resources, and the backup recovery agent device of giving the application storage resources with the information-reply of the storage resources that distributes;
Described backup services end device is used to receive the Backup Data of backup recovery agent device to its transmission, the storage medium of storage device under described Backup Data is write.
Described central control device also is used for sending described recovery tasks to the backup recovery agent device of recovery tasks counterpart terminal;
Described backup recovery agent device also is used for when receiving the recovery tasks of described central control device, to the memory location of described memory management unit inquiry restore data; After the information of the described restore data place storage device that receives described memory management unit answer, to the backup services end device transmission recovery request of described restore data place storage device, to obtain restore data; The described backup services end device that receives is write the disk of affiliated terminal to the restore data of its transmission;
Described memory management unit also is used for finding described restore data after some or a plurality of storage devices have corresponding Backup Data, gives described backup recovery agent device with the information-reply of described storage device;
Described backup services end device also is used for according to the recovery request of backup recovery agent device to its transmission, reads restore data from the storage medium of affiliated storage device, and sends to described backup recovery agent device.
Described backup recovery agent device also is used for when described backup tasks is incremental backup, judges whether the increment monitored results is complete, if then obtain monitoring snapshot table; Otherwise, memory location to described memory management unit inquiry Backup Data, backup services end device to described storage device after the information of the storage device that receives described memory management unit answer sends check request, receiving the backup services end device behind the test value of its transmission, under calculating on the disk of terminal with the check value of the data of described Backup Data correspondence, two check values are compared, comparative result is recorded in the verification snapshot table;
Described memory management unit, the information-reply that also is used for the Backup Data place storage device that will find is given described backup recovery agent device;
Described backup services end device also is used for according to the check request of backup recovery agent device to its transmission, reads Backup Data from the storage medium of affiliated storage device, and the calculation check value sends to described backup recovery agent device with described check value.
Described backup recovery agent device is further used for when judging that described increment monitored results is whether complete, judge last incremental backup after, whether described terminal did not stop, if then described the increment monitored results is complete fully, otherwise described increment monitored results is imperfect;
Described memory management unit, the information-reply that is further used for the storage device that the last backup that finds is used is given described backup recovery agent device.
Described backup recovery agent device also is used for obtaining the disk snapshot table when described backup tasks is full backup.
Described backup recovery agent device is further used for determining the backed up data amount according to described monitoring snapshot table, described verification snapshot table or described disk snapshot table.
Described central control device is further used for reading configuration information, sets up task list; Check the task in the described task list one by one, satisfy schedulable condition, and described task is when being backup tasks, send described task to the backup recovery agent device of the terminal of described task correspondence in checked task.
Described central control device is further used for reading configuration information, sets up task list; Check the task in the described task list one by one, satisfy schedulable condition, and described task is when being recovery tasks, send described task to the backup recovery agent device of the terminal of described task correspondence in checked task.
Described memory management unit is further used for when the memory allocated resource, judges whether the terminal that backs up did not carry out backup, if then the storage medium of allocation space maximum is as the storage resources of described terminal; Otherwise, distribute the storage resources of the storage medium of described terminal Last Backup use as described terminal.
Described backup services end device, whether the copy that also is used for judging described storage device Backup Data exceeds the default copy number of depositing, if, then the copy number in the described storage device is deducted the default copy number of depositing and obtain difference, difference is n, the copy of n time Backup Data the earliest in the copy of described storage device is merged, keep the copy number of appointment to guarantee described storage device.
Described backup services end device be further used for according to the recovery request that receives when the storage medium of affiliated storage device reads restore data, the data directory that put the recovery time of described recovery request appointment merges, generate the new data index, read restore data from the storage medium of described storage device according to described new data index.
Described backup services end device be further used for according to the check request that receives when the storage medium of described storage device reads Backup Data, the data directory that put the recovery time of described check request appointment merges, generate the new data index, read Backup Data from the storage medium of described storage device according to described new data index.
Described memory management unit also is used to safeguard a bivariate table, the storage device of record Backup Data and described Backup Data correspondence; When the storage device of definite restore data place, search described bivariate table, obtain the information of storage device at the Backup Data place of described restore data correspondence, give described backup recovery agent device with the information-reply of described storage device.
Beneficial effect of the present invention is, because method and system of the present invention backs up the irrelevant of upper layer applied business, so can carry out data backup and recovery to the terminal that adopts any service application type; Backup has adopted cheaply that memory device has made up storage platform, can reduce the construction cost of standby system; Each memory device can independently carry out data interaction with the terminal that backs up, and has realized parallel I/O, has improved the efficient of transmission.
Description of drawings
Fig. 1 is a hard disc stage network data backup system construction drawing of the present invention;
Fig. 2 hard disc stage network data backup method flow diagram of the present invention;
Fig. 3 is the operational flow diagram of the backup recovery agent device of terminal;
Fig. 4 is the checking process figure of the backup recovery agent device of terminal;
Fig. 5 is the operational flow diagram of memory management unit;
Fig. 6 is the operational flow diagram of backup services end device;
Fig. 7 is the scheduling flow figure of central control device.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 is a system construction drawing of the present invention, and system of the present invention comprises terminal 101, storage device 102, is used for the communication network 103 of connected system device, central control device D, memory management unit B; Terminal 101 comprises backup recovery agent device A and disk F, and storage device 102 comprises backup services apparatus C and is used for the storage medium E of store backup data.Communication network 103 in the present embodiment is the Internet or local area network (LAN).
Backup recovery agent device A is used to receive the task of central control device D, carries out concrete backup, verification or recovery operation according to the task type that receives.After backup recovery agent device A receives the backup tasks of central control device D, send the storage resources that backup instruction is used to back up with application to memory management unit B, behind the storage resources that acquisition is used to back up, C sends backup request to the backup services end device, begin to back up, the data of reading disk F send the data to backup services end device C; When backup recovery agent device A finds that the increment monitored results is imperfect, B sends checking command to memory management unit, to obtain the stored position information of Backup Data, backup services end device C to the stored position information appointment sends check request then, the check value that obtains data from stores service end C carries out verification operation, generates verification snapshot table; When receiving the recovery tasks of central control device D transmission, send the recovery instruction to memory management unit B, memory location with the inquiry restore data, after receiving the information of the restore data place storage device that memory management unit B replys, backup services end device C to restore data place storage device 102 sends recovery request, and the restore data that the backup services end device C that receives is sent writes among the disk F of affiliated terminal; And when carrying out incremental backup operations, the write operation of monitoring disk F, the disk sector that record is more corrected one's mistakes generates increment snapshot table.
Backup recovery agent device A supports full backup and two kinds of backup modes of incremental backup, and full backup backs up all sector datas on the specified volume, and incremental backup only backs up the sector data that changes behind Last Backup according to the result of monitoring; Backup recovery agent device A can work in full backup, incremental backup and write the monitoring three phases, in full dose or incremental backup stage, when the reading disk sector data backs up, disk write operation is monitored and record, read the time point consistency that mechanism has guaranteed Backup Data before employing is write; Only monitor disk write operation writing monitor stages, and with the disk sector of the form record change of snapshot table.
Memory management unit B is used for the storage system that managing storage is formed, and the Backup Data of depositing in storage system.Behind the backup instruction that receives backup recovery agent device A,, give backup recovery agent device A with the storage resources information-reply for this time backup memory allocated resource; When recovery instruction that receives backup recovery agent device A or checking command, the stored position information that recovers Backup Data is replied to backup recovery agent device A.
Backup services end device C is used to support backup recovery agent device A to finish backup, recovery and verification operation.When backup, the data of receiving terminal 101 are among the storage medium E with data write storage device 102; During recovery, from storage medium E, read Backup Data, send the backup recovery agent device A of the terminal 101 of backup recovery after the encryption to according to the recovery request information that receives; During verification, backup services end device C reads Backup Data according to the check request that receives from storage medium E, the MD5 value of piecemeal calculated data, the size of piecemeal can according to circumstances define, for example can be defined as 32K, the sector number in each piecemeal all is continuous, if the not enough 32K of continuous sector data, then get the data computation MD5 value of actual size, start sector number, end sector number and the corresponding M D5 value with data block sends backup recovery agent device A to then; And the Backup Data among the storage medium E is regularly carried out copy merge.
Backup services end device C is when handling backup request, if what Backup Data copy number had surpassed appointment in the storage device 102 deposits the copy number, the copy number of depositing that existing copy number is deducted appointment obtains difference, this difference is for surpassing the copy number n, a time n+1 the earliest copy in the existing copy is merged, guarantee that storage device keeps the copy number of appointment; When handling recovery or check request, if one time recovery request is specified the Backup Data that recovers a plurality of time points, backup service device merges the archive index of a plurality of time points, generates one and merges index, reads according to this index that Backup Data recovers or verification.
Central control device D provides the interface of configuration-system information, and can be according to other device in user's the configuration information management system.Configuration information wherein comprises mission bit stream, backup client client information, user profile, medium information, backup data information and the system parameters etc. of configuration.By controlling backup recovery agent device A to backup recovery agent device A transmission task.The mode of triggering central control device D transmission task has multiple, provides two kinds in the present embodiment, and a kind of is that operation plan triggers, and another kind is a manual triggers.To be central control device D determine to start moment of task according to operation plan to the operation plan triggering mode, and when satisfying schedulable condition, central control device D sends to task the backup recovery agent device A of task correspondence; The manual triggers mode directly sends instruction by the user exactly, and central control device D sends task according to this instruction to the backup recovery agent device A of task correspondence.
Figure 2 shows that method flow of the present invention.
Step S201, central control device D sends backup tasks to the backup recovery agent device A of the terminal 101 of backup tasks correspondence; Backup recovery agent device A receives this backup tasks.
Step S202, backup recovery agent device A determine the backed up data amount, apply for the storage resources that is used to back up to memory management unit B.
Step S203, memory management unit B memory allocated resource, and give backup recovery agent device A with the information-reply of the storage resources that distributes.
After the information of the storage resources that step S204, backup recovery agent device A to distribute, the Backup Data of reading terminals 101 sends to this Backup Data the backup services end device C of storage device 102 of information appointment of the storage resources of distribution.
Step S205, backup services end device C receives Backup Data, Backup Data is write the storage medium E of storage device 102.
Also comprise between step S201 and the step S202:
Step S211, when backup tasks was incremental backup, backup recovery agent device A judged whether the increment monitored results is complete, if, then obtain monitoring snapshot table, otherwise, to the memory location of memory management unit B inquiry Backup Data.
Step S212, memory management unit B replies to backup recovery agent device A with the stored position information of Backup Data.
Step S213, backup recovery agent device A sends check request to the backup services end device C of storage device 102.
Step S214, backup services end device C reads Backup Data, the calculation check value according to described check request from the storage medium E of storage device 102.
Step S215, backup services end device C sends to backup recovery agent device A with check value; The disk F of backup recovery agent device A computing terminal 101 goes up the check value with the data of described Backup Data correspondence, and two check values are compared, and comparative result is recorded in the verification snapshot table.
Step S221, central control device D sends recovery tasks to the backup recovery agent device A of the terminal 101 of recovery tasks correspondence, and backup recovery agent device A receives this recovery tasks;
Step S222, backup recovery agent device A is to the memory location of memory management unit B inquiry restore data.
Step S223, memory management unit B gives backup recovery agent device A with the information-reply of the restore data place storage device that finds.
Step S224, backup recovery agent device A sends recovery request to the backup services end device C of restore data place storage device 102, to obtain restore data.
Step S225, backup services end device C reads restore data according to recovery request from the storage medium E of storage device 102,
Step S226, backup services end device C send restore data to backup recovery agent device A; Backup recovery agent device A writes the restore data that receives the disk F of terminal 101.
Figure 3 shows that the workflow of backup recovery agent device A.Backup recovery agent device A is responsible for backup, verification, the recovery operation on the terminal 101, the action of backup recovery agent device A is by central control device D centralized control, carry out backup, verification or recovery operation according to the task that central control device D sends, concrete implementation is as follows:
Steps A 301, backup recovery agent device A waits for the task that central control device D sends that receives.
Steps A 302, the reception task.
Steps A 303, judgement receives the type of task, if backup tasks, execution in step A304.If recovery tasks, execution in step A316.
Steps A 304, the type of judgement backup tasks, if full backup, execution in step A305, if incremental backup, execution in step A306.
Steps A 305 is obtained the disk snapshot table.
Steps A 306 judges whether to carry out full backup, if do not carry out, and execution in step A305, otherwise, execution in step A307.
Steps A 307, judge incremental backup last time after system whether stopped, if do not stop, execution in step A308, otherwise, execution in step A309.
Steps A 308 is obtained monitoring snapshot table.
Steps A 309 is carried out checking procedure, generates verification snapshot table.
Steps A 310 according to disk snapshot table, monitoring snapshot table, verification snapshot table, is determined backup data quantity.
Steps A 311 sends backup instruction to memory management unit B, with application back-up storage resource.
Steps A 312 transmits backup request to the backup services end device C of storage device 102.
Steps A 313 transmits backup data index.
Steps A 314, the cyclic transfer Backup Data.
Steps A 315, Backup end returns steps A 301.
Steps A 316 sends the recovery instruction to memory management unit B, to obtain the stored information of Backup Data.
Steps A 317 sends recovery request to the backup services end device C of storage device 102.
Steps A 318, circulation is write on the disk F from the storage medium E reading of data of storage device 102.
Steps A 319 is recovered to finish, and returns steps A 301.
Figure 4 shows that the workflow diagram of backup recovery agent device A checking procedure, when the increment monitored results is imperfect, this process is used to guarantee the integrality of incremental data, the data mode of current Disk State with the last backup point of storage end compared, produce verification snapshot table according to difference, the data in magnetic disk of this correspondence of bit representation that in the verification snapshot table is " 1 " is different with data among the storage medium E, need back up; Otherwise " 0 " expression is identical with data in the storage medium, does not need to back up.The idiographic flow of checking procedure is as follows:
Steps A 401 sends checking command to memory management unit B, and the information of the storage device 102 of Backup Data is deposited in request.
Steps A 402 is obtained the disk snapshot table.
Steps A 403 is with the zero clearing of verification snapshot table.
Steps A 404 is sent check request to the backup services end device C of storage device 102.
Steps A 405 receives checking data, and the form of the data that receive is start sector number, continuous sector number and the check value of this section sector data.
Steps A 406 judges whether checking data corresponding position in the disk snapshot table is 1, if be 1, and execution in step A407 then; Otherwise, execution in step A405.Wherein, the corresponding disk sector of " 1 " expression is used in the disk snapshot table; The corresponding disk sector of " 0 " expression is not used.
Steps A 407 reads corresponding sectors of data from disk.
Steps A 408 is calculated the MD5 check value.
Steps A 409 judges whether this value equates with check value in the checking data that receives, if equate execution in step A411; Otherwise, execution in step A410.
Steps A 410 is 1 with position corresponding in the verification snapshot table.
Steps A 411 is judged whether checking data transmits to finish, and finishes if transmit, and then checking procedure finishes; Otherwise, execution in step A405.
Figure 5 shows that the workflow diagram of memory management unit B, concrete implementation is as follows:
Step B501 waits for the instruction of the backup recovery agent device A transmission of receiving terminal 101.
Step B502 receives instruction.
Step B503, the decision instruction type, if backup, execution in step B504; If verification, execution in step B509; If recover, carry out B510.
Step B504 judges whether this terminal 101 backed up, if do not back up, and execution in step B505; If backed up, execution in step B506.
Step B505, this terminal 101 is obtained the storage medium E of free space maximum in the resource pool.
Step B506 obtains the storage medium E that these terminal 101 Last Backups use from resource pool.
Step B507 sends the memory allocated resource information to terminal 101.
Step B508, the storage resources information of storage medium E in the modification resource pool;
Step B509 searches the storage medium E that stores these terminal 101 last Backup Datas.
Step B510 searches the storage medium E at terminal 101 restore data places.
Step B511 sends stored position information to the terminal 101 that sends instruction.
Memory management unit B safeguards a bivariate table, in step 507, and the storage device 102 of record Backup Data and this Backup Data correspondence; In step 510, memory management unit B searches bivariate table, and the information of the storage device 102 at the Backup Data place of acquisition restore data correspondence is given backup recovery agent device A with this information-reply.
Figure 6 shows that the workflow diagram of backup services end device C, concrete operating process is as follows:
Step C601 waits for the request that receives back-up terminals 101.
Step C602, receiving terminal 101 requests.
Step C603 judges request type, if be backup request, execution in step C604-C609; If be check request, execution in step C610-C615; If be recovery request, execution in step C616-C621.
Step C604 receives the global information that backs up.
Step C605 receives the alternate sector index.
Step C606 receives Backup Data.
Step C607 is put into data the storage medium E of backup.
Step C608 judges whether Backup Data receives end, if end, then execution in step C609; Otherwise, execution in step C606.
Step C609, Backup end, cleaning resource.
Step C610 receives the verification global information.
Step C611 generates new data directory according to some merging recovery time.
Step C612, based on new data directory, reading of data, segmentation calculation check value.
Step C613 sends to terminal 101 with sector segment index and check value.
Step C614 judges whether to read and finishes, if finish, and execution in step C615 then; Otherwise, execution in step C612.
Step C615, verification finishes, the cleaning resource.
Step C616 receives and recovers global information.
Step C617 generates new data directory according to some merging recovery time.
Step C618 is based on new data directory, reading of data.
Step C619 returns to terminal 101 with sector segment index and sector data.
Step C620 judges whether to recover to finish, if end, then execution in step C621; Otherwise, execution in step C618.
Step C621 recovers to finish, the cleaning resource.
Figure 7 shows that the process of the automatic scheduler task of central control device D, idiographic flow is as follows:
Step D701 reads configuration information, sets up task list.
Step D702 begins to check task list.
Step D703 judges whether also have unchecked task in the task list, if having, and execution in step D704; Otherwise, execution in step D707.
Step D704 takes out a task.
Step D705 judges whether this task satisfies schedulable condition, if satisfy execution in step D706; Otherwise, execution in step D703.
Step D706 sends to this task the backup recovery agent device A of appointment.
Step D707 waits for a period of time, and prepares to check next time.
Those skilled in the art can also carry out various modifications to above content under the condition that does not break away from the definite the spirit and scope of the present invention of claims.Therefore scope of the present invention is not limited in above explanation, but determine by the scope of claims.
Claims (26)
1. the method for a hard disc stage network data backup is characterized in that, comprising:
Step 1, central control device sends described backup tasks to the backup recovery agent device of the terminal of backup tasks correspondence, and described backup recovery agent device receives described backup tasks;
Step 2, described backup recovery agent device is determined the data volume of data to be backed up according to described backup tasks, is used to back up the storage resources of described data to be backed up to the memory management unit application according to the data volume of described data to be backed up;
Step 3, described memory management unit distributes described storage resources, and gives described backup recovery agent device with the information-reply of the storage resources that distributes;
Step 4, after described backup recovery agent device obtains the information of storage resources of described distribution, read the Backup Data of described terminal, described Backup Data is sent to backup services end device in the storage device, and described storage device is the specified storage device of information of the storage resources of described distribution;
Step 5, described backup services end device receives described Backup Data, described Backup Data is write the storage medium of described storage device.
2. the method for hard disc stage network data backup as claimed in claim 1 is characterized in that, also comprises after the described step 5:
Step 21, described central control device sends described recovery tasks to the backup recovery agent device of the terminal of recovery tasks correspondence, and described backup recovery agent device receives described recovery tasks;
Step 22, described backup recovery agent device are inquired the memory location of described restore data to described memory management unit;
Step 23, described memory management unit find described restore data corresponding Backup Data in some or a plurality of storage devices, give described backup recovery agent device with the information-reply of described storage device; Step 24, described backup recovery agent device sends recovery request to the backup services end device of described restore data place storage device, to obtain restore data;
Step 25, described backup services end device reads restore data according to described recovery request from the storage medium of described storage device, and sends to described backup recovery agent device;
Step 26, described backup recovery agent device write the restore data that receives the disk of described terminal.
3. the method for hard disc stage network data backup as claimed in claim 1 is characterized in that, also comprises between described step 1 and the described step 2:
Step 31, when described backup tasks was incremental backup, described backup recovery agent device judged whether the increment monitored results is complete, if, then obtain monitoring snapshot table, otherwise, to the memory location of described memory management unit inquiry Backup Data;
Step 32, described memory management unit is given described backup recovery agent device with the information-reply of Backup Data place storage device;
Step 33, described backup recovery agent device sends check request to the backup services end device of described storage device;
Step 34, described backup services end device reads Backup Data according to described check request from the storage medium of described storage device, and the calculation check value sends to described backup recovery agent device with described check value;
Step 35, described backup recovery agent device are calculated on the disk of described terminal the check value with the data of described Backup Data correspondence, and two check values are compared, and comparative result is recorded in the verification snapshot table.
4. the method for hard disc stage network data backup as claimed in claim 3 is characterized in that,
Backup recovery agent device described in the described step 31 judges that whether complete the increment monitored results further for after described backup recovery agent device judges last incremental backup, whether described terminal did not stop, if, then described increment monitored results is finished, otherwise described increment monitoring result is imperfect;
The information-reply of the storage device that the last backup that described step 32 further will find for described memory management unit is used is given described backup recovery agent device.
5. the method for hard disc stage network data backup as claimed in claim 3 is characterized in that, also comprises between the described step 1 and described 2:
Step 51, when described backup tasks was full backup, described backup recovery agent device was obtained the disk snapshot table.
6. the method for hard disc stage network data backup as claimed in claim 5 is characterized in that,
Determine described in the described step 2 that the backed up data amount is further for to determine the backed up data amount according to described monitoring snapshot table, described verification snapshot table or described disk snapshot table.
7. the method for hard disc stage network data backup as claimed in claim 1 is characterized in that, central control device sends described backup tasks to the backup recovery agent device of the terminal of backup tasks correspondence and further is in the described step 1,
Step 71 reads configuration information, sets up task list;
Step 72 is checked the task in the described task list one by one, satisfies schedulable condition in checked task, and described task is when being backup tasks, sends described task to the backup recovery agent device of the terminal of described task correspondence.
8. the method for hard disc stage network data backup as claimed in claim 2 is characterized in that, central control device described in the described step 21 sends described recovery tasks to the backup recovery agent device of the terminal of recovery tasks correspondence and further is,
Step 81 reads configuration information, sets up task list;
Step 82 is checked the task in the described task list one by one, satisfies schedulable condition in checked task, and described task is when being recovery tasks, sends described task to the backup recovery agent device of the terminal of described task correspondence.
9. the method for hard disc stage network data backup as claimed in claim 1 is characterized in that, the described memory management unit memory allocated resource in the described step 3 further is:
Step 91, described memory management unit judge whether described terminal did not carry out backup, if then the storage medium of allocation space maximum is as the storage resources of described terminal; Otherwise, distribute the storage resources of the storage medium of described terminal Last Backup use as described terminal.
10. the method for hard disc stage network data backup as claimed in claim 1 is characterized in that, also comprises in the described step 5:
Step 101, described backup services end device judges whether the copy of Backup Data in the described storage device exceeds the default copy number of depositing, if, then the copy number in the described storage device is deducted the default copy number of depositing and obtain difference, difference is n, the copy of n+1 time Backup Data the earliest in the copy of described storage device is merged, keep the copy number of appointment to guarantee described storage device.
11. the method for hard disc stage network data backup as claimed in claim 2 is characterized in that, reads restore data according to described recovery request from the storage medium of described storage device in the described step 25 further to be,
Step 111, the data directory of point merges to recovery time of described recovery request appointment, generates the new data index, reads restore data according to described new data index from the storage medium of described storage device.
12. the method for hard disc stage network data backup as claimed in claim 3 is characterized in that, backup services end device described in the described step 34 reads Backup Data according to described check request from the storage medium of described storage device and further is,
Step 121, the data directory of point merges to recovery time of described check request appointment, generates the new data index, reads Backup Data according to described new data index from the storage medium of described storage device.
13. the method for hard disc stage network data backup as claimed in claim 2 is characterized in that,
Described step 3 comprises that also described memory management unit is safeguarded a bivariate table, the storage device of record Backup Data and described Backup Data correspondence;
Described step 23 further is, described memory management unit is searched described bivariate table, obtains the information of storage device at the Backup Data place of described restore data correspondence, gives described backup recovery agent device with the information-reply of described storage device.
14. the system of a hard disc stage network data backup, comprise a plurality of terminals and be used for being connected the communication network that described system installs, described terminal comprises disk, it is characterized in that, described terminal also comprises backup recovery agent device, described system also comprises: central control device, memory management unit and a plurality of storage device, described storage device comprise storage medium and the backup services end device that is used for store backup data
Described central control device is used for sending described backup tasks to the backup recovery agent device of the terminal of backup tasks correspondence;
Described backup recovery agent device, be used for receiving described central control device behind the backup tasks of its transmission, determine the data volume of data to be backed up according to described backup tasks, be used to back up the storage resources of described data to be backed up according to the data volume of described data to be backed up to the memory management unit application; After the information of the storage resources that obtains described memory management unit distribution, the Backup Data of terminal under reading, described Backup Data is sent to backup services end device in the storage device, and described storage device is the specified storage device of information of the storage resources of described distribution;
Described memory management unit is used to backup to distribute described storage resources, and the backup recovery agent device of giving the application storage resources with the information-reply of the storage resources that distributes;
Described backup services end device is used to receive the Backup Data of backup recovery agent device to its transmission, the storage medium of storage device under described Backup Data is write.
15. the system of hard disc stage network data backup as claimed in claim 14 is characterized in that,
Described central control device also is used for sending described recovery tasks to the backup recovery agent device of recovery tasks counterpart terminal;
Described backup recovery agent device also is used for when receiving the recovery tasks of described central control device, to the memory location of described memory management unit inquiry restore data; After the information of the described restore data place storage device that receives described memory management unit answer, to the backup services end device transmission recovery request of described restore data place storage device, to obtain restore data; The described backup services end device that receives is write the disk of affiliated terminal to the restore data of its transmission;
Described memory management unit also is used for finding described restore data after some or a plurality of storage devices have corresponding Backup Data, gives described backup recovery agent device with the information-reply of described storage device;
Described backup services end device also is used for according to the recovery request of backup recovery agent device to its transmission, reads restore data from the storage medium of affiliated storage device, and sends to described backup recovery agent device.
16. the system of hard disc stage network data backup as claimed in claim 14 is characterized in that,
Described backup recovery agent device also is used for when described backup tasks is incremental backup, judges whether the increment monitored results is complete, if then obtain monitoring snapshot table; Otherwise, memory location to described memory management unit inquiry Backup Data, backup services end device to described storage device after the information of the storage device that receives described memory management unit answer sends check request, receiving the backup services end device behind the test value of its transmission, under calculating on the disk of terminal with the check value of the data of described Backup Data correspondence, two check values are compared, comparative result is recorded in the verification snapshot table;
Described memory management unit, the information-reply that also is used for the Backup Data place storage device that will find is given described backup recovery agent device;
Described backup services end device also is used for according to the check request of backup recovery agent device to its transmission, reads Backup Data from the storage medium of affiliated storage device, and the calculation check value sends to described backup recovery agent device with described check value.
17. the system of hard disc stage network data backup as claimed in claim 16 is characterized in that,
Described backup recovery agent device is further used for when judging that described increment monitored results is whether complete, judge last incremental backup after, whether described terminal did not stop, if then described the increment monitored results is complete fully, otherwise described increment monitored results is imperfect;
Described memory management unit, the information-reply that is further used for the storage device that the last backup that finds is used is given described backup recovery agent device.
18. the system of hard disc stage network data backup as claimed in claim 16 is characterized in that,
Described backup recovery agent device also is used for obtaining the disk snapshot table when described backup tasks is full backup.
19. the system of hard disc stage network data backup as claimed in claim 18 is characterized in that,
Described backup recovery agent device is further used for determining the backed up data amount according to described monitoring snapshot table, described verification snapshot table or described disk snapshot table.
20. the system of hard disc stage network data backup as claimed in claim 14 is characterized in that, described central control device is further used for reading configuration information, sets up task list; Check the task in the described task list one by one, satisfy schedulable condition, and described task is when being backup tasks, send described task to the backup recovery agent device of the terminal of described task correspondence in checked task.
21. the system of hard disc stage network data backup as claimed in claim 15 is characterized in that, described central control device is further used for reading configuration information, sets up task list; Check the task in the described task list one by one, satisfy schedulable condition, and described task is when being recovery tasks, send described task to the backup recovery agent device of the terminal of described task correspondence in checked task.
22. the system of hard disc stage network data backup as claimed in claim 14, it is characterized in that, described memory management unit is further used for when the memory allocated resource, judge whether the terminal that backs up did not carry out backup, if then the storage medium of allocation space maximum is as the storage resources of described terminal; Otherwise, distribute the storage resources of the storage medium of described terminal Last Backup use as described terminal.
23. the system of hard disc stage network data backup as claimed in claim 14, it is characterized in that, described backup services end device, whether the copy that also is used for judging described storage device Backup Data exceeds the default copy number of depositing, if, then the copy number in the described storage device is deducted the default copy number of depositing and obtain difference, difference is n, the copy of n time Backup Data the earliest in the copy of described storage device is merged, keep the copy number of appointment to guarantee described storage device.
24. the system of hard disc stage network data backup as claimed in claim 15, it is characterized in that, described backup services end device be further used for according to the recovery request that receives when the storage medium of affiliated storage device reads restore data, the data directory that put the recovery time of described recovery request appointment merges, generate the new data index, read restore data from the storage medium of described storage device according to described new data index.
25. the system of hard disc stage network data backup as claimed in claim 16, it is characterized in that, described backup services end device be further used for according to the check request that receives when the storage medium of described storage device reads Backup Data, the data directory that put the recovery time of described check request appointment merges, generate the new data index, read Backup Data from the storage medium of described storage device according to described new data index.
26. the system of hard disc stage network data backup as claimed in claim 15 is characterized in that,
Described memory management unit also is used to safeguard a bivariate table, the storage device of record Backup Data and described Backup Data correspondence; When the storage device of definite restore data place, search described bivariate table, obtain the information of storage device at the Backup Data place of described restore data correspondence, give described backup recovery agent device with the information-reply of described storage device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102249418A CN101394424B (en) | 2008-10-27 | 2008-10-27 | Hard disc stage network data backup system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102249418A CN101394424B (en) | 2008-10-27 | 2008-10-27 | Hard disc stage network data backup system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101394424A true CN101394424A (en) | 2009-03-25 |
| CN101394424B CN101394424B (en) | 2011-11-09 |
Family
ID=40494494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008102249418A Expired - Fee Related CN101394424B (en) | 2008-10-27 | 2008-10-27 | Hard disc stage network data backup system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101394424B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101902498A (en) * | 2010-07-02 | 2010-12-01 | 广州鼎甲计算机科技有限公司 | Network technology based storage cloud backup method |
| CN102024044A (en) * | 2010-12-08 | 2011-04-20 | 华为技术有限公司 | Distributed file system |
| CN102637140A (en) * | 2011-05-27 | 2012-08-15 | 南京信核数据科技有限公司 | Novel uncorrected data tape backup system |
| CN102693168A (en) * | 2011-03-22 | 2012-09-26 | 中兴通讯股份有限公司 | A method, a system and a service node for data backup recovery |
| CN103152407A (en) * | 2013-02-20 | 2013-06-12 | 浪潮电子信息产业股份有限公司 | Method for designing integral data disaster recovery backup system |
| CN104915362A (en) * | 2014-07-19 | 2015-09-16 | 国家电网公司 | Fast intelligent ERP system data migration scheme based on time slices, increment analysis and random disorganizing technology |
| CN105144105A (en) * | 2013-02-27 | 2015-12-09 | 网络存储技术公司 | System and method for a scalable crash-consistent snapshot operation |
| CN107111534A (en) * | 2016-06-28 | 2017-08-29 | 华为技术有限公司 | A kind of method and apparatus of data processing |
| CN107451176A (en) * | 2016-05-30 | 2017-12-08 | 恩芬森株式会社 | Data copy method and its device |
| CN108733511A (en) * | 2018-03-23 | 2018-11-02 | 成都安信思远信息技术有限公司 | A kind of electronic data processing method based on big data |
| CN110955557A (en) * | 2018-09-27 | 2020-04-03 | 阿里巴巴集团控股有限公司 | Data verification processing method and device, storage medium and processor |
| US11119863B2 (en) | 2015-09-25 | 2021-09-14 | Huawei Technologies Co., Ltd. | Data backup method and data processing system |
| US11132260B2 (en) | 2015-09-25 | 2021-09-28 | Huawei Technologies Co., Ltd. | Data processing method and apparatus |
| WO2022022587A1 (en) * | 2020-07-28 | 2022-02-03 | 华为技术有限公司 | Method and device for backup management, medium and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101201767A (en) * | 2006-12-14 | 2008-06-18 | 英业达股份有限公司 | System and method for backup and recovery of magnetic disc mirroring of computer system data |
| CN101256528B (en) * | 2008-03-20 | 2010-07-28 | 中国科学院计算技术研究所 | Magnetic disk data backup system and method supporting nought backup window |
-
2008
- 2008-10-27 CN CN2008102249418A patent/CN101394424B/en not_active Expired - Fee Related
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101902498A (en) * | 2010-07-02 | 2010-12-01 | 广州鼎甲计算机科技有限公司 | Network technology based storage cloud backup method |
| CN101902498B (en) * | 2010-07-02 | 2013-03-27 | 广州鼎甲计算机科技有限公司 | Network technology based storage cloud backup method |
| CN102024044B (en) * | 2010-12-08 | 2012-11-21 | 华为技术有限公司 | Distributed file system |
| CN102024044A (en) * | 2010-12-08 | 2011-04-20 | 华为技术有限公司 | Distributed file system |
| US9286319B2 (en) | 2011-03-22 | 2016-03-15 | Zte Corporation | Method, system and serving node for data backup and restoration |
| CN102693168A (en) * | 2011-03-22 | 2012-09-26 | 中兴通讯股份有限公司 | A method, a system and a service node for data backup recovery |
| CN102637140B (en) * | 2011-05-27 | 2015-01-21 | 南京信核数据科技有限公司 | Novel uncorrected data tape backup system |
| CN102637140A (en) * | 2011-05-27 | 2012-08-15 | 南京信核数据科技有限公司 | Novel uncorrected data tape backup system |
| CN103152407A (en) * | 2013-02-20 | 2013-06-12 | 浪潮电子信息产业股份有限公司 | Method for designing integral data disaster recovery backup system |
| CN105144105B (en) * | 2013-02-27 | 2019-04-19 | Netapp股份有限公司 | System and method for the expansible consistent snapshot operation of collapse |
| CN105144105A (en) * | 2013-02-27 | 2015-12-09 | 网络存储技术公司 | System and method for a scalable crash-consistent snapshot operation |
| CN104915362A (en) * | 2014-07-19 | 2015-09-16 | 国家电网公司 | Fast intelligent ERP system data migration scheme based on time slices, increment analysis and random disorganizing technology |
| US11119863B2 (en) | 2015-09-25 | 2021-09-14 | Huawei Technologies Co., Ltd. | Data backup method and data processing system |
| US11132260B2 (en) | 2015-09-25 | 2021-09-28 | Huawei Technologies Co., Ltd. | Data processing method and apparatus |
| CN107451176A (en) * | 2016-05-30 | 2017-12-08 | 恩芬森株式会社 | Data copy method and its device |
| CN107111534A (en) * | 2016-06-28 | 2017-08-29 | 华为技术有限公司 | A kind of method and apparatus of data processing |
| CN108733511A (en) * | 2018-03-23 | 2018-11-02 | 成都安信思远信息技术有限公司 | A kind of electronic data processing method based on big data |
| CN110955557A (en) * | 2018-09-27 | 2020-04-03 | 阿里巴巴集团控股有限公司 | Data verification processing method and device, storage medium and processor |
| CN110955557B (en) * | 2018-09-27 | 2023-09-12 | 阿里巴巴集团控股有限公司 | Data verification processing method, device, storage medium and processor |
| WO2022022587A1 (en) * | 2020-07-28 | 2022-02-03 | 华为技术有限公司 | Method and device for backup management, medium and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101394424B (en) | 2011-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101394424B (en) | Hard disc stage network data backup system and method | |
| US11093139B1 (en) | Durably storing data within a virtual storage system | |
| US11797197B1 (en) | Dynamic scaling of a virtual storage system | |
| US20210019237A1 (en) | Data recovery in a virtual storage system | |
| US20210019070A1 (en) | Virtual storage system architecture | |
| US11704202B2 (en) | Recovering from system faults for replicated datasets | |
| CN102981931B (en) | Backup method and device for virtual machine | |
| US8392375B2 (en) | Perpetual archival of data | |
| CN102782639B (en) | Enable to copy the system and method that target reclaims untapped storage space in thin supply storage system | |
| US11714572B2 (en) | Optimized data resiliency in a modular storage system | |
| US11422751B2 (en) | Creating a virtual storage system | |
| US10216429B2 (en) | Performing post-processing operations for log file writes | |
| Zhao et al. | Exploring reliability of exascale systems through simulations. | |
| CN104011717A (en) | Data selection for data storage backup | |
| CN105144142A (en) | Object storage using multiple dimensions of object information | |
| US11442669B1 (en) | Orchestrating a virtual storage system | |
| US20230014785A1 (en) | Data Storage In A Cloud-Based Storage System | |
| CN104239166A (en) | Method for realizing file backup for running virtual machine | |
| CN101939737A (en) | Scalable de-duplication mechanism | |
| CN101441582A (en) | Backup and recovery method of computer data object and system and program product for implementing the same | |
| US11893126B2 (en) | Data deletion for a multi-tenant environment | |
| EP3353627B1 (en) | Adaptive storage reclamation | |
| CN103034592B (en) | Data processing method and device | |
| CN105653396A (en) | Backup system and backup method thereof | |
| CN111027984B (en) | Service order processing method, system, electronic equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20111109 Termination date: 20201027 |