CN101662495A - Backup method, master server, backup servers and backup system - Google Patents
Backup method, master server, backup servers and backup system Download PDFInfo
- Publication number
- CN101662495A CN101662495A CN200910093018A CN200910093018A CN101662495A CN 101662495 A CN101662495 A CN 101662495A CN 200910093018 A CN200910093018 A CN 200910093018A CN 200910093018 A CN200910093018 A CN 200910093018A CN 101662495 A CN101662495 A CN 101662495A
- Authority
- CN
- China
- Prior art keywords
- backup
- load
- server
- information
- backup server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The embodiment of the invention discloses a backup method, a master server, backup servers and a backup system. The method includes the following steps: receiving load sampling information sent by thebackup server in the backup system that comprises at least two backup servers; according to the load sampling information, determining the load information of the backup server and according to the load information, determining the backup server with lightest load in the backup system; and sending backup operation to the backup server with lightest load so that the backup server with lightest load stores the backup data stream corresponding to the backup operation in a storage array. In LAN-Free framework, the embodiment of the invention improves the utilization rate of SAN bandwidth resources and the whole backup performance of the backup system, shortens a backup window, makes up the defect that the treatment of backup operation fails when the backup server goes wrong and improves the robustness of the backup system.
Description
Technical field
The embodiment of the invention relates to the data backup field, particularly a kind of backup method, master server, backup server and standby system.
Background technology
Present various redundancy technique and awareness intensification and the constantly development of along with people data being protected importance by the backup mode that various redundancy techniques derive.Because business data, personal data amount are increased sharply, the burden of standby system is increasing, is faced with the backup window problems of too.Therefore, backup performance become current structure standby system one of the important indicator that must pay close attention to.Wherein, backup window is meant in not serious influence and uses under the situation of the application program that needs backed up data, the time interval of carrying out data backup.
Aspect backup medium chose, traditional was simple replaced just gradually as the backup mode of medium with tape.Utilize disk, virtual tape library, perhaps the mode that combines with tape of disk backs up the development trend that becomes current standby system.And the group-network construction of standby system develops developing out based on storage area network (Storage Area Network gradually except original backup framework based on local network; Hereinafter to be referred as: local area network (LAN) SAN) separates (Local AreaNetwork-Free; Hereinafter to be referred as: LAN-Free) separate (Server-Free) backup framework with server.
In the LAN-Free framework, backup server is responsible for backing up the data on the backup client that configures in advance, and Backup Data stream arrives storage array by SAN.In this LAN-Free framework, because Backup Data stream is without the Ethernet of operation system this locality, so backup traffic is little to the influence of operation system, the performance of standby system has bigger lifting with comparing based on the performance of the LAN-Based group-network construction of local network.
In realizing process of the present invention, the inventor finds in the prior art owing to each backup server load in the standby system is unbalanced, the server load that may have is overweight, can not in time handle its backup job, thereby can not make full use of the bandwidth resources of SAN, the parallel performance of backup job is low in the whole standby system.
Summary of the invention
The embodiment of the invention provides a kind of backup method, master server, backup server and standby system, to improve the parallel processing performance of each backup server in the standby system, improves backup job number parallel in the standby system, shortens backup window.
The embodiment of the invention provides a kind of backup method, comprising:
Receive the load sample information that the backup server in the standby system sends, described standby system comprises at least two backup servers;
Determine the load information of described backup server according to described load sample information, and determine the lightest backup server of load in the described standby system according to described load information;
Backup job is sent to the lightest backup server of described load, so that the lightest backup server of described load stores the Backup Data stream of described backup job correspondence into storage array.
The embodiment of the invention also provides a kind of backup method, comprising:
Gather the load sample information of backup server;
Described load sample information is sent to master server, determines the lightest backup server of load in the standby system according to described load sample information, and backup job is sent to the lightest backup server of described load for described master server;
To store storage array into from the Backup Data stream of the backup job correspondence of described master server.
The embodiment of the invention also provides a kind of master server, comprising:
The load information receiver module is used for receiving the load sample information that the backup server of standby system sends, and described standby system comprises at least two backup servers;
The load balance scheduling module is used for determining according to the load sample information that described load information receiver module receives the load information of described backup server, and determines the lightest backup server of load in the described standby system according to described load information;
The backup job sending module is used for backup job is sent to the lightest backup server of load that described load balance scheduling module is determined.
The embodiment of the invention also provides a kind of backup server, comprising:
The load information sampling module, the load sample information that is used to gather described backup server;
The load information reporting module is used for the load sample information of described load information sampling module collection is sent to master server;
The backup job receiver module is used to receive the backup job that described master server sends;
Backup job operation module, the Backup Data stream that is used for backup job correspondence that described backup job receiver module is received stores storage array into;
Sampling request receiver module is used to receive the load information sampling request that described master server sends, and notifies described load information sampling module to gather the load sample information of described backup server.
The embodiment of the invention also provides a kind of standby system, comprises master server, at least two backup servers and storage array, wherein:
Described backup server, be used to gather the load sample information of described backup server, described load sample information is sent to described master server, and receives the backup job that described master server sends, store the Backup Data stream of described backup job correspondence into described storage array;
Described master server, be used to receive the load sample information that described backup server sends, determine the load information of described backup server according to described load sample information, and determine the lightest backup server of load in the described standby system, and backup job is sent to the lightest backup server of described load according to described load information;
Described storage array is used to store the Backup Data stream that described backup server sends.
By the embodiment of the invention, the master server in the standby system is determined the lightest backup server of load in the standby system according to the load sample information that comes from backup server, then backup job is sent to the lightest backup server of this load and handles.Thereby improved the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
Description of drawings
In order to be illustrated more clearly in the present invention or technical scheme of the prior art, to do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
The flow chart of the backup method that Fig. 1 provides for the embodiment of the invention one;
Fig. 2 sends the schematic diagram of an embodiment of backup job for master server of the present invention;
The flow chart of the backup method that Fig. 3 provides for the embodiment of the invention two;
The flow chart of the backup method that Fig. 4 provides for the embodiment of the invention three;
The flow chart of the backup method that Fig. 5 provides for the embodiment of the invention four;
The structural representation of the master server that Fig. 6 provides for the embodiment of the invention five;
The structural representation of the master server that Fig. 7 provides for the embodiment of the invention six;
The structural representation of the backup server that Fig. 8 provides for the embodiment of the invention seven;
The structural representation of the standby system that Fig. 9 provides for the embodiment of the invention eight;
The structural representation of the standby system that Figure 10 provides for the embodiment of the invention nine.
Embodiment
Below in conjunction with the accompanying drawing among the present invention, the technical scheme among the present invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills are obtained under the prerequisite of not making creative work belongs to the scope of protection of the invention.
The flow chart of the backup method that Fig. 1 provides for the embodiment of the invention one, as shown in Figure 1, this embodiment comprises:
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gathers the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation; By local ethernet the load sample information that writes down is sent to master server again.Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Particularly, backup server can periodically send the load sample information to master server, and for example: backup server can be one-period in 2 seconds, sends a load sample information every 2 seconds to master server; Also can send the load sample information to master server after Event triggered, for example: backup server can send a load sample information to master server after handling a backup job; Can after receiving a backup job, send a load sample information to master server.More than just backup server is to the dual mode of master server transmission load sample information, and present embodiment is not limited in this, and this dual mode can use separately, also can be used in combination.
In the present embodiment, master server can be sent to the lightest backup server of load with backup job by local ethernet.
Fig. 2 sends the schematic diagram of an embodiment of backup job for master server of the present invention, as shown in Figure 2, when sending backup job 15, master server can determine that the lightest backup server of load is a backup server 5 according to load information, therefore, master server is sent to backup server 5 with backup job 15.Receive after the backup job, backup server 5 operation backup jobs 15 store the Backup Data stream of backup job 15 correspondences into storage array.
When two of master server transmissions or many backup jobs, master server can be ranked to backup job according to the preset priority rule, and repeated execution of steps 101～step 103 is sent to backup server successively with the backup job in the queue queue.
This preset priority rule can for: determine the priority of backup job according to the time of reception of each backup job, for example: according to receive backup job by early to late order, the priority of each backup job is from high to low; Perhaps, determine the priority of backup job according to the significance level of each backup job, most important backup job priority is the highest; Be two kinds of examples of priority rule more than, present embodiment is not limited in this, any protection range that can all should fall into present embodiment to the priority rule that backup job is ranked.
In the foregoing description, the master server in the standby system is determined the lightest backup server of load in the standby system according to the load sample information that comes from backup server, then backup job is sent to the lightest backup server of this load and handles.Thereby improved the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The flow chart of the backup method that Fig. 3 provides for the embodiment of the invention two, as shown in Figure 3, this embodiment comprises:
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gather the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation, by local ethernet the load sample information that writes down is sent to master server again; Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Particularly, backup server can periodically send the load sample information to master server, and for example: backup server can be one-period in 2 seconds, sends a load sample information every 2 seconds to master server; Also can send the load sample information to master server after Event triggered, for example: backup server can send a load sample information to master server after handling a backup job; Can after receiving a backup job, send a load sample information to master server.More than just backup server is to the dual mode of master server transmission load sample information, and present embodiment is not limited in this, and this dual mode can use separately, also can be used in combination.
Particularly, after the load sample information that receives the backup server transmission, master server can be recorded in the load sample information of backup server in the load information table of setting; Calculate the load information of backup server then according to the load sample information of record, and the load information of the backup server that calculates is recorded in the above-mentioned load information table.In above-mentioned load information table, master server can be provided with sign for each backup server, as the load sample information of searching each backup server and the index of load information.
In the present embodiment, when the CPU utilance is that C, memory usage are M, the backup job number that moving is J, I/O load information is when being IO, master server calculates the load information of CPU utilance, memory usage, I/O of backup server and the weighted sum of the backup job number that moving, obtain backup server load information can for:
L＝F(C，M，J，IO)＝C×X1+M×X2+J×X3+IO×X4 (1)
In the formula (1), X1, X2, X3 and X4 represent C, M, J and the IO weight when computational load information, X1+X2+X3+X4=1 respectively.Wherein, the concrete value of Xi (i=1,2,3,4) can recommend to be provided with according to the ruuning situation setting or the employing of master server, for example: be provided with
It below only is a kind of mode of calculating the load information of backup server; the embodiment of the invention is not limited in this; any can be according to CPU utilance, memory usage, the load information of I/O and the backup job number that is moving of backup server, the mode of calculating the load information of backup server all should fall into the protection range of the embodiment of the invention.
Particularly, master server according to load information determine the lightest backup server of load can for: master server is determined the backup server that load is the lightest according to the load information that writes down in the load information table.
In the present embodiment, the load information of two or many backup servers is identical in standby system, and for hour, and when promptly the lightest backup server of load was not unique in the standby system, master server can be selected a lightest backup server of load at random; Perhaps, master server can be according to the preset priority rule, in the lightest backup server of load, select the highest backup server of priority, for example: master server can be determined the priority of backup server according to the sign of backup server, suppose backup server be designated 1～n the time, according to the sign of backup server by little to big order, the priority of backup server from high to low, it is the highest promptly to be designated 1 backup server priority.
Particularly, master server can be sent to the lightest backup server of load with backup job by local ethernet.
In the present embodiment, the embodiment that master server sends backup job can receive after the backup job as shown in Figure 2, and backup server moves this backup job, stores the Backup Data stream of this backup job correspondence into storage array.
When two of master server transmissions or many backup jobs, master server can be ranked to backup job according to the preset priority rule, and repeated execution of steps 301～step 304 is sent to backup server successively with the backup job in the queue queue.The priority rule that provides in the embodiment of the invention one can be provided this preset priority rule, does not repeat them here.
After backup job is sent to the lightest backup server of load, master server can be recorded in the transmission information of backup job in the above-mentioned load information table in the list item corresponding with the lightest backup server of load, and upgrades the load information of the lightest backup server of load.
In the foregoing description, master server in the standby system is according to the load sample information that comes from backup server, calculate the load information of backup server, determine the backup server that load is the lightest according to this load information then, backup job is sent to the lightest backup server of this load handles.Thereby improved the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The flow chart of the backup method that Fig. 4 provides for the embodiment of the invention three, as shown in Figure 4, this embodiment comprises:
Step 401, the state of each backup server in the master server monitoring standby system.
Step 402 has judged whether that backup server breaks down.When master server has monitored backup server when breaking down, enter step 403; If master server does not find that backup server breaks down, then enter step 405.
Step 403, master server are upgraded the load information table, and the load information of the backup server that breaks down is updated to default load threshold, enter step 404.
Particularly, in the embodiment of the invention, be provided with a load information table in the master server, be used to write down the load sample information of each backup server and the load information of each backup server of calculating according to the load sample information of record.
In the present embodiment, when master server has monitored backup server when breaking down, master server upgrades the load information table, the load information of the backup server that breaks down is updated to default load threshold, like this, before this backup server that breaks down recovered operate as normal, master server can not send backup job to this backup server that breaks down again.
Step 404, master server sends load information sampling request to the backup server that does not break down, and enters step 405.
Step 405, master server receive the load sample information that the backup server in the standby system sends.
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gather the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation, by local ethernet the load sample information that writes down is sent to master server again; Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Particularly, backup server can periodically send the load sample information to master server, and for example: backup server can be one-period in 2 seconds, sends a load sample information every 2 seconds to master server; Also can send the load sample information to master server after Event triggered, for example: backup server can perhaps receive after the backup job after handling a backup job, sends the load sample information to master server; Wherein, Event triggered comprises that also backup server receives the load information sampling request that master server sends, and after receiving load information sampling request, backup server sends the load sample information to master server.More than just backup server is to several modes of master server transmission load sample information, and present embodiment is not limited in this, and aforesaid way can use separately, also can be used in combination.
Step 406, the weighted sum of the load information of the CPU utilance of master server calculating backup server, memory usage, I/O and the backup job number that is moving, the load information of acquisition backup server enters step 407.
In the present embodiment, master server can obtain the load information of each backup server according to the method that step 302 provides, and does not repeat them here.
Step 407 judges whether the load information of all backup servers in the standby system all reaches default load threshold.When the load information of all backup servers all reaches default load threshold, execution in step 410; When existing load information not reach the backup server of default load threshold in the standby system, execution in step 408.
Step 408, master server is determined the backup server that load is the lightest according to load information, enters step 409.
Particularly, master server can be determined the backup server that load is the lightest according to the load information that writes down in the load information table.In the present embodiment, the load information of two or many backup servers is identical in standby system, and for hour, and when promptly the lightest backup server of load was not unique in the standby system, master server can be selected a lightest backup server of load at random; Perhaps, master server can be according to the preset priority rule, in the lightest backup server of load, select the highest backup server of priority, for example: master server can be determined the priority of backup server according to the sign of backup server, suppose backup server be designated 1～n the time, according to the sign of backup server by little to big order, the priority of backup server from high to low, it is the highest promptly to be designated 1 backup server priority.
Step 409, master server is sent to the lightest backup server of load with backup job.
Particularly, master server can be sent to the lightest backup server of load with backup job by local ethernet.Wherein, backup job comprises the backup job that is untreated and finishes from the backup job of backup client and the backup server that breaks down.
In the present embodiment, the embodiment that master server sends backup job can receive after the backup job as shown in Figure 2, and backup server moves this backup job, stores the Backup Data stream of this backup job correspondence into storage array.
When two of transmissions or many backup jobs, master server can be ranked to backup job according to the preset priority rule, and repeated execution of steps 401～step 409 is sent to backup server successively with the backup job in the queue queue.The priority rule that provides in the embodiment of the invention one can be provided this preset priority rule, does not repeat them here.
After backup job is sent to the lightest backup server of load, master server can be recorded in the transmission information of backup job in the above-mentioned load information table in the list item corresponding with the lightest backup server of load, and upgrades the load information of the lightest backup server of load.
Step 410, master server is ranked to backup job according to the preset priority rule, and returns execution in step 401.
In the present embodiment, when the load information of all backup servers in the standby system all reaches default load threshold, illustrate that present backup server all is in the state of operating at full capacity, ability is not handled more backup job, at this moment, master server can be ranked to backup job according to the preset priority rule and be waited, and returns execution in step 401, again the less backup server of wait acknowledge load is to issue processing with backup job.Wherein, the priority rule that provides in the embodiment of the invention one can be provided this preset priority rule, does not repeat them here.
In the foregoing description; master server in the standby system is monitored the state of backup server; when having monitored backup server when breaking down; backup job on the backup server that breaks down is sent to the backup server that does not break down; thereby remedied the defective that backup server breaks down and can cause the backup job processing to be failed; avoid the creation data on the backup client to face not protected danger, improved the robustness of standby system.And when there is the backup server of the load threshold that does not reach default in the master server in the standby system in determining standby system, determine the backup server that load is the lightest according to load information, backup job is sent to the lightest backup server of this load handles.Thereby improved the parallel processing performance of each backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The flow chart of the backup method that Fig. 5 provides for the embodiment of the invention four, as shown in Figure 5, this embodiment comprises:
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gathers the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation; Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Backup server can periodically be gathered the load sample information, and for example: backup server can be one-period in 2 seconds, gathers one time the load sample information every 2 seconds; Also can gather the load sample information after Event triggered, for example: backup server can perhaps receive after the backup job after handling a backup job, gathers one time the load sample information; Wherein, Event triggered comprises that also backup server receives the load information sampling request that master server sends, and after receiving load information sampling request, backup server is gathered the load sample information of this backup server.Be several modes that backup server is gathered the load sample information more than, present embodiment is not limited in this, and aforesaid way can use separately, also can be used in combination.
Particularly, backup server can be sent to master server with the load sample information by local ethernet.
In the foregoing description, backup server is gathered the load sample information of self, and this load sample information is sent to master server, thereby master server can be determined the backup server that load is the lightest according to this load sample information, and backup job is sent to the lightest backup server of load handles, improved the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improve the utilance of SAN bandwidth resources, improved the backup performance of standby system integral body, shortened backup window.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of program command, aforesaid program can be stored in the computer read/write memory medium, this program is carried out the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
The structural representation of the master server that Fig. 6 provides for the embodiment of the invention five, the master server of present embodiment can be realized the flow process that the present invention is embodiment illustrated in fig. 1, as shown in Figure 6, this master server can comprise: load information receiver module 61, load balance scheduling module 62 and backup job sending module 63.Wherein:
Load information receiver module 61 is used for receiving the load sample information that the backup server of standby system sends, and this standby system comprises at least two backup servers;
Wherein, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gathers the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation; By local ethernet the load sample information that writes down is sent to master server again.Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Load balance scheduling module 62 is used for determining according to the load sample information that load information receiver module 61 receives the load information of backup server, and determines the lightest backup server of load in the standby system according to this load information;
Backup job sending module 63 is used for backup job is sent to the lightest backup server of load that load balance scheduling module 62 is determined.
In the foregoing description, the load sample information that comes from backup server that load balance scheduling module 62 receives according to load information receiver module 61, determine the backup server that load is the lightest, backup job sending module 63 is sent to the lightest backup server of this load with backup job and handles then.Thereby improved the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The structural representation of the master server that Fig. 7 provides for the embodiment of the invention six, the master server of present embodiment can be realized Fig. 3 of the present invention or flow process embodiment illustrated in fig. 4, as shown in Figure 7, this master server can comprise: load information receiver module 71, load balance scheduling module 72, backup job sending module 73, load information logging modle 74, load information update module 75, global monitoring module 76 and sampling request sending module 77.
Wherein, load information receiver module 71 is used for receiving the load sample information that the backup server of standby system sends, and this standby system comprises at least two backup servers;
Particularly, load information receiver module 71 can receive the load sample information that the backup server cycle sends, and for example: backup server can be one-period in 2 seconds, sends a load sample information every 2 seconds to master server; Load information receiver module 71 also can receive the load sample information that backup server sends to master server after Event triggered, for example: backup server can be after handling a backup job, perhaps receive after the backup job, send the load sample information to master server; Backup server also can receive master server and send the load sample information to the load information sampling request back that backup server sends to master server.More than just backup server is to several modes of master server transmission load sample information, and present embodiment is not limited in this, and aforesaid way can use separately, also can be used in combination.
Concrete, the backup job number that the load sample information that described load information receiver module 71 receives can comprise the load information of CPU utilance, memory usage, I/O and move.
Load balance scheduling module 72 is used for determining according to the load sample information that load information receiver module 71 receives the load information of backup server, and determines the lightest backup server of load in the standby system according to load information;
Backup job sending module 73 is used for backup job is sent to the lightest backup server of load that load balance scheduling module 72 is determined;
Load information logging modle 74 is used for the load information table that load sample information and load information with backup server are recorded in setting;
Load information update module 75, be used for after backup job sending module 73 sends backup job, the transmission information of backup job is recorded in the load information table in the list item corresponding with the lightest backup server of load, and upgrades the load information of the lightest backup server of load;
In addition, when breaking down for some backup server in standby system, do not influence the operation of backup job, the master server in the present embodiment can also comprise:
Global monitoring module 76 is used for monitoring the operating state of each backup server of standby system;
Load information update module 75 also is used for monitoring standby system when having backup server to break down when global monitoring module 76, upgrades above-mentioned load information table, and the load information of the backup server that breaks down is updated to default load threshold;
Be understandable that the purpose that the load information of part server of breaking down is updated to default load threshold is that backup job sending module 73 no longer sends backup job to this backup server when issuing backup job.
Sampling request sending module 77 is used for monitoring standby system when having backup server to break down when global monitoring module 76, sends the load information sampling to the backup server that does not break down and asks.
Concrete, send load information sampling request by the backup server that other do not break down in standby system, thereby the backup server collection that other do not break down in the triggering standby system also sends self load sample information to this master server, thereby can make this master server determine the backup server that load is the lightest, and the backup job in the backup server that breaks down is sent to the lightest backup server of described load handles according to this load sample information.
Particularly, load balance scheduling module 72 can comprise: calculating sub module 721 and arbitration submodule 722, wherein:
Calculating sub module 721 is used to calculate the load information of CPU utilance, memory usage, I/O of backup server and the weighted sum of the backup job number that moving, obtains the load information of backup server; Specific descriptions are seen before and are stated embodiment two, do not repeat them here;
Arbitration submodule 722 is used for determining the backup server that load is the lightest according to calculating sub module 721 load calculated information;
Load balance scheduling module 72 can also comprise:
Queuing submodule 723, be used for when the arbitration result of arbitrating submodule 722 be the load information of all backup servers of standby system when all reaching default load threshold, according to the preset priority rule backup job is ranked.
Wherein, this preset priority rule can for: determine the priority of backup job according to the time of reception of backup job, according to receive backup job by early to late order, the priority of each backup job is from high to low; Perhaps, determine the priority of backup job according to the significance level of each backup job, most important backup job priority is the highest; Be two kinds of examples of priority rule more than, present embodiment is not limited in this, any protection range that can all should fall into present embodiment to the priority rule that backup job is ranked.
In the present embodiment, by the operating state of each backup server in the global monitoring module 76 monitoring standby systems is set, and when finding that backup server breaks down, by load information update module 75 more newly-installed load information tables, the load information of the backup server that breaks down is updated to default load threshold, and send load information sampling request to the backup server that do not break down by sampling request sending module 77, load information receiver module 71 receives the load sample information that the above-mentioned backup server that does not break down sends, thereby can make the lightest backup server of load in the backup server that this master server determines not break down according to this load sample information, and the backup job in the backup server that breaks down is sent to the lightest backup server of this load handles; Thereby remedied the defective that backup server breaks down and can cause the backup job processing to be failed; avoided the creation data on the backup client to face not protected danger; improved the robustness of standby system; improved the parallel processing performance of each backup server in the standby system simultaneously; avoided some backup server load overweight; improved the backup job number that walks abreast in the standby system; thereby in the LAN-Free framework; improved the utilance of SAN bandwidth resources; improve the backup performance of standby system integral body, shortened backup window.
The structural representation of the backup server that Fig. 8 provides for the embodiment of the invention seven, the backup server in the present embodiment can be realized flow process embodiment illustrated in fig. 5.As shown in Figure 8, this backup server can comprise: load information sampling module 81, load information reporting module 82, backup job receiver module 83, backup job operation module 84 and sampling request receiver module 85.Particularly:
Load information sampling module 81, the load sample information that is used to gather backup server;
Load information reporting module 82 is used for the load sample information that load information sampling module 81 is gathered is sent to master server;
Backup job receiver module 83 is used to receive the backup job that master server sends;
Backup job operation module 84, the Backup Data stream that is used for backup job correspondence that backup job receiver module 83 is received stores storage array into, and the backup job number that is moving to load information sampling module 81 feedbacks;
Sample and ask receiver module 85, be used to receive the load information sampling request that master server sends, and the load sample information of notification payload intelligence sample module 81 collection backup servers.
Specific descriptions can repeat no more referring to the embodiment of the invention four herein.
In the foregoing description, load information sampling module 81 is gathered the load sample information of self, load information reporting module 82 is sent to master server with this load sample information, thereby master server can be determined the backup server that load is the lightest according to this load sample information, and backup job is sent to the lightest backup server of load handles, improved the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The structural representation of the standby system that Fig. 9 provides for the embodiment of the invention eight, as shown in Figure 9, this standby system comprises master server 91, at least two backup servers 92 and storage arrays 93.
Particularly, backup server 92 can adopt the present invention's backup server embodiment illustrated in fig. 8 to realize.
Particularly, master server 91 can adopt Fig. 6 of the present invention or master server embodiment illustrated in fig. 7 to realize.
In the foregoing description, master server 91 is determined the lightest backup server of load 92 according to the load sample information that comes from backup server 92, then backup job is sent to the lightest backup server of this load 92 and handles.Thereby improved the parallel processing performance of each backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The structural representation of the standby system that Figure 10 provides for the embodiment of the invention nine, the standby system of present embodiment adopts the LAN-Free framework, as shown in figure 10, this standby system comprises master server 1001, at least two backup servers 1002, storage array 1003 and backup client 1004.Wherein:
Particularly, backup client 1004 can send backup job to master server 1001 by SAN.
Particularly, backup server 1002 can be sent to master server 1001 with the load sample information by local ethernet, by SAN Backup Data stream is sent to storage array 1003.Particularly, backup server 1002 can adopt the present invention's backup server embodiment illustrated in fig. 8 to realize.
The standby system that present embodiment provides is the load balancing cluster system, and the backup server 1002 in master server 1001 these standby systems of centralized management carries out backup job.Preferably, can in backup server 1002, select the standby server of a backup server as master server 1001, the standby server of one station server as master server 1001 perhaps is set separately, constitute the load balancing cluster system of active and standby pattern, cause the standby system can't operate as normal to prevent that master server 1001 from breaking down.
In the foregoing description, master server 1001 is according to the load sample information that comes from backup server 1002, determine the lightest backup server of load 1002, will be sent to the lightest backup server of this load 1002 from the backup job of backup client 1004 then and handle; Also the backup server that breaks down can the be untreated backup job that finishes of master server 1001 is sent to the lightest backup server of load 1002 and handles.Thereby improved the parallel processing performance of each backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources, improve the backup performance of standby system integral body, shortened backup window.
The backup method that the embodiment of the invention provides, system, master server and backup server, the situation that is equally applicable to a plurality of load balancing cluster systems and deposits, at this moment need to be provided with the load information that a master server is managed all load balancing cluster systems, the backup job that receives is sent to the lightest load balancing cluster system of load, determine the lightest backup server of load in the lightest load balancing cluster system of this load by the master server in the lightest load balancing cluster system of load again, backup job is sent to the lightest backup server of this load, and the backup server the lightest by this load carries out subsequent treatment to backup job.Concrete implementation process and Fig. 1 of the present invention, Fig. 3 or flow process embodiment illustrated in fig. 4 are similar, do not repeat them here.
It will be appreciated by those skilled in the art that accompanying drawing is the schematic diagram of a preferred embodiment, module in the accompanying drawing or flow process might not be that enforcement the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device among the embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of the foregoing description can be merged into a module, also can further split into a plurality of submodules.
It should be noted that at last: above embodiment is only in order to technical scheme of the present invention to be described but not limit it, although the present invention is had been described in detail with reference to preferred embodiment, those of ordinary skill in the art is to be understood that: it still can make amendment or be equal to replacement technical scheme of the present invention, and these modifications or be equal to replacement and also can not make amended technical scheme break away from the spirit and scope of technical solution of the present invention.
Claims (13)
1, a kind of backup method is characterized in that, comprising:
Receive the load sample information that the backup server in the standby system sends, described standby system comprises at least two backup servers;
Determine the load information of described backup server according to described load sample information, and determine the lightest backup server of load in the described standby system according to described load information;
Backup job is sent to the lightest backup server of described load, so that the lightest backup server of described load stores the Backup Data stream of described backup job correspondence into storage array.
2, method according to claim 1 is characterized in that, in the load information table that the load sample information of described backup server and load information are recorded in setting, described method also comprises:
The state of each backup server in the monitoring standby system;
When having monitored backup server when breaking down, upgrade described load information table, the load information of the backup server that breaks down is updated to default load threshold, and sends load information sampling request to the backup server that does not break down.
According to any described method of claim 1 to 2, it is characterized in that 3, the load sample information that the backup server in the described reception standby system sends comprises:
Receive the load sample information that the backup server cycle in the standby system sends; And/or,
Receive the load sample information that the backup server Event triggered in the standby system sends.
4, method according to claim 3 is characterized in that, described load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving,
Describedly determine that according to described load sample information the load information of described backup server comprises:
Calculate the load information of CPU utilance, memory usage, I/O of described backup server and the weighted sum of the backup job number that moving, obtain the load information of described backup server.
5, method according to claim 1 is characterized in that, describedly determines also to comprise before the lightest backup server of load in the described standby system according to described load information:
When the load information of all backup servers in the described standby system all reaches default load threshold, backup job is ranked according to the preset priority rule.
6, a kind of backup method is characterized in that, comprising:
Gather the load sample information of backup server;
Described load sample information is sent to master server, determines the lightest backup server of load in the standby system according to described load sample information, and backup job is sent to the lightest backup server of described load for described master server;
To store storage array into from the Backup Data stream of the backup job correspondence of described master server.
7, method according to claim 6 is characterized in that, the load sample information of described collection backup server comprises:
Gather the load sample information of backup server according to preset period; And/or,
Gather the load sample information of backup server through Event triggered.
8, a kind of master server is characterized in that, comprising:
The load information receiver module is used for receiving the load sample information that the backup server of standby system sends, and described standby system comprises at least two backup servers;
The load balance scheduling module is used for determining according to the load sample information that described load information receiver module receives the load information of described backup server, and determines the lightest backup server of load in the described standby system according to described load information;
The backup job sending module is used for backup job is sent to the lightest backup server of load that described load balance scheduling module is determined.
9, master server according to claim 8 is characterized in that, also comprises:
The load information logging modle is used for the load information table that load sample information and load information with described backup server are recorded in setting;
The global monitoring module is used for monitoring the state of described each backup server of standby system;
The load information update module is used for perhaps when described global monitoring module monitors has backup server to break down, upgrading the load information in the described load information table in described standby system after described backup job sending module sends backup job;
The sampling request sending module is used for sending load information sampling request to the backup server that does not break down.
10, according to Claim 8 to 9 any described master servers, it is characterized in that the backup job number that the load information that described load information receiver module receives comprises the load information of CPU utilance, memory usage, I/O and moving;
Described load balance scheduling module comprises:
Calculating sub module is used to calculate the load information of CPU utilance, memory usage, I/O of described backup server and the weighted sum of the backup job number that moving, obtains the load information of described backup server;
The arbitration submodule is used for determining the backup server that load is the lightest according to described calculating sub module load calculated information.
11, master server according to claim 10 is characterized in that, described load balance scheduling module also comprises:
When queuing submodule, the load information that is used for arbitration result when described arbitration submodule and is described all backup servers of standby system all reach default load threshold, backup job is ranked according to the preset priority rule.
12, a kind of backup server is characterized in that, comprising:
The load information sampling module, the load sample information that is used to gather described backup server;
The load information reporting module is used for the load sample information of described load information sampling module collection is sent to master server;
The backup job receiver module is used to receive the backup job that described master server sends;
Backup job operation module, the Backup Data stream that is used for backup job correspondence that described backup job receiver module is received stores storage array into;
Sampling request receiver module is used to receive the load information sampling request that described master server sends, and notifies described load information sampling module to gather the load sample information of described backup server.
13, a kind of standby system is characterized in that, comprises master server, at least two backup servers and storage array, wherein:
Described backup server, be used to gather the load sample information of described backup server, described load sample information is sent to described master server, and receives the backup job that described master server sends, store the Backup Data stream of described backup job correspondence into described storage array;
Described master server, be used to receive the load sample information that described backup server sends, determine the load information of described backup server according to described load sample information, and determine the lightest backup server of load in the described standby system, and backup job is sent to the lightest backup server of described load according to described load information;
Described storage array is used to store the Backup Data stream that described backup server sends.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910093018A CN101662495B (en) | 2009-09-16 | 2009-09-16 | Backup method, master server, backup servers and backup system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910093018A CN101662495B (en) | 2009-09-16 | 2009-09-16 | Backup method, master server, backup servers and backup system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101662495A true CN101662495A (en) | 2010-03-03 |
| CN101662495B CN101662495B (en) | 2012-09-05 |
Family
ID=41790280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910093018A Active CN101662495B (en) | 2009-09-16 | 2009-09-16 | Backup method, master server, backup servers and backup system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101662495B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402461A (en) * | 2011-12-08 | 2012-04-04 | 曙光信息产业(北京)有限公司 | Balanced scheduling method based on operation scale |
| CN102523127A (en) * | 2011-12-30 | 2012-06-27 | 网宿科技股份有限公司 | Master server and slave server switching method and system utilizing same |
| CN102904952A (en) * | 2012-10-12 | 2013-01-30 | 北京锐安科技有限公司 | Self-adapting system and method for efficiently processing input of mass data to database |
| CN103269495A (en) * | 2013-04-28 | 2013-08-28 | 苏州洁祥电子有限公司 | Car networking system and data backup method |
| CN103297767A (en) * | 2012-02-28 | 2013-09-11 | 三星电子（中国）研发中心 | JPEG image decoding method and decoder suitable for multi-core embedded type platform |
| CN105230009A (en) * | 2014-05-10 | 2016-01-06 | 苏州阔地网络科技有限公司 | A kind of load balance process method and system |
| CN105338080A (en) * | 2015-10-28 | 2016-02-17 | 无锡峰巢美家网络科技有限公司 | Synchronization and balancing service system of multi-server service data and balancing method |
| CN105657009A (en) * | 2015-12-30 | 2016-06-08 | 浪潮(北京)电子信息产业有限公司 | Object gateway load balancing system and method, and cross-region object gateway storage system |
| CN105929439A (en) * | 2016-04-19 | 2016-09-07 | 成都新核泰科科技有限公司 | Aerial gamma spectrometry survey system based on UAV |
| CN106155836A (en) * | 2015-04-07 | 2016-11-23 | 北京中科同向信息技术有限公司 | LAN-free redundancy technique based on FC-san |
| WO2017161979A1 (en) * | 2016-03-22 | 2017-09-28 | 中兴通讯股份有限公司 | Cloud platform-based method and device for managing servers |
| CN107465537A (en) * | 2017-07-13 | 2017-12-12 | 深圳市盛路物联通讯技术有限公司 | The backup method and system of Internet of Things repeater |
| CN107483236A (en) * | 2017-08-01 | 2017-12-15 | 深圳市盛路物联通讯技术有限公司 | The method and device of Internet of Things access point backup |
| CN107529187A (en) * | 2017-07-27 | 2017-12-29 | 深圳市盛路物联通讯技术有限公司 | A kind of data back up method and device based on Internet of Things |
| CN116881052A (en) * | 2023-09-07 | 2023-10-13 | 上海凯翔信息科技有限公司 | Data restoration system for distributed storage |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150421B (en) * | 2006-09-22 | 2011-05-04 | 华为技术有限公司 | A distributed content distribution method, edge server and content distribution network |
| CN100476742C (en) * | 2007-02-09 | 2009-04-08 | 华中科技大学 | Load balancing method based on object storage device |
| CN101127701A (en) * | 2007-07-24 | 2008-02-20 | 深圳市深信服电子科技有限公司 | Method for realizing proxy server load balance via network device |
| CN101399746B (en) * | 2007-09-26 | 2011-03-16 | 华为技术有限公司 | Packet routing method, system, device and method, system for selecting backup resource |
-
2009
- 2009-09-16 CN CN200910093018A patent/CN101662495B/en active Active
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402461A (en) * | 2011-12-08 | 2012-04-04 | 曙光信息产业(北京)有限公司 | Balanced scheduling method based on operation scale |
| CN102523127A (en) * | 2011-12-30 | 2012-06-27 | 网宿科技股份有限公司 | Master server and slave server switching method and system utilizing same |
| CN103297767B (en) * | 2012-02-28 | 2016-03-16 | 三星电子（中国）研发中心 | A kind of jpeg image coding/decoding method and decoder being applicable to multinuclear embedded platform |
| CN103297767A (en) * | 2012-02-28 | 2013-09-11 | 三星电子（中国）研发中心 | JPEG image decoding method and decoder suitable for multi-core embedded type platform |
| CN102904952A (en) * | 2012-10-12 | 2013-01-30 | 北京锐安科技有限公司 | Self-adapting system and method for efficiently processing input of mass data to database |
| CN102904952B (en) * | 2012-10-12 | 2015-07-01 | 北京锐安科技有限公司 | Self-adapting system and method for efficiently processing input of mass data to database |
| CN103269495A (en) * | 2013-04-28 | 2013-08-28 | 苏州洁祥电子有限公司 | Car networking system and data backup method |
| CN105230009A (en) * | 2014-05-10 | 2016-01-06 | 苏州阔地网络科技有限公司 | A kind of load balance process method and system |
| CN106155836A (en) * | 2015-04-07 | 2016-11-23 | 北京中科同向信息技术有限公司 | LAN-free redundancy technique based on FC-san |
| CN105338080A (en) * | 2015-10-28 | 2016-02-17 | 无锡峰巢美家网络科技有限公司 | Synchronization and balancing service system of multi-server service data and balancing method |
| CN105657009A (en) * | 2015-12-30 | 2016-06-08 | 浪潮(北京)电子信息产业有限公司 | Object gateway load balancing system and method, and cross-region object gateway storage system |
| CN105657009B (en) * | 2015-12-30 | 2018-12-21 | 浪潮(北京)电子信息产业有限公司 | Object gateway SiteServer LBS, method and trans-regional object gateway storage system |
| WO2017161979A1 (en) * | 2016-03-22 | 2017-09-28 | 中兴通讯股份有限公司 | Cloud platform-based method and device for managing servers |
| CN105929439A (en) * | 2016-04-19 | 2016-09-07 | 成都新核泰科科技有限公司 | Aerial gamma spectrometry survey system based on UAV |
| CN107465537A (en) * | 2017-07-13 | 2017-12-12 | 深圳市盛路物联通讯技术有限公司 | The backup method and system of Internet of Things repeater |
| CN107529187A (en) * | 2017-07-27 | 2017-12-29 | 深圳市盛路物联通讯技术有限公司 | A kind of data back up method and device based on Internet of Things |
| CN107483236A (en) * | 2017-08-01 | 2017-12-15 | 深圳市盛路物联通讯技术有限公司 | The method and device of Internet of Things access point backup |
| CN107483236B (en) * | 2017-08-01 | 2021-03-19 | 深圳市盛路物联通讯技术有限公司 | Method and device for backing up access point of Internet of things |
| CN116881052A (en) * | 2023-09-07 | 2023-10-13 | 上海凯翔信息科技有限公司 | Data restoration system for distributed storage |
| CN116881052B (en) * | 2023-09-07 | 2023-11-24 | 上海凯翔信息科技有限公司 | Data restoration system for distributed storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101662495B (en) | 2012-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101662495B (en) | Backup method, master server, backup servers and backup system | |
| US20220057951A1 (en) | Data storage system with metadata check-pointing | |
| US9485160B1 (en) | System for optimization of input/output from a storage array | |
| US11016956B2 (en) | Database management system with database hibernation and bursting | |
| US11516072B2 (en) | Hybrid cluster recovery techniques | |
| US9858322B2 (en) | Data stream ingestion and persistence techniques | |
| EP2633403B1 (en) | System and method of active risk management to reduce job de-scheduling probability in computer clusters | |
| US9276959B2 (en) | Client-configurable security options for data streams | |
| US9794135B2 (en) | Managed service for acquisition, storage and consumption of large-scale data streams | |
| US8140791B1 (en) | Techniques for backing up distributed data | |
| CN102402395B (en) | Quorum disk-based non-interrupted operation method for high availability system | |
| US20060069761A1 (en) | System and method for load balancing virtual machines in a computer network | |
| US8856091B2 (en) | Method and apparatus for sequencing transactions globally in distributed database cluster | |
| US8639808B1 (en) | Method and apparatus for monitoring storage unit ownership to continuously balance input/output loads across storage processors | |
| US20090043958A1 (en) | Method and apparatus for capacity on demand dynamic chunk allocation | |
| US20030204788A1 (en) | Predictive failure analysis for storage networks | |
| US20110231602A1 (en) | Non-disruptive disk ownership change in distributed storage systems | |
| CN110086888B (en) | Multi-cluster dynamic load method and device based on RabbitMQ and electronic equipment | |
| WO2007028248A1 (en) | Method and apparatus for sequencing transactions globally in a distributed database cluster | |
| CN103329106A (en) | Detection and handling of ALUA preferences and state transitions by host | |
| JP2005275829A (en) | Storage system | |
| US10810054B1 (en) | Capacity balancing for data storage system | |
| US7334062B1 (en) | Technique to monitor application behavior and tune replication performance | |
| CN101137984A (en) | Systems, methods, and software for distributed loading of databases | |
| JPWO2016166844A1 (en) | Distributed processing system, task processing method, storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee |
Owner name: HUAWEI DIGITAL TECHNOLOGY (CHENGDU) CO., LTD. Free format text: FORMER NAME: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES CO., LTD. |
|
| CP01 | Change in the name or title of a patent holder |
Address after: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Patentee after: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. Address before: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Patentee before: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20220908 Address after: No. 1899 Xiyuan Avenue, high tech Zone (West District), Chengdu, Sichuan 610041 Patentee after: Chengdu Huawei Technologies Co.,Ltd. Address before: 611731 Qingshui River District, Chengdu hi tech Zone, Sichuan, China Patentee before: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. |
|
| TR01 | Transfer of patent right |