CN101662495B - Backup method, master server, backup servers and backup system - Google Patents
Backup method, master server, backup servers and backup system Download PDFInfo
- Publication number
- CN101662495B CN101662495B CN200910093018A CN200910093018A CN101662495B CN 101662495 B CN101662495 B CN 101662495B CN 200910093018 A CN200910093018 A CN 200910093018A CN 200910093018 A CN200910093018 A CN 200910093018A CN 101662495 B CN101662495 B CN 101662495B
- Authority
- CN
- China
- Prior art keywords
- backup
- load
- server
- information
- backup server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Hardware Redundancy (AREA)
Abstract
The embodiment of the invention discloses a backup method, a master server, backup servers and a backup system. The method includes the following steps: receiving load sampling information sent by the backup server in the backup system that comprises at least two backup servers; according to the load sampling information, determining the load information of the backup server and according to the load information, determining the backup server with lightest load in the backup system; and sending backup operation to the backup server with lightest load so that the backup server with lightest load stores the backup data stream corresponding to the backup operation in a storage array. In LAN-Free framework, the embodiment of the invention improves the utilization rate of SAN bandwidth resources and the whole backup performance of the backup system, shortens a backup window, makes up the defect that the treatment of backup operation fails when the backup server goes wrong and improves the robustness of the backup system.
Description
Technical field
The embodiment of the invention relates to the data backup field, particularly a kind of backup method, master server, backup server and standby system.
Background technology
Present various redundancy technique and the backup mode Along with people's that is derived by various redundancy techniques are deepened and constantly development the awareness of data protection importance.Because business data, personal data amount are increased sharply, the burden of standby system is increasing, is faced with the backup window problems of too.Therefore, backup performance become current structure standby system one of the important indicator that must pay close attention to.Wherein, backup window is meant in not serious influence use to be needed under the situation of application program of backed up data, the time interval of carrying out data backup.
Aspect backup medium chooses, traditional be replaced just gradually merely with the backup mode of tape as medium.Utilize disk, virtual tape library, perhaps the mode that combines with tape of disk backs up the development trend that becomes current standby system.And the group-network construction of standby system develops developing out based on storage area network (Storage Area Network gradually except original backup framework based on local network; Hereinafter to be referred as: local area network (LAN) SAN) separates (Local AreaNetwork-Free; Hereinafter to be referred as: LAN-Free) separate (Server-Free) backup framework with server.
In the LAN-Free framework, backup server is responsible for backing up the data on the backup client that configures in advance, and Backup Data stream arrives storage array through SAN.In this LAN-Free framework; Because Backup Data stream is without the local Ethernet of operation system; So backup traffic is little to the influence of operation system, the performance of standby system has bigger lifting with performance based on the LAN-Based group-network construction of local network.
In realizing process of the present invention; The inventor finds in the prior art owing to each backup server load in the standby system is unbalanced; The server load that possibly have is overweight; Can not in time handle its backup job, thereby can not make full use of the bandwidth resources of SAN, the parallel performance of backup job is low in the whole standby system.
Summary of the invention
The embodiment of the invention provides a kind of backup method, master server, backup server and standby system, to improve the parallel processing performance of each backup server in the standby system, improves backup job number parallel in the standby system, shortens backup window.
The embodiment of the invention provides a kind of backup method, comprising:
Receive the load sample information that the backup server in the standby system sends, said standby system comprises at least two backup servers;
Confirm the load information of said backup server according to said load sample information, and confirm the lightest backup server of load in the said standby system according to said load information;
Backup job is sent to the lightest backup server of said load, so that the lightest backup server Backup Data stream that said backup job is corresponding of said load stores storage array into.
The embodiment of the invention also provides a kind of backup method, comprising:
Gather the load sample information of backup server;
Said load sample information is sent to master server, confirms the lightest backup server of load in the standby system according to said load sample information, and backup job is sent to the lightest backup server of said load for said master server;
To store storage array into by corresponding Backup Data stream from the backup job of said master server.
The embodiment of the invention also provides a kind of master server, comprising:
The load information receiver module is used for receiving the load sample information that the backup server of standby system sends, and said standby system comprises at least two backup servers;
The load balance scheduling module is used for confirming according to the load sample information that said load information receiver module receives the load information of said backup server, and confirms the lightest backup server of load in the said standby system according to said load information;
The backup job sending module is used for backup job is sent to the lightest backup server of load that said load balance scheduling module is confirmed.
The embodiment of the invention also provides a kind of backup server, comprising:
The load information sampling module, the load sample information that is used to gather said backup server;
The load information reporting module is used for the load sample information of said load information sampling module collection is sent to master server;
The backup job receiver module is used to receive the backup job that said master server sends;
Backup job operation module, the corresponding Backup Data stream of backup job that is used for said backup job receiver module is received stores storage array into;
Sampling request receiver module is used to receive the load information sampling request that said master server sends, and notifies said load information sampling module to gather the load sample information of said backup server.
The embodiment of the invention also provides a kind of standby system, comprises master server, at least two backup servers and storage array, wherein:
Said backup server; Be used to gather the load sample information of said backup server; Said load sample information is sent to said master server, and receives the backup job that said master server sends, the Backup Data stream that said backup job is corresponding stores said storage array into;
Said master server; Be used to receive the load sample information that said backup server sends; Confirm the load information of said backup server according to said load sample information; And confirm the lightest backup server of load in the said standby system, and backup job is sent to the lightest backup server of said load according to said load information;
Said storage array is used to store the Backup Data stream that said backup server sends.
Through the embodiment of the invention, the master server in the standby system is confirmed the lightest backup server of load in the standby system according to the load sample information that comes from backup server, then backup job is sent to the lightest backup server of this load and handles.Thereby improved the parallel processing performance of backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
Description of drawings
In order to be illustrated more clearly in the present invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
The flow chart of the backup method that Fig. 1 provides for the embodiment of the invention one;
Fig. 2 sends the sketch map of an embodiment of backup job for master server of the present invention;
The flow chart of the backup method that Fig. 3 provides for the embodiment of the invention two;
The flow chart of the backup method that Fig. 4 provides for the embodiment of the invention three;
The flow chart of the backup method that Fig. 5 provides for the embodiment of the invention four;
The structural representation of the master server that Fig. 6 provides for the embodiment of the invention five;
The structural representation of the master server that Fig. 7 provides for the embodiment of the invention six;
The structural representation of the backup server that Fig. 8 provides for the embodiment of the invention seven;
The structural representation of the standby system that Fig. 9 provides for the embodiment of the invention eight;
The structural representation of the standby system that Figure 10 provides for the embodiment of the invention nine.
Embodiment
To combine the accompanying drawing among the present invention below, the technical scheme among the present invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills are obtained under the prerequisite of not making creative work belongs to the scope that the present invention protects.
The flow chart of the backup method that Fig. 1 provides for the embodiment of the invention one, as shown in Figure 1, this embodiment comprises:
Step 101, master server receive the load sample information that the backup server in the standby system sends; This standby system comprises at least two backup servers.
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gathers the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation; Through local ethernet the load sample information that writes down is sent to master server again.Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Particularly, backup server can periodically send the load sample information to master server, and for example: backup server can be one-period in 2 seconds, whenever sends a load sample information at a distance from 2 seconds to master server; Also can after Event triggered, send the load sample information to master server, for example: backup server can send a load sample information to master server after handling a backup job; Can after receiving a backup job, send a load sample information to master server.More than just backup server sends the dual mode of load sample information to master server, and present embodiment is not limited in this, and this dual mode can use separately, also can be used in combination.
Step 102, master server is confirmed the load information of backup server according to the load sample information, and confirms the backup server that load is the lightest according to load information.
Step 103, master server is sent to the lightest backup server of load with backup job, so that the lightest backup server Backup Data stream that said backup job is corresponding of said load stores storage array into.
In the present embodiment, master server can be sent to the lightest backup server of load with backup job through local ethernet.
Fig. 2 sends the sketch map of an embodiment of backup job for master server of the present invention; As shown in Figure 2; When sending backup job 15; Master server can confirm that the lightest backup server of load is a backup server 5 according to load information, and therefore, master server is sent to backup server 5 with backup job 15.Receive after the backup job, backup server 5 operation backup jobs 15 store backup job 15 corresponding Backup Data streams into storage array.
When two of master server transmissions or many backup jobs, master server can be ranked to backup job according to the preset priority rule, and repeated execution of steps 101～step 103 is sent to backup server successively with the backup job in the queue queue.
This preset priority rule can for: confirm the priority of backup job according to the time of reception of each backup job, for example: according to receive backup job by early to late order, the priority of each backup job is from high to low; Perhaps, confirm the priority of backup job according to the significance level of each backup job, most important backup job priority is the highest; Be two kinds of examples of priority rule more than, present embodiment is not limited in this, any protection range that can all should fall into present embodiment to the priority rule that backup job is ranked.
In the foregoing description, the master server in the standby system is confirmed the lightest backup server of load in the standby system according to the load sample information that comes from backup server, then backup job is sent to the lightest backup server of this load and handles.Thereby improved the parallel processing performance of backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The flow chart of the backup method that Fig. 3 provides for the embodiment of the invention two, as shown in Figure 3, this embodiment comprises:
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly; Backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier; Gather the load sample information of backup server self then; The load sample information is recorded in the data structure of foundation, through local ethernet the load sample information that writes down is sent to master server again; Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Particularly, backup server can periodically send the load sample information to master server, and for example: backup server can be one-period in 2 seconds, whenever sends a load sample information at a distance from 2 seconds to master server; Also can after Event triggered, send the load sample information to master server, for example: backup server can send a load sample information to master server after handling a backup job; Can after receiving a backup job, send a load sample information to master server.More than just backup server sends the dual mode of load sample information to master server, and present embodiment is not limited in this, and this dual mode can use separately, also can be used in combination.
Particularly, after the load sample information that receives the backup server transmission, master server can be recorded in the load sample information of backup server in the load information table of setting; Calculate the load information of backup server then according to the load sample information of record, and the load information of the backup server that calculates is recorded in the above-mentioned load information table.In above-mentioned load information table, master server can be provided with sign for each backup server, as the load sample information of searching each backup server and the index of load information.
In the present embodiment; When the CPU utilance is that C, memory usage are M, the backup job number that moving is J, I/O load information is when being IO; Master server calculates load information and the weighted sum of the backup job number that moving of CPU utilance, memory usage, the I/O of backup server, obtain backup server load information can for:
L＝F(C，M，J，IO)＝C×X1+M×X2+J×X3+IO×X4 (1)
In the formula (1), X1, X2, X3 and X4 represent C, M, J and the IO weight when computational load information, X1+X2+X3+X4=1 respectively.Wherein, the concrete value of Xi (i=1,2,3,4) can recommend to be provided with according to the ruuning situation setting or the employing of master server, for example: be provided with
It below only is a kind of mode of calculating the load information of backup server; The embodiment of the invention is not limited in this; Any can be according to CPU utilance, memory usage, the load information of I/O and the backup job number that is moving of backup server, the mode of calculating the load information of backup server all should fall into the protection range of the embodiment of the invention.
Particularly, master server according to load information confirm the lightest backup server of load can for: master server is confirmed the backup server that load is the lightest according to the load information that writes down in the load information table.
In the present embodiment, the load information of two or many backup servers is identical in standby system, and for hour, and when promptly the lightest backup server of load was not unique in the standby system, master server can be selected a lightest backup server of load at random; Perhaps; Master server can be selected the highest backup server of priority according to the preset priority rule in the lightest backup server of load, for example: master server can be confirmed the priority of backup server according to the sign of backup server; Suppose backup server be designated 1～n the time; According to the sign of backup server by little to big order, the priority of backup server from high to low, it is the highest promptly to be designated 1 backup server priority.
Particularly, master server can be sent to the lightest backup server of load with backup job through local ethernet.
In the present embodiment, an embodiment of master server transmission backup job can be as shown in Figure 2, receive after the backup job, and this backup job of backup server operation, the Backup Data stream that this backup job is corresponding stores storage array into.
When two of master server transmissions or many backup jobs, master server can be ranked to backup job according to the preset priority rule, and repeated execution of steps 301～step 304 is sent to backup server successively with the backup job in the queue queue.This preset priority rule can adopt the priority rule that provides in the embodiment of the invention one, repeats no more at this.
After backup job is sent to the lightest backup server of load; Master server can be recorded in the transmission information of backup job in the above-mentioned load information table in the list item corresponding with the lightest backup server of load, and upgrades the load information of the lightest backup server of load.
In the foregoing description; Master server in the standby system is according to the load sample information that comes from backup server; Calculate the load information of backup server; Confirm the backup server that load is the lightest according to this load information then, backup job is sent to the lightest backup server of this load handles.Thereby improved the parallel processing performance of backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The flow chart of the backup method that Fig. 4 provides for the embodiment of the invention three, as shown in Figure 4, this embodiment comprises:
Step 402 has judged whether that backup server breaks down.When master server has monitored backup server when breaking down, get into step 403; If master server does not find that backup server breaks down, then get into step 405.
Particularly, in the embodiment of the invention, be provided with a load information table in the master server, be used to write down the load sample information of each backup server and the load information of each backup server of calculating according to the load sample information of record.
In the present embodiment; When master server has monitored backup server when breaking down; Master server upgrades the load information table, the load information of the backup server that breaks down is updated to preset load threshold, like this; Before this backup server that breaks down recovered operate as normal, master server can not send backup job to this backup server that breaks down again.
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly; Backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier; Gather the load sample information of backup server self then; The load sample information is recorded in the data structure of foundation, through local ethernet the load sample information that writes down is sent to master server again; Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Particularly, backup server can periodically send the load sample information to master server, and for example: backup server can be one-period in 2 seconds, whenever sends a load sample information at a distance from 2 seconds to master server; Also can after Event triggered, send the load sample information to master server, for example: backup server can perhaps receive after the backup job after handling a backup job, sends the load sample information to master server; Wherein, Event triggered comprises that also backup server receives the load information sampling request that master server sends, and after receiving load information sampling request, backup server sends the load sample information to master server.More than just backup server is to several kinds of modes of master server transmission load sample information, and present embodiment is not limited in this, and aforesaid way can use separately, also can be used in combination.
In the present embodiment, master server can obtain the load information of each backup server according to the method that step 302 provides, and repeats no more at this.
Step 407 judges whether the load information of all backup servers in the standby system all reaches preset load threshold.When the load information of all backup servers all reaches preset load threshold, execution in step 410; When existing load information not reach the backup server of preset load threshold in the standby system, execution in step 408.
Particularly, master server can be confirmed the backup server that load is the lightest according to the load information that writes down in the load information table.In the present embodiment, the load information of two or many backup servers is identical in standby system, and for hour, and when promptly the lightest backup server of load was not unique in the standby system, master server can be selected a lightest backup server of load at random; Perhaps; Master server can be selected the highest backup server of priority according to the preset priority rule in the lightest backup server of load, for example: master server can be confirmed the priority of backup server according to the sign of backup server; Suppose backup server be designated 1～n the time; According to the sign of backup server by little to big order, the priority of backup server from high to low, it is the highest promptly to be designated 1 backup server priority.
Particularly, master server can be sent to the lightest backup server of load with backup job through local ethernet.Wherein, backup job comprises the backup job that is untreated and finishes from the backup job of backup client and the backup server that breaks down.
In the present embodiment, an embodiment of master server transmission backup job can be as shown in Figure 2, receive after the backup job, and this backup job of backup server operation, the Backup Data stream that this backup job is corresponding stores storage array into.
When two of transmissions or many backup jobs, master server can be ranked to backup job according to the preset priority rule, and repeated execution of steps 401～step 409 is sent to backup server successively with the backup job in the queue queue.This preset priority rule can adopt the priority rule that provides in the embodiment of the invention one, repeats no more at this.
After backup job is sent to the lightest backup server of load; Master server can be recorded in the transmission information of backup job in the above-mentioned load information table in the list item corresponding with the lightest backup server of load, and upgrades the load information of the lightest backup server of load.
In the present embodiment, when the load information of all backup servers in the standby system all reaches preset load threshold, explain that present backup server all is in the state of operating at full capacity; Ability is not handled more backup job; At this moment, master server can be ranked to backup job according to the preset priority rule and waited, and returns execution in step 401; Again the less backup server of wait acknowledge load is to issue processing with backup job.Wherein, this preset priority rule can adopt the priority rule that provides in the embodiment of the invention one, repeats no more at this.
In the foregoing description; Master server in the standby system is monitored the state of backup server; When having monitored backup server when breaking down, the backup job on the backup server that breaks down is sent to the backup server that does not break down, break down and can cause backup job to handle the defective of failure thereby remedied backup server; Avoid the creation data on the backup client to face not protected danger, improved the robustness of standby system.And when there is the backup server of the load threshold that does not reach preset in the master server in the standby system in confirming standby system; Confirm the backup server that load is the lightest according to load information, backup job is sent to the lightest backup server of this load handles.Thereby improved the parallel processing performance of each backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The flow chart of the backup method that Fig. 5 provides for the embodiment of the invention four, as shown in Figure 5, this embodiment comprises:
In the present embodiment, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gathers the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation; Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Backup server can periodically be gathered the load sample information, and for example: backup server can be one-period in 2 seconds, every load sample information of gathering a time at a distance from 2 seconds; Also can after Event triggered, gather the load sample information, for example: backup server can perhaps receive after the backup job after handling a backup job, gathers one time the load sample information; Wherein, Event triggered comprises that also backup server receives the load information sampling request that master server sends, and after receiving load information sampling request, backup server is gathered the load sample information of this backup server.Be several kinds of modes that backup server is gathered the load sample information more than, present embodiment is not limited in this, and aforesaid way can use separately, also can be used in combination.
Particularly, backup server can be sent to master server with the load sample information through local ethernet.
In the foregoing description, backup server is gathered the load sample information of self, and this load sample information is sent to master server; Thereby master server can be confirmed the backup server that load is the lightest according to this load sample information, and backup job is sent to the lightest backup server of load handles, and has improved the parallel processing performance of backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be accomplished through the relevant hardware of program command; Aforesaid program can be stored in the computer read/write memory medium; This program the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
The structural representation of the master server that Fig. 6 provides for the embodiment of the invention five; The master server of present embodiment can be realized the flow process that the present invention is embodiment illustrated in fig. 1; As shown in Figure 6, this master server can comprise: load information receiver module 61, load balance scheduling module 62 and backup job sending module 63.Wherein:
Load information receiver module 61 is used for receiving the load sample information that the backup server of standby system sends, and this standby system comprises at least two backup servers;
Wherein, this load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving.Particularly, backup server can be set up the data structure that comprises above-mentioned four kinds of information earlier, gathers the load sample information of backup server self then, the load sample information is recorded in the data structure of foundation; Through local ethernet the load sample information that writes down is sent to master server again.Wherein, this data structure can be chained list or array etc., and the embodiment of the invention does not limit the concrete form of data structure.
Load balance scheduling module 62 is used for confirming according to the load sample information that load information receiver module 61 receives the load information of backup server, and confirms the lightest backup server of load in the standby system according to this load information;
Backup job sending module 63 is used for backup job is sent to the lightest backup server of load that load balance scheduling module 62 is confirmed.
In the foregoing description; The load sample information that comes from backup server that load balance scheduling module 62 receives according to load information receiver module 61; Confirm the backup server that load is the lightest, backup job sending module 63 is sent to the lightest backup server of this load with backup job and handles then.Thereby improved the parallel processing performance of backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The structural representation of the master server that Fig. 7 provides for the embodiment of the invention six; The master server of present embodiment can be realized Fig. 3 of the present invention or flow process embodiment illustrated in fig. 4; As shown in Figure 7, this master server can comprise: load information receiver module 71, load balance scheduling module 72, backup job sending module 73, load information logging modle 74, load information update module 75, global monitoring module 76 and sampling request sending module 77.
Wherein, load information receiver module 71 is used for receiving the load sample information that the backup server of standby system sends, and this standby system comprises at least two backup servers;
Particularly, load information receiver module 71 can receive the load sample information of backup server cycle transmission, and for example: backup server can be one-period in 2 seconds, whenever sends a load sample information at a distance from 2 seconds to master server; Load information receiver module 71 also can receive the load sample information that backup server sends to master server after Event triggered; For example: backup server can be after handling a backup job; Perhaps receive after the backup job, send the load sample information to master server; Backup server also can receive master server and send the load sample information to the load information sampling request back that backup server sends to master server.More than just backup server is to several kinds of modes of master server transmission load sample information, and present embodiment is not limited in this, and aforesaid way can use separately, also can be used in combination.
Concrete, the backup job number that the load sample information that said load information receiver module 71 receives can comprise the load information of CPU utilance, memory usage, I/O and move.
Load balance scheduling module 72 is used for confirming according to the load sample information that load information receiver module 71 receives the load information of backup server, and confirms the lightest backup server of load in the standby system according to load information;
Backup job sending module 73 is used for backup job is sent to the lightest backup server of load that load balance scheduling module 72 is confirmed;
Load information logging modle 74 is used for the load information table that load sample information and load information with backup server are recorded in setting;
Load information update module 75; Be used for after backup job sending module 73 sends backup job; The transmission information of backup job is recorded in the load information table in the list item corresponding with the lightest backup server of load, and upgrades the load information of the lightest backup server of load;
In addition, when breaking down for some backup server in standby system, do not influence the operation of backup job, the master server in the present embodiment can also comprise:
Load information update module 75 also is used for monitoring standby system when having backup server to break down when global monitoring module 76, upgrades above-mentioned load information table, and the load information of the backup server that breaks down is updated to preset load threshold;
It is understandable that the purpose that the load information of part server that breaks down is updated to preset load threshold is that backup job sending module 73 no longer sends backup job to this backup server when issuing backup job.
Sampling request sending module 77 is used for monitoring standby system when having backup server to break down when global monitoring module 76, sends the load information sampling to the backup server that does not break down and asks.
Concrete; Send load information sampling request through the backup server that other do not break down in standby system; Thereby the backup server collection that other do not break down in the triggering standby system is also sent self load sample information to this master server; Thereby can make this master server confirm the backup server that load is the lightest, and the backup job in the backup server that breaks down is sent to the lightest backup server of said load handles according to this load sample information.
Particularly, load balance scheduling module 72 can comprise: calculating sub module 721 and arbitration submodule 722, wherein:
Calculating sub module 721 is used to calculate load information and the weighted sum of the backup job number that moving of CPU utilance, memory usage, the I/O of backup server, obtains the load information of backup server; Specific descriptions are seen before and are stated embodiment two, repeat no more at this;
Load balance scheduling module 72 can also comprise:
Wherein, this preset priority rule can for: confirm the priority of backup job according to the time of reception of backup job, according to receive backup job by early to late order, the priority of each backup job is from high to low; Perhaps, confirm the priority of backup job according to the significance level of each backup job, most important backup job priority is the highest; Be two kinds of examples of priority rule more than, present embodiment is not limited in this, any protection range that can all should fall into present embodiment to the priority rule that backup job is ranked.
In the present embodiment; Through the operating state of each backup server in the global monitoring module 76 monitoring standby systems is set; And when finding that backup server breaks down; By load information update module 75 more newly-installed load information tables; The load information of the backup server that breaks down is updated to preset load threshold, and sends load information sampling request by sampling request sending module 77 to the backup server that does not break down, load information receiver module 71 receives the load sample information that the above-mentioned backup server that does not break down sends; Thereby can make the lightest backup server of load in the backup server that this master server confirms not break down according to this load sample information, and the backup job in the backup server that breaks down is sent to the lightest backup server of this load handles; Thereby remedied the defective that backup server breaks down and can cause the backup job processing to be failed; Avoid the creation data on the backup client to face not protected danger, improved the robustness of standby system, improved the parallel processing performance of each backup server in the standby system simultaneously; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The structural representation of the backup server that Fig. 8 provides for the embodiment of the invention seven, the backup server in the present embodiment can be realized flow process embodiment illustrated in fig. 5.As shown in Figure 8, this backup server can comprise: load information sampling module 81, load information reporting module 82, backup job receiver module 83, backup job operation module 84 and sampling request receiver module 85.Particularly:
Load information sampling module 81, the load sample information that is used to gather backup server;
Load information reporting module 82 is used for the load sample information that load information sampling module 81 is gathered is sent to master server;
Backup job receiver module 83 is used to receive the backup job that master server sends;
Backup job operation module 84, the corresponding Backup Data stream of backup job that is used for backup job receiver module 83 is received stores storage array into, and feeds back the backup job number that is moving to load information sampling module 81;
Sample and ask receiver module 85, be used to receive the load information sampling request that master server sends, and the load sample information of notification payload intelligence sample module 81 collection backup servers.
Specific descriptions can repeat no more referring to the embodiment of the invention four here.
In the foregoing description; Load information sampling module 81 is gathered the load sample information of self, and load information reporting module 82 is sent to master server with this load sample information, thereby master server can be confirmed the backup server that load is the lightest according to this load sample information; And backup job is sent to the lightest backup server of load handles; Improve the parallel processing performance of backup server in the standby system, avoided some backup server load overweight, improved the backup job number that walks abreast in the standby system; Thereby in the LAN-Free framework; Improve the utilance of SAN bandwidth resources, improved the whole backup performance of standby system, shortened backup window.
The structural representation of the standby system that Fig. 9 provides for the embodiment of the invention eight, as shown in Figure 9, this standby system comprises master server 91, at least two backup servers 92 and storage arrays 93.
Particularly, backup server 92 can adopt the present invention's backup server embodiment illustrated in fig. 8 to realize.
Particularly, master server 91 can adopt Fig. 6 of the present invention or master server embodiment illustrated in fig. 7 to realize.
In the foregoing description, master server 91 is confirmed the lightest backup server of load 92 according to the load sample information that comes from backup server 92, then backup job is sent to the lightest backup server of this load 92 and handles.Thereby improved the parallel processing performance of each backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The structural representation of the standby system that Figure 10 provides for the embodiment of the invention nine; The standby system of present embodiment adopts the LAN-Free framework; Shown in figure 10, this standby system comprises master server 1001, at least two backup servers 1002, storage array 1003 and backup client 1004.Wherein:
Particularly, backup client 1004 can be sent backup job to master server 1001 through SAN.
Particularly, backup server 1002 can be sent to master server 1001 with the load sample information through local ethernet, through SAN Backup Data stream is sent to storage array 1003.Particularly, backup server 1002 can adopt the present invention's backup server embodiment illustrated in fig. 8 to realize.
The standby system that present embodiment provides is the load balancing cluster system, and the backup server 1002 in master server 1001 these standby systems of centralized management carries out backup job.Preferably; Can in backup server 1002, select the standby server of a backup server as master server 1001; The standby server of one station server as master server 1001 perhaps is set separately; Constitute the load balancing cluster system of active and standby pattern, cause the standby system can't operate as normal to prevent that master server 1001 from breaking down.
In the foregoing description; Master server 1001 is according to the load sample information that comes from backup server 1002; Confirm the lightest backup server of load 1002, will be sent to the lightest backup server of this load 1002 from the backup job of backup client 1004 then and handle; Master server 1001 also can be sent to the be untreated backup job that finishes of the backup server that breaks down the lightest backup server of load 1002 and handles.Thereby improved the parallel processing performance of each backup server in the standby system; Avoided some backup server load overweight; Improve the backup job number that walks abreast in the standby system, thereby in the LAN-Free framework, improved the utilance of SAN bandwidth resources; Improve the whole backup performance of standby system, shortened backup window.
The backup method that the embodiment of the invention provides, system, master server and backup server; The situation that is equally applicable to a plurality of load balancing cluster systems and deposits; At this moment the load information of all load balancing cluster systems of master server management need be set; The backup job that receives is sent to the lightest load balancing cluster system of load; Confirm the lightest backup server of load in the lightest load balancing cluster system of this load by the master server in the lightest load balancing cluster system of load again, backup job is sent to the lightest backup server of this load, the backup server the lightest by this load carries out subsequent treatment to backup job.Concrete implementation process and Fig. 1 of the present invention, Fig. 3 or flow process embodiment illustrated in fig. 4 are similar, repeat no more at this.
It will be appreciated by those skilled in the art that accompanying drawing is the sketch map of a preferred embodiment, module in the accompanying drawing or flow process might not be that embodiment of the present invention is necessary.
It will be appreciated by those skilled in the art that the module in the device among the embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of the foregoing description can be merged into a module, also can further split into a plurality of submodules.
What should explain at last is: above embodiment is only in order to technical scheme of the present invention to be described but not limit it; Although the present invention has been carried out detailed explanation with reference to preferred embodiment; Those of ordinary skill in the art is to be understood that: it still can make amendment or be equal to replacement technical scheme of the present invention, also can not make amended technical scheme break away from the spirit and the scope of technical scheme of the present invention and these are revised or be equal to replacement.
Claims (8)
1. a backup method is characterized in that, comprising:
The state of each backup server in the monitoring standby system, said standby system comprises at least two backup servers;
When having monitored backup server when breaking down, more newly-installed load information table is updated to preset load threshold with the load information of the backup server that breaks down, and sends load information sampling request to the backup server that does not break down; Said load information table is used to write down the load sample information and the load information of said backup server;
Receive the load sample information that the backup server in the standby system sends;
Confirm the load information of said backup server according to said load sample information, and confirm the lightest backup server of load in the said standby system according to said load information;
Backup job is sent to the lightest backup server of said load, so that the lightest backup server Backup Data stream that said backup job is corresponding of said load stores storage array into.
2. method according to claim 1 is characterized in that, the load sample information that the backup server in the said reception standby system sends comprises:
The load sample information that the backup server cycle in the standby system that receives sends; And/or,
Receive the load sample information that the backup server Event triggered in the standby system is sent.
3. method according to claim 2 is characterized in that, said load sample information comprises: the load information of CPU utilance, memory usage, I/O and the backup job number that is moving,
Saidly confirm that according to said load sample information the load information of said backup server comprises:
Calculate load information and the weighted sum of the backup job number that moving of CPU utilance, memory usage, the I/O of said backup server, obtain the load information of said backup server.
4. method according to claim 1 is characterized in that, saidly confirms also to comprise before the lightest backup server of load in the said standby system according to said load information:
When the load information of all backup servers in the said standby system all reaches preset load threshold, backup job is ranked according to the preset priority rule.
5. a master server is characterized in that, comprising:
The load information receiver module is used for receiving the load sample information that the backup server of standby system sends, and said standby system comprises at least two backup servers;
The load balance scheduling module is used for confirming according to the load sample information that said load information receiver module receives the load information of said backup server, and confirms the lightest backup server of load in the said standby system according to said load information;
The backup job sending module is used for backup job is sent to the lightest backup server of load that said load balance scheduling module is confirmed;
The load information logging modle is used for the load information table that load sample information and load information with said backup server are recorded in setting;
The global monitoring module is used for monitoring the state of said each backup server of standby system;
The load information update module is used for after said backup job sending module sends backup job, perhaps when said global monitoring module monitors has backup server to break down, upgrading the load information in the said load information table in said standby system;
The sampling request sending module is used for sending load information sampling request to the backup server that does not break down.
6. master server according to claim 5 is characterized in that, the backup job number that the load information that said load information receiver module receives comprises the load information of CPU utilance, memory usage, I/O and moving,
Said load balance scheduling module comprises:
Calculating sub module is used to calculate load information and the weighted sum of the backup job number that moving of CPU utilance, memory usage, the I/O of said backup server, obtains the load information of said backup server;
The arbitration submodule is used for confirming the backup server that load is the lightest according to said calculating sub module load calculated information.
7. master server according to claim 6 is characterized in that, said load balance scheduling module also comprises:
When queuing submodule, the load information that is used for arbitration result when said arbitration submodule and is said all backup servers of standby system all reach preset load threshold, backup job is ranked according to the preset priority rule.
8. a standby system is characterized in that, comprises master server, at least two backup servers and storage array, wherein:
Said backup server; Be used to gather the load sample information of said backup server; Said load sample information is sent to said master server, and receives the backup job that said master server sends, the Backup Data stream that said backup job is corresponding stores said storage array into;
Said master server; Be used to receive the load sample information that said backup server sends; Confirm the load information of said backup server according to said load sample information; And confirm the lightest backup server of load in the said standby system according to said load information, and backup job is sent to the lightest backup server of said load, in the load information table that the load sample information of said backup server and load information are recorded in setting;
Said storage array is used to store the Backup Data stream that said backup server sends;
Said master server also is used for monitoring the state of each backup server of standby system; When having monitored backup server when breaking down, upgrade said load information table, the load information of the backup server that breaks down is updated to preset load threshold, and sends load information sampling request to the backup server that does not break down.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910093018A CN101662495B (en) | 2009-09-16 | 2009-09-16 | Backup method, master server, backup servers and backup system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910093018A CN101662495B (en) | 2009-09-16 | 2009-09-16 | Backup method, master server, backup servers and backup system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101662495A CN101662495A (en) | 2010-03-03 |
| CN101662495B true CN101662495B (en) | 2012-09-05 |
Family
ID=41790280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910093018A Active CN101662495B (en) | 2009-09-16 | 2009-09-16 | Backup method, master server, backup servers and backup system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101662495B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102402461A (en) * | 2011-12-08 | 2012-04-04 | 曙光信息产业(北京)有限公司 | Balanced scheduling method based on operation scale |
| CN102523127A (en) * | 2011-12-30 | 2012-06-27 | 网宿科技股份有限公司 | Master server and slave server switching method and system utilizing same |
| CN103297767B (en) * | 2012-02-28 | 2016-03-16 | 三星电子（中国）研发中心 | A kind of jpeg image coding/decoding method and decoder being applicable to multinuclear embedded platform |
| CN102904952B (en) * | 2012-10-12 | 2015-07-01 | 北京锐安科技有限公司 | Self-adapting system and method for efficiently processing input of mass data to database |
| CN103269495A (en) * | 2013-04-28 | 2013-08-28 | 苏州洁祥电子有限公司 | Car networking system and data backup method |
| WO2015172274A1 (en) * | 2014-05-10 | 2015-11-19 | 苏州阔地网络科技有限公司 | Load balancing processing method and system |
| CN106155836A (en) * | 2015-04-07 | 2016-11-23 | 北京中科同向信息技术有限公司 | LAN-free redundancy technique based on FC-san |
| CN105338080A (en) * | 2015-10-28 | 2016-02-17 | 无锡峰巢美家网络科技有限公司 | Synchronization and balancing service system of multi-server service data and balancing method |
| CN105657009B (en) * | 2015-12-30 | 2018-12-21 | 浪潮(北京)电子信息产业有限公司 | Object gateway SiteServer LBS, method and trans-regional object gateway storage system |
| CN107222327A (en) * | 2016-03-22 | 2017-09-29 | 中兴通讯股份有限公司 | A kind of method and device based on cloud platform management server |
| CN105929439A (en) * | 2016-04-19 | 2016-09-07 | 成都新核泰科科技有限公司 | Aerial gamma spectrometry survey system based on UAV |
| CN107465537A (en) * | 2017-07-13 | 2017-12-12 | 深圳市盛路物联通讯技术有限公司 | The backup method and system of Internet of Things repeater |
| CN107529187A (en) * | 2017-07-27 | 2017-12-29 | 深圳市盛路物联通讯技术有限公司 | A kind of data back up method and device based on Internet of Things |
| CN107483236B (en) * | 2017-08-01 | 2021-03-19 | 深圳市盛路物联通讯技术有限公司 | Method and device for backing up access point of Internet of things |
| CN116881052B (en) * | 2023-09-07 | 2023-11-24 | 上海凯翔信息科技有限公司 | Data restoration system for distributed storage |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101013387A (en) * | 2007-02-09 | 2007-08-08 | 华中科技大学 | Load balancing method based on object storage device |
| CN101127701A (en) * | 2007-07-24 | 2008-02-20 | 深圳市深信服电子科技有限公司 | Method for realizing proxy server load balance via network device |
| CN101399746A (en) * | 2007-09-26 | 2009-04-01 | 华为技术有限公司 | Packet routing method, system, device and method, system for selecting backup resource |
| EP2063598A1 (en) * | 2006-09-22 | 2009-05-27 | Huawei Technologies Co Ltd | A resource delivery method, system and edge server |
-
2009
- 2009-09-16 CN CN200910093018A patent/CN101662495B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2063598A1 (en) * | 2006-09-22 | 2009-05-27 | Huawei Technologies Co Ltd | A resource delivery method, system and edge server |
| CN101013387A (en) * | 2007-02-09 | 2007-08-08 | 华中科技大学 | Load balancing method based on object storage device |
| CN101127701A (en) * | 2007-07-24 | 2008-02-20 | 深圳市深信服电子科技有限公司 | Method for realizing proxy server load balance via network device |
| CN101399746A (en) * | 2007-09-26 | 2009-04-01 | 华为技术有限公司 | Packet routing method, system, device and method, system for selecting backup resource |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101662495A (en) | 2010-03-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101662495B (en) | Backup method, master server, backup servers and backup system | |
| US9485160B1 (en) | System for optimization of input/output from a storage array | |
| US11516072B2 (en) | Hybrid cluster recovery techniques | |
| US8140791B1 (en) | Techniques for backing up distributed data | |
| US9276959B2 (en) | Client-configurable security options for data streams | |
| US9858322B2 (en) | Data stream ingestion and persistence techniques | |
| CN101025674B (en) | Storage system | |
| US9794135B2 (en) | Managed service for acquisition, storage and consumption of large-scale data streams | |
| US9471585B1 (en) | Decentralized de-duplication techniques for largescale data streams | |
| US20200117547A1 (en) | System state recovery in a distributed, cloud-based storage system | |
| CN102402395B (en) | Quorum disk-based non-interrupted operation method for high availability system | |
| US20170235645A1 (en) | Chained replication techniques for large-scale data streams | |
| CN100470494C (en) | Cluster availability management method and system | |
| CN100568881C (en) | Be used to select storage cluster to be used for the method and system of accessing storage devices | |
| US6948102B2 (en) | Predictive failure analysis for storage networks | |
| CN100530133C (en) | Method and system for managing work load in network environment | |
| CN100385406C (en) | Performing scheduled backups of a backup node associated with a plurality of agent nodes | |
| US20060069761A1 (en) | System and method for load balancing virtual machines in a computer network | |
| US20150067411A1 (en) | Proactive failure handling in network nodes | |
| US20010049774A1 (en) | Apparatus system and method for n-way raid controller having improved performance and fault tolerance | |
| EP2426605B1 (en) | Providing executing programs with reliable access to non-local block data storage | |
| CN102088490B (en) | Data storage method, device and system | |
| CN110086888B (en) | Multi-cluster dynamic load method and device based on RabbitMQ and electronic equipment | |
| US8639808B1 (en) | Method and apparatus for monitoring storage unit ownership to continuously balance input/output loads across storage processors | |
| US9804993B1 (en) | Data volume placement techniques |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee |
Owner name: HUAWEI DIGITAL TECHNOLOGY (CHENGDU) CO., LTD. Free format text: FORMER NAME: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES CO., LTD. |
|
| CP01 | Change in the name or title of a patent holder |
Address after: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Patentee after: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. Address before: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Patentee before: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20220908 Address after: No. 1899 Xiyuan Avenue, high tech Zone (West District), Chengdu, Sichuan 610041 Patentee after: Chengdu Huawei Technologies Co.,Ltd. Address before: 611731 Qingshui River District, Chengdu hi tech Zone, Sichuan, China Patentee before: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. |
|
| TR01 | Transfer of patent right |