WO2021036330A1 - 备份处理方法及服务器 - Google Patents

备份处理方法及服务器 Download PDF

Info

Publication number
WO2021036330A1
WO2021036330A1 PCT/CN2020/088880 CN2020088880W WO2021036330A1 WO 2021036330 A1 WO2021036330 A1 WO 2021036330A1 CN 2020088880 W CN2020088880 W CN 2020088880W WO 2021036330 A1 WO2021036330 A1 WO 2021036330A1
Authority
WO
WIPO (PCT)
Prior art keywords
backup
server
production
information
data
Prior art date
Application number
PCT/CN2020/088880
Other languages
English (en)
French (fr)
Inventor
张磊
许茂鹏
王祥林
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP20857665.2A priority Critical patent/EP4016305A4/en
Publication of WO2021036330A1 publication Critical patent/WO2021036330A1/zh
Priority to US17/678,258 priority patent/US11971786B2/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1464Management of the backup or restore process for networked environments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1456Hardware arrangements for backup
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1458Management of the backup or restore process
    • G06F11/1469Backup restoration techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • G06F3/0619Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065Replication mechanisms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment

Definitions

  • the invention relates to the technical field of data backup, in particular to a backup processing method and a server.
  • Multi-server and multi-active cluster systems based on shared storage, such as Oracle real-time application clusters (Oracle RAC), are big data
  • the distributed data system of the system service such as Cassandra database, etc.
  • the characteristics of these production systems include: 1) A single object has a large amount of data backed up at a time; 2) The production system of the object to be backed up is a multi-server system; 3) The data to be backed up is distributed differently on multiple servers; 4) Each server of the production system The load is different.
  • FIG. 1 is a schematic diagram of a system architecture of the existing backup method.
  • the existing backup method simply requires that the same amount of data to be backed up be obtained from each production server for backup, resulting in the production system
  • the internal forwarding of data between internal production servers increases the processing burden of the production servers and also affects the rate of data backup.
  • the embodiment of the invention discloses a backup processing method and a server, which can avoid the waste of resources and increase the rate of data backup.
  • an embodiment of the present invention provides a backup processing method, which is applied to a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers; the method includes:
  • the main backup server of the plurality of backup servers divides the backup task into a plurality of backup subtasks; the main backup server allocates each backup subtask to each of the plurality of backup servers; The main backup server sends the multiple backup subtasks to the respective corresponding backup servers.
  • the primary backup server obtains first preset information; the first preset information includes one or more of first data distribution information and first resource consumption information; the first data The distribution information includes the first distribution of the data to be backed up in the production system; the production system includes multiple production servers; the first resource consumption information includes the first resource consumption corresponding to each of the multiple production servers; the primary backup server is based on The first preset information is divided into multiple backup subtasks; the backup subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to back up the data to be backed up in the target range in the execution production server; the execution backup The server includes the backup server in the backup system, the execution production server includes one or more production servers in the production system; the master backup server sends the multiple backup subtasks to the respective execution backup servers.
  • the data backup task of the entire production system is divided into multiple backup subtasks, and each backup subtask corresponds to the data range responsible for backup. Then distribute these backup subtasks to the respective execution backup services for data backup, which can improve the efficiency of backup and reduce the burden on the production server.
  • the embodiment of the present application makes full use of each backup server of the backup system to back up data, thereby greatly improving the backup. s efficiency.
  • the first preset information includes the first data distribution information
  • the main backup server divides multiple backup subtasks according to the first preset information, including: the main backup server according to the foregoing
  • the first data distribution information divides the multiple backup subtasks;
  • the data to be backed up in the target range includes data determined according to the distribution of the data to be backed up of the execution production server in the first data distribution information.
  • the first preset information includes the first resource consumption information
  • the main backup server divides multiple backup subtasks according to the first preset information, including: the main backup server according to the foregoing
  • the first resource consumption information divides the multiple backup subtasks
  • the backup subtask includes information about one or more initial backup rates
  • the one or more initial backup rates correspond to the backup subtasks in the first resource consumption information.
  • the resource consumption of one or more production servers corresponds to the set initial backup rate, and the information of the initial backup rate is used to indicate that data is obtained from the production server corresponding to the initial backup rate at the initial backup rate.
  • the rate at which the backup server obtains the data to be backed up from the production server can be set based on the resource consumption of the production server.
  • a lower rate can be set when the production server consumes more resources. In the case of less resource consumption, a higher rate is set. Therefore, the embodiment of the present application can effectively ensure that the backup task is completed without affecting the production service of the production server.
  • the method further includes: the primary backup server obtains second preset information; the second preset The information includes one or more of second data distribution information, second resource consumption information, and server health status information; the second data distribution information includes the second distribution of the data to be backed up in the production system; the second resource The consumption information includes the second resource consumption status corresponding to each of the multiple production servers; the health status information of the server includes one of the health status of the production server of the production system and the health status of the backup server of the backup system or Multiple; in the case that the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information, the main backup server generates the target backup subtask according to the second preset information
  • the adjustment information is used to instruct the execution backup server corresponding to the target backup subtask to perform data backup according to the adjustment information; the main backup server sends the adjustment information to the execution backup server corresponding to the target backup subtask.
  • the primary backup server can obtain information such as data distribution and resource consumption in the production system in real time, and then analyze the relationship between the newly obtained information and the information obtained last time. If the information changes, the adjustment information can be generated accordingly, so that the corresponding execution backup server adjusts the backup parameters (for example, the range of the data to be backed up or the backup rate) according to the adjustment information.
  • the backup parameters in the backup process can be adjusted in real time to ensure that the two processes of production and backup can be performed smoothly.
  • the second preset information includes the second data distribution information
  • the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information.
  • the primary backup server generates adjustment information for the target backup subtask according to the second preset information, including: after analyzing according to the second data distribution information that the target backup subtask has a change in the data range to be backed up
  • the primary backup server generates an adjusted data range to be backed up for the target backup subtask according to the data distribution of the execution production server corresponding to the target backup subtask in the second data distribution information.
  • the embodiment of the present application can adjust the data range to be backed up of the backup subtask according to the newly acquired data distribution information, so as to ensure that the data to be backed up can be completely obtained.
  • the second preset information includes the second resource consumption information
  • the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information.
  • the primary backup server generating adjustment information for the target backup subtask according to the second preset information includes: analyzing the resource consumption of the execution production server corresponding to the target backup subtask according to the second resource consumption information When the situation changes, the primary backup server generates an adjusted backup rate for the target backup subtask according to the resource consumption of the execution production server corresponding to the target backup subtask in the second resource consumption information.
  • the embodiment of the application can adjust the backup rate of the backup subtask according to the newly acquired resource consumption information. If it is lowered, data backup is guaranteed without affecting production. If it is higher, resources can be fully utilized to improve backup. rate.
  • the second preset information includes the health status information of the server, and the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information.
  • the primary backup server generates the adjustment information for the target backup subtask according to the second preset information, including: if the health status information of the server includes the health status of the production server of the production system, it is based on the production The health status of the production server of the system is analyzed.
  • the execution production server corresponding to the target backup subtask fails, the primary backup server generates the corresponding target backup subtask according to the health status of the production server of the production system.
  • the adjusted execution production server information if the health status information of the server includes the health status of the backup server of the backup system, the corresponding execution of the target backup subtask is analyzed based on the health status of the backup server of the backup system In the case of a failure of the backup server, the primary backup server generates the adjusted information corresponding to the execution of the backup server corresponding to the target backup subtask according to the health status of the backup server of the backup system.
  • the normally running production server or backup server can be replaced to continue to complete the corresponding backup task, thereby ensuring that the data backup task can be completed smoothly and avoiding causes The failure caused incomplete data backup.
  • the method further includes: the primary backup server sends the primary backup server to the first execution production server according to the first backup subtask.
  • the main backup server may also perform a backup subtask to obtain data to be backed up from the production server for backup, thereby making full use of server resources and increasing the backup rate.
  • the request for obtaining data to be backed up further includes information about a first initial backup rate, and the information about the first initial backup rate is the initial backup rate information included in the first backup subtask.
  • the backup server receiving the data to be backed up sent by the first execution production server includes: the primary backup server receives the data to be backed up sent by the first execution production server at the first initial backup rate.
  • the method further includes: the primary backup server correspondingly adjusts the standby data according to the first adjustment information.
  • Backup data acquisition request the aforementioned adjusted data acquisition request to be backed up includes one or more of the adjusted data range information to be backed up, the adjusted backup rate information, and the adjusted address information of the production server;
  • An adjustment information is used to instruct the main backup server to perform data backup according to the first adjustment information; the main backup server sends the adjusted data acquisition request to be backed up to the execution production server corresponding to the first backup subtask.
  • an embodiment of the present invention provides a backup processing method, which is applied to a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers; the method includes:
  • the first backup server receives the backup subtask sent by the main backup server, the backup subtask corresponds to the execution production server, and is used to instruct the first backup server to back up the data to be backed up in the target range in the execution production server;
  • the execution production server Is a server in the production system;
  • the first backup server is a server in the backup system;
  • the first backup server sends a data acquisition request to be backed up to the execution production server according to the backup subtask;
  • the data acquisition request to be backed up includes Information about the scope of the backup data; the first backup server receives the data to be backed up sent by the production execution server.
  • the request for obtaining data to be backed up further includes information about an initial backup rate
  • the first backup server receiving the data to be backed up sent by the production execution server includes: the first backup server uses the initial The backup rate receives the data to be backed up sent by the execution production server.
  • the first backup server after the first backup server receives the backup subtask sent by the primary backup server, it further includes: the first backup server receives the adjustment information of the backup subtask sent by the primary backup server, The adjustment information is used to instruct the first backup server to perform data backup according to the adjustment information; the first backup server correspondingly adjusts the data acquisition request to be backed up according to the adjustment information, and the adjusted data acquisition request to be backed up includes the adjusted One or more of the data range information to be backed up, the adjusted backup rate information, and the adjusted address information of the execution production server; the first backup server sends the adjusted waiting production server to the execution production server corresponding to the backup subtask. Backup data acquisition request.
  • the second aspect is an embodiment corresponding to the execution backup server of the first aspect, and for its beneficial effects, reference may be made to the description in the first aspect, which will not be repeated here.
  • an embodiment of the present invention provides a backup processing method, which is applied to a production system.
  • the above-mentioned production system includes multiple production servers; the method includes:
  • the first production server obtains first preset information.
  • the first preset information includes one or more of the first data distribution information and the first resource consumption information; the first data distribution information includes the data to be backed up in the first The first distribution situation in the production server; the first resource consumption information includes the first resource consumption situation of the first production server; the first production server sends the first preset information to the main backup server; the first preset Information is used to enable the main backup server to divide multiple backup subtasks according to the first preset information.
  • the backup subtasks correspond to the execution backup server and the execution production server, and are used to instruct the execution backup server to back up the target in the execution production server.
  • the master backup server is a server of the backup system, and the backup system includes one or more master backup servers and one or more slave backup servers for backing up the data of the production system.
  • the method further includes: the first production server receives the data acquisition request to be backed up sent by the second backup server, and The data acquisition request to be backed up includes information about the data range to be backed up; the second backup server is a backup server included in the backup system; the first production server acquires the data to be backed up according to the information in the data range to be backed up; the first production server Send the obtained data to be backed up to the second backup server.
  • the above-mentioned first preset information includes first resource consumption information
  • the above-mentioned data acquisition request to be backed up further includes information of an initial backup rate
  • the above-mentioned initial backup rate is obtained by the primary backup server according to the above The initial backup rate set by the resource consumption of the first production server
  • the first production server sends the acquired data to be backed up to the second backup server, including: the first production server sends the acquired data to be backed up to the The initial backup rate is sent to the aforementioned second backup server.
  • the first production server after the first production server sends the first preset information to the main backup server, it further includes: the first production server obtains second preset information, and the second preset information includes One or more of the second data distribution information, the second resource consumption information, and the health status information of the server; the second data distribution information includes the second distribution of the data to be backed up in the production system; the second resource consumption information includes The second resource consumption status corresponding to each of the multiple production servers; the health status information of the server includes the health status of the first production server; the first production server sends the second preset information to the primary backup server, and The second preset information is used to enable the main backup server to adjust one or more of the data range to be backed up, the backup rate, and the execution backup server of the backup subtask corresponding to the first production server according to the second preset information.
  • the method further includes: the first production server receives the adjusted data to be backed up sent by the third backup server Acquisition request, the adjusted data acquisition request to be backed up includes one or more of the adjusted data range to be backed up and the adjusted backup rate, one of the adjusted data range to be backed up and the adjusted backup rate
  • the third backup server is the backup server included in the backup system
  • the first production server sends the data to the third backup according to the adjusted data acquisition request to be backed up
  • the server sends the data to be backed up.
  • the third aspect is an embodiment corresponding to the execution production server of the first aspect, and its beneficial effects can be referred to the description in the first aspect, which is not repeated here.
  • an embodiment of the present invention provides a backup recovery processing method, which is applied to a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers; the above-mentioned method includes:
  • the main backup server of the plurality of backup servers divides the backup and restoration task into a plurality of backup and restoration subtasks; the main backup server allocates each backup and restoration subtask to each of the plurality of backup servers ; The main backup server sends the multiple backup and restoration subtasks to their respective backup servers.
  • the primary backup server obtains first information; the first information includes the third resource consumption status of each of the multiple production servers in the production system; the primary backup server is divided according to the first information Multiple backup and restoration subtasks; the above backup and restoration subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to send a preset range of data to the execution production server; the execution backup server includes the backup system The backup server; the execution production server includes one or more production servers in the production system; the master backup server sends the multiple backup restoration subtasks to the respective execution backup servers.
  • the embodiment of the application determines the range of data to be restored to be sent to the corresponding production server according to the resource consumption of each production server in the production server, and divides this backup and restoration task into multiple subtasks and distributes it to multiple servers in the backup system Execution, so the efficiency of backup and recovery is improved in the process of not hindering production.
  • the primary backup server divides multiple backup and recovery subtasks according to the first information, including: the primary backup server determines the load status of the multiple production servers according to the third resource consumption situation The primary backup server sets the data range that needs to be sent to the multiple production servers according to the load conditions of the multiple production servers; the primary backup server and the primary backup server divides multiple backup and recovery subtasks according to the data range.
  • the embodiment of the present application divides the backup and restoration subtasks according to the load of the production server, which ensures that the restoration of the backup data can be completed without hindering production.
  • the primary backup server divides multiple backup and recovery subtasks according to the first information, including: the primary backup server determines the initial backup and recovery corresponding to each of the multiple production servers according to the first information
  • the above-mentioned initial backup and recovery rate is the initial rate at which the execution backup server sends data to the corresponding execution production server; the above-mentioned primary backup server allocates the respective initial backup and restoration rates of the above-mentioned multiple production servers to the respective corresponding ones of the above-mentioned multiple production servers.
  • Backup and restore subtasks are the first information that the primary backup server divides multiple backup and recovery subtasks according to the first information, including: the primary backup server determines the initial backup and recovery corresponding to each of the multiple production servers according to the first information
  • the above-mentioned initial backup and recovery rate is the initial rate at which the execution backup server sends data to the corresponding execution production server; the above-mentioned primary backup server allocates the respective initial backup and restoration rates of the above-mentioned multiple production servers to
  • the embodiment of the present application determines the initial backup and recovery rate of data sent to the production server by the corresponding backup and recovery subtask according to the resource consumption of the production server, which can effectively ensure that the backup and recovery are completed without affecting the production service of the production server. Task.
  • the method further includes: the primary backup server obtains second information, and the second information includes the first 4. One or more of the resource consumption information and the server's health status information; the aforementioned fourth resource consumption information includes the fourth resource consumption situation corresponding to each of the multiple production servers in the aforementioned production system; the aforementioned server's health status information includes the aforementioned One or more of the health status of the production server of the production system and the health status of the backup server of the aforementioned backup system;
  • the primary backup server In the case where it is analyzed based on the second information that the target backup and restoration subtasks of the multiple backup and restoration subtasks need to be adjusted, the primary backup server generates adjustment information for the target backup and restoration subtasks according to the second information, and The adjustment information is used to instruct the execution backup server corresponding to the target backup and restoration subtask to send data to the corresponding execution production server according to the adjustment information; the master backup server sends the adjustment information to the execution backup server corresponding to the target backup and restoration subtask .
  • the main backup server can obtain the resource consumption of the production server, the health status information of the production server and the backup server in real time, and adjust the parameters of the corresponding subtasks in real time based on this information, so as to ensure that the production is not hindered. Complete the backup and recovery process more efficiently.
  • the above-mentioned second information includes the above-mentioned fourth resource consumption information; in the case that the target backup and recovery subtask among the multiple backup and recovery subtasks needs to be adjusted according to the analysis of the above-mentioned second information,
  • the primary backup server generates adjustment information for the target backup and restoration subtask according to the second information, including:
  • the primary backup server In the case that the data range that the target backup and recovery subtask needs to be sent to the corresponding execution production server needs to be adjusted according to the analysis of the fourth resource consumption information, the primary backup server generates a backup for the target according to the fourth resource consumption information. The adjusted data range that needs to be sent to the corresponding execution production server after the adjustment of the recovery subtask.
  • the above-mentioned second information includes the above-mentioned fourth resource consumption information; in the case that the target backup and recovery subtask among the multiple backup and recovery subtasks needs to be adjusted according to the analysis of the above-mentioned second information,
  • the primary backup server generates adjustment information for the target backup and restoration subtask according to the second information, including:
  • the primary backup server In the case that the initial backup recovery rate corresponding to the target backup and recovery subtask needs to be adjusted based on the analysis of the fourth resource consumption information, the primary backup server generates adjustments for the target backup and recovery subtask according to the fourth resource consumption information After the backup and recovery rate.
  • the above-mentioned second information includes the health status information of the above-mentioned server; in the case that the target backup and restoration subtasks among the above-mentioned multiple backup and restoration subtasks need to be adjusted according to the analysis of the above-mentioned second information,
  • the primary backup server generates adjustment information for the target backup and restoration subtask according to the second information, including:
  • the health status information of the aforementioned server includes the health status of the production server of the aforementioned production system
  • the execution production server corresponding to the aforementioned target backup and restoration subtask has failed based on the analysis of the aforementioned health status of the production server of the production system
  • the above-mentioned main backup server generates the adjusted execution production server information corresponding to the above-mentioned target backup and restoration subtask according to the health status of the production server of the above-mentioned production system;
  • the primary backup server If the health status information of the aforementioned server includes the health status of the backup server of the aforementioned backup system, in the case that the execution backup server corresponding to the aforementioned target backup and restoration subtask fails based on the analysis of the health status of the backup server of the aforementioned backup system, The primary backup server generates the adjusted execution backup server information corresponding to the target backup restoration subtask according to the health status of the backup server of the backup system.
  • the normally running production server or backup server can be replaced to continue to complete the corresponding backup and recovery tasks, thereby ensuring that the data backup and recovery can be completed smoothly. Avoid incomplete data backup and recovery due to faults.
  • the method further includes: the primary backup server sends the first backup and restoration subtask to the first execution according to the first backup and restoration subtask.
  • the production server sends first data; the first data includes data restored from the backup system to the first execution production server, and the execution backup server corresponding to the first backup restoration subtask is the main backup server.
  • the primary backup server can also be used as an execution backup server to perform corresponding backup and restoration subtasks.
  • the first backup and restoration subtask includes a first initial backup and restoration rate
  • the primary backup server sends data to the first execution production server according to the first backup and restoration subtask, including: the primary backup The server sends the first data to the first execution production server at the first initial backup and restoration rate according to the first backup and restoration subtask.
  • the method further includes: the primary backup server sends the adjusted data to the adjusted production server according to the first adjustment information.
  • the execution production server sends data corresponding to the first backup and restoration subtask
  • the adjusted first backup and restoration subtask includes the first adjustment information
  • the first adjustment information includes the adjusted range of sent data and the adjusted backup One or more of the recovery rate and the address information of the adjusted execution production server.
  • an embodiment of the present invention provides a backup recovery processing method, which is applied to a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers; the above-mentioned method includes:
  • the first backup server receives the backup and restoration subtask sent by the primary backup server.
  • the backup and restoration subtask corresponds to an execution production server, and is used to instruct the first backup server to send a preset range of data to the execution production server;
  • the server is a server in the production system;
  • the first backup server is a secondary backup server in the backup system;
  • the first backup server sends the data of the preset range to the execution production server according to the backup restoration subtask.
  • the backup and restoration subtask includes an initial backup and restoration rate
  • the first backup server sends the data in the preset range to the execution production server according to the backup and restoration subtask, including: The backup server sends the data in the preset range to the execution production server at the initial backup and recovery rate according to the backup and restoration subtask.
  • the method further includes: the first backup server receives the data sent by the primary backup server The adjustment information of the backup and restoration subtask, the adjustment information is used to instruct the main backup server to send data to the execution production server according to the adjustment information; the adjustment information includes the adjusted data range sent to the execution production server, and the adjustment information One or more of the backup and restoration rate and the address information of the adjusted execution production server; the first backup server sends data to the execution production server corresponding to the adjusted backup and restoration subtask according to the adjustment information.
  • the fifth aspect is an embodiment corresponding to the execution backup server of the fourth aspect.
  • the fifth aspect is an embodiment corresponding to the execution backup server of the fourth aspect.
  • an embodiment of the present invention provides a backup and recovery processing method, which is applied to a production system.
  • the above-mentioned production system includes multiple production servers; the above-mentioned method includes:
  • the first production server obtains first information; the first information includes the third resource consumption status corresponding to each of the multiple production servers; the first production server sends the first information to the main backup server; the first information is used to enable
  • the main backup server divides multiple backup and restoration subtasks according to the first information.
  • the backup and restoration subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to send a preset range of data to the execution production server
  • the above-mentioned primary backup server is a server of the backup system, and the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers.
  • the method further includes: the first production server receives the data in the preset range sent by the second backup server;
  • the second backup server is the backup server included in the foregoing backup system.
  • the first production server receiving the data in the preset range sent by the second backup server includes: the first production server receives the preset data sent by the second backup server at an initial backup recovery rate. Assuming a range of data, the initial backup recovery rate is the initial backup recovery rate set by the primary backup server according to the resource consumption of the first production server.
  • the first production server after the first production server sends the first information to the primary backup server, it further includes: the first production server obtains second information, and the second information includes fourth resource consumption information and One or more items in the health status information of the server; the fourth resource consumption information includes the fourth resource consumption corresponding to each of the multiple production servers in the production system; the health status information of the server includes the production server of the production system One or more of the health status of the backup system and the health status of the backup server of the aforementioned backup system;
  • the first production server sends the second information to the primary backup server, and the second information is used to enable the primary backup server to adjust the backup restoration rate of the backup restoration subtask corresponding to the first production server according to the second information, Execute one or more of the backup server and the data range that needs to be sent to the first production server.
  • the method further includes: the first production server receives the data sent by the third backup server, and the third backup server sends The data is the data sent by the third backup server to the first production server according to the adjustment information of the backup and restoration subtask corresponding to the first production server, and the adjustment information of the backup and restoration subtask corresponding to the first production server includes the adjusted information One or more of the range of data sent to the aforementioned execution production server and the adjusted backup recovery rate.
  • the sixth aspect is an embodiment corresponding to the execution production server of the fourth aspect, and its beneficial effects can be referred to the description in the first aspect, which will not be repeated here.
  • an embodiment of the present invention provides a backup processing server, the above-mentioned backup processing server is a primary backup server in a backup system, the above-mentioned backup system further includes one or more secondary backup servers; the above-mentioned backup processing server includes a processor, A memory and a communication module; the above-mentioned memory and the above-mentioned communication module are coupled to the above-mentioned processor, the above-mentioned memory stores a computer program, and when the above-mentioned processor executes the above-mentioned computer program, the following operations are performed:
  • the above-mentioned production system includes multiple production servers; the above-mentioned first resource consumption information includes the first resource consumption conditions corresponding to each of the above-mentioned multiple production servers; a plurality of backup subtasks are divided according to the above-mentioned first preset information; the above-mentioned backup subtasks correspond to There are an execution backup server and an execution production server, which are used to instruct the execution backup server to back up the data to be backed up in the target range of the execution production server; the execution backup server includes the backup server in the backup system, and the execution production server includes the production system.
  • One or more of the production servers in the system; the multiple backup subtasks are sent to their corresponding execution backup servers through the communication module.
  • the first preset information includes the first data distribution information
  • the division of multiple backup subtasks according to the first preset information is specifically: division according to the first data distribution information
  • the multiple backup subtasks; the data to be backed up in the target range includes data determined according to the distribution of the data to be backed up of the execution production server in the first data distribution information.
  • the first preset information includes the first resource consumption information
  • the division of multiple backup subtasks according to the first preset information is specifically: division according to the first resource consumption information
  • the foregoing multiple backup subtasks; the foregoing backup subtasks include information about one or more initial backup rates, and the one or more initial backup rates are based on one or more production tasks corresponding to the backup subtasks in the first resource consumption information.
  • the resource consumption of the server corresponds to the set initial backup rate, and the above-mentioned initial backup rate information is used to instruct to obtain data from the production server corresponding to the above-mentioned initial backup rate at the above-mentioned initial backup rate.
  • the method further includes:
  • the second preset information includes one or more of the second data distribution information, the second resource consumption information, and the health status information of the server; the second data distribution information includes the waiting information in the production system.
  • Generate adjustment information for the target backup subtask the adjustment information is used to instruct the execution backup server corresponding to the target backup subtask to perform data backup according to the adjustment information; the adjustment information is sent to the target backup subtask through the communication module The corresponding execution backup server.
  • the second preset information includes the second data distribution information
  • the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information.
  • generating adjustment information for the target backup subtask according to the second preset information is specifically: when it is analyzed according to the second data distribution information that the target backup subtask has a change in the data range to be backed up, According to the data distribution situation of the execution production server corresponding to the target backup subtask in the second data distribution information, an adjusted data range to be backed up for the target backup subtask is generated.
  • the second preset information includes the second resource consumption information
  • the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information.
  • generating adjustment information for the target backup subtask according to the second preset information is specifically: after analyzing the resource consumption of the execution production server corresponding to the target backup subtask according to the second resource consumption information, there is a change
  • the adjusted backup rate for the target backup subtask is generated according to the resource consumption of the execution production server corresponding to the target backup subtask in the second resource consumption information.
  • the second preset information includes the health status information of the server, and the target backup subtask among the multiple backup subtasks needs to be adjusted according to the analysis of the second preset information.
  • the adjustment information for the target backup subtask is generated according to the second preset information, specifically:
  • the health status information of the aforementioned server includes the health status of the production server of the aforementioned production system, in the case that the execution production server corresponding to the aforementioned target backup subtask fails according to the health status of the aforementioned production system’s production server, according to The health status of the production server of the above-mentioned production system generates the adjusted information of the execution production server corresponding to the above-mentioned target backup subtask; if the health status information of the above-mentioned server includes the health status of the backup server of the above-mentioned backup system, it is based on the above The health status of the backup server of the backup system is analyzed.
  • the execution backup server corresponding to the above-mentioned target backup subtask fails, according to the health status of the backup server of the above-mentioned backup system, the adjusted corresponding to the above-mentioned target backup subtask is generated Corresponding to the information of the backup server.
  • the method further includes: according to the first backup subtask through the above-mentioned communication module to the first execution
  • the server sends a request for obtaining data to be backed up;
  • the request for obtaining data to be backed up includes information about the range of data to be backed up;
  • the execution backup server corresponding to the first backup subtask is the backup processing server, and the execution production server corresponding to the first backup subtask Production server for the first execution of the above.
  • the data to be backed up sent by the first execution production server is received through the communication module.
  • the request for obtaining data to be backed up further includes information about a first initial backup rate, and the information about the first initial backup rate is the initial backup rate information included in the first backup subtask.
  • the communication module receiving the data to be backed up sent by the first execution production server is specifically: receiving the data to be backed up sent by the first execution production server through the communication module at the first initial backup rate.
  • the method further includes: correspondingly adjusting the data acquisition request to be backed up according to the first adjustment information, and the adjustment
  • the subsequent data acquisition request to be backed up includes one or more of the adjusted data range information to be backed up, the adjusted backup rate information, and the adjusted address information of the production server; the above-mentioned first adjustment information is used to indicate the above
  • the backup processing server performs data backup according to the first adjustment information; and sends the adjusted data acquisition request to be backed up to the execution production server corresponding to the first backup subtask through the communication module.
  • an embodiment of the present invention provides a backup processing server, the above-mentioned backup processing server is a secondary backup server in a backup system, and the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers;
  • the backup processing server includes a processor, a memory, and a communication module; the memory and the communication module are coupled to the processor, the memory stores a computer program, and when the processor executes the computer program, the following operations are performed:
  • the backup subtask sent by the main backup server is received through the communication module.
  • the backup subtask corresponds to an execution production server and is used to instruct the processor to back up the data to be backed up in the target range in the execution production server; the execution production server is production The server in the system; according to the above-mentioned backup subtask, the above-mentioned communication module sends a data acquisition request to be backed up to the above-mentioned execution production server; the above-mentioned data acquisition request to be backed up includes information about the range of data to be backed up; and the above-mentioned execution production server is received through the above-mentioned communication module. The data to be backed up.
  • the request for obtaining data to be backed up further includes information about an initial backup rate
  • the foregoing receiving the data to be backed up sent by the execution production server through the communication module is specifically: passing the data to be backed up at the initial backup rate.
  • the communication module receives the data to be backed up sent by the execution production server.
  • the method further includes: receiving adjustment information of the backup subtask sent by the main backup server through the communication module, and The adjustment information is used to instruct the processor to perform data backup according to the adjustment information; correspondingly adjust the data acquisition request to be backed up according to the adjustment information, and the adjusted data acquisition request to be backed up includes the adjusted data range information to be backed up and the adjusted data One or more of the backup rate information and the adjusted address information of the execution production server; the communication module sends the adjusted data acquisition request to be backed up to the execution production server corresponding to the backup subtask.
  • an embodiment of the present invention provides a backup processing server, the above-mentioned backup processing server is a production server in a production system; the above-mentioned backup processing server includes a processor, a memory, and a communication module; the above-mentioned memory, the above-mentioned communication module and the above-mentioned processing
  • the above-mentioned memory stores a computer program, and when the above-mentioned processor executes the above-mentioned computer program, the following operations are performed:
  • the first preset information includes one or more of first data distribution information and first resource consumption information; the first data distribution information includes the first data to be backed up in the backup processing server A distribution situation; the first resource consumption information includes the first resource consumption of the backup processing server; the first preset information is sent to the main backup server through the communication module; the first preset information is used to enable the main backup
  • the server divides a plurality of backup subtasks according to the first preset information, the backup subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to back up the data to be backed up in the target range in the execution production server;
  • the primary backup server is a server of the backup system, and the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers for backing up the data of the above-mentioned production system.
  • the method further includes: receiving, through the communication module, a data acquisition request to be backed up sent by the second backup server, and the waiting
  • the backup data acquisition request includes information about the range of data to be backed up;
  • the second backup server is a backup server included in the backup system;
  • the data to be backed up is acquired according to the information about the range of data to be backed up;
  • the above-mentioned first preset information includes first resource consumption information
  • the above-mentioned data acquisition request to be backed up further includes information of an initial backup rate
  • the above-mentioned initial backup rate is obtained by the primary backup server according to the above The backup initial rate set by the resource consumption of the backup processing server
  • the above-mentioned sending the acquired data to be backed up to the second backup server through the above-mentioned communication module is specifically: the above-mentioned data to be backed up acquired through the above-mentioned communication module is used as the initial The backup rate is sent to the aforementioned second backup server.
  • the method further includes: acquiring second preset information, where the second preset information includes second data distribution information , One or more of the second resource consumption information and the server's health status information;; the above-mentioned second data distribution information includes the second distribution of the data to be backed up in the production system; the above-mentioned second resource consumption information includes the above-mentioned multiple production The second resource consumption status corresponding to each server; the health status information of the server includes the health status of the backup processing server; the second preset information is sent to the primary backup server through the communication module, and the second preset information is used Therefore, the main backup server adjusts one or more of the data range to be backed up, the backup rate, and the execution backup server of the backup subtask corresponding to the backup processing server according to the second preset information.
  • the main backup server adjusts one or more of the data range to be backed up, the backup rate, and the execution backup server of the backup subtask corresponding to the backup processing server according to the second preset information.
  • the method further includes: receiving through the above-mentioned communication module the adjusted data to be backed up sent by the third backup server.
  • the aforementioned adjusted data acquisition request to be backed up includes one or more of the adjusted data range to be backed up and the adjusted backup rate, and one of the adjusted data range to be backed up and the adjusted backup rate Or multiple items are sent by the primary backup server to the third backup server; the third backup server is the backup server included in the backup system; and the adjusted data acquisition request to be backed up is sent to the third backup server through the communication module The above data to be backed up.
  • an embodiment of the present invention provides a backup processing server, the above-mentioned backup processing server is a primary backup server in a backup system, and the above-mentioned backup system further includes one or more secondary backup servers; the above-mentioned backup processing server includes:
  • the dividing unit is used to divide the backup task into multiple backup subtasks; the allocation unit is used to allocate each backup subtask to each of the multiple backup servers; the sending unit is used to divide the Multiple backup subtasks are sent to their corresponding backup servers.
  • the above-mentioned backup processing server further includes an obtaining unit for obtaining first preset information; the above-mentioned first preset information includes one or one of the first data distribution information and the first resource consumption information. Multiple items; the first data distribution information includes the first distribution of the data to be backed up in the production system; the production system includes multiple production servers; the first resource consumption information includes the first resource consumption corresponding to each of the multiple production servers Situation; the division unit is also used to divide multiple backup subtasks according to the first preset information; the backup subtasks correspond to the execution backup server and the execution production server, and are used to instruct the execution backup server to back up the execution production server Data to be backed up in the target range; the above-mentioned execution backup server includes the backup server in the above-mentioned backup system, and the above-mentioned execution production server includes one or more production servers in the above-mentioned production system.
  • the first preset information includes the first data distribution information
  • the dividing unit is configured to divide multiple backup subtasks according to the first preset information, specifically: The first data distribution information divides the multiple backup subtasks; the data to be backed up in the target range includes data determined according to the distribution of the data to be backed up of the execution production server in the first data distribution information.
  • the first preset information includes the first resource consumption information
  • the dividing unit is configured to divide multiple backup subtasks according to the first preset information, specifically: The first resource consumption information divides the multiple backup subtasks; the backup subtask includes information about one or more initial backup rates, and the one or more initial backup rates are based on the backup subtask in the first resource consumption information
  • the resource consumption of the corresponding one or more production servers corresponds to the set initial backup rate, and the information of the initial backup rate is used to indicate that data is obtained from the production server corresponding to the initial backup rate at the initial backup rate.
  • the backup processing server further includes a generating unit; the acquiring unit is further configured to acquire the second backup subtask after the sending unit sends the multiple backup subtasks to the respective execution backup servers.
  • One or more of the health status of the above-mentioned generation unit; the above-mentioned generating unit is configured to analyze the target backup sub-task among the above-mentioned multiple backup sub-tasks according to the above-mentioned second preset information and need to be adjusted according to the above-mentioned second preset information.
  • the preset information generates adjustment information for the target backup subtask, the adjustment information is used to instruct the execution backup server corresponding to the target backup subtask to perform data backup according to the adjustment information; the sending unit is also used to send the adjustment information Perform the backup server corresponding to the above-mentioned target backup subtask.
  • the second preset information includes the second data distribution information
  • the generating unit is configured to analyze the target backup in the multiple backup subtasks according to the second preset information.
  • the adjustment information for the target backup subtask is generated according to the second preset information, specifically: used to analyze the data to be backed up of the target backup subtask according to the second data distribution information.
  • the second preset information includes the second resource consumption information
  • the generating unit is configured to analyze the target backup in the multiple backup subtasks according to the second preset information.
  • the adjustment information for the target backup subtask is generated according to the second preset information, specifically: used to analyze the execution production corresponding to the target backup subtask according to the second resource consumption information
  • the adjusted backup rate for the target backup subtask is generated according to the resource consumption of the execution production server corresponding to the target backup subtask in the second resource consumption information.
  • the second preset information includes the health status information of the server
  • the generating unit is configured to analyze the target backup in the multiple backup subtasks according to the second preset information.
  • the adjustment information for the target backup subtask is generated according to the second preset information, specifically: if the health status information of the server includes the health status of the production server of the production system, it is used for In the case that the execution production server corresponding to the target backup subtask is found to be faulty based on the second preset information, the adjusted corresponding execution corresponding to the target backup subtask is generated according to the health status of the production server of the production system Information of the production server; if the health status information of the server includes the health status of the backup server of the backup system, it is used to analyze the failure of the execution backup server corresponding to the target backup subtask according to the second preset information Next, according to the health status of the backup server of the backup system, the adjusted information corresponding to the execution backup server corresponding to the target backup subtask is
  • the backup processing server further includes a receiving unit; the sending unit is further configured to send the multiple backup subtasks to the respective execution backup servers according to the first backup subtask Send a data acquisition request to be backed up to the first execution production server; the data acquisition request to be backed up includes information about the data range to be backed up; the execution backup server corresponding to the first backup subtask is the backup processing server, and the first backup subtask
  • the corresponding execution production server is the aforementioned first execution production server; the aforementioned receiving unit is configured to receive the data to be backed up sent by the aforementioned first execution production server.
  • the request for obtaining data to be backed up further includes information about a first initial backup rate, and the information about the first initial backup rate is the initial backup rate information included in the first backup subtask, and the receiving The unit is configured to receive the data to be backed up sent by the first execution production server, specifically: to receive the data to be backed up sent by the first execution production server at the first initial backup rate.
  • the backup processing server further includes an adjustment unit configured to, after the sending unit sends the data acquisition request to be backed up to the first execution production server according to the first backup subtask, according to the first adjustment information Correspondingly adjust the aforementioned data acquisition request to be backed up.
  • the adjusted data acquisition request to be backed up includes one or more of the adjusted data range information to be backed up, the adjusted backup rate information, and the adjusted address information of the execution production server. Item;
  • the first adjustment information is used to instruct the backup processing server to perform data backup according to the first adjustment information; the sending unit is also used to send the adjusted data to be backed up to the execution production server corresponding to the first backup subtask Get the request.
  • an embodiment of the present invention provides a backup processing server, the above-mentioned backup processing server is a secondary backup server in a backup system, and the above-mentioned backup system includes one or more primary backup servers and one or more secondary backup servers;
  • the backup processing server includes: a receiving unit for receiving a backup subtask sent by the main backup server, the backup subtask corresponds to an execution production server, and is used to instruct the backup processing server to back up the target range of the execution production server to be backed up Data;
  • the execution production server is a server in the production system;
  • the sending unit is configured to send a data acquisition request to be backed up to the execution production server according to the backup subtask;
  • the data acquisition request to be backed up includes information about the range of data to be backed up;
  • the receiving unit is further configured to receive the data to be backed up sent by the production execution server.
  • the request for obtaining data to be backed up further includes information about the initial backup rate
  • the receiving unit is further configured to receive the data to be backed up sent by the execution production server, specifically: The backup rate receives the data to be backed up sent by the execution production server.
  • the backup processing server further includes an adjustment unit; the receiving unit is further configured to receive the backup subtask sent by the primary backup server after receiving the backup subtask sent by the primary backup server
  • the adjustment information is used to instruct the backup processing server to perform data backup according to the adjustment information;
  • the adjustment unit is used to adjust the data acquisition request to be backed up correspondingly according to the adjustment information, and the adjusted data acquisition request to be backed up includes One or more of the adjusted data range information to be backed up, the adjusted backup rate information, and the adjusted address information of the execution production server; the sending unit is also used to send the execution production server corresponding to the backup subtask Send the adjusted data acquisition request to be backed up.
  • an embodiment of the present invention provides a backup processing server, the above-mentioned backup processing server is a production server in a production system; the above-mentioned backup processing server includes:
  • the acquiring unit is configured to acquire first preset information, where the first preset information includes one or more of first data distribution information and first resource consumption information; the first data distribution information includes the data to be backed up in the backup Processing the first distribution in the server; the first resource consumption information includes the first resource consumption of the backup processing server; the sending unit is configured to send the first preset information to the main backup server; the first preset information It is used to enable the main backup server to divide multiple backup subtasks according to the first preset information.
  • the backup subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to back up the target range in the execution production server
  • the master backup server is a server of the backup system, and the backup system includes one or more master backup servers and one or more slave backup servers for backing up the data of the production system.
  • the backup processing server further includes a receiving unit, configured to receive a data acquisition request to be backed up sent by the second backup server after the sending unit sends the first preset information to the primary backup server
  • the above-mentioned data acquisition request to be backed up includes information about the range of data to be backed up;
  • the second backup server is a backup server included in the above-mentioned backup system;
  • the above-mentioned acquisition unit is further configured to acquire the data to be backed up according to the information of the above-mentioned data range to be backed up;
  • the sending unit is further configured to send the acquired data to be backed up to the second backup server.
  • the above-mentioned first preset information includes first resource consumption information
  • the above-mentioned data acquisition request to be backed up further includes information of an initial backup rate
  • the above-mentioned initial backup rate is obtained by the primary backup server according to the above The initial rate of backup set by the resource consumption of the backup processing server
  • the sending unit is also used to send the acquired data to be backed up to the second backup server, specifically: for sending the acquired data to be backed up to the initial The backup rate is sent to the aforementioned second backup server.
  • the acquiring unit is further configured to acquire second preset information after the sending unit sends the first preset information to the main backup server, and the second preset information includes the second preset information.
  • the backup processing server further includes a receiving unit configured to receive the adjusted pending information sent by the third backup server after the sending unit sends the second preset information to the primary backup server.
  • the adjusted data acquisition request to be backed up includes one or more of the adjusted data range to be backed up and the adjusted backup rate. Among the adjusted data range to be backed up and the adjusted backup rate
  • One or more items are sent by the primary backup server to the third backup server; the third backup server is the backup server included in the backup system; the sending unit is also used to send data to the backup server according to the adjusted data acquisition request to be backed up The third backup server sends the data to be backed up.
  • an embodiment of the present invention provides a backup recovery processing server.
  • the backup recovery processing server is a master backup server in a backup system.
  • the backup system includes one or more master backup servers and one or more slave backups.
  • the server; the backup recovery processing server includes a processor, a memory, and a communication module; the memory and the communication module are coupled to the processor, the memory stores a computer program, and the processor executes the following operations when executing the computer program:
  • the above-mentioned first information includes the third resource consumption situation corresponding to each of the multiple production servers in the production system;
  • the above-mentioned backup and restoration subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to send a preset range of data to the execution production server;
  • the execution backup The server includes the backup server in the above-mentioned backup system;
  • the above-mentioned execution production server includes one or more production servers in the above-mentioned production system;
  • the multiple backup and restoration subtasks are sent to the respective execution backup servers through the communication module.
  • the foregoing division of multiple backup and restoration subtasks according to the foregoing first information includes:
  • the above-mentioned main backup server divides multiple backup and recovery subtasks according to the above-mentioned data range.
  • the foregoing division of multiple backup and restoration subtasks according to the foregoing first information includes:
  • the initial backup recovery rate is the initial rate at which the execution backup server sends data to the corresponding execution production server
  • the initial backup recovery rate corresponding to each of the multiple production servers is allocated to the backup and recovery subtasks corresponding to each of the multiple production servers.
  • the method further includes:
  • the second information includes one or more of the fourth resource consumption information and the health status information of the server; the fourth resource consumption information includes the fourth resource corresponding to each of the multiple production servers in the production system. Consumption status; the health status information of the server includes one or more of the health status of the production server of the production system and the health status of the backup server of the backup system;
  • the adjustment information for the target backup and restoration subtasks is generated according to the second information, and the adjustment information is used for Instruct the execution backup server corresponding to the target backup and restoration subtask to send data to the corresponding execution production server according to the adjustment information;
  • the adjustment information is sent to the execution backup server corresponding to the target backup and restoration subtask through the communication module.
  • the above-mentioned second information includes the above-mentioned fourth resource consumption information; in the case that the target backup and recovery subtask among the multiple backup and recovery subtasks needs to be adjusted according to the analysis of the above-mentioned second information,
  • the foregoing generating adjustment information for the foregoing target backup and restoration subtask according to the foregoing second information includes:
  • the data range that the target backup and recovery subtask needs to be sent to the corresponding execution production server needs to be adjusted based on the analysis of the fourth resource consumption information, based on the fourth resource consumption information, generate the data for the target backup and recovery subtask The adjusted data range that needs to be sent to the corresponding execution production server.
  • the above-mentioned second information includes the above-mentioned fourth resource consumption information; in the case that the target backup and recovery subtask among the multiple backup and recovery subtasks needs to be adjusted according to the analysis of the above-mentioned second information,
  • the foregoing generating adjustment information for the foregoing target backup and restoration subtask according to the foregoing second information includes:
  • the adjusted backup recovery for the target backup and recovery subtask is generated according to the fourth resource consumption information rate.
  • the above-mentioned second information includes the health status information of the above-mentioned server; in the case that the target backup and restoration subtasks among the above-mentioned multiple backup and restoration subtasks need to be adjusted according to the analysis of the above-mentioned second information,
  • the foregoing generating adjustment information for the foregoing target backup and restoration subtask according to the foregoing second information includes:
  • the health status information of the aforementioned server includes the health status of the production server of the aforementioned production system, in the case that the execution production server corresponding to the aforementioned target backup and restoration subtask has failed based on the analysis of the aforementioned health status of the production server of the production system, According to the health status of the production server of the aforementioned production system, generate the adjusted execution production server information corresponding to the aforementioned target backup and restoration subtask;
  • the health status information of the aforementioned server includes the health status of the backup server of the aforementioned backup system
  • the execution backup server corresponding to the aforementioned target backup and restoration subtask fails based on the analysis of the health status of the backup server of the aforementioned backup system
  • the information of the adjusted execution backup server corresponding to the above-mentioned target backup and restoration subtask is generated.
  • the method further includes:
  • the first data is sent to the first execution production server through the communication module; the first data includes data restored from the backup system to the first execution production server, and the first backup restoration subtask
  • the corresponding execution backup server is the aforementioned backup recovery processing server.
  • the foregoing first backup and restoration subtask includes a first initial backup and restoration rate
  • the foregoing sending data to the first execution production server through the communication module according to the first backup and restoration subtask includes:
  • the communication module sends the first data to the first execution production server at the first initial backup and restoration rate.
  • the method after sending the first data to the first execution production server through the communication module according to the first backup and restoration subtask, the method further includes:
  • the communication module sends data to the execution production server corresponding to the adjusted first backup and restoration subtask.
  • the adjusted first backup and restoration subtask includes the first adjustment information, and the first adjustment The information includes one or more of the adjusted data range sent, the adjusted backup recovery rate, and the adjusted address information of the execution production server.
  • an embodiment of the present invention provides a backup and recovery processing server.
  • the above-mentioned backup and recovery processing server is a secondary backup server in a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backups.
  • the server; the backup recovery processing server includes a processor, a memory, and a communication module; the memory and the communication module are coupled to the processor, the memory stores a computer program, and the processor executes the following operations when executing the computer program:
  • the backup restoration subtask corresponds to an execution production server, and is used to instruct the backup restoration processing server to send a preset range of data to the execution production server;
  • the execution production The server is the server in the production system;
  • the above-mentioned backup and recovery processing server is the secondary backup server in the above-mentioned backup system;
  • the data in the preset range is sent to the execution production server through the communication module.
  • the aforementioned backup and restoration subtask includes an initial backup and restoration rate
  • the aforementioned sending of the aforementioned preset range of data to the execution production server through the aforementioned communication module according to the aforementioned backup and restoration subtask includes:
  • the communication module sends the data in the preset range to the execution production server at the initial backup and restoration rate.
  • the method further includes:
  • the adjustment information of the backup and restoration subtask sent by the main backup server is received through the communication module, and the adjustment information is used to instruct the main backup server to send data to the execution production server according to the adjustment information;
  • the adjustment information includes the adjusted direction One or more of the data range sent by the execution production server, the adjusted backup recovery rate, and the adjusted address information of the execution production server;
  • the communication module sends data to the execution production server corresponding to the adjusted backup and restoration subtask.
  • an embodiment of the present invention provides a backup recovery processing server, the above-mentioned backup recovery processing server is a production server in a production system; the above-mentioned backup recovery processing server includes a processor, a memory, and a communication module; the above-mentioned memory and the above-mentioned communication The module is coupled with the above-mentioned processor, the above-mentioned memory stores a computer program, and when the above-mentioned processor executes the above-mentioned computer program, the following operations are performed:
  • the first information includes the third resource consumption situation corresponding to each of the multiple production servers;
  • the above-mentioned first information is sent to the primary backup server through the above-mentioned communication module; the above-mentioned first information is used to enable the above-mentioned primary backup server to divide a plurality of backup and restoration subtasks according to the above-mentioned first information, and the above-mentioned backup and restoration subtasks correspond to executing the backup server and executing
  • the production server is used to instruct the execution backup server to send a preset range of data to the execution production server;
  • the master backup server is the server of the backup system, and the backup system includes one or more master backup servers and one or more slave backups server.
  • the method further includes: receiving, through the communication module, the data of the preset range sent by the second backup server;
  • the backup server is the backup server included in the foregoing backup system.
  • the above-mentioned receiving the above-mentioned preset range of data sent by the second backup server through the above-mentioned communication module includes: receiving through the above-mentioned communication module the above-mentioned preset sent by the second backup server at an initial backup recovery rate For data within a range, the initial backup recovery rate is the initial backup recovery rate set by the primary backup server according to the resource consumption of the backup recovery processing server.
  • the method further includes:
  • the second information includes one or more of the fourth resource consumption information and the health status information of the server; the fourth resource consumption information includes the fourth resource corresponding to each of the multiple production servers in the production system. Consumption status; the health status information of the server includes one or more of the health status of the production server of the production system and the health status of the backup server of the backup system;
  • the second information is sent to the main backup server through the communication module, and the second information is used to enable the main backup server to adjust the backup and restore rate of the backup and restore subtasks corresponding to the backup and restore processing server according to the second information, and execute One or more of the backup server and the data range that needs to be sent to the above-mentioned backup and recovery processing server.
  • the method further includes: receiving data sent by the third backup server through the communication module, and data sent by the third backup server The data is the data sent by the third backup server to the backup recovery processing server according to the adjustment information of the backup recovery subtask corresponding to the backup recovery processing server, and the adjustment information of the backup recovery subtask corresponding to the backup recovery processing server includes the adjusted information One or more of the range of data sent to the aforementioned execution production server and the adjusted backup recovery rate.
  • an embodiment of the present invention provides a backup and recovery processing server.
  • the above-mentioned backup and recovery processing server is a primary backup server in a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backups.
  • Server; the above-mentioned backup and recovery processing server includes:
  • the dividing unit is used to divide the backup and restoration task into multiple backup and restoration subtasks; the allocation unit is used to allocate each backup and restoration subtask to each of the multiple backup servers; the sending unit is used to The multiple backup and restoration subtasks are sent to the respective corresponding backup servers.
  • the above-mentioned backup recovery processing server further includes an acquiring unit configured to acquire first information; the above-mentioned first information includes the third resource consumption situation corresponding to each of the multiple production servers in the production system;
  • the above-mentioned dividing unit is further configured to divide a plurality of backup and restoration subtasks according to the above-mentioned first information; the above-mentioned backup and restoration subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to send a preset to the execution production server Range of data; the above-mentioned execution backup server includes the backup server in the above-mentioned backup system; the above-mentioned execution production server includes one or more production servers in the above-mentioned production system.
  • the above-mentioned dividing unit further includes a determining unit, a setting unit, and a subtask dividing unit; the above-mentioned determining unit is configured to determine the load condition of the multiple production servers according to the above-mentioned third resource consumption condition;
  • the setting unit is used to set the data range that needs to be sent to the multiple production servers according to the load conditions of the multiple production servers;
  • the subtask division unit is used to divide multiple backups according to the data range according to the main backup server Resume subtasks.
  • the above-mentioned dividing unit further includes a determining unit and an allocating unit,
  • the above determining unit is configured to determine the respective initial backup recovery rate corresponding to the multiple production servers according to the above first information, and the initial backup recovery rate is the initial rate at which the execution backup server sends data to the corresponding execution production server;
  • the foregoing allocation unit is configured to allocate the respective initial backup and restoration rates of the multiple production servers to the respective backup and restoration subtasks of the multiple production servers.
  • the foregoing backup and recovery processing server further includes a generating unit
  • the acquiring unit is further configured to acquire second information after the sending unit sends the multiple backup and restoration subtasks to the respective execution backup servers, where the second information includes fourth resource consumption information and server health status information One or more of; the fourth resource consumption information includes the fourth resource consumption corresponding to each of the multiple production servers in the production system; the health status information of the servers includes the health status of the production servers of the production system and One or more of the health status of the backup server of the aforementioned backup system;
  • the generating unit is configured to generate adjustment information for the target backup and restore subtask according to the second information when it is analyzed based on the second information that the target backup and restore subtasks of the multiple backup and restore subtasks need to be adjusted.
  • the above adjustment information is used to instruct the execution backup server corresponding to the target backup restoration subtask to send data to the corresponding execution production server according to the adjustment information;
  • the sending unit is further configured to send the adjustment information to the execution backup server corresponding to the target backup and restoration subtask.
  • the above-mentioned second information includes the above-mentioned fourth resource consumption information; the above-mentioned generating unit is configured to analyze, based on the above-mentioned second information, the target backup and recovery subtask among the above-mentioned multiple backup and recovery subtasks. If adjustment is needed, generating adjustment information for the target backup and restoration subtask according to the second information, including:
  • the range of data that needs to be sent to the corresponding execution production server after the task is adjusted.
  • the above-mentioned second information includes the above-mentioned fourth resource consumption information; the above-mentioned generating unit is configured to analyze, based on the above-mentioned second information, the target backup and recovery subtask among the above-mentioned multiple backup and recovery subtasks. If adjustment is needed, generating adjustment information for the target backup and restoration subtask according to the second information, including:
  • the second information includes the health status information of the server; the generating unit is configured to analyze the target backup and recovery subtask among the multiple backup and recovery subtasks based on the second information If adjustment is needed, generating adjustment information for the target backup and restoration subtask according to the second information, including:
  • the generating unit is used to analyze the execution production server corresponding to the target backup and recovery subtask according to the health status of the production server of the production system. In the event of a failure, according to the health status of the production server of the aforementioned production system, generate the adjusted execution production server information corresponding to the aforementioned target backup and restoration subtask;
  • the generating unit is configured to analyze the health status of the backup server of the backup system to determine the execution backup server corresponding to the target backup restoration subtask. In the event of a failure, according to the health status of the backup server of the backup system, the adjusted execution backup server information corresponding to the target backup restoration subtask is generated.
  • the sending unit is further configured to send the multiple backup and restoration subtasks to the respective execution backup servers, and then send to the first execution production server according to the first backup and restoration subtasks.
  • First data includes data restored from the backup system to the first execution production server, and the execution backup server corresponding to the first backup restoration subtask is the backup restoration processing server.
  • the foregoing first backup and restoration subtask includes a first initial backup and restoration rate
  • the foregoing sending unit is further configured to send data to the first execution production server according to the first backup and restoration subtask, specifically:
  • It is also configured to send the first data to the first execution production server at the first initial backup and restore rate according to the first backup and restoration subtask.
  • the sending unit is further configured to send the first data to the first execution production server according to the first backup and restoration subtask, and restore the adjusted first backup according to the first adjustment information.
  • the execution production server corresponding to the subtask sends data
  • the adjusted first backup and restoration subtask includes the first adjustment information
  • the first adjustment information includes the adjusted range of sent data, the adjusted backup and restoration rate, and the adjustment One or more of the address information of the production server will be executed later.
  • an embodiment of the present invention provides a backup and recovery processing server.
  • the above-mentioned backup and recovery processing server is a secondary backup server in a backup system.
  • the above-mentioned backup system includes one or more primary backup servers and one or more secondary backups.
  • Server; the above-mentioned backup processing server includes:
  • the receiving unit is configured to receive the backup and restoration subtask sent by the main backup server, the backup and restoration subtask corresponds to an execution production server, and is used to instruct the backup and restoration processing server to send a preset range of data to the execution production server;
  • the production server is a server in the production system;
  • the above-mentioned backup recovery processing server is a secondary backup server in the above-mentioned backup system;
  • the sending unit is configured to send the data in the preset range to the execution production server according to the backup and restoration subtask.
  • the aforementioned backup and restoration subtask includes an initial backup and restoration rate
  • the aforementioned sending unit is configured to send the aforementioned preset range of data to the aforementioned execution production server according to the aforementioned backup and restoration subtask, specifically:
  • It is used to send the data of the preset range to the execution production server at the initial backup and recovery rate according to the backup and restoration subtask.
  • the receiving unit is further configured to receive the backup and restore data sent by the primary backup server after the sending unit sends the data in the preset range to the execution production server according to the backup and restoration subtask.
  • the adjustment information of the subtask is used to instruct the main backup server to send data to the execution production server according to the adjustment information;
  • the adjustment information includes the adjusted data range sent to the execution production server, and the adjusted backup recovery One or more of the speed and the address information of the adjusted execution production server;
  • the sending unit is further configured to send data to the execution production server corresponding to the adjusted backup and restoration subtask according to the adjustment information.
  • an embodiment of the present invention provides a backup recovery processing server, the foregoing backup recovery processing server is a production server in a production system; the foregoing backup recovery processing server includes:
  • An obtaining unit configured to obtain first information; the first information includes the third resource consumption situation corresponding to each of the multiple production servers;
  • the sending unit is configured to send the above-mentioned first information to the main backup server;
  • the above-mentioned first information is used to make the above-mentioned main backup server divide a plurality of backup and restoration subtasks according to the above-mentioned first information, and the above-mentioned backup and restoration subtasks correspond to the execution of the backup server and
  • the execution production server is used to instruct the execution backup server to send a preset range of data to the execution production server;
  • the master backup server is the server of the backup system, and the backup system includes one or more master backup servers and one or more slaves Backup server.
  • the backup recovery processing server further includes a receiving unit, configured to receive the preset range of data sent by the second backup server after the sending unit sends the first information to the primary backup server ;
  • the second backup server is a backup server included in the backup system.
  • the above-mentioned receiving unit is configured to receive the above-mentioned preset range of data sent by the second backup server, specifically:
  • It is used to receive the data of the preset range sent by the second backup server at an initial backup and recovery rate, where the initial backup and recovery rate is the initial backup and recovery rate set by the primary backup server according to the resource consumption of the backup and recovery processing server.
  • the acquiring unit is further configured to acquire second information after the sending unit sends the first information to the primary backup server.
  • the second information includes fourth resource consumption information and server information.
  • the fourth resource consumption information includes the fourth resource consumption status of each of the multiple production servers in the production system;
  • the health status information of the server includes the health of the production server of the production system One or more of the status and the health status of the backup server of the aforementioned backup system;
  • the sending unit is further configured to send the second information to the main backup server, and the second information is used to enable the main backup server to adjust the backup and restoration of the backup restoration subtask corresponding to the backup restoration processing server according to the second information.
  • the receiving unit is further configured to receive data sent by a third backup server after the sending unit sends the second information to the primary backup server, and the data sent by the third backup server
  • the adjustment information of the backup recovery subtask corresponding to the backup recovery processing server includes the adjusted direction One or more of the above-mentioned data range sent by the production server and the adjusted backup recovery rate.
  • an embodiment of the present invention provides a backup processing system.
  • the system includes a production system and a backup system.
  • the above-mentioned production system includes multiple production servers.
  • the above-mentioned backup system includes one or more primary backup servers and one or more Secondary backup server; wherein, the above-mentioned primary backup server is any one of the above-mentioned seventh aspect and its possible implementation manners, and the above-mentioned secondary backup server is any one of the above-mentioned eighth aspect and its possible implementation manners.
  • the server, the above-mentioned production server is the above-mentioned server in any one of the above-mentioned ninth aspect and its possible implementation manners.
  • an embodiment of the present invention provides a backup processing system.
  • the system includes a production system and a backup system.
  • the above-mentioned production system includes multiple production servers.
  • the above-mentioned backup system includes one or more primary backup servers and one or more Secondary backup server; wherein, the above-mentioned primary backup server is any one of the above-mentioned tenth aspect and its possible implementation manners, and the above-mentioned secondary backup server is any one of the above-mentioned eleventh aspect and its possible implementation manners
  • the foregoing server and the foregoing production server are any of the foregoing servers in the foregoing twelfth aspect and possible implementation manners thereof.
  • an embodiment of the present invention provides a backup recovery processing system, the system includes a production system and a backup system, the above-mentioned production system includes multiple production servers, and the above-mentioned backup system includes one or more primary backup servers and one or Multiple secondary backup servers; wherein, the primary backup server is any one of the above-mentioned thirteenth aspect and its possible implementation manners, and the above-mentioned secondary backup server is the above-mentioned fourteenth aspect and its possible implementation manners Any one of the aforementioned servers, and the aforementioned production server is any one of the aforementioned servers in the aforementioned fifteenth aspect and its possible implementation manners.
  • an embodiment of the present invention provides a backup recovery processing system, the system includes a production system and a backup system, the above-mentioned production system includes multiple production servers, and the above-mentioned backup system includes one or more primary backup servers and one or A plurality of slave backup servers; wherein, the above-mentioned primary backup server is any one of the above-mentioned sixteenth aspect and its possible implementation manners, and the above-mentioned secondary backup server is the above-mentioned seventeenth aspect and its possible implementation manners Any one of the aforementioned servers, and the aforementioned production server is any one of the aforementioned servers in the aforementioned eighteenth aspect and its possible implementation manners.
  • an embodiment of the present invention provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the first aspect and possible implementations thereof. Any one of the above methods.
  • an embodiment of the present invention provides a computer-readable storage medium, the above-mentioned computer-readable storage medium stores a computer program, and the above-mentioned computer program is executed by a processor to implement the above-mentioned second aspect and possible implementations thereof Any one of the above methods.
  • an embodiment of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the third aspect and its possible implementations. Any one of the above methods.
  • an embodiment of the present invention provides a computer-readable storage medium, the above-mentioned computer-readable storage medium stores a computer program, and the above-mentioned computer program is executed by a processor to implement the above-mentioned fourth aspect and possible implementations thereof Any one of the above methods.
  • an embodiment of the present invention provides a computer-readable storage medium, the above-mentioned computer-readable storage medium stores a computer program, and the above-mentioned computer program is executed by a processor to implement the above-mentioned fifth aspect and its possible implementations. Any one of the above methods.
  • an embodiment of the present invention provides a computer-readable storage medium, the above-mentioned computer-readable storage medium stores a computer program, and the above-mentioned computer program is executed by a processor to implement the above-mentioned sixth aspect and possible implementations thereof Any one of the above methods.
  • an embodiment of the present invention provides a computer program product.
  • the computer program product is read and executed by a computer, any one of the above-mentioned method and the above-mentioned second Any one of the above-mentioned methods in the aspect and possible implementations thereof, or any one of the above-mentioned methods in the above-mentioned third aspect and possible implementations thereof will be executed.
  • an embodiment of the present invention provides a computer program product.
  • the computer program product is read and executed by a computer, any one of the foregoing method and the foregoing fifth aspect of the foregoing fourth aspect and its possible implementation manners Any one of the aforementioned methods or the aforementioned sixth aspect and its possible implementation manners will be executed.
  • an embodiment of the present invention provides a computer program.
  • the computer program When the computer program is executed on a computer, the computer will enable the computer to implement any one of the above-mentioned method and the above-mentioned method in the above-mentioned first aspect and its possible implementations. Any one of the aforementioned methods in the second aspect and its possible implementations, or any one of the aforementioned methods in the aforementioned third aspect and its possible implementations.
  • an embodiment of the present invention provides a computer program that, when the computer program is executed on a computer, will enable the computer to implement any one of the above-mentioned method and the above-mentioned method in the above-mentioned fourth aspect and its possible implementations. Any one of the above methods in the fifth aspect and its possible implementations, or any one of the above methods in the sixth aspect and its possible implementations.
  • an embodiment of the present invention provides a device.
  • the device includes a processor and a communication interface, and the device is configured to execute any one of the foregoing method and the foregoing second aspect of the foregoing first aspect and its possible implementation manners. Any one of the above-mentioned methods in aspects and possible implementations thereof, or any one of the above-mentioned methods in the above-mentioned third aspect and possible implementations thereof.
  • the above-mentioned device is a chip or a system-on-chip SoC.
  • an embodiment of the present invention provides an apparatus.
  • the apparatus includes a processor and a communication interface.
  • the apparatus is configured to execute any one of the foregoing method and the foregoing fifth aspect of the foregoing fourth aspect and its possible implementation manners. Any one of the above-mentioned methods in aspects and possible implementations thereof, or any one of the above-mentioned methods in the above-mentioned sixth aspect and possible implementations thereof.
  • the above-mentioned device is a chip or a system-on-chip SoC.
  • the embodiment of the present application provides a backup processing method.
  • a simple balancing strategy is adopted to obtain the same amount of data from each production server.
  • the data to be backed up is backed up, which causes serious internal forwarding between production servers and degrades server performance.
  • the embodiment of the present application will analyze the data distribution information and/or resource consumption information obtained in advance in the production system according to the analysis results of the entire production system.
  • the data backup task is divided into multiple backup subtasks. Each backup subtask corresponds to the data range responsible for the backup, and then these backup subtasks are distributed to their corresponding backup services for data backup, which can improve the efficiency of backup and reduce the production server Burden.
  • the embodiment of the present application makes full use of each backup server of the backup system to back up data, thereby greatly improving the backup. s efficiency.
  • the embodiment of the present application also provides a backup and recovery processing method.
  • the embodiment of the present application determines the range of data to be restored to be sent to the corresponding production server according to the resource consumption of each production server in the production server, and the backup
  • the recovery task is divided into multiple sub-tasks and distributed to multiple servers in the backup system for execution, so the efficiency of backup recovery is improved without hindering production.
  • Figure 1 is a schematic diagram of a backup system architecture in the prior art
  • FIG. 2 is a schematic diagram of a backup system architecture provided by an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of the interaction flow of a backup processing method provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of the interaction flow of a backup processing method provided by an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a backup system architecture provided by an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of the interaction flow of a backup and recovery processing method provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of the interaction flow of a backup and recovery processing method provided by an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of the architecture of a backup and recovery system provided by an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of the logical structure of a primary backup server according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of the hardware structure of a primary backup server provided by an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of the logical structure of a secondary backup server according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of the hardware structure of a secondary backup server according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of the logical structure of a production server provided by an embodiment of the present invention.
  • FIG. 14 is a schematic diagram of the hardware structure of a production server provided by an embodiment of the present invention.
  • the system architecture shown in FIG. 2 may include a production system 201 and a backup system 202.
  • the production system 201 includes multiple production servers
  • the backup system 202 includes multiple backup servers.
  • the production systems 201 involved in the embodiments of the present application may be production systems of various industries, and these production systems may produce data or be used to store data.
  • the multiple production servers included in the production system 201 may each have its own division of labor, and the data produced or stored may be different.
  • the storage type of data in the production system 201 may be a shared storage type or a decentralized storage type.
  • the backup system 202 involved in the embodiment of the present application is used to obtain data from the production system 201 for backup.
  • the multiple backup servers included in the backup system 202 can perform division of labor to back up data in the production system 201.
  • system architecture of the backup processing method provided in the embodiment of the present application is not limited to the system architecture shown in FIG. 2.
  • FIG. 3 is a backup processing method provided by an embodiment of the present invention.
  • the method can be implemented based on the system architecture shown in FIG. 2.
  • the method includes but is not limited to the following steps:
  • Step 301 The production server in the production system obtains first preset information.
  • Step 302 The production system sends the above-mentioned first preset information to the main backup server.
  • the production system generally includes multiple production servers. Before backing up the data in the production system, the first preset information in the production system can be obtained first, and the first preset information can be analyzed and understood. One or more of the data distribution in the production system and the resource consumption of the production server, etc.
  • the backup system includes multiple backup servers, of which one or more backup servers are master backup servers, and the other backup servers are slave backup servers.
  • the primary backup server is mainly used to perform backup parent tasks
  • the secondary backup server is mainly used to perform backup subtasks.
  • the primary backup server can also perform backup subtasks.
  • the backup parent task is mainly used to obtain the first preset information in the production system, and multiple backup subtasks are divided and distributed to the corresponding backup server according to the first preset information.
  • the backup subtask is mainly used to instruct the corresponding backup server to obtain the data to be backed up from the corresponding production server for storage and backup.
  • the backup parent tasks and backup subtasks will be described in detail below and will not be detailed here.
  • the above-mentioned one or more primary backup servers may be any one or more of multiple backup servers in the backup system.
  • the specific determination of which primary backup server can be determined can be determined according to specific conditions. The program does not impose restrictions on this.
  • the following takes a primary backup server as an example to introduce the backup processing method provided by the embodiment of the present invention. If there are multiple primary backup servers in the backup system, the functions implemented by other primary backup servers can be compared with this one primary backup server. The backup server is the same, so I won’t repeat it in this manual.
  • the first preset information may include first data distribution information; or, the first preset information may include first resource consumption information; or, the first preset information may include first data Distribution information and first resource consumption information. among them:
  • the first data distribution information may include the distribution of the data to be backed up in the production system at the moment when the first data distribution information is generated.
  • the first data distribution information may indicate the capacity of the data to be backed up and the file name of the data to be backed up in each production server in the production system.
  • the first resource consumption information may include the resource consumption status of each production server in the production system at the moment when the first resource consumption information is generated.
  • the resource consumption situation may include the occupancy situation of the processor CPU, the usage situation of the memory, and the network bandwidth, and may also include the situation of Transaction Per Second (TPS).
  • TPS Transaction Per Second
  • the above-mentioned first preset information may also include data storage type information of the production system, for example, information about whether it is distributed storage or shared storage.
  • the first preset information acquired by the production server in the production system may be that after receiving the acquisition instruction of the primary backup service, the production servers in the production system acquire their respective information, and then send them separately To the main backup server. It can also be that equipment or devices outside the production system uniformly collect information from the production server in the production system, and finally obtain the first preset information, and a certain production server in the production system uniformly sends the first preset information to Primary backup server.
  • Step 303 The main backup server divides multiple backup subtasks according to the first preset information, and the backup subtasks correspond to an execution backup server and an execution production server.
  • the backup subtask is used to instruct the corresponding execution backup server to back up the data to be backed up in the target range in the corresponding execution production server.
  • the execution backup server corresponding to each backup subtask may include one backup server in the backup system, and the execution production server corresponding to each backup subtask may include one or more production servers in the production system.
  • the primary backup server analyzes the acquired first preset information, and divides multiple backup subtasks according to the analysis result.
  • Each backup subtask obtained by the division can correspond to a subtask identification number (identity document, ID), information of the backup server that executes the subtask (that is, the aforementioned backup server), and the location of the data to be backed up that the subtask needs to obtain Information about the production server (that is, the aforementioned execution production server), and the range information of the data to be backed up that the subtask needs to obtain (for example, the size of the data to be backed up, the corresponding file name, etc.).
  • each backup subtask obtained by the division may also correspond to the information of the initial backup rate of the subtask and so on. The initial backup rate may be used to instruct the execution backup server corresponding to the subtask to obtain the data to be backed up from the corresponding execution production server at the initial backup rate.
  • the information of the aforementioned production server may include one or more of the name of the server, the media access control address, and the Internet protocol address.
  • the above-mentioned backup server information may include one or more of the server's name, media access control address, and Internet protocol address.
  • the corresponding execution backup server in each backup subtask obtained by division may be one, and the corresponding execution production server in each backup subtask obtained by division may be one or more, namely
  • the subtask may only be responsible for obtaining data that needs to be backed up from one production server for backup, or the subtask may also be responsible for obtaining data to be backed up in the multiple production servers from multiple production servers for backup.
  • Step 304 The main backup server sends the multiple backup subtasks to the respective execution backup servers.
  • the main backup server since the multiple backup subtasks divided by the main backup server each correspond to the executed backup server, the main backup server sends the multiple backup subtasks to the corresponding backup server according to the information of the respective execution backup server.
  • the execution backup server here can be a slave backup server.
  • Step 305 Each of the backup servers in the backup system receives corresponding backup subtasks.
  • Step 306 The slave backup server in the backup system sends a data acquisition request to be backed up to the corresponding execution production server according to the received backup subtask; the data acquisition request to be backed up includes information about the data range to be backed up.
  • execution backup server which can be from the backup server
  • the other execution backup servers perform the specific operations of the backup server after receiving the backup subtask. It can be the same as the one performing backup server.
  • the backup subtask received by the execution backup server may be one or more, that is, if each backup subtask corresponds to an execution production server, then the execution backup server needs to be executed from one or more execution production servers. Obtain the data to be backed up for backup.
  • the following is an example of the execution of a backup subtask received by the backup server.
  • the execution backup server After the execution backup server receives the backup subtask, it can obtain the information of the corresponding execution production server from the backup subtask and the information about the range of data to be backed up that needs to be obtained from the corresponding execution production server. After the execution backup server obtains this information, it generates a data acquisition request to be backed up based on the information. The request can carry information about the range of data to be backed up that needs to be obtained from the corresponding execution production server, and then the execution backup server sends the request to The corresponding execution production server mentioned above.
  • the backup subtask received by the execution backup server may also include initial backup rate information, which is used to instruct the execution backup server to obtain the data to be backed up from the corresponding execution production server at the initial backup rate for backup. .
  • the data acquisition request to be backed up generated by the execution backup server may also carry the information of the initial backup rate, so that the corresponding production execution server sends the data to be backed up to the execution backup server according to the initial backup rate.
  • the one backup subtask also correspondingly includes information about the range of data to be backed up that needs to be obtained from the multiple execution production servers and/or correspondingly includes Obtain multiple initial backup rates of the data to be backed up from the multiple execution production servers.
  • Step 307 The production server in the production system receives each corresponding request for obtaining data to be backed up.
  • Step 308 The production server in the production system obtains the data to be backed up according to the information corresponding to the data range to be backed up.
  • Step 309 The production server in the production system sends the obtained data to be backed up to the corresponding backup server.
  • the following is an example of how to operate after a production server receives the data acquisition request to be backed up.
  • the operations of other production servers after receiving the data acquisition request to be backed up are the same.
  • the production server After the production server receives the request for obtaining the data to be backed up, it parses the request to obtain information about the range of data to be backed up, then obtains the data to be backed up according to the range information, and then sends the obtained data to be backed up to the corresponding server with backup.
  • the production server obtains the information about the backup rate after parsing the request, and uses the obtained data to be backed up as the backup rate. The rate is sent to the corresponding backup server.
  • the production server may obtain the data in the range corresponding to the request from the shared storage in the production system and send it to the corresponding execution backup server. .
  • the production server can obtain the above-mentioned request from the storage of the execution production server.
  • the data of the corresponding range is sent to the above-mentioned corresponding execution backup server.
  • the above-mentioned primary backup server can also be used as an execution backup server of the backup subtasks, that is, the primary backup server distributes one or more backup subtasks to itself for execution.
  • the main backup server sends a data acquisition request to be backed up to the corresponding execution production server according to the one or more backup subtasks; the data to be backed up
  • the acquisition request includes information about the range of data to be backed up, and then the data to be backed up sent by the corresponding execution production server is received for backup.
  • the first preset information includes the first data distribution information
  • the main backup server divides multiple backup subtasks according to the first preset information, including: the main backup server according to the foregoing
  • the first data distribution information divides the multiple backup subtasks;
  • the data to be backed up in the target range includes data determined according to the distribution of the data to be backed up of the execution production server in the first data distribution information.
  • first preset information includes first data distribution information, that is, includes information such as the capacity and file name of the data to be backed up corresponding to each production server in the production system
  • first data distribution information that is, includes information such as the capacity and file name of the data to be backed up corresponding to each production server in the production system
  • the primary backup server can use the Information such as the capacity and file name of the data to be backed up corresponding to each production server in the production system determines the data range that multiple backup subtasks are responsible for backing up.
  • the name of the production server Capacity of data to be backed up File name of the data to be backed up Production server 1 100G File_1, File_2... Production server 2 300G File_3, File_4... Production server 3 500G File_5, File_6... Production server 4 800G File_7, File_8...
  • Table 1 exemplarily gives the capacity and file name information of the data to be backed up corresponding to each production server in the production system in the form of a table.
  • the production system includes four production servers: production server 1, production server 2, production server 3, and production server 4.
  • the data capacities to be backed up corresponding to these four production servers are 100G, 300G, 500G, and 200G respectively.
  • Table 1 The file names of the data to be backed up on the four production servers are also correspondingly given.
  • the file names to be backed up in production server 1 include File_1, File_2, etc. Since there may be many file names, they are not listed one by one.
  • the data to be backed up can be files, recorded information, cached information, and other data that need to be backed up.
  • the format and form of the data to be backed up are not limited, and the format and form of the data to be backed up are not limited. Data is backed up, and there is no restriction on this in this program.
  • the primary backup server can divide multiple backup subtasks and determine the data range of each subtask according to the information in Table 1.
  • the following is an example based on the table The information of 1 is divided into subtasks:
  • the main backup server can divide four backup subtasks according to the information in Table 1. Assume that the subtask IDs assigned by the main backup server to these four subtasks can be subtask 1, subtask 2, subtask 3, and subtask 4, respectively. , And then the main backup server assigns the data to be backed up in the production server 1, production server 2, production server 3, and production server 4 to subtask 1, subtask 2, subtask 3, and subtask 4, respectively, to be responsible for the backup.
  • the one-to-one execution production servers of task 1, subtask 2, subtask 3, and subtask 4 are production server 1, production server 2, production server 3, and production server 4, respectively.
  • the main backup server can assign subtask 1, subtask 2, subtask 3, and subtask 4 to backup server 1 in a one-to-one correspondence.
  • Backup server 2, backup server 3, and backup server 4 execute, that is, the execution backup servers corresponding to subtask 1, subtask 2, subtask 3, and subtask 4 are backup server 1, backup server 2, backup server 3, and backup server, respectively 4.
  • the information included in each subtask after the assignment is complete can be found in Table 2.
  • each subtask corresponds to an execution backup server and an execution production server.
  • the subtask division method of mode 1 can be used to make full use of the backup server and avoid resources. Waste.
  • one backup service can be used to back up data for multiple production servers. For example, see the subtask division method in the second mode below.
  • Method 2 Assuming that there are only three backup servers, namely backup server 1, backup server 2, and backup server 3, in the backup system, the main backup server can divide three backup subtasks according to the information in Table 1. Assuming that the subtask IDs assigned to these three subtasks by the main backup server can be subtask 1, subtask 2, and subtask 3 respectively, and then the main backup server assigns the data to be backed up in production server 1 and production server 2 to the subtasks respectively. Task 1 and subtask 2 are responsible for backup. Assign the data to be backed up in production server 3 and production server 4 to subtask 3 for backup. That is, the execution production servers corresponding to subtask 1 and subtask 2 are production server 1 and production server. 2.
  • the execution production servers corresponding to subtask 3 are production server 3 and production server 4.
  • the primary backup server can assign subtask 1, subtask 2, and subtask 3 to backup server 1, backup server 2, and backup server 3 for execution, that is, the execution backup servers corresponding to subtask 1, subtask 2 and subtask 3, respectively These are backup server 1, backup server 2, and backup server 3.
  • the information included in each subtask after the assignment is complete can be found in Table 3.
  • the sub-task division method of Method 2 is not necessarily used when the backup server is not enough to perform data backup in a one-to-one correspondence with the production server. It can also be used in other situations, for example, the production server 3 and the production server 4 need to be backed up. The amount of data is small, and a backup server 3 can quickly implement its backup in the case that the division method of the second method is adopted. Of course, there are other cases that the division method of the second method can be adopted, and the details are not described here.
  • one backup server may not be able to back up, and multiple backup servers can be allocated to back up the data in the production server correspondingly. For example, see the subtask division method in the third mode below.
  • the main backup server can divide five backup subtasks according to the information in Table 1. Assume that the subtask IDs assigned to these five subtasks by the main backup server can be subtask 1, subtask 2, subtask 3, and subtask. 4 and subtask 5, and then the main backup server assigns the data to be backed up in production server 1, production server 2 and production server 3 to subtask 1, subtask 2 and subtask 3 respectively to be responsible for the backup, and the production server 4 to be backed up
  • the data is allocated to subtask 4 and subtask 5 for backup, that is, the execution production servers corresponding to subtask 1, subtask 2, subtask 3, subtask 4, and subtask 5 are production server 1, production server 2, Production server 3, production server 4, and production server 4.
  • the main backup server can assign subtask 1, subtask 2, subtask 3, subtask 4, and subtask 5 Correspondingly assigned to backup server 1, backup server 2, backup server 3, backup server 4, and backup server 5 for execution, that is, execute backup servers corresponding to subtask 1, subtask 2, subtask 3, subtask 4, and subtask 5, respectively.
  • the information included in each subtask after the allocation is complete can be found in Table 4.
  • one way can be determined according to the performance of the backup server corresponding to subtask 4 and subtask 5, such as the performance of backup server 4.
  • Weak 80% CPU usage and 70% memory usage
  • strong performance of the backup server 5 CPU usage 20%, memory usage 30%
  • the production server 4 A smaller part of the data to be backed up (for example, 300G) is allocated to the subtask 4 for backup, and a larger part of the data to be backed up in the production server 4 (for example, 500G) is allocated to the subtask 5 for backup.
  • Another way can be random or even distribution. This is just an example for illustration. In a specific embodiment, how to allocate can be determined according to specific conditions, and this solution does not limit this.
  • subtask 4 corresponds to two execution backup servers, that is, two backup servers are used to back up the data to be backed up in a production server, so as to make full use of resources to improve the efficiency of backup.
  • execution backup server execution production server
  • data range that needs to be backed up corresponding to specific subtasks can be determined according to specific conditions, and this solution does not limit this.
  • the first preset information includes the first resource consumption information
  • the main backup server divides multiple backup subtasks according to the first preset information, including: the main backup server according to the foregoing
  • the first resource consumption information divides the multiple backup subtasks
  • the backup subtask includes information about one or more initial backup rates
  • the one or more initial backup rates correspond to the backup subtasks in the first resource consumption information.
  • the resource consumption of one or more production servers corresponds to the set initial backup rate, and the information of the initial backup rate is used to indicate that data is backed up from the production server corresponding to the initial backup rate at the initial backup rate.
  • the primary backup server can divide the backup subtasks according to the acquired first resource consumption information.
  • a production server's CPU is occupied and/or memory is used more, it indicates that the load of the production server is heavier; if the network bandwidth of a production server is smaller and/or transactions per second are processed The smaller the amount, the worse the performance of the production server.
  • the primary backup server knows the scope and total amount of data to be backed up in the production system, but does not know the scope and quantity of the data to be backed up in each production server in the production system, the primary backup server divides the backup subtasks A production server with a heavier load and/or poor performance can be assigned a smaller range and quantity of backup data, and a production server with a lighter load and/or better performance can be assigned a larger range and quantity of backup data.
  • the name of the production server CPU usage Memory usage Network bandwidth Transactions per second Production server 1 10% 50% 100M 2000 Production server 2 35% 40% 50M 1000 Production server 3 50% 55% 20M 500 Production server 4 75% 65% 10M 200
  • the load corresponding to the production server 1, the production server 2, the production server 3, and the production server 4 is getting heavier and the performance is getting worse and worse.
  • the amount of data that needs to be backed up in the known production system is 1000G, which includes 1000 files of file-1, file-2, file-3,..., file-1000, and assumes that the capacity of each file is 1G.
  • the primary backup server can divide backup subtasks according to the above analysis results. The information included in each subtask after the division is complete can be found in Table 6.
  • the primary backup server can be divided into four subtasks, and each subtask corresponds to a production server. Assume that the task IDs of these four subtasks are subtask 1, subtask 2, subtask 3, and subtask 4.
  • the execution production servers corresponding to subtask 1, subtask 2, subtask 3, and subtask 4 can be production server 1, production server 2, production server 3, and production server 4, respectively; subtask 1, subtask 2, subtask 3, and subtask 4
  • the execution backup servers corresponding to task 4 may be backup server 1, backup server 2, backup server 3, and backup server 4, respectively. As the corresponding loads of production server 1, production server 2, production server 3, and production server 4 are getting heavier and worse, their performance is getting worse. Therefore, when the main backup server divides the backup subtasks, it is assigned to subtask 1, subtasks.
  • Task 2 subtask 3, and subtask 4 obtain smaller and smaller data to be backed up from their corresponding production server 1, production server 2, production server 3, and production server 4.
  • they can correspond to "450G, File_1, File_2,..., File_450", “300G, File_451, File_452,..., File_750", "200G, File_751, File_752,..., File_950” and "50G, File_951, File_952,..., File_1000".
  • the range of data to be backed up to be obtained for each subtask divided in Table 6 is only an example, and it can also be divided into other proportions, such as subtask 1, subtask 2, subtask 3, and subtask 4, respectively.
  • the corresponding range of data to be backed up to be obtained can be "500G, File_1, File_2,..., File_500", "250G, File_501, File_452,..., File_750", "200G, File_751, File_752,..., File_950” and "50G , File_951, File_952,..., File_1000” and so on.
  • the specific division ratio is determined according to the specific situation, and this plan does not impose restrictions on this.
  • the primary and backup servers in addition to dividing the data range that the backup subtasks are responsible for backing up according to the first resource consumption information, can also determine the initial value of each backup subtask according to the first resource consumption information. Backup rate.
  • the initial backup rate is 100 bits per second.
  • the initial backup rate of each backup subtask can be determined by setting a threshold. For example, if the CPU occupancy of the production server is less than or equal to 20%, and the network bandwidth is greater than or equal to 100M, then the initial rate of the backup subtask corresponding to the production server can be set to 1 megabit per second. If the CPU usage of the production server is greater than 20% and less than or equal to 40%, and the network bandwidth is less than 100M and greater than or equal to 50M, then the initial rate of the backup subtask corresponding to the production server can be set to 500 bits per second.
  • the initial rate of the backup subtask corresponding to the production server can be set to 200 bits per second. If the CPU occupancy of the production server is greater than 60%, and the network bandwidth is less than 20M, then the initial rate of the backup subtask corresponding to the production server can be set to 100 bits per second.
  • the specific determination method is determined according to the specific situation, and this solution does not limit this.
  • the example of setting the initial backup rate described above is introduced when one backup subtask corresponds to one production server. If a backup subtask corresponds to multiple production servers, it can be based on each of the multiple production servers. Set the respective initial backup rate for resource consumption, that is, there are multiple initial backup rates corresponding to the backup subtasks.
  • the primary backup server may divide the backup subtasks according to the first data distribution information.
  • the data range of the backup is then determined according to the first resource consumption information to determine the initial backup rate of each backup subtask.
  • Tables 1 to 4 which will not be repeated here.
  • Table 5 to Table 6 which will not be repeated here.
  • the primary backup server after the primary backup server receives the first preset information, before the entire backup process is completed, the primary backup server will obtain the latest preset information every first preset duration.
  • the latest preset information may include one or more of the latest data distribution information and the latest resource consumption information in the above-mentioned production system, and may also include the latest health status of each production server in the above-mentioned production system and/or The latest health status of each backup server in the above-mentioned backup system.
  • the information is then analyzed to generate adjustment information for the corresponding backup subtasks, which is used to adjust some parameters in the backup process to ensure that the production service of the production server and the backup operation of the backup server can be performed at the same time, and the production of the production server is not affected.
  • the distribution information of the data to be backed up may be constantly changing, and the consumption of resources is also constantly changing. Therefore, during the entire backup process, every second For a preset duration, the primary backup server can obtain one or more of the latest data distribution and resource consumption from the production system to adjust some backup parameters to achieve the goal of both backup and production.
  • the above-mentioned first preset duration may be five minutes, ten minutes, half an hour, etc.
  • the specific first preset duration is determined according to specific conditions, and this solution does not impose restrictions on this.
  • the information obtained by the primary backup server every first preset period of time may be obtained by directly interacting with the production system, or it may be sent to the primary backup server by other devices after obtaining the information from the production system. .
  • the second preset information is obtained as an example, how to generate adjustment information corresponding to the backup subtask based on the information is described.
  • the second preset information includes one or more of the second data distribution information, the second resource consumption information, and the health status information of the server.
  • the second data distribution information may include the latest data distribution information in the above-mentioned production system, and the information may be the data distribution information in the production system at the time when the second data distribution information is generated; the second resource consumption information may include the above-mentioned production system.
  • the latest resource consumption information in the system which may be resource consumption information in the production system at the time when the second resource consumption information is generated;
  • the health status information of the server may include the latest health status of each production server in the above-mentioned production system And/or the latest health status of each backup server in the above-mentioned backup system, which may be the health status of each production server in the above-mentioned production system and/or each backup in the above-mentioned backup system at the time when the server's health status information is obtained The health status of the server.
  • processing method of the latest data distribution and resource consumption information in the production system obtained every first preset time period after the second preset information is obtained can be the same.
  • Step 401 The above-mentioned production system obtains second preset information.
  • Step 402 The above-mentioned production system sends the above-mentioned second preset information to the main backup server.
  • the manner in which the production system obtains the second preset information may be the same as the manner in which the first preset information is obtained.
  • the second preset information includes the health status of each production server in the above-mentioned production system and/or the health status of each backup server in the above-mentioned backup system
  • each production server of the production system can obtain its own health status. It is sent to the main backup server separately, or a certain server or device (for example, a server dedicated to monitoring the health status of each production server in the production system) collects the health status information in the production system, and then the health status information in the production system is collected by a certain server or device in the production system.
  • the servers are sent to the main backup server in a centralized manner.
  • the primary backup server can actively collect the health status of each backup server in the backup system. For example, it can send a health status acquisition request to the backup server. After receiving the request, the backup server obtains its own health status information and sends it to the primary backup server; or , There is a server dedicated to monitoring the health status of each backup server in the backup system, then the primary backup server can obtain the health status of each backup server from the server.
  • Step 403 In the case where the primary backup server analyzes the target backup subtasks of the multiple backup subtasks to be adjusted according to the second preset information, the primary backup server generates a backup for the target according to the second preset information. Adjustment information for subtasks.
  • Step 404 The primary backup server sends the adjustment information to the execution backup server corresponding to the target backup subtask.
  • the obtained second preset information includes the second data distribution information, for example, it may be the data to be backed up of each production server in the production system at the time when the second data distribution information is generated. Information such as capacity, file name, etc., then the primary backup server can compare this information with the above-mentioned first data distribution information.
  • the information of each production server included in the second data distribution information is compared with the information of each production server included in the first preset data distribution information with the production server as the object, that is, the same production server is at different times
  • the acquired data is compared, for example, the information of the first production server included in the second data distribution information is compared with the information of the first production server included in the first data distribution information, and the information of the second production server included in the second data distribution information is compared.
  • the information is compared with the information of the second production server included in the first data distribution information, and so on.
  • the main backup can generate adjustment information for the backup subtask corresponding to the production server according to the change, and generate The adjustment information is sent to the corresponding execution backup server.
  • the data range of the first production server to be backed up is a data range with a capacity of 100G and file names file1 and file2, but in the second data distribution information, the data range of the first production server to be backed up is The data range with a capacity of 90G and file names of file2 and file3, that is, after obtaining the first data distribution information and before obtaining the second data distribution information, the first production server generates file3 that needs to be backed up, and this period of time has been completed Backup of file1. Therefore, the main backup server can generate an adjusted data range to be backed up for the backup subtask corresponding to the first production server, that is, a data range with a capacity of 90G and file names of file2 and file3. Then, the primary backup server sends the adjusted data range to the corresponding execution backup server.
  • the adjusted data range generated can be determined according to specific conditions, and this solution does not impose restrictions on this.
  • the acquired second preset information includes the second resource consumption information, it includes the processor CPU corresponding to each production server in the production system when the second resource consumption information is acquired. Occupancy, memory usage, and network bandwidth can also include transactions per second (Transaction Per Second, TPS). Then the primary backup server can compare this information with the above-mentioned first resource consumption information.
  • TPS Transaction Per Second
  • the information of each production server included in the second resource consumption information is compared with the information of each production server included in the first preset resource consumption information with the production server as the object, that is, the same production server is at different times
  • the acquired data is compared, for example, the information of the first production server included in the second resource consumption information is compared with the information of the first production server included in the first resource consumption information, and the information of the second production server included in the second resource consumption information is compared.
  • the information is compared with the information of the second production server included in the first resource consumption information, and so on.
  • the main backup can generate the corresponding production server according to the changes. And send the generated adjustment information to the corresponding execution backup server.
  • the CPU usage of the first production server is 10%, and the memory usage is 20%, but in the second resource consumption information, the CPU usage of the first production server is 50%
  • the memory usage is 60%, that is, after the first resource consumption information is obtained, before the second resource consumption information is obtained, the CPU usage of the first production server has increased by 50%, and the memory usage has increased by 40% , That is, during this period of time, the production load of the first production server has increased.
  • the primary backup server can reduce the rate at which the first production server sends the data to be backed up to the corresponding execution backup server, and then Generate the adjusted backup rate of the backup subtask corresponding to the first production server. And send the adjusted backup rate to the corresponding execution backup server.
  • the primary backup server can adjust the rate at which the first production server sends the data to be backed up to the corresponding execution backup server. High, and then generate the adjusted backup rate of the backup subtask corresponding to the first production server. And send the adjusted backup rate to the corresponding execution backup server.
  • the adjusted backup rate can be determined by setting a threshold. For example, after comparing the resource consumption of the above two acquisitions, if the CPU occupancy of the production server increases by 10% to 20%, the memory usage increases by 10% to 20%, then the primary backup server can reduce the rate at which the first production server sends the data to be backed up to the corresponding execution backup server by 20%, that is, assuming that the initial backup rate is 1Mbits per second, after reducing it by 20%, it will be 800 Bits per second. If the CPU occupancy of the production server is reduced by 10% to 20%, and the memory usage is reduced by 10% to 20%, the primary backup server can adjust the rate at which the first production server sends the data to be backed up to the corresponding execution backup server.
  • the primary backup server can Obtain the data to be backed up that needs to be obtained from the production server from other running production servers to continue the backup.
  • the main backup server adjusts the execution production server in the backup subtask corresponding to the production server to other normally running production servers, then generates the adjusted production server information, and sends the adjusted production server information to The execution backup server corresponding to the backup subtask. It should be noted that the adjusted execution production server has sufficient performance to replace the failed production server to send the data to be backed up to the backup server.
  • the main backup server adjusts the execution backup server in the backup subtask corresponding to the certain execution backup server to other normally running backup servers, and then generates the adjusted backup server information, and the adjusted backup server information The information and the backup subtask are sent to the execution backup server corresponding to the backup subtask.
  • Step 405 The execution backup server receives the adjustment information.
  • Step 406 The execution backup server adjusts the data acquisition request to be backed up according to the adjustment information.
  • Step 407 The execution backup server sends the adjusted data acquisition request to be backed up to the execution production server corresponding to the target backup subtask.
  • the corresponding execution backup server after the corresponding execution backup server receives the subtask adjustment information sent by the main backup server, it generates an adjusted data request to be backed up according to the adjustment information. If the adjustment information includes information about the adjusted data range to be backed up, the generated adjusted data to be backed up request carries the adjusted data range information to be backed up. If the adjustment information includes information about the adjusted rate to be backed up, the generated adjusted data request to be backed up carries the information about the adjusted rate to be backed up. If the adjustment information includes the information of the adjusted production server, the generated adjusted data request to be backed up carries the address information of the adjusted production server, and the address information is used to indicate to which production server the request is sent.
  • Step 408 The above-mentioned execution production server receives the above-mentioned adjustment request for obtaining data to be backed up.
  • Step 409 The execution production server obtains the data to be backed up according to the adjusted data obtaining request to be backed up.
  • Step 410 The execution production server sends the acquired data to be backed up to the execution backup server.
  • the corresponding execution production server after the corresponding execution production server receives the adjusted data to be backed up request sent by the corresponding execution backup server, it obtains the data to be backed up according to the request. If the request carries information about the adjusted data range to be backed up, the corresponding execution production server obtains the data to be backed up according to the adjusted data range to be backed up, and then sends the obtained data to be backed up to the corresponding execution backup server. If the request carries information about the adjusted to-be-backed-up rate, the corresponding execution production server sends the acquired data to be backed up to the corresponding execution-backup server at the adjusted to-be-backed-up rate.
  • FIG. 5 is a schematic diagram of a system library framework suitable for a backup processing method provided by an embodiment of the application.
  • the schematic diagram of the system framework shown in FIG. 5 may be a schematic diagram of a specific framework of the system framework shown in FIG. 1.
  • the system includes a production system and a backup system.
  • the production system can include three production servers (production server 1, production server 2, and production server 3), and each production server includes a monitoring module, a production layer, an acquisition module, and a transmission module;
  • the backup system can include three backup servers ( Backup server 1, backup server 2, and backup server 3), scheduler and backup storage.
  • Each backup server includes a parent task creation module, an analysis module, a child task distribution module, a child task creation module, a transmission module, a processing module, and a backup module .
  • the backup server 1 is the master backup server, and the backup server 2 and the backup server 3 are slave backup servers.
  • the primary backup server may be any one or more of the multiple backup servers in the backup system, and may be determined by the scheduler.
  • the monitoring module in the production server used to monitor the distribution of data in the production server and the resource consumption in the production server in real time, and send the acquired situation information to the main backup server.
  • Production layer in the production server Mainly used for production data, and data to be backed up can be obtained from the production layer.
  • Obtaining module in the production server used to obtain the data to be backed up in the production server.
  • Transmission module in the production server used to transmit the data to be backed up acquired by the acquisition module to the corresponding backup server.
  • the scheduler in the backup system used to schedule each backup server to back up the data in the production system.
  • the parent task creation module of the backup server used to create a backup parent task, which is mainly used to complete two major tasks. One is to write the name and ID of the production system, the time stamp of this backup, and the type of this backup, such as incremental backup or full backup, to the backup storage; the other is to analyze the data from the production system Obtain the distribution of data in the production server and the resource consumption in the production server, and then divide subtasks and distribution subtasks.
  • the analysis module of the backup server used to receive and analyze the information sent by the monitoring module in the production server, and determine the distribution of subtasks, the corresponding relationship between each subtask and the production server, and the production data acquisition of each subtask according to the load and data distribution. Scope, real-time adjustment of the scope of responsibility of each sub-task and the life cycle of the sub-task, etc. It can also be used to analyze the information sent by the monitoring module in the production server in real time, and generate adjustment information for the corresponding subtasks.
  • the subtask distribution module of the backup server used to distribute the divided subtasks to the backup servers in the backup system, and can also send the adjustment information of the subtasks to the corresponding backup server in real time.
  • the subtask creation module of the backup server used to create a backup subtask according to the received backup subtask creation instruction, and then send a request for obtaining the data to be backed up to the corresponding production server; it can also be used to receive real-time subtask adjustment information, and Adjust the execution of subtasks according to the adjusted information.
  • the transmission module of the backup server used to receive the data to be backed up transmitted from the corresponding production server.
  • the processing module of the backup server used to process the data to be backed up received by the transmission module, such as compressing and deduplicating the data.
  • Backup module of the backup server used to store the data processed by the processing module in the backup memory.
  • the following exemplarily introduces the flow of the backup processing method provided by the embodiment of the present application with reference to FIG. 5.
  • the method may include the following steps:
  • the parent task creation module of the backup server 1 receives the backup instruction sent by the scheduler.
  • the backup instruction is used to instruct to issue the backup task of the data of the production system to the backup server 1, that is, the backup server 1 will be the main backup server, and the other servers (Backup Server 2 and Backup Server 3) act as slave servers to assist the master backup service to complete the backup of the data in the production system.
  • the parent task creation module After receiving the above-mentioned backup instruction, the parent task creation module generates a backup parent task according to the instruction, and triggers the analysis module to obtain data distribution information and resource consumption information in the production system, and can also obtain data storage type information of the production system.
  • the analysis module sends an information acquisition instruction to each production server in the production system in response to the trigger of the parent task creation module.
  • the information acquisition instruction is used to trigger the monitoring module to acquire the data distribution information and resource consumption information in the production server, and also obtain the production The data storage type information of the system.
  • each production server After each production server receives the information acquisition instruction sent by the analysis module, it triggers the monitoring module to acquire its own data distribution information and resource consumption information and send it to the analysis module. It can also obtain the data storage type information of the production system and send it to the analysis module.
  • 5Analysis module is based on the received data distribution information and resource consumption information of each production server, and can also be based on the data storage type information of the received production system. At the same time, it combines the situation of each backup server (such as the number of backup servers, each backup Server performance, etc.) is divided into multiple backup subtasks. Each backup subtask corresponds to information such as identification number, execution backup server, execution production server, data range responsible for backup, and initial performance indicators such as initial backup rate.
  • the analysis module After the analysis module divides multiple backup subtasks, it triggers the subtask distribution module to send subtask creation instructions to the execution backup servers corresponding to each backup subtask (ie, backup server 1, backup server 2 and backup server 3). Carry the information included in the corresponding backup subtask, such as identification number, execution backup server, execution production server, data range responsible for backup, and initial performance indicators such as initial backup rate.
  • each execution backup server receives the subtask creation instruction sent by the subtask distribution module of the main backup server, it triggers its subtask creation module to create the subtask, and generates a data acquisition request to be backed up, which is used to send the corresponding production
  • the server requests to obtain the data to be backed up, and the request may carry information on the data range of the data to be backed up in the corresponding production server and information on the initial backup rate.
  • the subtask creation module of the execution backup server After the subtask creation module of the execution backup server generates the request for obtaining the data to be backed up, it triggers its own transmission module to send the request to the corresponding transmission module of the execution production server.
  • the corresponding execution production server After the corresponding execution production server receives the above-mentioned data acquisition request to be backed up, it triggers its own acquisition module to acquire the data to be backed up from the production layer according to the information of the data range of the data to be backed up, and then transmits the acquired data to be backed up to the transmission module .
  • the corresponding execution production server sends the acquired data to be backed up to the transmission module of the corresponding execution backup server at the initial backup rate carried in the request through the transmission module.
  • the transmission module of the corresponding execution backup server After the transmission module of the corresponding execution backup server receives the data to be backed up sent by the execution production server, the data is transmitted to the processing module, and the processing module performs processing operations such as compression and deduplication on the data.
  • the above-mentioned processing module transmits the processed data to the backup module.
  • the above-mentioned backup module saves the received data in the backup memory.
  • the analysis module of the primary backup server may obtain data distribution information and resource consumption information from each production server of the production system every first preset time period, and then use the analysis module Analyze the newly acquired information. If the newly acquired information changes with the information acquired last time, the adjustment information of the corresponding backup subtask can be generated based on these changes, and the adjustment information will be sent to the corresponding through the subtask distribution module.
  • FIG. 6 is a backup and recovery processing method provided by an embodiment of the present invention.
  • the method can be implemented based on the system architecture shown in FIG. 2.
  • the method includes but is not limited to the following steps:
  • Step 601 The production server in the production system obtains first information.
  • Step 602 The production system sends the above-mentioned first information to the main backup server.
  • the above-mentioned first information may include the first resource consumption situation corresponding to each of the multiple production servers in the production system.
  • the first resource consumption situation of the production server may be the resource consumption situation of the production server at the moment when the first resource consumption situation is generated, and the resource consumption situation may include the processor CPU occupation situation, memory usage situation, and memory usage situation of the production server. The usage of external storage.
  • the specific method for obtaining the first information here may be the same as the method for obtaining the first preset information in the foregoing step 301, and may refer to the corresponding description, which will not be repeated here.
  • Step 603 The above-mentioned main backup server divides a plurality of backup and restoration subtasks according to the first information, and the backup and restoration subtasks correspond to an execution backup server and an execution production server.
  • Step 604 The above-mentioned main backup server sends the multiple backup and restoration subtasks to the respective execution backup servers.
  • the backup restoration subtask corresponds to an execution backup server and an execution production server, and is used to instruct the execution backup server to send a preset range of data to the execution production server, so that the data in the backup system is restored to the production system in.
  • the primary backup server analyzes the acquired first information, and divides multiple backup and recovery subtasks according to the analysis result.
  • Each divided backup and restoration subtask can correspond to a subtask identification number (identity document, ID), information about the backup server that executes the subtask (that is, the aforementioned execution backup server), and receives the data to be restored sent by the subtask.
  • the information of the production server that is, the above-mentioned execution production server
  • the range information of the data that this subtask needs to send to the execution production server for example, the size of the data to be restored, the corresponding file name, etc.
  • each divided backup and restoration subtask may also correspond to information on the initial backup and restoration rate of the subtask, and so on.
  • the initial backup restoration rate may be used to instruct the execution backup server corresponding to the subtask to send the data to be restored to the corresponding execution production server at the initial backup restoration rate.
  • the information of the aforementioned production server may include one or more of the name of the server, the media access control address, and the Internet protocol address.
  • the above-mentioned backup server information may include one or more of the server's name, media access control address, and Internet protocol address.
  • the corresponding execution backup server in each backup and restoration subtask obtained by division may be one, and the corresponding execution production server in each backup and restoration subtask obtained by division may be one or more That is, the subtask can only send the data that needs to be restored to one production server, or the subtask can also be responsible for sending the data to be restored to multiple production servers respectively.
  • Step 605 Each of the backup servers in the backup system receives corresponding backup and restoration subtasks.
  • Step 606 The slave backup server in the backup system sends data to the corresponding execution production server according to the received backup restoration subtask.
  • the main backup server since the multiple backup and restoration subtasks divided by the main backup server each correspond to the executed backup server, the main backup server sends the multiple backup and restoration subtasks according to the information of the respective execution backup server. Give the corresponding execution backup server.
  • the execution backup server here can be a slave backup server.
  • the execution backup server After the execution backup server receives the backup restoration subtask sent by the main backup server, it can obtain the data that the backup restoration subtask needs to send to the corresponding execution production server from the storage of the backup system according to the backup restoration subtask, and then transfer these data Sent to the corresponding execution production server.
  • the backup and restoration subtasks received by the execution backup server may also include information on the initial backup and restoration rate. Then, the execution backup server sends the data to be restored to the execution production server according to the initial backup and restoration rate.
  • a backup and restoration subtask corresponds to multiple execution production servers
  • the one backup and restoration subtask also correspondingly includes the information and/or the range of data to be restored that needs to be sent to the multiple execution production servers
  • Correspondence includes multiple initial backup and restoration rates of sending data to be restored to the multiple execution production servers.
  • the above-mentioned primary backup server can also be used as an execution backup server for the backup and restoration subtasks, that is, the primary backup server distributes one or more backup and restoration subtasks to itself for execution.
  • the main backup server sends the data to be restored to the corresponding execution production server according to the one or more backup and restoration subtasks.
  • the main backup server divides multiple backup and recovery subtasks according to the first information, including: the main backup server determines the load of the multiple production servers according to the first information; The primary backup server determines the data range that needs to be sent to the multiple production servers according to the load of the multiple production servers; the primary backup server divides the data range that needs to be sent to the multiple production servers according to the above needs, and divides the backup and recovery subtasks .
  • the heavier the load on the production server the less data to be restored from the backup server sent to the production server, and the lighter the load on the production server, the more data to be restored from the backup server to the production server.
  • the load distribution of each production server needs to send the data to be restored to each production server.
  • Table 7 exemplarily shows the resource consumption of each production server in the production system.
  • the primary backup server can divide the backup data restoration task of the above-mentioned production system into 4 backup restoration subtasks, each of which corresponds to a production server.
  • the execution production servers corresponding to subtask 1, subtask 2, subtask 3, and subtask 4 can be production server 1, production server 2, production server 3, and production server 4, respectively; subtask 1, subtask 2, subtask 3, and subtask 4
  • the execution backup servers corresponding to task 4 may be backup server 1, backup server 2, backup server 3, and backup server 4, respectively.
  • the main backup server is allocated to Subtask 1, subtask 2, subtask 3, and subtask 4 respectively correspond to the smaller and smaller ranges of the data to be restored sent to production server 1, production server 2, production server 3, and production server 4.
  • they can correspond to " 40G, File1", “30G, File2", “20G, File3" and "10G, File4".
  • Table 8 The information included in each subtask after the division is completed can be found in Table 8.
  • the above-mentioned embodiment of dividing the backup and restoration subtasks it is also possible to first divide the backup and restoration subtasks according to the load of the production server, regardless of the usage of the external storage of the production server. The lighter the load on the production server , The corresponding backup and restoration subtasks need to send more data to the production server. If the load of the two production servers is the same, then look at the usage of the production server's external storage. When the load conditions of two production servers are the same, the less external memory usage of the production server is, the more data that the production server's corresponding backup and restoration subtask needs to send to the production server. The specific data range to be sent can be determined according to the specific situation.
  • the above embodiments are all described by taking one backup and recovery subtask corresponding to one execution production server as an example.
  • one subtask may also correspond to multiple production servers.
  • the main backup server may divide 3 backup and restoration subtasks according to Table 7, subtask 1 and subtask. 2
  • the information included is unchanged as shown in Table 8.
  • the execution backup server corresponding to subtask 3 can be backup server 3, and the corresponding execution production server can be production server 3 and production server 4.
  • subtask 3 needs to be sent to be restored
  • the data range includes "20G, File3" and "10G, File4".
  • this is only an exemplary description, and the specific division can be determined according to the specific situation, which is not limited in this solution.
  • the primary backup server divides multiple backup and recovery subtasks according to the first information, including: the primary backup server determines the initial backup and recovery corresponding to each of the multiple production servers according to the first information
  • the above-mentioned initial backup and recovery rate is the initial rate at which the execution backup server sends data to the corresponding execution production server; the above-mentioned primary backup server allocates the respective initial backup and restoration rates of the above-mentioned multiple production servers to the respective corresponding ones of the above-mentioned multiple production servers.
  • Backup and restore subtasks are the first information that the primary backup server divides multiple backup and recovery subtasks according to the first information, including: the primary backup server determines the initial backup and recovery corresponding to each of the multiple production servers according to the first information
  • the above-mentioned initial backup and recovery rate is the initial rate at which the execution backup server sends data to the corresponding execution production server; the above-mentioned primary backup server allocates the respective initial backup and restoration rates of the above-mentioned multiple production servers to
  • the initial backup and restoration rate of subtask 4 is 100 bits per second.
  • thresholds can be set to determine the initial backup and recovery rate of each backup and recovery subtask. For example, if the CPU occupancy of the production server is less than or equal to 20%, then the initial rate of the backup and recovery subtask corresponding to the production server can be set to 1 megabit per second. If the CPU occupancy of the production server is greater than 20% and less than or equal to 40%, then the initial rate of the backup and restoration subtask corresponding to the production server can be set to 500 bits per second. If the CPU occupancy of the production server is greater than 40% and less than 60%, then the initial rate of the backup and restoration subtasks corresponding to the production server can be set to 200 bits per second.
  • the initial rate of the backup and restoration subtask corresponding to the production server can be set to 100 bits per second.
  • the backup and recovery rate There are other embodiments for determining the backup and recovery rate, such as determining the corresponding backup and recovery rate based on the memory usage of the production server, etc., the specific determination method Determined according to the specific situation, this plan does not impose restrictions on this.
  • the above example of setting the initial rate of backup and recovery is introduced in the case that one backup and recovery subtask corresponds to one production server. If a backup and recovery subtask corresponds to multiple production servers, it can be based on the multiple The respective resource consumption of the production server sets their respective initial backup and recovery rates, that is, the backup and recovery subtasks correspond to multiple initial backup and recovery rates.
  • the primary backup server after the primary backup server receives the first information, before the entire backup restoration process is completed, the primary backup server will obtain the latest information every second preset period of time. It may include one or more of the latest resource consumption information in the above-mentioned production system, and may also include the latest health status of each production server in the above-mentioned production system and/or the latest health status of each backup server in the above-mentioned backup system . Then analyze this information to generate the adjustment information of the corresponding backup and recovery subtasks, which are used to adjust some parameters in the backup and recovery process to ensure that the production service of the production server and the backup and recovery operations of the backup server can be performed at the same time, and will not affect the production server. produce.
  • the primary backup server can start from the production every second preset period of time. Obtain the latest resource consumption in the system to adjust some parameters of the backup and recovery process to achieve the purpose of both backup and production.
  • the aforementioned preset duration may be five minutes, ten minutes, half an hour, etc.
  • the specific preset duration is determined according to specific circumstances, and this solution does not limit this.
  • the second preset duration may be the same as or different from the first preset duration.
  • the information obtained by the primary backup server every second preset period of time may be obtained by directly interacting with the production system, or it may be sent to the primary backup server by other devices after obtaining the information from the production system. .
  • the second information is obtained after the second preset time interval as an example to describe how to generate adjustment information corresponding to the backup and restoration subtasks based on the information.
  • the second information includes one or more of the second resource consumption information and the health status information of the server.
  • the second resource consumption information may include the latest resource consumption information in the above-mentioned production system, and the information may be the resource consumption status of each production server in the production system at the time when the second resource consumption information is generated; the health of the server
  • the status information may include the latest health status of each production server in the above-mentioned production system and/or the latest health status of each backup server in the above-mentioned backup system, which may be the time when the server's health status information is acquired in the above-mentioned production system The health status of each production server and/or the health status of each backup server in the aforementioned backup system.
  • the processing method of the information such as the latest resource consumption in the production system that is obtained every second preset time period after the second information is obtained can be the same.
  • Step 701 The above-mentioned production system obtains second information.
  • Step 702 The above-mentioned production system sends the above-mentioned second information to the main backup server.
  • the manner in which the above-mentioned production system obtains the second information may be the same as the manner in which the above-mentioned first information is obtained.
  • the second information includes the health status of each production server in the above-mentioned production system and/or the health status of each backup server in the above-mentioned backup system
  • each production server of the production system can obtain its own health status and send it separately
  • a certain server or device for example, a server dedicated to monitoring the health status of each production server in the production system collects the health status information in the production system, and then centralizes it by a server in the production system Sent to the main backup server.
  • the primary backup server can actively collect the health status of each backup server in the backup system. For example, it can send a health status acquisition request to the backup server. After receiving the request, the backup server obtains its own health status information and sends it to the primary backup server; or , There is a server dedicated to monitoring the health status of each backup server in the backup system, and the primary backup server can obtain the health status of each backup server from the server.
  • Step 703 In the case where the primary backup server analyzes the target backup and restore subtasks among the multiple backup and restore subtasks based on the second information to be adjusted, the primary backup server generates a response to the backup and restore subtasks according to the second information. The adjustment information of the target backup and restoration subtasks.
  • Step 704 The above-mentioned primary backup server sends the adjustment information to the execution backup server corresponding to the target backup and restoration subtask.
  • the acquired second preset information includes the second resource consumption information, it includes the processor CPU corresponding to each production server in the production system when the second resource consumption information is acquired. Occupancy, memory usage, external storage, etc. Then the primary backup server can compare this information with the above-mentioned first information.
  • the information of each production server included in the second resource consumption information is compared with the information of each production server included in the first information with the production server as the object, that is, the data acquired by the same production server at different times
  • the information of the first production server included in the second resource consumption information is compared with the information of the first production server included in the first information
  • the information of the second production server included in the second resource consumption information is compared with the first information including The information of the second production server is compared and so on.
  • the main backup can generate the production according to the changed situation
  • the adjustment information of the backup and restoration subtask corresponding to the server, and the generated adjustment information is sent to the corresponding execution backup server.
  • the second resource consumption information and the first information may be analyzed and compared to determine whether to adjust the range of data that needs to be sent to the corresponding execution production server in the backup and restoration subtask.
  • the CPU occupancy of the first production server is 10%, but in the second resource consumption information, the CPU occupancy of the first production server is 50%, that is, after obtaining the first information, obtain Before the second resource consumption information, the CPU occupancy of the first production server has increased by 50%, that is, during this period of time, the production load of the first production server has increased.
  • the primary backup server can reduce the range of the data to be restored sent to the first production server, and then generate the first production server.
  • the adjusted range of the data that needs to be sent to the first production server after the adjustment of the backup and restoration subtask corresponding to the production server. And send the adjusted data range information to the corresponding execution backup server.
  • the primary backup server can increase the range of the data to be restored sent to the first production server, and then Generate the adjusted data range that needs to be sent to the first production server of the backup and restoration subtask corresponding to the first production server. And send the adjusted data range information to the corresponding execution backup server.
  • the adjustment of the above data range can also be determined in conjunction with the memory usage of the server. The more memory is used, the heavier the load, and the smaller the range of data to be recovered from the production server can be set. The less used and the lighter the load, the larger the range of data to be restored received by the production server can be set.
  • the CPU occupancy of the first production server is 10%, but in the second resource consumption information, the CPU occupancy of the first production server is 50%, that is, after obtaining the first information, obtain Before the second resource consumption information, the CPU occupancy of the first production server has increased by 50%, that is, during this period of time, the production load of the first production server has increased.
  • the primary backup server may reduce the rate at which the first production server receives the data to be restored from the corresponding execution backup server. That is, reduce the rate at which the corresponding execution backup server sends the data to be restored to the first production server, and then generate the adjusted backup restoration rate of the backup restoration subtask corresponding to the first production server. And send the adjusted backup recovery rate to the corresponding execution backup server.
  • the primary backup server can receive the data to be restored from the corresponding execution backup server for the first production server. Increase, that is, increase the rate at which the corresponding execution backup server sends the data to be restored to the first production server, and then generate the adjusted backup restoration rate of the backup and restoration subtask corresponding to the first production server. And send the adjusted backup recovery rate to the corresponding execution backup server.
  • the adjusted backup recovery rate can be determined by setting a threshold. For example, after comparing the resource consumption obtained two times above, if the CPU occupancy of the production server increases by 10% to 20%, the primary backup server can use this The rate at which the first production server sends the data to be backed up to the corresponding execution backup server is reduced by 20%, that is, assuming that the initial backup recovery rate is 1 Mbits per second, after reducing it by 20%, it will be 800 bits per second. If the CPU occupancy of the production server is reduced by 10% to 20%, the primary backup server can increase the rate at which the first production server sends the data to be backed up to the corresponding backup server by 20%, that is, assume that the initial backup recovery rate is 1. Megabits per second, after increasing by 20%, it will be 1.2 Megabits per second. It is hereby explained that this is just an example, and there are other threshold settings. The specific setting depends on the specific situation, and this solution does not limit this.
  • the above adjustment and determination of the backup and recovery rate can also be determined in conjunction with the memory usage of the server.
  • the primary and backup server can report to The to-be-recovered data sent by a certain production server is sent to other running production servers to ensure that the entire data recovery process is completed.
  • the main backup server adjusts the execution production server in the backup and restoration subtask corresponding to the production server to other normally running production servers, then generates the adjusted production server information, and sends the adjusted production server information Perform the backup server corresponding to the backup and restore subtask. It should be noted that the adjusted execution production server has sufficient performance and storage space to receive the data to be restored from the failed production server.
  • the primary backup server can The backup and restoration sub-tasks of the failed execution backup server are assigned to other execution backup servers that are running normally to continue execution to ensure that the entire backup process is completed smoothly on time. Specifically, the primary backup server adjusts the execution backup server in the backup and restoration subtask corresponding to the certain execution backup server to other normally running backup servers, and then generates the adjusted backup server information, and then the adjusted backup server The information and the backup and restoration subtask are sent to the execution backup server corresponding to the backup and restoration subtask.
  • Step 705 The above-mentioned corresponding execution backup server receives the adjustment information.
  • Step 706 The above-mentioned corresponding execution backup server sends data to the execution production server corresponding to the adjusted target backup and restoration subtask according to the adjustment information.
  • the corresponding execution backup server After the corresponding execution backup server receives the above adjustment information, it analyzes the adjustment information. If the adjustment information includes adjusted range information for sending data to be restored to the corresponding execution production server, then the backup server The range information sends data to the corresponding execution production server. If the adjustment information includes the adjusted backup recovery rate information, the backup server sends data to the corresponding execution production server at the backup recovery rate. If the adjustment information includes the adjusted information of the corresponding execution production server, the backup server sends data to the adjusted execution production server according to the information.
  • FIG. 8 is a schematic diagram of a system library framework suitable for a backup processing method provided by an embodiment of the application.
  • the schematic diagram of the system framework shown in FIG. 8 may be a schematic diagram of a specific framework of the system framework shown in FIG. 1.
  • the system framework shown in Figure 8 can be the same as the system framework shown in Figure 5.
  • the process shown in Figure 5 is based on the framework to complete the process of data backup, and the process shown in Figure 8 is based on the framework to complete the process of backup and recovery .
  • the system includes a production system and a backup system.
  • the production system can include three production servers (production server 1, production server 2 and production server 3), and each production server includes a monitoring module, a production layer, an acquisition module, and a transmission module;
  • the backup system can include three backup servers ( Backup server 1, backup server 2 and backup server 3), scheduler and backup storage.
  • Each backup server includes a parent task creation module, an analysis module, a child task distribution module, a child task creation module, a transmission module, a processing module, and a backup module .
  • the backup server 1 is the master backup server, and the backup server 2 and the backup server 3 are slave backup servers.
  • the primary backup server may be any one or more of the multiple backup servers in the backup system, and may be determined by the scheduler.
  • the monitoring module in the production server used to monitor and acquire the resource consumption in the production server in real time, and send the acquired situation information to the primary backup server.
  • the production layer in the production server mainly used for production data.
  • Transmission module in the production server used to receive the data to be restored from the backup server.
  • the scheduler in the backup system used to schedule each backup server to backup and restore the data in the production system.
  • the parent task creation module of the backup server used to create a backup parent task, which is mainly used to complete two major tasks. One is to write the name and ID of the production system, the timestamp of this backup and restoration, etc. to the backup storage; the other is to analyze the resource consumption in the production server obtained from the production system, and then Divide subtasks and distribute subtasks.
  • the analysis module of the backup server It is used to receive and analyze the information sent by the monitoring module in the production server. It can determine the distribution of subtasks, the corresponding relationship between each subtask and the production server, and the relationship between each subtask and the production server according to the load of the production server and the use of external storage.
  • the task is responsible for the scope of the data sent, real-time adjustment of the scope of responsibility of each subtask and the life cycle of the subtask, and so on. It can also be used to analyze the information sent by the monitoring module in the production server in real time, and generate adjustment information for the corresponding subtasks.
  • the subtask distribution module of the backup server used to distribute the divided subtasks to the backup servers in the backup system, and can also send the adjustment information of the subtasks to the corresponding backup server in real time.
  • the subtask creation module of the backup server used to create a backup and restore subtask according to the received backup and restore subtask creation instruction, and then send the data to be restored to the corresponding production server; it can also be used to receive real-time subtask adjustment information, And adjust the execution of subtasks according to the adjusted information.
  • Transmission module of the backup server a transmission module used to obtain the data to be restored from the backup storage and transmit it to the corresponding production server.
  • the following exemplarily introduces the flow of the backup and recovery processing method provided by the embodiment of the present application with reference to FIG. 8.
  • the method may include the following steps:
  • the parent task creation module of the backup server 1 receives the backup and recovery instruction sent by the scheduler, which is used to instruct to issue the backup and recovery task of the data of the production system to the backup server 1, that is, the backup server 1 will be the main backup server ,
  • Other servers (backup server 2 and backup server 3) act as slave servers to assist the master backup service to complete the backup and recovery of the data of the production system.
  • the parent task creation module After the above-mentioned backup and restore instruction, it generates a backup and restore parent task according to the instruction, and triggers the analysis module to obtain resource consumption information in the production system, and can also obtain data storage type information of the production system.
  • the analysis module sends an information acquisition instruction to each production server in the production system in response to the trigger of the parent task creation module.
  • the information acquisition instruction is used to trigger the monitoring module to acquire the resource consumption information in the production server, and it can also acquire the data storage of the production system. Type information.
  • each production server After each production server receives the information acquisition instruction sent by the analysis module, it triggers the monitoring module to acquire its resource consumption information and sends it to the analysis module. It can also obtain the data storage type information of the production system and send it to the analysis module.
  • 5Analysis module is based on the received resource consumption information of each production server, and can also be based on the data storage type information received from the production system, and at the same time, combined with the situation of each backup server (such as the number of backup servers, the performance of each backup server, etc. ) Divide multiple backup and recovery subtasks.
  • Each backup and restoration subtask corresponds to information such as identification number, execution backup server, execution production server, data range responsible for backup and restoration, and initial performance indicators such as initial backup and restoration rate.
  • the analysis module After the analysis module divides multiple backup and recovery subtasks, it triggers the subtask distribution module to send subtask creation instructions to the execution backup servers corresponding to each backup and recovery subtask (ie, backup server 1, backup server 2, and backup server 3).
  • the instructions can carry information included in the corresponding backup and restoration subtasks, such as identification number, execution backup server, execution production server, data range responsible for backup and restoration, and initial performance indicators such as initial backup and restoration rate.
  • each execution backup server receives the subtask creation instruction sent by the subtask distribution module of the main backup server, it triggers the respective subtask creation module to create the subtask, and then triggers the respective transmission module to store the subtasks according to the subtasks created by them. Among them, the data to be recovered is obtained.
  • the transmission module of each execution backup server sends the acquired data to the corresponding transmission module of the execution production server.
  • the transmission modules of each production server store the corresponding received data in their corresponding storage; if the data storage type of the production system is a shared type, the data storage type of each production server The transmission module stores the corresponding received data in the shared memory.
  • the analysis module of the primary backup server can obtain resource consumption information from each production server of the production system every second preset time period, and then analyze the latest acquisition through the analysis module If the newly acquired information changes with the information acquired last time, the adjustment information of the corresponding backup and restoration subtask can be generated according to these changes, and the adjustment information will be sent to the corresponding execution backup through the subtask distribution module
  • the subtask creation module of the server, and then the corresponding execution backup server subtask creation module sends the data to be restored to the corresponding execution production server through the transmission module according to the adjustment information, so that the corresponding production server can restore the backup data .
  • each server such as a master backup server, a slave backup server, and a production server, includes hardware structures and/or software modules corresponding to each function in order to realize the above-mentioned functions.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
  • the embodiment of the application can divide the functional modules of the primary backup server, the secondary backup server, and the production server according to the above method examples.
  • each functional module can be divided corresponding to each function, or two or more functions can be integrated In a processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of modules in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • FIG. 9 shows a schematic diagram of a possible logical structure of the primary backup server involved in the above embodiment.
  • the primary backup server 900 includes: a sending unit 901, a receiving unit 902 ⁇ unit 903.
  • the sending unit 901 is configured to support the primary backup server to execute the steps of the primary backup server sending information in the method embodiments shown in FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof.
  • the receiving unit 902 is configured to support the primary backup server to execute the steps of the primary backup server receiving or acquiring information in the method embodiments shown in FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof.
  • the processing unit 903 is used to support the main backup server to execute the steps of dividing backup subtasks, generating information, adjusting information, and other steps in the method embodiment shown in FIG. 3, FIG. 4, or FIG. 5 and its possible implementation manners. Steps other than the steps performed by the transmitting unit 901 and the receiving unit 902, etc.
  • the primary backup server 900 may also include a storage unit for storing computer programs or data.
  • the processing unit 903 may call the computer program or data of the storage unit, so that the main backup server 900 obtains the first preset information; the first preset information includes the first data distribution information and the first resource consumption One or more items in the information; the first data distribution information includes the first distribution of the data to be backed up in the production system; the production system includes multiple production servers; the first resource consumption information includes the multiple The first resource consumption situation corresponding to each of the production servers; then, a plurality of backup subtasks are divided according to the first preset information; the backup subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution of the backup The server backs up the data to be backed up in the target range of the execution production server; the execution backup server includes a backup server in the backup system; the execution production server includes one or more production servers in the production system; and The multiple backup subtasks are sent to the respective execution backup servers.
  • the primary backup server 900 may also include a storage unit for storing computer programs or data.
  • the processing unit 903 may call the computer program or data of the storage unit, so that the main backup server 900 obtains the first information; the first information includes the third resource consumption corresponding to each of the multiple production servers in the production system.
  • the backup and recovery subtasks correspond to an execution backup server and an execution production server, and are used to instruct the execution backup server to send a preset to the execution production server Range of data;
  • the execution backup server includes the backup server in the backup system;
  • the execution production server includes one or more production servers in the production system; then, the multiple backup restoration subtasks are sent Give each corresponding execution backup server.
  • the aforementioned processing unit 903 may be a processor or a processing circuit.
  • the sending unit 901 and the receiving unit 902 may be coupled as a transceiver or a transceiver circuit or an interface circuit.
  • the storage unit may be a memory. The above-mentioned processing unit, sending unit, receiving unit, and storage unit may be integrated or separated.
  • FIG. 10 shows a schematic diagram of a possible hardware structure of the primary backup server involved in the above-mentioned embodiments provided by the embodiments of this application.
  • the primary backup server 1000 may include: one or more processors 1001, one or more memories 1002, and a communication module 1003 (for example, it may be one or more transceivers). These components can be connected through the bus 1004 or in other ways.
  • FIG. 10 takes the connection through the bus as an example. among them:
  • the communication module 1003 may be used to send information or requests generated by the processor 1001, such as generated backup subtasks or requests for obtaining data to be backed up.
  • the communication module 1003 can also be used for received data, such as data distribution information of the production system or data to be backed up.
  • the memory 1002 may be coupled with the processor 1001 through a bus 1004 or an input/output port, and the memory 1002 may also be integrated with the processor 1001.
  • the memory 1002 is used to store various software programs and/or multiple sets of instructions or data.
  • the memory 1002 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • the memory 1002 can store an operating system (hereinafter referred to as the system), such as embedded operating systems such as uCOS, VxWorks, and RTLinux.
  • the processor 1001 may be a central processing unit, a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application.
  • the processor may also be a combination for realizing certain functions, for example, including a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on.
  • the processor 1001 may be used to read and execute computer-readable instructions. Specifically, the processor 1001 may be used to call a program stored in the memory 1002, such as a program for implementing the backup processing method provided by one or more embodiments of the present application on the main backup server 1000 side, and execute instructions contained in the program.
  • a program stored in the memory 1002 such as a program for implementing the backup processing method provided by one or more embodiments of the present application on the main backup server 1000 side, and execute instructions contained in the program.
  • the primary backup server 1000 shown in FIG. 10 is only an implementation of the embodiment of the present application. In actual applications, the primary backup server 1000 may also include more or fewer components, which is not limited here.
  • the primary backup server 1000 reference may be made to the relevant descriptions in the method embodiments shown in the foregoing FIG. 3, FIG. 4, or FIG. 5 and possible implementation manners thereof, and details are not described herein again.
  • FIG. 11 shows a schematic diagram of a possible logical structure of the secondary backup server involved in the above embodiment.
  • the secondary backup server 1100 includes: a sending unit 1101, a receiving unit 1102 ⁇ unit 1103.
  • the sending unit 1101 is configured to support the execution of the step of sending information from the backup server in the method embodiment shown in FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof from the backup server.
  • the receiving unit 1102 is configured to support the execution of the steps of receiving information from the backup server in the method embodiment shown in FIG. 3, FIG. 4, or FIG. 5 and possible implementation manners thereof from the backup server.
  • the processing unit 1103 is configured to support the execution of the steps of adjusting information from the backup server in the method embodiment shown in FIG. 3, FIG. 4, or FIG. 5 and its possible implementations from the backup server, as well as the execution of the sending unit 1101 and the receiving unit 1102 Steps other than the steps above and so on.
  • the secondary backup server 1100 may further include a storage unit for storing computer programs or data.
  • the processing unit 1103 may call the computer program or data of the storage unit, so that the backup subtask sent by the main backup server is received from the backup server 1100, and the backup subtask corresponds to the execution production server for Instruct the first backup server to back up the data to be backed up in the target range of the execution production server; the execution production server is a server in the production system; then, according to the backup subtask, send the execution production server to be backed up Data acquisition request; the data acquisition request to be backed up includes information about the data range to be backed up; then, the data to be backed up sent by the execution production server is received.
  • the secondary backup server 1100 may further include a storage unit for storing computer programs or data.
  • the processing unit 1103 may call the computer program or data of the storage unit, so as to receive from the backup server 1100 a backup and restoration subtask sent by the primary backup server, and the backup and restoration subtask corresponds to an execution production server, Used to instruct the first backup server to send a preset range of data to the execution production server; the execution production server is a server in the production system; the first backup server is a slave backup server in the backup system ; Then, send the preset range of data to the execution production server according to the backup and restoration subtask.
  • the aforementioned processing unit 1103 may be a processor or a processing circuit.
  • the sending unit 1101 and the receiving unit 1102 may be coupled as a transceiver or a transceiver circuit or an interface circuit.
  • the storage unit may be a memory. The above-mentioned processing unit, sending unit, receiving unit, and storage unit may be integrated or separated.
  • FIG. 12 shows a schematic diagram of a possible hardware structure of the secondary backup server involved in the above-mentioned embodiments provided by the embodiments of this application.
  • the secondary backup server 1200 may include: one or more processors 1201, one or more memories 1202, and a communication module 1203 (for example, one or more transceivers). These components can be connected through the bus 1204 or in other ways.
  • FIG. 12 takes the connection through the bus as an example. among them:
  • the communication module 1203 may be used to send a request generated by the processor 1201, such as a generated request for obtaining data to be backed up.
  • the communication module 1203 can also be used to receive information and data, such as information of backup subtasks and data to be backed up.
  • the memory 1202 may be coupled with the processor 1201 through a bus 1204 or an input/output port, and the memory 1202 may also be integrated with the processor 1201.
  • the memory 1202 is used to store various software programs and/or multiple sets of instructions or data.
  • the memory 1202 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • the memory 1202 may store an operating system (hereinafter referred to as the system), such as embedded operating systems such as uCOS, VxWorks, and RTLinux.
  • the processor 1201 may be a central processing unit, a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application.
  • the processor may also be a combination for realizing certain functions, for example, including a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on.
  • the processor 1201 may be used to read and execute computer-readable instructions. Specifically, the processor 1201 may be used to call a program stored in the memory 1202, for example, the implementation program of the backup processing method provided by one or more embodiments of the present application on the side of the backup server 1200, and execute the instructions contained in the program.
  • the secondary backup server 1200 shown in FIG. 12 is only an implementation of the embodiment of the present application. In practical applications, the secondary backup server 1200 may also include more or fewer components, which is not limited here.
  • the slave backup server 1200 reference may be made to related descriptions in the method embodiments shown in the foregoing FIG. 3, FIG. 4, or FIG. 5 and possible implementation manners thereof, and details are not described herein again.
  • the slave backup server 1200 reference may be made to the relevant descriptions in the method embodiments shown in the foregoing FIG. 6, FIG. 7 or FIG. 8 and possible implementation manners thereof, which will not be repeated here.
  • FIG. 13 shows a schematic diagram of a possible logical structure of the production server involved in the above embodiment.
  • the production server 1300 includes: a sending unit 1301, a receiving unit 1302, and a processing unit. Unit 1303.
  • the sending unit 1301 is configured to support the production server to execute the steps of the production server sending information in the method embodiments shown in FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof.
  • the receiving unit 1302 is configured to support the production server to execute the steps of receiving information by the production server in the method embodiment shown in FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof.
  • the processing unit 1303 is configured to support the production server to obtain the data to be backed up, obtain the distribution information of the data to be backed up, or obtain the resource consumption of the production server in the method embodiment shown in FIG. 3, FIG. 4, or FIG. 5 and its possible implementations. Steps of the situation, and steps other than the steps performed by the sending unit 1301 and the receiving unit 1302, etc.
  • the production server 1300 may further include a storage unit for storing computer programs or data.
  • the processing unit 1303 may call the computer program or data of the storage unit, so that the production server 1300 obtains first preset information, where the first preset information includes first data distribution information and first resource consumption information One or more of; the first data distribution information includes the first distribution of the data to be backed up in the first production server; the first resource consumption information includes the first resources of the first production server Consumption; then, sending the first preset information to the main backup server; the first preset information is used to enable the main backup server to divide multiple backup subtasks according to the first preset information, the The backup subtask corresponds to an execution backup server and an execution production server, and is used to instruct the execution backup server to back up the data to be backed up in the target range of the execution production server; the main backup server is the server of the backup system, and the backup system It includes one or more master backup servers and one or more slave backup servers for backing up the data of the production system.
  • the production server 1300 may further include a storage unit for storing computer programs or data.
  • the processing unit 1303 may call the computer program or data of the storage unit, so that the production server 1300 obtains the first information; the first information includes the first resource consumption status corresponding to each of the multiple production servers; Then, the first information is sent to the main backup server; the first information is used to enable the main backup server to divide a plurality of backup and restoration subtasks according to the first information, and the backup and restoration subtasks correspond to performing backup
  • the server and the execution production server are used to instruct the execution backup server to send a preset range of data to the execution production server;
  • the primary backup server is a server of the backup system, and the backup system includes one or more primary backup servers And one or more secondary backup servers.
  • the aforementioned processing unit 1303 may be a processor or a processing circuit.
  • the sending unit 1301 and the receiving unit 1302 may be coupled as a transceiver or a transceiver circuit or an interface circuit.
  • the storage unit may be a memory. The above-mentioned processing unit, sending unit, receiving unit, and storage unit may be integrated or separated.
  • FIG. 14 shows a schematic diagram of a possible hardware structure of the production server involved in the foregoing embodiment provided by the embodiment of this application.
  • the production server 1400 may include: one or more processors 1401, one or more memories 1402, and a communication module 1403 (for example, one or more transceivers). These components can be connected through a bus 1404 or in other ways.
  • FIG. 14 uses a bus connection as an example. among them:
  • the communication module 1403 may be used to send a request generated by the processor 1401, for example, a generated request for obtaining data to be backed up.
  • the communication module 1403 can also be used to receive information and data, such as information about backup subtasks and data to be backed up.
  • the memory 1402 may be coupled with the processor 1401 through a bus 1404 or an input/output port, and the memory 1402 may also be integrated with the processor 1401.
  • the memory 1402 is used to store various software programs and/or multiple sets of instructions or data.
  • the memory 1402 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • the memory 1402 can store an operating system (hereinafter referred to as the system), such as embedded operating systems such as uCOS, VxWorks, and RTLinux.
  • the processor 1401 may be a central processing unit, a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of this application.
  • the processor may also be a combination for realizing certain functions, for example, a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on.
  • the processor 1401 may be used to read and execute computer-readable instructions. Specifically, the processor 1401 may be used to call a program stored in the memory 1402, such as a program for implementing the backup processing method provided by one or more embodiments of the present application on the production server 1400 side, and execute instructions contained in the program.
  • a program stored in the memory 1402 such as a program for implementing the backup processing method provided by one or more embodiments of the present application on the production server 1400 side, and execute instructions contained in the program.
  • the production server 1400 shown in FIG. 14 is only an implementation manner of the embodiment of the present application. In actual applications, the production server 1400 may also include more or fewer components, which is not limited here.
  • the production server 1400 reference may be made to related descriptions in the method embodiments shown in the foregoing FIG. 3, FIG. 4, or FIG. 5 and possible implementation manners thereof, and details are not repeated here.
  • the specific implementation of the production server 1400 reference may be made to related descriptions in the method embodiments shown in the foregoing FIG. 6, FIG. 7 or FIG. 8 and possible implementation manners thereof, and details are not described herein again.
  • the embodiment of the present invention also provides a backup processing system, including a production system and a backup system, the production system includes multiple production servers, and the backup system includes one or more master backup servers and one or more slave backup servers;
  • the primary backup server may be the server described in FIG. 9 or FIG. 10
  • the secondary backup server may be the server described in FIG. 11 or FIG. 12
  • the production server may be the server described in FIG. 13 or FIG. 14.
  • the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the foregoing FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof The method embodiment.
  • the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the foregoing FIG. 6, FIG. 7 or FIG. 8 and possible implementations thereof The method embodiment.
  • the embodiment of the present invention also provides a computer program product.
  • the computer program product is read and executed by a computer, the method embodiments described in the foregoing FIG. 3, FIG. 4, or FIG. 5 and possible implementation manners thereof can be realized.
  • the embodiment of the present invention also provides a computer program product.
  • the computer program product is read and executed by a computer, the method embodiments described in the foregoing FIG. 6, FIG. 7 or FIG. 8 and possible implementation manners thereof can be realized.
  • the embodiment of the present invention also provides a computer program.
  • the computer program When the computer program is executed on a computer, the computer will enable the computer to implement the method embodiments described in FIG. 3, FIG. 4, or FIG. 5 and possible implementations thereof.
  • the embodiment of the present invention also provides a computer program.
  • the computer program When the computer program is executed on a computer, the computer will enable the computer to implement the method embodiments described in FIG. 6, FIG. 7 or FIG. 8 and possible implementations thereof.
  • the embodiment of the present application divides the data backup task of the entire production system into multiple tasks based on the analysis result of the data distribution information and/or resource consumption information obtained in advance in the production system. Each backup subtask corresponds to the data range responsible for backup, and then distributes these backup subtasks to their respective execution backup services for data backup, which can improve the efficiency of backup and reduce the burden on the production server.
  • the embodiment of the present application makes full use of each backup server of the backup system to back up data, thereby greatly improving the backup. s efficiency.

Abstract

一种备份处理方法及服务器,该方法应用于备份系统,所述备份系统包括多个备份服务器;该方法包括:所述多个备份服务器中的主备份服务器将备份任务划分为多个备份子任务;所述主备份服务器将每个备份子任务分配给所述多个备份服务器中的每个备份服务器;所述主备份服务器将所述多个备份子任务发送给各自对应的备份服务器。采用本方法,能够提高数据备份的速率。

Description

备份处理方法及服务器 技术领域
本发明涉及数据备份技术领域,尤其涉及一种备份处理方法及服务器。
背景技术
在云计算和大数据时代,需要备份的数据形态越来越广泛。比如需要备份存储阵列上达到256TB的超大逻辑单元号(logical unit number,LUN),基于共享存储的多服务器多活的集群系统如甲骨文实时应用集群(oracle real application clusters,Oracle RAC),为大数据系统服务的分布式数据系统比如卡桑德拉Cassandra数据库等。这些生产系统的特点包括:1)单对象单次备份数据量很大;2)待备份对象生产系统是多服务器系统;3)待备份数据在多服务器上数据分布不同;4)生产系统各个服务器的负载不同。
现有的数据备份方法中,例如可以参见图1,图1为现有备份方法的一个系统架构示意图。在图1中可以看到,每个生产服务器上的数据量是不同的,但现有的备份方法是简单地要求从每一个生产服务器上获取等量的待备份数据进行备份,导致了生产系统内生产服务器之间数据的内部转发,增加生产服务器的处理负担的同时还影响数据备份的速率。此外,在图1中还可以看到,现有的备份方法中只使用备份系统中的一个备份服务器对生产系统的数据进行备份,其它的备份服务器则被闲置,导致资源的浪费,同时还导致备份的速率低下。
综上所述,如何充分利用资源提高数据备份速率是本领域人员需要解决的问题。
发明内容
本发明实施例公开了一种备份处理方法及服务器,能够避免资源的浪费,提高数据备份的速率。
第一方面,本发明实施例提供了一种备份处理方法,该方法应用于备份系统,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;该方法包括:
所述多个备份服务器中的主备份服务器将备份任务划分为多个备份子任务;所述主备份服务器将每个备份子任务分配给所述多个备份服务器中的每个备份服务器;所述主备份服务器将所述多个备份子任务发送给各自对应的备份服务器。
在其中一种可能的实施方式中,上述主备份服务器获取第一预设信息;上述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;上述第一数据分布信息包括生产系统中待备份数据的第一分布情况;上述生产系统包括多个生产服务器;上述第一资源消耗信息包括上述多个生产服务器各自对应的第一资源消耗情况;上述主备份服务器根据上述第一预设信息划分多个备份子任务;上述备份子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述执行备份服务器包括上述备份系统中的备份服务器,上述执行生产服务器包括上述生产系统中的一个或多个生产服务器;上述主备份服务器将上述多个备份子任务发送给各自对应的执行备份服务器。
在本申请实施例中,相比于现有技术在不了解生产系统的信息的情况下,采用简单的均衡策略要求从每一个生产服务器上获取等量的待备份数据进行备份,本申请实施例根据对预先获取生产系统中的数据分布信息和/或资源消耗信息的分析结果将对整个生产系统的数据备份任务划分为多个备份子任务,每个备份子任务对应有负责备份的数据范围,然后将这些 备份子任务分发给各自对应执行备份服务进行数据备份,能够提高备份的效率,减轻生产服务器的负担。此外,相比于现有技术只使用备份系统中的一个备份服务器对整个生产系统的数据进行备份,本申请实施例充分利用了备份系统的各个备份服务器对数据进行备份,从而极大地提高了备份的效率。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一数据分布信息,上述主备份服务器根据上述第一预设信息划分多个备份子任务,包括:上述主备份服务器根据上述第一数据分布信息划分上述多个备份子任务;上述目标范围的待备份数据包括根据上述第一数据分布信息中上述执行生产服务器的待备份数据的分布情况确定的数据。
在本身申请实施例中,由于获取了生产系统中每一个生产服务器上待备份数据的信息,那么在进行待备份数据获取时,可以只要求从目标生产服务器中获取该服务器有的待备份数据,避免了现有技术中需要向其它生产服务器获取该目标服务器没有的待备份数据来发送给备份服务器的问题,从而避免了生产服务器之间的内部转发,减轻了生产服务器的处理负担,同时,由于不需要向其它服务器获取信息,从而可以提高备份的速率。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一资源消耗信息,上述主备份服务器根据上述第一预设信息划分多个备份子任务,包括:上述主备份服务器根据上述第一资源消耗信息划分上述多个备份子任务;上述备份子任务包括一个或多个初始备份速率的信息,上述一个或多个初始备份速率为根据上述第一资源消耗信息中上述备份子任务对应的一个或多个生产服务器的资源消耗情况对应设置的备份初始速率,上述初始备份速率的信息用于指示以上述初始备份速率从上述初始备份速率对应的生产服务器中获取数据。
在本申请实施例中,可以通过生产服务器的资源消耗情况设置备份服务器从该生产服务器中获取待备份数据的速率,可以在生产服务器的资源消耗较多的情况下,设置较低的速率,在资源消耗较少的情况下,设置较高的速率,因此,通过本申请实施例可以有效地保证在不影响生产服务器的生产服务的情况下完成备份任务。
在其中一种可能的实施方式中,上述主备份服务器将上述多个备份子任务发送给各自对应的执行备份服务器之后,还包括:上述主备份服务器获取第二预设信息;上述第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中一项或多项;上述第二数据分布信息包括上述生产系统中待备份数据的第二分布情况;上述第二资源消耗信息包括上述多个生产服务器各自对应的第二资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,上述主备份服务器根据上述第二预设信息生成针对上述目标备份子任务的调整信息,上述调整信息用于指示上述目标备份子任务对应的执行备份服务器根据上述调整信息进行数据备份;上述主备份服务器将上述调整信息发送给上述目标备份子任务对应的执行备份服务器。
在本申请实施例中,主备份服务器可以实时获取生产系统中的数据分布情况、资源消耗情况等信息,然后分析这些新获取的信息与上一次获取的信息的变化关系,如果对应的生产服务器的信息出现了变动,那么可以对应生成调整信息,使得对应的执行备份服务器根据该调整信息调整备份的参数(例如待备份数据范围或备份速率)等。通过本申请实施例,可以实时调整备份过程中的备份参数,保证生产和备份这两个过程都能顺利进行。
在其中一种可能的实施方式中,上述第二预设信息包括上述第二数据分布信息,上述在 根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,上述主备份服务器根据上述第二预设信息生成针对上述目标备份子任务的调整信息,包括:在根据上述第二数据分布信息分析出上述目标备份子任务的待备份数据范围有变动的情况下,上述主备份服务器根据上述第二数据分布信息中上述目标备份子任务对应的执行生产服务器的数据分布情况,生成针对上述目标备份子任务的调整后的待备份数据范围。
本申请实施例可以根据新获取的数据分布信息调整备份子任务的待备份数据范围,以保证可以完全获取待备份的数据。
在其中一种可能的实施方式中,上述第二预设信息包括上述第二资源消耗信息,上述在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,上述主备份服务器根据上述第二预设信息生成针对上述目标备份子任务的调整信息,包括:在根据上述第二资源消耗信息分析出上述目标备份子任务对应的执行生产服务器的资源消耗情况有变动的情况下,上述主备份服务器根据上述第二资源消耗信息中上述目标备份子任务对应的执行生产服务器的资源消耗情况,生成针对上述目标备份子任务的调整后的备份速率。
本申请实施例可以根据新获取的资源消耗信息调整备份子任务的备份速率,如果调低了,则保证在不影响生产的情况下进行数据备份,如果调高了,则能够充分利用资源提高备份速率。
在其中一种可能的实施方式中,上述第二预设信息包括上述服务器的健康状态信息,上述在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,上述主备份服务器根据上述第二预设信息生成针对上述目标备份子任务的调整信息,包括:如果上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况,在根据上述生产系统的生产服务器的健康状态情况分析出上述目标备份子任务对应的执行生产服务器出现故障的情况下,上述主备份服务器根据上述生产系统的生产服务器的健康状态情况,生成上述目标备份子任务对应的调整后的执行生产服务器的信息;如果上述服务器的健康状态信息包括上述备份系统的备份服务器的健康状态情况,在根据上述备份系统的备份服务器的健康状态情况分析出上述目标备份子任务对应的执行备份服务器出现故障的情况下,上述主备份服务器根据上述备份系统的备份服务器的健康状态情况,生成上述目标备份子任务对应的调整后的对应执行备份服务器的信息。
本申请实施例中,在执行生产服务器或执行备份服务器出现故障的情况下,可以更换正常运行的生产服务器或备份服务器继续完成对应的备份任务,从而保证了能够顺利完成数据的备份任务,避免因故障导致数据备份不完全。
在其中一种可能的实施方式中,上述主备份服务器将上述多个备份子任务发送给各自对应的执行备份服务器之后,还包括:上述主备份服务器根据第一备份子任务向第一执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息;上述第一备份子任务对应的执行备份服务器为上述主备份服务器,上述第一备份子任务对应的执行生产服务器为上述第一执行生产服务器;上述主备份服务器接收上述第一执行生产服务器发送的待备份数据。
在本申请实施例中,主备份服务器也可以执行备份子任务向生产服务器获取待备份数据进行备份,从而充分利用了服务器资源,提高了备份速率。
在其中一种可能的实施方式中,上述待备份数据获取请求还包括第一初始备份速率的信息,上述第一初始备份速率的信息为上述第一备份子任务包括的初始备份速率信息,上述主 备份服务器接收上述第一执行生产服务器发送的待备份数据,包括:上述主备份服务器以上述第一初始备份速率接收上述第一执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述主备份服务器根据第一备份子任务向第一执行生产服务器发送待备份数据获取请求之后,还包括:上述主备份服务器根据第一调整信息对应调整上述待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围信息、调整后的备份速率信息和调整后的执行生产服务器的地址信息中的一项或多项;上述第一调整信息用于指示上述主备份服务器根据上述第一调整信息进行数据备份;上述主备份服务器向上述第一备份子任务对应的执行生产服务器发送调整后的待备份数据获取请求。
第二方面,本发明实施例提供了一种备份处理方法,该方法应用于备份系统,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;该方法包括:
第一备份服务器接收上述主备份服务器发送的备份子任务,上述备份子任务对应有执行生产服务器,用于指示上述第一备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述执行生产服务器为生产系统中的服务器;上述第一备份服务器为上述备份系统中的服务器;上述第一备份服务器根据上述备份子任务向上述执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息;上述第一备份服务器接收上述执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述待备份数据获取请求还包括初始备份速率的信息,上述第一备份服务器接收上述执行生产服务器发送的待备份数据,包括:上述第一备份服务器以上述初始备份速率接收上述执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述第一备份服务器接收上述主备份服务器发送的备份子任务之后,还包括:上述第一备份服务器接收上述主备份服务器发送的上述备份子任务的调整信息,上述调整信息用于指示上述第一备份服务器根据上述调整信息进行数据备份;上述第一备份服务器根据上述调整信息对应调整上述待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围信息、调整后的备份速率信息和调整后的执行生产服务器的地址信息中的一项或多项;上述第一备份服务器向上述备份子任务对应的执行生产服务器发送调整后的待备份数据获取请求。
第二方面是与第一方面的执行备份服务器对应的实施例,其有益效果可以对应参照第一方面中的描述,此处不再赘述。
第三方面、本发明实施例提供了一种备份处理方法,该方法应用于生产系统,上述生产系统包括多个生产服务器;该方法包括:
第一生产服务器获取第一预设信息,上述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;上述第一数据分布信息包括待备份数据在上述第一生产服务器中的第一分布情况;上述第一资源消耗信息包括上述第一生产服务器的第一资源消耗情况;上述第一生产服务器向主备份服务器发送上述第一预设信息;上述第一预设信息用于使上述主备份服务器根据上述第一预设信息划分多个备份子任务,上述备份子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述主备份服务器为备份系统的服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器,用于备份上述生产系统的数据。
在其中一种可能的实施方式中,上述第一生产服务器向主备份服务器发送上述第一预设信息之后,还包括:上述第一生产服务器接收第二备份服务器发送的待备份数据获取请求, 上述待备份数据获取请求包括待备份数据范围的信息;上述第二备份服务器为上述备份系统包括的备份服务器;上述第一生产服务器根据上述待备份数据范围的信息获取待备份数据;上述第一生产服务器将获取的上述待备份数据发送给上述第二备份服务器。
在其中一种可能的实施方式中,上述第一预设信息包括第一资源消耗信息,上述待备份数据获取请求还包括初始备份速率的信息,上述初始备份速率为上述主备份服务器根据获取的上述第一生产服务器的资源消耗情况设置的备份初始速率;上述第一生产服务器将获取的上述待备份数据发送给上述第二备份服务器,包括:上述第一生产服务器将获取的上述待备份数据以上述初始备份速率发送给上述第二备份服务器。
在其中一种可能的实施方式中,上述第一生产服务器向主备份服务器发送上述第一预设信息之后,还包括:上述第一生产服务器获取第二预设信息,上述第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中一项或多项;上述第二数据分布信息包括生产系统中待备份数据的第二分布情况;上述第二资源消耗信息包括上述多个生产服务器各自对应的第二资源消耗情况;上述服务器的健康状态信息包括上述第一生产服务器的健康状态情况;上述第一生产服务器向上述主备份服务器发送上述第二预设信息,上述第二预设信息用于使上述主备份服务器根据上述第二预设信息调整上述第一生产服务器对应的备份子任务的待备份数据范围、备份速率和执行备份服务器中的一项或多项。
在其中一种可能的实施方式中,上述第一生产服务器向上述主备份服务器发送上述第二预设信息之后,还包括:上述第一生产服务器接收第三备份服务器发送的调整后的待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围和调整后的备份速率中的一项或多项,调整后的待备份数据范围和调整后的备份速率中的一项或多项为上述主备份服务器发送给上述第三备份服务器;上述第三备份服务器为上述备份系统包括的备份服务器;上述第一生产服务器根据调整后的待备份数据获取请求向上述第三备份服务器发送上述待备份数据。
第三方面是与第一方面的执行生产服务器对应的实施例,其有益效果可以对应参照第一方面中的描述,此处不再赘述。
第四方面,本发明实施例提供了一种备份恢复处理方法,该方法应用于备份系统,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述方法包括:
所述多个备份服务器中的主备份服务器将备份恢复任务划分为多个备份恢复子任务;所述主备份服务器将每个备份恢复子任务分配给所述多个备份服务器中的每个备份服务器;所述主备份服务器将所述多个备份恢复子任务发送给各自对应的备份服务器。
在其中一种可能的实施方式中,上述主备份服务器获取第一信息;上述第一信息包括生产系统中多个生产服务器各自对应的第三资源消耗情况;上述主备份服务器根据上述第一信息划分多个备份恢复子任务;上述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器向上述执行生产服务器发送预设范围的数据;上述执行备份服务器包括上述备份系统中的备份服务器;上述执行生产服务器包括上述生产系统中的一个或多个生产服务器;上述主备份服务器将上述多个备份恢复子任务发送给各自对应的执行备份服务器。
本申请实施例根据生产服务器中各个生产服务器的资源消耗情况来确定向对应的生产服务器发送的待恢复的数据范围,且将这个备份恢复任务划分为多个子任务分发给备份系统中的多个服务器执行,因此在不妨碍生产的过程中提高了备份恢复的效率。
在其中一种可能的实施方式中,上述主备份服务器根据上述第一信息划分多个备份恢复子任务,包括:上述主备份服务器根据上述第三资源消耗情况确定上述多个生产服务器的负载轻重情况;上述主备份服务器根据上述多个生产服务器的负载轻重情况设置需要分别向上述多个生产服务器发送的数据范围;上述主备份服务器上述主备份服务器根据上述数据范围划分多个备份恢复子任务。
本申请实施例根据生产服务器的负载的轻重情况来划分备份恢复子任务,保证了可以在不妨碍生产的过程中完成备份数据的恢复。
在其中一种可能的实施方式中,上述主备份服务器根据上述第一信息划分多个备份恢复子任务,包括:上述主备份服务器根据上述第一信息确定上述多个生产服务器各自对应的初始备份恢复速率,上述初始备份恢复速率为执行备份服务器向对应的执行生产服务器发送数据的初始速率;上述主备份服务器将上述多个生产服务器各自对应的初始备份恢复速率分配给上述多个生产服务器各自对应的备份恢复子任务。
本申请实施例根据生产服务器的资源消耗情况来确定其对应的备份恢复子任务向该生产服务器发送数据的初始备份恢复速率,能够有效地保证在不影响生产服务器的生产服务的情况下完成备份恢复的任务。
在其中一种可能的实施方式中,上述主备份服务器将上述多个备份恢复子任务发送给各自对应的执行备份服务器之后,还包括:上述主备份服务器获取第二信息,上述第二信息包括第四资源消耗信息和服务器的健康状态信息中的一项或多项;上述第四资源消耗信息包括上述生产系统中多个生产服务器各自对应的第四资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;
在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述主备份服务器根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,上述调整信息用于指示上述目标备份恢复子任务对应的执行备份服务器根据上述调整信息向对应的执行生产服务器发送数据;上述主备份服务器将上述调整信息发送给上述目标备份恢复子任务对应的执行备份服务器。
本申请实施例中,主备份服务器可以实时获取生产服务器的资源消耗情况、生产服务器和备份服务器的健康状态信息等,根据这些信息实时调整对应的子任务的参数,从而在保证不妨碍生产的情况下更高效地完成备份恢复的过程。
在其中一种可能的实施方式中,上述第二信息包括上述第四资源消耗信息;在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述主备份服务器根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
在根据上述第四资源消耗信息分析出上述目标备份恢复子任务需要向对应的执行生产服务器发送的数据范围需要调整的情况下,上述主备份服务器根据上述第四资源消耗信息,生成针对上述目标备份恢复子任务的调整后的需要向对应的执行生产服务器发送的数据范围。
在其中一种可能的实施方式中,上述第二信息包括上述第四资源消耗信息;在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述主备份服务器根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
在根据上述第四资源消耗信息分析出上述目标备份恢复子任务对应的初始备份恢复速率需要调整的情况下,上述主备份服务器根据上述第四资源消耗信息,生成针对上述目标备份 恢复子任务的调整后的备份恢复速率。
在其中一种可能的实施方式中,上述第二信息包括上述服务器的健康状态信息;在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述主备份服务器根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
如果上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况,在根据上述生产系统的生产服务器的健康状态情况分析出上述目标备份恢复子任务对应的执行生产服务器出现故障的情况下,上述主备份服务器根据上述生产系统的生产服务器的健康状态情况,生成上述目标备份恢复子任务对应的调整后的执行生产服务器的信息;
如果上述服务器的健康状态信息包括上述备份系统的备份服务器的健康状态情况,在根据上述备份系统的备份服务器的健康状态情况分析出上述目标备份恢复子任务对应的执行备份服务器出现故障的情况下,上述主备份服务器根据上述备份系统的备份服务器的健康状态情况,生成上述目标备份恢复子任务对应的调整后的执行备份服务器的信息。
在本申请实施例中,在执行生产服务器或执行备份服务器出现故障的情况下,可以更换正常运行的生产服务器或备份服务器继续完成对应的备份恢复任务,从而保证了能够顺利完成数据的备份恢复,避免因故障导致数据备份恢复不完全。
在其中一种可能的实施方式中,上述主备份服务器将上述多个备份恢复子任务发送给各自对应的执行备份服务器之后,还包括:上述主备份服务器根据第一备份恢复子任务向第一执行生产服务器发送第一数据;上述第一数据包括从备份系统中恢复到上述第一执行生产服务器中的数据,上述第一备份恢复子任务对应的执行备份服务器为上述主备份服务器。
本申请实施例说明,主备份服务器也可以作为执行备份服务器执行对应的备份恢复子任务。
在其中一种可能的实施方式中,上述第一备份恢复子任务包括第一初始备份恢复速率,上述主备份服务器根据第一备份恢复子任务向第一执行生产服务器发送数据,包括:上述主备份服务器根据第一备份恢复子任务以上述第一初始备份恢复速率向上述第一执行生产服务器发送上述第一数据。
在其中一种可能的实施方式中,上述主备份服务器根据第一备份恢复子任务向第一执行生产服务器发送第一数据之后,还包括:上述主备份服务器根据第一调整信息向调整后的上述第一备份恢复子任务对应的执行生产服务器发送数据,上述调整后的上述第一备份恢复子任务包括上述第一调整信息,上述第一调整信息包括调整后的发送的数据范围、调整后的备份恢复速率和调整后的执行生产服务器的地址信息中的一项或多项。
第五方面,本发明实施例提供了一种备份恢复处理方法,该方法应用于备份系统,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述方法包括:
第一备份服务器接收上述主备份服务器发送的备份恢复子任务,上述备份恢复子任务对应有执行生产服务器,用于指示上述第一备份服务器向上述执行生产服务器发送预设范围的数据;上述执行生产服务器为生产系统中的服务器;上述第一备份服务器为上述备份系统中的从备份服务器;上述第一备份服务器根据上述备份恢复子任务向上述执行生产服务器发送上述预设范围的数据。
在其中一种可能的实施方式中,上述备份恢复子任务包括初始备份恢复速率,上述第一备份服务器根据上述备份恢复子任务向上述执行生产服务器发送上述预设范围的数据,包括:上述第一备份服务器根据上述备份恢复子任务以上述初始备份恢复速率向上述执行生产服务 器发送上述预设范围的数据。
在其中一种可能的实施方式中,上述第一备份服务器根据上述备份恢复子任务向上述执行生产服务器发送上述预设范围的数据之后,还包括:上述第一备份服务器接收上述主备份服务器发送的上述备份恢复子任务的调整信息,上述调整信息用于指示上述主备份服务器根据上述调整信息向上述执行生产服务器发送数据;上述调整信息包括调整后的向上述执行生产服务器发送的数据范围、调整后的备份恢复速率和调整后的执行生产服务器的地址信息中的一项或多项;上述第一备份服务器根据上述调整信息向调整后的上述备份恢复子任务对应的执行生产服务器发送数据。
第五方面是与第四方面的执行备份服务器对应的实施例,其有益效果可以对应参照第一方面中的描述,此处不再赘述。
第六方面,本发明实施例提供了一种备份恢复处理方法,该方法应用于生产系统,上述生产系统包括多个生产服务器;上述方法包括:
第一生产服务器获取第一信息;上述第一信息包括上述多个生产服务器各自对应的第三资源消耗情况;上述第一生产服务器向主备份服务器发送上述第一信息;上述第一信息用于使上述主备份服务器根据上述第一信息划分多个备份恢复子任务,上述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器向上述执行生产服务器发送预设范围的数据;上述主备份服务器为备份系统的服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器。
在其中一种可能的实施方式中,上述第一生产服务器向主备份服务器发送上述第一信息之后,还包括:上述第一生产服务器接收第二备份服务器发送的上述预设范围的数据;上述第二备份服务器为上述备份系统包括的备份服务器。
在其中一种可能的实施方式中,上述第一生产服务器接收第二备份服务器发送的上述预设范围的数据,包括:上述第一生产服务器以初始备份恢复速率接收第二备份服务器发送的上述预设范围的数据,上述初始备份恢复速率为上述主备份服务器根据上述第一生产服务器的资源消耗情况设置的备份恢复初始速率。
在其中一种可能的实施方式中,上述第一生产服务器向主备份服务器发送上述第一信息之后,还包括:上述第一生产服务器获取第二信息,上述第二信息包括第四资源消耗信息和服务器的健康状态信息中的一项或多项;上述第四资源消耗信息包括上述生产系统中多个生产服务器各自对应的第四资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;
上述第一生产服务器向上述主备份服务器发送上述第二信息,上述第二信息用于使上述主备份服务器根据上述第二信息,调整上述第一生产服务器对应的备份恢复子任务的备份恢复速率、执行备份服务器和需要向上述第一生产服务器发送的数据范围中的一项或多项。
在其中一种可能的实施方式中,上述第一生产服务器向上述主备份服务器发送上述第二信息之后,还包括:上述第一生产服务器接收第三备份服务器发送的数据,上述第三备份服务器发送的数据为上述第三备份服务器根据上述第一生产服务器对应的备份恢复子任务的调整信息向上述第一生产服务器发送的数据,上述第一生产服务器对应的备份恢复子任务的调整信息包括调整后的向上述执行生产服务器发送的数据范围和调整后的备份恢复速率中的一项或多项。
第六方面是与第四方面的执行生产服务器对应的实施例,其有益效果可以对应参照第一 方面中的描述,此处不再赘述。
第七方面,本发明实施例提供了一种备份处理服务器,上述备份处理服务器为备份系统中的主备份服务器,上述备份系统还包括一个或多个从备份服务器;上述备份处理服务器包括处理器、存储器以及通信模块;上述存储器以及上述通信模块与上述处理器耦合,上述存储器存储有计算机程序,上述处理器执行上述计算机程序时,执行如下操作:
获取第一预设信息;上述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;上述第一数据分布信息包括生产系统中待备份数据的第一分布情况;上述生产系统包括多个生产服务器;上述第一资源消耗信息包括上述多个生产服务器各自对应的第一资源消耗情况;根据上述第一预设信息划分多个备份子任务;上述备份子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述执行备份服务器包括上述备份系统中的备份服务器,上述执行生产服务器包括上述生产系统中的一个或多个生产服务器;通过上述通信模块将上述多个备份子任务发送给各自对应的执行备份服务器。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一数据分布信息,上述根据上述第一预设信息划分多个备份子任务,具体为:根据上述第一数据分布信息划分上述多个备份子任务;上述目标范围的待备份数据包括根据上述第一数据分布信息中上述执行生产服务器的待备份数据的分布情况确定的数据。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一资源消耗信息,上述根据上述第一预设信息划分多个备份子任务,具体为:根据上述第一资源消耗信息划分上述多个备份子任务;上述备份子任务包括一个或多个初始备份速率的信息,上述一个或多个初始备份速率为根据上述第一资源消耗信息中上述备份子任务对应的一个或多个生产服务器的资源消耗情况对应设置的备份初始速率,上述初始备份速率的信息用于指示以上述初始备份速率从上述初始备份速率对应的生产服务器中获取数据。
在其中一种可能的实施方式中,上述通过上述通信模块将上述多个备份子任务发送给各自对应的执行备份服务器之后,还包括:
获取第二预设信息;上述第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中一项或多项;上述第二数据分布信息包括上述生产系统中待备份数据的第二分布情况;上述第二资源消耗信息包括上述多个生产服务器各自对应的第二资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,上述调整信息用于指示上述目标备份子任务对应的执行备份服务器根据上述调整信息进行数据备份;通过上述通信模块将上述调整信息发送给上述目标备份子任务对应的执行备份服务器。
在其中一种可能的实施方式中,上述第二预设信息包括上述第二数据分布信息,上述在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,具体为:在根据上述第二数据分布信息分析出上述目标备份子任务的待备份数据范围有变动的情况下,根据上述第二数据分布信息中上述目标备份子任务对应的执行生产服务器的数据分布情况,生成针对上述目标备份子任务的调整后的待备份数据范围。
在其中一种可能的实施方式中,上述第二预设信息包括上述第二资源消耗信息,上述在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,具体为:在根据上述第二资源消耗信息分析出上述目标备份子任务对应的执行生产服务器的资源消耗情况有变动的情况下,根据上述第二资源消耗信息中上述目标备份子任务对应的执行生产服务器的资源消耗情况,生成针对上述目标备份子任务的调整后的备份速率。
在其中一种可能的实施方式中,上述第二预设信息包括上述服务器的健康状态信息,上述在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,具体为:
如果上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况,在根据上述生产系统的生产服务器的健康状态情况分析出上述目标备份子任务对应的执行生产服务器出现故障的情况下,根据上述生产系统的生产服务器的健康状态情况,生成上述目标备份子任务对应的调整后的执行生产服务器的信息;如果上述服务器的健康状态信息包括上述备份系统的备份服务器的健康状态情况,在根据上述备份系统的备份服务器的健康状态情况分析出上述目标备份子任务对应的执行备份服务器出现故障的情况下,根据上述备份系统的备份服务器的健康状态情况,生成上述目标备份子任务对应的调整后的对应执行备份服务器的信息。
在其中一种可能的实施方式中,上述通过上述通信模块将上述多个备份子任务发送给各自对应的执行备份服务器之后,还包括:根据第一备份子任务通过上述通信模块向第一执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息;上述第一备份子任务对应的执行备份服务器为上述备份处理服务器,上述第一备份子任务对应的执行生产服务器为上述第一执行生产服务器。通过上述通信模块接收上述第一执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述待备份数据获取请求还包括第一初始备份速率的信息,上述第一初始备份速率的信息为上述第一备份子任务包括的初始备份速率信息,上述通过上述通信模块接收上述第一执行生产服务器发送的待备份数据,具体为:以上述第一初始备份速率通过上述通信模块接收上述第一执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述根据第一备份子任务向第一执行生产服务器发送待备份数据获取请求之后,还包括:根据第一调整信息对应调整上述待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围信息、调整后的备份速率信息和调整后的执行生产服务器的地址信息中的一项或多项;上述第一调整信息用于指示上述备份处理服务器根据上述第一调整信息进行数据备份;通过上述通信模块向上述第一备份子任务对应的执行生产服务器发送调整后的待备份数据获取请求。
第八方面,本发明实施例提供了一种备份处理服务器,上述备份处理服务器为备份系统中的从备份服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述备份处理服务器包括处理器、存储器以及通信模块;上述存储器以及上述通信模块与上述处理器耦合,上述存储器存储有计算机程序,上述处理器执行上述计算机程序时,执行如下操作:
通过上述通信模块接收上述主备份服务器发送的备份子任务,上述备份子任务对应有执行生产服务器,用于指示上述处理器备份上述执行生产服务器中目标范围的待备份数据;上 述执行生产服务器为生产系统中的服务器;根据上述备份子任务通过上述通信模块向上述执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息;通过上述通信模块接收上述执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述待备份数据获取请求还包括初始备份速率的信息,上述通过上述通信模块接收上述执行生产服务器发送的待备份数据,具体为:以上述初始备份速率通过上述通信模块接收上述执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述通过上述通信模块接收上述主备份服务器发送的备份子任务之后,还包括:通过上述通信模块接收上述主备份服务器发送的上述备份子任务的调整信息,上述调整信息用于指示上述处理器根据上述调整信息进行数据备份;根据上述调整信息对应调整上述待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围信息、调整后的备份速率信息和调整后的执行生产服务器的地址信息中的一项或多项;通过上述通信模块向上述备份子任务对应的执行生产服务器发送调整后的待备份数据获取请求。
第九方面,本发明实施例提供了一种备份处理服务器,上述备份处理服务器为生产系统中的生产服务器;上述备份处理服务器包括处理器、存储器以及通信模块;上述存储器以及上述通信模块与上述处理器耦合,上述存储器存储有计算机程序,上述处理器执行上述计算机程序时,执行如下操作:
获取第一预设信息,上述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;上述第一数据分布信息包括待备份数据在上述备份处理服务器中的第一分布情况;上述第一资源消耗信息包括上述备份处理服务器的第一资源消耗情况;通过上述通信模块向主备份服务器发送上述第一预设信息;上述第一预设信息用于使上述主备份服务器根据上述第一预设信息划分多个备份子任务,上述备份子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述主备份服务器为备份系统的服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器,用于备份上述生产系统的数据。
在其中一种可能的实施方式中,上述通过上述通信模块向主备份服务器发送上述第一预设信息之后,还包括:通过上述通信模块接收第二备份服务器发送的待备份数据获取请求,上述待备份数据获取请求包括待备份数据范围的信息;上述第二备份服务器为上述备份系统包括的备份服务器;根据上述待备份数据范围的信息获取待备份数据;通过上述通信模块将获取的上述待备份数据发送给上述第二备份服务器。
在其中一种可能的实施方式中,上述第一预设信息包括第一资源消耗信息,上述待备份数据获取请求还包括初始备份速率的信息,上述初始备份速率为上述主备份服务器根据获取的上述备份处理服务器的资源消耗情况设置的备份初始速率;上述通过上述通信模块将获取的上述待备份数据发送给上述第二备份服务器,具体为:通过上述通信模块将获取的上述待备份数据以上述初始备份速率发送给上述第二备份服务器。
在其中一种可能的实施方式中,上述通过上述通信模块向主备份服务器发送上述第一预设信息之后,还包括:获取第二预设信息,上述第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中一项或多项;;上述第二数据分布信息包括生产系统中待备份数据的第二分布情况;上述第二资源消耗信息包括上述多个生产服务器各自对应的第二资源消耗情况;上述服务器的健康状态信息包括上述备份处理服务器的健康状态情况; 通过上述通信模块向上述主备份服务器发送上述第二预设信息,上述第二预设信息用于使上述主备份服务器根据上述第二预设信息调整上述备份处理服务器对应的备份子任务的待备份数据范围、备份速率和执行备份服务器中的一项或多项。
在其中一种可能的实施方式中,上述通过上述通信模块向上述主备份服务器发送上述第二预设信息之后,还包括:通过上述通信模块接收第三备份服务器发送的调整后的待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围和调整后的备份速率中的一项或多项,调整后的待备份数据范围和调整后的备份速率中的一项或多项为上述主备份服务器发送给上述第三备份服务器;上述第三备份服务器为上述备份系统包括的备份服务器;根据调整后的待备份数据获取请求通过上述通信模块向上述第三备份服务器发送上述待备份数据。
第十方面,本发明实施例提供了一种备份处理服务器,上述备份处理服务器为备份系统中的主备份服务器,上述备份系统还包括一个或多个从备份服务器;上述备份处理服务器包括:
划分单元,用于将备份任务划分为多个备份子任务;分配单元,用于将每个备份子任务分配给所述多个备份服务器中的每个备份服务器;发送单元,用于将所述多个备份子任务发送给各自对应的备份服务器。
在其中一种可能的实施方式中,上述备份处理服务器还包括获取单元,用于获取第一预设信息;上述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;上述第一数据分布信息包括生产系统中待备份数据的第一分布情况;上述生产系统包括多个生产服务器;上述第一资源消耗信息包括上述多个生产服务器各自对应的第一资源消耗情况;上述划分单元,还用于根据上述第一预设信息划分多个备份子任务;上述备份子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述执行备份服务器包括上述备份系统中的备份服务器,上述执行生产服务器包括上述生产系统中的一个或多个生产服务器。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一数据分布信息,上述划分单元,用于根据上述第一预设信息划分多个备份子任务,具体为:用于根据上述第一数据分布信息划分上述多个备份子任务;上述目标范围的待备份数据包括根据上述第一数据分布信息中上述执行生产服务器的待备份数据的分布情况确定的数据。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一资源消耗信息,上述划分单元,用于根据上述第一预设信息划分多个备份子任务,具体为:用于根据上述第一资源消耗信息划分上述多个备份子任务;上述备份子任务包括一个或多个初始备份速率的信息,上述一个或多个初始备份速率为根据上述第一资源消耗信息中上述备份子任务对应的一个或多个生产服务器的资源消耗情况对应设置的备份初始速率,上述初始备份速率的信息用于指示以上述初始备份速率从上述初始备份速率对应的生产服务器中获取数据。
在其中一种可能的实施方式中,上述备份处理服务器还包括生成单元;上述获取单元,还用于在上述发送单元将上述多个备份子任务发送给各自对应的执行备份服务器之后,获取第二预设信息;上述第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中一项或多项;上述第二数据分布信息包括上述生产系统中待备份数据的第二分布情况;上述第二资源消耗信息包括上述多个生产服务器各自对应的第二资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的 备份服务器的健康状态情况中的一项或多项;上述生成单元,用于在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,上述调整信息用于指示上述目标备份子任务对应的执行备份服务器根据上述调整信息进行数据备份;上述发送单元,还用于将上述调整信息发送给上述目标备份子任务对应的执行备份服务器。
在其中一种可能的实施方式中,上述第二预设信息包括上述第二数据分布信息,上述生成单元,用于在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,具体为:用于在根据上述第二数据分布信息分析出上述目标备份子任务的待备份数据范围有变动的情况下,根据上述第二数据分布信息中上述目标备份子任务对应的执行生产服务器的数据分布情况,生成针对上述目标备份子任务的调整后的待备份数据范围。
在其中一种可能的实施方式中,上述第二预设信息包括上述第二资源消耗信息,上述生成单元,用于在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,具体为:用于在根据上述第二资源消耗信息分析出上述目标备份子任务对应的执行生产服务器的资源消耗情况有变动的情况下,根据上述第二资源消耗信息中上述目标备份子任务对应的执行生产服务器的资源消耗情况,生成针对上述目标备份子任务的调整后的备份速率。
在其中一种可能的实施方式中,上述第二预设信息包括上述服务器的健康状态信息,上述生成单元,用于在根据上述第二预设信息分析出上述多个备份子任务中的目标备份子任务需要调整的情况下,根据上述第二预设信息生成针对上述目标备份子任务的调整信息,具体为:如果上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况,用于在根据上述第二预设信息分析出上述目标备份子任务对应的执行生产服务器出现故障的情况下,根据上述生产系统的生产服务器的健康状态情况生成上述目标备份子任务对应的调整后的对应执行生产服务器的信息;如果上述服务器的健康状态信息包括上述备份系统的备份服务器的健康状态情况,用于在根据上述第二预设信息分析出上述目标备份子任务对应的执行备份服务器出现故障的情况下,根据上述备份系统的备份服务器的健康状态情况生成上述目标备份子任务对应的调整后的对应执行备份服务器的信息。
在其中一种可能的实施方式中,上述备份处理服务器还包括接收单元;上述发送单元,还用于在将上述多个备份子任务发送给各自对应的执行备份服务器之后,根据第一备份子任务向第一执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息;上述第一备份子任务对应的执行备份服务器为上述备份处理服务器,上述第一备份子任务对应的执行生产服务器为上述第一执行生产服务器;上述接收单元,用于接收上述第一执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述待备份数据获取请求还包括第一初始备份速率的信息,上述第一初始备份速率的信息为上述第一备份子任务包括的初始备份速率信息,上述接收单元,用于接收上述第一执行生产服务器发送的待备份数据,具体为:用于以上述第一初始备份速率接收上述第一执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述备份处理服务器还包括调整单元,用于在上述发送单元根据第一备份子任务向第一执行生产服务器发送待备份数据获取请求之后,根据第一调整信息对应调整上述待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的 待备份数据范围信息、调整后的备份速率信息和调整后的执行生产服务器的地址信息中的一项或多项;上述第一调整信息用于指示上述备份处理服务器根据上述第一调整信息进行数据备份;上述发送单元,还用于向上述第一备份子任务对应的执行生产服务器发送调整后的待备份数据获取请求。
第十一方面,本发明实施例提供了一种备份处理服务器,上述备份处理服务器为备份系统中的从备份服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述备份处理服务器包括:接收单元,用于接收上述主备份服务器发送的备份子任务,上述备份子任务对应有执行生产服务器,用于指示上述备份处理服务器备份上述执行生产服务器中目标范围的待备份数据;上述执行生产服务器为生产系统中的服务器;发送单元,用于根据上述备份子任务向上述执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息;上述接收单元,还用于接收上述执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述待备份数据获取请求还包括初始备份速率的信息,上述接收单元,还用于接收上述执行生产服务器发送的待备份数据,具体为:用于以上述初始备份速率接收上述执行生产服务器发送的待备份数据。
在其中一种可能的实施方式中,上述备份处理服务器还包括调整单元;上述接收单元,还用于在接收上述主备份服务器发送的备份子任务之后,接收上述主备份服务器发送的上述备份子任务的调整信息,上述调整信息用于指示上述备份处理服务器根据上述调整信息进行数据备份;上述调整单元,用于根据上述调整信息对应调整待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围信息、调整后的备份速率信息和调整后的执行生产服务器的地址信息中的一项或多项;上述发送单元,还用于向上述备份子任务对应的执行生产服务器发送调整后的待备份数据获取请求。
第十二方面,本发明实施例提供了一种备份处理服务器,上述备份处理服务器为生产系统中的生产服务器;上述备份处理服务器包括:
获取单元,用于获取第一预设信息,上述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;上述第一数据分布信息包括待备份数据在上述备份处理服务器中的第一分布情况;上述第一资源消耗信息包括上述备份处理服务器的第一资源消耗情况;发送单元,用于向主备份服务器发送上述第一预设信息;上述第一预设信息用于使上述主备份服务器根据上述第一预设信息划分多个备份子任务,上述备份子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器备份上述执行生产服务器中目标范围的待备份数据;上述主备份服务器为备份系统的服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器,用于备份上述生产系统的数据。
在其中一种可能的实施方式中,上述备份处理服务器还包括接收单元,用于在上述发送单元向主备份服务器发送上述第一预设信息之后,接收第二备份服务器发送的待备份数据获取请求,上述待备份数据获取请求包括待备份数据范围的信息;上述第二备份服务器为上述备份系统包括的备份服务器;上述获取单元,还用于根据上述待备份数据范围的信息获取待备份数据;上述发送单元,还用于将获取的上述待备份数据发送给上述第二备份服务器。
在其中一种可能的实施方式中,上述第一预设信息包括第一资源消耗信息,上述待备份数据获取请求还包括初始备份速率的信息,上述初始备份速率为上述主备份服务器根据获取的上述备份处理服务器的资源消耗情况设置的备份初始速率;上述发送单元,还用于将获取 的上述待备份数据发送给上述第二备份服务器,具体为:用于将获取的上述待备份数据以上述初始备份速率发送给上述第二备份服务器。
在其中一种可能的实施方式中,上述获取单元,还用于在上述发送单元向主备份服务器发送上述第一预设信息之后,获取第二预设信息,上述第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中一项或多项;上述第二数据分布信息包括生产系统中待备份数据的第二分布情况;上述第二资源消耗信息包括上述多个生产服务器各自对应的第二资源消耗情况;上述服务器的健康状态信息包括上述备份处理服务器的健康状态情况;上述发送单元,还用于向上述主备份服务器发送上述第二预设信息,上述第二预设信息用于使上述主备份服务器根据上述第二预设信息调整上述备份处理服务器对应的备份子任务的待备份数据范围、备份速率和执行备份服务器中的一项或多项。
在其中一种可能的实施方式中,上述备份处理服务器还包括接收单元,用于在上述发送单元向上述主备份服务器发送上述第二预设信息之后,接收第三备份服务器发送的调整后的待备份数据获取请求,上述调整后的待备份数据获取请求包括调整后的待备份数据范围和调整后的备份速率中的一项或多项,调整后的待备份数据范围和调整后的备份速率中的一项或多项为上述主备份服务器发送给上述第三备份服务器;上述第三备份服务器为上述备份系统包括的备份服务器;上述发送单元,还用于根据调整后的待备份数据获取请求向上述第三备份服务器发送上述待备份数据。
第十三方面,本发明实施例提供了一种备份恢复处理服务器,上述备份恢复处理服务器为备份系统中的主备份服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述备份恢复处理服务器包括处理器、存储器以及通信模块;上述存储器以及上述通信模块与上述处理器耦合,上述存储器存储有计算机程序,上述处理器执行上述计算机程序时,执行如下操作:
获取第一信息;上述第一信息包括生产系统中多个生产服务器各自对应的第三资源消耗情况;
根据上述第一信息划分多个备份恢复子任务;上述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器向上述执行生产服务器发送预设范围的数据;上述执行备份服务器包括上述备份系统中的备份服务器;上述执行生产服务器包括上述生产系统中的一个或多个生产服务器;
通过上述通信模块将上述多个备份恢复子任务发送给各自对应的执行备份服务器。
在其中一种可能的实施方式中,上述根据上述第一信息划分多个备份恢复子任务,包括:
根据上述第三资源消耗情况确定上述多个生产服务器的负载轻重情况;
根据上述多个生产服务器的负载轻重情况设置需要分别向上述多个生产服务器发送的数据范围;
上述主备份服务器根据上述数据范围划分多个备份恢复子任务。
在其中一种可能的实施方式中,上述根据上述第一信息划分多个备份恢复子任务,包括:
根据上述第一信息确定上述多个生产服务器各自对应的初始备份恢复速率,上述初始备份恢复速率为执行备份服务器向对应的执行生产服务器发送数据的初始速率;
将上述多个生产服务器各自对应的初始备份恢复速率分配给上述多个生产服务器各自对应的备份恢复子任务。
在其中一种可能的实施方式中,上述通过上述通信模块将上述多个备份恢复子任务发送 给各自对应的执行备份服务器之后,还包括:
获取第二信息,上述第二信息包括第四资源消耗信息和服务器的健康状态信息中的一项或多项;上述第四资源消耗信息包括上述生产系统中多个生产服务器各自对应的第四资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;
在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,上述调整信息用于指示上述目标备份恢复子任务对应的执行备份服务器根据上述调整信息向对应的执行生产服务器发送数据;
通过上述通信模块将上述调整信息发送给上述目标备份恢复子任务对应的执行备份服务器。
在其中一种可能的实施方式中,上述第二信息包括上述第四资源消耗信息;在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
在根据上述第四资源消耗信息分析出上述目标备份恢复子任务需要向对应的执行生产服务器发送的数据范围需要调整的情况下,根据上述第四资源消耗信息,生成针对上述目标备份恢复子任务的调整后的需要向对应的执行生产服务器发送的数据范围。
在其中一种可能的实施方式中,上述第二信息包括上述第四资源消耗信息;在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
在根据上述第四资源消耗信息分析出上述目标备份恢复子任务对应的初始备份恢复速率需要调整的情况下,根据上述第四资源消耗信息,生成针对上述目标备份恢复子任务的调整后的备份恢复速率。
在其中一种可能的实施方式中,上述第二信息包括上述服务器的健康状态信息;在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,上述根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
如果上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况,在根据上述生产系统的生产服务器的健康状态情况分析出上述目标备份恢复子任务对应的执行生产服务器出现故障的情况下,根据上述生产系统的生产服务器的健康状态情况,生成上述目标备份恢复子任务对应的调整后的执行生产服务器的信息;
如果上述服务器的健康状态信息包括上述备份系统的备份服务器的健康状态情况,在根据上述备份系统的备份服务器的健康状态情况分析出上述目标备份恢复子任务对应的执行备份服务器出现故障的情况下,根据上述备份系统的备份服务器的健康状态情况,生成上述目标备份恢复子任务对应的调整后的执行备份服务器的信息。
在其中一种可能的实施方式中,上述通过上述通信模块将上述多个备份恢复子任务发送给各自对应的执行备份服务器之后,还包括:
根据第一备份恢复子任务通过上述通信模块向第一执行生产服务器发送第一数据;上述第一数据包括从备份系统中恢复到上述第一执行生产服务器中的数据,上述第一备份恢复子任务对应的执行备份服务器为上述备份恢复处理服务器。
在其中一种可能的实施方式中,上述第一备份恢复子任务包括第一初始备份恢复速率, 上述根据第一备份恢复子任务通过上述通信模块向第一执行生产服务器发送数据,包括:
根据第一备份恢复子任务通过上述通信模块以上述第一初始备份恢复速率向上述第一执行生产服务器发送上述第一数据。
在其中一种可能的实施方式中,上述根据第一备份恢复子任务通过上述通信模块向第一执行生产服务器发送第一数据之后,还包括:
根据第一调整信息通过上述通信模块向调整后的上述第一备份恢复子任务对应的执行生产服务器发送数据,上述调整后的上述第一备份恢复子任务包括上述第一调整信息,上述第一调整信息包括调整后的发送的数据范围、调整后的备份恢复速率和调整后的执行生产服务器的地址信息中的一项或多项。
第十四方面,本发明实施例提供了一种备份恢复处理服务器,上述备份恢复处理服务器为备份系统中的从备份服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述备份恢复处理服务器包括处理器、存储器以及通信模块;上述存储器以及上述通信模块与上述处理器耦合,上述存储器存储有计算机程序,上述处理器执行上述计算机程序时,执行如下操作:
通过上述通信模块接收上述主备份服务器发送的备份恢复子任务,上述备份恢复子任务对应有执行生产服务器,用于指示上述备份恢复处理服务器向上述执行生产服务器发送预设范围的数据;上述执行生产服务器为生产系统中的服务器;上述备份恢复处理服务器为上述备份系统中的从备份服务器;
根据上述备份恢复子任务通过上述通信模块向上述执行生产服务器发送上述预设范围的数据。
在其中一种可能的实施方式中,上述备份恢复子任务包括初始备份恢复速率,上述根据上述备份恢复子任务通过上述通信模块向上述执行生产服务器发送上述预设范围的数据,包括:
根据上述备份恢复子任务通过上述通信模块以上述初始备份恢复速率向上述执行生产服务器发送上述预设范围的数据。
在其中一种可能的实施方式中,上述根据上述备份恢复子任务通过上述通信模块向上述执行生产服务器发送上述预设范围的数据之后,还包括:
通过上述通信模块接收上述主备份服务器发送的上述备份恢复子任务的调整信息,上述调整信息用于指示上述主备份服务器根据上述调整信息向上述执行生产服务器发送数据;上述调整信息包括调整后的向上述执行生产服务器发送的数据范围、调整后的备份恢复速率和调整后的执行生产服务器的地址信息中的一项或多项;
根据上述调整信息通过上述通信模块向调整后的上述备份恢复子任务对应的执行生产服务器发送数据。
第十五方面,本发明实施例提供了一种备份恢复处理服务器,上述备份恢复处理服务器为生产系统中的生产服务器;上述备份恢复处理服务器包括处理器、存储器以及通信模块;上述存储器以及上述通信模块与上述处理器耦合,上述存储器存储有计算机程序,上述处理器执行上述计算机程序时,执行如下操作:
获取第一信息;上述第一信息包括上述多个生产服务器各自对应的第三资源消耗情况;
通过上述通信模块向主备份服务器发送上述第一信息;上述第一信息用于使上述主备份服务器根据上述第一信息划分多个备份恢复子任务,上述备份恢复子任务对应有执行备份服 务器和执行生产服务器,用于指示上述执行备份服务器向上述执行生产服务器发送预设范围的数据;上述主备份服务器为备份系统的服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器。
在其中一种可能的实施方式中,上述通过上述通信模块向主备份服务器发送上述第一信息之后,还包括:通过上述通信模块接收第二备份服务器发送的上述预设范围的数据;上述第二备份服务器为上述备份系统包括的备份服务器。
在其中一种可能的实施方式中,上述通过上述通信模块接收第二备份服务器发送的上述预设范围的数据,包括:通过上述通信模块以初始备份恢复速率接收第二备份服务器发送的上述预设范围的数据,上述初始备份恢复速率为上述主备份服务器根据上述备份恢复处理服务器的资源消耗情况设置的备份恢复初始速率。
在其中一种可能的实施方式中,上述通过上述通信模块向主备份服务器发送上述第一信息之后,还包括:
获取第二信息,上述第二信息包括第四资源消耗信息和服务器的健康状态信息中的一项或多项;上述第四资源消耗信息包括上述生产系统中多个生产服务器各自对应的第四资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;
通过上述通信模块向上述主备份服务器发送上述第二信息,上述第二信息用于使上述主备份服务器根据上述第二信息,调整上述备份恢复处理服务器对应的备份恢复子任务的备份恢复速率、执行备份服务器和需要向上述备份恢复处理服务器发送的数据范围中的一项或多项。
在其中一种可能的实施方式中,上述通过上述通信模块向上述主备份服务器发送上述第二信息之后,还包括:通过上述通信模块接收第三备份服务器发送的数据,上述第三备份服务器发送的数据为上述第三备份服务器根据上述备份恢复处理服务器对应的备份恢复子任务的调整信息向上述备份恢复处理服务器发送的数据,上述备份恢复处理服务器对应的备份恢复子任务的调整信息包括调整后的向上述执行生产服务器发送的数据范围和调整后的备份恢复速率中的一项或多项。
第十六方面,本发明实施例提供了一种备份恢复处理服务器,上述备份恢复处理服务器为备份系统中的主备份服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述备份恢复处理服务器包括:
划分单元,用于将备份恢复任务划分为多个备份恢复子任务;分配单元,用于将每个备份恢复子任务分配给所述多个备份服务器中的每个备份服务器;发送单元,用于将所述多个备份恢复子任务发送给各自对应的备份服务器。
在其中一种可能的实施方式中,上述备份恢复处理服务器还包括获取单元,用于获取第一信息;上述第一信息包括生产系统中多个生产服务器各自对应的第三资源消耗情况;
上述划分单元,还用于根据上述第一信息划分多个备份恢复子任务;上述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器向上述执行生产服务器发送预设范围的数据;上述执行备份服务器包括上述备份系统中的备份服务器;上述执行生产服务器包括上述生产系统中的一个或多个生产服务器。
在其中一种可能的实施方式中,上述划分单元还包括确定单元、设置单元和子任务划分单元;上述确定单元,用于根据上述第三资源消耗情况确定上述多个生产服务器的负载轻重 情况;上述设置单元,用于根据上述多个生产服务器的负载轻重情况设置需要分别向上述多个生产服务器发送的数据范围;上述子任务划分单元,用于根据上述主备份服务器根据上述数据范围划分多个备份恢复子任务。
在其中一种可能的实施方式中,上述划分单元还包括确定单元和分配单元,
上述确定单元,用于根据上述第一信息确定上述多个生产服务器各自对应的初始备份恢复速率,上述初始备份恢复速率为执行备份服务器向对应的执行生产服务器发送数据的初始速率;
上述分配单元,用于将上述多个生产服务器各自对应的初始备份恢复速率分配给上述多个生产服务器各自对应的备份恢复子任务。
在其中一种可能的实施方式中,上述备份恢复处理服务器还包括生成单元;
上述获取单元,还用于在上述发送单元将上述多个备份恢复子任务发送给各自对应的执行备份服务器之后,获取第二信息,上述第二信息包括第四资源消耗信息和服务器的健康状态信息中的一项或多项;上述第四资源消耗信息包括上述生产系统中多个生产服务器各自对应的第四资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;
上述生成单元,用于在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,上述调整信息用于指示上述目标备份恢复子任务对应的执行备份服务器根据上述调整信息向对应的执行生产服务器发送数据;
上述发送单元,还用于将上述调整信息发送给上述目标备份恢复子任务对应的执行备份服务器。
在其中一种可能的实施方式中,上述第二信息包括上述第四资源消耗信息;上述生成单元,用于在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
用于在根据上述第四资源消耗信息分析出上述目标备份恢复子任务需要向对应的执行生产服务器发送的数据范围需要调整的情况下,根据上述第四资源消耗信息,生成针对上述目标备份恢复子任务的调整后的需要向对应的执行生产服务器发送的数据范围。
在其中一种可能的实施方式中,上述第二信息包括上述第四资源消耗信息;上述生成单元,用于在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
用于在根据上述第四资源消耗信息分析出上述目标备份恢复子任务对应的初始备份恢复速率需要调整的情况下,根据上述第四资源消耗信息,生成针对上述目标备份恢复子任务的调整后的备份恢复速率。
在其中一种可能的实施方式中,上述第二信息包括上述服务器的健康状态信息;上述生成单元,用于在根据上述第二信息分析出上述多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,根据上述第二信息生成针对上述目标备份恢复子任务的调整信息,包括:
如果上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况,上述生成单元,用于在根据上述生产系统的生产服务器的健康状态情况分析出上述目标备份恢复子任务对应的执行生产服务器出现故障的情况下,根据上述生产系统的生产服务器的健康状态情况,生成上述目标备份恢复子任务对应的调整后的执行生产服务器的信息;
如果上述服务器的健康状态信息包括上述备份系统的备份服务器的健康状态情况,上述生成单元,用于在根据上述备份系统的备份服务器的健康状态情况分析出上述目标备份恢复子任务对应的执行备份服务器出现故障的情况下,根据上述备份系统的备份服务器的健康状态情况,生成上述目标备份恢复子任务对应的调整后的执行备份服务器的信息。
在其中一种可能的实施方式中,上述发送单元,还用于在将上述多个备份恢复子任务发送给各自对应的执行备份服务器之后,根据第一备份恢复子任务向第一执行生产服务器发送第一数据;上述第一数据包括从备份系统中恢复到上述第一执行生产服务器中的数据,上述第一备份恢复子任务对应的执行备份服务器为上述备份恢复处理服务器。
在其中一种可能的实施方式中,上述第一备份恢复子任务包括第一初始备份恢复速率,上述发送单元还用于根据第一备份恢复子任务向第一执行生产服务器发送数据,具体为:
还用于根据第一备份恢复子任务以上述第一初始备份恢复速率向上述第一执行生产服务器发送上述第一数据。
在其中一种可能的实施方式中,上述发送单元,还用于根据第一备份恢复子任务向第一执行生产服务器发送第一数据之后,根据第一调整信息向调整后的上述第一备份恢复子任务对应的执行生产服务器发送数据,上述调整后的上述第一备份恢复子任务包括上述第一调整信息,上述第一调整信息包括调整后的发送的数据范围、调整后的备份恢复速率和调整后的执行生产服务器的地址信息中的一项或多项。
第十七方面,本发明实施例提供了一种备份恢复处理服务器,上述备份恢复处理服务器为备份系统中的从备份服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;上述备份处理服务器包括:
接收单元,用于接收上述主备份服务器发送的备份恢复子任务,上述备份恢复子任务对应有执行生产服务器,用于指示上述备份恢复处理服务器向上述执行生产服务器发送预设范围的数据;上述执行生产服务器为生产系统中的服务器;上述备份恢复处理服务器为上述备份系统中的从备份服务器;
发送单元,用于根据上述备份恢复子任务向上述执行生产服务器发送上述预设范围的数据。
在其中一种可能的实施方式中,上述备份恢复子任务包括初始备份恢复速率,上述发送单元,用于根据上述备份恢复子任务向上述执行生产服务器发送上述预设范围的数据,具体为:
用于根据上述备份恢复子任务以上述初始备份恢复速率向上述执行生产服务器发送上述预设范围的数据。
在其中一种可能的实施方式中,上述接收单元,还用于上述发送单元根据上述备份恢复子任务向上述执行生产服务器发送上述预设范围的数据之后,接收上述主备份服务器发送的上述备份恢复子任务的调整信息,上述调整信息用于指示上述主备份服务器根据上述调整信息向上述执行生产服务器发送数据;上述调整信息包括调整后的向上述执行生产服务器发送的数据范围、调整后的备份恢复速率和调整后的执行生产服务器的地址信息中的一项或多项;
上述发送单元,还用于根据上述调整信息向调整后的上述备份恢复子任务对应的执行生产服务器发送数据。
第十八方面,本发明实施例提供了一种备份恢复处理服务器,上述备份恢复处理服务器为生产系统中的生产服务器;上述备份恢复处理服务器包括:
获取单元,用于获取第一信息;上述第一信息包括上述多个生产服务器各自对应的第三资源消耗情况;
发送单元,用于向主备份服务器发送上述第一信息;上述第一信息用于使上述主备份服务器根据上述第一信息划分多个备份恢复子任务,上述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示上述执行备份服务器向上述执行生产服务器发送预设范围的数据;上述主备份服务器为备份系统的服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器。
在其中一种可能的实施方式中,上述备份恢复处理服务器还包括接收单元,用于在上述发送单元向主备份服务器发送上述第一信息之后,接收第二备份服务器发送的上述预设范围的数据;上述第二备份服务器为上述备份系统包括的备份服务器。
在其中一种可能的实施方式中,上述接收单元,用于接收第二备份服务器发送的上述预设范围的数据,具体为:
用于以初始备份恢复速率接收第二备份服务器发送的上述预设范围的数据,上述初始备份恢复速率为上述主备份服务器根据上述备份恢复处理服务器的资源消耗情况设置的备份恢复初始速率。
在其中一种可能的实施方式中,上述获取单元,还用于在上述发送单元向主备份服务器发送上述第一信息之后,获取第二信息,上述第二信息包括第四资源消耗信息和服务器的健康状态信息中的一项或多项;上述第四资源消耗信息包括上述生产系统中多个生产服务器各自对应的第四资源消耗情况;上述服务器的健康状态信息包括上述生产系统的生产服务器的健康状态情况和上述备份系统的备份服务器的健康状态情况中的一项或多项;
上述发送单元,还用于向上述主备份服务器发送上述第二信息,上述第二信息用于使上述主备份服务器根据上述第二信息,调整上述备份恢复处理服务器对应的备份恢复子任务的备份恢复速率、执行备份服务器和需要向上述备份恢复处理服务器发送的数据范围中的一项或多项。
在其中一种可能的实施方式中,上述接收单元,还用于在上述发送单元向上述主备份服务器发送上述第二信息之后,接收第三备份服务器发送的数据,上述第三备份服务器发送的数据为上述第三备份服务器根据上述备份恢复处理服务器对应的备份恢复子任务的调整信息向上述备份恢复处理服务器发送的数据,上述备份恢复处理服务器对应的备份恢复子任务的调整信息包括调整后的向上述执行生产服务器发送的数据范围和调整后的备份恢复速率中的一项或多项。
第十九方面,本发明实施例提供一种备份处理系统,该系统包括生产系统和备份系统,上述生产系统包括多个生产服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;其中,上述主备份服务器为上述第七方面及其可能的实施方式中的任一项上述服务器,上述从备份服务器为上述第八方面及其可能的实施方式中的任一项上述服务器,上述生产服务器为上述第九方面及其可能的实施方式中的任一项上述服务器。
第二十方面,本发明实施例提供一种备份处理系统,该系统包括生产系统和备份系统,上述生产系统包括多个生产服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;其中,上述主备份服务器为上述第十方面及其可能的实施方式中的任一项上述服务器,上述从备份服务器为上述第十一方面及其可能的实施方式中的任一项上述服务器,上述生产服务器为上述第十二方面及其可能的实施方式中的任一项上述服务器。
第二十一方面,本发明实施例提供一种备份恢复处理系统,该系统包括生产系统和备份系统,上述生产系统包括多个生产服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;其中,上述主备份服务器为上述第十三方面及其可能的实施方式中的任一项上述服务器,上述从备份服务器为上述第十四方面及其可能的实施方式中的任一项上述服务器,上述生产服务器为上述第十五方面及其可能的实施方式中的任一项上述服务器。
第二十二方面,本发明实施例提供一种备份恢复处理系统,该系统包括生产系统和备份系统,上述生产系统包括多个生产服务器,上述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;其中,上述主备份服务器为上述第十六方面及其可能的实施方式中的任一项上述服务器,上述从备份服务器为上述第十七方面及其可能的实施方式中的任一项上述服务器,上述生产服务器为上述第十八方面及其可能的实施方式中的任一项上述服务器。
第二十三方面,本发明实施例提供一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行以实现上述第一方面及其可能的实施方式中的任意一项上述的方法。
第二十四方面,本发明实施例提供一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行以实现上述第二方面及其可能的实施方式中的任意一项上述的方法。
第二十五方面,本发明实施例提供一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行以实现上述第三方面及其可能的实施方式中的任意一项上述的方法。
第二十六方面,本发明实施例提供一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行以实现上述第四方面及其可能的实施方式中的任意一项上述的方法。
第二十七方面,本发明实施例提供一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行以实现上述第五方面及其可能的实施方式中的任意一项上述的方法。
第二十八方面,本发明实施例提供一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行以实现上述第六方面及其可能的实施方式中的任意一项上述的方法。
第二十九方面,本发明实施例提供一种计算机程序产品,当上述计算机程序产品被计算机读取并执行时,上述第一方面及其可能的实施方式中任意一项上述方法、上述第二方面及其可能的实施方式中任意一项上述方法或上述第三方面及其可能的实施方式中任意一项上述方法将被执行。
第三十方面,本发明实施例提供一种计算机程序产品,当上述计算机程序产品被计算机读取并执行时,上述第四方面及其可能的实施方式中任意一项上述方法、上述第五方面及其可能的实施方式中任意一项上述方法或上述第六方面及其可能的实施方式中任意一项上述方法将被执行。
第三十一方面,本发明实施例提供一种计算机程序,当上述计算机程序在计算机上执行时,将会使上述计算机实现上述第一方面及其可能的实施方式中任意一项上述方法、上述第二方面及其可能的实施方式中任意一项上述方法或上述第三方面及其可能的实施方式中任意一项上述方法。
第三十二方面,本发明实施例提供一种计算机程序,当上述计算机程序在计算机上执行时,将会使上述计算机实现上述第四方面及其可能的实施方式中任意一项上述方法、上述第五方面及其可能的实施方式中任意一项上述方法或上述第六方面及其可能的实施方式中任意一项上述方法。
第三十三方面,本发明实施例提供一种装置,上述装置包括处理器和通信接口,上述装置被配置为执行上述第一方面及其可能的实施方式中任意一项上述方法、上述第二方面及其可能的实施方式中任意一项上述方法或上述第三方面及其可能的实施方式中任意一项上述方法。
在其中一种可能的实施方式中,上述装置为芯片或系统芯片SoC。
第三十四方面,本发明实施例提供一种装置,上述装置包括处理器和通信接口,上述装置被配置为执行上述第四方面及其可能的实施方式中任意一项上述方法、上述第五方面及其可能的实施方式中任意一项上述方法或上述第六方面及其可能的实施方式中任意一项上述方法。
在其中一种可能的实施方式中,上述装置为芯片或系统芯片SoC。
综上所述,本申请实施例提供了一种备份处理方法,相比于现有技术在不了解生产系统的信息的情况下,采用简单的均衡策略要求从每一个生产服务器上获取等量的待备份数据进行备份,导致生产服务器之间的内部转发严重,损耗服务器性能,本申请实施例根据对预先获取生产系统中的数据分布信息和/或资源消耗信息的分析结果将对整个生产系统的数据备份任务划分为多个备份子任务,每个备份子任务对应有负责备份的数据范围,然后将这些备份子任务分发给各自对应执行备份服务进行数据备份,能够提高备份的效率,减轻生产服务器的负担。此外,相比于现有技术只使用备份系统中的一个备份服务器对整个生产系统的数据进行备份,本申请实施例充分利用了备份系统的各个备份服务器对数据进行备份,从而极大地提高了备份的效率。
此外,本申请实施例还提供了一种备份恢复处理方法,本申请实施例根据生产服务器中各个生产服务器的资源消耗情况来确定向对应的生产服务器发送的待恢复的数据范围,且将这个备份恢复任务划分为多个子任务分发给备份系统中的多个服务器执行,因此在不妨碍生产的过程中提高了备份恢复的效率。
附图说明
以下对本发明实施例用到的附图进行介绍。
图1是现有技术中的一种备份系统架构示意图;
图2是本发明实施例提供的一种备份系统架构示意图;
图3是本发明实施例提供的一种备份处理方法的交互流程示意图;
图4是本发明实施例提供的一种备份处理方法的交互流程示意图;
图5是本发明实施例提供的一种备份系统架构示意图;
图6是本发明实施例提供的一种备份恢复处理方法的交互流程示意图;
图7是本发明实施例提供的一种备份恢复处理方法的交互流程示意图;
图8是本发明实施例提供的一种备份恢复系统架构示意图;
图9是本发明实施例提供的一种主备份服务器的逻辑结构示意图;
图10是本发明实施例提供的一种主备份服务器的硬件结构示意图;
图11是本发明实施例提供的一种从备份服务器的逻辑结构示意图;
图12是本发明实施例提供的一种从备份服务器的硬件结构示意图;
图13是本发明实施例提供的一种生产服务器的逻辑结构示意图;
图14是本发明实施例提供的一种生产服务器的硬件结构示意图。
具体实施方式
下面结合本发明实施例中的附图对本发明实施例进行描述。
为了更好的理解本发明实施例提供的一种备份处理方法及相关服务器,下面先对本发明实施例涉及的备份处理方法的系统构架进行描述。如图2所示的系统架构,可以包括生产系统201和备份系统202,其中,生产系统201包括多个生产服务器,备份系统202包括多个备份服务器。
本申请实施例涉及的生产系统201可以是各个行业的生产系统,这些生产系统可以生产数据或者用于存储数据等。生产系统201包括的多个生产服务器可以各自有自己的分工,生产或存储的数据可以不相同。生产系统201中数据的存储类型可以是共享的存储类型,也可以是分散的存储类型。
本申请实施例涉及的备份系统202用于从生产系统201中获取数据进行备份。备份系统202包括的多个备份服务器可以进行分工对生产系统201中的数据进行备份。
需要说明的是,本申请实施例提供的备份处理方法的系统构架不限于图2所示系统架构。
下面结合附图详细描述本申请实施例提供的备份处理方法。
请参见图3,图3是本发明实施例提供的一种备份处理方法,该方法可以基于图2所示的系统架构来实现,该方法包括但不限于如下步骤:
步骤301、生产系统中的生产服务器获取第一预设信息。
步骤302、该生产系统向主备份服务器发送上述第一预设信息。
在具体的实施例中,生产系统一般包括多个生产服务器,在对生产系统中的数据进行备份之前,可以先获取该生产系统中的第一预设信息,通过该第一预设信息分析了解生产系统中的数据分布情况和生产服务器的资源消耗情况中的一项或多项情况等等。
此外,备份系统包括多个备份服务器,其中一个或多个备份服务器为主备份服务器,其它的备份服务器则为从备份服务器。主备分服务器主要用于执行备份父任务,从备份服务器主要用于执行备份子任务,当然,主备份服务器也可以执行备份子任务。其中,备份父任务主要用于获取生产系统中的第一预设信息,根据第一预设信息划分出多个备份子任务分发给对应的备份服务器。备份子任务主要用于指示对应的备份服务器从对应的生产服务器中获取待备份数据进行存储备份。关于备份父任务和备份子任务,下面会详细介绍,此处暂不详述。
在其中一种可能的实施方式中,上述一个或多个主备份服务器可以是备份系统中多个备份服务器中的任意一个或多个,具体确定哪个为主备份服务器可以根据具体的情况确定,本方案对此不做限制。
需要说明的是,下面以一个主备份服务器为例介绍本发明实施例提供的备份处理方法,如果备份系统中存在多个主备份服务器,那么其它的主备份服务器所实现的功能可以与此一个主备份服务器的相同,本说明书不再赘述。
在其中一种可能的实施方式中,第一预设信息可以包括第一数据分布信息;或者,第一预设信息可以包括第一资源消耗信息;或者,第一预设信息可以包括第一数据分布信息和第 一资源消耗信息。其中:
第一数据分布信息可以包括生成该第一数据分布信息的时刻生产系统中待备份数据的分布情况。第一数据分布信息可以指示出生产系统中每一个生产服务器中需要备份的数据的容量和需要备份的数据的文件名等信息。
第一资源消耗信息可以包括生成该第一资源消耗信息的时刻生产系统中每一个生产服务器的资源消耗情况。该资源消耗情况可包括处理器CPU的占用情况、内存的使用情况和网络带宽,还可以包括每秒事务处理量(Transaction Per Second,TPS)的情况。
在其中一种可能的实施方式中,上述第一预设信息还可以包括生产系统的数据存储类型信息,例如是分散存储还是共享存储的信息。
在其中一种可能的实施方式中,生产系统中的生产服务器获取的第一预设信息可以是接收到主备份服务的获取指令之后该生产系统中的生产服务器各自获取各自的信息,然后各自发送给主备份服务器。也可以是生产系统以外的设备或装置从生产系统中的生产服务器中统一采集信息,最后得到第一预设信息,并由生产系统中的某个生产服务器统一将该第一预设信息发送给主备份服务器。
步骤303、上述主备份服务器根据上述第一预设信息划分多个备份子任务,上述备份子任务对应有执行备份服务器和执行生产服务器。
在具体的实施例中,备份子任务用于指示对应的执行备份服务器备份对应的执行生产服务器中目标范围的待备份数据。每一个备份子任务对应的执行备份服务器可以包括备份系统中的一个备份服务器,每一个备份子任务对应的执行生产服务器可以包括生产系统中的一个或多个生产服务器。
在具体实施例中,上述主备份服务器分析获取的第一预设信息,根据分析结果划分多个备份子任务。划分得到的每一个备份子任务可以对应有子任务标识号(identity document,ID)、执行该子任务的备份服务器(即上述的执行备份服务器)的信息、该子任务需要获取的待备份数据所在的生产服务器(即上述的执行生产服务器)的信息、该子任务需要获取的待备份数据的范围信息(例如待备份数据的容量大小、对应的文件名等信息)。可选的,划分得到的每一个备份子任务还可以对应有该子任务的初始备份速率的信息等等。该初始备份速率可以用于指示该子任务对应的执行备份服务器以该初始备份速率从对应的执行生产服务器中获取待备份数据。
可选的,上述生产服务器的信息可以包括服务器的名称、媒体访问控制地址和互联网协议地址中的一项或多项。上述备份服务器的信息可以包括服务器的名称、媒体访问控制地址和互联网协议地址中的一项或多项。
在其中一种可能的实施方式中,划分得到的每一个备份子任务中对应的执行备份服务器可以是一个,划分得到的每一个备份子任务中对应的执行生产服务器可以是一个或多个,即该子任务可以只负责从一个生产服务器上获取需要备份的数据进行备份,或者,该子任务还可以负责从多个生产服务器上分别获取该多个生产服务器中待备份的数据进行备份。
步骤304、上述主备份服务器将上述多个备份子任务发送给各自对应的执行备份服务器。
在具体的实施例中,由于主备份服务器划分的多个备份子任务各自对应有执行的备份服务器,因此,主备份服务器根据各自对应的执行备份服务器的信息将该多个备份子任务发送给对应的执行备份服务器。这里的执行备份服务器可以是从备份服务器。
步骤305、备份系统中的从备份服务器各自接收对应的备份子任务。
步骤306、备份系统中的从备份服务器根据接收的备份子任务向对应的执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息。
为了便于理解,下面以一个执行备份服务器(可以是从备份服务器)为例介绍接收到备份子任务之后执行备份服务器的具体操作,其它的执行备份服务器接收到备份子任务之后执行备份服务器的具体操作可以与该一个执行备份服务器相同。
在具体实施例中,执行备份服务器接收到的备份子任务可以是一个或多个,即如果每一个备份子任务对应有一个执行生产服务器,那么该执行备份服务器需要从一个或多个执行生产服务器中获取待备份数据以进行备份。下面以执行备份服务器接收到一个备份子任务为例进行说明。
执行备份服务器接收到备份子任务后,可以从该备份子任务中获取对应的执行生产服务器的信息以及需要从该对应的执行生产服务器中获取的待备份数据范围的信息。执行备份服务器获取到这些信息之后,根据这些信息生成待备份数据获取请求,该请求中可以携带需要从对应的执行生产服务器中获取的待备份数据范围的信息,然后执行备份服务器将该请求发送给上述对应的执行生产服务器。
可选的,上述执行备份服务器接收到的备份子任务还可以包括初始备份速率的信息,该信息用于指示上述执行备份服务器以该初始备份速率从对应的执行生产服务器中获取待备份数据进行备份。那么,执行备份服务器生成的待备份数据获取请求还可以携带上述初始备份速率的信息,以使得上述对应的执行生产服务器根据该初始备份速率向上述执行备份服务器发送待备份数据。
可选的,如果一个备份子任务中对应有多个执行生产服务器,那么该一个备份子任务中也对应包括需要从该多个执行生产服务器中获取的待备份数据范围的信息和/或对应包括从该多个执行生产服务器中获取待备份数据的多个初始备份速率。
步骤307、生产系统中的生产服务器接收各自对应的待备份数据获取请求。
步骤308、生产系统中的生产服务器根据各自对应的待备份数据范围的信息获取待备份数据。
步骤309、生产系统中的生产服务器将上述获取的待备份数据发送给各自对应的备份服务器。
下面以一个生产服务器接收到待备份数据获取请求之后如何操作为例进行介绍,其它的生产服务器接收到待备份数据获取请求之后的操作与此相同。
生产服务器接收到上述待备份数据获取请求之后,解析该请求获取待备份数据范围的信息,然后根据该范围信息获取待备份数据,然后,将获取的待备份数据发送给对应的带备份服务器。
在其中一种可能的实施方式中,如果上述待备份数据获取请求还有携带初始备份速率的信息,那么生产服务器解析该请求后获取该备份速率的信息,并将获取的待备份数据以该备份速率发送给对应的备份服务器。
可选的,如果上述生产服务器所在的生产系统的数据为共享存储的类型,那么生产服务器可以从该生产系统中的共享存储器中获取上述请求中对应的范围的数据发送给上述对应的执行备份服务器。
可选的,如果上述生产服务器所在的生产系统的数据为分散存储的类型,即生产系统中的数据分散存储在各个生产服务器中,那么生产服务器可以从该执行生产服务器的存储器中 获取上述请求中对应的范围的数据发送给上述对应的执行备份服务器。
在其中一种可能的实施方式中,上述主备份服务器也可以作为备份子任务的执行备份服务器,即主备份服务器将一个或多个备份子任务分发给自己执行。在上述步骤304将上述多个备份子任务发送给各自对应的执行备份服务器之后,主备份服务器根据上述一个或多个备份子任务向对应的执行生产服务器发送待备份数据获取请求;上述待备份数据获取请求包括待备份数据范围的信息,然后接收对应的执行生产服务器发送的待备份数据进行备份。本申请实施例中如何从生产服务器中获取待备份数据的具体实现可以参见步骤305至步骤309中对应的具体描述,此处不再赘述。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一数据分布信息,上述主备份服务器根据上述第一预设信息划分多个备份子任务,包括:上述主备份服务器根据上述第一数据分布信息划分上述多个备份子任务;上述目标范围的待备份数据包括根据上述第一数据分布信息中上述执行生产服务器的待备份数据的分布情况确定的数据。
在具体实施例中,如果上述第一预设信息包括第一数据分布信息,即包括生产系统中每一个生产服务器中对应的待备份数据的容量和文件名等信息,那么主备份服务器可以根据该生产系统中每一个生产服务器中对应的待备份数据的容量和文件名等信息来确定多个备份子任务负责备份的数据范围。
为了便于理解,举例说明。参见表1。
表1
生产服务器的名称 待备份数据的容量 待备份数据的文件名
生产服务器1 100G File_1、File_2…
生产服务器2 300G File_3、File_4…
生产服务器3 500G File_5、File_6…
生产服务器4 800G File_7、File_8…
表1中以表格的形式示例性地给出了生产系统中每一个生产服务器中对应的待备份数据的容量、文件名信息。假设生产系统包括四个生产服务器:生产服务器1、生产服务器2、生产服务器3和生产服务器4,这四个生产服务器对应的待备份数据容量分别为100G、300G、500G和200G,此外,表1中还对应给出了这四个生产服务器待备份数据的文件名,例如生产服务器1中待备份的文件名包括File_1、File_2等,由于文件名可能比较多,就不一一列出。
需要说明的是,待备份的数据可以是文件,也可以是记录信息、缓存信息等其它一切需要备份的数据,待备份的数据的格式和形式不限,根据具体情况对各种格式和形式的数据进行备份,本方案中对此不做限制。
假设上述第一预设信息包括表1中的信息,那么主备份服务器可以根据表1中的信息来划分多个备份子任务并确定各个子任务负责的数据范围,下面示例性地给出根据表1的信息划分子任务的方式:
方式一、主备份服务器可以根据表1的信息划分四个备份子任务,假设主备份服务器分配给这四个子任务的子任务ID可以分别为子任务1、子任务2、子任务3和子任务4,然后主备份服务器将生产服务器1、生产服务器2、生产服务器3和生产服务器4中待备份的数据分别对应分配给子任务1、子任务2、子任务3和子任务4负责备份,即与子任务1、子任务 2、子任务3和子任务4一一对应的执行生产服务器分别为生产服务器1、生产服务器2、生产服务器3和生产服务器4。假设备份系统中有备份服务器1、备份服务器2、备份服务器3、备份服务器4…,则主备份服务器可以将子任务1、子任务2、子任务3和子任务4一一对应分配给备份服务器1、备份服务器2、备份服务器3和备份服务器4执行,即子任务1、子任务2、子任务3和子任务4对应的执行备份服务器分别为备份服务器1、备份服务器2、备份服务器3和备份服务器4。分配完成后的每个子任务包括的信息可以参见表2。
表2
Figure PCTCN2020088880-appb-000001
在方式一中,每一个子任务对应有一个执行备份服务器和一个执行生产服务器,在备份系统中备份服务器充足的情况下,可以采用方式一的子任务划分方式,以充分利用备份服务器,避免资源的浪费。但是在备份服务器不够与生产服务器一一对应进行数据备份的情况下,可以一个备份服务对应多个生产服务器进行数据的备份,例如可以参见下面方式二的子任务划分方式。
方式二、假设备份系统中只有备份服务器1、备份服务器2和备份服务器3这三个备份服务器,则主备份服务器可以根据表1的信息划分三个备份子任务。假设主备份服务器分配给这三个子任务的子任务ID可以分别为子任务1、子任务2和子任务3,然后主备份服务器将生产服务器1和生产服务器2中待备份的数据分别对应分配给子任务1和子任务2负责备份,将生产服务器3和生产服务器4中待备份的数据分配给子任务3负责备份,即与子任务1和子任务2分别对应的执行生产服务器为生产服务器1和生产服务器2,而子任务3对应的执行生产服务器为生产服务器3和生产服务器4。然后,主备份服务器可以将子任务1、子任务2和子任务3对应分配给备份服务器1、备份服务器2和备份服务器3执行,即子任务1、子任务2和子任务3对应的执行备份服务器分别为备份服务器1、备份服务器2和备份服务器3。分配完成后的每个子任务包括的信息可以参见表3。
表3
Figure PCTCN2020088880-appb-000002
需要说明的是,方式二的子任务划分方式不一定是在备份服务器不够与生产服务器一一对应进行数据备份的情况下使用,也可以是其它的情况例如在生产服务器3和生产服务器4需要备份的数据量较少,一个备份服务器3完全可以快速实现其备份的情况下采用方式二的划分方式,当然还有其它情况可以采用方式二的划分方式,此处不再赘述。
在某个生产服务器中待备份数据较多的情况下,一个备份服务器可能备份不过来,可以分配多个备份服务器对应备份该生产服务器中的数据。例如可以参见下面方式三的子任务划分方式。
方式三、主备份服务器可以根据表1的信息划分五个备份子任务,假设主备份服务器分配给这五个子任务的子任务ID可以分别为子任务1、子任务2、子任务3、子任务4和子任务5,然后主备份服务器将生产服务器1、生产服务器2和生产服务器3中待备份的数据分别对应分配给子任务1、子任务2和子任务3负责备份,将生产服务器4中待备份的数据分配给子任务4和子任务5负责备份,即与子任务1、子任务2、子任务3、子任务4和子任务5一一对应的执行生产服务器分别为生产服务器1、生产服务器2、生产服务器3、生产服务器4和生产服务器4。假设备份系统中有备份服务器1、备份服务器2、备份服务器3、备份服务器4、备份服务器5…,则主备份服务器可以将子任务1、子任务2、子任务3、子任务4和子任务5对应分配给备份服务器1、备份服务器2、备份服务器3、备份服务器4和备份服务器5执行,即与子任务1、子任务2、子任务3、子任务4和子任务5分别对应的执行备份服务器为备份服务器1、备份服务器2、备份服务器3、备份服务器4和备份服务器5。分配完成后的每个子任务包括的信息可以参见表4。
表4
Figure PCTCN2020088880-appb-000003
关于上述如何确定子任务4和子任务5负责的待备份的数据范围,一种方式可以是根据子任务4和子任务5各自对应的执行备份服务器的性能的强弱来决定,例如备份服务器4的性能较弱(CPU占用情况为80%,内存的占用情况为70%),而备份服务器5的性能较强(CPU占用情况为20%,内存的占用情况为30%),那么可以将生产服务器4中待备份数据的较少部分(如300G)分配给子任务4负责备份,将生产服务器4中待备份数据的较多部分(如500G)分配给子任务5负责备份。另一种方式也可以随机或者平均分配。这里只是举例说明,在具体实施例中如何分配可以根据具体的情况确定,本方案对此不做限定。
方式三中子任务4对应有两个执行备份服务器,即采用两个备份服务器去备份一个生产服务器中的待备份数据,以充分利用资源来提高备份的效率。
需要说明的是,上述只是示例性地介绍子任务的划分方式,具体的子任务对应的执行备份服务器、执行生产服务器和需要备份的数据范围可以根据具体的情况确定,本方案对此不作限制。
在其中一种可能的实施方式中,上述第一预设信息包括上述第一资源消耗信息,上述主备份服务器根据上述第一预设信息划分多个备份子任务,包括:上述主备份服务器根据上述第一资源消耗信息划分上述多个备份子任务;上述备份子任务包括一个或多个初始备份速率的信息,上述一个或多个初始备份速率为根据上述第一资源消耗信息中上述备份子任务对应 的一个或多个生产服务器的资源消耗情况对应设置的备份初始速率,上述初始备份速率的信息用于指示以上述初始备份速率从上述初始备份速率对应的生产服务器中备份数据。
在具体实施例中,如果上述主备份服务器获取的第一预设信息中只包括第一资源消耗信息,即只包括获取该第一资源消耗信息时生产系统中每一个生产服务器对应的处理器CPU的占用情况、内存的使用情况和网络带宽,还可以包括每秒事务处理量(Transaction Per Second,TPS)的情况等,那么主备份服务器可以根据获取的第一资源消耗信息划分备份子任务。
具体的,如果一个生产服务器的CPU被占用的越多和/或内存被使用的越多,则表明该生产服务器的负载越重;如果一个生产服务器的网络带宽越小和/或每秒事务处理量越小,则表明该生产服务器的性能越差。在主备份服务器已知生产系统中需要备份的数据范围和总量,但不知道生产系统中每一个生产服务器中的待备份数据的范围和数量的情况下,主备份服务器在划分备份子任务时可以给负载较重和/或性能较差的生产服务器对应分配较小范围和数量的备份数据,可以给负载较轻和/或性能较好的生产服务器对应分配较大范围和数量的备份数据。
为了便于理解,下面举例说明。参见表5,表5示例性地给出了生产系统中各个生产服务器的资源消耗情况。
表5
生产服务器的名称 CPU占用情况 内存的使用情况 网络带宽 每秒事务处理量
生产服务器1 10% 50% 100M 2000
生产服务器2 35% 40% 50M 1000
生产服务器3 50% 55% 20M 500
生产服务器4 75% 65% 10M 200
通过分析表5中的信息可以发现,生产服务器1、生产服务器2、生产服务器3和生产服务器4对应的负载越来越重、性能越来越差。假设已知的生产系统中需要备份的数据量为1000G,这1000G包括file-1、file-2、file-3、…、file-1000这1000个文件,假设每个文件的容量为1G。那么,主备份服务器可以根据上述分析结果划分备份子任务。划分完成后的每个子任务包括的信息可以参见表6。
表6
Figure PCTCN2020088880-appb-000004
在表6中,主备份服务器可以划分四个子任务,每个子任务对应一个生产服务器。假设这四个子任务的任务ID分别为子任务1、子任务2、子任务3和子任务4。子任务1、子任务2、子任务3和子任务4对应的执行生产服务器可以分别为生产服务器1、生产服务器2、生产服务器3和生产服务器4;子任务1、子任务2、子任务3和子任务4对应的执行备份服务器可以分别为备份服务器1、备份服务器2、备份服务器3和备份服务器4。由于生产服务器 1、生产服务器2、生产服务器3和生产服务器4对应的负载越来越重、性能越来越差,因此,主备份服务器在划分备份子任务的时候,分配给子任务1、子任务2、子任务3和子任务4从各自对应的生产服务器1、生产服务器2、生产服务器3和生产服务器4获取的待备份数据的范围越来越小,例如可以分别对应是“450G,File_1、File_2、…、File_450”、“300G,File_451、File_452、…、File_750”、“200G,File_751、File_752、…、File_950”和“50G,File_951、File_952、…、File_1000”。
需要说明的是,表6中划分的每个子任务需要获取的待备份数据的范围只是示例性地,也可以是其它的比例划分,例如子任务1、子任务2、子任务3和子任务4分别对应的需要获取的待备份数据的范围可以是“500G,File_1、File_2、…、File_500”、“250G,File_501、File_452、…、File_750”、“200G,File_751、File_752、…、File_950”和“50G,File_951、File_952、…、File_1000”等等,具体的划分比例根据具体情况确定,本方案对此不做限制。
在其中一种可能的实施例中,主备分服务器除了可以根据第一资源消耗信息划分备份子任务负责备份的数据范围之外,还可以根据第一资源消耗信息确定每个备份子任务的初始备份速率。
为了便于理解本申请实施例,下面举例说明。
还是参见表5和表6,在表5中生产服务器1、生产服务器2、生产服务器3和生产服务器4对应的负载越来越重、性能越来越差,因此,在确定表6中对应的子任务1、子任务2、子任务3和子任务4的初始备份速率的时候,可以按子任务1、子任务2、子任务3和子任务4的顺序逐渐变慢。
例如,可以设置子任务1的初始备份速率为1兆比特每秒、设置子任务2的初始备份速率为500比特每秒、设置子任务3的初始备份速率为200比特每秒、设置子任务4的初始备份速率为100比特每秒。
或者,可以通过设置阈值来确定各个备份子任务的初始备份速率。例如,如果生产服务器的CPU占用情况小于等于20%,且网络带宽大于等于100M,那么,可以设置该生产服务器对应的备份子任务的初始速率为1兆比特每秒。如果生产服务器的CPU占用情况大于20%且小于等于40%,且网络带宽小于100M且大于等于50M,那么,可以设置该生产服务器对应的备份子任务的初始速率为500比特每秒。如果生产服务器的CPU占用情况大于40%且小于60%,且网络带宽小于50M且大于等于20M,那么,可以设置该生产服务器对应的备份子任务的初始速率为200比特每秒。如果生产服务器的CPU占用情况大于60%,且网络带宽小于20M,那么,可以设置该生产服务器对应的备份子任务的初始速率为100比特每秒。此处只是示例性地对如何确定备份恢复速率进行介绍,还存在其它的确定备份恢复速率的实施例,具体的确定方式根据具体的情况来确定,本方案对此不做限制。
需要说明的是,上述介绍的设置备份初始速率的举例是在一个备份子任务对应一个生产服务器的情况下来介绍的,如果一个备份子任务对应多个生产服务器时,可以根据该多个生产服务器各自的资源消耗情况设置各自的初始备份速率,即备份子任务对应有多个初始备份速率。
在具体实施例中,如果上述主备份服务器获取的第一预设信息中包括第一数据分布信息和第一资源消耗信息,那么主备份服务器可以根据第一数据分布信息来划分各个备份子任务负责备份的数据范围,然后根据第一资源消耗信息来确定各个备份子任务的初始备份速率。关于根据第一数据分布信息来划分各个备份子任务负责备份的数据范围的具体实现可以对应 参考表1至表4中的具体描述,此处不再赘述。关于根据第一资源消耗信息来确定各个备份子任务的初始备份速率的具体实现可以参见表5至表6中的具体描述,此处不再赘述。
在其中一种可能的实施方式中,上述主备份服务器接收上述第一预设信息之后,在整个备份过程完成之前,每隔第一预设时长,主备份服务器会获取最新的预设信息,该最新的预设信息可以包括上述生产系统中的最新的数据分布信息和最新的资源消耗信息中的一项或多项,还可以包括上述生产系统中的各个生产服务器最新的健康状态情况和/或上述备份系统中各个备份服务器最新的健康状态情况。然后分析这些信息以生成对应的备份子任务的调整信息,用于调整备份过程中的一些参数,保证生产服务器的生产服务和备份服务器的备份操作可以同时进行,并不影响生产服务器的生产。
在具体实施例中,由于生产系统中的生产一直在进行,因此待备份数据的分布信息可能会不断的变化,资源的消耗情况也在不断的变化,因此,在整个备份过程中,每隔第一预设时长主备份服务器都可以从生产系统中获取最新的数据分布情况和资源消耗情况中的一项或多项,以调整备份的一些参数,实现备份和生产两不误的目的。具体的,上述第一预设时长可以是五分钟、十分钟、半个小时等等,具体的第一预设时长根据具体的情况确定,本方案对此不做限制。
可选的,上述主备份服务器每隔第一预设时长获取的信息可以是和生产系统直接交互获取的,也可以是其它设备先从生产系统中获取这些信息后,发送给该主备份服务器的。
下面结合图4,以上述主备份服务器获取第一预设信息之后,隔了上述第一预设时长后,获取到第二预设信息为例介绍如何根据这些信息生成对应备份子任务的调整信息,该第二预设信息包括第二数据分布信息、第二资源消耗信息和服务器的健康状态信息中的一项或多项。
其中,第二数据分布信息可以包括上述生产系统中的最新的数据分布信息,该信息可以为生成该第二数据分布信息的时刻生产系统中的数据分布信息;第二资源消耗信息可以包括上述生产系统中的最新的资源消耗信息,该信息可以为生成该第二资源消耗信息的时刻生产系统中的资源消耗信息;服务器的健康状态信息可以包括上述生产系统中的各个生产服务器最新的健康状态情况和/或上述备份系统中各个备份服务器最新的健康状态情况,该情况可以为获取该服务器的健康状态信息的时刻上述生产系统中的各个生产服务器的健康状态情况和/或上述备份系统中各个备份服务器的健康状态情况。
需要说明的是,上述获取第二预设信息之后每隔第一预设时长再获取的生产系统中最新的数据分布情况和资源消耗情况等信息的处理方式可以与此相同。
在图4中,可以包括但不限于如下步骤:
步骤401、上述生产系统获取第二预设信息。
步骤402、上述生产系统向主备份服务器发送上述第二预设信息。
在具体的实施例中,上述生产系统获取第二预设信息的方式可以与获取上述第一预设信息的方式相同。当第二预设信息包括上述生产系统中的各个生产服务器的健康状态情况和/或上述备份系统中各个备份服务器的健康状态情况的时候,生产系统的各个生产服务器可以各自获取各自的健康状态情况分别发送给主备份服务器,或者由某一个服务器或设备(例如专用于监控生产系统中各个生产服务器的健康状态的服务器)采集好生产系统中的健康状态信息,然后再由生产系统中的某个服务器集中发送给主备份服务器。此外,主备份服务器可以主动采集备份系统中各个备份服务器的健康状态情况,例如,可以向备份服务器发送健康状态获取请求,备份服务器接收到请求后获取自身的健康状态信息发送给主备份服务器;或者, 备份系统中有专用于监控各个备份服务器的健康状态的服务器,那么主备份服务器可以从该服务器中获取到各个备份服务器的健康状态。
步骤403、上述主备份服务器在根据上述第二预设信息分析出多个备份子任务中的目标备份子任务需要调整的情况下,上述主备份服务器根据上述第二预设信息生成针对上述目标备份子任务的调整信息。
步骤404、上述主备份服务器将上述调整信息发送给上述目标备份子任务对应的执行备份服务器。
在其中一种可能的实施方式中,如果上述获取的第二预设信息包括上述第二数据分布信息,例如可以是生成该第二数据分布信息的时刻生产系统中各个生产服务器的待备份数据的容量、文件名等信息,那么主备份服务器可以将这些信息与上述第一数据分布信息进行比较。具体的,将第二数据分布信息中包括的各个生产服务器的信息以生产服务器为对象对应与第一预设数据分布信息中包括的各个生产服务器的信息进行比较,即将相同的生产服务器在不同时刻获取到的数据进行比较,例如第二数据分布信息包括的第一生产服务器的信息与第一数据分布信息包括的第一生产服务器的信息进行比较、第二数据分布信息包括的第二生产服务器的信息与第一数据分布信息包括的第二生产服务器的信息进行比较等等。
如果比较后发现有生产服务器的待备份数据的范围(容量和/或文件等)出现了变动,那么主备份可以根据变动的情况生成该生产服务器对应的备份子任务的调整信息,并将生成的调整信息发送给对应的执行备份服务器。
例如,在第一数据分布信息中第一生产服务器的待备份数据范围为容量100G、文件名为file1和file2的数据范围,但是在第二数据分布信息中第一生产服务器的待备份数据范围为容量90G、文件名为file2和file3的数据范围,即在获取第一数据分布信息之后,获取第二数据分布信息之前,该第一生产服务器又产生了file3需要备份,而这段时间已经完成了file1的备份。因此,主备份服务器可以针对第一生产服务器对应的备份子任务生成调整后的待备份数据范围,即容量90G、文件名为file2和file3的数据范围。然后,主备份服务器将该调整后的数据范围发送给对应的执行备份服务器。此处只是举例说明,还存在其它可能实施的范围变动情况,生成的调整后的数据范围可以根据具体的情况而定,本方案对此不做限制。
在其中一种可能的实施方式中,如果上述获取的第二预设信息包括上述第二资源消耗信息,即包括获取该第二资源消耗信息时生产系统中每一个生产服务器对应的处理器CPU的占用情况、内存的使用情况和网络带宽,还可以包括每秒事务处理量(Transaction Per Second,TPS)的情况等。那么主备份服务器可以将这些信息与上述第一资源消耗信息进行比较。具体的,将第二资源消耗信息中包括的各个生产服务器的信息以生产服务器为对象对应与第一预设资源消耗信息中包括的各个生产服务器的信息进行比较,即将相同的生产服务器在不同时刻获取到的数据进行比较,例如第二资源消耗信息包括的第一生产服务器的信息与第一资源消耗信息包括的第一生产服务器的信息进行比较、第二资源消耗信息包括的第二生产服务器的信息与第一资源消耗信息包括的第二生产服务器的信息进行比较等等。
如果比较后发现有生产服务器的资源消耗情况(CPU的占用情况、内存的使用情况和网络带宽等中的一项或多项)出现了变动,那么主备份可以根据变动的情况生成该生产服务器对应的备份子任务的调整信息,并将生成的调整信息发送给对应的执行备份服务器。
例如,在第一资源消耗信息中第一生产服务器的CPU的占用情况为10%、内存的使用情况为20%,但是在第二资源消耗信息中第一生产服务器的CPU的占用情况为50%、内存的使 用情况为60%,即在获取第一资源消耗信息之后,获取第二资源消耗信息之前,该第一生产服务器的CPU的占用情况增加了50%,内存的使用情况增加了40%,即在这段时间该第一生产服务器的生产负载加重了。此时,为了不影响该第一生产服务器的生产服务,即不和生产服务抢占资源,那么主备份服务器可以将该第一生产服务器向对应的执行备份服务器发送待备份数据的速率调低,然后生成该第一生产服务器对应的备份子任务的调整后的备份速率。并将调整后的备份速率发送给对应的执行备份服务器。此处只是举例说明,还存在其它可能的实施例,可以根据具体情况而定,本方案对此不做限定。
此外,如果比较发现第一生产服务器的负载减轻了,那么为了充分利用生产服务器的资源,提高利用率,主备份服务器可以将该第一生产服务器向对应的执行备份服务器发送待备份数据的速率调高,然后生成该第一生产服务器对应的备份子任务的调整后的备份速率。并将调整后的备份速率发送给对应的执行备份服务器。
可选的,可以通过设置阈值来确定调整的备份速率,例如,上述两次获取的资源消耗情况比较后,如果生产服务器的CPU占用情况增加10%至20%、内存的使用情况增加10%至20%,那么主备份服务器可以将该第一生产服务器向对应的执行备份服务器发送待备份数据的速率调低20%,即假设初始备份速率为1M比特每秒,调低20%之后则为800比特每秒。如果生产产服务器的CPU占用情况减少10%至20%、内存的使用情况减少10%至20%,那么主备份服务器可以将该第一生产服务器向对应的执行备份服务器发送待备份数据的速率调高20%,即假设初始备份速率为1兆比特每秒,调高20%之后则为1.2兆比特每秒。特此说明,此处只是举例说明,还存在其它阈值的设定情况,具体如何设置根据具体的情况而定,本方案对此不做限定。
在其中一种可能的实施方式中,如果上述第二预设信息中包括上述生产系统中的各个生产服务器的健康状态情况,那么如果该生产系统中某个生产服务器出现了故障,主备份服务器可以从其它运行正常的生产服务器中获取需要从该生产服务器中获取的待备份数据以继续备份。具体的,主备份服务器将该生产服务器对应的备份子任务中的执行生产服务器调整为其它正常运行的生产服务器,然后生成调整后的生产服务器的信息,将该调整后的生产服务器的信息发送给该备份子任务对应的执行备份服务器。需要说明的是,调整后的执行生产服务器有足够的性能代替故障的生产服务器向备份服务器发送待备份数据。
在其中一种可能的实施方式中,如果上述第二预设信息中包括上述备份系统中的各个备份服务器的健康状态情况,那么如果该备份系统中某个执行备份服务器出现了故障,主备份服务器可以将该出现了故障的执行备份服务器负责的备份子任务分配给其它运行正常的执行备份服务器继续执行,以保证整个备份过程按时顺利完成。具体的,主备份服务器将该某个执行备份服务器对应的备份子任务中的执行备份服务器调整为其它正常运行的备份服务器,然后生成调整后的备份服务器的信息,将该调整后的备份服务器的信息以及该备份子任务发送给该备份子任务对应的执行备份服务器。
步骤405、上述执行备份服务器接收上述调整信息。
步骤406、上述执行备份服务器根据上述调整信息调整待备份数据获取请求。
步骤407、上述执行备份服务器发送上述调整后的待备份数据获取请求给上述目标备份子任务对应的执行生产服务器。
在具体实施例中,对应的执行备份服务器接收到主备份服务器发送的子任务调整信息之后,根据该调整信息生成调整后的待备份数据请求。如果该调整信息包括调整后的待备份数 据范围的信息,那么生成的调整后的待备份数据请求携带该调整后的待备份数据范围的信息。如果该调整信息包括调整后的待备份速率的信息,那么生成的调整后的待备份数据请求携带该调整后的待备份速率的信息。如果该调整信息包括调整后的生产服务器的信息,那么生成的调整后的待备份数据请求携带该调整后的生产服务器的地址信息,该地址信息用于指示将该请求发送到哪个生产服务器。
步骤408、上述执行生产服务器接收上述调整后待备份数据获取请求。
步骤409、上述执行生产服务器根据上述调整后待备份数据获取请求获取待备份数据。
步骤410、上述执行生产服务器将上述获取的待备份数据发送给上述执行备份服务器。
在具体实施例中,对应的执行生产服务器接收到上述对应的执行备份服务器发送的调整后的待备份数据请求之后,根据该请求获取待备份的数据。如果该请求携带调整后的待备份数据范围的信息,那么该对应的执行生产服务器根据该调整后的待备份数据范围获取待备份数据,然后将获取的待备份数据发送给对应的执行备份服务器。如果该请求携带调整后的待备份速率的信息,那么该对应的执行生产服务器将获取的待备份数据以该调整后的待备份速率发送给对应的执行备份服务器。
为了便于理解本申请方案,将提供如下一种实施方式,该实施方式是基于图3和/或图4所述方法的思想给出的最优实施例。
参见图5,图5为本申请实施例提供的一种适用于备份处理方法的系统库框架示意图。图5所述的系统框架示意图可以是图1所示系统框架的一个具体框架的示意图。
如图5所述,该系统包括生产系统和备份系统。其中,生产系统可以包括三个生产服务器(生产服务器1、生产服务器2和生产服务器3),每个生产服务器包括监测模块、生产层、获取模块和传输模块;备份系统可以包括三个备份服务器(备份服务器1、备份服务器2和备份服务器3)、调度器和备份存储器,每个备份服务器包括父任务创建模块、分析模块、子任务分发模块、子任务创建模块、传输模块、处理模块和备份模块。
此外,在图5中,备份服务器1为主备份服务器,备份服务器2和备份服务器3为从备份服务器。需要说明的是,主备份服务器可以是备份系统中多个备份服务器中的任意一个或多个,可以由调度器来确定。
下面介绍生产服务器和备份服务器各个模块以及调度器的在数据备份过程中用途。
生产服务器中的监测模块:用于实时监测获取生产服务器中数据的分布情况以及生产服务器中的资源消耗情况,并将获取的情况信息发送给主备份服务器。
生产服务器中的生产层:主要用于生产数据,可以从生产层获取待备份数据。
生产服务器中的获取模块:用于获取生产服务器中的待备份数据。
生产服务器中的传输模块:用于将获取模块获取的待备份数据传输到对应的备份服务器。
备份系统中的调度器:用于调度各个备份服务器对生产系统中的数据进行备份。
备份服务器的父任务创建模块:用于创建备份父任务,该备份父任务主要用于完成两大项任务。一项是向备份存储器写入本次备份对象即生产系统的名称和ID、本次备份的时间戳以及本次备份的类型例如是增量备份还是全量备份等;另一项是分析从生产系统中获取的生产服务器中数据的分布情况以及生产服务器中的资源消耗情况,然后划分子任务和分发子任务。
备份服务器的分析模块:用于接收和分析生产服务器中的监测模块发送的信息,可以根 据负载和数据分布情况决定子任务分布、每个子任务与生产服务器的对应关系、每个子任务的生产数据获取范围、实时调整每个子任务的责任范围和子任务的生命周期等等。还可以用于实时分析生产服务器中的监测模块发送的信息,并生成对应的子任务的调整信息。
备份服务器的子任务分发模块:用于将划分好的子任务对应分发给备份系统中的备份服务器,还可以实时将子任务的调整信息发送给对应的备份服务器。
备份服务器的子任务创建模块:用于根据接收到的备份子任务创建指令创建备份子任务,然后向对应的生产服务器发送待备份数据获取请求;还可以用于接收实时的子任务调整信息,并根据调整的信息调整子任务的执行。
备份服务器的传输模块:用于接收对应的生产服务器传输过来的待备份数据。
备份服务器的处理模块:用于处理传输模块接收到的待备份数据,例如对数据进行压缩、重删等操作。
备份服务器的备份模块:用于将处理模块处理之后的数据存储到备份存储器中。
下面结合图5示例性地介绍本申请实施例提供的备份处理方法的流程,该方法的可以包括如下步骤:
①备份服务器1的父任务创建模块接收调度器发送的备份指令,该备份指令用于指示将对生产系统的数据的备份任务下发给备份服务器1,即将备份服务器1作为主备份服务器,其它服务器(备份服务器2和备份服务器3)作为从服务器协助主备份服务完成对生产系统中的数据的备份。
②父任务创建模块接收到上述备份指令之后,根据指令生成备份父任务,并触发分析模块获取生产系统中的数据的分布信息以及资源消耗信息,还可以获取生产系统的数据存储类型信息。
③分析模块响应于父任务创建模块的触发向生产系统中的各个生产服务器发送信息获取指令,该信息获取指令用于触发监测模块获取生产服务器中的数据分布信息和资源消耗信息,还可以获取生产系统的数据存储类型信息。
④各个生产服务器接收到分析模块发送的信息获取指令后,分别触发监测模块获取各自的数据分布信息和资源消耗信息发送给分析模块,还可以获取生产系统的数据存储类型信息发送给分析模块。
⑤分析模块根据接收到的各个生产服务器的数据分布信息和资源消耗信息,还可以根据接收到生产系统的数据存储类型信息,同时,结合各个备份服务器的情况(例如备份服务器的数量、每个备份服务器的性能等)划分出多个备份子任务。每一个备份子任务都对应有标识号、执行备份服务器、执行生产服务器、负责备份的数据范围以及初始性能指标例如初始备份速率等信息。
⑥分析模块划分完多个备份子任务之后,触发子任务分发模块向各个备份子任务对应的执行备份服务器(即备份服务器1、备份服务器2和备份服务器3)发送子任务创建指令,该指令可以携带对应的备份子任务包括的信息,例如标识号、执行备份服务器、执行生产服务器、负责备份的数据范围以及初始性能指标例如初始备份速率等信息。
⑦各个执行备份服务器接收到主备份服务器的子任务分发模块发送的子任务创建指令之后,触发各自的子任务创建模块创建子任务,并生成待备份数据获取请求,该请求用于向对应的生产服务器请求获取待备份数据,且该请求可以携带对应的生产服务器中待备份数据的数据范围的信息和初始备份速率的信息。
⑧执行备份服务器的子任务创建模块生成待备份数据获取请求之后,触发自身的传输模将该请求发送到对应的执行生产服务器的传输模块中。
⑨该对应的执行生产服务器接收到上述待备份数据获取请求之后,触发自身的获取模块根据待备份数据的数据范围的信息从生产层获取待备份数据,然后将获取的待备份数据传输道传输模块。
⑩该对应的执行生产服务器通过传输模块将获取的待备份数据以上述请求中携带的初始备份速率发送给对应的执行备份服务器的传输模块。
Figure PCTCN2020088880-appb-000005
该对应的执行备份服务器的传输模块接收执行生产服务器发送的待备份数据之后,将该数据传输到处理模块,处理模块对数据进行压缩、重删等处理操作。
Figure PCTCN2020088880-appb-000006
上述处理模块将处理后的数据传输到备份模块。
Figure PCTCN2020088880-appb-000007
上述备份模块将接收到的数据保存到备份存储器中。
在其中一种可能的实施方式中,在整个备份过程中,主备份服务器的分析模块可以每隔第一预设时长向生产系统的各个生产服务器获取数据分布信息和资源消耗信息,然后通过分析模块分析最新获取的信息,如果最新获取的信息跟上一次获取的信息出现了变动,那么可以根据这些变动生成对应的备份子任务的调整信息,并通过子任务分发模块将这些调整信息发送给对应的执行备份服务器的子任务创建模块,然后该对应的执行备份服务器的子任务创建模块根据调整信息生产调整后的待备份数据获取请求,通过传输模块将该请求发送给对应的执行生产服务器,以使的该对应的生产服务器根据该请求获取待备份数据发送给该对应的执行备份服务器以进行备份。
上述结合图5介绍的方法步骤及其可能的实施例中具体的描述和有益效果可以对应参见图3和图4所述方法的描述,此处不再赘述。
下面结合附图详细描述本申请实施例提供的备份恢复处理方法。
请参见图6,图6是本发明实施例提供的一种备份恢复处理方法,该方法可以基于图2所示的系统架构来实现,该方法包括但不限于如下步骤:
步骤601、生产系统中的生产服务器获取第一信息。
步骤602、该生产系统向主备份服务器发送上述第一信息。
在具体实施例中,上述第一信息可以包括生产系统中多个生产服务器各自对应的第一资源消耗情况。该生产服务器的第一资源消耗情况可以为生成该第一资源消耗情况的时刻该生产服务器的资源消耗情况,该资源消耗情况可包括该生产服务器的处理器CPU的占用情况、内存的使用情况和外存的使用情况。
此处获取第一信息的具体方式可以与上述步骤301中获取第一预设信息的方式相同,可以参见对应的描述,此处不再赘述。
步骤603、上述主备份服务器根据所述第一信息划分多个备份恢复子任务,所述备份恢复子任务对应有执行备份服务器和执行生产服务器。
步骤604、上述主备份服务器将所述多个备份恢复子任务发送给各自对应的执行备份服务器。
具体的,备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示所述执行备份服务器向所述执行生产服务器发送预设范围的数据,以使得将备份系统中的数据恢复到生产系统中。
在具体实施例中,上述主备份服务器分析获取的第一信息,根据分析结果划分多个备份恢复子任务。划分得到的每一个备份恢复子任务可以对应有子任务标识号(identity document,ID)、执行该子任务的备份服务器(即上述的执行备份服务器)的信息、接收该子任务发送的待恢复数据的生产服务器(即上述的执行生产服务器)的信息、该子任务需要向执行生产服务器发送的数据的范围信息(例如待恢复数据的容量大小、对应的文件名等信息)。可选的,划分得到的每一个备份恢复子任务还可以对应有该子任务的初始备份恢复速率的信息等等。该初始备份恢复速率可以用于指示该子任务对应的执行备份服务器以该初始备份恢复速率向对应的执行生产服务器发送待恢复数据。
可选的,上述生产服务器的信息可以包括服务器的名称、媒体访问控制地址和互联网协议地址中的一项或多项。上述备份服务器的信息可以包括服务器的名称、媒体访问控制地址和互联网协议地址中的一项或多项。
在其中一种可能的实施方式中,划分得到的每一个备份恢复子任务中对应的执行备份服务器可以是一个,划分得到的每一个备份恢复子任务中对应的执行生产服务器可以是一个或多个,即该子任务可以只向一个生产服务器发送需要恢复的数据,或者,该子任务还可以负责向多个生产服务器分别发送待恢复的数据。
步骤605、备份系统中的从备份服务器各自接收对应的备份恢复子任务。
步骤606、备份系统中的从备份服务器根据接收的备份恢复子任务向对应的执行生产服务器发送数据。
在具体的实施例中,由于主备份服务器划分的多个备份恢复子任务各自对应有执行的备份服务器,因此,主备份服务器根据各自对应的执行备份服务器的信息将该多个备份恢复子任务发送给对应的执行备份服务器。这里的执行备份服务器可以是从备份服务器。
执行备份服务器接收到主备份服务器发送的备份恢复子任务之后,可以根据该备份恢复子任务从备份系统的存储器中获取该备份恢复子任务需要向对应的执行生产服务器发送的数据,然后将这些数据发送给该对应的执行生产服务器。
可选的,上述执行备份服务器接收到的备份恢复子任务还可以包括初始备份恢复速率的信息,那么,上述执行备份服务器根据该初始备份恢复速率向上述执行生产服务器发送待恢复的数据。
可选的,如果一个备份恢复子任务中对应有多个执行生产服务器,那么该一个备份恢复子任务中也对应包括需要向该多个执行生产服务器发送的待恢复的数据范围的信息和/或对应包括向该多个执行生产服务器发送待恢复数据的多个初始备份恢复速率。
在其中一种可能的实施方式中,上述主备份服务器也可以作为备份恢复子任务的执行备份服务器,即主备份服务器将一个或多个备份恢复子任务分发给自己执行。在上述步骤604将上述多个备份恢复子任务发送给各自对应的执行备份服务器之后,主备份服务器根据上述一个或多个备份恢复子任务向对应的执行生产服务器发送待恢复数据。本申请实施例中如何向生产服务器发送待恢复数据的具体实现可以参见步骤605至步骤606中对应的具体描述,此处不再赘述。
在其中一种可能的实施方式中,上述主备份服务器根据上述第一信息划分多个备份恢复子任务,包括:上述主备份服务器根据上述第一信息确定上述多个生产服务器的负载轻重情况;上述主备份服务器根据上述多个生产服务器的负载轻重情况确定需要分别向上述多个生产服务器发送的数据范围;上述主备份服务器根据上述需要分别向上述多个生产服务器发送 的数据范围划分备份恢复子任务。
在具体实施例中,生产服务器的负载越重,备份服务器向该生产服务器发送的待恢复数据越少,生产服务器的负载越轻,备份服务器向该生产服务器发送的待恢复数据越多,可以根据各个生产服务器的负载情况分配需要向该各个生产服务器发送的待恢复数据。
为了便于理解本申请实施例,下面举例说明。请参见表7,表7示例性地给出了生产系统中各个生产服务器的资源消耗情况。
表7
生产服务器的名称 CPU占用情况 内存的使用情况 外存的使用情况
生产服务器1 10% 50% 30%
生产服务器2 35% 40% 45%
生产服务器3 50% 55% 50%
生产服务器4 75% 65% 60%
通过分析表7中的信息可以发现,生产服务器1、生产服务器2、生产服务器3和生产服务器4对应的负载越来越重、外存空间的使用越来越多。假设有100G的数据需要恢复到该生产系统中,这100G数据对应的文件的名称例如可以是file1、file2、file3和file4。文件file1、file2、file3和file4对应的数据大小例如可以分别40G、30G、20G和10G。假设备份系统包括备份服务器1、备份服务器2、备份服务器3、备份服务器4…。通过上述分析,主备份服务器可以将对上述生产系统的备份数据恢复任务划分为4个备份恢复子任务,每个子任务对应一个生产服务器。
假设这四个子任务的任务ID分别为子任务1、子任务2、子任务3和子任务4。子任务1、子任务2、子任务3和子任务4对应的执行生产服务器可以分别为生产服务器1、生产服务器2、生产服务器3和生产服务器4;子任务1、子任务2、子任务3和子任务4对应的执行备份服务器可以分别为备份服务器1、备份服务器2、备份服务器3和备份服务器4。由于生产服务器1、生产服务器2、生产服务器3和生产服务器4对应的负载越来越重、外存空间的使用越来越多,因此,主备份服务器在划分备份恢复子任务的时候,分配给子任务1、子任务2、子任务3和子任务4各自对应向生产服务器1、生产服务器2、生产服务器3和生产服务器4发送的待恢复数据的范围越来越小,例如可以分别对应是“40G,File1”、“30G,File2”、“20G,File3”和“10G,File4”。划分完成后的每个子任务包括的信息可以参见表8。
表8
Figure PCTCN2020088880-appb-000008
可选的,在上述备份恢复子任务的划分实施例中,也可以先不看生产服务器外存的使用情况,先根据生产服务器的负载的情况来划分备份恢复子任务,生产服务器的负载越轻,其对应的备份恢复子任务需要向该生产服务器发送的数据就越多。如果两个生产服务器的负载 情况相同,此时再看生产服务器外存的使用情况。在两个生产服务器的负载情况相同的情况下,生产服务器的外存使用越少,该生产服务器对应的备份恢复子任务需要向该生产服务器发送的数据多。具体发送的数据范围可以根据具体的情况确定。以上实施例都是以一个备份恢复子任务对应有一个执行生产服务器为例来描述的。
可选的,在上述备份恢复子任务的划分实施例中,也可以一个子任务对应有多个生产服务器,例如,主备份服务器可以根据表7划分3个备份恢复子任务,子任务1和子任务2包括的信息如表8所示不变,子任务3对应的执行备份服务器可以是备份服务器3、对应的执行生产服务器可以是生产服务器3和生产服务器4,那么子任务3需要发送的待恢复数据的范围包括“20G,File3”和“10G,File4”。当然,这只是示例性的描述,具体的划分可以根据具体的情况确定,本方案对此不做限定。
在其中一种可能的实施方式中,上述主备份服务器根据上述第一信息划分多个备份恢复子任务,包括:上述主备份服务器根据上述第一信息确定上述多个生产服务器各自对应的初始备份恢复速率,上述初始备份恢复速率为执行备份服务器向对应的执行生产服务器发送数据的初始速率;上述主备份服务器将上述多个生产服务器各自对应的初始备份恢复速率分配给上述多个生产服务器各自对应的备份恢复子任务。
为了便于理解本申请实施例本申请实施例,下面举例说明。
还是参见表7和表8,在表7中生产服务器1、生产服务器2、生产服务器3和生产服务器4对应的负载越来越重,因此,在确定表8中对应的子任务1、子任务2、子任务3和子任务4的初始备份恢复速率的时候,可以按子任务1、子任务2、子任务3和子任务4的顺序逐渐变慢。
例如,可以设置子任务1的初始备份恢复速率为1兆比特每秒、设置子任务2的初始备份恢复速率为500比特每秒、设置子任务3的初始备份恢复速率为200比特每秒、设置子任务4的初始备份恢复速率为100比特每秒。
或者,可以通过设置阈值来确定各个备份恢复子任务的初始备份恢复速率。例如,如果生产服务器的CPU占用情况小于等于20%,那么,可以设置该生产服务器对应的备份恢复子任务的初始速率为1兆比特每秒。如果生产服务器的CPU占用情况大于20%且小于等于40%,那么,可以设置该生产服务器对应的备份恢复子任务的初始速率为500比特每秒。如果生产服务器的CPU占用情况大于40%且小于60%,那么,可以设置该生产服务器对应的备份恢复子任务的初始速率为200比特每秒。如果生产服务器的CPU占用情况大于60%,那么,可以设置该生产服务器对应的备份恢复子任务的初始速率为100比特每秒。此处只是示例性地对如何确定备份恢复速率进行介绍,还存在其它的确定备份恢复速率的实施例,例如结合生产服务器的内存的使用情况来确定对应的备份恢复速率等等,具体的确定方式根据具体的情况来确定,本方案对此不做限制。
需要说明的是,上述介绍的设置备份恢复初始速率的举例是在一个备份恢复子任务对应一个生产服务器的情况下来介绍的,如果一个备份恢复子任务对应多个生产服务器时,可以根据该多个生产服务器各自的资源消耗情况设置各自的初始备份恢复速率,即备份恢复子任务对应有多个初始备份恢复速率。
在其中一种可能的实施方式中,上述主备份服务器接收上述第一信息之后,在整个备份恢复过程完成之前,每隔第二预设时长,主备份服务器会获取最新的信息,该最新的信息可以包括上述生产系统中最新的资源消耗信息中的一项或多项,还可以包括上述生产系统中的 各个生产服务器最新的健康状态情况和/或上述备份系统中各个备份服务器最新的健康状态情况。然后分析这些信息以生成对应的备份恢复子任务的调整信息,用于调整备份恢复过程中的一些参数,保证生产服务器的生产服务和备份服务器的备份恢复操作可以同时进行,并不影响生产服务器的生产。
在具体实施例中,由于生产系统中的生产一直在进行,因此资源的消耗情况也在不断的变化,因此,在整个备份恢复过程中,每隔第二预设时长主备份服务器都可以从生产系统中获取最新的资源消耗情况,以调整备份恢复过程的一些参数,实现备份和生产两不误的目的。具体的,上述预设时长可以是五分钟、十分钟、半个小时等等,具体的预设时长根据具体的情况确定,本方案对此不做限制。上述第二预设时长可以和上述第一预设时长相同,也可以不同。
可选的,上述主备份服务器每隔第二预设时长获取的信息可以是和生产系统直接交互获取的,也可以是其它设备先从生产系统中获取这些信息后,发送给该主备份服务器的。
下面结合图7,以上述主备份服务器获取第一信息之后,隔了上述第二预设时长后,获取到第二信息为例介绍如何根据这些信息生成对应备份恢复子任务的调整信息,该第二信息包括第二资源消耗信息和服务器的健康状态信息中的一项或多项。
其中,该第二资源消耗信息可以包括上述生产系统中的最新的资源消耗信息,该信息可以为生成该第二资源消耗信息的时刻生产系统中各个生产服务器各自对应的资源消耗情况;服务器的健康状态信息可以包括上述生产系统中的各个生产服务器最新的健康状态情况和/或上述备份系统中各个备份服务器最新的健康状态情况,该情况可以为获取该服务器的健康状态信息的时刻上述生产系统中的各个生产服务器的健康状态情况和/或上述备份系统中各个备份服务器的健康状态情况。
需要说明的是,上述获取第二信息之后每隔第二预设时长再获取的生产系统中最新资源消耗情况等信息的处理方式可以与此相同。
在图7中,可以包括但不限于如下步骤:
步骤701、上述生产系统获取第二信息。
步骤702、上述生产系统向主备份服务器发送上述第二信息。
在具体的实施例中,上述生产系统获取第二信息的方式可以与获取上述第一信息的方式相同。当第二信息包括上述生产系统中的各个生产服务器的健康状态情况和/或上述备份系统中各个备份服务器的健康状态情况的时候,生产系统的各个生产服务器可以各自获取各自的健康状态情况分别发送给主备份服务器,或者由某一个服务器或设备(例如专用于监控生产系统中各个生产服务器的健康状态的服务器)采集好生产系统中的健康状态信息,然后再由生产系统中的某个服务器集中发送给主备份服务器。此外,主备份服务器可以主动采集备份系统中各个备份服务器的健康状态情况,例如,可以向备份服务器发送健康状态获取请求,备份服务器接收到请求后获取自身的健康状态信息发送给主备份服务器;或者,备份系统中有专用于监控各个备份服务器的健康状态的服务器,那么主备份服务器可以从该服务器中获取到各个备份服务器的健康状态。
步骤703、上述主备份服务器在根据所述第二信息分析出多个备份恢复子任务中的目标备份恢复子任务需要调整的情况下,所述主备份服务器根据所述第二信息生成针对所述目标备份恢复子任务的调整信息。
步骤704、上述主备份服务器将所述调整信息发送给所述目标备份恢复子任务对应的执 行备份服务器。
在其中一种可能的实施方式中,如果上述获取的第二预设信息包括上述第二资源消耗信息,即包括获取该第二资源消耗信息时生产系统中每一个生产服务器对应的处理器CPU的占用情况、内存的使用情况和外存的情况等。那么主备份服务器可以将这些信息与上述第一信息进行比较。具体的,将第二资源消耗信息中包括的各个生产服务器的信息以生产服务器为对象对应与第一信息中包括的各个生产服务器的信息进行比较,即将相同的生产服务器在不同时刻获取到的数据进行比较,例如第二资源消耗信息包括的第一生产服务器的信息与第一信息包括的第一生产服务器的信息进行比较、第二资源消耗信息包括的第二生产服务器的信息与第一信息包括的第二生产服务器的信息进行比较等等。
如果比较后发现有生产服务器的资源消耗情况(CPU的占用情况、内存的使用情况和外存的使用情况中的一项或多项)出现了变动,那么主备份可以根据变动的情况生成该生产服务器对应的备份恢复子任务的调整信息,并将生成的调整信息发送给对应的执行备份服务器。
可选的,可以根据分析比较上述第二资源消耗信息和第一信息来确定是否调整备份恢复子任务中需要向对应的执行生产服务器发送的数据的范围。例如,在第一信息中第一生产服务器的CPU的占用情况为10%,但是在第二资源消耗信息中第一生产服务器的CPU的占用情况为50%,即在获取第一信息之后,获取第二资源消耗信息之前,该第一生产服务器的CPU的占用情况增加了50%,即在这段时间该第一生产服务器的生产负载加重了。此时,为了不影响该第一生产服务器的生产服务,即不和生产服务抢占资源,那么主备份服务器可以将发送给该第一生产服务器的待恢复数据的范围调小,然后生成该第一生产服务器对应的备份恢复子任务的调整后的需要向该第一生产服务器发送的数据的范围。并将调整后的数据范围的信息发送给对应的执行备份服务器。此处只是举例说明,还存在其它可能的实施例,可以根据具体情况而定,本方案对此不做限定。
此外,如果比较发现第一生产服务器的负载减轻了,那么为了充分利用生产服务器的资源,提高利用率,那么主备份服务器可以将发送给该第一生产服务器的待恢复数据的范围调大,然后生成该第一生产服务器对应的备份恢复子任务的调整后的需要向该第一生产服务器发送的数据的范围。并将调整后的数据范围的信息发送给对应的执行备份服务器。
需要说明的是,上述数据范围的调整也可以结合服务器的内存使用情况来确定,内存被使用的越多,负载越重,那么对应生产服务器接收到的待恢复数据的范围可以设置越小,内存被使用的越少,负载越轻,那么对应生产服务器接收到的待恢复数据的范围可以设置越大。
当然,上述范围的调整都需要保证生产服务器接收到待恢复数据的大小不大于该生产服务器剩余的外存储空间。
可选的,可以根据分析比较上述第二资源消耗信息和第一信息来确定是否调整备份恢复子任务中的备份恢复速率。例如,在第一信息中第一生产服务器的CPU的占用情况为10%,但是在第二资源消耗信息中第一生产服务器的CPU的占用情况为50%,即在获取第一信息之后,获取第二资源消耗信息之前,该第一生产服务器的CPU的占用情况增加了50%,即在这段时间该第一生产服务器的生产负载加重了。此时,为了不影响该第一生产服务器的生产服务,即不和生产服务抢占资源,那么主备份服务器可以将该第一生产服务器接收对应的执行备份服务器发送的待恢复数据的速率调低,即调低该对应的执行备份服务器向该第一生产服务器发送待恢复数据的速率,然后生成该第一生产服务器对应的备份恢复子任务的调整后的备份恢复速率。并将调整后的备份恢复速率发送给对应的执行备份服务器。此处只是举例说 明,还存在其它可能的实施例,可以根据具体情况而定,本方案对此不做限定。
此外,如果比较发现第一生产服务器的负载减轻了,那么为了充分利用生产服务器的资源,提高利用率,主备份服务器可以将该第一生产服务器接收对应的执行备份服务器发送的待恢复数据的速率调高,即调高该对应的执行备份服务器向该第一生产服务器发送待恢复数据的速率,然后生成该第一生产服务器对应的备份恢复子任务的调整后的备份恢复速率。并将调整后的备份恢复速率发送给对应的执行备份服务器。
可选的,可以通过设置阈值来确定调整的备份恢复速率,例如,上述两次获取的资源消耗情况比较后,如果生产服务器的CPU占用情况增加10%至20%,那么主备份服务器可以将该第一生产服务器向对应的执行备份服务器发送待备份数据的速率调低20%,即假设初始备份恢复速率为1M比特每秒,调低20%之后则为800比特每秒。如果生产服务器的CPU占用情况减少10%至20%,那么主备份服务器可以将该第一生产服务器向对应的执行备份服务器发送待备份数据的速率调高20%,即假设初始备份恢复速率为1兆比特每秒,调高20%之后则为1.2兆比特每秒。特此说明,此处只是举例说明,还存在其它阈值的设定情况,具体如何设置根据具体的情况而定,本方案对此不做限定。
需要说明的是,上述备份恢复速率的调整和确定也可以结合服务器的内存使用情况来确定,内存被使用的越多,负载越重,那么对应生产服务器的备份恢复速率可以设置越低,内存被使用的越少,负载越轻,那么对应生产服务器的备份恢复速率可以设置越高。
在其中一种可能的实施方式中,如果上述第二信息中包括上述生产系统中的各个生产服务器的健康状态情况,那么如果该生产系统中某个生产服务器出现了故障,主备份服务器可以将向该某个生产服务器发送的待恢复数据发送给其它运行正常的生产服务器以保证完成整个数据恢复的过程。具体的,主备份服务器将该生产服务器对应的备份恢复子任务中的执行生产服务器调整为其它正常运行的生产服务器,然后生成调整后的生产服务器的信息,将该调整后的生产服务器的信息发送给该备份恢复子任务对应的执行备份服务器。需要说明的是,调整后的执行生产服务器有足够的性能和存储空间接收故障的生产服务器的待恢复数据。
在其中一种可能的实施方式中,如果上述第二信息中包括上述备份系统中的各个备份服务器的健康状态情况,那么如果该备份系统中某个执行备份服务器出现了故障,主备份服务器可以将该出现了故障的执行备份服务器负责的备份恢复子任务分配给其它运行正常的执行备份服务器继续执行,以保证整个备份过程按时顺利完成。具体的,主备份服务器将该某个执行备份服务器对应的备份恢复子任务中的执行备份服务器调整为其它正常运行的备份服务器,然后生成调整后的备份服务器的信息,将该调整后的备份服务器的信息以及该备份恢复子任务发送给该备份恢复子任务对应的执行备份服务器。
步骤705、上述对应的执行备份服务器接收所述调整信息。
步骤706、上述对应的执行备份服务器根据所述调整信息向调整后的所述目标备份恢复子任务对应的执行生产服务器发送数据。
在具体实施例中,对应的执行备份服务器接收到上述调整信息后,分析该调整信息,如果该调整信息包括调整后的向对应的执行生产服务器发送待恢复数据的范围信息,那么该备份服务器根据该范围信息向对应的执行生产服务器发送数据。如果该调整信息包括调整后的备份恢复速率信息,那么该备份服务器以该备份恢复速率向对应的执行生产服务器发送数据。如果该调整信息包括调整后的对应的执行生产服务器的信息,那么该备份服务器根据该信息向调整后的执行生产服务器发送数据。
为了便于理解本申请方案,将提供如下一种实施方式,该实施方式是基于图6和/或图7所述方法的思想给出的最优实施例。
参见图8,图8为本申请实施例提供的一种适用于备份处理方法的系统库框架示意图。图8所述的系统框架示意图可以是图1所示系统框架的一个具体框架的示意图。图8所示的系统框架可以与图5所示的系统框架相同,图5所示的流程是基于该框架完成数据备份的过程,而图8所示的流程是基于该框架完成备份恢复的过程。
如图8所述,该系统包括生产系统和备份系统。其中,生产系统可以包括三个生产服务器(生产服务器1、生产服务器2和生产服务器3),每个生产服务器包括监测模块、生产层、获取模块和传输模块;备份系统可以包括三个备份服务器(备份服务器1、备份服务器2和备份服务器3)、调度器和备份存储器,每个备份服务器包括父任务创建模块、分析模块、子任务分发模块、子任务创建模块、传输模块、处理模块和备份模块。
此外,在图8中,备份服务器1为主备份服务器,备份服务器2和备份服务器3为从备份服务器。需要说明的是,主备份服务器可以是备份系统中多个备份服务器中的任意一个或多个,可以由调度器来确定。
下面介绍生产服务器和备份服务器各个模块以及调度器在备份数据恢复过程中的用途。
生产服务器中的监测模块:用于实时监测获取生产服务器中的资源消耗情况,并将获取的情况信息发送给主备份服务器。
生产服务器中的生产层:主要用于生产数据。
生产服务器中的传输模块:用于接收备份服务器发送的待恢复数据。
备份系统中的调度器:用于调度各个备份服务器对生产系统中的数据进行备份恢复。
备份服务器的父任务创建模块:用于创建备份父任务,该备份父任务主要用于完成两大项任务。一项是向备份存储器写入本次备份恢复对象即生产系统的名称和ID、本次备份恢复的时间戳等;另一项是分析从生产系统中获取的生产服务器中的资源消耗情况,然后划分子任务和分发子任务。
备份服务器的分析模块:用于接收和分析生产服务器中的监测模块发送的信息,可以根据生产服务器的负载和外存的使用情况决定子任务分布、每个子任务与生产服务器的对应关系、每个子任务负责发送的数据范围、实时调整每个子任务的责任范围和子任务的生命周期等等。还可以用于实时分析生产服务器中的监测模块发送的信息,并生成对应的子任务的调整信息。
备份服务器的子任务分发模块:用于将划分好的子任务对应分发给备份系统中的备份服务器,还可以实时将子任务的调整信息发送给对应的备份服务器。
备份服务器的子任务创建模块:用于根据接收到的备份恢复子任务创建指令创建备份恢复子任务,然后向对应的生产服务器发送待恢复的数据;还可以用于接收实时的子任务调整信息,并根据调整的信息调整子任务的执行。
备份服务器的传输模块:用于从备份存储器中获取待恢复数据传输给对应的生产服务器的传输模块。
除了上述介绍了具体功能的其它的模块在备份数据恢复过程中可以暂时不使用。
下面结合图8示例性地介绍本申请实施例提供的备份恢复处理方法的流程,该方法的可以包括如下步骤:
①备份服务器1的父任务创建模块接收调度器发送的备份恢复指令,该备份恢复指令用于指示将对生产系统的数据的备份恢复任务下发给备份服务器1,即将备份服务器1作为主备份服务器,其它服务器(备份服务器2和备份服务器3)作为从服务器协助主备份服务完成对生产系统的数据的备份恢复。
②父任务创建模块接收到上述备份恢复指令之后,根据指令生成备份恢复父任务,并触发分析模块获取生产系统中的资源消耗信息,还可以获取生产系统的数据存储类型信息。
③分析模块响应于父任务创建模块的触发向生产系统中的各个生产服务器发送信息获取指令,该信息获取指令用于触发监测模块获取生产服务器中的资源消耗信息,还可以获取生产系统的数据存储类型信息。
④各个生产服务器接收到分析模块发送的信息获取指令后,分别触发监测模块获取各自的资源消耗信息发送给分析模块,还可以获取生产系统的数据存储类型信息发送给分析模块。
⑤分析模块根据接收到的各个生产服务器的资源消耗信息,还可以根据接收到生产系统的数据存储类型信息,同时,结合各个备份服务器的情况(例如备份服务器的数量、每个备份服务器的性能等)划分出多个备份恢复子任务。每一个备份恢复子任务都对应有标识号、执行备份服务器、执行生产服务器、负责备份恢复的数据范围以及初始性能指标例如初始备份恢复速率等信息。
⑥分析模块划分完多个备份恢复子任务之后,触发子任务分发模块向各个备份恢复子任务对应的执行备份服务器(即备份服务器1、备份服务器2和备份服务器3)发送子任务创建指令,该指令可以携带对应的备份恢复子任务包括的信息,例如标识号、执行备份服务器、执行生产服务器、负责备份恢复的数据范围以及初始性能指标例如初始备份恢复速率等信息。
⑦各个执行备份服务器接收到主备份服务器的子任务分发模块发送的子任务创建指令之后,触发各自的子任务创建模块创建子任务,然后触发各自的传输模块根据各自创建的子任务的从备份存储其中获取待恢复数据。
⑧各个执行备份服务器的传输模块根据各自创建的子任务的从备份存储其中获取待恢复数据。
⑨各个执行备份服务器的传输模块将获取的数据发送给对应的执行生产服务器的传输模块。
然后,如果生产系统的数据存储类型为分散类型的话,各个生产服务器的传输模块将对应接收到的数据存储到各自对应的存储器中;如果生产系统的数据存储类型为共享类型的话,各个生产服务器的传输模块将对应接收到的数据存储到共享的存储器中。
在其中一种可能的实施方式中,在整个备份恢复过程中,主备份服务器的分析模块可以每隔第二预设时长向生产系统的各个生产服务器获取资源消耗信息,然后通过分析模块分析最新获取的信息,如果最新获取的信息跟上一次获取的信息出现了变动,那么可以根据这些变动生成对应的备份恢复子任务的调整信息,并通过子任务分发模块将这些调整信息发送给对应的执行备份服务器的子任务创建模块,然后该对应的执行备份服务器的子任务创建模块根据调整信息通过传输模块将待恢复数据发送给对应的执行生产服务器,以使的该对应的生产服务器进行备份数据的恢复。
上述结合图8介绍的方法步骤及其可能的实施例中具体的描述和有益效果可以对应参见图6和图7所述方法的描述,此处不再赘述。
上述主要从主备份服务器与从备份服务器之间、主备份服务器与生产服务器之间以及从备份服务器与生产服务器之间交互的角度对本申请实施例提供的方案进行了介绍。可以理解的是,各个服务器,例如主备份服务器、从备份服务器和生产服务器等为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的服务器及方法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
本申请实施例可以根据上述方法示例对主备份服务器、从备份服务器和生产服务器等进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
在采用对应各个功能划分各个功能模块的情况下,图9示出了上述实施例中所涉及的主备份服务器的一种可能的逻辑结构示意图,主备份服务器900包括:发送单元901、接收单元902和处理单元903。示例性的,发送单元901用于支持主备份服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中主备份服务器发送信息的步骤。接收单元902用于支持主备份服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中主备份服务器接收或获取信息的步骤。处理单元903,用于支持主备份服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中主备份服务器划分备份子任务、生成信息、调整信息的步骤,以及其他除发送单元901和接收单元902执行的步骤以外的其他步骤等。
可选的,该主备份服务器900还可以包括存储单元,用于存储计算机程序或者数据。一种可能的方式中,处理单元903可以调用存储单元的计算机程序或者数据,使得主备份服务器900获取第一预设信息;所述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;所述第一数据分布信息包括生产系统中待备份数据的第一分布情况;所述生产系统包括多个生产服务器;所述第一资源消耗信息包括所述多个生产服务器各自对应的第一资源消耗情况;然后,根据所述第一预设信息划分多个备份子任务;所述备份子任务对应有执行备份服务器和执行生产服务器,用于指示所述执行备份服务器备份所述执行生产服务器中目标范围的待备份数据;所述执行备份服务器包括所述备份系统中的备份服务器;所述执行生产服务器包括所述生产系统中的一个或多个生产服务器;并将所述多个备份子任务发送给各自对应的执行备份服务器。
可选的,该主备份服务器900还可以包括存储单元,用于存储计算机程序或者数据。一种可能的方式中,处理单元903可以调用存储单元的计算机程序或者数据,使得主备份服务器900获取第一信息;所述第一信息包括生产系统中多个生产服务器各自对应的第三资源消耗情况;再根据所述第一信息划分多个备份恢复子任务;所述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示所述执行备份服务器向所述执行生产服务器发送预设范围的数据;所述执行备份服务器包括所述备份系统中的备份服务器;所述执行生产服务器包括所述生产系统中的一个或多个生产服务器;然后,将所述多个备份恢复子任务发送给各自对应的执行备份服务器。
在硬件实现上,上述处理单元903可以为处理器或者处理电路等。发送单元901和接收 单元902可以耦合为收发器或者收发电路或者接口电路等。存储单元可以为存储器。上述处理单元、发送单元、接收单元和存储单元可以集成在一起,也可以分离。
图10所示,为本申请的实施例提供的上述实施例中所涉及的主备份服务器的一种可能的硬件结构示意图。如图10所示,主备份服务器1000可包括:一个或多个处理器1001、一个或多个存储器1002和通信模块1003(例如可以是一个或多个收发器)。这些部件可通过总线1004或者其他方式连接,图10以通过总线连接为例。其中:
通信模块1003可用于对处理器1001生成的信息或请求进行发送,例如生成的备份子任务或者待备份数据获取请求等。通信模块1003还可用于接收的数据,例如生产系统的数据分布信息或待备份数据等。
存储器1002可以和处理器1001通过总线1004或者输入输出端口耦合,存储器1002也可以与处理器1001集成在一起。存储器1002用于存储各种软件程序和/或多组指令或者数据。具体的,存储器1002可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器1002可以存储操作系统(下述简称系统),例如uCOS、VxWorks、RTLinux等嵌入式操作系统。
处理器1001可以是中央处理器单元,通用处理器,数字信号处理器,专用集成电路,现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现确定功能的组合,例如包含一个或多个微处理器组合,数字信号处理器和微处理器的组合等等。
本申请实施例中,处理器1001可用于读取和执行计算机可读指令。具体的,处理器1001可用于调用存储于存储器1002中的程序,例如本申请的一个或多个实施例提供的备份处理方法在主备份服务器1000侧的实现程序,并执行该程序包含的指令。
需要说明的是,图10所示的主备份服务器1000仅仅是本申请实施例的一种实现方式,实际应用中,主备份服务器1000还可以包括更多或更少的部件,这里不作限制。关于主备份服务器1000的具体实现可以参考前述图3、图4或图5及其可能的实施方式所示方法实施例中的相关描述,此处不再赘述。或者,关于主备份服务器1000的具体实现可以参考前述图6、图7或图8及其可能的实施方式所示方法实施例中的相关描述,此处不再赘述。
在采用对应各个功能划分各个功能模块的情况下,图11示出了上述实施例中所涉及的从备份服务器的一种可能的逻辑结构示意图,从备份服务器1100包括:发送单元1101、接收单元1102和处理单元1103。示例性的,发送单元1101用于支持从备份服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中从备份服务器发送信息的步骤。接收单元1102用于支持从备份服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中从备份服务器接收信息的步骤。处理单元1103,用于支持从备份服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中从备份服务器调整信息的步骤,以及除发送单元1101和接收单元1102执行的步骤以外的其它步骤等。
可选的,该从备份服务器1100还可以包括存储单元,用于存储计算机程序或者数据。一种可能的方式中,处理单元1103可以调用存储单元的计算机程序或者数据,使得从备份服务器1100接收所述主备份服务器发送的备份子任务,所述备份子任务对应有执行生产服务器,用于指示所述第一备份服务器备份所述执行生产服务器中目标范围的待备份数据;所述执行生产服务器为生产系统中的服务器;然后,根据所述备份子任务向所述执行生产服务器发送 待备份数据获取请求;所述待备份数据获取请求包括待备份数据范围的信息;然后,接收所述执行生产服务器发送的待备份数据。
可选的,该从备份服务器1100还可以包括存储单元,用于存储计算机程序或者数据。一种可能的方式中,处理单元1103可以调用存储单元的计算机程序或者数据,使得从备份服务器1100接收所述主备份服务器发送的备份恢复子任务,所述备份恢复子任务对应有执行生产服务器,用于指示所述第一备份服务器向所述执行生产服务器发送预设范围的数据;所述执行生产服务器为生产系统中的服务器;所述第一备份服务器为所述备份系统中的从备份服务器;然后,根据所述备份恢复子任务向所述执行生产服务器发送所述预设范围的数据。
在硬件实现上,上述处理单元1103可以为处理器或者处理电路等。发送单元1101和接收单元1102可以耦合为收发器或者收发电路或者接口电路等。存储单元可以为存储器。上述处理单元、发送单元、接收单元和存储单元可以集成在一起,也可以分离。
图12所示,为本申请的实施例提供的上述实施例中所涉及的从备份服务器的一种可能的硬件结构示意图。如图12所示,从备份服务器1200可包括:一个或多个处理器1201、一个或多个存储器1202和通信模块1203(例如可以是一个或多个收发器)。这些部件可通过总线1204或者其他方式连接,图12以通过总线连接为例。其中:
通信模块1203可用于对处理器1201生成的请求进行发送,例如生成的待备份数据获取请求等。通信模块1203还可用于接收信息和数据,例如备份子任务的信息和待备份数据等。
存储器1202可以和处理器1201通过总线1204或者输入输出端口耦合,存储器1202也可以与处理器1201集成在一起。存储器1202用于存储各种软件程序和/或多组指令或者数据。具体的,存储器1202可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器1202可以存储操作系统(下述简称系统),例如uCOS、VxWorks、RTLinux等嵌入式操作系统。
处理器1201可以是中央处理器单元,通用处理器,数字信号处理器,专用集成电路,现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现确定功能的组合,例如包含一个或多个微处理器组合,数字信号处理器和微处理器的组合等等。
本申请实施例中,处理器1201可用于读取和执行计算机可读指令。具体的,处理器1201可用于调用存储于存储器1202中的程序,例如本申请的一个或多个实施例提供的备份处理方法在从备份服务器1200侧的实现程序,并执行该程序包含的指令。
需要说明的是,图12所示的从备份服务器1200仅仅是本申请实施例的一种实现方式,实际应用中,从备份服务器1200还可以包括更多或更少的部件,这里不作限制。关于从备份服务器1200的具体实现可以参考前述图3、图4或图5及其可能的实施方式所示方法实施例中的相关描述,此处不再赘述。或者,关于从备份服务器1200的具体实现可以参考前述图6、图7或图8及其可能的实施方式所示方法实施例中的相关描述,此处不再赘述。
在采用对应各个功能划分各个功能模块的情况下,图13示出了上述实施例中所涉及的生产服务器的一种可能的逻辑结构示意图,生产服务器1300包括:发送单元1301、接收单元1302和处理单元1303。示例性的,发送单元1301用于支持生产服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中生产服务器发送信息的步骤。接收单元1302用于支持生产服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中生产服 务器接收信息的步骤。处理单元1303,用于支持生产服务器执行前述图3、图4或图5及其可能的实施方式所示方法实施例中获取待备份数据、获取待备份数据的分布信息或者获取生产服务器的资源消耗情况的步骤,以及除发送单元1301和接收单元1302执行的步骤以外的其它步骤等。
可选的,该生产服务器1300还可以包括存储单元,用于存储计算机程序或者数据。一种可能的方式中,处理单元1303可以调用存储单元的计算机程序或者数据,使得生产服务器1300获取第一预设信息,所述第一预设信息包括第一数据分布信息和第一资源消耗信息中一项或多项;所述第一数据分布信息包括待备份数据在所述第一生产服务器中的第一分布情况;所述第一资源消耗信息包括所述第一生产服务器的第一资源消耗情况;然后,向主备份服务器发送所述第一预设信息;所述第一预设信息用于使所述主备份服务器根据所述第一预设信息划分多个备份子任务,所述备份子任务对应有执行备份服务器和执行生产服务器,用于指示所述执行备份服务器备份所述执行生产服务器中目标范围的待备份数据;所述主备份服务器为备份系统的服务器,所述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器,用于备份所述生产系统的数据。
可选的,该生产服务器1300还可以包括存储单元,用于存储计算机程序或者数据。一种可能的方式中,处理单元1303可以调用存储单元的计算机程序或者数据,使得生产服务器1300获取第一信息;所述第一信息包括所述多个生产服务器各自对应的第一资源消耗情况;然后,向主备份服务器发送所述第一信息;所述第一信息用于使所述主备份服务器根据所述第一信息划分多个备份恢复子任务,所述备份恢复子任务对应有执行备份服务器和执行生产服务器,用于指示所述执行备份服务器向所述执行生产服务器发送预设范围的数据;所述主备份服务器为备份系统的服务器,所述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器。
在硬件实现上,上述处理单元1303可以为处理器或者处理电路等。发送单元1301和接收单元1302可以耦合为收发器或者收发电路或者接口电路等。存储单元可以为存储器。上述处理单元、发送单元、接收单元和存储单元可以集成在一起,也可以分离。
图14所示,为本申请的实施例提供的上述实施例中所涉及的生产服务器的一种可能的硬件结构示意图。如图14所示,生产服务器1400可包括:一个或多个处理器1401、一个或多个存储器1402和通信模块1403(例如可以是一个或多个收发器)。这些部件可通过总线1404或者其他方式连接,图14以通过总线连接为例。其中:
通信模块1403可用于对处理器1401生成的请求进行发送,例如生成的待备份数据获取请求等。通信模块1403还可用于接收信息和数据,例如备份子任务的信息和待备份数据等。
存储器1402可以和处理器1401通过总线1404或者输入输出端口耦合,存储器1402也可以与处理器1401集成在一起。存储器1402用于存储各种软件程序和/或多组指令或者数据。具体的,存储器1402可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器1402可以存储操作系统(下述简称系统),例如uCOS、VxWorks、RTLinux等嵌入式操作系统。
处理器1401可以是中央处理器单元,通用处理器,数字信号处理器,专用集成电路,现场可编程门阵列或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现确定功能的组合,例如包含一个或多个微处理器组合,数字信号处理器和 微处理器的组合等等。
本申请实施例中,处理器1401可用于读取和执行计算机可读指令。具体的,处理器1401可用于调用存储于存储器1402中的程序,例如本申请的一个或多个实施例提供的备份处理方法在生产服务器1400侧的实现程序,并执行该程序包含的指令。
需要说明的是,图14所示的生产服务器1400仅仅是本申请实施例的一种实现方式,实际应用中,生产服务器1400还可以包括更多或更少的部件,这里不作限制。关于生产服务器1400的具体实现可以参考前述图3、图4或图5及其可能的实施方式所示方法实施例中的相关描述,此处不再赘述。或者,关于生产服务器1400的具体实现可以参考前述图6、图7或图8及其可能的实施方式所示方法实施例中的相关描述,此处不再赘述。
本发明实施例还提供一种备份处理系统,包括生产系统和备份系统,所述生产系统包括多个生产服务器,所述备份系统包括一个或多个主备份服务器和一个或多个从备份服务器;其中,所述主备份服务器可以为图9或图10所述服务器,所述从备份服务器可以为图11或图12所述服务器,所述生产服务器可以为图13或图14所述服务器。
本发明实施例还提供一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行以实现前述图3、图4或图5及其可能的实施方式所述方法实施例。
本发明实施例还提供一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行以实现前述图6、图7或图8及其可能的实施方式所述方法实施例。
本发明实施例还提供一种计算机程序产品,当该计算机程序产品被计算机读取并执行时,前述图3、图4或图5及其可能的实施方式所述方法实施例得以实现。
本发明实施例还提供一种计算机程序产品,当该计算机程序产品被计算机读取并执行时,前述图6、图7或图8及其可能的实施方式所述方法实施例得以实现。
本发明实施例还提供一种计算机程序,当该计算机程序在计算机上执行时,将会使所述计算机实现前述图3、图4或图5及其可能的实施方式所述方法实施例。
本发明实施例还提供一种计算机程序,当该计算机程序在计算机上执行时,将会使所述计算机实现前述图6、图7或图8及其可能的实施方式所述方法实施例。
综上所述,在本申请实施例,相比于现有技术在不了解生产系统的信息的情况下,采用简单的均衡策略要求从每一个生产服务器上获取等量的待备份数据进行备份,导致生产服务器之间的内部转发严重,损耗服务器性能,本申请实施例根据对预先获取生产系统中的数据分布信息和/或资源消耗信息的分析结果将对整个生产系统的数据备份任务划分为多个备份子任务,每个备份子任务对应有负责备份的数据范围,然后将这些备份子任务分发给各自对应执行备份服务进行数据备份,能够提高备份的效率,减轻生产服务器的负担。此外,相比于现有技术只使用备份系统中的一个备份服务器对整个生产系统的数据进行备份,本申请实施例充分利用了备份系统的各个备份服务器对数据进行备份,从而极大地提高了备份的效率。
综上,以上仅为本发明的较佳实施例而已,并非用于限定本发明的保护范围。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。

Claims (12)

  1. 一种备份处理方法,其特征在于,应用于备份系统,所述备份系统包括多个备份服务器;所述方法包括:
    所述多个备份服务器中的主备份服务器将备份任务划分为多个备份子任务;
    所述主备份服务器将每个备份子任务分配给所述多个备份服务器中的每个备份服务器;
    所述主备份服务器将所述多个备份子任务发送给各自对应的备份服务器。
  2. 根据权利要求1所述的方法,其特征在于,还包括:
    所述主备份服务器获取第一预设信息,所述第一预设信息包括数据在多个生产设备中的分布信息和/或所述多个生产设备的资源消耗情况;
    所述主备份服务器将备份任务划分多个备份子任务包括:根据所述第一预设信息将所述备份任务划分为所述多个备份子任务,其中,每个备份子任务对应一个生产设备。
  3. 根据权利要求1或2所述方法,其特征在于,还包括:
    所述主备份服务器设置每个备份子任务对应的备份速率,以指示每个备份服务器以设置的备份速率备份数据。
  4. 一种备份恢复处理方法,其特征在于,应用于备份系统,所述备份系统包括多个备份服务器;所述方法包括:
    所述多个备份服务器中的主备份服务器将备份恢复任务划分为多个备份恢复子任务;
    所述主备份服务器将每个备份恢复子任务分配给所述多个备份服务器中的每个备份服务器;
    所述主备份服务器将所述多个备份恢复子任务发送给各自对应的备份服务器。
  5. 根据权利要求4所述的方法,其特征在于,还包括:
    所述主备份服务器获取第二预设信息,所述第二预设信息包括多个生产设备的资源消耗情况;
    所述主备份服务器将备份恢复任务划分多个备份恢复子任务包括:根据所述第二预设信息将所述备份恢复任务划分为所述多个备份恢复子任务,其中,每个备份恢复子任务对应一个生产设备。
  6. 根据权利要求4或5所述方法,其特征在于,还包括:
    所述主备份服务器设置每个备份恢复子任务对应的备份恢复速率,以指示每个备份服务器以设置的备份恢复速率恢复数据。
  7. 一种备份处理服务器,其特征在于,所述备份处理服务器为备份系统中的主备份服务器;所述备份处理服务器包括:
    划分单元,用于将备份任务划分为多个备份子任务;
    分配单元,用于将每个备份子任务分配给所述多个备份服务器中的每个备份服务器;
    发送单元,用于将所述多个备份子任务发送给各自对应的备份服务器。
  8. 根据权利要求7所述的备份处理服务器,其特征在于,所述备份处理服务器还包括获取单元,用于获取第一预设信息,所述第一预设信息包括数据在多个生产设备中的分布信息和/或所述多个生产设备的资源消耗情况;
    所述划分单元,用于将备份任务划分为多个备份子任务,具体为:用于根据所述第一预设信息将所述备份任务划分为所述多个备份子任务,其中,每个备份子任务对应一个生产设备。
  9. 根据权利要求7或8所述的备份处理服务器,其特征在于,所述备份处理服务器还包括设置单元,用于设置每个备份子任务对应的备份速率,以指示每个备份服务器以设置的备份速率备份数据。
  10. 一种备份恢复处理服务器,其特征在于,所述备份恢复处理服务器为备份系统中的主备份服务器;所述备份恢复处理服务器包括:
    划分单元,用于将备份恢复任务划分为多个备份恢复子任务;
    分配单元,用于将每个备份恢复子任务分配给所述多个备份服务器中的每个备份服务器;
    发送单元,用于将所述多个备份恢复子任务发送给各自对应的备份服务器。
  11. 根据权利要求10所述的备份恢复处理服务器,其特征在于,所述备份恢复处理服务器还包括获取单元,用于获取第二预设信息,所述第二预设信息包括多个生产设备的资源消耗情况;
    所述划分单元,用于将备份恢复任务划分为多个备份恢复子任务,具体为:用于根据所述第二预设信息将所述备份恢复任务划分为所述多个备份恢复子任务,其中,每个备份恢复子任务对应一个生产设备。
  12. 根据权利要求10或11所述方法,其特征在于,所述备份恢复处理服务器还包括设置单元,用于设置每个备份恢复子任务对应的备份恢复速率,以指示每个备份服务器以设置的备份恢复速率恢复数据。
PCT/CN2020/088880 2019-08-28 2020-05-07 备份处理方法及服务器 WO2021036330A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20857665.2A EP4016305A4 (en) 2019-08-28 2020-05-07 BACKUP PROCESSING METHODS AND SERVERS
US17/678,258 US11971786B2 (en) 2019-08-28 2022-02-23 Backup processing method and server

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910802426.1 2019-08-28
CN201910802426.1A CN110597659A (zh) 2019-08-28 2019-08-28 备份处理方法及服务器

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/678,258 Continuation US11971786B2 (en) 2019-08-28 2022-02-23 Backup processing method and server

Publications (1)

Publication Number Publication Date
WO2021036330A1 true WO2021036330A1 (zh) 2021-03-04

Family

ID=68856175

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/088880 WO2021036330A1 (zh) 2019-08-28 2020-05-07 备份处理方法及服务器

Country Status (3)

Country Link
EP (1) EP4016305A4 (zh)
CN (1) CN110597659A (zh)
WO (1) WO2021036330A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110597659A (zh) * 2019-08-28 2019-12-20 华为技术有限公司 备份处理方法及服务器
CN113127258A (zh) * 2019-12-30 2021-07-16 华为技术有限公司 一种数据备份方法、装置、设备及介质
CN112527559B (zh) * 2020-12-09 2021-10-08 广州技象科技有限公司 一种物联网数据备份方法及装置
CN116541900B (zh) * 2023-07-07 2024-04-05 深圳星火半导体科技有限公司 基于数据保护的存储管理方法、装置、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104142871A (zh) * 2013-05-10 2014-11-12 中国电信股份有限公司 用于数据备份的方法、装置和分布式文件系统
CN106648979A (zh) * 2016-12-09 2017-05-10 曙光信息产业(北京)有限公司 分布式实时文件系统的备份方法及备份系统
CN107729177A (zh) * 2017-09-18 2018-02-23 中国科学院信息工程研究所 基于云存储的备份数据存储管理方法、装置和系统
CN109408280A (zh) * 2017-08-17 2019-03-01 北京金山云网络技术有限公司 数据备份方法、装置及系统
CN110597659A (zh) * 2019-08-28 2019-12-20 华为技术有限公司 备份处理方法及服务器

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103036946B (zh) * 2012-11-21 2016-08-24 中国电信股份有限公司 一种用于云平台处理文件备份任务的方法和系统
US9753672B1 (en) * 2013-06-27 2017-09-05 EMC IP Holding Company LLC Method and system for parent backup application driving of children backup applications
CN106708661B (zh) * 2016-12-09 2020-05-19 浙江宇视科技有限公司 一种广域网环境中的数据备份方法及装置
CN107741890A (zh) * 2017-10-16 2018-02-27 郑州云海信息技术有限公司 一种备份管理方法及装置
CN109951662B (zh) * 2017-12-20 2022-06-14 浙江宇视科技有限公司 录像备份方法及系统
CN109144783B (zh) * 2018-08-22 2020-08-18 南京壹进制信息科技有限公司 一种分布式海量非结构化数据备份方法及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104142871A (zh) * 2013-05-10 2014-11-12 中国电信股份有限公司 用于数据备份的方法、装置和分布式文件系统
CN106648979A (zh) * 2016-12-09 2017-05-10 曙光信息产业(北京)有限公司 分布式实时文件系统的备份方法及备份系统
CN109408280A (zh) * 2017-08-17 2019-03-01 北京金山云网络技术有限公司 数据备份方法、装置及系统
CN107729177A (zh) * 2017-09-18 2018-02-23 中国科学院信息工程研究所 基于云存储的备份数据存储管理方法、装置和系统
CN110597659A (zh) * 2019-08-28 2019-12-20 华为技术有限公司 备份处理方法及服务器

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4016305A4 *

Also Published As

Publication number Publication date
EP4016305A4 (en) 2022-09-14
US20220179749A1 (en) 2022-06-09
CN110597659A (zh) 2019-12-20
EP4016305A1 (en) 2022-06-22

Similar Documents

Publication Publication Date Title
WO2021036330A1 (zh) 备份处理方法及服务器
US8949847B2 (en) Apparatus and method for managing resources in cluster computing environment
CN107291546B (zh) 一种资源调度方法及装置
US9864759B2 (en) System and method for providing scatter/gather data processing in a middleware environment
CN107515786B (zh) 资源分配方法、主装置、从装置和分布式计算系统
WO2018072687A1 (zh) 一种资源调度的方法、装置和过滤式调度器
WO2019001092A1 (zh) 负载均衡引擎,客户端,分布式计算系统以及负载均衡方法
CN103377092A (zh) 用于动态资源管理的两级动态资源管理方法和装置
TW201217988A (en) Reactive load balancing for distributed systems
CN108270805B (zh) 用于数据处理的资源分配方法及装置
CN111930493A (zh) 集群中NodeManager状态管理方法、装置及计算设备
CN103761146A (zh) 一种MapReduce动态设定slots数量的方法
JP2017037492A (ja) 分散処理プログラム、分散処理方法および分散処理装置
CN111414241A (zh) 批量数据处理方法、装置、系统、计算机设备及计算机可读存储介质
CN106878389B (zh) 用于在云系统中进行资源调度的方法和装置
CN111459641A (zh) 一种跨机房的任务调度和任务处理的方法及装置
CN107203256B (zh) 一种网络功能虚拟化场景下的节能分配方法与装置
Marandi et al. Filo: Consolidated consensus as a cloud service
US9672073B2 (en) Non-periodic check-pointing for fine granular retry of work in a distributed computing environment
CN111400241B (zh) 数据重构方法和装置
CN116643875A (zh) 一种任务调度方法、服务器及服务器集群
CN108347341A (zh) 一种用于调整虚拟机加速能力的加速能力调整方法及装置
US11971786B2 (en) Backup processing method and server
CN112823338A (zh) 使用分布式分段处理借用的资源分配
CN106844021B (zh) 计算环境资源管理系统及其管理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20857665

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020857665

Country of ref document: EP

Effective date: 20220314