CN116521449A

CN116521449A - Backup data processing method, device and server

Info

Publication number: CN116521449A
Application number: CN202310511559.XA
Authority: CN
Inventors: 任岗; 潘磊
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2023-05-08
Filing date: 2023-05-08
Publication date: 2023-08-01

Abstract

The specification provides a method, a device and a server for processing backup data, which can be used in the financial field. Based on the method, in the data backup process, a server firstly generates a target backup object list aiming at the current time period; the backup information of the first full backup of the target backup object in the last history and the backup information of the second incremental backup from the end of the first full backup of the target backup object to the current time point are obtained by inquiring the backup system database; determining a target adjustment strategy matched with the current backup condition of the target backup object according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; and according to the target adjustment strategy, the backup strategy of the current time period of the target object is adjusted and obtained. Therefore, different backup status types can be effectively distinguished, and backup strategies with higher matching degree and better effect can be automatically generated, so that backup processing can be better performed.

Description

Backup data processing method, device and server

Technical Field

The present disclosure belongs to the technical field of the internet, and in particular, relates to a method, an apparatus, and a server for processing backup data.

Background

In a financial business scenario, a transaction system server is required to access and process large amounts of transaction data every day.

Based on the existing method, the server performs full-scale backup on transaction data in a transaction database at fixed intervals of longer time according to fixed configuration parameters; meanwhile, the transaction data in the transaction database is subjected to incremental backup at fixed short time intervals. When the backup processing is specifically performed based on the method, the problems that the whole backup efficiency is low, a large amount of backup medium resources are easy to occupy and the like often exist.

In view of the above problems, no effective solution has been proposed at present.

Disclosure of Invention

The specification provides a method, a device and a server for processing backup data, which accurately determine a target adjustment strategy matched with a current target backup object by finely distinguishing different backup status types; and then the backup strategy of the matched current time period can be dynamically adjusted based on the target adjustment strategy; and the backup process of the current time period can be intelligently and pointedly carried out based on the backup strategy of the current time period, so that the resource consumption of the backup medium is effectively reduced, and the overall backup efficiency is improved.

The specification provides a backup data processing method, which includes:

inquiring a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object;

according to the target backup object list, acquiring backup information of a first full backup of the target backup object and backup information of a second incremental backup from the end of the first full backup of the target backup object to the current time point by inquiring a backup system database; wherein the first full back-up is the last full back-up;

determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object;

according to the target adjustment strategy, adjusting the backup strategy of the target backup object in a time period to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

In one embodiment, before querying the backup system database to determine the target backup object list, the method further comprises:

acquiring backup information of historical backup of a time period on each backup object through a corresponding backup tool at intervals of preset time periods;

and storing the backup information of the historical backup of the last time period of each backup object into a backup system database according to the corresponding storage rule.

In one embodiment, the backup information of the historical backup includes at least one of: the method comprises the steps of a backup type of the historical backup, a backup start time of the historical backup, a backup end time of the historical backup, a recovery state mark of the historical backup, a cleaning label of the historical backup and a backup data volume of the historical backup.

In one embodiment, querying a backup system database to determine a target backup object list includes:

inquiring a backup system database, and screening a backup object with a recovery state mark of historical backup of the previous time period being a positive mark as a target backup object of the current time period;

and obtaining and generating a target backup object list according to the object identification of the target backup object.

In one embodiment, determining, from a preset adjustment policy set, a target adjustment policy matching a current target backup object according to backup information of a first full backup and backup information of a second incremental backup of the target backup object, includes:

determining the backup data volume of the first full backup according to the backup information of the first full backup of the target backup object; determining the accumulated backup data amount of the second incremental backup according to the backup information of the second incremental backup;

predicting the backup data volume of the next incremental backup according to the backup information of the second incremental backup;

determining the type of the current target backup condition of the target backup object according to the backup data volume of the first full backup, the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup;

and determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the target backup condition type of the current target backup object.

In one embodiment, predicting the backup data amount of the next incremental backup based on the backup information of the second incremental backup includes:

And calculating the average value of the backup data volume of the second incremental backup according to the backup information of the second incremental backup, and taking the average value as the backup data volume of the next incremental backup.

In one embodiment, determining the target backup status type of the current target backup object according to the backup data amount of the first full backup, the accumulated backup data amount of the second incremental backup, and the backup data of the next incremental backup includes:

detecting whether the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is larger than the backup data volume of the first full backup according to the backup data volume of the first full backup, the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup;

detecting whether the average value of the backup data volume of the second incremental backup is larger than the preset proportional value of the backup data volume of the first full backup or not under the condition that the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is larger than the backup data volume of the first full backup;

under the condition that the average value of the backup data volume of the second incremental backup is less than or equal to the preset proportion value of the backup data volume of the first full backup, determining that the target backup condition type is the first backup condition type; otherwise, determining that the target backup status type is the third backup status type.

In one embodiment, the method further comprises:

detecting whether the accumulated time from the end of the first full-volume backup of the target backup object to the current time point is greater than a preset accumulated time threshold value or not under the condition that the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is smaller than or equal to the backup data volume of the first full-volume backup;

under the condition that the accumulated time from the end of the first full-quantity backup of the target backup object to the current time point is less than or equal to a preset accumulated time threshold value, determining that the target backup condition type is a second backup condition type; otherwise, determining that the target backup status type is the fourth backup status type.

In one embodiment, determining, from a preset adjustment policy set, a target adjustment policy matching the current target backup object according to the target backup status type of the current target backup object, includes:

under the condition that the current target backup condition type of the target backup object is the first backup condition type, determining a corresponding first preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the corresponding first preset adjustment strategy as a target adjustment strategy;

Under the condition that the current target backup condition type of the target backup object is determined to be the second backup condition type, determining a corresponding second preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the second preset adjustment strategy as the target adjustment strategy;

under the condition that the current target backup condition type of the target backup object is determined to be the third backup condition type, determining a corresponding third preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the third preset adjustment strategy as the target adjustment strategy;

and under the condition that the current target backup object is determined to be the fourth backup object, determining a corresponding fourth preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the fourth preset adjustment strategy as the target adjustment strategy.

In one embodiment, when the target adjustment policy is the first preset adjustment policy, adjusting the backup policy of the target backup object in a previous time period according to the target adjustment policy to obtain the backup policy of the target backup object in the current time period, including:

according to a first preset adjustment strategy, setting a first backup aiming at the current time period in a backup strategy of the previous time period as full backup; and adjusting the interval duration of the incremental backup after the first backup in the current time period to obtain the backup strategy of the current time period of the target backup object.

In one embodiment, when the target adjustment policy is the second preset adjustment policy, adjusting the backup policy of the target backup object in a previous time period according to the target adjustment policy to obtain the backup policy of the target backup object in the current time period, including:

according to a second preset adjustment strategy, modifying full-quantity backup aiming at the current time period in the backup strategy of the previous time period into incremental backup; and adjusting the interval duration of the incremental backup in the current time period to obtain the backup strategy of the current time period of the target backup object.

In one embodiment, when the target adjustment policy is the third preset adjustment policy, adjusting the backup policy of the target backup object in a previous time period according to the target adjustment policy to obtain the backup policy of the target backup object in the current time period, including:

according to a third preset adjustment strategy, the incremental backup aiming at the current time period in the backup strategy of the previous time period is modified into full-quantity backup; adjusting the interval duration of full backup in the current time period; and setting a backup reminding mechanism to obtain a backup strategy of the target backup object in the current time period.

In one embodiment, when the target adjustment policy is the fourth preset adjustment policy, adjusting the backup policy of the target backup object in a previous time period according to the target adjustment policy to obtain the backup policy of the target backup object in the current time period, including:

And setting the first backup aiming at the current time period in the backup strategy of the previous time period as full backup according to a fourth preset adjustment strategy to obtain the backup strategy of the current time period of the target backup object.

In one embodiment, after adjusting the backup policy of the target backup object for a period of time according to the target adjustment policy, to obtain the backup policy of the target backup object for the current period of time, the method further includes:

inquiring a backup system database to determine a target cleaning object list; the target cleaning object list at least comprises an object identifier of a backup object of which whether backup data on the backup medium need to be cleaned or not is to be determined in the current time period;

according to the target cleaning object list, the first full-quantity backup and the last full-quantity backup restoration state before the first full-quantity backup are marked as positively marked backup objects by inquiring the backup system database, and the target cleaning object is determined;

setting a cleaning label for the last full-quantity backup before the first full-quantity backup of the target cleaning object and the incremental backup between the last full-quantity backup before the first full-quantity backup of the target cleaning object and the first full-quantity backup of the target cleaning object; the cleaning tag is used for indicating backup data to be cleaned in the backup medium in the current time period.

The specification also provides a processing device for backup data, which comprises:

the first query module is used for querying the backup system database and determining a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object;

the second query module is used for acquiring the backup information of the first full-quantity backup of the target backup object and the backup information of the second incremental backup from the end of the first full-quantity backup of the target backup object to the current time point by querying the backup system database according to the target backup object list; wherein the first full back-up is the last full back-up;

the determining module is used for determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup of the target backup object and the backup information of the second incremental backup;

the adjusting module is used for adjusting the backup strategy of the target backup object in a time period according to the target adjustment strategy to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

The present specification also provides a server comprising a processor and a memory for storing processor-executable instructions, the processor implementing the steps associated with a method of processing backup data when executing the instructions.

Based on the backup data processing method, device and server provided by the specification, in the data backup process, the server can generate a target backup object list aiming at the current time period; the backup information of the first full backup of the target backup object in the last history and the backup information of the second incremental backup from the end of the first full backup of the target backup object to the current time point are obtained by inquiring the backup system database; determining a target adjustment strategy matched with the current target backup object according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; and according to the target adjustment strategy, the backup strategy of the current time period of the target object is obtained through targeted dynamic adjustment. Therefore, the target adjustment strategy matched with the current target backup object can be accurately determined by finely distinguishing different backup status types; furthermore, the backup strategy of the current time period with higher matching degree and better effect can be dynamically adjusted based on the target adjustment strategy; based on the backup strategy, the backup processing of the target backup object in the current time period can be intelligently and pointedly carried out, so that the resource consumption of the backup medium is effectively reduced, and the overall backup efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure, the drawings that are required for the embodiments will be briefly described below, and the drawings described below are only some embodiments described in the present disclosure, and other drawings may be obtained according to these drawings without inventive effort for a person of ordinary skill in the art.

FIG. 1 is a flow chart of a method for processing backup data according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of one embodiment of a method for processing backup data provided by embodiments of the present disclosure, in one example scenario;

FIG. 3 is a schematic diagram of one embodiment of a method for processing backup data provided by embodiments of the present disclosure, in one example scenario;

FIG. 4 is a schematic diagram of one embodiment of a method for processing backup data provided by embodiments of the present disclosure, in one example scenario;

FIG. 5 is a schematic diagram of the structural composition of a server according to one embodiment of the present disclosure;

FIG. 6 is a schematic diagram of the structural composition of a backup data processing apparatus according to one embodiment of the present disclosure;

FIG. 7 is a schematic diagram of one embodiment of a method for processing backup data provided by embodiments of the present disclosure, in one example scenario;

Fig. 8 is a schematic diagram of an embodiment of a method for processing backup data according to the embodiment of the present disclosure, in an example of a scenario.

Detailed Description

In order to make the technical solutions in the present specification better understood by those skilled in the art, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present specification, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are intended to be within the scope of the present disclosure.

Referring to fig. 1, an embodiment of the present disclosure provides a method for processing backup data, where the method is specifically applied to a server side. In particular implementations, the method may include the following:

s101: inquiring a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object;

S102: according to the target backup object list, acquiring backup information of a first full backup of the target backup object and backup information of a second incremental backup from the end of the first full backup of the target backup object to the current time point by inquiring a backup system database; wherein the first full back-up is the last full back-up;

s103: determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object;

s104: according to the target adjustment strategy, adjusting the backup strategy of the target backup object in a time period to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

Based on the above embodiment, the server may periodically detect each preset time period and determine the current specific backup status type of the target backup object according to the backup information of the last time period of the target backup object; then accurately determining a target adjustment strategy matched with the current target backup object by distinguishing different backup status types; and the backup strategy of the current time period with higher matching degree and better effect can be dynamically adjusted based on the target adjustment strategy.

In some embodiments, referring to fig. 2, the above-mentioned backup data processing method may be specifically applied to a server side.

The server may specifically include a background server applied to a data processing system side and capable of implementing functions such as data transmission and data processing. Specifically, the server may be, for example, an electronic device having data operation, storage function and network interaction function. Alternatively, the server may be a software program running in the electronic device that provides support for data processing, storage, and network interactions. In the present embodiment, the number of servers is not particularly limited. The server may be one server, several servers, or a server cluster formed by several servers.

Further, the server may be further connected to a backup system database.

The backup system database may specifically store backup information of historical backups of each backup object. For example, the backup object y historically uses 2023, 27, 15:00 for full back-up and the backup object x historically uses 2022, 12, 10:34 for incremental back-up.

In particular implementations, a data processing system receives and processes a large amount of business data (e.g., transaction data). The server in the data processing system processes the service data, and performs corresponding backup processing on data objects (or referred to as backup objects) related to the service data, such as files or databases related to the service data, through a backup tool according to a corresponding backup strategy, and stores corresponding backup data (or a backup data set) in a designated backup medium.

In the specific backup processing process, the server may periodically collect backup information of historical backup of each data object in a period of time at preset intervals, and store the backup information in the backup system database. Then, the server can acquire and determine the current specific backup status type of the target object according to the backup information of the first full-quantity backup which is the latest in history of the target backup object and the backup information of the second incremental backup which occurs from the first full-quantity backup of the target backup object to the current time point by inquiring the backup system database; determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the current specific backup condition type of the target object; and then according to the target adjustment strategy, dynamically adjusting the backup strategy used for a time period on the target backup object in the backup tool to obtain the backup strategy with good effect for the current time period of the target backup object. And further, according to the backup strategy, the backup tool can be used for carrying out backup processing aiming at the current time period of the target backup object. In addition, the server can prompt a system administrator in time according to the corresponding backup strategy when detecting and identifying the abnormal backup condition.

In some embodiments, the backup system database stores backup information of historical backups of respective backup objects. The target backup object list at least comprises object identifiers of target backup objects of which the backup strategies are to be adjusted in the current time period. The object identifier of the target backup object may specifically include identification information such as an object name, an object number, and the like, which can be used to indicate the target backup object.

Further, the target backup object list may further include an object type of the target backup object. The object types may specifically include: file data, database data, etc. Specifically, the database data may include: oracle databases, mySQL databases, etc.

For different types of backup objects, when specific backup is performed, the server can adopt different backup rules to perform differentiated backup processing on specific data in the backup objects.

Specifically, for example, incremental backup is performed on the file data, and only the difference data between the current backup and the last backup recorded by the corresponding backup tool is backed up according to the corresponding backup rule. For full-scale backup of an Oracle Database, according to corresponding backup rules, a set of all data files (Database files), archive files (Archive logs) and Control files (Control files) of the Database is backed up; for the incremental backup of the Oracle database, only the collection of the archive files and the latest control files of the database are backed up according to the corresponding backup rules. For the full backup of the MySQL database, according to the corresponding backup rule, carrying out backup on all data file sets of the database; for incremental backups of MySQL databases, only the collection of database log files (Binlog) is backed up according to the corresponding backup rules.

In some embodiments, before querying the backup system database and determining the target backup object list, the method may further include the following when implemented:

s1: acquiring backup information of historical backup of a time period on each backup object through a corresponding backup tool at intervals of preset time periods;

s2: and storing the backup information of the historical backup of the last time period of each backup object into a backup system database according to the corresponding storage rule.

Based on the above embodiment, the server may automatically collect and utilize the backup information of the historical backup of the last time period of the backup object every preset time period, and update the backup system database in time.

In some embodiments, the preset period of time may specifically be one week, one month, or the like. Accordingly, the backup information of the historical backup in the previous period may be the backup information of the last week or the last month.

In particular implementations, a centralized backup tool (NBU) may be used as a corresponding backup tool to perform a particular backup process. The centralized backup tool belongs to a backup tool class, and is different from a local backup tool, and has a three-layer tool structure: the system comprises a backup main control terminal, a backup server and a backup client. When in specific backup, a corresponding backup strategy can be set at the backup main control end; the centralized backup tool calls tasks according to the policies to form specific backup activities, and backups related data of the backup objects through the backup activities and stores the data in the appointed backup media.

The backup activity may specifically be an activity of backing up a data object (or referred to as a backup object) to be backed up according to a backup policy by using a corresponding backup tool, where the backup activity processes the backup object according to characteristics of the backup tool, or means such as data copying, data packaging, or encryption, to form a backup data (set).

The backup medium may include a tape library and/or a disk.

The backup policy may specifically refer to a set of backup tool parameters, which are used to define backup activities, for example, define parameter data including backup objects, backup start time, backup types (full backup or incremental), resources used during backup, and backup media stored in backup.

In specific implementation, when the backup tool performs backup processing, corresponding backup logs are synchronously recorded and updated. Correspondingly, the server can acquire the backup information of the historical backup of the corresponding backup object in the last time period by inquiring the data record of the last time period in the backup log.

And then, the server can store the backup information of the historical backup of the last time period of the backup object into the backup system database according to the corresponding relation between the sequence of the backup time and the object identification of the backup object according to the corresponding storage rule.

In some embodiments, the backup information of the historical backup includes at least one of: the backup type of the historical backup, the backup start time of the historical backup, the backup end time of the historical backup, the recovery state mark of the historical backup, the cleaning label of the historical backup, the backup data volume of the historical backup and the like.

Specifically, the backup types may include: full back-up and incremental back-up. The full backup (or simply full backup) may specifically refer to that all data sets of the data object are backed up, whether the data object is modified since the last backup. The incremental backup (incremental backup, or simply incremental) may specifically be a backup of data that changes after the data object was last backed up (whichever type of backup).

The recovery status flag (or recoverable status flag) may specifically include: positive and negative flags. In particular, when there is backup data of a certain backup in the backup medium, the corresponding restore status flag may be set to an affirmative flag. In contrast, when there is no backup data of a certain backup in the backup medium, the corresponding restoration state flag may be set to a negative flag. The cleaning tag is used for indicating that corresponding backup data stored in the backup medium is backup data to be cleaned. The above backup data amount may specifically refer to a data size of the backup data, for example, 1G, 2T, or the like.

Of course, it should be noted that the above listed backup information is only a schematic illustration. In specific implementation, the backup information may further include, for example, a backup date, a start time of the corresponding full backup, and so on, according to a specific application scenario and a processing requirement.

Based on the embodiment, the backup information of the relatively rich and various historical backups can be obtained and utilized, and the current specific backup condition of each backup object and the current specific environmental characteristics of the backup medium can be finely determined.

In some embodiments, the querying the backup system database to determine the target backup object list may include the following contents when implemented:

s1: inquiring a backup system database, and screening a backup object with a recovery state mark of historical backup of the previous time period being a positive mark as a target backup object of the current time period;

s2: and obtaining and generating a target backup object list according to the object identification of the target backup object.

The backup object whose recovery state of the historical backup is marked as affirmative marking can be specifically understood as a backup object whose backup data of the historical backup in the backup process of the previous period has not been cleaned.

Based on the above embodiment, the server may automatically generate a corresponding target backup object list for subsequent data processing.

In some embodiments, referring to fig. 3, the determining, from a preset adjustment policy set, the target adjustment policy matching the current target backup object according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object may include the following when implemented:

s1: determining the backup data volume of the first full backup according to the backup information of the first full backup of the target backup object; determining the accumulated backup data amount of the second incremental backup according to the backup information of the second incremental backup;

s2: predicting the backup data volume of the next incremental backup according to the backup information of the second incremental backup;

s3: determining the type of the current target backup condition of the target backup object according to the backup data volume of the first full backup, the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup;

s4: and determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the target backup condition type of the current target backup object.

Based on the above embodiment, the server may automatically obtain and accurately determine the matched target adjustment policy by distinguishing the specific backup status type of the target backup object according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object.

The target adjustment policy may be specifically understood as an adjustment rule set for adjusting the backup policy executed in the current period of time of the target backup object.

The first full-scale backup of the target backup object may specifically be a historical full-scale backup of the target backup object, where the historical point is closest to the current point in time.

The second incremental backup may specifically refer to a history incremental backup that occurs in a period of time up to the current point in time after the first full-volume backup occurs. Specifically, the second incremental backup may include one incremental backup, or may include a plurality of incremental backups arranged in chronological order.

The next incremental backup may specifically refer to the current time point or the last incremental backup after the current time point.

The above-mentioned target backup status type of the target object may be specifically used to characterize the current specific backup status of the target object. Specifically, the backup status types of the target object may include the following four types: a first backup status type, a second backup status type, a third backup status type, and a fourth backup status type.

The first backup status type may specifically refer to a backup status in which the accumulated backup data size of the incremental backup to be cleaned currently by the target backup object is relatively large, and the backup data size of the single incremental backup is relatively large.

The second backup status type may specifically refer to a backup status in which the accumulated backup data amount of the incremental backup to be cleaned up by the target backup object is relatively small, and the interval duration since the last first full backup is relatively short.

The third backup status type may specifically refer to a backup status in which the accumulated backup data volume of the incremental backup to be cleaned up by the target backup object is relatively large, and the backup data volume of the single incremental backup is relatively small.

The fourth backup status type may specifically refer to a backup status in which the accumulated backup data amount of the incremental backup to be cleaned up by the target backup object is relatively small, and the interval period since the last first full backup is relatively long.

The preset adjustment policy set may specifically include four different preset adjustment policies: the first preset adjustment strategy, the second preset adjustment strategy, the third preset adjustment strategy and the fourth preset adjustment strategy. Each preset adjustment strategy corresponds to one backup status type one by one.

Before specific implementation, a large number of historical backup strategy adjustment records can be obtained; clustering is carried out on the historical backup strategy adjustment records so as to obtain adjustment strategy data sets respectively corresponding to different backup condition types; and constructing a preset adjustment strategy corresponding to each backup condition type according to the adjustment strategy data set.

In some embodiments, the predicting the backup data amount of the next incremental backup according to the backup information of the second incremental backup may include the following when implemented:

Based on the above embodiment, the server can accurately estimate the backup data amount of the last incremental backup.

In some embodiments, the backup data amount of the next incremental backup may also be predicted, when implemented, according to the following: and processing the backup information of the second incremental backup of the target backup object and the service information of the service data related to the target backup object in the last time period by using a preset backup data volume prediction model, and accurately predicting the current backup data volume of the second incremental backup. The preset backup data amount prediction model may be specifically obtained by training in advance using a sample backup data record.

In some embodiments, the determining the target backup status type of the current target backup object according to the backup data amount of the first full backup, the accumulated backup data amount of the second incremental backup, and the backup data of the next incremental backup may include the following when the implementation is performed:

s1: detecting whether the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is larger than the backup data volume of the first full backup according to the backup data volume of the first full backup, the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup;

s2: detecting whether the average value of the backup data volume of the second incremental backup is larger than the preset proportional value of the backup data volume of the first full backup or not under the condition that the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is larger than the backup data volume of the first full backup;

s3: under the condition that the average value of the backup data volume of the second incremental backup is less than or equal to the preset proportion value of the backup data volume of the first full backup, determining that the target backup condition type is the first backup condition type; otherwise, determining that the target backup status type is the third backup status type.

The preset proportion value may be 50%. In the implementation, other numerical values can be set as the preset proportion values according to specific business requirements and by combining the historical backup records, the overall performance of the data processing system and the overall resource condition of the backup media.

Based on the above embodiment, the server can automatically and accurately identify and judge the first backup status type and the third backup status type.

In some embodiments, the method may further include the following when implemented:

s1: detecting whether the accumulated time from the end of the first full-volume backup of the target backup object to the current time point is greater than a preset accumulated time threshold value or not under the condition that the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is smaller than or equal to the backup data volume of the first full-volume backup;

s2: under the condition that the accumulated time from the end of the first full-quantity backup of the target backup object to the current time point is less than or equal to a preset accumulated time threshold value, determining that the target backup condition type is a second backup condition type; otherwise, determining that the target backup status type is the fourth backup status type.

The preset cumulative time period threshold may specifically be 30 days. In implementation, the user can also set a proper time length as the preset accumulated time length threshold value in a self-defined manner according to specific situations and processing requirements.

Based on the above embodiment, the server can automatically and accurately identify and judge the second backup status type and the fourth backup status type.

In some embodiments, the determining, according to the target backup status type of the current target backup object, the target adjustment policy matching the current target backup object from the preset adjustment policy set may include the following when implemented:

s1: under the condition that the current target backup condition type of the target backup object is the first backup condition type, determining a corresponding first preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the corresponding first preset adjustment strategy as a target adjustment strategy;

s2: under the condition that the current target backup condition type of the target backup object is determined to be the second backup condition type, determining a corresponding second preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the second preset adjustment strategy as the target adjustment strategy;

S3: under the condition that the current target backup condition type of the target backup object is determined to be the third backup condition type, determining a corresponding third preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the third preset adjustment strategy as the target adjustment strategy;

s4: and under the condition that the current target backup object is determined to be the fourth backup object, determining a corresponding fourth preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the fourth preset adjustment strategy as the target adjustment strategy.

Based on the above embodiment, the target adjustment policy for the current time period and matched with the target backup object can be accurately determined according to the current specific target backup status type of the target backup object.

In some embodiments, when the target adjustment policy is the first preset adjustment policy, according to the target adjustment policy, the backup policy of the target backup object in a period of time is adjusted to obtain the backup policy of the target backup object in the current period of time, where the specific implementation may include the following contents: according to a first preset adjustment strategy, setting a first backup aiming at the current time period in a backup strategy of the previous time period as full backup; and adjusting the interval duration of the incremental backup after the first backup in the current time period to obtain the backup strategy of the current time period of the target backup object.

Specifically, for example, according to a first preset adjustment policy, a first backup start window closest to a current time period may be adjusted to full backup; and simultaneously, the incremental backup after the full backup is adjusted to be executed once a day.

Based on the above embodiment, the backup strategy of the current time period which is aimed at the target backup object, matched with the target backup condition and better in effect can be automatically and accurately obtained through dynamic adjustment according to the first preset adjustment strategy.

In some embodiments, when the target adjustment policy is the second preset adjustment policy, according to the target adjustment policy, the backup policy of the target backup object in a period of time is adjusted to obtain the backup policy of the target backup object in the current period of time, where the specific implementation may include the following contents: according to a second preset adjustment strategy, modifying full-quantity backup aiming at the current time period in the backup strategy of the previous time period into incremental backup; and adjusting the interval duration of the incremental backup in the current time period to obtain the backup strategy of the current time period of the target backup object.

Specifically, for example, the full-scale backup may be temporarily not configured according to a second preset adjustment policy; and meanwhile, the incremental backup is regulated to be executed once a day, and the last backup starting window in the current time period is forcedly regulated to be the incremental backup.

Based on the above embodiment, the backup strategy of the current time period which is aimed at the target backup object, matched with the target backup condition and better in effect can be automatically and accurately obtained through dynamic adjustment according to the second preset adjustment strategy.

In some embodiments, when the target adjustment policy is the third preset adjustment policy, according to the target adjustment policy, the backup policy of the target backup object in a period of time is adjusted to obtain the backup policy of the target backup object in the current period of time, where the specific implementation may include the following contents: according to a third preset adjustment strategy, the incremental backup aiming at the current time period in the backup strategy of the previous time period is modified into full-quantity backup; adjusting the interval duration of full backup in the current time period; and setting a backup reminding mechanism to obtain a backup strategy of the target backup object in the current time period.

Specifically, for example, according to a third preset adjustment policy, the full-volume backup may be adjusted to be performed once a day, and meanwhile, the full-volume backup is performed by forcedly starting a backup start window that is the last in the current time period. Further, the system administrator may also be notified in the form of mail or alarm, etc. by setting a backup alert mechanism. Therefore, the system manager can be timely reminded that the increment data quantity of the target backup object is too large, the combination of the conventional full backup and increment is not recommended, and the daily full backup is recommended to be implemented; and prompts the system administrator to confirm whether the data growth condition of the target backup object is abnormal or not in time.

Based on the above embodiment, the backup strategy of the current time period which is aimed at the target backup object, matched with the target backup condition and has good effect can be automatically and accurately obtained through dynamic adjustment according to the third preset adjustment strategy.

In some embodiments, further, in implementation, the server may further collect and process backup information of the first full backup and backup information of the second incremental backup of the target backup object in the previous time period according to the third preset adjustment policy, so as to obtain backup feature data about the target backup object; and then calling a preset backup exception model to automatically detect whether the current backup condition of the target backup object is abnormal or not by processing the backup characteristic data of the target backup object. Under the condition that the abnormality exists, the abnormality prompt information can be directly generated and touched to a system administrator so as to eliminate related systems in time and ensure the health and stability of the backup data processing of the data processing system.

In some embodiments, in addition, the server may further allocate the backup medium in the idle state in time according to a third preset adjustment policy, so as to better match with the backup policy of the current time period, and complete and accurately implement the backup processing for the current time period of the target backup object.

In some embodiments, when the target adjustment policy is the fourth preset adjustment policy, adjusting the backup policy of the last time period of the target backup object according to the target adjustment policy to obtain the backup policy of the current time period of the target backup object, where the specific implementation may include the following: and setting the first backup aiming at the current time period in the backup strategy of the previous time period as full backup according to a fourth preset adjustment strategy to obtain the backup strategy of the current time period of the target backup object.

Specifically, for example, according to a first preset adjustment policy, a first backup start window closest to a current time period may be adjusted to full backup; and meanwhile, the backup strategy of the incremental backup phase after the full backup is kept unchanged relative to the previous time period.

Based on the above embodiment, the backup policy of the current time period which is aimed at the target backup object, matched with the target backup condition and has a good effect can be obtained automatically and accurately through dynamic adjustment according to the fourth preset adjustment policy.

In some embodiments, after adjusting the backup policy of the target backup object in a previous time period according to the target adjustment policy to obtain the backup policy of the target backup object in the current time period, the method may further include, when implemented: and providing the backup strategy of the current time period to a server responsible for data backup. The server responsible for data backup can call the corresponding backup tool to automatically perform backup processing for the current time period of the target backup object based on the backup strategy of the current time period.

In some embodiments, after adjusting the backup policy of the target backup object in a previous time period according to the target adjustment policy to obtain the backup policy of the target backup object in the current time period, referring to fig. 4, when the method is implemented, the method may further include the following:

s1: inquiring a backup system database to determine a target cleaning object list; the target cleaning object list at least comprises an object identifier of a backup object of which whether backup data on the backup medium need to be cleaned or not is to be determined in the current time period;

s2: according to the target cleaning object list, the first full-quantity backup and the last full-quantity backup restoration state before the first full-quantity backup are marked as positively marked backup objects by inquiring the backup system database, and the target cleaning object is determined;

s3: setting a cleaning label for the last full-quantity backup before the first full-quantity backup of the target cleaning object and the incremental backup between the last full-quantity backup before the first full-quantity backup of the target cleaning object and the first full-quantity backup of the target cleaning object; the cleaning tag is used for indicating backup data to be cleaned in the backup medium in the current time period.

Based on the embodiment, the backup data in the backup medium can be periodically inspected, cleanable backup data can be timely found, and the corresponding cleaning label is set, so that cleanable backup data in the backup medium can be timely cleaned according to the cleaning label, occupied and consumed backup medium resources are released, and waste of the backup medium resources is reduced.

In some embodiments, in the implementation, after the backup policy of the target backup object in the current time period is obtained by adjusting the backup policy of the target backup object in the previous time period, or after the server responsible for backup completes the backup processing of the current time period according to the backup policy of the current time period, the backup system database is queried, and the backup object with the current recovery state marked as the affirmative mark is screened out to generate the corresponding target cleaning object list.

The last full-size backup before the first full-size backup is specifically understood as a full-size backup that occurs before the first full-size backup and is closest to the first full-size backup.

In some embodiments, after setting the cleanup tag for the last full backup before the target cleanup object first full backup and for the incremental backup between the last full backup before the target cleanup object first full backup and the target cleanup object first full backup, the method may further include: and sending a cleaning instruction to a server responsible for cleaning. And the server responsible for cleaning receives and responds to the cleaning instruction, automatically cleans and deletes corresponding backup data in the backup media according to the cleaning label, and timely releases occupied and consumed backup media resources.

In the specific implementation, the server responsible for cleaning also generates a corresponding cleaning record in the cleaning process. Accordingly, the method may further include: and updating the corresponding historical backup information in the backup system database according to the cleaning record. For example, the restoration state flag in the backup information of the history backup to be cleaned is modified from the original affirmative flag to negative flag, etc.

From the above, based on the method, the device and the server for processing backup data provided in the embodiments of the present disclosure, in the data backup process, the server generates a target backup object list for the current time period; the backup information of the first full backup of the target backup object in the last history and the backup information of the second incremental backup from the end of the first full backup of the target backup object to the current time point are obtained by inquiring the backup system database; determining a target adjustment strategy matched with the current target backup object according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; and according to the target adjustment strategy, the backup strategy of the current time period of the target object is adjusted and obtained. Therefore, the target adjustment strategy matched with the current target backup object can be accurately determined by distinguishing different backup status types; furthermore, the backup strategy of the current time period with higher matching degree and better effect can be dynamically adjusted based on the target adjustment strategy; based on the backup strategy, the backup processing of the current time period can be intelligently and pointedly carried out, so that the resource consumption of the backup medium is effectively reduced, and the overall backup efficiency is improved.

The embodiment of the specification also provides a server, which comprises a processor and a memory for storing instructions executable by the processor, wherein the processor can execute the following steps according to the instructions when being implemented: inquiring a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object; according to the target backup object list, acquiring backup information of a first full backup of the target backup object and backup information of a second incremental backup from the end of the first full backup of the target backup object to the current time point by inquiring a backup system database; wherein the first full back-up is the last full back-up; determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; according to the target adjustment strategy, adjusting the backup strategy of the target backup object in a time period to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

In order to more accurately complete the above instructions, referring to fig. 5, another specific server is provided in this embodiment of the present disclosure, where the server includes a network communication port 501, a processor 502, and a memory 503, and the above structures are connected by an internal cable, so that each structure may perform specific data interaction.

The network communication port 501 may be specifically configured to query a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object.

The processor 502 may be specifically configured to obtain, by querying a backup system database according to the target backup object list, backup information of a first full-volume backup of the target backup object and backup information of a second incremental backup from a current time point to a current time point after the first full-volume backup of the target backup object is completed; wherein the first full back-up is the last full back-up; determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; according to the target adjustment strategy, adjusting the backup strategy of the target backup object in a time period to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

The memory 503 may be used to store a corresponding program of instructions.

In this embodiment, the network communication port 501 may be a virtual port that binds with different communication protocols, so that different data may be sent or received. For example, the network communication port may be a port responsible for performing web data communication, a port responsible for performing FTP data communication, or a port responsible for performing mail data communication. The network communication port may also be an entity's communication interface or a communication chip. For example, it may be a wireless mobile network communication chip, such as GSM, CDMA, etc.; it may also be a Wifi chip; it may also be a bluetooth chip.

In this embodiment, the processor 502 may be implemented in any suitable manner. For example, the processor may take the form of, for example, a microprocessor or processor, and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable logic controller, and an embedded microcontroller, among others. The description is not intended to be limiting.

In this embodiment, the memory 503 may include a plurality of layers, and in a digital system, the memory may be any memory as long as it can hold binary data; in an integrated circuit, a circuit with a memory function without a physical form is also called a memory, such as a RAM, a FIFO, etc.; in the system, the storage device in physical form is also called a memory, such as a memory bank, a TF card, and the like.

The embodiments of the present specification also provide a computer program product comprising a computer program which, when executed by a processor, implements: inquiring a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object; according to the target backup object list, acquiring backup information of a first full backup of the target backup object and backup information of a second incremental backup from the end of the first full backup of the target backup object to the current time point by inquiring a backup system database; wherein the first full back-up is the last full back-up; determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; according to the target adjustment strategy, adjusting the backup strategy of the target backup object in a time period to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

The embodiments of the present specification also provide a computer readable storage medium storing computer program instructions that when executed implement a method for processing backup data as described above: inquiring a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object; according to the target backup object list, acquiring backup information of a first full backup of the target backup object and backup information of a second incremental backup from the end of the first full backup of the target backup object to the current time point by inquiring a backup system database; wherein the first full back-up is the last full back-up; determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object; according to the target adjustment strategy, adjusting the backup strategy of the target backup object in a time period to obtain the backup strategy of the target backup object in the current time period; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

In the present embodiment, the storage medium includes, but is not limited to, a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), a Cache (Cache), a Hard Disk (HDD), or a Memory Card (Memory Card). The memory may be used to store computer program instructions. The network communication unit may be an interface for performing network connection communication, which is set in accordance with a standard prescribed by a communication protocol.

In this embodiment, the functions and effects of the program instructions stored in the computer readable storage medium may be explained in comparison with other embodiments, and are not described herein.

Referring to fig. 6, on a software level, the embodiment of the present disclosure further provides a device for processing backup data, where the device may specifically include the following structural modules:

the first query module 601 may specifically be configured to query a backup system database to determine a target backup object list; the target backup object list at least comprises object identifiers of target backup objects of the backup strategy to be adjusted in the current time period; the backup system database contains backup information of historical backup of the backup object;

The second query module 602 may be specifically configured to obtain, by querying a backup system database according to the target backup object list, backup information of a first full-volume backup of the target backup object and backup information of a second incremental backup from a current time point to a current time point after the first full-volume backup of the target backup object is completed; wherein the first full back-up is the last full back-up;

the determining module 603 may be specifically configured to determine, from a preset adjustment policy set, a target adjustment policy that matches the current target backup object according to backup information of the first full backup and backup information of the second incremental backup of the target backup object;

the adjustment module 604 may be specifically configured to adjust a backup policy of a current time period of the target backup object according to the target adjustment policy, to obtain the backup policy of the current time period of the target backup object; the backup strategy of the current time period of the target backup object is used for carrying out backup processing of the current time period on the target backup object.

In some embodiments, before the backup system database is queried and the target backup object list is determined, the device may be further configured to collect, by using a corresponding backup tool, backup information of historical backups of each backup object in a previous time period at a preset time period during implementation; and storing the backup information of the historical backup of the last time period of each backup object into a backup system database according to the corresponding storage rule.

In some embodiments, the backup information of the historical backup may specifically include at least one of the following: the backup type of the historical backup, the backup start time of the historical backup, the backup end time of the historical backup, the recovery state mark of the historical backup, the cleaning label of the historical backup, the backup data volume of the historical backup and the like.

In some embodiments, when the first query module 601 is specifically implemented, the backup system database may be queried to determine the target backup object list according to the following manner: inquiring a backup system database, and screening a backup object with a recovery state mark of historical backup of the previous time period being a positive mark as a target backup object of the current time period; and obtaining and generating a target backup object list according to the object identification of the target backup object.

In some embodiments, when the determining module 603 is specifically implemented, the target adjustment policy matching the current target backup object may be determined according to the backup information of the first full backup and the backup information of the second incremental backup of the target backup object from the preset adjustment policy set according to the following manner: determining the backup data volume of the first full backup according to the backup information of the first full backup of the target backup object; determining the accumulated backup data amount of the second incremental backup according to the backup information of the second incremental backup; predicting the backup data volume of the next incremental backup according to the backup information of the second incremental backup; determining the type of the current target backup condition of the target backup object according to the backup data volume of the first full backup, the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup; and determining a target adjustment strategy matched with the current target backup object from a preset adjustment strategy set according to the target backup condition type of the current target backup object.

In some embodiments, when the determining module 603 is specifically implemented, the backup data amount of the next incremental backup may be predicted according to the backup information of the second incremental backup in the following manner: and calculating the average value of the backup data volume of the second incremental backup according to the backup information of the second incremental backup, and taking the average value as the backup data volume of the next incremental backup.

In some embodiments, when the determining module 603 is specifically configured, the type of the target backup status of the current target backup object may be determined according to the backup data amount of the first full backup, the accumulated backup data amount of the second incremental backup, and the backup data of the next incremental backup in the following manner: detecting whether the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is larger than the backup data volume of the first full backup according to the backup data volume of the first full backup, the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup; detecting whether the average value of the backup data volume of the second incremental backup is larger than the preset proportional value of the backup data volume of the first full backup or not under the condition that the sum of the accumulated backup data volume of the second incremental backup and the backup data volume of the next incremental backup is larger than the backup data volume of the first full backup; under the condition that the average value of the backup data volume of the second incremental backup is less than or equal to the preset proportion value of the backup data volume of the first full backup, determining that the target backup condition type is the first backup condition type; otherwise, determining that the target backup status type is the third backup status type.

In some embodiments, when the determining module 603 is specifically configured, the determining module may be further configured to detect, when it is determined that a sum of the accumulated backup data amount of the second incremental backup and the backup data amount of the next incremental backup is less than or equal to the backup data amount of the first full backup, whether an accumulated time period from the end of the first full backup of the target backup object to the current time point is greater than a preset accumulated time period threshold; under the condition that the accumulated time from the end of the first full-quantity backup of the target backup object to the current time point is less than or equal to a preset accumulated time threshold value, determining that the target backup condition type is a second backup condition type; otherwise, determining that the target backup status type is the fourth backup status type.

In some embodiments, when the determining module 603 is specifically implemented, the target adjustment policy matching the current target backup object may be determined from the preset adjustment policy set according to the target backup status type of the current target backup object in the following manner: under the condition that the current target backup condition type of the target backup object is the first backup condition type, determining a corresponding first preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the corresponding first preset adjustment strategy as a target adjustment strategy; under the condition that the current target backup condition type of the target backup object is determined to be the second backup condition type, determining a corresponding second preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the second preset adjustment strategy as the target adjustment strategy; under the condition that the current target backup condition type of the target backup object is determined to be the third backup condition type, determining a corresponding third preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the third preset adjustment strategy as the target adjustment strategy; and under the condition that the current target backup object is determined to be the fourth backup object, determining a corresponding fourth preset adjustment strategy from a preset adjustment strategy set according to the corresponding relation, and taking the fourth preset adjustment strategy as the target adjustment strategy.

In some embodiments, when the target adjustment policy is the first preset adjustment policy, the adjustment module 604 may adjust the backup policy of the last time period of the target backup object according to the target adjustment policy according to the following manner to obtain the backup policy of the current time period of the target backup object when the target adjustment policy is specifically implemented: according to a first preset adjustment strategy, setting a first backup aiming at the current time period in a backup strategy of the previous time period as full backup; and adjusting the interval duration of the incremental backup after the first backup in the current time period to obtain the backup strategy of the current time period of the target backup object.

In some embodiments, when the target adjustment policy is the second preset adjustment policy, the adjustment module 604 may adjust the backup policy of the last time period of the target backup object according to the target adjustment policy according to the following manner to obtain the backup policy of the current time period of the target backup object when the target adjustment policy is specifically implemented: according to a second preset adjustment strategy, modifying full-quantity backup aiming at the current time period in the backup strategy of the previous time period into incremental backup; and adjusting the interval duration of the incremental backup in the current time period to obtain the backup strategy of the current time period of the target backup object.

In some embodiments, when the target adjustment policy is the third preset adjustment policy, the adjustment module 604 may adjust the backup policy of the last time period of the target backup object according to the target adjustment policy according to the following manner to obtain the backup policy of the current time period of the target backup object when the target adjustment policy is specifically implemented: according to a third preset adjustment strategy, the incremental backup aiming at the current time period in the backup strategy of the previous time period is modified into full-quantity backup; adjusting the interval duration of full backup in the current time period; and setting a backup reminding mechanism to obtain a backup strategy of the target backup object in the current time period.

In some embodiments, when the target adjustment policy is the fourth preset adjustment policy, the adjustment module 604 may adjust the backup policy of the last time period of the target backup object according to the target adjustment policy according to the following manner to obtain the backup policy of the current time period of the target backup object when the target adjustment policy is specifically implemented: and setting the first backup aiming at the current time period in the backup strategy of the previous time period as full backup according to a fourth preset adjustment strategy to obtain the backup strategy of the current time period of the target backup object.

In some embodiments, after the backup policy of the last time period of the target backup object is adjusted according to the target adjustment policy to obtain the backup policy of the current time period of the target backup object, the device may be further configured to query a backup system database to determine a target cleaning object list when the device is implemented; the target cleaning object list at least comprises an object identifier of a backup object of which whether backup data on the backup medium need to be cleaned or not is to be determined in the current time period; according to the target cleaning object list, the first full-quantity backup and the last full-quantity backup restoration state before the first full-quantity backup are marked as positively marked backup objects by inquiring the backup system database, and the target cleaning object is determined; setting a cleaning label for the last full-quantity backup before the first full-quantity backup of the target cleaning object and the incremental backup between the last full-quantity backup before the first full-quantity backup of the target cleaning object and the first full-quantity backup of the target cleaning object; the cleaning tag is used for indicating backup data to be cleaned in the backup medium in the current time period.

It should be noted that, the units, devices, or modules described in the above embodiments may be implemented by a computer chip or entity, or may be implemented by a product having a certain function. For convenience of description, the above devices are described as being functionally divided into various modules, respectively. Of course, when the present description is implemented, the functions of each module may be implemented in the same piece or pieces of software and/or hardware, or a module that implements the same function may be implemented by a plurality of sub-modules or a combination of sub-units, or the like. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

From the above, based on the backup data processing apparatus provided in the embodiments of the present disclosure, the target adjustment policy that matches the current target backup object may be accurately determined by distinguishing different backup status types; furthermore, the backup strategy of the current time period with higher matching degree and better effect can be dynamically adjusted based on the target adjustment strategy; based on the backup strategy, the backup processing of the current time period can be intelligently and pointedly carried out, so that the resource consumption of the backup medium is effectively reduced, and the overall backup efficiency is improved.

In a specific scenario example, for a data processing system of a transaction facility such as a bank, the backup system of at least the policy adjustment module and the medium cleaning module may be constructed by applying the processing method of backup data provided in the present specification, and specifically, reference may be made to fig. 7, and the backup policy may be dynamically adjusted by using the backup system, and at the same time, redundant data in a backup medium may be automatically cleaned. The specific procedure can be found in the following.

The backup system is constructed and utilized to regularly collect the backup result condition, grasp the condition of a specific backup object, calculate and analyze the condition according to the backup condition, automatically adjust the backup strategy according to the designated strategy, enable the backup object to switch between full backup and increment, operate the backup storage medium after the backup is successful, clear the historical backup data set and form a backup cycle. Thereby improving the utilization rate of the backup retention medium or reducing the call of the backup resource, and further realizing the optimization and the promotion of the whole backup resource.

Referring to fig. 7, the main function of the policy scheduling module is to form a loop through a tool, periodically collect data on a backup condition, and dynamically (e.g. distinguish specific backup status types) adjust the backup policy according to the grasped backup data characteristics.

When the policy scheduling module is specifically executed, the backup condition stage can be checked periodically. Specifically, the above modules mainly adopt Python, SHELL as a development language, and MySQL as a data storage tool (hereinafter referred to as a system database).

The main function of the stage is to periodically start the inspection function of the backup condition. For example, the data acquisition is performed on the NBU at four times a day periodically to obtain the recent backup activity condition of the designated backup object. The backup object list is a list (for example, a target object list) manually set in the earlier stage, and records the backup objects, full backup, incremental backup and other information of which the dynamic cyclic backup strategy of the invention needs to be adopted. The acquired backup cases (e.g., backup information) include: 1. backup object names; 2. backup date; 3. a backup start date; 4. the backup end date; 5. backup status (success, failure in implementation); 6. backup data volume; 7. backup type (full backup, incremental); 8. a recoverable state (1 recoverable, 0 ready to clear); 9. a data cleaning mark; 10. full standby policy start time, etc., and update relevant information into a system database (e.g., a backup system database). After the inspection is completed, the following stage can be entered: and calculating a backup condition stage.

In the stage of calculating the backup condition (i.e. determining the type of the target backup condition of the target backup object), the algorithm for judgment is mainly calculated according to the collected information and the algorithm of the invention. See in particular fig. 8.

Specifically, after triggering, data with a recoverable state being recoverable (for example, a recoverable state flag is an affirmative flag) may be obtained from the system database according to each backup object in the backup object list, and a table is formed. The backup information of the last full backup (e.g., the first full backup), in particular, the data backup size, the backup status, the backup end time point, etc., is obtained. And simultaneously obtaining incremental backups (such as a second incremental backup) which are successful from the last full backup to all current backup states, and calculating the sum of the data backup amounts. If the sum of the incremental backup data (e.g., the cumulative amount of backup data for the second incremental backup) and the average incremental backup data amount (e.g., the predicted amount of backup data for the next incremental backup) is greater than the most recent full backup data amount (e.g., the amount of backup data for the first full backup), then the backup policy enters the A policy combination. If (sum of incremental backup data + average incremental backup data size) is less than the most recent full backup data size, the backup policy enters a B-policy combination. If the over-backup policy is a policy combination (e.g., a first preset adjustment policy) and the sum of incremental average backup data is greater than 50% of the total backup data amount, then policy combination C (e.g., a third preset adjustment policy) is entered. If policy combination B (e.g., the second preset adjustment policy) is backed up and the last full backup to the current point in time has reached a preset threshold (typically 1 month), policy combination D (e.g., the fourth preset adjustment policy) is entered.

Then, it can be confirmed whether the adjustment phase is triggered. The policy combination can be determined through an algorithm, and compared with the current latest policy combination of the backup object. If the strategy combination is unchanged, the strategy adjustment is not needed, the backup strategy adjustment stage is directly skipped, and if the strategy combination is inconsistent with the latest strategy, the backup strategy adjustment stage is entered.

In the stage of adjusting the backup strategy, the strategy can be adjusted according to the strategy combination, and the related strategy adjustment action information is updated into the system database. Specifically, the adjustment can be performed according to the following strategy combination:

1) The strategy combination A adjusts the last backup starting window to be a full backup strategy; and simultaneously, the incremental backup is regulated to be daily, and the incremental strategy of the last backup starting window is canceled.

2) Policy combination B, temporarily not configuring the full standby policy; and meanwhile, the incremental backup is regulated to be daily, and the incremental strategy of the last backup starting window is forcedly started.

3) And C, strategy combination, namely adjusting a daily full-backup strategy and forcedly starting a latest backup starting window. The system manager is notified of the large incremental data amount of the backup object through mail or alarm, the combination of full backup and increment is not recommended, daily full backup is recommended to be implemented, and the system manager confirms whether the data growth condition is abnormal or not.

4) Policy combination D, the adjustment may refer to the processing of policy combination a.

After the completion of the present phase, the next phase cycle can be entered.

The medium cleaning module has the main functions of forming circulation through the tool, periodically inspecting the condition of the backup medium and timely cleaning redundant data.

In the periodic checking media case phase, the tool periodically checks the system database inventory, and in particular confirms that the recoverable state column is 1, that data is available for recovery while remaining in the backup media, performs data acquisition according to the backup object classification, and forms a table (e.g., a target clean up inventory). And enter the computing media case phase.

In the computing medium case phase, the full standby may be checked for recoverable full standby according to the form case, and if there are more than two full standby recently, the full standby in the long term is marked as to be cleaned (e.g., a cleaning tag is set). And simultaneously marking the incremental backup before the last full backup (actually according to the time point when the backup is successfully ended) as to be cleaned.

And after confirming whether the cleaning stage is triggered or not, entering the cleaning stage after checking the backup media to be cleaned.

In the implementation cleaning stage, cleaning of the backup medium is implemented through an interface of the backup system, and meanwhile, information such as a recoverable state, a data cleaning identifier and the like is updated in a system database, and the implementation log condition of related cleaning actions is recorded.

After the completion of the present phase, the next phase cycle is entered.

Through the application in the scene example, the processing method of the backup data provided by the specification is verified, the data quantity of full backup and incremental backup can be statistically analyzed by monitoring the backup condition of the backup object, the characteristics of the backup object are analyzed, the backup history condition of the backup object is applied to different strategy combinations, and meanwhile, redundant backup data and media are cleaned timely. And the dynamic cyclic adjustment of the backup strategy combination can effectively avoid the frequent starting of full backup caused by the fixed backup strategy, and reduce the occupation of backup medium resources. The utilization rate of the backup medium can be effectively reduced and the whole resource of the backup system can be optimized by timely cleaning the historical redundant data. The method can also be used for clearly reading the backup statistical information and characteristics of the backup object through recording and analyzing the historical backup activity of the backup object, and providing data support for the follow-up backup strategy tuning and architecture optimization.

Although the present description provides method operational steps as described in the examples or flowcharts, more or fewer operational steps may be included based on conventional or non-inventive means. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When implemented by an apparatus or client product in practice, the methods illustrated in the embodiments or figures may be performed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment, or even in a distributed data processing environment). The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, it is not excluded that additional identical or equivalent elements may be present in a process, method, article, or apparatus that comprises a described element. The terms first, second, etc. are used to denote a name, but not any particular order.

Those skilled in the art will also appreciate that, in addition to implementing the controller in a pure computer readable program code, it is well possible to implement the same functionality by logically programming the method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers, etc. Such a controller can be regarded as a hardware component, and means for implementing various functions included therein can also be regarded as a structure within the hardware component. Or even means for achieving the various functions may be regarded as either software modules implementing the methods or structures within hardware components.

The description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, classes, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer-readable storage media including memory storage devices.

Although the present specification has been described by way of example, it will be appreciated by those skilled in the art that there are many variations and modifications to the specification without departing from the spirit of the specification, and it is intended that the appended claims encompass such variations and modifications as do not depart from the spirit of the specification.

Claims

1. A method for processing backup data, comprising:

2. The method of claim 1, wherein prior to querying the backup system database to determine the target backup object list, the method further comprises:

3. The method of claim 2, wherein the backup information of the historical backup comprises at least one of: the method comprises the steps of a backup type of the historical backup, a backup start time of the historical backup, a backup end time of the historical backup, a recovery state mark of the historical backup, a cleaning label of the historical backup and a backup data volume of the historical backup.

4. The method of claim 2, wherein determining a target adjustment policy matching the current target backup object from a set of preset adjustment policies based on backup information of the first full backup and backup information of the second incremental backup of the target backup object, comprises:

5. The method of claim 4, wherein predicting the amount of backup data for the next incremental backup based on the backup information for the second incremental backup, comprises:

6. The method of claim 4, wherein determining the target backup status type of the current target backup object based on the backup data amount of the first full backup, the accumulated backup data amount of the second incremental backup, and the backup data of the next incremental backup comprises:

7. The method of claim 6, wherein the method further comprises:

8. The method of claim 7, wherein determining a target adjustment policy matching the current target backup object from a set of preset adjustment policies based on the target backup status type of the current target backup object, comprises:

under the condition that the current target backup condition type of the target backup object is determined to be the first backup condition type, determining a corresponding first preset adjustment strategy from a preset adjustment strategy set as a target adjustment strategy;

under the condition that the current target backup condition type of the target backup object is determined to be the second backup condition type, determining a corresponding second preset adjustment strategy from a preset adjustment strategy set to serve as a target adjustment strategy;

under the condition that the current target backup condition type of the target backup object is determined to be the third backup condition type, determining a corresponding third preset adjustment strategy from a preset adjustment strategy set to serve as a target adjustment strategy;

And under the condition that the current target backup object is determined to be the fourth backup object, determining a corresponding fourth preset adjustment strategy from a preset adjustment strategy set as a target adjustment strategy.

9. The method of claim 8, wherein, in the case that the target adjustment policy is the first preset adjustment policy, adjusting the backup policy of the last time period of the target backup object according to the target adjustment policy to obtain the backup policy of the current time period of the target backup object, includes:

10. The method of claim 8, wherein, in the case that the target adjustment policy is the second preset adjustment policy, adjusting the backup policy of the last time period of the target backup object according to the target adjustment policy to obtain the backup policy of the current time period of the target backup object includes:

11. The method of claim 8, wherein, in the case that the target adjustment policy is the third preset adjustment policy, adjusting the backup policy of the last time period of the target backup object according to the target adjustment policy to obtain the backup policy of the current time period of the target backup object includes:

12. The method of claim 8, wherein, in the case that the target adjustment policy is the fourth preset adjustment policy, adjusting the backup policy of the last time period of the target backup object according to the target adjustment policy to obtain the backup policy of the current time period of the target backup object, includes:

13. The method of claim 1, wherein after adjusting the backup policy for a time period on the target backup object according to the target adjustment policy to obtain the backup policy for the current time period of the target backup object, the method further comprises:

14. A backup data processing apparatus, comprising:

15. A server comprising a processor and a memory for storing processor-executable instructions, which when executed by the processor implement the steps of the method of any one of claims 1 to 13.