WO2018177036A1

WO2018177036A1 - Database data archiving method and system, terminal, and computer readable storage medium

Info

Publication number: WO2018177036A1
Application number: PCT/CN2018/076198
Authority: WO
Inventors: 凌剑; 姜云鹏; 吴海波; 马向东; 丁杰
Original assignee: 平安科技（深圳）有限公司
Priority date: 2017-03-31
Filing date: 2018-02-11
Publication date: 2018-10-04
Also published as: CN108664524A

Abstract

Disclosed is a database data archiving method. The method comprises: obtaining a resource occupancy rate of a database in real time, and detecting a variation trend of the resource occupancy rate of the database; starting a data archiving task for data archiving if it is detected that the resource occupancy rate decreases to a preset first threshold; obtaining the resource occupancy rate and the variation trend thereof in real time during the data archiving, and stopping the data archiving task if it is detected that the resource occupancy rate increases to a preset second threshold. Also disclosed are a database data archiving system, a terminal, and a computer readable storage medium. The present application can take full advantage of operating resources of a database, and avoid the waste of resources during an idle period.

Description

Database data archiving method, system, terminal and computer readable storage medium

The present application claims the priority of the Chinese Patent Application, filed on Jan. 31, 2017, filed Jan.

Technical field

The present application relates to the field of database technologies, and in particular, to a database data archiving method, system, terminal, and computer readable storage medium.

Background technique

As the number of data files in the database increases, the performance of the database will gradually decrease, and the data in the database will be archived in time to improve and stabilize the performance of the database. At present, the data archiving of the database is performed by a timed task, that is, according to the preset task execution time, the data archiving task is started periodically, and the data archiving task is stopped periodically.

Due to the low flexibility of the timing task, the data archiving task is easy to conflict with other JOB tasks in the database. At the same time, multiple tasks in parallel will result in a particularly high resource rate and performance degradation of the database during a certain period of time. The resource usage rate of the time period without JOB task running is relatively low, which seriously wastes the resources of the database.

Summary of the invention

The main purpose of the present application is to provide a database data archiving method, system, terminal and computer readable storage medium, aiming at solving the technical problem of database resource waste.

To achieve the above objective, the present application provides a database data archiving method, and the database data archiving method includes the following steps:

Obtaining the resource occupancy rate of the database in real time, and detecting a change trend of the database resource occupancy rate;

If it is detected that the resource occupancy rate is reduced to a preset first threshold, the data archiving task is started, and data archiving is performed;

When data archiving is performed, the resource occupancy rate and its changing trend are obtained in real time, and if the resource occupancy rate is detected to increase to a preset second threshold, the data archiving task is stopped.

In addition, to achieve the above object, the present application further provides a database data archiving system, where the database data archiving system includes:

An acquiring module, configured to acquire a resource occupancy rate of the database in real time, and detect a change trend of the database resource occupancy rate;

a startup module, configured to start a data archiving task and perform data archiving if detecting that the resource occupancy rate is reduced to a preset first threshold;

The obtaining module is further configured to acquire the resource occupancy rate and its changing trend in real time when performing data archiving;

The stopping module is configured to stop the data archiving task if the resource occupancy rate is detected to increase to a preset second threshold.

In addition, in order to achieve the above object, the present application further provides a terminal, where the terminal includes: a memory, a processor, and a database data archiving program stored on the memory and operable on the processor, the database data The following steps are implemented when the archiver is executed by the processor:

In addition, in order to achieve the above object, the present application further provides a computer readable storage medium, where the database data storage program is stored, and the database data archive program is executed by the processor to implement the following steps:

The database data archiving method, system, terminal and computer readable storage medium proposed by the embodiments of the present application obtain the resource occupancy rate of the database in real time, monitor the resource occupancy of the database, and detect the change trend of the database resource occupancy rate; The resource usage of the database is reduced to a preset first threshold, indicating that the database is currently in an idle state, then the data archiving task is started, data archiving is performed, and the idle period of the seamless docking database is realized; when data archiving is performed, real-time access is performed. The resource occupancy rate of the database and its changing trend are to grasp the state of the resource occupancy rate of the database and respond in time; if the resource occupancy rate of the database increases to a preset second threshold, indicating that the database is currently in a busy state, the data is stopped. Archiving tasks to avoid preempting system resources with other processes in the database, resulting in system performance degradation. The data inductive task in the present application is based on the change trend of the resource occupancy rate of the database and the preset threshold value is started or stopped in real time, and has high flexibility, can fully utilize the running resources of the database, avoid waste of idle period resources, and improve the use of database resources. rate. Moreover, according to the resource occupancy rate of the database, the data induction task can be avoided, and the peak period of resource usage of the database can be avoided, thereby improving the data processing efficiency of the database in each time period and improving the overall performance of the database.

DRAWINGS

1 is a schematic flowchart of a first embodiment of a database data archiving method according to the present application;

2 is a schematic flowchart of a second embodiment of a database data archiving method according to the present application;

3 is a schematic flowchart of a step of acquiring the resource occupancy rate of the database in real time in FIG. 1;

4 is a schematic flowchart of a fourth embodiment of a database data archiving method according to the present application;

5 is a schematic diagram of functional modules of a first embodiment and a third embodiment of a database data archiving system of the present application;

6 is a schematic diagram of functional modules of a second embodiment of a database data archiving system of the present application;

7 is a schematic diagram of functional modules of a fourth embodiment of a database data archiving system of the present application;

FIG. 8 is a schematic structural diagram of a terminal in a hardware operating environment according to an embodiment of the present application.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

Referring to FIG. 1 , a first embodiment of a database data archiving method of the present application provides a database data archiving method, where the database data archiving method includes:

Step S10: Obtain a resource occupancy rate of the database in real time, and detect a change trend of the database resource occupancy rate.

When archiving the data of the database, the application discards the traditional timing task, and follows the resource usage of the database, flexibly configures the running time of the archiving task, fully utilizes the idle resources of the database, and avoids the peak of the JOB task in the database. To improve the resource efficiency of the database.

Specifically, first, the data archiving system acquires the resource occupancy rate of the database in real time.

As an implementation manner, the resource occupancy rate of the database can be obtained through the monitoring platform. The monitoring platform calculates the real-time resource occupancy rate of the database by monitoring the key resources in the database, the usage of the read and write pages, the usage of the data blocks of the disk, and the usage rate of the buffer. Since the processes in the database may change in real time, the data archiving system needs to retrieve the resource occupancy rate of the database from the monitoring platform in real time to understand the resource usage of the database.

After obtaining the real-time resource occupancy rate of the database, the data archiving system detects the change trend of the resource occupancy rate.

As an implementation manner, the data archiving system can determine the real-time change trend of the resource occupancy rate according to the value of the resource occupancy of the current time and the value of the resource occupancy rate of the previous time or the difference. For example, if the resource occupancy rate at the current time is 50% and the resource occupancy rate at the previous time is 40%, the change trend of the resource occupancy rate may be determined to be increased.

Of course, as another implementation manner, the data archiving system can also detect the overall trend of the resource occupancy rate within the preset duration. The preset duration can be flexibly set according to actual needs. Specifically, the data archiving system first determines the initial time according to the current time and the preset duration. For example, the current time is 12:0, the preset time is 4 minutes, and the initial time is 11:56. Then, according to the value of the resource occupancy of the current time and the value of the resource occupancy rate of the initial time or the difference, the real-time change trend of the resource occupancy rate is determined, and the obtained trend is the overall trend of the entire time interval from the initial time to the current time.

Step S20: If it is detected that the resource occupancy rate is reduced to a preset first threshold, the data archiving task is started, and data archiving is performed.

After obtaining the resource occupancy rate of the database, the data archiving system determines whether the data archiving task can be started according to the resource occupancy rate.

Specifically, as an implementation manner, the data archiving system monitors the change trend of the database resource occupancy rate in real time.

If the resource usage of the database is continuously reduced, it indicates that there are more and more idle resources in the database. When the resource usage rate decreases to the preset first threshold, the data archiving task is started, and data such as historical data and logs are archived. The first threshold is a threshold for starting the data archiving task, and can be flexibly configured according to actual needs, for example, 30%.

In step S30, when the data is archived, the resource occupancy rate and its changing trend are obtained in real time. If the resource occupancy rate is detected to increase to a preset second threshold, the data archiving task is stopped.

While the data archiving system performs data archiving, the data archiving system obtains the resource occupancy rate in real time and continues to detect the resource occupancy rate change trend of the database. If the resource occupancy rate is continuously increased, when the preset second threshold is increased, for example, 80%, the data archiving system stops the data archiving task to prevent other processes in the database from preempting resources and affecting the performance of the database. It should be noted that the first threshold and the second threshold may be flexibly configured according to actual needs. Preferably, the first threshold is less than the second threshold.

Further, in order to prevent the data resource occupation rate from increasing to a second threshold caused by starting the data archiving task, the data archiving task is frequently started and stopped, and the resource occupied by the data archiving task can be estimated in advance, and the data archiving task is determined. Resource occupancy rate. Then, the second threshold is configured according to the first threshold and the resource occupancy rate of the data archiving task, and the second threshold may be higher than the sum of the first threshold and the resource occupancy of the data archiving task. For example, if the first threshold is 30% and the resource occupancy rate of the data archiving task is 2%, the second threshold can be configured to be 35%, and a certain resource is reserved for the data archiving task or other JOB tasks.

Preferably, as another implementation manner, the growth value of the database resource occupancy rate after starting the data archiving task is first obtained. Specifically, the database resource occupancy rate at the moment after the data archiving task is started and the database resource occupancy rate at the moment before the data archiving task is started may be calculated, and the growth rate of the database resource occupancy rate is calculated.

Then, the second threshold is configured according to the preset first threshold and the calculated growth value. That is to say, the second threshold is configured according to the actual resource occupancy of the database, and the second threshold may be higher than the sum of the first threshold and the growth value. For example, if the first threshold is 30% and the resource occupancy rate increases by 2% after the data archiving task is started, the second threshold can be configured to be 35%, and a certain resource is reserved for the data archiving task or other JOB tasks. Thereafter, the data archiving system continues to detect the resource occupancy rate and trend of the database, and stops or restarts the data archiving task according to the resource occupancy rate.

As a result, data archiving of the database is achieved.

In this embodiment, the resource occupancy rate of the database is obtained in real time to monitor the resource occupancy of the database, and the change trend of the database resource occupancy rate is detected; if the resource occupancy rate of the database is reduced to a preset first threshold, indicating that the database is currently When entering the idle state, the data archiving task is started, and data archiving is performed to realize the idle period of the seamless docking database; when data archiving is performed, the resource occupancy rate of the database and its changing trend are acquired in real time, so as to grasp the resource occupancy state of the database. If the resource occupancy rate of the database increases to a preset second threshold, indicating that the database is currently in a busy state, the data archiving task is stopped, and the system resources are prevented from being seized by other processes in the database, resulting in system performance degradation. . In this embodiment, the data induction task is based on the change trend of the database resource occupancy rate and the preset threshold value is started or stopped in real time, and has high flexibility, can fully utilize the running resources of the database, avoid waste of idle period resources, and improve the use of database resources. rate. Moreover, according to the resource occupancy rate of the database, the data induction task can be avoided, and the peak period of resource usage of the database can be avoided, thereby improving the data processing efficiency of the database in each time period and improving the overall performance of the database.

Further, referring to FIG. 2, the second embodiment of the database data archiving method of the present application provides a database data archiving method. The database data archiving method further includes:

Step S40: Determine whether the current time is within a preset archiving period; if the current time is within a preset archiving period, step S10 is performed.

Due to the difference in the amount of data in different databases, different databases require different lengths of data to be summarized; moreover, due to the use of the database, the amount of data stored in different time periods is different, so that the database does not need to be continuously Induction of data. Therefore, the archiving cycle can be preset, and the data is summarized only in the archiving cycle to avoid the suspended database inductive task. Although the data induction has been completed, the process still exists and wastes resources.

Specifically, as an implementation manner, before starting the data induction task, it is required to detect whether the current time is within a preset archival period. The preset archiving period may be a fixed time interval of each day, a fixed time interval of each week, a fixed time interval of each month, and the like, for example, from 1 to 7 of each month.

If the current time is in the preset archiving period, the resource occupancy rate of the database is obtained in real time, and the trend of the database resource occupancy rate is detected, thereby determining whether data archiving needs to be started. When it is detected that the resource occupancy rate of the database is reduced to a preset first threshold, the data archiving task is started, and data archiving is performed. It should be noted that, when entering the preset archiving period, if the change trend of the database resource occupancy rate is reduced, and the current resource occupancy rate is less than the first threshold, the data archiving task is started, and data archiving is performed.

Thereby, time period control of the data archiving task is realized.

In this embodiment, the control of the data archiving cycle is implemented to control centralized data archiving only in a fixed period, thereby avoiding waste of resources in the data archiving task.

Further, referring to FIG. 3, the third embodiment of the database data archiving method of the present application provides a database data archiving method, based on the embodiment shown in FIG. 1 or FIG. 2 (the embodiment is illustrated by using FIG. 1). Step S10 includes:

In step S11, the JOB task in the database is counted, and the running information of each JOB task is obtained.

The resource usage of the database can also be calculated based on the JOB task in the database. The step of "acquiring the resource occupancy rate of the database in real time" can be further refined to "statistically query the JOB task in the database, obtain the running information of each JOB task; and obtain the database at each moment according to the running information of each JOB task. Resource occupancy rate."

Specifically, as an implementation manner, first, all JOB tasks currently existing in the database are counted. It should be noted that the JOB task refers to a specific task that is periodically executed in the database. The periodicity may be daily, weekly, monthly, yearly, etc.; specific tasks may be deletion, storage, backup, and the like. For example, the data in the database is backed up at 1 am every Monday.

After all the JOB tasks in the database are obtained by statistics, the running information of each JOB task is obtained. Further, the running information of the JOB task includes a running time, a starting frequency, and resource occupancy information of the JOB task. The running time of the JOB task includes the start time and stop time of the JOB task; the start frequency of the JOB task is the time interval between the JOB task and the last running, for example, once a week, once every hour. The resource occupancy information of the JOB task runtime includes the database running resource information occupied by the JOB task at runtime, such as the data range, the amount of data, and the application of the service.

Step S12: Acquire, according to the operation information of each JOB task, the resource occupancy rate of the database at each moment.

After obtaining the running information of the JOB task, the resource occupancy rate of the database at each moment is calculated according to the running information of the JOB task in the database.

First, according to the running time and starting frequency of each JOB task, all the JOB tasks running at the same time in the database can be obtained. Then, according to the number of all JOB tasks running at this time, and the resource occupation information of each JOB task running, the time is calculated. Database resource usage. When calculating the resource occupancy rate of the database, the database resource occupancy rate at this moment can be calculated according to the number of JOB tasks, the data range involved in each JOB task operation, the amount of data, and the weights corresponding to the pre-configured factors.

Thereby, the resource occupancy rate of each time of the database can be calculated.

In this embodiment, the resource occupancy rate of the database at each moment is calculated according to the JOB task in the database, thereby avoiding the peak period in which the JOB task occupies a high running resource, and archiving data only when the resource occupancy rate is low. .

Further, referring to FIG. 4, the fourth embodiment of the database data archiving method of the present application provides a database data archiving method. The database data archiving method further includes:

Step S50: When it is detected that the JOB task in the database is updated, the operation information of the JOB task is updated, and the process proceeds to step S12.

The administrator can add, delete or modify the JOB task as needed to update the JOB task.

When the data induction system detects that the JOB task of the database is updated, because the updated JOB task may change the execution time and other factors, it is necessary to update the operation information of the JOB task. After updating the running information of the JOB task, according to the updated JOB task running information, the resource occupancy rate of the database at each moment is recalculated, and the data inductive task of the database is started or stopped.

In this embodiment, the JOB task information in the database is monitored. If the JOB task in the database is updated, the running information of the JOB task is updated to recalculate the resource occupancy rate of the database, and the resource occupancy rate of the database is performed. Correction.

Referring to FIG. 5, a first embodiment of the database data archiving system of the present application provides a database data archiving system, where the database data archiving system includes:

The obtaining module 10 is configured to acquire the resource occupancy rate of the database in real time, and detect a change trend of the database resource occupancy rate.

Specifically, first, the obtaining module 10 acquires the resource occupancy rate of the database in real time.

As an implementation manner, the resource occupancy rate of the database can be obtained through the monitoring platform. The monitoring platform calculates the real-time resource occupancy rate of the database by monitoring the key resources in the database, the usage of the read and write pages, the usage of the data blocks of the disk, and the usage rate of the buffer. Because the processes in the database may change in real time, the obtaining module 10 needs to retrieve the resource occupancy rate of the database from the monitoring platform in real time to understand the resource usage of the database.

After obtaining the real-time resource occupancy rate of the database, the obtaining module 10 detects the change trend of the resource occupancy rate.

As an implementation manner, the obtaining module 10 may determine a real-time change trend of the resource occupancy rate according to the value of the resource occupancy of the current time and the value of the resource occupancy rate of the previous time or the difference. For example, if the resource occupancy rate at the current time is 50% and the resource occupancy rate at the previous time is 40%, the change trend of the resource occupancy rate may be determined to be increased.

Of course, as another implementation manner, the acquiring module 10 can also detect the overall trend of the resource occupancy rate within the preset duration. The preset duration can be flexibly set according to actual needs. Specifically, the obtaining module 10 first determines an initial time according to the current time and the preset time length. For example, the current time is 12:0, the preset time is 4 minutes, and the initial time is 11:56. Then, the obtaining module 10 determines the real-time change trend of the resource occupancy rate according to the value of the resource occupancy and the initial time resource occupancy rate or the difference, and the obtained change trend is the whole time interval from the initial time to the current time. trend.

The startup module 20 is configured to start a data archiving task and perform data archiving if it is detected that the resource occupancy rate is reduced to a preset first threshold.

After obtaining the resource occupancy rate of the database, the startup module 20 determines whether the data archiving task can be started according to the resource occupancy rate.

Specifically, as an implementation manner, the startup module 20 monitors the change trend of the database resource occupancy rate in real time.

If the resource usage of the database is continuously reduced, it indicates that there are more and more idle resources in the database. When the resource usage rate decreases to a preset first threshold, the startup module 20 starts a data archiving task, and data such as historical data and logs. Archive. The first threshold is a threshold for starting the data archiving task, and can be flexibly configured according to actual needs, for example, 30%.

The obtaining module 10 is further configured to acquire the resource occupancy rate and its changing trend in real time when performing data archiving.

The stopping module 30 is configured to stop the data archiving task if the resource occupancy rate is detected to increase to a preset second threshold.

While the data is being archived, the obtaining module 10 obtains the resource occupancy rate in real time, and continues to detect the resource occupancy rate change trend of the database. If the resource occupancy rate is continuously increased, when the preset second threshold is increased, for example, 80%, the stop module 30 stops the data archiving task to prevent other processes in the database from preempting resources and affecting the performance of the database. It should be noted that the first threshold and the second threshold may be flexibly configured according to actual needs. Preferably, the first threshold is less than the second threshold.

Further, in order to prevent the data resource occupation rate from increasing to a second threshold, the data archiving task is frequently started and stopped, and the stopping module 30 can estimate the resource occupied by the data archiving task in advance and determine the data. The resource usage of the archived task. Then, the stopping module 30 configures the second threshold according to the first threshold and the resource occupancy rate of the data archiving task, and the second threshold may be higher than the sum of the first threshold and the resource occupancy rate of the data archiving task. For example, if the first threshold is 30% and the resource occupancy rate of the data archiving task is 2%, the stopping module 30 can configure the second threshold to be 35%, and reserve certain resources for the data archiving task or other JOB tasks.

Preferably, as another implementation manner, the stopping module 30 first acquires an increase value of the database resource occupancy rate after starting the data archiving task. Specifically, the database resource occupancy rate at the moment after the data archiving task is started and the database resource occupancy rate at the moment before the data archiving task is started may be calculated, and the growth rate of the database resource occupancy rate is calculated.

Then, the stopping module 30 configures the second threshold according to the preset first threshold and the calculated growth value. That is to say, the second threshold is configured according to the actual resource occupancy of the database, and the second threshold may be higher than the sum of the first threshold and the growth value. For example, if the first threshold is 30% and the resource occupancy rate increases by 2% after the data archiving task is started, the stop module 30 can configure the second threshold to be 35%, and reserve a certain amount for the data archiving task or other JOB tasks. resource of. Thereafter, the obtaining module 10 continues to detect the resource occupancy rate and the changing trend of the database, and the stopping module 30 stops or restarts the data archiving task according to the resource occupancy rate.

As a result, data archiving of the database is achieved.

In this embodiment, the acquiring module 10 acquires the resource occupancy rate of the database in real time, monitors the resource occupancy of the database, and detects the change trend of the database resource occupancy rate; if the resource occupancy rate of the database decreases to a preset first threshold, When the database is in the idle state, the startup module 20 starts the data archiving task and performs data archiving to realize the idle period of the seamless docking database. When the data is archived, the obtaining module 10 obtains the resource occupancy rate of the database and its changing trend in real time. To grasp the resource occupancy status of the database and respond in time; if the resource occupancy rate of the database increases to a preset second threshold, indicating that the database is currently in a busy state, the stop module 30 stops the data archiving task, avoiding the database Other processes in the system seize system resources, resulting in system performance degradation. In this embodiment, the data induction task is based on the change trend of the database resource occupancy rate and the preset threshold value is started or stopped in real time, and has high flexibility, can fully utilize the running resources of the database, avoid waste of idle period resources, and improve the use of database resources. rate. Moreover, according to the resource occupancy rate of the database, the data induction task can be avoided, and the peak period of resource usage of the database can be avoided, thereby improving the data processing efficiency of the database in each time period and improving the overall performance of the database.

Further, referring to FIG. 6, the second embodiment of the database data archiving system of the present application provides a database data archiving system. The database data archiving system further includes:

The period module 40 is configured to determine whether the current time is within a preset archival period;

The obtaining module 10 is further configured to acquire a resource occupancy rate of the database in real time and detect a change trend of the database resource occupancy rate, if the current time is in a preset archival period.

Specifically, as an implementation manner, before starting the data induction task, the periodic module 40 needs to detect whether the current time is within a preset archival period. The preset archiving period may be a fixed time interval of each day, a fixed time interval of each week, a fixed time interval of each month, and the like, for example, from 1 to 7 of each month.

If the current time is in the preset archiving period, the obtaining module 10 obtains the resource occupancy rate of the database in real time, detects the change trend of the database resource occupancy rate, and determines whether the data archiving needs to be started. When it is detected that the resource occupancy of the database is reduced to a preset first threshold, the startup module 20 starts a data archiving task and performs data archiving. If the current time is not within the preset archiving period, the cycle module 40 prohibits the initiation of the data archiving task. It should be noted that, when the preset archiving period is entered, if the change trend of the database resource occupancy rate is decreased, and the current resource occupancy rate is less than the first threshold, the startup module 20 starts the data archiving task and performs data archiving. .

Thereby, time period control of the data archiving task is realized.

Further, referring to FIG. 5, a third embodiment of the database data archiving system of the present application provides a database data archiving system based on the first embodiment or the second embodiment of the database data archiving system of the present application (this embodiment archives database data) The first embodiment of the system is taken as an example. The acquiring module 10 is further configured to:

The JOB task in the database is counted, and the running information of each JOB task is obtained. According to the running information of each JOB task, the resource occupancy rate of the database at each moment is obtained.

The resource usage of the database can also be calculated based on the JOB task in the database. The "resource acquisition rate of the database in real time" can be further refined to "statistically record the JOB task in the database, obtain the operation information of each JOB task; and obtain the resource occupation of the database at each moment according to the operation information of each JOB task. rate".

Specifically, as an implementation manner, first, the acquiring module 10 counts all JOB tasks currently existing in the database. It should be noted that the JOB task refers to a specific task that is periodically executed in the database. The periodicity may be daily, weekly, monthly, yearly, etc.; specific tasks may be deletion, storage, backup, and the like. For example, the data in the database is backed up at 1 am every Monday.

After the statistics all the JOB tasks in the database are obtained, the obtaining module 10 obtains the running information of each JOB task. Further, the running information of the JOB task includes a running time, a starting frequency, and resource occupancy information of the JOB task. The running time of the JOB task includes the start time and stop time of the JOB task; the start frequency of the JOB task is the time interval between the JOB task and the last running, for example, once a week, once every hour. The resource occupancy information of the JOB task runtime includes the database running resource information occupied by the JOB task at runtime, such as the data range, the amount of data, and the application of the service.

After obtaining the running information of the JOB task, the obtaining module 10 calculates the resource occupancy rate of the database at each moment according to the running information of the JOB task in the database.

First, the obtaining module 10 can acquire all the JOB tasks running at the same time in the database according to the running time and the starting frequency of each JOB task; then, according to the number of all JOB tasks running at this moment, and the resource occupation information of each JOB task running, Calculate the database resource occupancy at this moment. When calculating the resource occupancy rate of the database, the obtaining module 10 may calculate the database resources at the moment according to the number of JOB tasks, the data range involved in each JOB task operation, the amount of data, and the weights corresponding to the pre-configured factors. Occupancy rate.

Thus, the obtaining module 10 can calculate the resource occupancy rate of the database at each moment.

Further, referring to FIG. 7, the fourth embodiment of the database data archiving system of the present application provides a database data archiving system. The database data archiving system further includes:

The update module 50 is configured to update the operation information of the JOB task when it is detected that the JOB task in the database is updated.

When the data induction system detects that the JOB task of the database is updated, because the updated JOB task may change the execution time and the like, the update module 50 needs to update the operation information of the JOB task. After updating the running information of the JOB task, the obtaining module 10 recalculates the resource occupancy rate of the database at each moment according to the updated JOB task running information, and is used to start or stop the data inductive task of the database.

In this embodiment, the JOB task information in the database is monitored. If the JOB task in the database is updated, the update module 50 updates the running information of the JOB task to recalculate the resource occupancy rate of the database and the resources of the database. The occupancy rate is corrected.

As shown in FIG. 8, FIG. 8 is a schematic structural diagram of a terminal in a hardware operating environment according to an embodiment of the present application. The terminal in this embodiment may be a terminal device such as a PC. As shown in FIG. 8, the terminal may include a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, and a memory 1004. Among them, the communication bus 1002 is used to implement connection communication between these components. The user interface 1003 can include a display, an input unit such as a keyboard, and the optional user interface 1003 can also include a standard wired interface, a wireless interface. The memory 1004 may be a high speed RAM memory or a stable memory (non-volatile) Memory), such as disk storage. The memory 1004 can also optionally be a storage device independent of the aforementioned processor 1001.

It will be understood by those skilled in the art that the terminal structure shown in FIG. 8 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. As shown in FIG. 8, an operating system, a user interface module, and a database archiving program may be included in the memory 1004 as a computer storage medium. In the terminal shown in FIG. 8, the user interface 1003 is mainly used to connect a client (the user's mobile terminal) to perform data communication with the client; and the processor 1001 can be used to call a database archiving program stored in the memory 1004, and Do the following:

Further, the processor 1001 may be configured to invoke a database archiving program stored in the memory 1004, and further perform the following operations:

Determine whether the current time is within a preset archiving period;

If the current time is in the preset archiving period, the step is: acquiring the resource occupancy rate of the database in real time, and detecting a change trend of the resource occupancy rate.

Counting JOB tasks in the database to obtain running information of each JOB task;

According to the operation information of each JOB task, the resource occupancy rate of the database at each moment is obtained.

When the JOB task in the database is updated, the running information of the JOB task is updated, and the execution step is performed: the resource occupancy rate of the database at each moment is obtained according to the running information of the JOB task.

Further, the running information of the JOB task includes a running time, a starting frequency, and resource occupancy information of the JOB task.

The specific embodiment of the terminal of the present application is substantially the same as the foregoing embodiment of the database archiving method, and details are not described herein.

In addition, the embodiment of the present application further provides a computer readable storage medium, where the database readable storage medium stores a database data archiving program, and when the database data archiving program is executed by the processor, the following steps are implemented:

Further, when the database data archiving program is executed by the processor, the following steps are implemented:

Determine whether the current time is within a preset archiving period;

The specific embodiment of the computer readable storage medium of the present application is substantially the same as the embodiment of the above database archiving method, and details are not described herein.

It is also to be understood that the term "comprises", "comprising", or any other variants thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a And includes other elements not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a cloud server or a network device, etc.) to perform the methods of various embodiments of the present application.

The above is only an alternative embodiment of the present application, and thus does not limit the scope of the patent application, and the equivalent structure or equivalent process transformation of the specification and the drawings of the present application, or directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of this application.

Claims

A database data archiving method, characterized in that the database data archiving method comprises the following steps:

Obtaining the resource occupancy rate of the database in real time, and detecting a change trend of the database resource occupancy rate;

If it is detected that the resource occupancy rate is reduced to a preset first threshold, the data archiving task is started, and data archiving is performed;

When data archiving is performed, the resource occupancy rate and its changing trend are obtained in real time, and if the resource occupancy rate is detected to increase to a preset second threshold, the data archiving task is stopped.
The database data archiving method according to claim 1, wherein the database data archiving method further comprises:

Determine whether the current time is within a preset archiving period;

If the current time is in the preset archiving period, the step is: acquiring the resource occupancy rate of the database in real time, and detecting a change trend of the resource occupancy rate.
The database data archiving method according to claim 1, wherein the step of acquiring the resource occupancy rate of the database in real time comprises:

Counting JOB tasks in the database to obtain running information of each JOB task;

According to the operation information of each JOB task, the resource occupancy rate of the database at each moment is obtained.
The database data archiving method according to claim 3, wherein the database data archiving method further comprises:

When the JOB task in the database is updated, the running information of the JOB task is updated, and the execution step is performed: the resource occupancy rate of the database at each moment is obtained according to the running information of the JOB task.
The database data archiving method according to claim 4, wherein the running information of the JOB task includes a running time, a starting frequency, and resource occupancy information of the JOB task.
A database data archiving system, characterized in that the database data archiving system comprises:

An acquiring module, configured to acquire a resource occupancy rate of the database in real time, and detect a change trend of the database resource occupancy rate;

a startup module, configured to start a data archiving task and perform data archiving if detecting that the resource occupancy rate is reduced to a preset first threshold;

The obtaining module is further configured to acquire the resource occupancy rate and its changing trend in real time when performing data archiving;

The stopping module is configured to stop the data archiving task if the resource occupancy rate is detected to increase to a preset second threshold.
The database data archiving system of claim 6, wherein the database data archiving system further comprises:

a period module, configured to determine whether the current time is within a preset archival period;

The acquiring module is further configured to acquire a resource occupancy rate of the database in real time and detect a change trend of the database resource occupancy rate, if the current time is in a preset archiving period.
The database data archiving system according to claim 6, wherein the obtaining module is further configured to:

The JOB task in the database is counted, and the running information of each JOB task is obtained. According to the running information of each JOB task, the resource occupancy rate of the database at each moment is obtained.
The database data archiving system according to claim 8, wherein the database data archiving system further comprises:

And an update module, configured to update operation information of the JOB task when monitoring that the JOB task in the database is updated.
The database data archiving system according to claim 9, wherein the operation information of the JOB task includes a running time of the JOB task, a startup frequency, and resource occupancy information at runtime.
A terminal, comprising: a memory, a processor, and a database data archiving program stored on the memory and operable on the processor, wherein the database data archiving program is used by the processor The following steps are implemented during execution:

Obtaining the resource occupancy rate of the database in real time, and detecting a change trend of the database resource occupancy rate;

If it is detected that the resource occupancy rate is reduced to a preset first threshold, the data archiving task is started, and data archiving is performed;

When data archiving is performed, the resource occupancy rate and its changing trend are obtained in real time, and if the resource occupancy rate is detected to increase to a preset second threshold, the data archiving task is stopped.
The terminal according to claim 11, wherein said database data archiving program is further executed as follows when said processor executes:

Determine whether the current time is within a preset archiving period;

If the current time is in the preset archiving period, the step is: acquiring the resource occupancy rate of the database in real time, and detecting a change trend of the resource occupancy rate.
The terminal according to claim 11, wherein said database data archiving program is further executed as follows when said processor executes:

Counting JOB tasks in the database to obtain running information of each JOB task;

According to the operation information of each JOB task, the resource occupancy rate of the database at each moment is obtained.
The terminal according to claim 13, wherein said database data archiving program is further executed as follows when said processor executes:

When the JOB task in the database is updated, the running information of the JOB task is updated, and the execution step is performed: the resource occupancy rate of the database at each moment is obtained according to the running information of the JOB task.
The terminal according to claim 14, wherein the operation information of the JOB task includes a running time of the JOB task, a startup frequency, and resource occupancy information at runtime.
A computer readable storage medium, wherein the computer readable storage medium stores a database data archiving program, and when the database data archiving program is executed by the processor, the following steps are implemented:

Obtaining the resource occupancy rate of the database in real time, and detecting a change trend of the database resource occupancy rate;

If it is detected that the resource occupancy rate is reduced to a preset first threshold, the data archiving task is started, and data archiving is performed;

When data archiving is performed, the resource occupancy rate and its changing trend are obtained in real time, and if the resource occupancy rate is detected to increase to a preset second threshold, the data archiving task is stopped.
The computer readable storage medium of claim 16, wherein the database data archiving program is further executed by the processor to:

Determine whether the current time is within a preset archiving period;

If the current time is in the preset archiving period, the step is: acquiring the resource occupancy rate of the database in real time, and detecting a change trend of the resource occupancy rate.
The computer readable storage medium of claim 16, wherein the database data archiving program is further executed by the processor to:

Counting JOB tasks in the database to obtain running information of each JOB task;

According to the operation information of each JOB task, the resource occupancy rate of the database at each moment is obtained.
The computer readable storage medium of claim 18, wherein the database data archiving program is further executed by the processor to:

When the JOB task in the database is updated, the running information of the JOB task is updated, and the execution step is performed: the resource occupancy rate of the database at each moment is obtained according to the running information of the JOB task.
The computer readable storage medium according to claim 19, wherein the operation information of the JOB task includes a running time of the JOB task, a startup frequency, and resource occupancy information at runtime.