CN109656945A - A kind of information processing method - Google Patents
A kind of information processing method Download PDFInfo
- Publication number
- CN109656945A CN109656945A CN201811349476.0A CN201811349476A CN109656945A CN 109656945 A CN109656945 A CN 109656945A CN 201811349476 A CN201811349476 A CN 201811349476A CN 109656945 A CN109656945 A CN 109656945A
- Authority
- CN
- China
- Prior art keywords
- data
- backup
- data set
- target
- withdraws
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1415—Saving, restoring, recovering or retrying at system level
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of information processing methods, which comprises acquisition withdraws request；Request progress legitimacy authentication is withdrawn to described；When the authentication is passed for legitimacy, it obtains according to the time interval that withdraws for withdrawing that request carries and withdraws the corresponding global amount backup file of time interval and correction amount backup file with described, the acquisition target data set corresponding with the index symbol from database instance is accorded with according to the index；The corresponding business datum of the target data set is determined in the global amount backup file according to index symbol, and the corresponding daily record data of the target data set is determined in the correction amount backup file according to index symbol；Target Backup Data is formed according to the business datum and daily record data；The target Backup Data is withdrawn to withdrawing in data set.The embodiment of the present invention withdraws processing by carrying out data according to set coarseness, improves the efficiency that data withdraw processing.
Description
Technical field
The present embodiments relate to database technical field, in particular to a kind of information processing method.
Background technique
Under certain application scenarios, caused by user faces code vulnerabilities when data entanglement situation, needs to carry out data and return
Processing is removed, user withdraws request by triggering user end to server transmission, and server withdraws request according to this, obtains and this time
The corresponding backup file of request is removed, the backup file is imported into temporal instance, after the data check in temporal instance is successful,
Using the temporal instance replacement data library example to complete to withdraw.However, the known technology needs to be traversed in database instance
All data, and all data in database instance are withdrawn into processing to time interval is withdrawn, so that process resource is excessive
It occupies, causes to withdraw efficiency lower.
Summary of the invention
The embodiment of the invention provides a kind of information processing method, it is able to solve and is needed in the related technology by database instance
In all data withdrawn and lead to withdraw the lower problem of efficiency, the technical solution is as follows:
A kind of information processing method is applied to server, which comprises acquisition withdraws request, described to withdraw request
Including withdrawing time interval and index symbol；Request progress legitimacy authentication is withdrawn to described；When the authentication is passed for legitimacy, according to
It is described withdraw time interval and obtain withdraw that time interval is corresponding global to measure backup file and correction amount backup file, root with described
Target data set corresponding with the index symbol is obtained from database instance according to index symbol；According to the index Fu Suo
It states and determines the corresponding business datum of the target data set in global amount backup file, and accorded with according to the index in the amendment
It measures and determines the corresponding daily record data of the target data set in backup file, wherein the global amount backup file is in target
Backup time carries out the backup file that primary global backup obtains to database, when the correction amount backup file is described withdraws
Between at the beginning of section or finish time the operation log of the database is carried out between target backup time respectively it is standby
The backup file that part obtains；Target Backup Data is formed according to the business datum and daily record data；The target is backed up
Data are withdrawn to withdrawing in data set, wherein it is described withdraw data set be in the database instance with the target data set
Corresponding data acquisition system.
Information processing method provided by the embodiment of the present invention carries out data according to set coarseness and withdraws, avoids existing
When example rank is withdrawn in technology, need to withdraw efficiency caused by being withdrawn all data in database instance lower
The problem of.
Detailed description of the invention
Fig. 1 is the flow diagram of information processing method provided in an embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
With reference to Fig. 1, a kind of information processing method provided in an embodiment of the present invention is applied to server end, the method master
It comprises the following steps:
Step 1, it obtains and withdraws request, it is described to withdraw request including withdrawing time interval and index symbol.
Step 2, request progress legitimacy authentication is withdrawn to described.
Step 3, it when the authentication is passed for legitimacy, obtains according to the time interval that withdraws and described withdraws time interval pair
The global amount backup file and correction amount backup file answered, obtain and the index from database instance according to index symbol
Accord with corresponding target data set.
Step 4, it is accorded with according to the index and determines the corresponding industry of the target data set in the global amount backup file
Business data, and the corresponding log number of the target data set is determined in the correction amount backup file according to index symbol
According to, wherein the global amount backup file is that the backup that primary global backup obtains is carried out to database in target backup time
File, at the beginning of the correction amount backup file withdraws time interval for described in or when finish time backs up with target respectively
The backup file that the operation log of the database is backed up between quarter.
Step 5, target Backup Data is formed according to the business datum and daily record data.
Step 6, the target Backup Data is withdrawn to withdrawing in data set, wherein the data set that withdraws is described
Data acquisition system corresponding with the target data set in database instance.
Specifically, described that the target Backup Data is withdrawn into processing to withdrawing in data set in the step 6, it wraps
It includes:
The corresponding business datum of the target data set is written back to described withdraw in data set by step 61；
Step 62, after the completion of write back data, the corresponding daily record data of the target data set is played back into described withdraw
In data set.
In the present embodiment, the data withdraw processing, refer to the data in database being restored to a certain historical juncture, such as
It is restored to the information processing method at a certain moment that data occur before entanglement.
The database refers to the database being deployed in virtual computation environmental comprising multiple database instances.
In the present embodiment, the database include but is not limited to MongoDB database, SQL Server database,
Oracle database, MySQL database etc..Wherein, MongoDB database is a kind of Document image analysis, i.e. Oriented Documents
Database.It is mainly illustrated so that cloud database is MongoDB database as an example in the present embodiment.
The document refers to the basic unit of MongoDB database, similar to a table in relevant database
A line.
The set refers to that in MongoDB database, one group of document is known as a set, and set is database instance
One proper subclass of corresponding all data, similar to the combination of a table or at least two tables in relevant database.
The database instance is the running logical unit of work (LUW) of database, and a database instance can be to data
Library carries out once-through operation, such as: increase operation, modification operation, delete operation, optionally, database instance be one or
One group of structured query language sentence.
Operation log, all database manipulations and order in storing data library.In MongoDB database, copy set collection
Group is recorded all additions and deletions by oplog log and changes operation.Wherein, be stored in Oplog log in database one or
The changed content of a plurality of data and change time.
The global amount backup file carries out primary global backup to database in some historical juncture and is formed by number
According to the complete image file in library.
The correction amount backup file carries out backup institute to the changing unit in database based on global amount backup file
Obtained backup file.
Correction amount backup file include by least one of operation log, data logging and system log of database into
The backup file that row backup obtains.
Information processing method provided in this embodiment is withdrawn according to set coarseness, is avoided real in the related technology
Example rank needs to be withdrawn all data in database instance and leads to withdraw the lower problem of efficiency when withdrawing, one
Aspect, so that when user only needs to withdraw the partial data in database instance, it can be to the part for needing withdraw
Data are withdrawn, and are improved and are withdrawn efficiency；On the other hand, the partial data in the database instance withdraws treatment process
In other data and access unaffected, the range for reducing loss of data of maximum possible.
The information processing method provided in this embodiment includes:
Step 201, obtain client transmission withdraws request, and withdrawing request includes withdrawing time interval and index to accord with, rope
Draw symbol for target data set to be withdrawn in the example of unique identification data library.
Optionally, withdraw time interval be client send withdraw the sending instant of request before m days in it is any when
Between point.
Optionally, database instance includes at least two data acquisition systems, and data acquisition system is the database in database instance
Set either in database instance.The present embodiment is not limited this.
At least two data acquisition systems respectively correspond to a set identification, and set identification in database instance for uniquely marking
Know the data acquisition system.Target data set to be withdrawn is a data acquisition system in database instance.
When user needs to carry out data to withdraw processing, user is selected in database instance by used client
Target data set to be withdrawn and time interval is withdrawn, correspondingly, the client used by a user is sent to control centre
Request is withdrawn, it includes withdrawing time interval and index symbol that this, which withdraws request,.Corresponding, control centre receives time that client is sent
Request is removed, and this is withdrawn into request and is forwarded to the center of withdrawing.Corresponding, the center that withdraws receives withdrawing for control centre's forwarding and asks
It asks.
Step 202, it obtains and withdraws time interval and the corresponding target Backup Data of index symbol.
Optionally, center is withdrawn after receiving and withdrawing request, is determined that this withdraws in request and is withdrawn time interval and rope
Draw symbol, obtained from backup center and withdraws time interval and the corresponding target Backup Data of index symbol.
It should be noted that withdraw center from backup center with withdraw time interval and the corresponding target backup of index symbol
The process of data can refer to the associated description in following example, not introduce first herein.
Step 203, target Backup Data is withdrawn into processing to withdrawing in data set, withdrawing data set is in database instance
Data acquisition system corresponding with target data set.
It withdraws center and target Backup Data is withdrawn into processing to withdrawing in data set.Optionally, withdrawing data set is to obtain
The data acquisition system created after request is withdrawn to what client was sent.
In conclusion the embodiment of the present invention withdraws request by what acquisition client was sent, withdrawing request includes when withdrawing
Between section and index symbol, obtain and withdraw time interval and the corresponding target Backup Data of index symbol, by target Backup Data time
Processing is removed to withdrawing in data set, withdrawing data set is data acquisition system corresponding with target data set in database instance；I.e. originally
Information processing method provided by inventive embodiments is withdrawn according to set coarseness, and instance-level in the related technology is avoided
It needs to be withdrawn all data in database instance when not withdrawing and leads to withdraw the lower problem of efficiency, in a side
Face, so that when user only needs to withdraw the partial data in database instance, it can be to the part number for needing withdraw
According to being withdrawn, improves and withdraw efficiency；On the other hand, the partial data in the database instance is withdrawn in treatment process
Other data and unaffected, the range for reducing loss of data of maximum possible of access.
Specifically, the concrete processing procedure of information processing method provided in this embodiment is as follows:
Step 301, client sends to control centre and withdraws request.
User logs in console when needing to carry out data to withdraw processing, through client, which exists according to user
What the needs selected on console were withdrawn withdraw time interval, target data set to be withdrawn and input withdraw set identification,
Generation withdraws request, this withdraw request include withdraw time interval, for identify target data set to be withdrawn index accord with and
Withdraw set identification.
Withdrawing set identification is the set identification for withdrawing data set to be created specified by user, this withdraws set identification
Cannot target data set corresponding with database instance index symbol exist punching.
Step 302, control centre receive client transmission withdraw request after, this is withdrawn during request is forwarded to and withdraws
The heart.
This is withdrawn request and is forwarded to the center of withdrawing by control centre, corresponding, and the center of withdrawing receives this and withdraws request.
Step 303, withdraw center verify this withdraw request it is whether legal.
Optionally, when the center of withdrawing, which receives, withdraws request, verification withdraws the legitimacy of request, comprising: judgement backup
In center whether there is target backup file corresponding with time interval is withdrawn, alternatively, judge this withdraw time interval whether
In preset time range.When the center of withdrawing judges there is target corresponding with time interval is withdrawn backup text in backup center
Part, alternatively, determining that it is legal for withdrawing request when judging that this withdraws time interval in preset time range.
Schematically, preset time range is in m days before client transmission withdraws the sending instant of request.
If withdraw center determine withdraw request be it is legal, then follow the steps 304；Determine that withdrawing request is if withdrawing center
It is illegal, then terminate process.
Step 304, when the center that withdraws verify out this withdraw request it is legal after, obtain the overall situation corresponding with time interval is withdrawn
Measure backup file.
Optionally, center is withdrawn according to time interval is withdrawn, it is nearest that distance withdrawn time interval in the heart in the backup
Backup time is determined as target backup time, and N number of global amount backup file and N number of global amount backup text are stored in backup center
The corresponding backup time of part, N are positive integer；Obtain the corresponding global amount backup file of target backup time.Wherein, global
Amount backup file is that the backup file that primary global backup obtains is carried out to database in target backup time.
Optionally, the method that backup center backs up global amount backup file, including but not limited to following two can
The backup method of energy.
In a kind of possible backup method, backup center is spaced primary to database progress global standby at predetermined time intervals
Part obtains global amount backup file, and database includes M data acquisition system, and M is positive integer；M is extracted from overall situation amount backup file
A corresponding Backup Data of data acquisition system；The corresponding Backup Data of M data acquisition system is individually backed up standby to gather
Part file.
Optionally, it if backup center is to be backed up according to this kind of backup method to overall situation amount backup file, withdraws
Center obtains the corresponding global amount backup file of target backup time, comprising: it is standby to obtain the corresponding M set of target backup time
Part file.
In alternatively possible backup method, backup center is spaced at predetermined time intervals carries out the primary overall situation to database
Backup obtains global amount backup file, and overall situation amount backup file includes the corresponding business number of M data acquisition system in database
According to M is positive integer.In order to facilitate introduction, only it is illustrated by taking second of possible backup method as an example below.
Optionally, it is stored with N number of global amount backup file in backup center and N number of global amount backup file is corresponding
Backup time, N are positive integer.Wherein, the backup time of global amount backup file includes backing up opening for overall situation amount backup file
Begin moment and/or finish time.
Step 305, it withdraws center and the corresponding business of target data set is determined in overall situation amount backup file according to index symbol
Data.
It withdraws center to be accorded with according to index, overall situation amount backup file is filtered by built-in filter, obtains target
The corresponding business datum of data set.
Optionally, after withdrawing the corresponding global amount backup file of center acquisition target backup time, target is backed up into file
Decompression processing is carried out, and is accorded with according to index, the corresponding industry of target data set is determined from the target backup file after decompression processing
Business data.
Step 306, withdraw center according to withdraw request in withdraw set identification, create and withdraw in database instance
Set identification is corresponding to withdraw data set.
Optionally, when the center that withdraws verify out this withdraw request it is legal after, create and withdraw set in database instance
It identifies and corresponding withdraws data set.
Wherein, it withdraws set identification and the corresponding set identification of at least two data acquisition systems in database instance is equal
It is different.
It should be noted that step 306 can execute side by side with step 304 or step 305, step can also be first carried out
306 execute step 304 and step 305 again, and the present embodiment is not limited this.
Step 307, it withdraws center and is written back to the corresponding business datum of target data set and withdraw in data set.
Optionally, this withdraws data set and can set and retains certain time (such as 48 hours) and have function restriction, such as not
It can be carried out data backup, which includes automated back-up and manual backup.
It withdraws after the corresponding business datum of target data set is written back to and withdraws in data set by center, using withdrawing data set
Instead of target data set.
Optionally, it withdraws center use and withdraws data set instead of target data set, comprising: reservation withdraws the same of data set
When, the target data set in database instance is deleted, and discharge the resource of target data set.
Step 308, center is withdrawn to obtain target backup time and withdraw the correction amount backup file between time interval.
Wherein, correction amount backup file for target backup time and withdraws the operation log between time interval to database
The backup file backed up.
It should be noted that step 308 and step 304 can execute side by side, i.e., it ought withdraw center and verify out this and withdraw and ask
After asking legal, global amount backup file corresponding with time interval is withdrawn and correction amount backup file are obtained from backup center.
Step 309, it withdraws center and the corresponding log of target data set is determined in correction amount backup file according to index symbol
Data.
Optionally, the method that backup center backs up correction amount backup file, comprising: at predetermined time intervals interval or
Person backs up the operation log of database to obtain correction amount backup file in real time, and correction amount backup file includes in database
The corresponding daily record data of M data acquisition system, M are positive integer.
Optionally, it withdraws center and determines the corresponding daily record data of target data set in correction amount backup file, comprising: root
It is accorded with according to index, correction amount backup file is filtered by built-in filter, obtains the corresponding log number of target data set
According to.
Step 310, center is withdrawn after the completion of write back data, and the corresponding daily record data of target data set is played back to and is withdrawn
In data set.
Optionally, the corresponding daily record data of target data set includes K daily record data, and K is positive integer.Schematically, day
Will data are oplog daily record data.
Center is withdrawn successively to play back to and withdraw number target backup time and K daily record data for withdrawing between time interval
According to concentration.Since business datum may continue to write to during full backup, in order to guarantee the consistency of business datum, need
Oplog daily record data to be re-executed once since target backup time.Since oplog daily record data has idempotence,
Even if therefore data have existed, data entanglement will not be caused by repeatedly playing back again to K oplog daily record data.
In a schematical example, it is as follows which withdraws treatment process:
1, user passes through global wide area network (World Wide Web, WEB) console or application programming interface
(Application Programming Interface, API) will withdraw request and be sent to control centre.
User withdraws time interval and target data set to be withdrawn by determining in the application program of client to send out
Rise withdraw request, the application program pass through application programming interface (Application Programming Interface,
API) access control center to be to transmit data, thus make control centre receive it is corresponding withdraw request, this withdraws request and includes
Withdraw time interval and index symbol.
2, control centre will withdraw request and be forwarded to the center of withdrawing.
Optionally, control centre has in cluster management, metadata management, equipment management, process relationship and monitoring alarm
At least one function.
Control centre receive client send withdraw request after, this is withdrawn into request and is forwarded to the center of withdrawing.
3, the global amount backup file of center acquisition corresponding with time interval is withdrawn from backup center and correction amount are withdrawn
Backup file.
The center of withdrawing verify this withdraw request it is whether legal, if verify out this withdraw request be it is legal, from backup center
The global amount backup file of middle acquisition and correction amount backup file.
4, it withdraws center and target Backup Data is withdrawn into processing to withdrawing in data set.
It withdraws center the corresponding business datum of target data set is determined in global measure according to index symbol in backup file, and
The corresponding daily record data of target data set is determined in correction amount backup file, using the business datum determined and daily record data as
Target Backup Data is withdrawn processing to withdrawing in data set by target Backup Data.
Withdraw center and target Backup Data is withdrawn processing to withdrawing in data set, including two stages: full dose data are returned
Write phase and oplog log playback phase.In the full dose write back data stage, center is withdrawn by the corresponding business of target data set
Write back data is to withdrawing in data set.In oplog log playback phase, center is withdrawn by the corresponding log number of target data set
It is withdrawn in data set according to playing back to.
The two stages include but is not limited to following steps.
1, it withdraws center and sends the first request to backup center, first request is for request overall situation amount backup text
Part.
2, backup center returns to global amount backup file.
Backup center returns to global amount backup file to the center that withdraws, and corresponding, the filter withdrawn in center receives
The overall situation measures backup file.
3, filter is filtered overall situation amount backup file according to name space (English: namespace) to be withdrawn,
Obtain target data set.
Optionally, filter is arranged in withdrawing center, and the data which is used to get the center of withdrawing carry out
Filtration treatment.
4, filter returns to target data set to be withdrawn to the center of withdrawing.
5, it withdraws center the business datum that target data is concentrated is written to withdrawing data set.
6, it withdraws data set and returns to write-in result to the center that withdraws.
7, withdraw center to backup center send second request, this second request for request target backup time with
Withdraw the correction amount backup file between time interval.
8, backup center returns to target backup time and withdraws the correction amount backup file between time interval, i.e. target is standby
Part moment and withdraw the oplog log between time interval.
Backup center returns to oplog log to the center that withdraws, and corresponding, the filter withdrawn in center receives oplog
Log.
9, oplog log is filtered by filter according to name space to be withdrawn, and it is corresponding to obtain target data set
Oplog daily record data.
Optionally, oplog log is mapped as the processing operation of target data set by filter.For example, order creat () is used
Database is created in instruction, corresponding processing operation is that namespace parameter therein is changed to target data set
namespace；Order dropDatabase () is used to indicate the database deleted after withdrawing, and corresponding processing operation is to delete
Mesh number is gathered according to mark；Order drop () is used to indicate delete target data set, and corresponding processing operation is to delete mesh number to collect according to mark
It closes；Order collMod () is used to indicate the attribute information of modification set, and attribute information includes the expired time and data of index
The method of salary distribution etc. of document space in set, corresponding processing operation are that namespace parameter therein is changed to target collection
Namespace.
10, filter returns to the corresponding oplog daily record data of target data set to the center that withdraws.
Filter returns to oplog daily record data to be played back to the center of withdrawing, and corresponding, the center of withdrawing is received wait play back
Oplog daily record data.
11, it withdraws center and oplog daily record data is successively subjected in the heart playback operation in the backup.
12, backup center returns to playback result to the center that withdraws.
In oplog daily record data successively by carry out playback operation after, backup center to withdraw center return playback result.
The playback result includes the result for being used to indicate the successful result of playback operation or being used to indicate playback operation failure.It is corresponding
, the center of withdrawing receives the playback result.
It should be noted is that if withdrawing time interval is some overall situation amount backup file stored in backup center
Backup time, then withdraw center do not need obtain correction amount backup file, also there is no need to execute in correction amount backup file
The corresponding daily record data of middle determining target data set, and daily record data played back to and is withdrawn in data set.At this point, withdrawing
Center only needs to obtain global amount backup file.Therefore, withdraw center obtain with withdraw time interval and index symbol it is corresponding
Target Backup Data, may include: when in the backup in the heart find backup time identical with time interval is withdrawn when, will
Backup time is determined as target backup time, and N number of global amount backup file and N number of global amount backup text are stored in backup center
The corresponding backup time of part, N are positive integer；Obtain global amount backup file corresponding with time interval is withdrawn；According to rope
Draw symbol and determines the corresponding business datum of target data set in overall situation amount backup file.
It needs to illustrate on the other hand, since the embodiment of the present invention is to carry out data by set dimension to withdraw processing, to return
The target object removed is database instance, if too fast be written data toward withdrawing in data set, will traffic affecting it is normal
Read-write.Moreover, the oplog log space of MongoDB database is often limited, too fast write-in data may be from section
Before point pulls the oplog log of host node, oplog log to be read is covered, and then lead to host node in copy set cluster
The problem of with from node synchronous abnormality.Therefore, it in order to avoid the operation to database instance impacts, needs to withdraw data
The speed of processing is controlled.
For this purpose, the embodiment of the present invention withdraws flow-control mechanism using the concept realization of variable window.Data withdraw processing system
Further include monitoring center, withdraw center for oplog log and successively carry out playback operation in the heart in the backup, comprising: 1, agency's clothes
The corresponding service request of business device real time monitoring copy set cluster, generates monitoring data；2, proxy server is reported to monitoring center
The monitoring data；3, monitoring center receives the monitoring data, and the corresponding business of copy set cluster is obtained from monitoring data and is asked
Parameter is sought, which is used to indicate the pressure size of the corresponding service request of operation log in playback window.Monitoring
The service request parameter that center will acquire is sent to the center of withdrawing.Corresponding, the center of withdrawing receives the service request parameter,
It is adjusted according to window size of the service request parameter to playback window.4, withdraw center according to playback window adjusted after
The continuous data that carry out withdraw processing.
Center is withdrawn in above-mentioned steps, oplog log is successively subjected to playback operation in the heart in the backup, including but unlimited
In following steps:
Step 801, the window size of playback window is initialized, the window size of playback window is used to indicate primary playback behaviour
Make the quantity of corresponding daily record data.
The window size of center initialization playback window is withdrawn, the window size of playback window, which can be, withdraws center default
It is arranged, is also possible to artificially to be arranged, the present embodiment is not limited this.
For example, the window size of initialization playback window is 4, that is, it is used to indicate the corresponding database of a playback operation
The quantity of operation log is " 4 ".
Step 802, service request parameter is obtained, it is corresponding that service request parameter is used to indicate daily record data in playback window
The pressure size of service request.
It withdraws center and obtains the corresponding service request parameter of copy set cluster, which includes query rate per second
(Queries-per-second, QPS) and/or evaluation time delay.
Wherein, query rate per second is used to indicate the corresponding service request of copy set cluster stream handled at the appointed time
Measure size.Evaluation time delay is used to indicate to length of time used in the corresponding service request of copy set cluster.
Optionally, it further includes monitoring center that data, which withdraw processing system, and monitoring center is for obtaining monitoring data, from monitoring
The corresponding service request parameter of copy set cluster is obtained in data, which includes query rate per second and/or evaluation
Time delay.Service request parameter is sent to the center of withdrawing by monitoring center, corresponding, and the center of withdrawing receives service request ginseng
Number.
It withdraws center and obtains service request parameter, comprising: be spaced the acquisition business from monitoring center at predetermined time intervals and ask
Seek parameter；Alternatively, service request parameter is obtained from monitoring center in real time.
Step 803, according to service request parameter, the window size of playback window is adjusted.
Center is withdrawn according to service request parameter, the window size of playback window is adjusted, comprising: work as service request
When parameter meets preset condition, expand the window size of playback window；When service request time delay is unsatisfactory for preset condition, reduce
The window size of playback window.Wherein, preset condition includes that query rate per second is greater than the first preset threshold, and/or evaluation time delay
Less than the second preset threshold.The present embodiment is not limited the practical value of the first preset threshold and the second preset threshold.
Optionally, the window size of middle auxocardia playback window is withdrawn, comprising: by the window size of playback window multiplied by
The window size of playback window adjusted is calculated in one predetermined coefficient.The window size that center reduces playback window is withdrawn,
It include: that the window size of playback window adjusted is calculated divided by the second predetermined coefficient in the window size of playback window.
Wherein, the first predetermined coefficient and the second predetermined coefficient are all larger than 1.
Optionally, the first predetermined coefficient and the second predetermined coefficient are identical coefficients, or are different coefficient.For example,
First predetermined coefficient and the second predetermined coefficient are 2.
Step 804, according to playback window adjusted, playback operation is continued to execute to daily record data.
Center is withdrawn according to playback window adjusted, playback operation is continued to execute to the daily record data not yet played back.
Wherein, the corresponding daily record data of target data set includes K daily record data, and K daily record data includes having played back
At least one of the daily record data played back in daily record data, current window and the daily record data not yet played back.
In one embodiment, it includes 2 oplog played back days that the window size of playback window, which is 2, K oplog log,
Will data, the center that withdraws obtains evaluation time delay, when judging to evaluate time delay less than the second preset threshold, by the window of playback window
For mouth size multiplied by the first predetermined coefficient 2, the window size of the playback window after being adjusted is " 4 ", i.e., playback window adjusted
4 oplog logs after the oplog log played back in mouthful to 2 continue to execute playback operation.
In conclusion the embodiment of the present invention also obtains the corresponding service request parameter of copy set cluster by withdrawing center,
According to service request parameter, the window size of playback window is adjusted, according to playback window adjusted, to daily record data
Playback operation is continued to execute, speed when enabling the center of withdrawing that according to the monitoring data of real time monitoring data are withdrawn with processing
It is controlled, avoids impacting the operation of database instance.
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and
Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.
Claims (2)
1. a kind of information processing method, which is characterized in that be applied to server, which comprises
Acquisition withdraws request, described to withdraw request including withdrawing time interval and index symbol；
Request progress legitimacy authentication is withdrawn to described；
When the authentication is passed for legitimacy, according to it is described withdraw time interval and obtain withdraw the corresponding global amount of time interval with described
Backup file and correction amount backup file obtain mesh corresponding with the index symbol according to index symbol from database instance
Mark data set；
The corresponding business datum of the target data set, and root are determined in the global amount backup file according to index symbol
The corresponding daily record data of the target data set is determined in the correction amount backup file according to index symbol, wherein described
Overall situation amount backup file is that the backup file that primary global backup obtains, the amendment are carried out to database in target backup time
At the beginning of amount backup file withdraws time interval for described in or finish time is respectively between target backup time to described
The backup file that the operation log of database is backed up；
Target Backup Data is formed according to the business datum and daily record data；
The target Backup Data is withdrawn to withdrawing in data set, wherein the data set that withdraws is the database instance
In data acquisition system corresponding with the target data set.
2. information processing method according to claim 1, which is characterized in that described that the target Backup Data is withdrawn place
Reason is to withdrawing in data set, comprising:
The corresponding business datum of the target data set is written back to described withdraw in data set；
After the completion of write back data, the corresponding daily record data of the target data set is played back into described withdraw in data set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811349476.0A CN109656945A (en) | 2018-11-14 | 2018-11-14 | A kind of information processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811349476.0A CN109656945A (en) | 2018-11-14 | 2018-11-14 | A kind of information processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109656945A true CN109656945A (en) | 2019-04-19 |
Family
ID=66110933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811349476.0A Pending CN109656945A (en) | 2018-11-14 | 2018-11-14 | A kind of information processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109656945A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111930712A (en) * | 2020-09-10 | 2020-11-13 | 北京联想协同科技有限公司 | File control method and device and storage medium |
| CN116775664A (en) * | 2023-08-17 | 2023-09-19 | 金篆信科有限责任公司 | Database playback method, device, system and medium for improving time degree of freedom |
-
2018
- 2018-11-14 CN CN201811349476.0A patent/CN109656945A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111930712A (en) * | 2020-09-10 | 2020-11-13 | 北京联想协同科技有限公司 | File control method and device and storage medium |
| CN116775664A (en) * | 2023-08-17 | 2023-09-19 | 金篆信科有限责任公司 | Database playback method, device, system and medium for improving time degree of freedom |
| CN116775664B (en) * | 2023-08-17 | 2023-11-14 | 金篆信科有限责任公司 | Database playback method, device, system and medium for improving time degree of freedom |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8738565B2 (en) | Collecting data from data sources | |
| US8418003B2 (en) | Log collecting apparatus, program, method, and system | |
| US7778959B2 (en) | Protecting storages volumes with mock replication | |
| CN107992398A (en) | The monitoring method and monitoring system of a kind of operation system | |
| US8112399B2 (en) | Method and apparatus for configurable data aggregation in a data warehouse | |
| CN105468989B (en) | Cloud storage quota management method based on linux kernel monitoring | |
| CN107209704A (en) | Detect the write-in lost | |
| CN103729361A (en) | Method and device for testing performance of database | |
| DE102013201174A1 (en) | Online review of a standby database in physical replication environments using log shipping | |
| CN108228390A (en) | Data return shelves method and device | |
| CN105302697B (en) | A kind of running state monitoring method and system of density data model database | |
| CN104022913B (en) | For method of testing and the device of data cluster | |
| CN103618652A (en) | Audit and depth analysis system and audit and depth analysis method of business data | |
| US20070112876A1 (en) | Method and apparatus for pruning data in a data warehouse | |
| CN110019469A (en) | Distributed data base data processing method, device, storage medium and electronic device | |
| CN104182302A (en) | Database backup method and device | |
| CN109656945A (en) | A kind of information processing method | |
| CN110008197A (en) | A kind of data processing method, system and electronic equipment and storage medium | |
| CN109714249A (en) | A kind of method for pushing and relevant apparatus of small routine message | |
| US11341842B2 (en) | Metering data management system and computer readable recording medium | |
| CN110175070A (en) | Management method, device, system, medium and the electronic equipment of distributed data base | |
| US9977726B2 (en) | System and method for smart framework for network backup software debugging | |
| CN107329832A (en) | A kind of data receiver method and device | |
| CN104021079B (en) | Real-time monitoring and analyzing system and method for host system data | |
| CN108763933A (en) | A kind of application management method and system based on auto-programming inventory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190419 |