CN107239457A - Data archiving method and device - Google Patents
Data archiving method and device Download PDFInfo
- Publication number
- CN107239457A CN107239457A CN201610182520.8A CN201610182520A CN107239457A CN 107239457 A CN107239457 A CN 107239457A CN 201610182520 A CN201610182520 A CN 201610182520A CN 107239457 A CN107239457 A CN 107239457A
- Authority
- CN
- China
- Prior art keywords
- data
- filing
- handling system
- archived
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the present application provides a kind of data archiving method and device, and methods described includes：Obtain the systematic function of data handling system；Monitor whether the systematic function is met in performance requirement condition, and the runtime data storehouse of the data handling system with the presence or absence of the data to be archived for meeting data archive condition；Performance requirement condition is met in the systematic function, and when there are the data to be archived for meeting archive condition in the runtime data storehouse, data filing instruction is generated, responding the data filing by the data handling system instructs the data storage to be archived into filing data storehouse.The embodiment of the present application realizes data automatic archiving, improves data filing efficiency, and do not interfere with system operation.
Description
Technical field
The application belongs to technical field of data processing, specifically, is related to a kind of data archiving method and dress
Put.
Background technology
With the development of network and computer technology, the data handling system based on computer technology,
The processing such as processing, arrangement, analysis to data are realized to operate, and with data processing complexity
And the increase of data volume, the storage and maintenance of data in data handling system, face average annual tens of
Hundred million DBMSs increase the challenge of scale, if things go on like this in data handling system, runtime data storehouse
The accumulation of mass data will result directly in the reduction of database performance in (runtime database),
So as to influence data processing, Consumer's Experience is influenceed.
Therefore it is accomplished by data handling system, the data in runtime data storehouse carry out data and returned
Shelves, partial data are stored in another single filing data storehouse, to ensure runtime data
The response time in storehouse, it is ensured that the efficiency of data processing.
In the prior art, data filing is mainly by manually completing, and selection needs what is filed
Data, are stored in filing data storehouse, but file this mode manually, complex operation, efficiency
It is relatively low.
The content of the invention
In view of this, technical problems to be solved in this application there is provided a kind of data archiving method and dress
Put, realize data automatic archiving, improve data filing efficiency.
In order to solve the above-mentioned technical problem, this application discloses a kind of data archiving method, including：
Obtain the systematic function of data handling system；
Monitor the systematic function and whether meet performance requirement condition, and the data handling system fortune
With the presence or absence of the data to be archived for meeting data archive condition in database during row；
Return in the systematic function meets performance requirement condition, and the runtime data storehouse in the presence of satisfaction
During the data to be archived of shelves condition, generation data filing instruction is responded described by the data handling system
Data filing instruction is by the data storage to be archived into filing data storehouse.
Preferably, return in the runtime data storehouse for judging the data handling system with the presence or absence of satisfaction
The data to be archived of shelves condition include：
Judge in the runtime data storehouse of the data handling system with the presence or absence of operating frequency less than frequency
Threshold value, data volume are more than higher than data threshold or the last operating time and the time difference of current time
The tables of data of time threshold；There will be operating frequency less than frequency threshold, data volume higher than data threshold or
Person's operating time the last time and the time difference of current time are more than data in the tables of data of time threshold
It is used as data to be archived.
Preferably, in the runtime data storehouse for judging the data handling system, if there is satisfaction
The data to be archived of archive condition include：
In the runtime data storehouse for judging the data handling system, if there is operating frequency less than frequency
Threshold value or the last operating time and the time difference of current time are more than the number to be archived of time threshold
According to.
Preferably, in the data handling system responds the data filing instruction process, methods described
Also include：
It is changed into being unsatisfactory for the performance requirement from meeting performance requirement condition when monitoring the systematic function
During condition, generation filing pause instruction responds the filing pause instruction by the data handling system,
The data pause to be archived is stored to filing data storehouse；
During the data handling system response filing pause instruction, when monitoring the system
When performance is changed into meeting again the performance requirement condition from being unsatisfactory for the performance requirement condition, generation is returned
Shelves recover instruction, recover instruction by the data handling system response filing, continuation is waited to return by described
File data is stored to filing data storehouse.
Preferably, the systematic function includes system load and/or database response time；
It is described to judge whether the systematic function meets performance requirement condition and include：
Judge whether the system load is less than load threshold and/or whether the database response time is small
In response lag.
A kind of data filing device, including：
Performance acquisition module, the systematic function for obtaining data handling system；
Performance monitoring module, for monitoring whether the systematic function meets performance requirement condition；
File and whether there is in judge module, the runtime data storehouse for judging the data handling system
Meet the data to be archived of data archive condition；
File trigger module, for meeting performance requirement condition in the systematic function, and during the operation
When there are the data to be archived for meeting archive condition in database, generation data filing instruction, by the number
The data filing is responded according to processing system to instruct the data storage to be archived into filing data storehouse.
Preferably, it is described filing judge module specifically for：
Judge in the runtime data storehouse of the data handling system with the presence or absence of operating frequency less than frequency
Threshold value, data volume are more than higher than data threshold or the last operating time and the time difference of current time
The tables of data of time threshold；There will be operating frequency less than frequency threshold, data volume higher than data threshold or
During person's operating time the last time and the time difference of current time are more than in the tables of data of time threshold
Data are used as data to be archived.
Preferably, it is described filing judge module specifically for：
In the runtime data storehouse for judging the data handling system, if there is operating frequency less than frequency
Threshold value or the last operating time and the time difference of current time are more than the number to be archived of time threshold
According to.
Preferably, in addition to：
Filing pause module, for responding the data filing instruction process in the data handling system
In, monitor that the systematic function is changed into being unsatisfactory for the performance requirement condition from meeting performance requirement condition
When, generation filing pause instruction responds the filing pause instruction, by institute by the data handling system
Data pause to be archived is stated to store to filing data storehouse；
File recovery module, in the data handling system response filing pause instruction process
In, monitor that the systematic function is changed into meeting the performance again from being unsatisfactory for the performance requirement condition
During demand condition, generation filing recovers instruction, is referred to by the data handling system response filing recovery
Order, continues the data storage to be archived to filing data storehouse.
Preferably, the systematic function includes system load and/or database response time；
The performance judging module includes：
Judge whether the system load is less than load threshold and/or whether the database response time is small
In response lag.
Compared with prior art, the application can be obtained including following technique effect：
Exist in the systematic function of data handling system meets performance requirement condition, and runtime data storehouse
When meeting the data to be archived of archive condition, i.e., automatically by data filing to be archived into filing data storehouse,
The embodiment of the present application realizes data automatic archiving, improves data filing efficiency, reduces data filing
Complexity, and consider systematic function, only when systematic function meets performance requirement condition, then carry out
Data filing so that data filing operation does not interfere with system operation.
Certainly, implementing any product of the application must be not necessarily required to while reaching all the above skill
Art effect.
Brief description of the drawings
Accompanying drawing described herein is used for providing further understanding of the present application, constitutes one of the application
Point, the schematic description and description of the application is used to explain the application, does not constitute to the application's
It is improper to limit.In the accompanying drawings：
Fig. 1 is a kind of flow chart of data archiving method one embodiment of the embodiment of the present application；
Fig. 2 is a kind of flow chart of another embodiment of data archiving method of the embodiment of the present application；
Fig. 3 is a kind of structural representation of data filing device one embodiment of the embodiment of the present application；
Fig. 4 is a kind of structural representation of another embodiment of data filing device of the embodiment of the present application；
Fig. 5 is a kind of structural representation of data archiving system one embodiment of the embodiment of the present application.
Embodiment
Presently filed embodiment is described in detail below in conjunction with drawings and Examples, thereby to the application
How application technology means can fully understand to solve technical problem and reach the implementation process of technology effect
And implement according to this.
Data handling system in the embodiment of the present application can be applied in different business scenarios, realize industry
The processing for data of being engaged in, such as data handling system can be connected with banking system, with refund, payment etc.
Business datum in business function, data handling system namely including user's funds data, according to not of the same trade or business
Business request, such as refund request or payment request, it is possible to achieve to processing operation of user's funds data etc..
In the runtime data storehouse of data handling system, the incremental of data volume will aggravate runtime data
The response time in storehouse, data processing will be influenceed.Need to be returned the data in runtime data
Shelves.In the prior art, data filing is mainly by manually completing, and selection needs the number filed
According to storing into filing data storehouse, but file this mode manually, it is complex operation, less efficient.
In order to improve the efficiency of data filing, data filing complexity is reduced, inventor is by one
Row research and propose technical scheme, in the embodiment of the present application, and obtain data handling system is
System performance；Judge whether the systematic function meets performance requirement condition, and the data handling system
Runtime data storehouse in the presence or absence of meeting the data to be archived of data archive condition；In the systematicness
The number to be archived for existing in performance requirement condition, and the runtime data storehouse and meeting archive condition can be met
According to when, generation data filing instruction responds data filing instruction by institute by the data handling system
Data storage to be archived is stated into filing data storehouse.The embodiment of the present application, rationally make use of data processing system
The systematic function surplus of system, will be full when the systematic function of data handling system meets performance requirement condition
The data storage to be archived of sufficient data archive condition realizes data automatic archiving into filing data storehouse,
And the system operation of data handling system is not interfered with, and so as to improve the efficiency of data filing, reduction
The complexity of artificial filing.
Technical scheme is described in detail below in conjunction with accompanying drawing.
A kind of flow chart of data archiving method one embodiment that Fig. 1 provides for the embodiment of the present application, should
Method can include following steps：
101：Obtain the systematic function of data handling system.
Wherein, the systematic function of data handling system is obtained, can get data filing with confidence
Performed during filing instruction in breath, the filing instruction in the data filing configuration information can by user with
Shi Jinhang dynamic configurations, data filing configuration information can be only fitted in data handling system or and data
In the resource management system of processing system connection.
Therefore, as another embodiment, the systematic function of the acquisition data handling system, Ke Yishi
When getting the filing instruction of user's triggering, the systematic function of data handling system is obtained.
Certainly, in data handling system running, the operation of step 101 can also be performed in real time.
Wherein, the systematic function for obtaining data handling system can be the number for obtaining monitoring system collection
According to the systematic function of processing system.
Monitoring system is used to carry out performance monitoring to data handling system, including the database response time, is
System load etc. systematic function.So as to directly be from what monitoring system obtained the data handling system
System performance.
102：Monitor whether the systematic function meets performance requirement condition, if it is, step 103 is performed,
Terminate flow if not.
Systematic function can include the system load of data handling system, the database in runtime data storehouse rings
The database response of the performance data of systematic function, wherein runtime data storehouse can be characterized between seasonable etc.
Time can refer to average response time.
Performance requirement condition is used to represent that systematic function surplus is supported to perform data filing operation enough.
As a kind of possible implementation, the systematic function can include system load and/or database
Response time；
Therefore, the performance requirement condition can be less than load threshold and/or database response for system load
Time is less than response lag.
It is described to judge whether the systematic function meets performance requirement condition namely judge the system load
Whether it is less than load threshold and/or whether the database response time is less than response lag.
103：Judge that the runtime data storehouse of the data handling system whether there is and meet archive condition
Data to be archived, if it is, performing step 104, terminate flow if not.
The archive condition can be pre-configured with, and can also be updated according to user's request, be realized dynamic
Configuration.
Archive condition can be only fitted in data handling system, can also configure and connect with data handling system
In the resource management system connect, therefore the archive condition can be obtained from resource management system first.
104：Data filing instruction is generated, responding the data filing by the data handling system instructs
By the data storage to be archived into filing data storehouse.
The operation of step 101~step 104 can be performed by data handling system in the embodiment of the present application,
It can be performed by the data filing equipment being connected with data processing, after now generation data filing instruction,
And send data filing instruction to data handling system, so as to be responded by the data handling system
The data filing instruction is by the data storage to be archived into filing data storehouse.
In the embodiment of the present application, not total data is filed to or filed simultaneously in runtime data storehouse
Into filing data storehouse, due to there is recent renewal or the higher number of operating frequency in runtime data storehouse
According to, then without filing into filing data storehouse, it is necessary to the data filed be typically historical data or
Data infrequently operated etc., therefore can be by setting archive condition, screening meets treating for archive condition
Filing data is stored into filing data storehouse.
The archive condition, which can have in a variety of possible implementations, embodiment below, to be situated between in detail
Continue.
In the embodiment of the present application, judged by obtaining the systematic function of data handling system, be
When system performance meets performance requirement condition, and runtime data storehouse meets the to be archived of archive condition in presence
During data, you can to generate data filing instruction, by data handling system by responding the data filing
Instruction, by data storage to be archived into filing data storehouse, it is achieved thereby that the automatic archiving of data, and
Rationally make use of systematic function, system operation will not be impacted, improve data filing efficiency,
Reduce the complexity of data filing.
As another embodiment, archive condition can refer to that operating frequency is less than frequency threshold, data volume
It is more than time threshold higher than data threshold or the last operating time and the time difference of current time
Data to be archived in tables of data.
Tables of data is a storage object in runtime data storehouse, for data storage.
Therefore with the presence or absence of satisfaction filing in the runtime data storehouse for judging the data handling system
The data to be archived of condition can be with：
Judge in the runtime data storehouse of the data handling system with the presence or absence of operating frequency less than frequency
Threshold value, data volume are more than higher than data threshold or the last operating time and the time difference of current time
The tables of data of time threshold；
Wherein, operating frequency less than the tables of data of frequency threshold, data volume higher than data threshold tables of data,
Or the last operating time and the time difference of current time are more than the number in the tables of data of time threshold
According to i.e. be defined as data to be archived.
It is that operating frequency is high less than tables of data, the data volume of frequency threshold when carrying out data filing
It is more than the time in the tables of data of data threshold or the last operating time and the time difference of current time
The tables of data of threshold value is stored into filing data storehouse.
What the relatively low tables of data of operating frequency or the higher tables of data of data volume or long-time were not operated
Tables of data, these tables of data can waste runtime data library storage space, therefore can store to filing
In database, to improve the performance in runtime data storehouse.
Wherein, the frequency threshold, data threshold and time threshold can be pre-configured with, or from money
The frequency threshold, data threshold and time threshold are obtained in management system, user can pass through money
Management system updates the frequency threshold, data threshold and time threshold at any time.
As another embodiment, the archive condition can refer to operating frequency less than frequency threshold or
The last operating time and the time difference of current time are more than time threshold.
Therefore, in the runtime data storehouse for judging the data handling system, if there is satisfaction and return
The data to be archived of shelves condition include：
In the runtime data storehouse for judging the data handling system, if there is operating frequency less than frequency
Threshold value or the last operating time and the time difference of current time are more than the number to be archived of time threshold
According to.
Namely except that can judge tables of data, the data in tables of data can also be judged,
Can be the data storage to be archived by archive condition is met in tables of data into filing data storehouse.
The data storage to be archived of archive condition will be met in tables of data into filing data storehouse.
Wherein, due in data handling system response data filing instruction process, due to data handling system
Systematic function may change, cause data handling system no longer to meet performance requirement condition now
Filing can be suspended until data handling system meets performance requirement condition.
Or, because archive condition can be with dynamic configuration, if the filing instruction of data handling system response data
During, the data to be archived no longer meet the archive condition, you can to stop filing.
Therefore, as another embodiment, another implementation of the data archiving method provided as shown in Figure 2
The flow chart of example, this method can include following steps：
201：Obtain the systematic function of data handling system.
202：Monitor whether the systematic function meets performance requirement condition, if it is, step 203 is performed,
If otherwise can be continued executing with return to step 201.
Wherein, as a kind of possible implementation, the systematic function can include system load and/
Or the database response time；
Therefore, the performance requirement condition can be less than load threshold and/or database response for system load
Time is less than response lag.
It is described to judge whether the systematic function meets performance requirement condition namely judge the system load
Whether it is less than load threshold and/or whether the database response time is less than response lag.
203：Judge that the runtime data storehouse of the data handling system whether there is and meet archive condition
Data to be archived, if it is, step 104 is performed, if otherwise can be continued executing with return to step 201.
The archive condition can be pre-configured with, and can also be updated according to user's request, be realized dynamic
Configuration.
Archive condition can be only fitted in data handling system, can also configure and connect with data handling system
In the resource management system connect, therefore the archive condition can be obtained from resource management system first, then
Judge that the runtime data storehouse of the data handling system whether there is the number to be archived for meeting archive condition
According to.
Archive condition can have a variety of possible implementations, refer to described in above-described embodiment, herein not
Repeat again.
204：Data filing instruction is generated, responding the data filing by the data handling system instructs,
By the data storage to be archived into filing data storehouse.
205：In the data handling system responds the data filing instruction process, the system is monitored
Whether system performance is changed into being unsatisfactory for the performance requirement condition from meeting performance requirement condition, if it is, holding
Row step 206, if otherwise continuing to monitor, data handling system can continue the data to be archived
Store into filing data storehouse.
206：Generation filing pause instruction, the filing pause instruction is responded by the data handling system,
The data pause to be archived is stored to filing data storehouse.
207：Monitor whether the systematic function is changed into satisfaction again from being unsatisfactory for the performance requirement condition
Performance requirement condition, if it is, monitoring can if it is be continued by performing step 208.
208：Generation filing recovers instruction, and instruction is recovered by the data handling system response filing,
Continue the data storage to be archived to filing data storehouse.
In the present embodiment, by obtaining the systematic function of data handling system, rationally utilize more than systematic function
Amount, will meet the data to be archived of archive condition, when can include the relatively low data of operating frequency, operation
Between compared with long number according to this and the data in the more tables of data of data volume, data filing is performed automatically, will wait to return
File data is stored into filing data storehouse.And during data filing is performed, systematic function can be carried out
Judge, once systematic function is unsatisfactory for performance requirement condition, you can data filing is performed until being to suspend
When system performance meets performance requirement condition, then recover to perform data filing, so as to both ensure to see data filing
Automatic execution, and system operation will not be impacted, improve data filing efficiency, reduce number
The complexity brought according to filing manual operations.
A kind of structural representation of data filing device one embodiment that Fig. 3 provides for the embodiment of the present application
Figure, wherein, the data filing device can be only fitted in data handling system, can be used as data processing
The One function that system can be realized；Can certainly configure in independence and data handling system, and with number
In the data filing equipment connected according to processing system.
The device can include：
Performance acquisition module 301, the systematic function for obtaining data handling system.
Performance monitoring module 302, for monitoring whether the systematic function meets performance requirement condition.
Systematic function can include the system load of data handling system, the database in runtime data storehouse rings
The performance data of systematic function can be characterized between seasonable etc..
Performance requirement condition is used to represent that systematic function surplus is supported to perform data filing operation enough.
As a kind of possible implementation, the systematic function can include system load and/or database
Response time；
Therefore, the performance requirement condition can be less than load threshold and/or database response for system load
Time is less than response lag.
The performance judging module is specifically to judge whether the system load is less than load threshold and/or number
Whether it is less than response lag according to the storehouse response time.
File judge module 303, in the runtime data storehouse for judging the data handling system whether
In the presence of the data to be archived for meeting data archive condition.
File trigger module 304, for meeting performance requirement condition, and the fortune in the systematic function
When there are the data to be archived for meeting archive condition during row in database, generation data filing instruction, by institute
State data handling system and respond the data filing instruction, by the data storage to be archived to filing data
In storehouse.
When the configuration of data filing device is in data filing equipment described in the embodiment of the present application, filing triggering
After module generation data filing instruction, it is additionally operable to send data filing instruction to data processing system
System, in order to which data handling system responds the data filing instruction, so that the data to be archived be deposited
Storage is into filing data storehouse
In the embodiment of the present application, judged by obtaining the systematic function of data handling system, be
When system performance meets performance requirement condition, and runtime data storehouse meets the to be archived of archive condition in presence
During data, you can to generate data filing instruction, by data handling system by responding the data filing
Instruction, by data storage to be archived into filing data storehouse, it is achieved thereby that the automatic archiving of data, and
Rationally make use of systematic function, system operation will not be impacted, improve data filing efficiency,
Reduce the complexity of data filing.
As another embodiment, archive condition can refer to that operating frequency is less than frequency threshold, data volume
It is more than time threshold higher than data threshold or the last operating time and the time difference of current time
Data to be archived in tables of data.
Tables of data is a storage object in runtime data storehouse, for data storage.
Therefore the filing judge module can be specifically for：
Judge in the runtime data storehouse of the data handling system with the presence or absence of operating frequency less than frequency
Threshold value, data volume are more than higher than data threshold or the last operating time and the time difference of current time
The tables of data of time threshold.
Wherein, operating frequency less than the tables of data of frequency threshold, data volume higher than data threshold tables of data,
Or the last operating time and the time difference of current time are more than the number in the tables of data of time threshold
According to i.e. be defined as data to be archived.
It is that operating frequency is high less than tables of data, the data volume of frequency threshold when carrying out data filing
It is more than the time in the tables of data of data threshold or the last operating time and the time difference of current time
The tables of data of threshold value is stored into filing data storehouse.
What the relatively low tables of data of operating frequency or the higher tables of data of data volume or long-time were not operated
Tables of data, these tables of data can waste runtime data library storage space, therefore can store to filing
In database, to improve the performance in runtime data storehouse.
Wherein, the frequency threshold, data threshold and time threshold can be pre-configured with, or from money
The frequency threshold, data threshold and time threshold are obtained in management system, user can pass through money
Management system updates the frequency threshold, data threshold and time threshold at any time.
As another embodiment, the archive condition can refer to operating frequency less than frequency threshold or
The last operating time and the time difference of current time are more than time threshold.
Therefore, it is described filing judge module specifically for：
In the runtime data storehouse for judging the data handling system, if there is operating frequency less than frequency
Threshold value or the last operating time and the time difference of current time are more than the number to be archived of time threshold
According to.
Namely except that can judge tables of data, the data in tables of data can also be judged,
Can be the data storage to be archived by archive condition is met in tables of data into filing data storehouse.
The data storage to be archived of archive condition will be met in tables of data into filing data storehouse.
Wherein, due in data handling system response data filing instruction process, due to data handling system
Systematic function may change, cause data handling system no longer to meet performance requirement condition now
Filing can be suspended until data handling system meets performance requirement condition.
Or, because the threshold value in archive condition can be with dynamic configuration, if data handling system response data
File in instruction process, the data to be archived no longer meet the archive condition, you can to stop filing.
Therefore, as another embodiment, as shown in figure 4, existing with embodiment illustrated in fig. 3 difference
In the device can also include：
Filing pause module 305, was instructed for responding the data filing in the data handling system
Cheng Zhong, monitors that the systematic function is changed into being unsatisfactory for the performance requirement bar from meeting performance requirement condition
During part, generation filing pause instruction responds the filing pause instruction by the data handling system, will
The data pause to be archived is stored to filing data storehouse.
It is, of course, also possible to including filing recovery module 306, for responding institute in the data handling system
During stating filing pause instruction, monitor described to state systematic function by being unsatisfactory for the performance requirement condition
When being changed into meeting the performance requirement condition again, generation filing recovers instruction, by the data processing system
The system response filing recovers instruction, continues the data storage to be archived to filing data storehouse.
In the present embodiment, by obtaining the systematic function of data handling system, rationally utilize more than systematic function
Amount, will meet the data to be archived of archive condition, when can include the relatively low data of operating frequency, operation
Between compared with long number according to this and the data in the more tables of data of data volume, data filing is performed automatically, will wait to return
File data is stored into filing data storehouse.And during data filing is performed, systematic function can be carried out
Judge, once systematic function is unsatisfactory for performance requirement condition, you can data filing is performed until being to suspend
When system performance meets performance requirement condition, then recover to perform data filing, so as to both ensure to see data filing
Automatic execution, and system operation will not be impacted, improve data filing efficiency, reduce number
The complexity brought according to filing manual operations.
Data filing device shown in Fig. 3 or Fig. 4 can be only fitted in data handling system, be used as data
The One function that processing system can be realized.
Certainly, in a practical application, Fig. 3 or the data filing device shown in Fig. 4 can be only fitted to
In the independent data filing equipment with data handling system.
As shown in figure 5, the embodiment of the present application additionally provides a kind of data archiving system, data can be included
Processing system 501 and data filing equipment 502.
Data filing equipment 502 is used for the systematic function for obtaining data handling system 501, and judges that it is
It is no to meet performance requirement condition.
Certainly, as another embodiment, the data archiving system can also include monitoring system 503,
Systematic function for monitoring data processing system.
Therefore, data filing equipment 502 is specifically the data processing system that the monitoring system 503 obtained is gathered
The systematic function of system.
Data filing equipment 502 meets performance requirement condition in the systematic function of data handling system, may be used also
To carry out filing assessment, judge in the runtime data storehouse 504 of data handling system 501 with the presence or absence of full
The data to be archived of sufficient archive condition, so as to generate data filing instruction.
Data handling system 501 responds data filing instruction, by data storage to be archived to filing data
505 in storehouse.
By the data archiving system of the embodiment of the present application, the system operation of data handling system is not influenceed,
Automaticdata filing is realized, the efficiency of data filing is improved, reduces the complexity of data filing.
In a typical configuration, computing device include one or more processors (CPU), input/
Output interface, network interface and internal memory.
Internal memory potentially includes the volatile memory in computer-readable medium, random access memory
And/or the form, such as read-only storage (ROM) or flash memory (flash RAM) such as Nonvolatile memory (RAM).
Internal memory is the example of computer-readable medium.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by
Any method or technique come realize information store.Information can be computer-readable instruction, data structure,
The module of program or other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory
(PRAM), static RAM (SRAM), dynamic random access memory (DRAM),
Other kinds of random access memory (RAM), read-only storage (ROM), electrically erasable
Read-only storage (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage
(CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic cassette tape, tape
Magnetic rigid disk is stored or other magnetic storage apparatus or any other non-transmission medium, can be by available for storage
The information that computing device is accessed.Defined according to herein, computer-readable medium does not include non-temporary electricity
The data-signal and carrier wave of brain readable media (transitory media), such as modulation.
Some vocabulary have such as been used to censure specific components among specification and claim.This area skill
Art personnel are, it is to be appreciated that hardware manufacturer may call same component with different nouns.This explanation
Book and claim be not in the way of the difference of title is used as differentiation component, but with component in function
On difference be used as the criterion of differentiation.Such as " the bag in specification in the whole text and claim mentioned in
Containing " it is an open language, therefore " include but be not limited to " should be construed to." substantially " refer to receivable
In error range, those skilled in the art can solve the technical problem, base in the range of certain error
Originally the technique effect is reached.In addition, " coupling " one word is herein comprising any direct and indirect electrically coupling
Take over section.Therefore, if a first device is coupled to a second device described in text, described first is represented
Device can directly be electrically coupled to the second device, or indirectly electric by other devices or coupling means
Property is coupled to the second device.Specification subsequent descriptions is implement the better embodiment of the application, so
The description is for the purpose of the rule for illustrating the application, to be not limited to scope of the present application.
The protection domain of the application is worked as to be defined depending on the appended claims person of defining.
It should also be noted that, term " comprising ", "comprising" or its any other variant be intended to it is non-
It is exclusive to include, so that commodity or system including a series of key elements not only will including those
Element, but also other key elements including being not expressly set out, or also include for this commodity or be
The intrinsic key element of system.In the absence of more restrictions, limited by sentence "including a ..."
Key element, it is not excluded that also there is other identical element in the commodity or system including the key element.
Some preferred embodiments of the application have shown and described in described above, but as it was previously stated, should manage
Solution the application is not limited to form disclosed herein, is not to be taken as the exclusion to other embodiment,
And available for various other combinations, modification and environment, and can apply described herein in contemplated scope,
It is modified by the technology or knowledge of above-mentioned teaching or association area.And those skilled in the art are carried out changes
Dynamic and change does not depart from spirit and scope, then all should the application appended claims protection
In the range of.
Claims (10)
1. a kind of data archiving method, it is characterised in that including：
Obtain the systematic function of data handling system；
Monitor the systematic function and whether meet performance requirement condition, and the data handling system fortune
With the presence or absence of the data to be archived for meeting data archive condition in database during row；
Return in the systematic function meets performance requirement condition, and the runtime data storehouse in the presence of satisfaction
During the data to be archived of shelves condition, generation data filing instruction is responded described by the data handling system
Data filing instruction is by the data storage to be archived into filing data storehouse.
2. the method as described in claim 1, it is characterised in that the judgement data processing system
Include in the runtime data storehouse of system with the presence or absence of the data to be archived for meeting archive condition：
Judge in the runtime data storehouse of the data handling system with the presence or absence of operating frequency less than frequency
Threshold value, data volume are more than higher than data threshold or the last operating time and the time difference of current time
The tables of data of time threshold；There will be operating frequency less than frequency threshold, data volume higher than data threshold or
Person's operating time the last time and the time difference of current time are more than data in the tables of data of time threshold
It is used as data to be archived.
3. the method as described in claim 1, it is characterised in that the judgement data processing system
In the runtime data storehouse of system, if exist and meet the data to be archived of archive condition and include：
In the runtime data storehouse for judging the data handling system, if there is operating frequency less than frequency
Threshold value or the last operating time and the time difference of current time are more than the number to be archived of time threshold
According to.
4. the method as described in claim 1, it is characterised in that in data handling system response
In the data filing instruction process, methods described also includes：
It is changed into being unsatisfactory for the performance requirement from meeting performance requirement condition when monitoring the systematic function
During condition, generation filing pause instruction responds the filing pause instruction by the data handling system,
The data pause to be archived is stored to filing data storehouse；
During the data handling system response filing pause instruction, when monitoring the system
When performance is changed into meeting again the performance requirement condition from being unsatisfactory for the performance requirement condition, generation is returned
Shelves recover instruction, recover instruction by the data handling system response filing, continuation is waited to return by described
File data is stored to filing data storehouse.
5. the method as described in claim 1, it is characterised in that the systematic function is negative including system
Carry and/or the database response time；
It is described to judge whether the systematic function meets performance requirement condition and include：
Judge whether the system load is less than load threshold and/or whether the database response time is small
In response lag.
6. a kind of data filing device, it is characterised in that including：
Performance acquisition module, the systematic function for obtaining data handling system；
Performance monitoring module, for monitoring whether the systematic function meets performance requirement condition；
File and whether there is in judge module, the runtime data storehouse for judging the data handling system
Meet the data to be archived of data archive condition；
File trigger module, for meeting performance requirement condition in the systematic function, and during the operation
When there are the data to be archived for meeting archive condition in database, generation data filing instruction, by the number
The data filing is responded according to processing system to instruct the data storage to be archived into filing data storehouse.
7. device as claimed in claim 6, it is characterised in that the filing judge module is specifically used
In：
Judge in the runtime data storehouse of the data handling system with the presence or absence of operating frequency less than frequency
Threshold value, data volume are more than higher than data threshold or the last operating time and the time difference of current time
The tables of data of time threshold；There will be operating frequency less than frequency threshold, data volume higher than data threshold or
During person's operating time the last time and the time difference of current time are more than in the tables of data of time threshold
Data are used as data to be archived.
8. device as claimed in claim 6, it is characterised in that the filing judge module is specifically used
In：
In the runtime data storehouse for judging the data handling system, if there is operating frequency less than frequency
Threshold value or the last operating time and the time difference of current time are more than the number to be archived of time threshold
According to.
9. device as claimed in claim 6, it is characterised in that also include：
Filing pause module, for responding the data filing instruction process in the data handling system
In, monitor that the systematic function is changed into being unsatisfactory for the performance requirement condition from meeting performance requirement condition
When, generation filing pause instruction responds the filing pause instruction, by institute by the data handling system
Data pause to be archived is stated to store to filing data storehouse；
File recovery module, in the data handling system response filing pause instruction process
In, monitor that the systematic function is changed into meeting the performance again from being unsatisfactory for the performance requirement condition
During demand condition, generation filing recovers instruction, is referred to by the data handling system response filing recovery
Order, continues the data storage to be archived to filing data storehouse.
10. device as claimed in claim 6, it is characterised in that the systematic function is negative including system
Carry and/or the database response time；
The performance judging module includes：
Judge whether the system load is less than load threshold and/or whether the database response time is small
In response lag.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610182520.8A CN107239457A (en) | 2016-03-28 | 2016-03-28 | Data archiving method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610182520.8A CN107239457A (en) | 2016-03-28 | 2016-03-28 | Data archiving method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107239457A true CN107239457A (en) | 2017-10-10 |
Family
ID=59983264
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610182520.8A Pending CN107239457A (en) | 2016-03-28 | 2016-03-28 | Data archiving method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107239457A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108052281A (en) * | 2017-11-30 | 2018-05-18 | 平安科技（深圳）有限公司 | Business Information storage method, application server and computer storage media |
| CN109522314A (en) * | 2018-10-16 | 2019-03-26 | 平安科技（深圳）有限公司 | Data archiving method and terminal device based on block chain |
| CN109901965A (en) * | 2017-12-08 | 2019-06-18 | 英业达科技有限公司 | Storage resource processing system and its method |
| CN110059139A (en) * | 2019-03-12 | 2019-07-26 | 平安普惠企业管理有限公司 | Business datum archiving method, equipment, server and computer readable storage medium |
| CN110245118A (en) * | 2019-06-27 | 2019-09-17 | 重庆市筑智建信息技术有限公司 | BIM data information three-dimensional gridding retrieval filing method and filing system thereof |
| CN110765088A (en) * | 2019-10-22 | 2020-02-07 | 北京天融信网络安全技术有限公司 | Log processing method and electronic equipment |
| CN110825695A (en) * | 2019-11-04 | 2020-02-21 | 泰康保险集团股份有限公司 | Data processing method, device, medium and electronic equipment |
| CN110837592A (en) * | 2019-11-08 | 2020-02-25 | 京东数字科技控股有限公司 | Method, apparatus and computer readable storage medium for data archiving |
| CN111506749A (en) * | 2020-04-15 | 2020-08-07 | 北京金山云网络技术有限公司 | Monitoring data archiving method and device, electronic equipment and storage medium |
| CN111581432A (en) * | 2020-04-30 | 2020-08-25 | 北京达佳互联信息技术有限公司 | Data processing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101446966A (en) * | 2008-12-31 | 2009-06-03 | 中国建设银行股份有限公司 | Data storage method and system |
| CN103078933A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration time |
| CN103617076A (en) * | 2013-10-31 | 2014-03-05 | 中兴通讯股份有限公司 | Method and system for dispatching virtualized resources and server |
| US20140095448A1 (en) * | 2012-09-28 | 2014-04-03 | Oracle International Corporation | Automated information lifecycle management using low access patterns |
| CN104573020A (en) * | 2015-01-12 | 2015-04-29 | 浪潮电子信息产业股份有限公司 | Automatic data migrating and optimizing method in hierarchical storage system |
| CN107229657A (en) * | 2016-03-25 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Data migration method and device |
-
2016
- 2016-03-28 CN CN201610182520.8A patent/CN107239457A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101446966A (en) * | 2008-12-31 | 2009-06-03 | 中国建设银行股份有限公司 | Data storage method and system |
| US20140095448A1 (en) * | 2012-09-28 | 2014-04-03 | Oracle International Corporation | Automated information lifecycle management using low access patterns |
| CN103078933A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration time |
| CN103617076A (en) * | 2013-10-31 | 2014-03-05 | 中兴通讯股份有限公司 | Method and system for dispatching virtualized resources and server |
| CN104573020A (en) * | 2015-01-12 | 2015-04-29 | 浪潮电子信息产业股份有限公司 | Automatic data migrating and optimizing method in hierarchical storage system |
| CN107229657A (en) * | 2016-03-25 | 2017-10-03 | 阿里巴巴集团控股有限公司 | Data migration method and device |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108052281A (en) * | 2017-11-30 | 2018-05-18 | 平安科技（深圳）有限公司 | Business Information storage method, application server and computer storage media |
| CN109901965A (en) * | 2017-12-08 | 2019-06-18 | 英业达科技有限公司 | Storage resource processing system and its method |
| CN109522314A (en) * | 2018-10-16 | 2019-03-26 | 平安科技（深圳）有限公司 | Data archiving method and terminal device based on block chain |
| CN109522314B (en) * | 2018-10-16 | 2023-04-14 | 平安科技（深圳）有限公司 | Block chain-based data archiving method and terminal equipment |
| WO2020181799A1 (en) * | 2019-03-12 | 2020-09-17 | 平安普惠企业管理有限公司 | Data archiving method and device, server, and computer readable storage medium |
| CN110059139A (en) * | 2019-03-12 | 2019-07-26 | 平安普惠企业管理有限公司 | Business datum archiving method, equipment, server and computer readable storage medium |
| CN110245118A (en) * | 2019-06-27 | 2019-09-17 | 重庆市筑智建信息技术有限公司 | BIM data information three-dimensional gridding retrieval filing method and filing system thereof |
| CN110245118B (en) * | 2019-06-27 | 2021-05-14 | 重庆市筑智建信息技术有限公司 | BIM data information three-dimensional gridding retrieval filing method and filing system thereof |
| CN110765088A (en) * | 2019-10-22 | 2020-02-07 | 北京天融信网络安全技术有限公司 | Log processing method and electronic equipment |
| CN110825695A (en) * | 2019-11-04 | 2020-02-21 | 泰康保险集团股份有限公司 | Data processing method, device, medium and electronic equipment |
| CN110837592A (en) * | 2019-11-08 | 2020-02-25 | 京东数字科技控股有限公司 | Method, apparatus and computer readable storage medium for data archiving |
| CN111506749A (en) * | 2020-04-15 | 2020-08-07 | 北京金山云网络技术有限公司 | Monitoring data archiving method and device, electronic equipment and storage medium |
| CN111506749B (en) * | 2020-04-15 | 2024-01-02 | 北京金山云网络技术有限公司 | Monitoring data archiving method and device, electronic equipment and storage medium |
| CN111581432A (en) * | 2020-04-30 | 2020-08-25 | 北京达佳互联信息技术有限公司 | Data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107239457A (en) | Data archiving method and device | |
| CN102968374B (en) | A kind of data warehouse method of testing | |
| CN106156355B (en) | Log processing method and device | |
| US20170060546A1 (en) | System and method for providing software build violation detection and self-healing | |
| US20190163552A1 (en) | System and method for contextual event sequence analysis | |
| CN109522388A (en) | A kind of creation method and device of intelligence worksheet processing rule | |
| CN102857371A (en) | Dynamic allocation management method for cluster system | |
| CN107329806A (en) | A kind of development environment construction method and device | |
| CN106354817A (en) | Method and device for processing log | |
| US20090187606A1 (en) | Optimized modification of a clustered computer system | |
| EP4375892A1 (en) | Distributed training method for ai model and related device | |
| EP4078380A1 (en) | Behavior-driven die management on solid-state drives | |
| CN108156030A (en) | The method and device that a kind of configuration strategy synchronizes | |
| US10574552B2 (en) | Operation of data network | |
| AU2015265596B2 (en) | System and method for recording the beginning and ending of job level activity in a mainframe computing environment | |
| CN108268355A (en) | For the monitoring system and method for data center | |
| CN106547861A (en) | A kind of method and device of the data base of intelligent management machine node | |
| US20130124817A1 (en) | Information processing apparatus | |
| CN106708657A (en) | Metadata management method and apparatus, and distributed file system | |
| CN112612587B (en) | Spark platform dynamic resource allocation method for flow analysis | |
| CN109597736A (en) | A kind of monitoring method, device, equipment and medium | |
| CN104539449A (en) | Handling method and related device for fault information | |
| CN104123217A (en) | Capture method and system of execution instruction of service server | |
| CN104699513B (en) | A kind of document handling method and device | |
| CN115442262B (en) | Resource evaluation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200924 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200924 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171010 |