CN103544075B - The processing method and system of data - Google Patents
The processing method and system of data Download PDFInfo
- Publication number
- CN103544075B CN103544075B CN201110459485.7A CN201110459485A CN103544075B CN 103544075 B CN103544075 B CN 103544075B CN 201110459485 A CN201110459485 A CN 201110459485A CN 103544075 B CN103544075 B CN 103544075B
- Authority
- CN
- China
- Prior art keywords
- storage medium
- data
- time window
- incremental
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
The present invention provides a kind of processing method and system of data, and the method includes obtaining the corresponding very first time window of the first storage medium；Every the very first time window, the first storage medium of triggering is obtained and stores the corresponding first kind incremental data of initial data, and records corresponding first storage time of first kind incremental data；Obtain corresponding second time window of the second storage medium；Every the second time window, in will be stored in the first storage medium, and the age of incremental data is more than generation Equations of The Second Kind incremental data after all first kind incremental datas of the first preset time period are merged, and Equations of The Second Kind incremental data is moved in the second storage medium from the first storage medium, re-record corresponding second storage time of Equations of The Second Kind incremental data；Wherein, the second time window is more than very first time window；Performance of the performance of the second storage medium less than the first storage medium.
Description
Technical field
The present invention relates to data backup and filing technology, more particularly to a kind of processing method and system of data.
Background technology
It is that business datum is not destroyed during data-center applications, data is protected by the way of backup generally.Mesh
It is preceding mainly to have two kinds of backup modes of full backup and incremental backup.Wherein, the operation principle of full backup is at regular intervals
The file or disk partition that need backup are integrally done and once backed up.The operation principle of incremental backup is at regular intervals will
The file of backup or the changing unit of disk partition is needed to do and once back up.
In addition, after Recent data backup, a big chunk user needs for long-term data to carry out filing preservation, will
The copy data of backup is according to factors such as ages of data, and the copy data that will meet transition condition is (higher from storage medium high
The disk or tape of speed) move on time storage medium (compared with the disk or tape of low speed).
But, existing time of filing window is typically equal to BACKUP TIME window, and immobilizes, so as to can be formed to a certain degree
On the wasting of resources, for example：Central processing unit (the Central Processing Unit used during filing；Referred to as：CPU) and
The waste of memory source and time of filing window and BACKUP TIME window is too small and the filing that produces using disk space consumption
Take.Meanwhile, also reduce the speed and efficiency of backup and filing.Wherein, time of filing window refers to two adjacent filing moment
Between time spacing；BACKUP TIME window refers to the time interval between two adjacent backup times.
The content of the invention
A kind of processing method and system of data of present invention offer, the utilization rate for being effectively improved hardware resource,
And improve speed and efficiency in backup and archiving process.
The first aspect of the invention is to provide a kind of processing method of data, including：
Obtain the corresponding very first time window of the first storage medium；
Every the very first time window, trigger first storage medium and obtain and store the corresponding first kind of initial data
Incremental data, and record corresponding first storage time of the first kind incremental data；
Obtain corresponding second time window of the second storage medium；
Every second time window, in will be stored in first storage medium, and incremental data age more than the
All first kind incremental datas of one preset time period generate Equations of The Second Kind incremental data after merging, and the Equations of The Second Kind is increased
Amount data move to the second storage medium from first storage medium, re-record the Equations of The Second Kind incremental data corresponding the
Two storage times；
Wherein, second time window is more than the very first time window；The performance of second storage medium is less than described
The performance of the first storage medium.
Another aspect of the present invention is to provide a kind of processing system of data, including：The processing equipment of data and at least
Two storage mediums, wherein, the processing equipment of the data includes：
Preserving module, the mapping relations for preserving storage medium and time window；
Time window acquisition module, for obtaining the corresponding very first time window of the first storage medium；
Data storage trigger module, obtains and deposits for every the very first time window, triggering first storage medium
The corresponding first kind incremental data of storage initial data；
Logging modle, for recording corresponding first storage time of the first kind incremental data；
The time window acquisition module is additionally operable to obtain corresponding second time window of the second storage medium；
Data merging treatment module is additionally operable to every second time window, in will be stored in first storage medium,
And the age of incremental data is more than generation Equations of The Second Kind after all first kind incremental datas of the second preset time period are merged and increases
Amount data；
Transferring module, for the Equations of The Second Kind incremental data to be moved into the second storage medium from first storage medium
In；
The logging modle is additionally operable to record corresponding second storage time of the Equations of The Second Kind incremental data；
Wherein, second time window is more than the very first time window；The performance of second storage medium is less than described
The performance of the first storage medium.
The solution have the advantages that：By the way that every very first time window, the first storage medium of triggering is obtained and stores original
The corresponding first kind incremental data of data, and corresponding first storage time of the first kind incremental data is recorded, deposited every second
Corresponding second time window of storage media, in will be stored in the first storage medium, and the age of incremental data first presets more than this
All first kind incremental datas of time period merge after generate Equations of The Second Kind incremental data, and by the Equations of The Second Kind incremental data from
First storage medium is moved in the second storage medium, re-records corresponding second storage time of the Equations of The Second Kind incremental data, phase
For fixed and equal in the prior art BACKUP TIME window and time of filing window, because second time window is more than first
Time window, so as to reduce the frequency of filing, has saved system resource；And the Equations of The Second Kind in it will be stored in the first storage medium
Incremental data can merge operation when moving to the second storage medium, so as to effectively reduce data backup and/or filing
Incremental data conceptual data amount, save backup or the disk space that uses of filing, therefore solve in the prior art
The problem of the wasting of resources, improves the speed and efficiency of backup and/or filing.
Brief description of the drawings
Fig. 1 is the flow chart of one embodiment of the processing method of data backup of the present invention；
Fig. 2 applies a principle schematic in the incremental backup treatment of data for the processing method of data；
Fig. 3 is the flow chart of another embodiment of the processing method of data of the present invention；
Fig. 4 is the structural representation of one embodiment of the processing system of data of the present invention.
Specific embodiment
Fig. 1 is the flow chart of one embodiment of the processing method of data of the present invention, as shown in figure 1, the present embodiment is held
Row main body is the processing equipment of data, then the method includes：
Step 101, the corresponding very first time window of the first storage medium of acquisition.
In the present embodiment, time window refers to the time spacing between adjacent storage time.
In embodiments of the present invention, the first storage medium can correspond to multiple time windows, when first storage medium is pre-
When being provided with multiple time windows, one of time window is obtained as the corresponding very first time window of first storage medium.Specifically
, according to specific user's request or other conditions one of them can be selected to be deposited as described first from multiple time windows
The corresponding very first time window of storage media.
Step 102, every very first time window, trigger first storage medium and obtain and store initial data corresponding first
Class incremental data, and record corresponding first storage time of the first kind incremental data.
Step 103, corresponding second time window of the second storage medium of acquisition.
Step 104, every second time window, in will be stored in first storage medium, and incremental data is older
Equations of The Second Kind incremental data is generated after all first kind incremental datas of the first preset time period are merged, and by the Equations of The Second Kind
During incremental data moves to the second storage medium from first storage medium, the Equations of The Second Kind incremental data corresponding second is re-recorded
Storage time.
Wherein, second time window is more than very first time window；The performance of second storage medium is less than the first storage medium
Performance.In addition, the present invention is not limited the first preset time period, any setting can be needed according to actual conditions.
In the present embodiment, for example, the first storage medium can be specially solid state hard disc (Solid State
Drive；Referred to as：SSD), the second storage medium can be specially serial connecting small computer system interface (Serial
Attached Small Computer System Interface；Referred to as：SAS) hard disk.Or, the first storage medium can be with
It is SAS hard disks, the second storage medium can be Serial Advanced Technology Attachment (Serial Advanced Technology
Attachment；Referred to as：SATA) hard disk.
The first storage medium (such as SSD) described in the present embodiment is obtained and stores the corresponding first kind increment of initial data
The controller that data specifically refer to SSD is obtained and stores the corresponding first kind incremental data of initial data, in the embodiment of the present invention
Described first kind incremental data refers in very first time window, relative to the data that initial data changes；
The Equations of The Second Kind incremental data generated after being merged to all first kind incremental datas described in the embodiment of the present invention
Refer to incremental data of the data relative to initial data at the second time window moment.
In addition, in the present embodiment, the processing method of data can be applied at the backup of data and/or the filing of data
In reason.For example, Fig. 2 for data processing method apply data incremental backup treatment on a principle schematic,
As shown in Fig. 2 the initial data is specially disk partition, and respectively including 9 subregions, when initial, the data stored in 9 subregions
Respectively a, b, c, d, e, f, g, h and i.In addition, very first time window can be specially the first BACKUP TIME window, the second time window can
To be specially the second BACKUP TIME window, wherein, for the first storage medium, its corresponding very first time window is 1 day；For second
Storage medium, its corresponding second time window is 1 week.First preset time period is also 1 week.The processing method of the data it is specific
Implementation is：At first day, the first storage medium of triggering was obtained and stores the corresponding first kind incremental data of initial data
Be a1, wherein, the a1 for initial data a change/incremental data, and record corresponding first storage times of the a1 (equivalent to
BACKUP TIME).At second day, the first storage medium of triggering is obtained and stores the corresponding first kind incremental data of initial data and is
B1, wherein, the b1 is the change/incremental data of initial data b, and records corresponding first storage times of the b1.Subsequently successively
Analogize, repeat no more.It is worth noting that, at the 3rd day, the initial data correspondence that the first storage medium of triggering is obtained and stored
First kind incremental data be a2+c1, wherein, initial data a become turn to a2.
Every the second time window, the second storage medium of triggering is obtained and stores the Equations of The Second Kind incremental number in the first storage medium
According to, the Equations of The Second Kind incremental data in will be stored in the first storage medium, and incremental data age more than the second time window
The data that all first kind incremental datas are generated after merging.In other words, will back up in the first storage medium, and the first kind
All first kind incremental datas of the age of incremental data more than one week generate Equations of The Second Kind incremental data after merging, and should
Equations of The Second Kind incremental data is backuped in the second storage medium from the first storage medium.
As shown in Fig. 2 for the not a1 of first day of data a in Equations of The Second Kind incremental data, but the a2 of the 3rd day, changing speech
It, before merging, the change total amount of 7 days is 8 delta datas, and after merging, the change total amount of 7 days is only 7 delta datas,
Therefore, when incremental data is moved into the second storage medium by the first storage medium, when being more than first due to the second time window
Between window, i.e. Equations of The Second Kind incremental data total amount less than the summation of the first kind incremental data of first 7 days, therefore reduce and need migration
The total amount of incremental data, equivalent to the consuming for reducing the resources such as hard disk, CPU and internal memory, improves the efficiency of overall filing.
In the present embodiment, by the way that every very first time window, the first storage medium of triggering is obtained and stores initial data pair
The first kind incremental data answered, and corresponding first storage time of the first kind incremental data is recorded, every the i-th storage medium pair
The i-th time window answered, in will be stored in the first storage medium, and the age of incremental data is all more than the first preset time period
First kind incremental data generates Equations of The Second Kind incremental data after merging, and by the Equations of The Second Kind incremental data from the first storage medium
Move in the second storage medium, corresponding second storage time of the Equations of The Second Kind incremental data is re-recorded, relative to prior art
Middle fixation and equal BACKUP TIME window and time of filing window, because second time window is more than very first time window, so as to drop
The frequency of low filing, has saved system resource；And the Equations of The Second Kind incremental data migration in it will be stored in the first storage medium
To operation can be merged during the second storage medium, so as to effectively reduce the incremental data of data backup and/or filing
Conceptual data amount, saves the disk space that backup or filing are used, therefore solve asking for the wasting of resources in the prior art
Topic, improves the speed and efficiency of backup and/or filing.
It is worth noting that, the quantity not to storage medium of the invention is limited, according to actual conditions the need for,
Any storage medium that varying number is set.
Fig. 3 is the flow chart of another embodiment of the processing method of data of the present invention, with the processing method application of data
In the treatment of backup and the filing of data, and storage medium quantity as a example by 4, the technical side of the present embodiment to be discussed in detail
Case, as shown in figure 3, the method for the present embodiment includes：
Step 201, the corresponding very first time window of the first storage medium of acquisition, and every very first time window, triggering first is deposited
Storage media is obtained and stores the corresponding first kind incremental data of initial data, re-records the first kind incremental data corresponding first
Storage time.
Specifically, in the present embodiment, very first time window is 1 hour；First storage medium is SSD.
Step 202, corresponding second time window of the second storage medium is obtained, and every the second time window, will be stored in the
In one storage medium, and incremental data age more than the first preset time period all first kind incremental datas merge after
Generation Equations of The Second Kind incremental data, and the Equations of The Second Kind incremental data is moved in the second storage medium from the first storage medium, then
Record corresponding second storage time of the Equations of The Second Kind incremental data.
Wherein, Equations of The Second Kind incremental data is in will be stored in the first storage medium, and the age of incremental data is more than second
The data that all first kind incremental datas of time window are generated after merging.
Specifically, in the present embodiment, second storage medium is SAS hard disks.Second time window is specially 1 day, first
Preset time period is 1 day.In addition, by triggering the first storage medium will be obtained and stored for first hour to the second 4 hours the
One class incremental data generates Equations of The Second Kind incremental data after merging, and the Equations of The Second Kind incremental data is moved into the second storage Jie
In matter, so as to realize the backup from the first storage medium to the incremental data of the second storage medium.
Step 203, corresponding 3rd time window of the 3rd storage medium is obtained, and every the 3rd time window, will be stored in the
In two storage mediums, and incremental data age more than the second preset time period all Equations of The Second Kind incremental datas merge after
3rd class incremental data of generation, and the 3rd class incremental data is moved in the 3rd storage medium from the second storage medium,
Re-record corresponding 3rd storage time of the 3rd class incremental data.
Wherein, the 3rd class incremental data is in will be stored in the second storage medium, and the age of incremental data is more than the 3rd
The data that all Equations of The Second Kind incremental datas of time window are generated after merging.
Specifically, in the present embodiment, the 3rd storage medium is SATA hard disc.3rd time window is specially 1 week, second
Preset time period is 2 days.In addition, the Equations of The Second Kind that first day to the 7th day is obtained and stored by triggering the second storage medium increases
Amount data generate the 3rd class incremental data after merging, and the 3rd class incremental data moved into the 3rd storage medium,
So as to realize the filing from the second storage medium to the incremental data of the 3rd storage medium.
Step 204, corresponding 4th time window of the 4th storage medium is obtained, and every the 4th time window, will be stored in the
In three storage mediums, and incremental data age more than the 3rd preset time period all 3rd class incremental datas merge after
Generate the 4th class incremental data, and the 4th class incremental data is moved into the 4th storage medium from the 3rd storage medium, then
Record corresponding 4th storage time of the 4th class incremental data.
Wherein, the 4th class incremental data is in will be stored in the 3rd storage medium, and the age of incremental data is more than the 4th
The data that all 3rd class incremental datas of time window are generated after merging.
Specifically, in the present embodiment, the 4th storage medium is special SATA hard disc.4th time window is specially 1 year,
3rd preset time period is January.In addition, by trigger the 3rd storage medium by acquisition in first week to the one 2 week and store the
Three class incremental datas generate the 4th class incremental data after merging, and the 4th class incremental data is moved into the 4th storage Jie
In matter, so as to realize the filing from the 3rd storage medium to the incremental data of the 4th storage medium.
In addition, in the present embodiment, the 4th storage medium can be specially the SATA hard disc of special filing.It is worth noting
, the SATA hard disc of the special filing starts only when filing data is read and write, and other times may be at resting state, from
And it is effectively improved the service life of the SATA hard disc of the special filing.
Also, it should be noted that when the first preset time period, the second preset time period and the 3rd in the present embodiment are default
Between section can with it is equal can also be unequal, be not intended to limit in the present embodiment, except the example above illustrate in addition to, can also be according to reality
Border situation needs any setting.
In the present embodiment, by the way that every very first time window, the first storage medium of triggering is obtained and stores initial data pair
The first kind incremental data answered, and corresponding first storage time of the first kind incremental data is recorded, every the i-th storage medium pair
The i-th time window answered, the i-th storage medium of triggering is obtained and stores the i-th class incremental data in the i-th -1 storage medium, and is recorded
Corresponding i-th storage time of the i-th class incremental data, wherein, the i-th class data storage is storage in the i-th -1 storage medium
In, and incremental data age more than the i-th -1 preset time period all i-th -1 class incremental datas merge after generate number
According to because the i-th time window is more than the i-th -1 time window, relative to fixed and equal in the prior art BACKUP TIME window and returning
Shelves time window, The present invention reduces data backup and/or the data volume of the incremental data of filing, therefore solves in the prior art
The problem of the wasting of resources, improves the speed and efficiency of backup and/or filing, and then obtain lower total all cost (Total
Cost of Ownership；Referred to as：) and data protection efficiency higher TCO.Wherein, i is integer, and i is more than or equal to 2.
Further, in yet another embodiment of the present invention, on the basis of above-described embodiment, the method can also be entered
One step includes：
Treatment is updated to the very first time window, the second time window and/or the 3rd time window.
Fig. 4 is the structural representation of one embodiment of the processing system of data of the present invention, as shown in figure 4, the present embodiment
System include：The storage medium 12 of processing equipment 11 and at least two of data, in the present embodiment, when storage medium 12 is two
It is individual, and during for the first storage medium and the second storage medium, the processing equipment 11 of data includes：Preserving module 111, time window is obtained
Modulus block 112, data storage trigger module 113, logging modle 114, data merging treatment module 115 and transferring module 116；Its
In, preserving module 111 is used to preserve the mapping relations of storage medium and time window；Time window acquisition module 112 is used to obtain the
The corresponding very first time window of one storage medium；Data storage trigger module 113 is used for every very first time window, triggers this and first deposits
Storage media is obtained and stores the corresponding first kind incremental data of initial data；Logging modle 114 is used to record the first kind increment
Corresponding first storage time of data；Time window acquisition module 112 is additionally operable to obtain the second storage medium corresponding second time
Window；Data merging treatment module 115 is additionally operable to every second time window, in will be stored in first storage medium, and increment
The age of data generates Equations of The Second Kind incremental data after being merged more than all first kind incremental datas of the first preset time period；
During transferring module 116 is used to for the Equations of The Second Kind incremental data to move to the second storage medium from first storage medium；Record
Module 114 is additionally operable to record corresponding second storage time of the Equations of The Second Kind incremental data.Specifically, second time window is more than
Very first time window；Performance of the performance of second storage medium less than the first storage medium.
In embodiments of the present invention, time window acquisition module 112 specifically for when first storage medium be preset with it is many
During individual time window, one of time window is obtained as the corresponding very first time window of first storage medium.
The processing system of the present embodiment data can perform the technical scheme of embodiment of the method shown in Fig. 1 or 2, and it realizes former
Reason is similar, and here is omitted.
In the present embodiment, by the way that every very first time window, the first storage medium of triggering is obtained and stores initial data pair
The first kind incremental data answered, and corresponding first storage time of the first kind incremental data is recorded, every the i-th storage medium pair
The i-th time window answered, in will be stored in the first storage medium, and the age of incremental data is all more than the first preset time period
First kind incremental data generates Equations of The Second Kind incremental data after merging, and by the Equations of The Second Kind incremental data from the first storage medium
Move in the second storage medium, corresponding second storage time of the Equations of The Second Kind incremental data is re-recorded, relative to prior art
Middle fixation and equal BACKUP TIME window and time of filing window, because second time window is more than very first time window, and will deposit
The Equations of The Second Kind incremental data stored up in the first storage medium moves to the second storage medium, so as to effectively reduce data backup
And/or the conceptual data amount of the incremental data of filing, the disk space that backup or filing are used is saved, therefore solve existing
There is the problem of the wasting of resources in technology, improve the speed and efficiency of backup and/or filing.
Further, in another embodiment, on the basis of above-mentioned embodiment illustrated in fig. 4, time window is obtained
Modulus block 112 is additionally operable to obtain corresponding 3rd time window of the 3rd storage medium；Data merging treatment module 115 be additionally operable to every
3rd time window, in will be stored in second storage medium, and incremental data institute of the age more than the second preset time period
The 3rd class incremental data is generated after having Equations of The Second Kind incremental data to merge；Transferring module 116 is additionally operable to the 3rd class increment
During data move to the 3rd storage medium from second storage medium；Logging modle 114 is additionally operable to record the 3rd class increment
Corresponding 3rd storage time of data；Wherein, the 3rd time window is more than second time window；The performance of the 3rd storage medium
More than the performance of second storage medium.
Further, the processing equipment 11 of the data in the system also includes：Update module, for the very first time
Window, the second time window, the 3rd time window, the first preset time period and/or the second preset time period are updated treatment.
It is worth noting that, the quantity not to storage medium of the invention is limited, according to actual conditions the need for,
Any storage medium that varying number is set.
In the present embodiment, by the way that every very first time window, the first storage medium of triggering is obtained and stores initial data pair
The first kind incremental data answered, and corresponding first storage time of the first kind incremental data is recorded, every the i-th storage medium pair
The i-th time window answered, the i-th storage medium of triggering is obtained and stores the i-th class incremental data in the i-th -1 storage medium, and is recorded
Corresponding i-th storage time of the i-th class incremental data, wherein, the i-th class data storage is storage in the i-th -1 storage medium
In, and incremental data age more than the i-th -1 preset time period all i-th -1 class incremental datas merge after generate number
According to because the i-th time window is more than the i-th -1 time window, relative to fixed and equal in the prior art BACKUP TIME window and returning
Shelves time window, The present invention reduces data backup and/or the data volume of the incremental data of filing, therefore solves in the prior art
The problem of the wasting of resources, improves the speed and efficiency of backup and/or filing, and then obtain lower total all cost (Total
Cost of Ownership；Referred to as：) and data protection efficiency higher TCO.Wherein, i is integer, and i is more than or equal to 2.
In addition, the storage medium include it is following one or several：SSD, SAS hard disk, SATA hard disc and special SATA are hard
Disk.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above-mentioned each method embodiment can lead to
The related hardware of programmed instruction is crossed to complete.Foregoing program can be stored in a computer read/write memory medium.The journey
Sequence upon execution, performs the step of including above-mentioned each method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic disc or
Person's CD etc. is various can be with the medium of store program codes.
Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations；To the greatest extent
Pipe has been described in detail with reference to foregoing embodiments to the present invention, it will be understood by those within the art that：Its according to
The technical scheme described in foregoing embodiments can so be modified, or which part or all technical characteristic are entered
Row equivalent；And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology
The scope of scheme.
Claims (9)
1. a kind of processing method of data, it is characterised in that including：
Obtain the corresponding very first time window of the first storage medium；
Every the very first time window, trigger first storage medium and obtain and store the corresponding first kind increment of initial data
Data, and record corresponding first storage time of the first kind incremental data；
Obtain corresponding second time window of the second storage medium；
Every second time window, in will be stored in first storage medium, and the age of incremental data is pre- more than first
If all first kind incremental datas of time period generate Equations of The Second Kind incremental data after merging, when merging, work as multiple
During the first kind incremental data same initial data of correspondence, then only retain first storage time nearest apart from current time corresponding
First kind incremental data；
During the Equations of The Second Kind incremental data is moved into the second storage medium from first storage medium, described second is re-recorded
Corresponding second storage time of class incremental data；
Wherein, second time window is more than the very first time window；The performance of second storage medium is less than described first
The performance of storage medium.
2. the processing method of data according to claim 1, it is characterised in that also include：
Obtain corresponding 3rd time window of the 3rd storage medium；
Every the 3rd time window, in will be stored in second storage medium, and the age of incremental data is pre- more than second
If all Equations of The Second Kind incremental datas of time period generate the 3rd class incremental data after merging, and by the 3rd class incremental number
Moved in the 3rd storage medium according to from second storage medium, re-record the 3rd class incremental data corresponding
Three storage times；
Wherein, the 3rd time window is more than second time window；The performance of the 3rd storage medium is less than described second
The performance of storage medium.
3. the processing method of data according to claim 2, it is characterised in that also include：
To the very first time window, the second time window, the 3rd time window, the first preset time period and/or the second preset time period
It is updated treatment.
4. the processing method of data according to claim 1, it is characterised in that the storage medium of the acquisition first is corresponding
Very first time window includes：When first storage medium is preset with multiple time windows, one of time window is obtained as institute
State the corresponding very first time window of the first storage medium.
5. a kind of processing system of data, it is characterised in that including：The processing equipment of data and at least two storage mediums, its
In, the processing equipment of the data includes：
Preserving module, the mapping relations for preserving storage medium and time window；
Time window acquisition module, for obtaining the corresponding very first time window of the first storage medium；
Data storage trigger module, obtains and stores original for every the very first time window, triggering first storage medium
The corresponding first kind incremental data of beginning data；
Logging modle, for recording corresponding first storage time of the first kind incremental data；
The time window acquisition module is additionally operable to obtain corresponding second time window of the second storage medium；
Data merging treatment module is additionally operable to every second time window, in will be stored in first storage medium, and is increased
The age for measuring data is more than generation Equations of The Second Kind incremental number after all first kind incremental datas of the first preset time period are merged
According to, when merging, when the multiple first kind incremental datas correspondence same initial data when, then only retain apart from current time most
The near corresponding first kind incremental data of the first storage time；
Transferring module, in the Equations of The Second Kind incremental data is moved into the second storage medium from first storage medium；
The logging modle is additionally operable to record corresponding second storage time of the Equations of The Second Kind incremental data；
Wherein, second time window is more than the very first time window；The performance of second storage medium is less than described first
The performance of storage medium.
6. the processing system of data according to claim 5, it is characterised in that the time window acquisition module is additionally operable to obtain
Take corresponding 3rd time window of the 3rd storage medium；
The data merging treatment module is additionally operable to every the 3rd time window, in will be stored in second storage medium,
And the age of incremental data is more than the 3rd class of generation after all Equations of The Second Kind incremental datas of the second preset time period are merged and increases
Amount data；
The transferring module is additionally operable to for the 3rd class incremental data to move to the described 3rd from second storage medium deposits
In storage media；
The logging modle is additionally operable to record corresponding 3rd storage time of the 3rd class incremental data；
Wherein, the 3rd time window is more than second time window；The performance of the 3rd storage medium is less than described second
The performance of storage medium.
7. the processing system of data according to claim 6, it is characterised in that the processing equipment of the data also includes：
Update module, for pre- to the very first time window, the second time window, the 3rd time window, the first preset time period and/or second
If the time period is updated treatment.
8. the processing system of data according to claim 5, it is characterised in that time window acquisition module is specifically for working as
When stating the first storage medium and being preset with multiple time windows, one of time window is obtained corresponding as first storage medium
Very first time window.
9. the processing system of the data according to claim 5 or 6, it is characterised in that the storage medium is included as next
Plant or several：SSD, SAS hard disk, SATA hard disc and special SATA hard disc.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110459485.7A CN103544075B (en) | 2011-12-31 | 2011-12-31 | The processing method and system of data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110459485.7A CN103544075B (en) | 2011-12-31 | 2011-12-31 | The processing method and system of data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103544075A CN103544075A (en) | 2014-01-29 |
| CN103544075B true CN103544075B (en) | 2017-07-07 |
Family
ID=49967549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110459485.7A Active CN103544075B (en) | 2011-12-31 | 2011-12-31 | The processing method and system of data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103544075B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10620834B2 (en) * | 2016-03-25 | 2020-04-14 | Netapp, Inc. | Managing storage space based on multiple dataset backup versions |
| CN108984105B (en) | 2017-06-02 | 2021-09-10 | 伊姆西Ip控股有限责任公司 | Method and device for distributing replication tasks in network storage device |
| CN108984106B (en) * | 2017-06-02 | 2021-09-10 | 伊姆西Ip控股有限责任公司 | Method and apparatus for data copy switching |
| CN107315657B (en) * | 2017-06-19 | 2020-09-29 | 浙江大华技术股份有限公司 | Data backup method and device |
| US11531570B2 (en) * | 2020-03-11 | 2022-12-20 | Fortinet, Inc. | Adaptive resource provisioning for a multi-tenant distributed event data store |
| CN115114344B (en) * | 2021-11-05 | 2023-06-23 | 腾讯科技（深圳）有限公司 | Transaction processing method, device, computing equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0769741A1 (en) * | 1995-10-20 | 1997-04-23 | Digital Equipment Corporation | variable-level backup scheduling method and apparatus |
| US7103740B1 (en) * | 2003-12-31 | 2006-09-05 | Veritas Operating Corporation | Backup mechanism for a multi-class file system |
| CN101051285A (en) * | 2006-09-21 | 2007-10-10 | 上海交通大学 | File matching method in computer network data backup |
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101650677A (en) * | 2009-07-27 | 2010-02-17 | 浪潮电子信息产业股份有限公司 | File data backup method based on Delta increment |
| US8230192B2 (en) * | 2010-02-05 | 2012-07-24 | Lsi Corporation | System and method for QoS-based storage tiering and migration technique |
-
2011
- 2011-12-31 CN CN201110459485.7A patent/CN103544075B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0769741A1 (en) * | 1995-10-20 | 1997-04-23 | Digital Equipment Corporation | variable-level backup scheduling method and apparatus |
| US7103740B1 (en) * | 2003-12-31 | 2006-09-05 | Veritas Operating Corporation | Backup mechanism for a multi-class file system |
| CN101051285A (en) * | 2006-09-21 | 2007-10-10 | 上海交通大学 | File matching method in computer network data backup |
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103544075A (en) | 2014-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103544075B (en) | The processing method and system of data | |
| US8291245B2 (en) | Method, apparatus and system for reducing power consumption based on storage device data migration | |
| US7945733B2 (en) | Hierarchical storage management (HSM) for redundant array of independent disks (RAID) | |
| US9411821B1 (en) | Block-based backups for sub-file modifications | |
| US20120117029A1 (en) | Backup policies for using different storage tiers | |
| US7653781B2 (en) | Automatic RAID disk performance profiling for creating optimal RAID sets | |
| US20120095968A1 (en) | Storage tiers for different backup types | |
| US9274723B2 (en) | Storage apparatus and its control method | |
| CN102713878A (en) | Apparatus and method for managing a file in a distributed storage system | |
| US9996557B2 (en) | Database storage system based on optical disk and method using the system | |
| JP2007234026A (en) | Data storage system including unique block pool manager and application in hierarchical storage device | |
| US20140215127A1 (en) | Apparatus, system, and method for adaptive intent logging | |
| CN103914516A (en) | Method and system for layer-management of storage system | |
| CN105138476A (en) | Data storage method and system based on hadoop heterogeneous storage | |
| CN103019890A (en) | Block-level disk data protection system and method thereof | |
| CN104899117B (en) | Memory database parallel logging method towards Nonvolatile memory | |
| TW200540623A (en) | System and method for drive recovery following a drive failure | |
| US7984313B2 (en) | Method, apparatus and system for reducing power consumption involving data storage devices | |
| CN103713973A (en) | Mixed storage backup method and system based on HDD and SSD | |
| US11016675B2 (en) | Optimizing timing for data migration from old generation tapes to new generation tapes | |
| JP6218668B2 (en) | Efficient use of meta information associated with writing files to media | |
| WO2018010766A1 (en) | Apparatus and method for backing up data of computing devices in a computer network | |
| CN104142943A (en) | Database expansion method and database | |
| Frank et al. | Evolutionary trends in a supercomputing tertiary storage environment | |
| US20220404987A1 (en) | Storage system, storage control device, and storage control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221010 Address after: No. 1899 Xiyuan Avenue, high tech Zone (West District), Chengdu, Sichuan 610041 Patentee after: Chengdu Huawei Technologies Co.,Ltd. Address before: 611731 Qingshui River District, Chengdu hi tech Zone, Sichuan, China Patentee before: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. |