CN102968281A - Data migration method and device - Google Patents

Data migration method and device Download PDF

Info

Publication number
CN102968281A
CN102968281A CN2012104869888A CN201210486988A CN102968281A CN 102968281 A CN102968281 A CN 102968281A CN 2012104869888 A CN2012104869888 A CN 2012104869888A CN 201210486988 A CN201210486988 A CN 201210486988A CN 102968281 A CN102968281 A CN 102968281A
Authority
CN
China
Prior art keywords
hard disk
same kind
mean value
data
availability ratio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012104869888A
Other languages
Chinese (zh)
Inventor
雷延钊
刘飞
陈思
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN2012104869888A priority Critical patent/CN102968281A/en
Publication of CN102968281A publication Critical patent/CN102968281A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses a data migration method, comprising the following steps of: obtaining the space utilization rate of each hard disk in any one storage pool; according to the obtained space utilization rate, calculating the average value of the space utilization rates in the same type of hard disks; migrating the data in the hard disk with the space utilization rate greater than the average value in the same type of hard disks to the hard disk with the space utilization rate less than the average value in the same type of hard disks. According to the data migration method provided by the embodiment of the invention, the data storage equilibrium in the same type of hard disks can be realized, the pressure of the hard disk with great data storage capacity is reduced, and the service life of the hard disk with great data storage capacity is prolonged.

Description

A kind of method of Data Migration and device
Technical field
The present invention relates to technical field of data processing, be specifically related to a kind of method and device of Data Migration.
Background technology
In high-end field of storage, storage system can be divided into a storage pool or a plurality of storage pool, can comprise one or more accumulation layer again in each storage pool, each accumulation layer is comprised of the hard disk of a plurality of same kind.
Data can constantly be stored on the different hard disks in the read-write process, stored data are not identical on each hard disk, the storage space that hard disk is utilized is not identical yet, will cause the data skewness like this, the data volume of indivedual hard-disc storage is excessive, frequently is used, cause this hard disk pressure excessive, the data stream of some hard-disc storage is very little, and the number of times that is used also seldom is in idle condition always.
In the research and practice process to prior art, the present inventor finds, because the space availability ratio of each hard disk is different in the hard disk of same kind, cause in the same kind pressure of the large hard disk of storage data volume excessive, thereby reduced the serviceable life of the large hard disk of this storage data volume.
Summary of the invention
The embodiment of the invention provides a kind of method of Data Migration, can realize the automatic equalization of same kind data in hard disk, alleviated the pressure of the large hard disk of memory data output, has prolonged the serviceable life of the large hard disk of memory data output.The embodiment of the invention also provides corresponding device.
First aspect present invention provides a kind of method of Data Migration, comprising:
Obtain the space availability ratio of each hard disk in arbitrary storage pool;
According to the space availability ratio of obtaining, the mean value of the space availability ratio of the hard disk of calculating same kind;
With space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
In conjunction with first aspect, in the possible implementation of the first, described method also comprises:
According to the described space availability ratio of obtaining and described mean value, calculate the mean square deviation of space availability ratio of the hard disk of described same kind.
In conjunction with the possible implementation of first aspect the first, in the possible implementation of the second, described space utilization factor in the described same kind in the hard disk of space utilization factor less than described mean value, being comprised in the described same kind greater than the Data Migration in the hard disk of described mean value:
When the mean square deviation of the space availability ratio of the hard disk of described same kind during greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
In conjunction with first aspect, first aspect the first or the possible implementation of the second, in the third possible implementation, the described space availability ratio of obtaining each hard disk in arbitrary storage pool comprises:
Scan each hard disk in described arbitrary storage pool;
Add up the space availability ratio of scanned described each hard disk.
In conjunction with first aspect, first aspect the first or the possible implementation of the second, in the 4th kind of possible implementation, described space utilization factor in the described same kind in the hard disk of space utilization factor less than described mean value, being comprised in the described same kind greater than the Data Migration in the hard disk of described mean value:
Inquire about the data of storing in the hard disk of space utilization factor greater than described mean value in the described same kind;
Need to determine the data of migration and the target hard disk that the described data that need to move will be moved to;
Revise the described data storage path that will move, and the described Data Migration that will move is arrived described target hard disk.
Second aspect present invention provides a kind of data processing equipment, comprising:
Acquiring unit is for the space availability ratio of obtaining arbitrary each hard disk of storage pool;
Computing unit, for the space availability ratio of obtaining according to described acquiring unit, the mean value of the space availability ratio of the hard disk of calculating same kind;
Data migration unit is used in the hard disk of Data Migration in the hard disk of mean value that described same kind space utilization factor is calculated greater than the described computing unit mean value that the space utilization factor calculates less than described computing unit in the described same kind.
In conjunction with second aspect, in the possible implementation of the first, described computing unit also is used for the space availability ratio and the described mean value that obtain according to described acquiring unit, calculates the mean square deviation of space availability ratio of the hard disk of described same kind.
In conjunction with the possible implementation of second aspect the first, in the possible implementation of the second,
Described data migration unit, the mean square deviation of space availability ratio of hard disk that is used for the same kind that calculates when described computing unit is during greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
In conjunction with second aspect, second aspect the first or the possible implementation of the second, in the third possible implementation, described acquiring unit comprises:
The scanning subelement is used for scanning described each hard disk of arbitrary storage pool;
The statistics subelement is used for the space availability ratio of adding up scanned described each hard disk of described scanning subelement.
In conjunction with second aspect, second aspect the first or the possible implementation of the second, in the 4th kind of possible implementation, described data migration unit comprises:
The inquiry subelement is used for inquiring about the data of storing in the hard disk of described same kind space utilization factor greater than described mean value;
Determine subelement, be used for the definite data of migration and target hard disk that the described data that need to move will be moved to of needing that described inquiry subelement inquires;
Revise subelement, be used for revising the data storage path that will move that described definite subelement is determined;
The migration subelement, be used for and will the described Data Migration that will move to the definite target hard disk of described definite subelement.
The embodiment of the invention adopts the space availability ratio of obtaining each hard disk in arbitrary storage pool; According to the space availability ratio of obtaining, the mean value of the space availability ratio of the hard disk of calculating same kind; With space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.Data are unbalanced compares with storage in the hard disk of same kind in the prior art, the data migration method that the embodiment of the invention provides, can realize in the hard disk of same kind that the data storage is balanced, alleviate the pressure of the large hard disk of memory data output, prolonged serviceable life of the large hard disk of memory data output.
Description of drawings
In order to be illustrated more clearly in the technical scheme in the embodiment of the invention, the accompanying drawing of required use was done to introduce simply during the below will describe embodiment, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those skilled in the art, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is an embodiment synoptic diagram of the method for the Data Migration that provides of the embodiment of the invention;
Fig. 2 is a synoptic diagram in the application scenarios in the embodiment of the invention;
Fig. 3 is another synoptic diagram in the application scenarios in the embodiment of the invention;
Fig. 4 is an embodiment synoptic diagram of data processing equipment in the embodiment of the invention;
Fig. 5 is another embodiment synoptic diagram of data processing equipment in the embodiment of the invention;
Fig. 6 is another embodiment synoptic diagram of data processing equipment in the embodiment of the invention;
Fig. 7 is an embodiment synoptic diagram of data processing equipment in the embodiment of the invention.
Embodiment
The embodiment of the invention provides a kind of method of Data Migration, can realize the automatic equalization of same kind data in hard disk, alleviated the pressure of the large single hard disk of memory data output, has prolonged the serviceable life of the large single hard disk of memory data output.The embodiment of the invention also provides corresponding device.Below be elaborated respectively.
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those skilled in the art belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
Data processing equipment in the embodiment of the invention can be large-scale high-performance computer or small-size computer.
Consult Fig. 1, an embodiment of the method for the Data Migration that the embodiment of the invention provides comprises:
101, data processing equipment obtains the space availability ratio of each hard disk in arbitrary storage pool.
In high-end field of storage, can be a storage pool or a plurality of storage pool with system divides, can comprise one or more accumulation layer again in each storage pool, each accumulation layer is comprised of the hard disk of a plurality of same kind.
Data read-write operation will be finished in storage pool, if a hard disk is not divided in the storage pool, then can not carry out data read-write operation to this hard disk.
The space utilization factor is the number percent that the storage size that has been utilized in the hard disk accounts for the total storage space of this hard disk in the embodiment of the invention.
Take a storage space total amount as the 8G hard disk as example, if the storage space of this hard disk occupied 2G, the space availability ratio of this hard disk is 25% so.
102, data processing equipment is according to the space availability ratio obtained, calculates the mean value of space availability ratio of the hard disk of same kind.
The computing formula of mean value can be expressed as:
μ = 1 N Σ i = 1 N x i
Wherein, μ is mean value, and N is same kind hard disk quantity, and N is natural number, and i is the variable quantity from 1 to N, represents first hard disk during i=1, represents second hard disk during i=2 ..., representing N hard disk during i=N, i is less than or equal to N, x iIt is the space availability ratio of i hard disk.
Suppose that hard disk type is the integrated driving of electronics (Integrated Drive Electronics, IDE) hard disk quantity has 6, the space availability ratio of obtaining these 6 hard disks in the step 101 is 10%, 20%, 30%, 40%, 50% and 60%, and average value mu equals 35% so.
103, data processing equipment with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
Calculated the mean value of the space availability ratio of same kind in step 102, treating apparatus namely can carry out Data Migration according to the size of the space availability ratio of each hard disk.
Here also can be understood as: data processing equipment compares the space availability ratio of each hard disk of this same kind and the mean value that calculates, and determines that more afterwards Data Migration in each hard disk that space availability ratio is large is in the little hard disk of space availability ratio.
The embodiment of the invention adopts the space availability ratio of obtaining each hard disk in arbitrary storage pool; According to the space availability ratio of obtaining, the mean value of the space availability ratio of the hard disk of calculating same kind; With space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.Data are unbalanced compares with storage in the hard disk of same kind in the prior art, the data migration method that the embodiment of the invention provides, can realize in the hard disk of same kind that the data storage is balanced, alleviated the pressure of the large hard disk of memory data output, prolonged serviceable life of the large hard disk of memory data output, the pressure relieve of the hard disk that the factor data memory space is large further can also improve the efficient of reading and writing data.
Alternatively, on the basis of embodiment corresponding to above-mentioned Fig. 1, another embodiment of the method for the Data Migration that the embodiment of the invention provides also comprises:
According to the described space availability ratio of obtaining and described mean value, calculate the mean square deviation of space availability ratio of the hard disk of described same kind.
In the embodiment of the invention, mean square deviation be each data bias square mean value root again, bias is the difference of the mean value of each data and these data, bias is the difference of mean value of space availability ratio of the hard disk of the space availability ratio of each hard disk in the same kind and this same kind in embodiments of the present invention, is formulated as:
σ = 1 N Σ i = 1 N ( x i - μ ) 2
Wherein, σ is mean square deviation, and μ is mean value, and N is same kind hard disk quantity, and N is natural number, and i is the variable quantity from 1 to N, represents first hard disk during i=1, represents second hard disk during i=2 ..., representing N hard disk during i=N, i is less than or equal to N, x iIt is the space availability ratio of i hard disk.
When μ equals 35%, bring above-mentioned mean square deviation formula into and calculate σ and approximate 17%.
Alternatively, on the basis of optional embodiment corresponding to above-mentioned Fig. 1, among another embodiment of the method for the Data Migration that the embodiment of the invention provides,
Described space utilization factor in the described same kind in the hard disk of space utilization factor less than described mean value, can be comprised in the described same kind greater than the Data Migration in the hard disk of described mean value:
When the mean square deviation of the space availability ratio of the hard disk of described same kind during greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
As the preferred embodiments of the present invention, can be with the mean square deviation of the space availability ratio of the hard disk of same kind as triggering the condition that Data Migration occurs between each hard disk.Suppose that preset threshold value is 15%, the meansquaredeviationσ that calculates approximates 17%, this moment, mean square deviation 17% was greater than preset threshold value 15%, the hard disk that can judge so the IDE type need to carry out Data Migration, then be that Data Migration in 40%, 50% and 60% the hard disk is in space availability ratio position 10%, 20%, 30% hard disk with space availability ratio, keep the space availability ratio in each hard disk is 35% as far as possible, makes the data balancing storage.
Alternatively, on optional embodiment basis corresponding to embodiment corresponding to above-mentioned Fig. 1 and Fig. 1, among another embodiment of the method for the Data Migration that the embodiment of the invention provides, the described space availability ratio of obtaining each hard disk in arbitrary storage pool can comprise:
Scan each hard disk in described arbitrary storage pool;
Add up the space availability ratio of scanned described each hard disk.
In the embodiment of the invention, data processing equipment can periodically issue scan request to each hard disk, and each hard disk is scanned, and adds up the space availability ratio of each hard disk.
For example: data processing equipment can issue the single pass request to each hard disk every 5 seconds, namely every 5 second the run-down hard disk, read the storage space that has taken of each hard disk, according to the storage space total amount of each hard disk, calculate the space availability ratio of each hard disk.
Alternatively, on optional embodiment basis corresponding to embodiment corresponding to above-mentioned Fig. 1 and Fig. 1, among another embodiment of the method for the Data Migration that the embodiment of the invention provides, described space utilization factor in the described same kind in the hard disk of space utilization factor less than described mean value, being comprised in the described same kind greater than the Data Migration in the hard disk of described mean value:
Inquire about the data of storing in the hard disk of space utilization factor greater than described mean value in the described same kind;
Need to determine the data of migration and the target hard disk that the described data that need to move will be moved to;
Revise the described data storage path that will move, and the described Data Migration that will move is arrived described target hard disk.
In the embodiment of the invention, data in the large hard disk of memory data output will be moved in the little hard disk of memory data output, to guarantee data continuity in use behind the Data Migration, so need to revise the store path of wanting migration data, interrupt thereby guarantee can not occur in use data.
For example: the space availability ratio of hard disk 1 is 10%, the space availability ratio of hard disk 2 is 20%, the space availability ratio of hard disk 3 is 30%, partial data in the hard disk 3 to be moved in the hard disk 1, after this part data of determining to move, hard disk 1 is revised as by hard disk 3 in this part the data storage path that will move, and this part data that will move is moved in the hard disk 1 by hard disk 3.
For the ease of understanding, the below is take two concrete application scenarioss as example, the detailed process of the method for Data Migration in the detailed explanation embodiment of the invention:
Consult Fig. 2, the hard disk that four same kind are arranged among Fig. 2, be respectively the first hard disk 200, the second hard disk 210, the 3rd hard disk 220 and the 4th hard disk 230, the black bar shaped part is divided and half black half informal voucher shaped part is divided into and is utilized the space in four hard disks, scan each first hard disk 200, the second hard disk 210, the 3rd hard disk 220 and the 4th hard disk 230, the space availability ratio that gets access to the first hard disk 200 is 25%, the space availability ratio of the second hard disk 210 is 50%, the space availability ratio of the 3rd hard disk 220 is 25%, the space availability ratio of the 4th hard disk 230 is 40%, the space availability ratio that calculates these four hard disks is 35%, further calculate the mean square deviation of these four hard disks, the mean square deviation that calculates is 19%, when preset threshold value is 15%, mean square deviation 19% is greater than preset threshold value 15%, log-on data is balanced, with the Data Migration in the two and half black half white bar shaped storage spaces in the second hard disk 210 to the first hard disk 200, Data Migration to the three hard disks 220 in the bar shaped storage space that in the second hard disk 210 one and half black half is white, Data Migration to the three hard disks 220 in the bar shaped storage space that in the 4th hard disk 230 one and half black half is white, the data after the migration distribute and can consult Fig. 3 and understand.
Distortion as above-mentioned application scenarios, can also not need to calculate root mean square, after the mean value that calculates space availability ratio is 35%, directly with the space hold rate greater than the second hard disk 210 of 35% and the Data Migration in the 4th hard disk 230 to the space hold rate less than in the 35% the first hard disks 200 and the 3rd hard disk 220, final migration results is identical with Fig. 3.
Consult Fig. 4, an embodiment of the data processing equipment 30 that the embodiment of the invention provides comprises:
Acquiring unit 301 is for the space availability ratio of obtaining arbitrary each hard disk of storage pool;
Computing unit 302, for the space availability ratio of obtaining according to described acquiring unit 301, the mean value of the space availability ratio of the hard disk of calculating same kind;
Data migration unit 303 is used in the hard disk of Data Migration in the hard disk of mean value that described same kind space utilization factor is calculated greater than described computing unit 302 mean value that the space utilization factor calculates less than described computing unit 302 in the described same kind.
In the embodiment of the invention, acquiring unit 301 obtains the space availability ratio of each hard disk in arbitrary storage pool; The space availability ratio that computing unit 302 obtains according to described acquiring unit 301, the mean value of the space availability ratio of the hard disk of calculating same kind; In the hard disk of the mean value that the space utilization factor calculates less than described computing unit 302 in the described same kind of the Data Migration in the hard disk of the mean value that data migration unit 303 calculates space utilization factor in the described same kind greater than described computing unit 302.Compared with prior art, the data processing equipment that the embodiment of the invention provides can realize in the hard disk of same kind that the data storage is balanced, alleviated the pressure of the large hard disk of memory data output, prolonged serviceable life of the large hard disk of memory data output, and behind the pressure relieve of the large hard disk of memory data output, can also improve data read-write efficiency.
On the basis of embodiment corresponding to above-mentioned Fig. 4, in the data processing equipment that the embodiment of the invention provides,
Described computing unit 302 also is used for the space availability ratio and the described mean value that obtain according to described acquiring unit 301, calculates the mean square deviation of space availability ratio of the hard disk of described same kind.
On the basis of optional embodiment corresponding to above-mentioned Fig. 4, in the data processing equipment that the embodiment of the invention provides,
Described data migration unit 303, the mean square deviation of space availability ratio of hard disk that is used for the same kind that calculates when described computing unit 302 is during greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
On the basis of optional embodiment corresponding to embodiment corresponding to above-mentioned Fig. 4 and Fig. 4, consult Fig. 5, in the data processing equipment that the embodiment of the invention provides, described acquiring unit 301 comprises: scanning subelement 3011 and statistics subelement 3012,
Described scanning subelement 3011 is used for scanning described each hard disk of arbitrary storage pool;
Described statistics subelement 3012 is used for adding up the space availability ratio of scanned described each hard disk of described scanning subelement 3011.
On the basis of optional embodiment corresponding to embodiment corresponding to above-mentioned Fig. 4 and Fig. 4, consult Fig. 6, in the data processing equipment that the embodiment of the invention provides, described data migration unit 303 comprises:
Inquiry subelement 3031 is used for inquiring about the data of storing in the hard disk of described same kind space utilization factor greater than described mean value;
Determine subelement 3032, be used for the definite data of migration and target hard disk that the described data that need to move will be moved to of needing that described inquiry subelement 3031 inquires;
Revise subelement 3033, be used for revising the data storage path that will move that described definite subelement 3032 is determined;
Migration subelement 3034, be used for and will the described Data Migration that will move to the definite target hard disk of described definite subelement 3032.
Consult Fig. 7, an embodiment of the data processing equipment 40 that the embodiment of the invention provides comprises:
Comprise: input media 410, output unit 420, storer 430 and processor 440;
Input media 410, output unit 420, storer 430 are connected with processor and are connected by bus or other modes;
Wherein, processor 440 is used for obtaining the space availability ratio of arbitrary each hard disk of storage pool; According to the space availability ratio of obtaining, the mean value of the space availability ratio of the hard disk of calculating same kind; With space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
In the some embodiments of the invention, processor 440 also is used for according to the described space availability ratio of obtaining and described mean value, calculates the mean square deviation of space availability ratio of the hard disk of described same kind.
In the some embodiments of the invention, when processor 440 is used for mean square deviation when the space availability ratio of the hard disk of described same kind greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
In the some embodiments of the invention, processor 440 is used for scanning described each hard disk of arbitrary storage pool, adds up the space availability ratio of scanned described each hard disk.
In the some embodiments of the invention, processor 440 is used for inquiring about the data of storing in the hard disk of described same kind space utilization factor greater than described mean value; Need to determine the data of migration and the target hard disk that the described data that need to move will be moved to; Revise the described data storage path that will move, and the described Data Migration that will move is arrived described target hard disk.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of above-described embodiment is to come the relevant hardware of instruction finish by program, this program can be stored in the computer-readable recording medium, and storage medium can comprise: ROM, RAM, disk or CD etc.
More than method and the device of Data Migration that the embodiment of the invention is provided be described in detail, used specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.

Claims (10)

1. the method for a Data Migration is characterized in that, comprising:
Obtain the space availability ratio of each hard disk in arbitrary storage pool;
According to the space availability ratio of obtaining, the mean value of the space availability ratio of the hard disk of calculating same kind;
With space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
2. method according to claim 1 is characterized in that, also comprises:
According to the described space availability ratio of obtaining and described mean value, calculate the mean square deviation of space availability ratio of the hard disk of described same kind.
3. method according to claim 2 is characterized in that, described space utilization factor in the described same kind in the hard disk of space utilization factor less than described mean value, being comprised in the described same kind greater than the Data Migration in the hard disk of described mean value:
When the mean square deviation of the space availability ratio of the hard disk of described same kind during greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
4. the described method of any one is characterized in that according to claim 1 ~ 3, and the described space availability ratio of obtaining each hard disk in arbitrary storage pool comprises:
Scan each hard disk in described arbitrary storage pool;
Add up the space availability ratio of scanned described each hard disk.
5. the described method of any one according to claim 1 ~ 3, it is characterized in that, described space utilization factor in the described same kind in the hard disk of space utilization factor less than described mean value, being comprised in the described same kind greater than the Data Migration in the hard disk of described mean value:
Inquire about the data of storing in the hard disk of space utilization factor greater than described mean value in the described same kind;
Need to determine the data of migration and the target hard disk that the described data that need to move will be moved to;
Revise the described data storage path that will move, and the described Data Migration that will move is arrived described target hard disk.
6. a data processing equipment is characterized in that, comprising:
Acquiring unit is for the space availability ratio of obtaining arbitrary each hard disk of storage pool;
Computing unit, for the space availability ratio of obtaining according to described acquiring unit, the mean value of the space availability ratio of the hard disk of calculating same kind;
Data migration unit is used in the hard disk of Data Migration in the hard disk of mean value that described same kind space utilization factor is calculated greater than the described computing unit mean value that the space utilization factor calculates less than described computing unit in the described same kind.
7. device according to claim 6 is characterized in that,
Described computing unit also is used for the space availability ratio and the described mean value that obtain according to described acquiring unit, calculates the mean square deviation of space availability ratio of the hard disk of described same kind.
8. device according to claim 7 is characterized in that,
Described data migration unit, the mean square deviation of space availability ratio of hard disk that is used for the same kind that calculates when described computing unit is during greater than preset threshold value, with space utilization factor in the described same kind greater than the Data Migration in the hard disk of described mean value in the described same kind in the hard disk of space utilization factor less than described mean value.
9. the described device of any one is characterized in that according to claim 6 ~ 8, and described acquiring unit comprises:
The scanning subelement is used for scanning described each hard disk of arbitrary storage pool;
The statistics subelement is used for the space availability ratio of adding up scanned described each hard disk of described scanning subelement.
10. the described device of any one is characterized in that according to claim 6 ~ 8, and described data migration unit comprises:
The inquiry subelement is used for inquiring about the data of storing in the hard disk of described same kind space utilization factor greater than described mean value;
Determine subelement, be used for the definite data of migration and target hard disk that the described data that need to move will be moved to of needing that described inquiry subelement inquires;
Revise subelement, be used for revising the data storage path that will move that described definite subelement is determined;
The migration subelement, be used for and will the described Data Migration that will move to the definite target hard disk of described definite subelement.
CN2012104869888A 2012-11-26 2012-11-26 Data migration method and device Pending CN102968281A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012104869888A CN102968281A (en) 2012-11-26 2012-11-26 Data migration method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012104869888A CN102968281A (en) 2012-11-26 2012-11-26 Data migration method and device

Publications (1)

Publication Number Publication Date
CN102968281A true CN102968281A (en) 2013-03-13

Family

ID=47798446

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012104869888A Pending CN102968281A (en) 2012-11-26 2012-11-26 Data migration method and device

Country Status (1)

Country Link
CN (1) CN102968281A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103500072A (en) * 2013-09-27 2014-01-08 华为技术有限公司 Data migration method and data migration device
CN103605484A (en) * 2013-11-26 2014-02-26 华为技术有限公司 Data storage method and storage server
CN103645860A (en) * 2013-11-27 2014-03-19 华为技术有限公司 Memory space management method and memory management device
CN104571947A (en) * 2014-12-05 2015-04-29 华为技术有限公司 Method for partitioning hard disk domains in storage array, as well as controller and storage array
CN105183670A (en) * 2015-10-27 2015-12-23 北京百度网讯科技有限公司 Data processing method and device used for distributed cache system
CN107015867A (en) * 2017-04-06 2017-08-04 安徽国防科技职业学院 A kind of efficient data processing server system
CN108089814A (en) * 2016-11-23 2018-05-29 中移(苏州)软件技术有限公司 A kind of date storage method and device
CN108197229A (en) * 2017-12-29 2018-06-22 北京搜狐新媒体信息技术有限公司 The balance method and system of a kind of data in magnetic disk
CN108924202A (en) * 2018-06-25 2018-11-30 郑州云海信息技术有限公司 A kind of the data disaster tolerance method and relevant apparatus of distributed type assemblies
CN109936627A (en) * 2019-02-21 2019-06-25 山东浪潮云信息技术有限公司 A kind of automaticdata equalization methods and tool based on hadoop
CN111124284A (en) * 2019-11-30 2020-05-08 浪潮电子信息产业股份有限公司 Hard disk management method, device and related components
CN111124269A (en) * 2018-10-31 2020-05-08 伊姆西Ip控股有限责任公司 Method, electronic device, and computer-readable storage medium for storage management
CN116049096A (en) * 2022-05-05 2023-05-02 荣耀终端有限公司 Data migration method, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101827120A (en) * 2010-02-25 2010-09-08 浪潮(北京)电子信息产业有限公司 Cluster storage method and system
CN102014150A (en) * 2010-09-29 2011-04-13 厦门市美亚柏科信息股份有限公司 Distributed small file storage system based on UDP (User Datagram Protocol) and data processing method thereof
CN102480502A (en) * 2010-11-26 2012-05-30 联想(北京)有限公司 I/O load equilibrium method and I/O server

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101827120A (en) * 2010-02-25 2010-09-08 浪潮(北京)电子信息产业有限公司 Cluster storage method and system
CN102014150A (en) * 2010-09-29 2011-04-13 厦门市美亚柏科信息股份有限公司 Distributed small file storage system based on UDP (User Datagram Protocol) and data processing method thereof
CN102480502A (en) * 2010-11-26 2012-05-30 联想(北京)有限公司 I/O load equilibrium method and I/O server

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103500072A (en) * 2013-09-27 2014-01-08 华为技术有限公司 Data migration method and data migration device
CN103605484A (en) * 2013-11-26 2014-02-26 华为技术有限公司 Data storage method and storage server
CN103605484B (en) * 2013-11-26 2016-10-26 华为技术有限公司 The method of a kind of data storage and storage server
US9733835B2 (en) 2013-11-26 2017-08-15 Huawei Technologies Co., Ltd. Data storage method and storage server
CN103645860A (en) * 2013-11-27 2014-03-19 华为技术有限公司 Memory space management method and memory management device
CN103645860B (en) * 2013-11-27 2017-01-25 华为技术有限公司 Memory space management method and memory management device
CN104571947A (en) * 2014-12-05 2015-04-29 华为技术有限公司 Method for partitioning hard disk domains in storage array, as well as controller and storage array
WO2016086818A1 (en) * 2014-12-05 2016-06-09 华为技术有限公司 Method for dividing hard disk domains in memory array, controller and memory array
CN104571947B (en) * 2014-12-05 2017-10-10 华为技术有限公司 A kind of method and controller, storage array that hard disk domain is divided in storage array
CN105183670A (en) * 2015-10-27 2015-12-23 北京百度网讯科技有限公司 Data processing method and device used for distributed cache system
CN105183670B (en) * 2015-10-27 2018-11-27 北京百度网讯科技有限公司 Data processing method and device for distributed cache system
CN108089814A (en) * 2016-11-23 2018-05-29 中移(苏州)软件技术有限公司 A kind of date storage method and device
CN108089814B (en) * 2016-11-23 2021-04-06 中移(苏州)软件技术有限公司 Data storage method and device
CN107015867B (en) * 2017-04-06 2018-01-19 安徽国防科技职业学院 A kind of efficient data processing server system
CN107015867A (en) * 2017-04-06 2017-08-04 安徽国防科技职业学院 A kind of efficient data processing server system
CN108197229A (en) * 2017-12-29 2018-06-22 北京搜狐新媒体信息技术有限公司 The balance method and system of a kind of data in magnetic disk
CN108924202A (en) * 2018-06-25 2018-11-30 郑州云海信息技术有限公司 A kind of the data disaster tolerance method and relevant apparatus of distributed type assemblies
CN108924202B (en) * 2018-06-25 2021-12-03 郑州云海信息技术有限公司 Distributed cluster data disaster tolerance method and related device
CN111124269A (en) * 2018-10-31 2020-05-08 伊姆西Ip控股有限责任公司 Method, electronic device, and computer-readable storage medium for storage management
CN111124269B (en) * 2018-10-31 2023-10-27 伊姆西Ip控股有限责任公司 Method, electronic device, and computer-readable storage medium for storage management
CN109936627A (en) * 2019-02-21 2019-06-25 山东浪潮云信息技术有限公司 A kind of automaticdata equalization methods and tool based on hadoop
CN111124284A (en) * 2019-11-30 2020-05-08 浪潮电子信息产业股份有限公司 Hard disk management method, device and related components
CN116049096A (en) * 2022-05-05 2023-05-02 荣耀终端有限公司 Data migration method, electronic equipment and storage medium
CN116049096B (en) * 2022-05-05 2024-04-16 荣耀终端有限公司 Data migration method, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN102968281A (en) Data migration method and device
US9552230B2 (en) Apparatus and method for allocating a task based on measured and estimated core usage
CN103336758B (en) The sparse matrix storage means of a kind of employing with the sparse row of compression of local information and the SpMV implementation method based on the method
CN103688248B (en) A kind of management method of storage array, device and controller
US8996464B2 (en) Efficient partitioning techniques for massively distributed computation
CN103778071A (en) Cache space distribution method and device
CN103500072A (en) Data migration method and data migration device
US7536432B2 (en) Parallel merge/sort processing device, method, and program for sorting data strings
CN111831254A (en) Image processing acceleration method, image processing model storage method and corresponding device
CN103268202A (en) Capacity expanding method and capacity expanding equipment
CN108733324B (en) Data reading and writing method, device and equipment of solid state disk and storage medium
US20180285011A1 (en) Memory side accelerator thread assignments
CN106569893B (en) Flow control method and device
CN104199784A (en) Data migration method and device based on hierarchical storage
CN103856548A (en) Dynamic resource scheduling method and dynamic resource scheduler
CN104935523B (en) The processing method and equipment of a kind of load balancing
CN103927263A (en) Garbage recycling method and garbage recycling device
CN110688256A (en) Metadata power-on recovery method and device, electronic equipment and storage medium
CN104077081A (en) Storage method and device
US8555005B2 (en) Memory managing apparatus and method using a pointer indicator bit to perform garbage collection
CN101799832A (en) Method for rapidly writing mass data into database once
CN104111875A (en) Device, system and method for dynamically controlling number of newly-increased tasks at cloud data center
CN103713953A (en) Device and method for transferring data in memory
CN103324577B (en) Based on the extensive itemize file allocation system minimizing IO access conflict and file itemize
CN105426131A (en) KV (Key Value) storage implementation method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130313