CN104239230A - Data block migration method and device - Google Patents
Data block migration method and device Download PDFInfo
- Publication number
- CN104239230A CN104239230A CN201410431442.1A CN201410431442A CN104239230A CN 104239230 A CN104239230 A CN 104239230A CN 201410431442 A CN201410431442 A CN 201410431442A CN 104239230 A CN104239230 A CN 104239230A
- Authority
- CN
- China
- Prior art keywords
- stabilization
- threshold value
- value
- data block
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses a data block migration method and device. According to the method, the access frequency of a data block is counted; whether the access frequency reaches the storage threshold value of the data block migration or not is judged; if the access frequency reaches the storage threshold value of the data block migration, whether the access frequency is a value in an anti-shake region range of the storage threshold value or not is judged; if the access frequency is not the value in the anti-shake region range of the storage threshold value, a data block is migrated into a storage medium conforming to the data block access frequency; if the access frequency is the value in the anti-shade region range of the storage threshold value, the data block is not migrated. According to the method and the device, the frequent migration of data with tiny access frequency change among different storage media can be avoided, and further, the service performance of a storage system can be improved.
Description
Technical field
The present invention relates to technical field of data storage, particularly relate to a kind of data block moving method and device.
Background technology
Data hierarchy memory technology, as the mainstream technology of technical field of data storage, can meet the performance and the capacity requirement that meet data hierarchy storage system with lower price.
Data hierarchy memory technology mainly comprises data block monitoring, the cold and hot identification of data block and data block and moves three parts.Data monitoring process, mainly monitors and the parameter values such as the access frequency of recording data blocks, determines the access temperature of data block.The cold and hot identifying of data, the access frequency mainly by determining in data monitoring process, identifies cold spot data block and hot spot data block.Data block transition process, mainly to the cold spot data block identified in the cold and hot identifying of data block and hot spot data block, determination data block should be stored in which layer of data hierarchy storage system, hot spot data block can migrate to the high-performance level of data hierarchy storage system, and cold spot data block can migrate to the low performance level in data hierarchy storage system.
Data block migration is carried out in current data hierarchy storage system, hot spot data block is moved to high-performance level, cold spot data block moves to low performance level, the following process of general employing: the access frequency obtaining the data block in each storage medium, and rank is carried out to the access frequency obtained, according to the access frequency rank of the data block in the capacity of hierarchical storage medium each in data hierarchy storage system and each storage medium, determine the access frequency of the data on the storage medium border that performance rate is adjacent, the storage threshold value of access frequency as adjacent storage medium being positioned at adjacent storage medium boundary position place that this is determined.Determine to store after threshold value, judge whether the access frequency of data block reaches and store threshold value accordingly, if reach, then carry out data block migration, data block to be moved in the storage medium of the corresponding level be consistent to access frequency and to store.
At present, carry out in the fast transition process of data, the data block near threshold value is stored between adjacent two hierarchical storage media for access frequency, can along with the subtle change of access frequency, make it be applicable to moving in another kind of storage medium, and frequently move between two kinds of storage mediums.
For above-mentioned access frequency generation subtle change, cause the phenomenon of the frequent movement between two kinds of storage mediums of data block, the system resource of data hierarchy storage system can be taken, such as committed memory, bandwidth etc., will the service feature of storage system be affected.
Summary of the invention
The embodiment of the present invention provides a kind of data block moving method and device, to solve access frequency generation subtle change, and the problem that the storage system service feature caused reduces.
First aspect, provides a kind of data block moving method, is applied to storage system, and described storage system comprises at least two kinds of different storage mediums of performance rate, and described method comprises:
Add up the access frequency of described data block;
Judge whether described access frequency reaches the storage threshold value of carrying out data block migration;
If described access frequency reaches the storage threshold value of carrying out data block migration, then judge described access frequency whether in the stabilization regional extent value of described storage threshold value, described stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium;
If described data block not in the stabilization regional extent value of described storage threshold value, then migrates in the storage medium meeting data block access frequency by described access frequency;
If described access frequency in the stabilization regional extent value of described storage threshold value, does not then move described data block.
In conjunction with first aspect, in the first implementation, described method also comprises:
Determine the stabilization regional extent value of the storage threshold value between storage medium that in described storage system, performance rate is adjacent.
In conjunction with the first implementation of first aspect, in the second implementation, the described stabilization regional extent value determining the storage threshold value between storage medium that in described data hierarchy storage system, performance rate is adjacent, comprising:
Obtain the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value;
By [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium;
Wherein, TH is for storing threshold value, and β is the stabilization factor, β ∈ (0,1).
In conjunction with the second implementation of first aspect, in the third implementation, obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value, comprising:
By the fixed value preset, as the stabilization factor of the stabilization regional extent value for determining described storage threshold value.
In conjunction with the second implementation of first aspect, in the 4th kind of implementation, obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value, comprising:
According to the traffic pressure of data hierarchy storage system, obtain the stabilization regional extent value for determining described storage threshold value stabilization factor-beta;
Wherein, the numerical value of the stabilization factor that the business that traffic pressure is large is corresponding, is less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure.
Second aspect, provides a kind of data block moving apparatus, is applied to storage system, and described storage system comprises at least two kinds of different storage mediums of performance rate, comprising: statistic unit, judging unit and migration units, wherein:
Described statistic unit, for adding up the access frequency of described data block;
Described judging unit, for judging whether the described access frequency that described statistic unit is added up reaches the storage threshold value of carrying out data block migration, if described access frequency reaches the storage threshold value of carrying out data block migration, then judge described access frequency whether in the stabilization regional extent value of described storage threshold value, described stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium;
Described migration units, if for the judged result of described judging unit be described access frequency not in the stabilization regional extent value of described storage threshold value, then described data block is migrated in the storage medium meeting data block access frequency; If the judged result of described judging unit be described access frequency in the stabilization regional extent value of described storage threshold value, then do not move described data block.
In conjunction with second aspect, in the first implementation, described device also comprises determining unit, wherein,
Described determining unit, for determining the stabilization regional extent value of the storage threshold value between storage medium that in described storage system, performance rate is adjacent.
In conjunction with the first implementation of second aspect, in the second implementation, described device also comprises acquiring unit, wherein,
Described acquiring unit, for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value;
Described determining unit, specifically for determining the stabilization regional extent value of the storage threshold value between storage medium that in described data hierarchy storage system, performance rate is adjacent as follows:
By [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium;
Wherein, TH is for storing threshold value, and β is the stabilization factor, β ∈ (0,1).
In conjunction with the second implementation of second aspect, in the third implementation, described acquiring unit, specifically for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value as follows:
By the fixed value preset, as the stabilization factor of the stabilization regional extent value for determining described storage threshold value.
In conjunction with the second implementation of second aspect, in the 4th kind of implementation, described acquiring unit, specifically for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value as follows:
According to the traffic pressure of data hierarchy storage system, obtain the stabilization regional extent value for determining described storage threshold value stabilization factor-beta;
Wherein, the numerical value of the stabilization factor that the business that traffic pressure is large is corresponding, is less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure.
The data block moving method that the embodiment of the present invention provides and device, carry out in data block transition process, after access frequency is compared with storage threshold value, also judge further described access frequency whether in the stabilization regional extent value of described storage threshold value, if the access frequency of data block is in the stabilization regional extent value of the storage threshold value determined, then not migration data block, therefore the data block of access frequency generation subtle change frequent migration between different storage medium can be avoided, and then improve the service feature of storage system.
Accompanying drawing explanation
The data block moving method realization flow figure that Fig. 1 provides for the embodiment of the present invention;
Fig. 2 is that in the embodiment of the present invention, in storage threshold value stabilization regional extent value, data do not move schematic diagram;
Fig. 3 is the aggregated structure schematic diagram of embodiment of the present invention application;
Data block migration control procedure realization flow figure in the aggregated structure that Fig. 4 provides for the embodiment of the present invention;
The data block moving apparatus that Fig. 5 A-Fig. 5 D provides for the embodiment of the present invention forms schematic diagram;
The another data block moving apparatus that Fig. 6 provides for the embodiment of the present invention forms schematic diagram.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, is not whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
The data block moving method that the embodiment of the present invention provides, is applied in storage system, and this storage system comprises the different storage medium of performance rate, and the access frequency of the data block stored in every one deck storage medium is different.In the embodiment of the present invention be adjacent level storage medium between storage threshold settings one variation range, data block in this variation range is not moved, below the embodiment of the present invention for convenience of description, the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium is called the stabilization regional extent value storing threshold value.Be positioned at the data stored near threshold value for access frequency rank in the embodiment of the present invention, if access frequency rank is in storage threshold value stabilization regional extent value, do not carry out data block migration, make the storage medium that access frequency rank is storing the current storage of data block in threshold value stabilization regional extent value constant, the data block of access frequency generation subtle change frequent migration between different storage medium can be avoided, and then improve the service feature of storage system.
Figure 1 shows that the data block moving method realization flow figure that the embodiment of the present invention provides, the executive agent of the method can be the data block moving apparatus in storage system, and this data block moving apparatus can be a controller with management and control function being arranged on physical host.Certainly this data block moving apparatus also can be in the controller integrated and be provided with the parts of the software program performing corresponding function.The embodiment of the present invention is not regarded it as and is limited, and can also be that other has management and control function, and can perform the control device of corresponding function.As shown in Figure 1, the method comprises:
S101: the access frequency of statistics block.
In the embodiment of the present invention, store the different data block of access frequency in each storage medium in storage system, the access frequency of data block embodies the access temperature of data block.The access temperature of data block can adopt multiplely determines mode, data block access frequency in setting-up time such as can be adopted as module, also there is the method adopting many indexes to obtain weighted value by different weight, be finally converted into count value, using the count value after this conversion as access temperature.
S102: judge whether the access frequency of data block reaches the storage threshold value of carrying out Data Migration.
Can arrange according to access frequency order from high to low access frequency rank in the embodiment of the present invention, also can arrange according to access frequency order from low to high, the embodiment of the present invention does not limit.
Carry out data block migration, first need the storage threshold value of determining to carry out data block migration.General, by rank between the storage medium that performance rate is adjacent, the access frequency of the data block of stored boundary position, be defined as the storage threshold value between adjacent storage medium.
The capacity of the storage medium of different performance is different, and the data block quantity of storage is also different, therefore by the access frequency after the capacity of each storage medium and rank, can determine to store threshold value.In the embodiment of the present invention can by rank between the storage medium that performance rate is adjacent, the access frequency of the data block of stored boundary position, be defined as the storage threshold value between adjacent storage medium.Such as, there are three kinds of storage mediums in data hierarchy storage system, be respectively low performance layer, secondary high-performance layer and peak performance layer, and respectively can store M, a N and P data block, then rank is the storage threshold value of low performance layer in the temperature of the data block of M, rank is the storage threshold value of time high-performance layer in the access frequency of the data block of M+1 and rank in the access frequency of the data block of M+N, and rank is the storage threshold value of peak performance layer in the access frequency of the data block of M+N+1.
It should be noted that, storage threshold value used in the embodiment of the present invention refers to the storage threshold value between adjacent storage medium, for the upper threshold of the lower threshold of the minimum storage medium of performance and the highest storage medium of performance, and can without the need to taking into account.
When carrying out data block migration, judge whether access frequency reaches the storage threshold value of carrying out data block migration, if reach, then performs S103, if do not reach, then carry out migration according to original storage mode and store.
S103: judge access frequency whether in the stabilization regional extent value storing threshold value.
For avoiding access frequency generation subtle change in the embodiment of the present invention, cause the phenomenon of data frequent movement between two kinds of storage mediums soon, determine a stabilization regional extent value for storing threshold value, stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium.
Carry out in data block process in the embodiment of the present invention, if access frequency reaches the storage threshold value of carrying out data block migration, then judge access frequency further whether in the stabilization regional extent value storing threshold value.If access frequency in storage threshold value stabilization regional extent value, is then carried out S104, is not carried out data block migration, to eliminate unnecessary data mobile.If access frequency in the stabilization regional extent value storing threshold value, is not then carried out S105, data block is migrated in the storage medium meeting data block access frequency.
S104: not migration data block.
In the embodiment of the present invention, if the access frequency of data block reaches the storage threshold value of carrying out moving, but in the stabilization regional extent value storing threshold value, then do not carry out data block migration, to eliminate unnecessary data mobile.Such as access frequency is [1, M] data block in scope, be stored in low performance layer, being positioned at the data block stored near threshold value M is easy to because access frequency generation subtle change, and reach the storage threshold value M carrying out data block migration, if traditionally moving method, then can move to memory access frequency at [M+1, M+N] data block in scope secondary high-performance layer in store, after reaching the storage threshold value M carrying out data block migration in data block access frequency in the embodiment of the present invention, whether the further access frequency judging data block is in the stabilization regional extent value storing threshold value M, if in stabilization regional extent value, then do not carry out data block migration, will data block be stored in low performance storage medium, and do not migrate in the storage medium of time high-performance layer, prevent data block frequently movement.
S105: data block is migrated in the storage medium of the access frequency meeting data block.
The data block moving method that the embodiment of the present invention provides, carry out in data block transition process, after access frequency is compared with storage threshold value, also judge further described access frequency whether in the stabilization regional extent value of described storage threshold value, if the access frequency of data block is in the stabilization regional extent value of the storage threshold value determined, then not migration data block, therefore the data block of access frequency generation subtle change frequent migration between different storage medium can be avoided, and then improve the service feature of storage system.
Carry out in the embodiment of the present invention in data block transition process, by access frequency and storage threshold value, or access frequency and the stabilization regional extent value storing threshold value are compared, mainly for the storage threshold value between the adjacent storage medium of performance rate, and the stabilization regional extent value of storage threshold value between the adjacent storage medium of performance rate, therefore in the embodiment of the present invention, need the stabilization regional extent value of the storage threshold value between storage medium that in predefined storage system, performance rate is adjacent.
The embodiment of the present invention is carried out in the process of data block migration below with reference to practical application to above-mentioned, determines the stabilization regional extent value storing threshold value, to realize the nonmigratory process of data in the stabilization regional extent value storing threshold value, is described in detail.
In the embodiment of the present invention when determining the stabilization regional extent value storing threshold value, determine by a stabilization factor.Get the stabilization factor-beta for determining the stabilization regional extent value storing threshold value, and the storage threshold T H determined, by [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium, wherein TH is for storing threshold value, namely rank is in the access frequency of the data block on storage medium border, β is the stabilization factor, β ∈ (0,1).Such as shown in Fig. 2, storage medium 1 and storage medium 2 is had in data hierarchy storage system, storage medium 1 can a store M data block, the access frequency that access frequency rank is positioned at the data block at M place is TH, then the storage threshold value of storage medium 1 is TH, if the stabilization factor is β, then when the access frequency of data block is at [TH* (1-β), TH* (1+ β)] data (in the scope between the dotted line in Fig. 2) in scope, the storage medium of former storage all can be kept constant.
In the embodiment of the present invention, the access frequency TH of above-mentioned data determined by data actual access situation, and in the embodiment of the present invention, above-mentioned stabilization factor-beta can be preferably as follows mode:
A: by the fixed value preset, as the stabilization factor for determining the stabilization regional extent value storing threshold value.
The embodiment of the present invention can according to actual conditions, and to storage threshold settings one fixed value of each storage medium in hierarchical stor as the stabilization factor for determining the stabilization regional extent value storing threshold value, this fixed value preset can be empirical value.
The implementation of the mode determination stabilization factor of above-mentioned predetermined fixed value is adopted in the embodiment of the present invention, the stabilization factor is set as fixed value, then when determining the stabilization regional extent value storing threshold value, can directly according to the storage threshold value that monitoring obtains, carry out the determination of the stabilization regional extent value storing threshold value, implementation is simple.If the access frequency of data block is in this stabilization regional extent value, then keep the storage medium of the current storage of data constant, do not carry out data block migration, prevent the frequent migration of the data block in data hierarchy storage system, reduce data block frequent migration to the impact of host service.
B: according to different traffic pressures, determines the stabilization factor of the stabilization regional extent value of the storage threshold value determining storage medium.
The current business pressure of Bedding storage system can be obtained in the embodiment of the present invention, determine determining according to current business pressure the stabilization regional extent value storing threshold value the stabilization factor.By different traffic pressures, determine the process of the stabilization factor, the stabilization factor that dynamic identification different business pressure is corresponding, store the stabilization regional extent value of threshold value in real time according to traffic pressure adjustment, the service feature of system is provided.
The numerical value of the stabilization factor corresponding to traffic pressure large business is preferably set in the embodiment of the present invention, be less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure, so that the hot spot data making traffic pressure large moves in high performance storage medium as far as possible, the data that traffic pressure is little, remain in the storage medium of former low performance as far as possible, improve data hierarchy storage system service feature further.
It should be noted that, determine in the embodiment of the present invention that the implementation of the stabilization factor can be not limited to above-mentioned two kinds of modes, can also be other implementation, the embodiment of the present invention limit.
The data block moving method that the embodiment of the present invention provides, according to storage threshold value and the default stabilization factor, determine the stabilization regional extent value storing threshold value, if the access frequency of data block sends out the stabilization regional extent value being positioned at and storing threshold value, keep the storage medium of the current storage of data block constant, the data block of access frequency generation subtle change frequent migration between different storage medium can be avoided, and then improve data hierarchy storage system service feature.
The data block moving method provided in the embodiment of the present invention can be applicable to single memory node, also can be applicable to have in the aggregated structure of multiple memory node.Be applied to the application scenarios of single memory node, then directly can obtain the access frequency of the data in each storage medium in single memory node, and carry out the determination of the storage threshold value stabilization regional extent value of each storage medium on memory node.When being applied in aggregated structure, on each memory node, the cold and hot standard of given data block is different really, and what namely store on memory node A thinks the data block that temperature is higher, not necessarily can higher than thinking for the data block that temperature is lower of storing on memory node B.Therefore for preventing the frequent migration of the data block in aggregated structure in the embodiment of the present invention, the access frequency of the data in aggregated structure, each memory node stored in each storage medium can be obtained; To the access frequency being stored in the data on each memory node in each storage medium obtained, rank again, obtains the access frequency rank of total data in aggregated structure.And then the determination of the stabilization regional extent value storing threshold value is carried out according to the capacity of each storage medium in aggregated structure.
Figure 3 shows that the aggregated structure schematic diagram including multiple memory node, control center in aggregated structure, monitoring management can be carried out to each memory node, such as, can obtain the access frequency of the data block that each memory node stores, and control the migration storage etc. that each memory node carries out data.
The data block moving method that Fig. 4 provides for the application embodiment of the present invention, the control procedure method realization flow figure of data block migration is carried out in aggregated structure, the executive agent of the method can be the control center in aggregated structure, can certainly be the control assembly with corresponding function independent of control center, the embodiment of the present invention limit.As shown in Figure 3, the method comprises:
S201: the access frequency obtaining the data block in aggregated structure, each memory node stored in each storage medium.
S202: to the access frequency being stored in the data block on each memory node in each storage medium obtained, rank again, obtains the access frequency rank of all data blocks in aggregated structure.
S203: according to the access frequency rank of all data blocks in the capacity of each storage medium on memory node each in aggregated structure and aggregated structure, determines to store threshold value.
Storage medium in the embodiment of the present invention on each memory node may be identical, also may be different, therefore for the storage medium that storage media types is identical in the embodiment of the present invention, when determining the capacity of storage medium, can using the capacity of storage medium identical for type and the capacity as such storage medium.For the storage medium that storage media types is different, then can directly using the memory capacity of self capacity of the storage medium of each type as corresponding stored media type.
After determining the capacity of the whole storage mediums in aggregated structure, then by the access frequency rank of all data blocks in aggregated structure, the data block access frequency at the storage medium boundary position place of rank between adjacent storage medium can be determined, as storage threshold value.
S204: determine the stabilization regional extent value storing threshold value.
Determine that the stabilization regional extent value of storage threshold value can consult the associated description in above-described embodiment, do not repeat them here.
S205: by the stabilization regional extent value of storage threshold value determined, be distributed to each memory node.
In the embodiment of the present invention, for reducing the load of control center, the stabilization regional extent value of the storage threshold value determined can be distributed to each memory node, carry out data block by each memory node and moving the control stored.
S206: control the stabilization regional extent value of each memory node according to the storage threshold value determined, carry out the control of data block transition process.
What in the embodiment of the present invention, each memory node can not consider the data that itself stores is cold spot data or hot spot data, can judge that the access frequency rank of data block is whether in storage threshold value stabilization regional extent value; If so, then do not carry out data block migration, keep the storage medium of the current storage of data block constant; If not, then by data block, move in the storage medium of the access frequency rank meeting data block and store.
In the embodiment of the present invention, in aggregated structure, the storage threshold value stabilization regional extent value of the storage medium that each memory node adopts control center to issue carries out the migration control of data, what do not consider data is hot spot data or cold spot data at this node, can carry out preventing the data of access frequency generation subtle change frequent migration between different storage medium in aggregated structure, and then improve data hierarchy storage system service feature.
It should be noted that, implementation process in the embodiment of the present invention shown in Fig. 4 is only be illustrated as preferred embodiment, concrete implementation is not limited thereto, control center such as also can be adopted the stabilization regional extent value of the storage threshold value determined not to be issued to each memory node, but after determining the stabilization regional extent value storing threshold value, the step whether frequency that directly conducts interviews judges in the stabilization regional extent value of storage threshold value, and the migration storing process of the data block stored in each memory node is controlled according to judged result.
Based on the data block moving method that above-described embodiment provides, the embodiment of the present invention also provides a kind of data migration device 500, and as shown in Figure 5A, this device 500 comprises statistic unit 501, judging unit 502 and migration units 503, wherein:
Statistic unit 501, for the access frequency of statistics block.
Judging unit 502, for judging whether the access frequency that statistic unit 501 is added up reaches the storage threshold value of carrying out data block migration, if access frequency reaches the storage threshold value of carrying out data block migration, then judge access frequency whether in the stabilization regional extent value storing threshold value, stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium.
Migration units 503, if for the judged result of judging unit 502 be access frequency not in the stabilization regional extent value storing threshold value, then data block is migrated in the storage medium meeting data block access frequency; If the judged result of judging unit 502 be described access frequency in the stabilization regional extent value of described storage threshold value, then not migration data block.
In the first implementation, device 500 also comprises determining unit 504, as shown in Figure 5 B, wherein,
Determining unit 504, for determining the stabilization regional extent value of the storage threshold value between storage medium that in storage system, performance rate is adjacent.
In conjunction with the first implementation, in the second implementation, device 500 also comprises acquiring unit 505, as shown in Figure 5 C, wherein,
Acquiring unit 505, for obtaining the stabilization factor-beta for determining the stabilization regional extent value storing threshold value.
Determining unit 504, specifically for determining the stabilization regional extent value of the storage threshold value between storage medium that in data hierarchy storage system, performance rate is adjacent as follows:
By [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium.
Wherein, TH is for storing threshold value, and β is the stabilization factor, β ∈ (0,1).
In the third implementation, acquiring unit 505, specifically for obtaining the stabilization factor-beta for determining the stabilization regional extent value storing threshold value as follows:
By the fixed value preset, as the stabilization factor for determining the stabilization regional extent value storing threshold value.
In the 4th kind of implementation, acquiring unit 505, specifically for obtaining the stabilization factor-beta for determining the stabilization regional extent value storing threshold value as follows:
According to the traffic pressure of data hierarchy storage system, obtain for determine store threshold value stabilization regional extent value stabilization factor-beta.
Wherein, the numerical value of the stabilization factor that the business that traffic pressure is large is corresponding, is less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure.
In the 5th kind of implementation, acquiring unit 505, also for:
Obtain the access frequency of the data block in aggregated structure, each memory node stored in each storage medium.
According to the access frequency being stored in each data block on each memory node obtained, rank is carried out to data blocks whole in aggregated structure.
In the 6th kind of implementation, device 500 also comprises and issues unit 506 and control module 507, as shown in Figure 5 D, wherein:
Issue unit 506, for determine in determining unit 504 store threshold value stabilization regional extent value after, to each memory node in aggregated structure, issue the stabilization regional extent value of the storage threshold value determined.
Control module 507, judging unit 502 for controlling each memory node in aggregated structure judges the access frequency of the data block stored in the storage medium that in respective storage medium, performance rate is adjacent respectively, in the stabilization regional extent value of the storage threshold value whether between the adjacent storage medium of correspondence.
The data storage device that the embodiment of the present invention provides, carry out in data storage procedure, after determining to store threshold value, further define the stabilization regional extent value storing threshold value, by judging the access frequency of the data block stored in storage medium that in each storage medium, performance rate is adjacent respectively, in the stabilization regional extent value of the storage threshold value whether between the adjacent storage medium of correspondence, if the access frequency of data block is in the stabilization regional extent value of the storage threshold value determined, then keep the storage medium of the current storage of data block constant, therefore the data block of access frequency generation subtle change frequent migration between different storage medium can be avoided, and then improve data hierarchy storage system service feature.
Above-mentioned data storage device in the embodiment of the present invention, can be independently parts, also can be integrated in miscellaneous part, the said apparatus that the such as embodiment of the present invention provides can be the controller in data sense of propriety storage system, also can be the new parts be integrated in controller.
It should be noted that, in the embodiment of the present invention, in data storage device, the functional realiey of modules/unit and interactive mode can with further reference to the descriptions of related method embodiment.
The data block moving method provided based on above-described embodiment and device, the embodiment of the present invention also provides a kind of data block moving apparatus 600, as shown in Figure 6, this data block moving apparatus 600 comprises processor 601, storer 602 and bus 603, and wherein processor 601 is all connected with bus 603 with storer 602.
In the embodiment of the present invention, processor 601 can be a general central processor (CPU), microprocessor, ASIC(Application Specific Integrated Circuit) (application-specific integrated circuit, ASIC), or one or more for control the present invention program's program perform integrated circuit.
Storer 602, can be ROM (read-only memory) (read-only memory, ROM) static storage device of the other types of static information and instruction can maybe be stored, random access memory (random access memory, or the dynamic memory of other types of information and instruction can be stored RAM), also can be EEPROM (Electrically Erasable Programmable Read Only Memo) (Electrically Erasable Programmable Read-Only Memory, EEPROM), read-only optical disc (Compact Disc Read-Only Memory, or other optical disc storage CD-ROM), laser disc stores and (comprises compression laser disc, laser dish, laser disc, Digital Versatile Disc, Blu-ray Disc etc.), magnetic disk storage medium or other magnetic storage apparatus, or the program code that can be used in carrying or storing the expectation with instruction or data structure form also can by any other medium of computer access, but be not limited thereto.These storeies are connected with processor by bus.
Bus 603 can comprise a path, communicates for the treatment of between device 601 and storer 602.
Storer 602 in the embodiment of the present invention, for the program code that storage of processor 601 performs.
Processor 601, for calling the program code that storer 602 stores, realizes following function:
The access frequency of statistics block.
Judge whether access frequency reaches the storage threshold value of carrying out data block migration.
If access frequency reaches the storage threshold value of carrying out data block migration, then judge access frequency whether in the stabilization regional extent value storing threshold value, stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium.
If data block in the stabilization regional extent value storing threshold value, does not then migrate in the storage medium meeting data block access frequency by access frequency.
If access frequency is in the stabilization regional extent value storing threshold value, then not migration data block.
In the first implementation, processor 601 also for:
Determine the stabilization regional extent value of the storage threshold value between storage medium that in storage system, performance rate is adjacent.
In the second implementation, processor 601 is specifically for determining the stabilization regional extent value of the storage threshold value between storage medium that in storage system, performance rate is adjacent as follows:
Obtain the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value;
By [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium;
Wherein, TH is for storing threshold value, and β is the stabilization factor, β ∈ (0,1).
In the third implementation, processor 601 is specifically for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value as follows:
By the fixed value preset, as the stabilization factor of the stabilization regional extent value for determining described storage threshold value.
In the 4th kind of implementation, processor 601 is specifically for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value as follows:
According to the traffic pressure of data hierarchy storage system, obtain the stabilization regional extent value for determining described storage threshold value stabilization factor-beta;
Wherein, the numerical value of the stabilization factor that the business that traffic pressure is large is corresponding, is less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure.
In the 5th kind of implementation, processor 601 is for obtaining the access frequency of the data block in aggregated structure, each memory node stored in each storage medium;
Processor 601 specifically for as follows according to the access frequency of each data block obtained, carries out rank to data block:
According to the access frequency being stored in each data block on each memory node obtained, rank is carried out to data blocks whole in aggregated structure.
In the 6th kind of implementation, processor 601 also for:
After determining the stabilization regional extent value of storage threshold value, to each memory node in aggregated structure, issue the stabilization regional extent value of the described storage threshold value determined;
Whether each memory node controlled in aggregated structure judges the access frequency of the database stored in respective storage medium respectively, in the stabilization regional extent value of described storage threshold value.
It should be noted that, in the embodiment of the present invention, in data storage device, the functional realiey of modules/unit and interactive mode can with further reference to the descriptions of related method embodiment.
The data block moving apparatus that the embodiment of the present invention provides, carry out in data block transition process, after determining to store threshold value, further define the stabilization regional extent value storing threshold value, by judging the access frequency of the data block stored in storage medium that in each storage medium, performance rate is adjacent respectively, in the stabilization regional extent value of the storage threshold value whether between the adjacent storage medium of correspondence, if the access frequency of data block is in the stabilization regional extent value of the storage threshold value determined, then keep the storage medium of the current storage of data block constant, therefore the data block of access frequency generation subtle change frequent migration between different storage medium can be avoided, and then improve data hierarchy storage system service feature.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (10)
1. a data block moving method, is applied to storage system, and described storage system comprises at least two kinds of different storage mediums of performance rate, and it is characterized in that, described method comprises:
Add up the access frequency of described data block;
Judge whether described access frequency reaches the storage threshold value of carrying out data block migration;
If described access frequency reaches the storage threshold value of carrying out data block migration, then judge described access frequency whether in the stabilization regional extent value of described storage threshold value, described stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium;
If described data block not in the stabilization regional extent value of described storage threshold value, then migrates in the storage medium meeting data block access frequency by described access frequency;
If described access frequency in the stabilization regional extent value of described storage threshold value, does not then move described data block.
2. the method for claim 1, is characterized in that, described method also comprises:
Determine the stabilization regional extent value of the storage threshold value between storage medium that in described storage system, performance rate is adjacent.
3. method as claimed in claim 2, is characterized in that, the described stabilization regional extent value determining the storage threshold value between storage medium that in described data hierarchy storage system, performance rate is adjacent, comprising:
Obtain the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value;
By [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium;
Wherein, TH is for storing threshold value, and β is the stabilization factor, β ∈ (0,1).
4. method as claimed in claim 3, is characterized in that, obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value, comprising:
By the fixed value preset, as the stabilization factor of the stabilization regional extent value for determining described storage threshold value.
5. method as claimed in claim 3, is characterized in that, obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value, comprising:
According to the traffic pressure of data hierarchy storage system, obtain the stabilization regional extent value for determining described storage threshold value stabilization factor-beta;
Wherein, the numerical value of the stabilization factor that the business that traffic pressure is large is corresponding, is less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure.
6. a data block moving apparatus, is applied to storage system, and described storage system comprises at least two kinds of different storage mediums of performance rate, it is characterized in that, comprising: statistic unit, judging unit and migration units, wherein:
Described statistic unit, for adding up the access frequency of described data block;
Described judging unit, for judging whether the described access frequency that described statistic unit is added up reaches the storage threshold value of carrying out data block migration, if described access frequency reaches the storage threshold value of carrying out data block migration, then judge described access frequency whether in the stabilization regional extent value of described storage threshold value, described stabilization regional extent value is the variation range interval value preventing data block from carrying out the storage threshold value of moving between different storage medium;
Described migration units, if for the judged result of described judging unit be described access frequency not in the stabilization regional extent value of described storage threshold value, then described data block is migrated in the storage medium meeting data block access frequency; If the judged result of described judging unit be described access frequency in the stabilization regional extent value of described storage threshold value, then do not move described data block.
7. device as claimed in claim 6, it is characterized in that, described device also comprises determining unit, wherein,
Described determining unit, for determining the stabilization regional extent value of the storage threshold value between storage medium that in described storage system, performance rate is adjacent.
8. device as claimed in claim 7, it is characterized in that, described device also comprises acquiring unit, wherein,
Described acquiring unit, for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value;
Described determining unit, specifically for determining the stabilization regional extent value of the storage threshold value between storage medium that in described data hierarchy storage system, performance rate is adjacent as follows:
By [TH* (1-β), TH* (1+ β)], as the stabilization regional extent value of the storage threshold value of storage medium;
Wherein, TH is for storing threshold value, and β is the stabilization factor, β ∈ (0,1).
9. device as claimed in claim 8, is characterized in that, described acquiring unit, specifically for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value as follows:
By the fixed value preset, as the stabilization factor of the stabilization regional extent value for determining described storage threshold value.
10. device as claimed in claim 8, is characterized in that, described acquiring unit, specifically for obtaining the stabilization factor-beta of the stabilization regional extent value for determining described storage threshold value as follows:
According to the traffic pressure of data hierarchy storage system, obtain the stabilization regional extent value for determining described storage threshold value stabilization factor-beta;
Wherein, the numerical value of the stabilization factor that the business that traffic pressure is large is corresponding, is less than the numerical value of the stabilization factor corresponding to the little business of traffic pressure.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410431442.1A CN104239230B (en) | 2014-08-28 | 2014-08-28 | A kind of data block migration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410431442.1A CN104239230B (en) | 2014-08-28 | 2014-08-28 | A kind of data block migration method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104239230A true CN104239230A (en) | 2014-12-24 |
| CN104239230B CN104239230B (en) | 2017-06-09 |
Family
ID=52227344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410431442.1A Active CN104239230B (en) | 2014-08-28 | 2014-08-28 | A kind of data block migration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104239230B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9760310B2 (en) | 2015-08-06 | 2017-09-12 | International Business Machines Corporation | High performance data storage management using dynamic compression |
| CN107870735A (en) * | 2016-09-28 | 2018-04-03 | 杭州华为数字技术有限公司 | Data managing method, device and equipment |
| CN110674086A (en) * | 2019-09-29 | 2020-01-10 | 广州华多网络科技有限公司 | Data merging method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6035377A (en) * | 1997-12-17 | 2000-03-07 | Ncr Corporation | Method and apparatus for determining memory pages having greatest frequency of access in a non-uniform memory access computer system |
| CN102117248A (en) * | 2011-03-09 | 2011-07-06 | 浪潮(北京)电子信息产业有限公司 | Caching system and method for caching data in caching system |
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
| CN103336670A (en) * | 2013-06-04 | 2013-10-02 | 华为技术有限公司 | Method and device for automatic distribution of data blocks based on data temperature |
-
2014
- 2014-08-28 CN CN201410431442.1A patent/CN104239230B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6035377A (en) * | 1997-12-17 | 2000-03-07 | Ncr Corporation | Method and apparatus for determining memory pages having greatest frequency of access in a non-uniform memory access computer system |
| CN102117248A (en) * | 2011-03-09 | 2011-07-06 | 浪潮(北京)电子信息产业有限公司 | Caching system and method for caching data in caching system |
| CN102156738A (en) * | 2011-04-13 | 2011-08-17 | 成都市华为赛门铁克科技有限公司 | Method for processing data blocks, and data block storage equipment and system |
| CN103336670A (en) * | 2013-06-04 | 2013-10-02 | 华为技术有限公司 | Method and device for automatic distribution of data blocks based on data temperature |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9760310B2 (en) | 2015-08-06 | 2017-09-12 | International Business Machines Corporation | High performance data storage management using dynamic compression |
| CN107870735A (en) * | 2016-09-28 | 2018-04-03 | 杭州华为数字技术有限公司 | Data managing method, device and equipment |
| CN107870735B (en) * | 2016-09-28 | 2021-01-05 | 华为技术有限公司 | Data management method, device and equipment |
| CN110674086A (en) * | 2019-09-29 | 2020-01-10 | 广州华多网络科技有限公司 | Data merging method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104239230B (en) | 2017-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106502576B (en) | Migration strategy adjusting method and device | |
| CN100468374C (en) | Method and apparatus to establish, report and adjust system memory usage | |
| CN102650931B (en) | Method and system for writing data | |
| CN107783734B (en) | Resource allocation method, device and terminal based on super-fusion storage system | |
| CN103473142B (en) | Virtual machine migration method under a kind of cloud computing operating system and device | |
| CN103747047A (en) | CDN file storage method, file distribution control center and system thereof | |
| WO2011016081A1 (en) | Storage system, control method thereof, and program to adjust power consumption per workload | |
| US20130185506A1 (en) | Controlling a Storage System | |
| US9524245B2 (en) | Cache management method and apparatus for non-volatile storage device | |
| US9141288B2 (en) | Chargeback based storage recommendations for datacenters | |
| CN102156738A (en) | Method for processing data blocks, and data block storage equipment and system | |
| US9823875B2 (en) | Transparent hybrid data storage | |
| CN104050097A (en) | Selecting between non-volatile memory units having different minimum addressable data unit sizes | |
| WO2017036428A2 (en) | Capacity change suggestion method and device | |
| CN105786401A (en) | Data management method and device in server cluster system | |
| CN104113576A (en) | Method and device for updating client | |
| US8856442B2 (en) | Method for volume management | |
| CN104239230A (en) | Data block migration method and device | |
| CN110737717B (en) | Database migration method and device | |
| CN110018797B (en) | Data migration method, device and equipment and readable storage medium | |
| US9558783B2 (en) | System and method for displaying tape drive utilization and performance data | |
| TWI718252B (en) | Task scheduling method and device | |
| CN105338097A (en) | Terminal screen size-based flow control method, terminal and business server | |
| CN112204514A (en) | Techniques for preserving life expectancy of non-volatile memory | |
| JP4778538B2 (en) | Storage data management system and storage data management program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |