CN102831088A - Data migration method and device based on mixing memory - Google Patents

Data migration method and device based on mixing memory Download PDF

Info

Publication number
CN102831088A
CN102831088A CN2012102642460A CN201210264246A CN102831088A CN 102831088 A CN102831088 A CN 102831088A CN 2012102642460 A CN2012102642460 A CN 2012102642460A CN 201210264246 A CN201210264246 A CN 201210264246A CN 102831088 A CN102831088 A CN 102831088A
Authority
CN
China
Prior art keywords
write back
data
waiting
back data
memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012102642460A
Other languages
Chinese (zh)
Inventor
常艺伟
葛雄资
徐泽明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NATIONAL SUPERCOMPUTING CENTER IN SHENZHEN (SHENZHEN CLOUD COMPUTING CENTER)
Original Assignee
NATIONAL SUPERCOMPUTING CENTER IN SHENZHEN (SHENZHEN CLOUD COMPUTING CENTER)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NATIONAL SUPERCOMPUTING CENTER IN SHENZHEN (SHENZHEN CLOUD COMPUTING CENTER) filed Critical NATIONAL SUPERCOMPUTING CENTER IN SHENZHEN (SHENZHEN CLOUD COMPUTING CENTER)
Priority to CN2012102642460A priority Critical patent/CN102831088A/en
Publication of CN102831088A publication Critical patent/CN102831088A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Memory System Of A Hierarchy Structure (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a data migration method and a device based on a mixing memory. The data migration method comprises the following steps of: receiving a data write-back command; storing the data to be written back to an SSD (Solid State Disk) of storage equipment when access frequency of the data to be written back in cache equipment is larger than a preset frequency threshold value; storing the data to be written back to an HDD (Hard Disk Drive) of the storage equipment when an access sequence of the data to be written back in the cache equipment is larger than a preset sequence threshold value. The device performs a self-adaptive adjustment to the data stored in the mixing memory, and intelligently migrates a storage position of the data to be written back, so that an SSD loss is reduced to the maximum, an integral service life of the mixing memory is improved, and access delay is reduced, and moreover, resource storage is better utilized and access efficiency is improved.

Description

Data migration method and device based on mixing memory
Technical field
The present invention relates to technical field of computer data storage, specially refer to data migration method and device based on mixing memory.
Background technology
In the cloud epoch, be that computational resource or storage resources are all focused on long-range data center, except the direct stores service of special intended for end consumers, all the other most of storage resources all can be directly in the face of the server among the data center.Along with the extensive growth and the server of mass data are used extensively and profoundly, a lot of important application such as transacter, weather forecast etc. all receive the restriction of bottom main memory and performance of storage system.Make full use of existing memory technology, improving existing main memory and memory system architecture is vital for improving the entire system performance.Solid state hard disc has multiple advantages, but has also that cost is high, capacity is low, writes characteristics such as limited service life.
Summary of the invention
Fundamental purpose of the present invention is that data migration method and the device based on mixing memory that a kind of cost is low, capacity greatly, effectively improves serviceable life is provided.
The present invention proposes a kind of data migration method based on mixing memory, comprises step:
Receive data and write back instruction;
When the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, with the said solid-state hard disk SSD of waiting to write back data storage to memory device;
When the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, with the said hard disk drive HDD that waits to write back data storage to memory device.
Preferably, said reception data also comprise after writing back the step of instruction:
Judge the said former memory location of waiting to write back data;
When judging said former memory location of waiting to write back data at said HDD, carry out said when the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, with the said step of waiting to write back the solid-state hard disk SSD of data storage to memory device;
When judging said former memory location of waiting to write back data at said SSD; Carry out said when the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, with the said step of waiting to write back the hard disk drive HDD of data storage to memory device.
Preferably, said when the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, the said step of waiting to write back the solid-state hard disk SSD of data storage to memory device is specifically comprised:
Judge that the said access frequency of waiting to write back data is whether greater than the predeterminated frequency threshold value of said SSD;
If then wait to write back data storage to said SSD with said;
If, then do not wait to write back data storage to said HDD with said.
Preferably, said when the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, the said step of waiting to write back the hard disk drive HDD of data storage to memory device is specifically comprised:
Judge that the said access order property of waiting to write back data is whether greater than the preset order property threshold value of said HDD;
If then wait to write back data storage to said HDD with said;
If, then do not wait to write back data storage to said SSD with said.
Preferably, said reception data also comprise before writing back the step of instruction: monitor said buffer memory equipment and memory device, and the canned data and the visit information of data in said buffer memory equipment and the memory device is stored in the visit information table;
The step that said reception data write back instruction also comprises afterwards: from said visit information table, obtain said canned data and the visit information of waiting to write back data.
The present invention also proposes a kind of data migration device based on mixing memory, comprising:
The command reception module is used to receive data and writes back instruction;
First transferring module, the access frequency that is used for waiting to write back data when buffer memory equipment are during greater than the predeterminated frequency threshold value, with the said solid-state hard disk SSD of waiting to write back data storage to memory device;
Second transferring module, the access order property that is used for waiting to write back data when buffer memory equipment are during greater than preset order property threshold value, with the said hard disk drive HDD that waits to write back data storage to memory device.
Preferably, said data migration device based on mixing memory also comprises:
Position judging module is used to judge the said former memory location of waiting to write back data;
Said first transferring module also is used for; When said position judging module is judged said former memory location of waiting to write back data at said HDD; Judge that the access frequency of waiting to write back data in the buffer memory equipment is greater than the predeterminated frequency threshold value, with the said solid-state hard disk SSD of waiting to write back data storage to memory device;
Said second transferring module also is used for; When said position judging module is judged said former memory location of waiting to write back data at said SSD; Judge that the access order property of waiting to write back data in the buffer memory equipment is greater than preset order property threshold value, with the said hard disk drive HDD that waits to write back data storage to memory device.
Preferably, said first transferring module specifically is used for:
Judge that the said access frequency of waiting to write back data is whether greater than the predeterminated frequency threshold value of said SSD;
If then wait to write back data storage to said SSD with said;
If, then do not wait to write back data storage to said HDD with said.
Preferably, said second transferring module specifically is used for:
Judge that the said access order property of waiting to write back data is whether greater than the preset order property threshold value of said HDD;
If then wait to write back data storage to said HDD with said;
If, then do not wait to write back data storage to said SSD with said.
Preferably, said data migration device based on mixing memory also comprises:
The monitoring and statistics module is used to monitor said buffer memory equipment and memory device, and the canned data and the visit information of data in said buffer memory equipment and the memory device is stored in the visit information table;
The information acquisition module is used for obtaining said canned data and the visit information of waiting to write back data from said visit information table.
The present invention is through the self-adaptation adjustment to storage data in the mixing memory; Carry out the intelligence migration with waiting the memory location that writes back data; To reduce the loss of SSD to greatest extent, improve the whole service life of mixing memory, reduce the visit time-delay; And can better utilize storage resources, improve access efficiency.
Description of drawings
Fig. 1 is the process flow diagram of first embodiment that the present invention is based on the data migration method of mixing memory;
Fig. 2 is the process flow diagram of second embodiment that the present invention is based on the data migration method of mixing memory;
Fig. 3 is the process flow diagram of the 3rd embodiment that the present invention is based on the data migration method of mixing memory;
Fig. 4 is the process flow diagram of the 4th embodiment that the present invention is based on the data migration method of mixing memory;
Fig. 5 is the structural representation of first embodiment that the present invention is based on the data migration device of mixing memory;
Fig. 6 is the structural representation of second embodiment that the present invention is based on the data migration device of mixing memory;
Fig. 7 is the structural representation of the 3rd embodiment that the present invention is based on the data migration device of mixing memory.
The realization of the object of the invention, functional characteristics and advantage will combine embodiment, further specify with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.
Mixing memory of the present invention comprises memory device and buffer memory equipment.Memory device comprises SSD (solid state disk; Solid state hard disc) and HDD (Hard Disk Drive, hard disk drive), since SSD have fast and read, lowly postpone, write characteristics such as loss; Therefore SSD being used for storage reads frequently to write the few data of number of times; Buffer memory equipment comprises DRAM (Dynamic Random Access Memory, dynamic RAM) and PCM (phase change memory, phase transition storage); The PCM capacity is bigger, and the DRAM capacity is less, because the read rate of PCM and DRAM is more or less the same; But there is the loss problem of writing in PCM; Its limited service life, so PCM is more suitable for storing and reads frequent data, writes frequent data and then mainly is stored in DRAM.The present invention has combined the advantage of each storage chip in the mixing memory, has carried out holistic approach and design at aspects such as the built-in function distribution of mixing memory, the layout that reads and writes data and data migtations, and specific embodiment is following.
As shown in Figure 1, Fig. 1 is the process flow diagram of first embodiment that the present invention is based on the data migration method of mixing memory, and the data migration method based on mixing memory that this embodiment mentions comprises step:
Step S101 receives data and writes back instruction;
Step S102 is when the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, with the solid-state hard disk SSD of waiting to write back data storage to memory device;
Read owing to SSD has fast, hang down delay, write loss, therefore, its performance has determined SSD to be more suitable for the high data of memory access frequency, can effectively reduce access time delay.
Step S103 is when the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, with the hard disk drive HDD that waits to write back data storage to memory device.
Because the existence of prefetch mechanisms, the high data storage of access order property is in HDD, but the better utilization storage resources, and equilibrium utilizes each memory device.
Present embodiment is through the self-adaptation adjustment to storage data in the mixing memory; Carry out the intelligence migration with waiting the memory location that writes back data; To reduce the loss of SSD to greatest extent, improve the whole service life of mixing memory, reduce the visit time-delay; And can better utilize storage resources, improve access efficiency.
As shown in Figure 2, Fig. 2 is the process flow diagram of second embodiment that the present invention is based on the data migration method of mixing memory.
Step S201 receives data and writes back instruction;
Step S202 judges the former memory location of waiting to write back data;
Step S203 when former memory location that judgement waits to write back data during at HDD, and when the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, will wait to write back data storage to SSD;
For the to be write back data of former memory location at HDD, consider SSD have fast read, the low characteristics that postpone, write loss, its performance has determined SSD to be more suitable for the high data of memory access frequency, can effectively reduce access time delay.Therefore, according to the data access frequency configuration frequency threshold of statistics, access frequency is write back SSD greater than the data of frequency threshold.
Step S204 when former memory location that judgement waits to write back data during at SSD, and when the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, will wait to write back data storage to HDD.
For the to be write back data of former memory location at SSD, consider the existence of prefetch mechanisms, the high data storage of access order property is in HDD, but the better utilization storage resources, equilibrium utilizes each memory device.Therefore, the succession threshold value is set, access order property is write back HDD greater than the data of real-time threshold value according to the data access sequences property of statistics.
Present embodiment has taken into full account the reading fast of SSD, the low characteristics that postpone and the prefetch mechanisms of HDD, helps reducing the loss of mixing memory, improves whole service life, reduces the visit time-delay, and can better utilize storage resources, improves access efficiency.
As shown in Figure 3, Fig. 3 is the process flow diagram of the 3rd embodiment that the present invention is based on the data migration method of mixing memory.
Step S301 receives data and writes back instruction;
Step S302 judges the former memory location of waiting to write back data;
Step S311 when former memory location that judgement waits to write back data during at HDD, judges that whether the access frequency of waiting in the buffer memory equipment to write back data is greater than the predeterminated frequency threshold value; If, execution in step S321 then; If deny, then execution in step S322;
Former memory location is judged in the data to be write back of the HDD frequency that conducts interviews, access frequency is write back SSD greater than the data of frequency threshold, still write back former memory location, can effectively reduce access time delay less than the data of frequency threshold.
Step S312 when former memory location that judgement waits to write back data during at SSD, judges that the access order property of waiting to write back data in the buffer memory equipment is during whether greater than preset order property threshold value; If, execution in step S322 then; If deny, then execution in step S321;
Judge in the data to be write back of the SSD succession that conducts interviews for former memory location; Access order property is write back HDD greater than the data of real-time threshold value; Data less than the succession threshold value still write back former memory location, but the better utilization storage resources, and equilibrium utilizes each memory device.
Step S321 is with the solid-state hard disk SSD of waiting to write back data storage to memory device;
Step S322 is with the hard disk drive HDD that waits to write back data storage to memory device.
Present embodiment has taken into full account the reading fast of SSD, the low characteristics that postpone and the prefetch mechanisms of HDD, helps reducing the loss of mixing memory, improves whole service life, reduces the visit time-delay, and can better utilize storage resources, improves access efficiency.
As shown in Figure 4, Fig. 4 is the process flow diagram of the 4th embodiment that the present invention is based on the data migration method of mixing memory.
Step S401 monitors buffer memory equipment and memory device, and the canned data and the visit information of data in buffer memory equipment and the memory device is stored in the visit information table;
The former storage device type that canned data comprises data (for example; 0 expression data are from SSD; 1 expression data are from HDD) and buffer memory device type (for example, 0 expression PCM, 1 expression DRAM); Visit information comprises the visit information situation (for example, the read operation frequency counting of data, write operation frequency counting, hit operating frequency counting, miss operating frequency counting etc.) of data.The data layout of each data and visit situation in the dynamic monitoring mixing memory comprise the canned data and the visit information of data, and relevant information is written in the visit information table.Simultaneously, also can threshold value be set, to determine whether to carry out data migtation according to the result who adds up in the visit information table.
Step S402 receives data and writes back instruction;
Step S403 obtains canned data and the visit information of waiting to write back data from the visit information table.
Carrying out data when writing back, dynamic canned data and the visit information that from the visit information table, obtains data, when data access frequency or access order property surpass assign thresholds, trigger data migration instruction.
Step S404 according to canned data, judges the former memory location of waiting to write back data;
Step S411 when former memory location that judgement waits to write back data during at HDD, according to visit information, judges that whether the access frequency of waiting in the buffer memory equipment to write back data is greater than the predeterminated frequency threshold value; If, execution in step S421 then; If deny, then execution in step S422;
Step S412 when former memory location that judgement waits to write back data during at SSD, according to visit information, judges that the access order property of waiting to write back data in the buffer memory equipment is during whether greater than preset order property threshold value; If, execution in step S422 then; If deny, then execution in step S421;
Step S421 is with the solid-state hard disk SSD of waiting to write back data storage to memory device;
Step S422 is with the hard disk drive HDD that waits to write back data storage to memory device.
Present embodiment, is treated the memory location that writes back data and is carried out the self-adaptation adjustment according to the canned data and the visit information of data in the visit information table through dynamically updating the visit information table; Carry out the intelligence migration with waiting the memory location that writes back data; To reduce the loss of SSD to greatest extent, improve the whole service life of mixing memory, reduce the visit time-delay; And can better utilize storage resources, improve access efficiency.
As shown in Figure 5, Fig. 5 is the structural representation of first embodiment that the present invention is based on the data migration device of mixing memory, and the data migration device based on mixing memory that this embodiment mentions comprises:
Command reception module 10 is used to receive data and writes back instruction;
First transferring module 20, the access frequency that is used for waiting to write back data when buffer memory equipment are during greater than the predeterminated frequency threshold value, with the solid-state hard disk SSD of waiting to write back data storage to memory device;
Second transferring module 30, the access order property that is used for waiting to write back data when buffer memory equipment are during greater than preset order property threshold value, with the hard disk drive HDD that waits to write back data storage to memory device.
In the present embodiment, read owing to SSD has fast, hang down delay, write loss, therefore, its performance has determined SSD to be more suitable for the high data of memory access frequency, can effectively reduce access time delay; Simultaneously, because the existence of prefetch mechanisms, the high data storage of access order property is in HDD, but the better utilization storage resources, and equilibrium utilizes each memory device.Therefore; Present embodiment is through the self-adaptation adjustment of storage data in first transferring module 20 and 30 pairs of mixing memories of second transferring module, intelligence carried out in the memory location of waiting to write back data move, to reduce the loss of SSD to greatest extent; Improve the whole service life of mixing memory; Reduce the visit time-delay, and can better utilize storage resources, improve access efficiency.
As shown in Figure 6, Fig. 6 is the structural representation of second embodiment that the present invention is based on the data migration device of mixing memory.Data migration device based on mixing memory also comprises:
Position judging module 40 is used to judge the former memory location of waiting to write back data;
First transferring module 20 also is used for; When position judging module 40 judges that the former memory location of waiting to write back data is during at HDD; Judge that the access frequency of waiting to write back data in the buffer memory equipment is greater than the predeterminated frequency threshold value, with the solid-state hard disk SSD of waiting to write back data storage to memory device;
Second transferring module 30 also is used for; When position judging module 40 judges that the former memory location of waiting to write back data is during at SSD; Judge that the access order property of waiting to write back data in the buffer memory equipment is greater than preset order property threshold value, with the hard disk drive HDD that waits to write back data storage to memory device.
The former memory location that present embodiment is judged for position judging module 40 is in the data to be write back of HDD; Consider SSD have fast read, the low characteristics that postpone, write loss; Its performance has determined SSD to be more suitable for the high data of memory access frequency, can effectively reduce access time delay, therefore; According to the data access frequency configuration frequency threshold of statistics, access frequency is write back SSD greater than the data of frequency threshold through first transferring module 20.Simultaneously, the existence of prefetch mechanisms is considered in the data to be write back of SSD in the former memory location of judging for position judging module 40, and the high data storage of access order property is in HDD, but the better utilization storage resources, and equilibrium utilizes each memory device.Therefore, the succession threshold value is set, access order property is write back HDD greater than the data of real-time threshold value through second transferring module 30 according to the data access sequences property of statistics.Present embodiment has taken into full account the reading fast of SSD, the low characteristics that postpone and the prefetch mechanisms of HDD, helps reducing the loss of mixing memory, improves whole service life, reduces the visit time-delay, and can better utilize storage resources, improves access efficiency.
In the embodiment of the invention, first transferring module 20 specifically is used for:
Judge that the access frequency wait to write back data is whether greater than the predeterminated frequency threshold value of SSD;
If then will wait to write back data storage to SSD;
If, then will not wait to write back data storage to HDD.
Second transferring module 30 specifically is used for:
Judge that the access order property wait to write back data is whether greater than the preset order property threshold value of HDD;
If then will wait to write back data storage to HDD;
If, then will not wait to write back data storage to SSD.
Present embodiment is judged in the data to be write back of the HDD frequency that conducts interviews through 20 pairs of former memory locations of first transferring module; Access frequency is write back SSD greater than the data of frequency threshold; Data less than frequency threshold still write back former memory location, can effectively reduce access time delay.Simultaneously; Judge in the data to be write back of the SSD succession that conducts interviews through 30 pairs of former memory locations of second transferring module; Access order property is write back HDD greater than the data of real-time threshold value; Data less than the succession threshold value still write back former memory location, but the better utilization storage resources, and equilibrium utilizes each memory device.Present embodiment has taken into full account the reading fast of SSD, the low characteristics that postpone and the prefetch mechanisms of HDD, helps reducing the loss of mixing memory, improves whole service life, reduces the visit time-delay, and can better utilize storage resources, improves access efficiency.
As shown in Figure 7, Fig. 7 is the structural representation of the 3rd embodiment that the present invention is based on the data migration device of mixing memory.Data migration device based on mixing memory also comprises:
Monitoring and statistics module 50 is used to monitor buffer memory equipment and memory device, and the canned data and the visit information of data in buffer memory equipment and the memory device is stored in the visit information table;
Information acquisition module 60 is used for obtaining canned data and the visit information of waiting to write back data from the visit information table.
The former storage device type that the canned data of present embodiment comprises data (for example; 0 expression data are from SSD; 1 expression data are from HDD) and buffer memory device type (for example, 0 expression PCM, 1 expression DRAM); Visit information comprises the visit information situation (for example, the read operation frequency counting of data, write operation frequency counting, hit operating frequency counting, miss operating frequency counting etc.) of data.Through the data layout and the visit situation of each data in the monitoring and statistics module 50 dynamic monitoring mixing memories, comprise the canned data and the visit information of data, and relevant information is written in the visit information table.Simultaneously, also can threshold value be set, to determine whether to carry out data migtation according to the result who adds up in the visit information table.Carrying out data when writing back, information acquisition module 60 dynamic canned data and the visit informations that from the visit information table, obtain data, when data access frequency or access order property surpass assign thresholds, trigger data migration instruction.Present embodiment, is treated the memory location that writes back data and is carried out the self-adaptation adjustment according to the canned data and the visit information of data in the visit information table through dynamically updating the visit information table; Carry out the intelligence migration with waiting the memory location that writes back data; To reduce the loss of SSD to greatest extent, improve the whole service life of mixing memory, reduce the visit time-delay; And can better utilize storage resources, improve access efficiency.
The above is merely the preferred embodiments of the present invention; Be not so limit claim of the present invention; Every equivalent structure or equivalent flow process conversion that utilizes instructions of the present invention and accompanying drawing content to be done; Or directly or indirectly be used in other relevant technical fields, all in like manner be included in the scope of patent protection of the present invention.

Claims (10)

1. the data migration method based on mixing memory is characterized in that, comprises step:
Receive data and write back instruction;
When the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, with the said solid-state hard disk SSD of waiting to write back data storage to memory device;
When the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, with the said hard disk drive HDD that waits to write back data storage to memory device.
2. the data migration method based on mixing memory according to claim 1 is characterized in that, the step that said reception data write back instruction also comprises afterwards:
Judge the said former memory location of waiting to write back data;
When judging said former memory location of waiting to write back data at said HDD, carry out said when the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, with the said step of waiting to write back the solid-state hard disk SSD of data storage to memory device;
When judging said former memory location of waiting to write back data at said SSD; Carry out said when the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, with the said step of waiting to write back the hard disk drive HDD of data storage to memory device.
3. the data migration method based on mixing memory according to claim 2; It is characterized in that; Said when the access frequency of waiting to write back data in the buffer memory equipment during greater than the predeterminated frequency threshold value, the said step of waiting to write back the solid-state hard disk SSD of data storage to memory device is specifically comprised:
Judge that the said access frequency of waiting to write back data is whether greater than the predeterminated frequency threshold value of said SSD;
If then wait to write back data storage to said SSD with said;
If, then do not wait to write back data storage to said HDD with said.
4. the data migration method based on mixing memory according to claim 2; It is characterized in that; Said when the access order property of waiting to write back data in the buffer memory equipment during greater than preset order property threshold value, the said step of waiting to write back the hard disk drive HDD of data storage to memory device is specifically comprised:
Judge that the said access order property of waiting to write back data is whether greater than the preset order property threshold value of said HDD;
If then wait to write back data storage to said HDD with said;
If, then do not wait to write back data storage to said SSD with said.
5. according to claim 3 or 4 described data migration methods based on mixing memory; It is characterized in that; The step that said reception data write back instruction also comprises before: monitor said buffer memory equipment and memory device, and the canned data and the visit information of data in said buffer memory equipment and the memory device is stored in the visit information table;
The step that said reception data write back instruction also comprises afterwards: from said visit information table, obtain said canned data and the visit information of waiting to write back data.
6. the data migration device based on mixing memory is characterized in that, comprising:
The command reception module is used to receive data and writes back instruction;
First transferring module, the access frequency that is used for waiting to write back data when buffer memory equipment are during greater than the predeterminated frequency threshold value, with the said solid-state hard disk SSD of waiting to write back data storage to memory device;
Second transferring module, the access order property that is used for waiting to write back data when buffer memory equipment are during greater than preset order property threshold value, with the said hard disk drive HDD that waits to write back data storage to memory device.
7. the data migration device based on mixing memory according to claim 6 is characterized in that, also comprises:
Position judging module is used to judge the said former memory location of waiting to write back data;
Said first transferring module also is used for; When said position judging module is judged said former memory location of waiting to write back data at said HDD; Judge that the access frequency of waiting to write back data in the buffer memory equipment is greater than the predeterminated frequency threshold value, with the said solid-state hard disk SSD of waiting to write back data storage to memory device;
Said second transferring module also is used for; When said position judging module is judged said former memory location of waiting to write back data at said SSD; Judge that the access order property of waiting to write back data in the buffer memory equipment is greater than preset order property threshold value, with the said hard disk drive HDD that waits to write back data storage to memory device.
8. the data migration device based on mixing memory according to claim 7 is characterized in that, said first transferring module specifically is used for:
Judge that the said access frequency of waiting to write back data is whether greater than the predeterminated frequency threshold value of said SSD;
If then wait to write back data storage to said SSD with said;
If, then do not wait to write back data storage to said HDD with said.
9. the data migration device based on mixing memory according to claim 7 is characterized in that, said second transferring module specifically is used for:
Judge that the said access order property of waiting to write back data is whether greater than the preset order property threshold value of said HDD;
If then wait to write back data storage to said HDD with said;
If, then do not wait to write back data storage to said SSD with said.
10. according to Claim 8 or 9 described data migration device, it is characterized in that, also comprise based on mixing memory:
The monitoring and statistics module is used to monitor said buffer memory equipment and memory device, and the canned data and the visit information of data in said buffer memory equipment and the memory device is stored in the visit information table;
The information acquisition module is used for obtaining said canned data and the visit information of waiting to write back data from said visit information table.
CN2012102642460A 2012-07-27 2012-07-27 Data migration method and device based on mixing memory Pending CN102831088A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012102642460A CN102831088A (en) 2012-07-27 2012-07-27 Data migration method and device based on mixing memory

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012102642460A CN102831088A (en) 2012-07-27 2012-07-27 Data migration method and device based on mixing memory

Publications (1)

Publication Number Publication Date
CN102831088A true CN102831088A (en) 2012-12-19

Family

ID=47334233

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012102642460A Pending CN102831088A (en) 2012-07-27 2012-07-27 Data migration method and device based on mixing memory

Country Status (1)

Country Link
CN (1) CN102831088A (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103218173A (en) * 2013-03-27 2013-07-24 华为技术有限公司 Method and device for storage control
CN103500072A (en) * 2013-09-27 2014-01-08 华为技术有限公司 Data migration method and data migration device
CN103744624A (en) * 2014-01-10 2014-04-23 浪潮电子信息产业股份有限公司 System architecture for realizing selective upgrade of data cached in SSD (Solid State Disk) of storage system
WO2014114203A1 (en) * 2013-01-22 2014-07-31 International Business Machines Corporation Tiered caching and migration in differing granularities
CN104516678A (en) * 2013-09-29 2015-04-15 国际商业机器公司 Method and device for storing data
WO2015061965A1 (en) * 2013-10-29 2015-05-07 Hua Zhong University Of Science Technology Mixed cache management
CN104679661A (en) * 2013-11-27 2015-06-03 阿里巴巴集团控股有限公司 Hybrid memory control method and hybrid memory system
CN105637470A (en) * 2013-04-25 2016-06-01 微软技术许可有限责任公司 Dirty data management for hybrid drives
CN105653524A (en) * 2014-11-10 2016-06-08 阿里巴巴集团控股有限公司 Data storage method, device and system
CN105892947A (en) * 2016-03-31 2016-08-24 华中科技大学 SSD and HDD hybrid caching management method and system of energy-saving storage system
CN106484329A (en) * 2016-09-26 2017-03-08 浪潮电子信息产业股份有限公司 Big data transmission integrity protection mechanism based on multi-level storage
CN106775453A (en) * 2016-11-22 2017-05-31 华中科技大学 A kind of construction method for mixing storage array
WO2017092480A1 (en) * 2015-12-04 2017-06-08 华为技术有限公司 Data migration method and device
CN107807797A (en) * 2017-11-17 2018-03-16 北京联想超融合科技有限公司 The method, apparatus and server of data write-in
CN107967172A (en) * 2017-12-21 2018-04-27 深圳大学 A kind of Spark tasks dynamic migration method and system towards isomery storage
CN108733326A (en) * 2018-05-25 2018-11-02 郑州云海信息技术有限公司 A kind of disk processing method and processing device
CN109151358A (en) * 2018-09-10 2019-01-04 郑州云海信息技术有限公司 A kind of processing system for video and method
CN109196459A (en) * 2016-05-31 2019-01-11 重庆大学 A kind of distributed heterogeneous memory system data location mode of decentralization
WO2019037093A1 (en) * 2017-08-25 2019-02-28 深圳大学 Spark distributed computing data processing method and system
CN109697027A (en) * 2017-10-23 2019-04-30 三星电子株式会社 Data storage device including shared memory area and dedicated memory area
WO2019119332A1 (en) * 2017-12-21 2019-06-27 深圳大学 Heterogeneous storage-oriented method and system for dynamic migration of spark task
CN110032339A (en) * 2019-04-12 2019-07-19 北京旷视科技有限公司 Data migration method, device, system, equipment and storage medium
CN110187840A (en) * 2019-05-30 2019-08-30 北京奇艺世纪科技有限公司 A kind of data migration method, device, server and storage medium
CN110333825A (en) * 2013-04-26 2019-10-15 株式会社日立制作所 Storage system
CN110703997A (en) * 2019-09-29 2020-01-17 北京浪潮数据技术有限公司 Cloud storage system, data storage method, device, equipment and computer medium
CN111782132A (en) * 2019-04-03 2020-10-16 北京沃东天骏信息技术有限公司 Data reading and writing method, device and storage medium thereof
CN114816232A (en) * 2021-07-27 2022-07-29 云南省地质环境监测院(云南省环境地质研究院) Method and device for efficiently accessing geological disaster big data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101907978A (en) * 2010-07-27 2010-12-08 浙江大学 Mixed storage system and storage method based on solid state disk and magnetic hard disk
CN102117248A (en) * 2011-03-09 2011-07-06 浪潮(北京)电子信息产业有限公司 Caching system and method for caching data in caching system
CN102298506A (en) * 2010-06-24 2011-12-28 国际商业机器公司 Storage system and method for implementing the same
CN102364474A (en) * 2011-11-17 2012-02-29 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method
US20120166749A1 (en) * 2009-09-08 2012-06-28 International Business Machines Corporation Data management in solid-state storage devices and tiered storage systems

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120166749A1 (en) * 2009-09-08 2012-06-28 International Business Machines Corporation Data management in solid-state storage devices and tiered storage systems
CN102298506A (en) * 2010-06-24 2011-12-28 国际商业机器公司 Storage system and method for implementing the same
CN101907978A (en) * 2010-07-27 2010-12-08 浙江大学 Mixed storage system and storage method based on solid state disk and magnetic hard disk
CN102117248A (en) * 2011-03-09 2011-07-06 浪潮(北京)电子信息产业有限公司 Caching system and method for caching data in caching system
CN102364474A (en) * 2011-11-17 2012-02-29 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method

Cited By (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104937574A (en) * 2013-01-22 2015-09-23 国际商业机器公司 Tiered caching and migration in differing granularities
CN104937574B (en) * 2013-01-22 2017-06-16 国际商业机器公司 The method and system of data processing in storage environment is calculated
US9471506B2 (en) 2013-01-22 2016-10-18 International Business Machines Corporation Tiered caching and migration in differing granularities
WO2014114203A1 (en) * 2013-01-22 2014-07-31 International Business Machines Corporation Tiered caching and migration in differing granularities
US9465554B2 (en) 2013-01-22 2016-10-11 International Business Machines Corporation Tiered caching and migration in differing granularities
US9285998B2 (en) 2013-01-22 2016-03-15 International Business Machines Corporation Tiered caching and migration in differing granularities
US9037791B2 (en) 2013-01-22 2015-05-19 International Business Machines Corporation Tiered caching and migration in differing granularities
CN103218173A (en) * 2013-03-27 2013-07-24 华为技术有限公司 Method and device for storage control
CN103218173B (en) * 2013-03-27 2016-03-09 华为技术有限公司 Storage controlling method and device
CN105637470B (en) * 2013-04-25 2020-09-29 微软技术许可有限责任公司 Method and computing device for dirty data management
CN105637470A (en) * 2013-04-25 2016-06-01 微软技术许可有限责任公司 Dirty data management for hybrid drives
US10416932B2 (en) 2013-04-25 2019-09-17 Microsoft Technology Licensing, Llc Dirty data management for hybrid drives
CN110333825A (en) * 2013-04-26 2019-10-15 株式会社日立制作所 Storage system
CN103500072A (en) * 2013-09-27 2014-01-08 华为技术有限公司 Data migration method and data migration device
CN104516678A (en) * 2013-09-29 2015-04-15 国际商业机器公司 Method and device for storing data
CN104516678B (en) * 2013-09-29 2017-09-26 国际商业机器公司 Method and apparatus for data storage
WO2015061965A1 (en) * 2013-10-29 2015-05-07 Hua Zhong University Of Science Technology Mixed cache management
US9785558B2 (en) 2013-10-29 2017-10-10 Hua Zhong University Of Science Technology Mixed cache management
US10671290B2 (en) 2013-11-27 2020-06-02 Alibaba Group Holding Limited Control of storage of data in a hybrid storage system
CN110825324A (en) * 2013-11-27 2020-02-21 阿里巴巴集团控股有限公司 Hybrid storage control method and hybrid storage system
CN110825324B (en) * 2013-11-27 2023-05-30 北京奥星贝斯科技有限公司 Hybrid storage control method and hybrid storage system
CN104679661B (en) * 2013-11-27 2019-12-10 阿里巴巴集团控股有限公司 hybrid storage control method and hybrid storage system
CN104679661A (en) * 2013-11-27 2015-06-03 阿里巴巴集团控股有限公司 Hybrid memory control method and hybrid memory system
CN103744624B (en) * 2014-01-10 2017-09-22 浪潮电子信息产业股份有限公司 A kind of system architecture for realizing the data cached selectivity upgradings of storage system SSD
CN103744624A (en) * 2014-01-10 2014-04-23 浪潮电子信息产业股份有限公司 System architecture for realizing selective upgrade of data cached in SSD (Solid State Disk) of storage system
CN105653524A (en) * 2014-11-10 2016-06-08 阿里巴巴集团控股有限公司 Data storage method, device and system
CN113836084A (en) * 2014-11-10 2021-12-24 创新先进技术有限公司 Data storage method, device and system
WO2017092480A1 (en) * 2015-12-04 2017-06-08 华为技术有限公司 Data migration method and device
CN105892947B (en) * 2016-03-31 2019-01-22 华中科技大学 A kind of SSD and HDD the hybrid cache management method and system of energy conservation storage system
CN105892947A (en) * 2016-03-31 2016-08-24 华中科技大学 SSD and HDD hybrid caching management method and system of energy-saving storage system
CN109196459A (en) * 2016-05-31 2019-01-11 重庆大学 A kind of distributed heterogeneous memory system data location mode of decentralization
CN109196459B (en) * 2016-05-31 2020-12-08 重庆大学 Decentralized distributed heterogeneous storage system data distribution method
CN106484329B (en) * 2016-09-26 2019-01-08 浪潮电子信息产业股份有限公司 Big data transmission integrity protection method based on multi-level storage
CN106484329A (en) * 2016-09-26 2017-03-08 浪潮电子信息产业股份有限公司 Big data transmission integrity protection mechanism based on multi-level storage
CN106775453B (en) * 2016-11-22 2019-07-05 华中科技大学 A kind of construction method mixing storage array
CN106775453A (en) * 2016-11-22 2017-05-31 华中科技大学 A kind of construction method for mixing storage array
WO2019037093A1 (en) * 2017-08-25 2019-02-28 深圳大学 Spark distributed computing data processing method and system
CN109697027A (en) * 2017-10-23 2019-04-30 三星电子株式会社 Data storage device including shared memory area and dedicated memory area
CN109697027B (en) * 2017-10-23 2024-02-02 三星电子株式会社 Data storage device including shared memory region and dedicated memory region
CN107807797A (en) * 2017-11-17 2018-03-16 北京联想超融合科技有限公司 The method, apparatus and server of data write-in
CN107807797B (en) * 2017-11-17 2021-03-23 北京联想超融合科技有限公司 Data writing method and device and server
CN107967172A (en) * 2017-12-21 2018-04-27 深圳大学 A kind of Spark tasks dynamic migration method and system towards isomery storage
CN107967172B (en) * 2017-12-21 2022-01-11 深圳大学 Spark task dynamic migration method and system for heterogeneous storage
WO2019119332A1 (en) * 2017-12-21 2019-06-27 深圳大学 Heterogeneous storage-oriented method and system for dynamic migration of spark task
CN108733326A (en) * 2018-05-25 2018-11-02 郑州云海信息技术有限公司 A kind of disk processing method and processing device
CN109151358A (en) * 2018-09-10 2019-01-04 郑州云海信息技术有限公司 A kind of processing system for video and method
CN111782132A (en) * 2019-04-03 2020-10-16 北京沃东天骏信息技术有限公司 Data reading and writing method, device and storage medium thereof
CN110032339A (en) * 2019-04-12 2019-07-19 北京旷视科技有限公司 Data migration method, device, system, equipment and storage medium
CN110187840A (en) * 2019-05-30 2019-08-30 北京奇艺世纪科技有限公司 A kind of data migration method, device, server and storage medium
CN110703997A (en) * 2019-09-29 2020-01-17 北京浪潮数据技术有限公司 Cloud storage system, data storage method, device, equipment and computer medium
CN114816232A (en) * 2021-07-27 2022-07-29 云南省地质环境监测院(云南省环境地质研究院) Method and device for efficiently accessing geological disaster big data
CN114816232B (en) * 2021-07-27 2022-11-08 云南省地质环境监测院(云南省环境地质研究院) Method and device for efficiently accessing geological disaster big data

Similar Documents

Publication Publication Date Title
CN102831088A (en) Data migration method and device based on mixing memory
CN104090847B (en) Address distribution method of solid-state storage device
CN102298561B (en) A kind of mthods, systems and devices memory device being carried out to multi-channel data process
CN102831087A (en) Data reading-writing processing method and device based on mixing memory
CN102866957B (en) Multi-core multi-thread microprocessor-oriented virtual active page buffer method and device
CN104903864A (en) Selective error correcting code and memory access granularity switching
US20150143045A1 (en) Cache control apparatus and method
CN102843396A (en) Data writing and reading method and device in distributed caching system
CN103345368B (en) Data caching method in buffer storage
CN105243033A (en) Data processing method and electronic device
CN103631624A (en) Method and device for processing read-write request
CN102637147A (en) Storage system using solid state disk as computer write cache and corresponding management scheduling method
US20160154452A1 (en) System and method for controlling the power mode of operation of a memory device
CN106951488A (en) A kind of log recording method and device
KR102201352B1 (en) Hierarchical Register File Device Based on Spin Transfer Torque-Random Access Memory
US20180004409A1 (en) Method and apparatus for managing storage device
CN109213693A (en) Memory management method, storage system and computer program product
CN102779098B (en) The cooperating type adaptive prefetching methods, devices and systems of hybrid cache
CN109375868B (en) Data storage method, scheduling device, system, equipment and storage medium
CN106469119A (en) A kind of data write buffer method based on NVDIMM and its device
CN102123318B (en) IO acceleration method of IPTV application
CN103488582A (en) Method and device for writing cache memory
CN102646071B (en) Device and method for executing cache write hit operation in single cycle
CN104182281A (en) Method for implementing register caches of GPGPU (general purpose graphics processing units)
CN104252423A (en) Consistency processing method and device based on multi-core processor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20121219