CN104933153A - Collaboration-based solid-state drive memory system performance improving method - Google Patents
Collaboration-based solid-state drive memory system performance improving method Download PDFInfo
- Publication number
- CN104933153A CN104933153A CN201510355787.8A CN201510355787A CN104933153A CN 104933153 A CN104933153 A CN 104933153A CN 201510355787 A CN201510355787 A CN 201510355787A CN 104933153 A CN104933153 A CN 104933153A
- Authority
- CN
- China
- Prior art keywords
- block
- solid
- state disk
- module
- piece
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
- G06F12/023—Free address space management
- G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1737—Details of further file system functions for reducing power consumption or coping with limited storage space, e.g. in mobile devices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a collaboration-based solid-state disc memory system performance improving method. The method comprises the following steps: dividing data blocks into a hot data block and a cold data block, collecting garbage recycling information, transferring the garbage recycling information to a solid-state drive at equipment terminal, wherein the solid-state drive is used for receiving the garbage recycling information and executing the garbage recycling operation. The performance of the solid-state drive memory system is improved through the adoption of the collaborative garbage recycling of a host terminal and the equipment terminal.
Description
Technical field
The invention belongs to technical field of computer data storage, more specifically, relate to a kind of solid-state disk performance of storage system raising method based on cooperation.
Background technology
Solid-state disk (Solid State Drive is called for short SSD) is the hard disk made with solid-state electronic storage chip array, and current solid-state disk is mainly based on FLASH chip.Along with the reduction of solid-state disk cost, solid-state disk storage system has been widely used in the fields such as vehicle-mounted, video monitoring, military affairs, the network terminal, electric power, medical treatment.
Nowadays, in the application of solid-state disk, the technology such as polycaryon processor host side use make host side have resource from strength to strength, but, be in the solid-state disk resource but relative deficiency of equipment end, this can cause solid-state disk hydraulic performance decline, can affect the experience effect of user simultaneously.
Summary of the invention
For above defect or the Improvement requirement of prior art, the invention provides a kind of solid-state disk performance of storage system based on cooperation and improve method and system, its object is to, based on dsc data identification, collaboration type garbage reclamation is carried out by host side and equipment end, solve the solid-state disk inadequate resource existed in existing solid-state disk system, thus affect the technical matters of Consumer's Experience effect.
For achieving the above object, according to one aspect of the present invention, provide a kind of solid-state disk performance of storage system raising method based on cooperation, comprise the following steps:
(1) block that in file system selection solid-state disk, invalid page is maximum is as to be recycled piece of Block
collect;
(2) file system judges this to be recycled piece of Block according to dsc data recognition methods
collectwhether be hot block, if it is go to step (3); Otherwise go to step (5);
(3) whether file system is found to have and is met U in all hot block of solid-state disk
free>=U
validhot block, if had, proceed to step (4), otherwise label C lean_To_Block=-1 be set, then proceed to step (7), wherein U
freerepresent the free page utilization factor of this hot block, U
validrepresent to be recycled piece of Block
collectactive page utilization factor;
(4) file system is meeting U
free>=U
validmultiple hot block in find make U
freeminimum hot block, and this hot block searched out is labeled as Block
target, then proceed to step (7);
(5) whether file system is found to have and is met U in all cold piece of solid-state disk
free>=U
validcold piece, if had, proceed to step (6), otherwise label C lean_To_Block=-1 be set, then proceed to step (7);
(6) file system is meeting U
free>=U
validmultiple cold piece in find make U
freeminimum cold piece, and be labeled as Block by this cold piece that searches out
target, then proceed to step (7);
(7) file system is according to the block Block of above-mentioned acquisition
targetand to be recycled piece of Block
collectthe middle position at the valid data page place of reclaiming or the label C lean_To_Block of needing generates GC order, and this GC order is sent to solid-state disk;
(8) solid-state disk judges whether the label C lean_To_Block in this GC order is-1, and if so, then solid-state disk performs the garbage reclamation operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC order
collectin valid data read, and the valid data of reading are moved to block Block
targetin.
Preferably, hot block comprises 15% maximum data block of dsc data page in solid-state disk, and in solid-state disk, remaining piece is cold piece.
Preferably, the form of GC order is Block<Block
collect, Block
collect_ Bitmap, Block
target, Clean_To_Block>, wherein Block
collect_ Bitmap represents to be recycled piece of Block
collectthe middle position needing the valid data page place of reclaiming.
According to another aspect of the present invention, provide a kind of solid-state disk performance of storage system based on cooperation and improve system, comprising:
First module, selects invalid page is maximum in solid-state disk block as to be recycled piece of Block for file system
collect;
Second module, judges this to be recycled piece of Block for file system according to dsc data recognition methods
collectwhether be hot block, if it is go to the 3rd module; Otherwise go to the 5th module;
Whether the 3rd module, find to have for file system and meet U in all hot block of solid-state disk
free>=U
validhot block, if had, proceed to four module, otherwise label C lean_To_Block=-1 be set, then proceed to the 7th module, wherein U
freerepresent the free page utilization factor of this hot block, U
validrepresent to be recycled piece of Block
collectactive page utilization factor;
Four module, is meeting U for file system
free>=U
validmultiple hot block in find make U
freeminimum hot block, and this hot block searched out is labeled as Block
target, then proceed to the 7th module;
Whether the 5th module, find to have for file system and meet U in all cold piece of solid-state disk
free>=U
validcold piece, if had, proceed to the 6th module, otherwise label C lean_To_Block=-1 be set, then proceed to the 7th module;
6th module, is meeting U for file system
free>=U
validmultiple cold piece in find make U
freeminimum cold piece, and be labeled as Block by this cold piece that searches out
target, then proceed to the 7th module.
7th module, for the block Block of file system according to above-mentioned acquisition
targetand to be recycled piece of Block
collectthe middle position at the valid data page place of reclaiming or the label C lean_To_Block of needing generates GC order, and this GC order is sent to solid-state disk;
8th module, whether the label C lean_To_Block judged in this GC order for solid-state disk is-1, and if so, then solid-state disk performs the garbage reclamation operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC order
collectin valid data read, and the valid data of reading are moved to block Block
targetin.
In general, the above technical scheme conceived by the present invention compared with prior art, can obtain following beneficial effect:
1, the invention solves the technical matters of the solid-state disk inadequate resource existed in existing solid-state disk system: owing to have employed step (1), blocks maximum for invalid data is picked out, and adopt step (2), this block is identified as hot block or cold piece, and then adopt step (3) (4) (5) and step (6), find out the block satisfied condition, make this block can hold the valid data of the block that step (1) is selected, the part garbage reclamation function of solid-state disk is put into host side file system to perform, therefore compensate for the relative deficiency of solid-state disk internal resource.
2, invention increases the performance of solid-state disk, and then improve the overall performance of solid-state disk storage system, improve the experience effect of user.
Accompanying drawing explanation
Fig. 1 is the schematic diagram of the solid-state disk performance of storage system raising method that the present invention is based on cooperation.
Fig. 2 is the refinement process flow diagram of the solid-state disk performance of storage system raising method that the present invention is based on cooperation.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.In addition, if below in described each embodiment of the present invention involved technical characteristic do not form conflict each other and just can mutually combine.
As illustrated in fig. 1 and 2, the solid-state disk performance of storage system raising method that the present invention is based on cooperation comprises the following steps:
(1) block that in file system selection solid-state disk, invalid page is maximum as to be recycled piece, and is labeled as Block by this to be recycled piece
collect;
(2) file system judges this to be recycled piece of Block according to dsc data recognition methods (Hot data identification method)
collectwhether be hot block (Hot block), if it is go to step (3); Otherwise go to step (5); Specifically, dsc data recognition methods is a kind of technology distinguished data according to the access frequency of data, in the process of user to data access, some data can be accessed frequently, and some data are seldom accessed, the data be accessed frequently are called dsc data, and seldom accessed data are called cold data, 15% block comprising dsc data page maximum in solid-state disk is called as hot block, and rest block is then called cold piece (Cold block);
(3) whether file system is found to have and is met U in all hot block of solid-state disk
free>=U
validhot block, if had, proceed to step (4), otherwise label C lean_To_Block=-1 be set, then proceed to step (7), wherein U
freerepresent the free page utilization factor of this hot block, it equals not comprise in this hot block the ratio of all page quantity in the page quantity of data and this hot block, U
validrepresent to be recycled piece of Block
collectactive page utilization factor, it equals to comprise in this hot block the ratio of all page quantity in the page quantity of valid data and this hot block;
(4) file system is meeting U
free>=U
validmultiple hot block in find make U
freeminimum hot block, and this hot block searched out is labeled as Block
target, then proceed to step (7);
(5) whether file system is found to have and is met U in all cold piece of solid-state disk
free>=U
validcold piece, if had, proceed to step (6), otherwise label C lean_To_Block=-1 be set, then proceed to step (7);
(6) file system is meeting U
free>=U
validmultiple cold piece in find make U
freeminimum cold piece, and be labeled as Block by this cold piece that searches out
target, then proceed to step (7);
(7) file system is according to the block Block of above-mentioned acquisition
target, and to be recycled piece of Block
collectthe middle position at the valid data page place of reclaiming or the label C lean_To_Block of needing generates garbage reclamation (Garbage collection is called for short GC) order, and this GC order is sent to solid-state disk; Specifically, the form of this GC order is Block<Block
collect, Block
collect_ Bitmap, Block
target, Clean_To_Block>, wherein Block
collect_ Bitmap represents Block
collectthe middle position needing the valid data page place of reclaiming;
(8) solid-state disk judges whether the label C lean_To_Block in this GC order is-1, and if so, then solid-state disk performs garbage reclamation operation (i.e. Self-GC) of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC order
collectin valid data read, and the valid data of reading are moved to block Block
targetin.
According to another aspect of the present invention, provide a kind of solid-state disk performance of storage system based on cooperation and improve system, comprising:
First module, selects invalid page is maximum in solid-state disk block as to be recycled piece of Block for file system
collect;
Second module, judges this to be recycled piece of Block for file system according to dsc data recognition methods
collectwhether be hot block, if it is go to the 3rd module; Otherwise go to the 5th module;
Whether the 3rd module, find to have for file system and meet U in all hot block of solid-state disk
free>=U
validhot block, if had, proceed to four module, otherwise label C lean_To_Block=-1 be set, then proceed to the 7th module, wherein U
freerepresent the free page utilization factor of this hot block, U
validrepresent to be recycled piece of Block
collectactive page utilization factor;
Four module, is meeting U for file system
free>=U
validmultiple hot block in find make U
freeminimum hot block, and this hot block searched out is labeled as Block
target, then proceed to the 7th module;
Whether the 5th module, find to have for file system and meet U in all cold piece of solid-state disk
free>=U
validcold piece, if had, proceed to the 6th module, otherwise label C lean_To_Block=-1 be set, then proceed to the 7th module;
6th module, is meeting U for file system
free>=U
validmultiple cold piece in find make U
freeminimum cold piece, and be labeled as Block by this cold piece that searches out
target, then proceed to the 7th module.
7th module, for the block Block of file system according to above-mentioned acquisition
targetand to be recycled piece of Block
collectthe middle position at the valid data page place of reclaiming or the label C lean_To_Block of needing generates GC order, and this GC order is sent to solid-state disk;
8th module, whether the label C lean_To_Block judged in this GC order for solid-state disk is-1, and if so, then solid-state disk performs the garbage reclamation operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC order
collectin valid data read, and the valid data of reading are moved to block Block
targetin.
Those skilled in the art will readily understand; the foregoing is only preferred embodiment of the present invention; not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.
Claims (4)
1. one kind based on cooperation solid-state disk performance of storage system raising method, it is characterized in that, comprise the following steps:
(1) block that in file system selection solid-state disk, invalid page is maximum is as to be recycled piece of Block
collect;
(2) file system judges this to be recycled piece of Block according to dsc data recognition methods
collectwhether be hot block, if it is go to step (3); Otherwise go to step (5);
(3) whether file system is found to have and is met U in all hot block of solid-state disk
free>=U
validhot block, if had, proceed to step (4), otherwise label C lean_To_Block=-1 be set, then proceed to step (7), wherein U
freerepresent the free page utilization factor of this hot block, U
validrepresent to be recycled piece of Block
collectactive page utilization factor;
(4) file system is meeting U
free>=U
validmultiple hot block in find make U
freeminimum hot block, and this hot block searched out is labeled as Block
target, then proceed to step (7);
(5) whether file system is found to have and is met U in all cold piece of solid-state disk
free>=U
validcold piece, if had, proceed to step (6), otherwise label C lean_To_Block=-1 be set, then proceed to step (7);
(6) file system is meeting U
free>=U
validmultiple cold piece in find make U
freeminimum cold piece, and be labeled as Block by this cold piece that searches out
target, then proceed to step (7);
(7) file system is according to the block Block of above-mentioned acquisition
targetand to be recycled piece of Block
collectthe middle position at the valid data page place of reclaiming or the label C lean_To_Block of needing generates GC order, and this GC order is sent to solid-state disk;
(8) solid-state disk judges whether the label C lean_To_Block in this GC order is-1, and if so, then solid-state disk performs the garbage reclamation operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC order
collectin valid data read, and the valid data of reading are moved to block Block
targetin.
2. solid-state disk performance of storage system raising method according to claim 1, is characterized in that, hot block comprises 15% maximum data block of dsc data page in solid-state disk, and in solid-state disk, remaining piece is cold piece.
3. solid-state disk performance of storage system raising method according to claim 1, is characterized in that, the form of GC order is Block<Block
collect, Block
collect_ Bitmap, Block
target, Clean_To_Block>, wherein Block
collect_ Bitmap represents to be recycled piece of Block
collectthe middle position needing the valid data page place of reclaiming.
4. the solid-state disk performance of storage system based on cooperation improves a system, it is characterized in that, comprising:
First module, selects invalid page is maximum in solid-state disk block as to be recycled piece of Block for file system
collect;
Second module, judges this to be recycled piece of Block for file system according to dsc data recognition methods
collectwhether be hot block, if it is go to the 3rd module; Otherwise go to the 5th module;
Whether the 3rd module, find to have for file system and meet U in all hot block of solid-state disk
free>=U
validhot block, if had, proceed to four module, otherwise label C lean_To_Block=-1 be set, then proceed to the 7th module, wherein U
freerepresent the free page utilization factor of this hot block, U
validrepresent to be recycled piece of Block
collectactive page utilization factor;
Four module, is meeting U for file system
free>=U
validmultiple hot block in find make U
freeminimum hot block, and this hot block searched out is labeled as Block
target, then proceed to the 7th module;
Whether the 5th module, find to have for file system and meet U in all cold piece of solid-state disk
free>=U
validcold piece, if had, proceed to the 6th module, otherwise label C lean_To_Block=-1 be set, then proceed to the 7th module;
6th module, is meeting U for file system
free>=U
validmultiple cold piece in find make U
freeminimum cold piece, and be labeled as Block by this cold piece that searches out
target, then proceed to the 7th module.
7th module, for the block Block of file system according to above-mentioned acquisition
targetand to be recycled piece of Block
collectthe middle position at the valid data page place of reclaiming or the label C lean_To_Block of needing generates GC order, and this GC order is sent to solid-state disk;
8th module, whether the label C lean_To_Block judged in this GC order for solid-state disk is-1, and if so, then solid-state disk performs the garbage reclamation operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC order
collectin valid data read, and the valid data of reading are moved to block Block
targetin.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510355787.8A CN104933153B (en) | 2015-06-24 | 2015-06-24 | A kind of solid-state disk performance of storage system based on cooperation improves method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510355787.8A CN104933153B (en) | 2015-06-24 | 2015-06-24 | A kind of solid-state disk performance of storage system based on cooperation improves method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104933153A true CN104933153A (en) | 2015-09-23 |
| CN104933153B CN104933153B (en) | 2018-04-10 |
Family
ID=54120320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510355787.8A Active CN104933153B (en) | 2015-06-24 | 2015-06-24 | A kind of solid-state disk performance of storage system based on cooperation improves method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104933153B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391774A (en) * | 2017-09-15 | 2017-11-24 | 厦门大学 | The rubbish recovering method of JFS based on data de-duplication |
| CN108563586A (en) * | 2018-04-12 | 2018-09-21 | 华中科技大学 | A kind of method of garbage reclamation data and user data in separation solid-state disk |
| CN109376094A (en) * | 2018-09-27 | 2019-02-22 | 郑州云海信息技术有限公司 | A kind of method of the cold and hot Data Migration of garbage reclamation in storage system |
| CN109388579A (en) * | 2018-09-18 | 2019-02-26 | 深圳市德名利电子有限公司 | A kind of flash memory cold data recognition methods |
| CN112286843A (en) * | 2020-08-12 | 2021-01-29 | 深圳安捷丽新技术有限公司 | System and method for data storage system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902474A (en) * | 2014-04-11 | 2014-07-02 | 华中科技大学 | Mixed storage system and method for supporting solid-state disk cache dynamic distribution |
| US20140289454A1 (en) * | 2013-03-21 | 2014-09-25 | Kabushiki Kaisha Toshiba | Storage device and controller |
-
2015
- 2015-06-24 CN CN201510355787.8A patent/CN104933153B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140289454A1 (en) * | 2013-03-21 | 2014-09-25 | Kabushiki Kaisha Toshiba | Storage device and controller |
| CN103902474A (en) * | 2014-04-11 | 2014-07-02 | 华中科技大学 | Mixed storage system and method for supporting solid-state disk cache dynamic distribution |
Non-Patent Citations (1)
| Title |
|---|
| 黄平: "基于固态盘特征的存储优化研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391774A (en) * | 2017-09-15 | 2017-11-24 | 厦门大学 | The rubbish recovering method of JFS based on data de-duplication |
| CN108563586A (en) * | 2018-04-12 | 2018-09-21 | 华中科技大学 | A kind of method of garbage reclamation data and user data in separation solid-state disk |
| CN108563586B (en) * | 2018-04-12 | 2021-11-02 | 华中科技大学 | Method for separating garbage recovery data and user data in solid-state disk |
| CN109388579A (en) * | 2018-09-18 | 2019-02-26 | 深圳市德名利电子有限公司 | A kind of flash memory cold data recognition methods |
| CN109376094A (en) * | 2018-09-27 | 2019-02-22 | 郑州云海信息技术有限公司 | A kind of method of the cold and hot Data Migration of garbage reclamation in storage system |
| CN112286843A (en) * | 2020-08-12 | 2021-01-29 | 深圳安捷丽新技术有限公司 | System and method for data storage system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104933153B (en) | 2018-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104933153A (en) | Collaboration-based solid-state drive memory system performance improving method | |
| CN102411628B (en) | Android system-based file scanning method and device | |
| CN101763437B (en) | Method and device for realizing high-speed buffer storage | |
| CN105677742A (en) | Method and apparatus for storing files | |
| CN104298736A (en) | Method and device for aggregating and connecting data as well as database system | |
| CN107247722B (en) | File scanning method and device and intelligent terminal | |
| CN103473343A (en) | File management method, device and terminal | |
| CN114721972B (en) | Garbage recycling method and device, readable storage medium and electronic equipment | |
| CN103218416A (en) | Method, device and system for loading database | |
| CN103744896A (en) | Method and device for data processing | |
| CN104572681B (en) | A kind of smartcard file management system and its management method based on registration table | |
| CN103119567B (en) | For the system and method in managing virtual tape pool territory | |
| CN106067889B (en) | Electronic device and its method for uploading | |
| CN110007860A (en) | Method, solid state hard disk and the storage device of garbage disposal based on LSM database | |
| CN107301203B (en) | Mass data comparison method and system | |
| CN103092955B (en) | Checkpointed method, Apparatus and system | |
| CN109086001B (en) | NAND Flash garbage recovery method and system | |
| CN106528004A (en) | Method for improving DRAM less SSD trash recycling efficiency, Block, and trash recycling system | |
| WO2019127926A1 (en) | Calculation method and calculation device for sparse neural network, electronic device, computer readable storage medium, and computer program product | |
| CN101430755A (en) | Label recognition anti-collision processing method in radio frequency recognition technology | |
| CN103927399A (en) | Information push method and device | |
| CN103559106A (en) | Data backup method, device and system | |
| CN103310401A (en) | Image coarsening circuit and method for coarsening image | |
| CN112364017A (en) | Method for filtering black and white lists by utilizing bloom filter | |
| CN203414999U (en) | Fax-based clinical test data acquisition system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |