CN104933153B - A kind of solid-state disk performance of storage system based on cooperation improves method - Google Patents

A kind of solid-state disk performance of storage system based on cooperation improves method Download PDF

Info

Publication number
CN104933153B
CN104933153B CN201510355787.8A CN201510355787A CN104933153B CN 104933153 B CN104933153 B CN 104933153B CN 201510355787 A CN201510355787 A CN 201510355787A CN 104933153 B CN104933153 B CN 104933153B
Authority
CN
China
Prior art keywords
block
solid
state disk
module
free
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510355787.8A
Other languages
Chinese (zh)
Other versions
CN104933153A (en
Inventor
曾令仿
刘文国
冯丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huazhong University of Science and Technology
Original Assignee
Huazhong University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huazhong University of Science and Technology filed Critical Huazhong University of Science and Technology
Priority to CN201510355787.8A priority Critical patent/CN104933153B/en
Publication of CN104933153A publication Critical patent/CN104933153A/en
Application granted granted Critical
Publication of CN104933153B publication Critical patent/CN104933153B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/1737—Details of further file system functions for reducing power consumption or coping with limited storage space, e.g. in mobile devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of solid-state disk performance of storage system based on cooperation to improve method, including：Data block is divided into hot data block and cold data block, collects garbage reclamation information, by the solid-state disk of garbage reclamation information transmission to equipment end, solid-state disk receives garbage reclamation information and performs garbage collection operation.The present invention improves the performance of solid-state disc storaging system using the collaborative garbage reclamation of host side and equipment end.

Description

A kind of solid-state disk performance of storage system based on cooperation improves method
Technical field
The invention belongs to technical field of computer data storage, is taken inventory more particularly, to a kind of solid-state based on cooperation Storage system performance improves method.
Background technology
Solid-state disk (Solid State Drive, abbreviation SSD) is with solid-state electronic storage chip array and manufactured hard Disk, current solid-state disk are mainly based upon FLASH chip.With the reduction of solid-state disk cost, solid-state disc storaging system is wide It is general to be applied to the fields such as vehicle-mounted, video monitoring, military affairs, the network terminal, electric power, medical treatment.
Nowadays, in the application of solid-state disk, the technology such as polycaryon processor is used so that host side possesses host side Stronger and stronger resource, however, the but relative deficiency of the solid-state disk resource in equipment end, this can be caused under solid-state disk performance Drop, while the experience effect of user can be influenceed.
The content of the invention
For the disadvantages described above or Improvement requirement of prior art, the invention provides a kind of solid-state disk storage based on cooperation Systematic function improves method and system, it is intended that being identified based on dsc data, is carried out by host side and equipment end collaborative Garbage reclamation, solves solid-state disk inadequate resource present in existing solid-state disc system, so as to influence the technology of Consumer's Experience effect Problem.
To achieve the above object, according to one aspect of the present invention, there is provided a kind of solid-state disk storage system based on cooperation Performance of uniting improves method, comprises the following steps：
(1) in file system selection solid-state disk the most block of invalid page as to be recycled piece of Blockcollect；
(2) file system judges the to be recycled piece of Block according to dsc data recognition methodscollectWhether it is hot block, if It is to go to step (3)；Otherwise step (5) is gone to；
(3) file system looks for whether there are in all hot blocks of solid-state disk meets Ufree>=UvalidHot block, such as Fruit has, and is transferred to step (4), otherwise sets label C lean_To_Block=-1, is then transferred to step (7), wherein UfreeRepresent The free page utilization rate of the hot block, UvalidRepresent to be recycled piece of BlockcollectActive page utilization rate；
(4) file system is meeting Ufree>=UvalidMultiple hot blocks in find make UfreeMinimum hot block, and will find The hot block arrived is labeled as Blocktarget, then it is transferred to step (7)；
(5) file system looks for whether there are in all cold pieces of solid-state disk meets Ufree>=UvalidCold piece, such as Fruit has, and is transferred to step (6), otherwise sets label C lean_To_Block=-1, is then transferred to step (7)；
(6) file system is meeting Ufree>=UvalidMultiple cold pieces in find make UfreeMinimum cold piece, and will find This cold piece arrived is labeled as Blocktarget, then it is transferred to step (7)；
(7) file system is according to the block Block of above-mentioned acquisitiontargetAnd to be recycled piece of BlockcollectIn need to reclaim The valid data page where position or label C lean_To_Block generation GC orders, and by the GC orders be sent to consolidate State disk；
(8) solid-state disk judges whether the label C lean_To_Block in the GC orders is -1, if it is, solid-state disk is held Row acquiescence garbage collection operation, then process terminate, otherwise by be recycled piece of Block in GC orderscollectIn significant figure Block Block is moved to according to reading, and by the valid data of readingtargetIn.
Preferably, hot block is that 15% most data block of dsc data page is included in solid-state disk, remaining piece in solid-state disk For cold piece.
Preferably, the form of GC orders is Block<Blockcollect,Blockcollect_Bitmap,Blocktarget, Clean_To_Block>, wherein Blockcollect_ Bitmap represents to be recycled piece of BlockcollectThe middle significant figure for needing to reclaim According to the position where the page.
It is another aspect of this invention to provide that providing a kind of solid-state disk performance of storage system based on cooperation improves system, Including：
First module, the block most for invalid page in file system selection solid-state disk is as to be recycled piece Blockcollect；
Second module, the to be recycled piece of Block is judged according to dsc data recognition methods for file systemcollectWhether be Hot block, if it is go to the 3rd module；Otherwise the 5th module is gone to；
3rd module, looks for whether there are and meets U for file system in all hot blocks of solid-state diskfree>= UvalidHot block, if being then transferred to the 4th module, otherwise set label C lean_To_Block=-1, be then transferred to the 7th mould Block, wherein UfreeRepresent the free page utilization rate of the hot block, UvalidRepresent to be recycled piece of BlockcollectActive page utilization rate；
4th module, meeting U for file systemfree>=UvalidMultiple hot blocks in find make UfreeMinimum heat Block, and the hot block searched out is labeled as Blocktarget, then it is transferred to the 7th module；
5th module, looks for whether there are and meets U for file system in all cold pieces of solid-state diskfree>= UvalidCold piece, if being then transferred to the 6th module, otherwise set label C lean_To_Block=-1, be then transferred to the 7th mould Block；
6th module, meeting U for file systemfree>=UvalidMultiple cold pieces in find make UfreeMinimum is cold Block, and it is labeled as Block by this cold piece searched outtarget, then it is transferred to the 7th module.
7th module, the block Block for file system according to above-mentioned acquisitiontargetAnd to be recycled piece of Blockcollect Position or label C lean_To_Block generation GC orders where the middle valid data page for needing to reclaim, and the GC is ordered Order is sent to solid-state disk；
8th module, judge whether the label C lean_To_Block in the GC orders is -1 for solid-state disk, if it is, Then solid-state disk performs the garbage collection operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC orderscollect In valid data read, and the valid data of reading are moved into block BlocktargetIn.
In general, by the contemplated above technical scheme of the present invention compared with prior art, it can obtain down and show Beneficial effect：
1st, the present invention solves the technical problem of solid-state disk inadequate resource present in existing solid-state disc system：Due to using Step (1), the most block of invalid data is picked out, and using step (2), the block is identified as into hot block or cold piece, entered And step (3) (4) (5) and step (6) are used, the block of the condition of satisfaction is searched out, the block is accommodated what step (1) was selected The valid data of block, the part garbage reclamation function of solid-state disk is put into host side file system to perform, therefore compensate for solid The relative deficiency of state disk internal resource.
2nd, the present invention improves the performance of solid-state disk, and then improves the overall performance of solid-state disc storaging system, improves The experience effect of user.
Brief description of the drawings
Fig. 1 is the schematic diagram that solid-state disk performance of storage system of the present invention based on cooperation improves method.
Fig. 2 is the refined flow chart that solid-state disk performance of storage system of the present invention based on cooperation improves method.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and It is not used in the restriction present invention.As long as in addition, technical characteristic involved in each embodiment of invention described below Conflict can is not formed each other to be mutually combined.
As illustrated in fig. 1 and 2, solid-state disk performance of storage system of the present invention based on cooperation improves method and comprised the following steps：
(1) the most block of invalid page is marked as to be recycled piece, and by this to be recycled piece in file system selection solid-state disk It is designated as Blockcollect；
(2) file system judges that this is treated according to dsc data recognition methods (Hot data identification method) Reclaim block BlockcollectWhether it is hot block (Hot block), if it is goes to step (3)；Otherwise step (5) is gone to；Tool For body, dsc data recognition methods is a kind of technology to be made a distinction to data according to the access frequency of data, in user couple During data access, some data can be accessed frequently, and some data are seldom accessed, and the data being accessed frequently claim For dsc data, and seldom accessed data are referred to as cold data, and 15% block quilt that dsc data page is most is included in solid-state disk Referred to as hot block, rest block are then referred to as cold piece (Cold block)；
(3) file system looks for whether there are in all hot blocks of solid-state disk meets Ufree>=UvalidHot block, such as Fruit has, and is transferred to step (4), otherwise sets label C lean_To_Block=-1, is then transferred to step (7), wherein UfreeRepresent The free page utilization rate of the hot block, it is equal to the page quantity for not including data in the hot block and all page quantities in the hot block Ratio, UvalidRepresent to be recycled piece of BlockcollectActive page utilization rate, it is equal in the hot block comprising valid data The ratio of page quantity and all page quantities in the hot block；
(4) file system is meeting Ufree>=UvalidMultiple hot blocks in find make UfreeMinimum hot block, and will find The hot block arrived is labeled as Blocktarget, then it is transferred to step (7)；
(5) file system looks for whether there are in all cold pieces of solid-state disk meets Ufree>=UvalidCold piece, such as Fruit has, and is transferred to step (6), otherwise sets label C lean_To_Block=-1, is then transferred to step (7)；
(6) file system is meeting Ufree>=UvalidMultiple cold pieces in find make UfreeMinimum cold piece, and will find This cold piece arrived is labeled as Blocktarget, then it is transferred to step (7)；
(7) file system is according to the block Block of above-mentioned acquisitiontargetAnd to be recycled piece of BlockcollectIn need to reclaim The valid data page where position or label C lean_To_Block generation garbage reclamation (Garbage collection, Abbreviation GC) order, and the GC orders are sent to solid-state disk；Specifically, the form of the GC orders is Block< Blockcollect,Blockcollect_Bitmap,Blocktarget,Clean_To_Block>, wherein Blockcollect_ Bitmap generations Table BlockcollectPosition where the middle valid data page for needing to reclaim；
(8) solid-state disk judges whether the label C lean_To_Block in the GC orders is -1, if it is, solid-state disk is held The garbage collection operation (i.e. Self-GC) of row acquiescence, then process terminates, otherwise by be recycled piece of Block in GC orderscollect In valid data read, and the valid data of reading are moved into block BlocktargetIn.
It is another aspect of this invention to provide that providing a kind of solid-state disk performance of storage system based on cooperation improves system, Including：
First module, the block most for invalid page in file system selection solid-state disk is as to be recycled piece Blockcollect；
Second module, the to be recycled piece of Block is judged according to dsc data recognition methods for file systemcollectWhether be Hot block, if it is go to the 3rd module；Otherwise the 5th module is gone to；
3rd module, looks for whether there are and meets U for file system in all hot blocks of solid-state diskfree>= UvalidHot block, if being then transferred to the 4th module, otherwise set label C lean_To_Block=-1, be then transferred to the 7th mould Block, wherein UfreeRepresent the free page utilization rate of the hot block, UvalidRepresent to be recycled piece of BlockcollectActive page utilization rate；
4th module, meeting U for file systemfree>=UvalidMultiple hot blocks in find make UfreeMinimum heat Block, and the hot block searched out is labeled as Blocktarget, then it is transferred to the 7th module；
5th module, looks for whether there are and meets U for file system in all cold pieces of solid-state diskfree>= UvalidCold piece, if being then transferred to the 6th module, otherwise set label C lean_To_Block=-1, be then transferred to the 7th mould Block；
6th module, meeting U for file systemfree>=UvalidMultiple cold pieces in find make UfreeMinimum is cold Block, and it is labeled as Block by this cold piece searched outtarget, then it is transferred to the 7th module.
7th module, the block Block for file system according to above-mentioned acquisitiontargetAnd to be recycled piece of Blockcollect Position or label C lean_To_Block generation GC orders where the middle valid data page for needing to reclaim, and the GC is ordered Order is sent to solid-state disk；
8th module, judge whether the label C lean_To_Block in the GC orders is -1 for solid-state disk, if it is, Then solid-state disk performs the garbage collection operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC orderscollect In valid data read, and the valid data of reading are moved into block BlocktargetIn.
As it will be easily appreciated by one skilled in the art that the foregoing is merely illustrative of the preferred embodiments of the present invention, not to The limitation present invention, all any modification, equivalent and improvement made within the spirit and principles of the invention etc., all should be included Within protection scope of the present invention.

Claims (4)

1. a kind of solid-state disk performance of storage system based on cooperation improves method, it is characterised in that comprises the following steps：
(1) in file system selection solid-state disk the most block of invalid page as to be recycled piece of Blockcollect；
(2) file system judges the to be recycled piece of Block according to dsc data recognition methodscollectWhether it is hot block, if it is turns To step (3)；Otherwise step (5) is gone to；
(3) file system looks for whether there are in all hot blocks of solid-state disk meets Ufree>=UvalidHot block, if Step (4) is then transferred to, otherwise label C lean_To_Block=-1 is set, be then transferred to step (7), wherein UfreeRepresent the heat The free page utilization rate of block, UvalidRepresent to be recycled piece of BlockcollectActive page utilization rate；
(4) file system is meeting Ufree>=UvalidMultiple hot blocks in find make UfreeMinimum hot block, and will search out The hot block is labeled as Blocktarget, then it is transferred to step (7)；
(5) file system looks for whether there are in all cold pieces of solid-state disk meets Ufree>=UvalidCold piece, if Step (6) is then transferred to, otherwise label C lean_To_Block=-1 is set, be then transferred to step (7)；
(6) file system is meeting Ufree>=UvalidMultiple cold pieces in find make UfreeMinimum cold piece, and will search out This cold piece is labeled as Blocktarget, then it is transferred to step (7)；
(7) file system is according to the block Block of acquisitiontargetAnd to be recycled piece of BlockcollectThe middle valid data for needing to reclaim Position or label C lean_To_Block generation GC orders where the page, and the GC orders are sent to solid-state disk；
(8) solid-state disk judges whether the label C lean_To_Block in the GC orders is -1, is write from memory if it is, solid-state disk performs The garbage collection operation recognized, then process terminate, otherwise by be recycled piece of Block in GC orderscollectIn valid data read Go out, and the valid data of reading are moved into block BlocktargetIn.
2. solid-state disk performance of storage system according to claim 1 improves method, it is characterised in that hot block is in solid-state disk Comprising 15% most data block of dsc data page, remaining piece is cold piece in solid-state disk.
3. solid-state disk performance of storage system according to claim 1 improves method, it is characterised in that the form of GC orders is Block<Blockcollect,Blockcollect_Bitmap,Blocktarget,Clean_To_Block>, wherein Blockcollect_ Bitmap represents to be recycled piece of BlockcollectPosition where the middle valid data page for needing to reclaim.
4. a kind of solid-state disk performance of storage system based on cooperation improves system, it is characterised in that including：
First module, the block most for invalid page in file system selection solid-state disk is as to be recycled piece of Blockcollect；
Second module, the to be recycled piece of Block is judged according to dsc data recognition methods for file systemcollectWhether it is hot block, If it is the 3rd module is gone to；Otherwise the 5th module is gone to；
3rd module, looks for whether there are and meets U for file system in all hot blocks of solid-state diskfree>=Uvalid's Hot block, if being then transferred to the 4th module, otherwise label C lean_To_Block=-1 is set, be then transferred to the 7th module, its Middle UfreeRepresent the free page utilization rate of the hot block, UvalidRepresent to be recycled piece of BlockcollectActive page utilization rate；
4th module, meeting U for file systemfree>=UvalidMultiple hot blocks in find make UfreeMinimum hot block, and The hot block searched out is labeled as Blocktarget, then it is transferred to the 7th module；
5th module, looks for whether there are and meets U for file system in all cold pieces of solid-state diskfree>=Uvalid's Cold piece, if being then transferred to the 6th module, otherwise label C lean_To_Block=-1 is set, be then transferred to the 7th module；
6th module, meeting U for file systemfree>=UvalidMultiple cold pieces in find make UfreeMinimum cold piece, and Block is labeled as by this cold piece searched outtarget, then it is transferred to the 7th module；
7th module, the block Block for file system according to acquisitiontargetAnd to be recycled piece of BlockcollectIn need to reclaim The valid data page where position or label C lean_To_Block generation GC orders, and by the GC orders be sent to consolidate State disk；
8th module, judge whether the label C lean_To_Block in the GC orders is -1 for solid-state disk, if it is, solid State disk performs the garbage collection operation of acquiescence, and then process terminates, otherwise by be recycled piece of Block in GC orderscollectIn Valid data are read, and the valid data of reading are moved into block BlocktargetIn.
CN201510355787.8A 2015-06-24 2015-06-24 A kind of solid-state disk performance of storage system based on cooperation improves method Active CN104933153B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510355787.8A CN104933153B (en) 2015-06-24 2015-06-24 A kind of solid-state disk performance of storage system based on cooperation improves method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510355787.8A CN104933153B (en) 2015-06-24 2015-06-24 A kind of solid-state disk performance of storage system based on cooperation improves method

Publications (2)

Publication Number Publication Date
CN104933153A CN104933153A (en) 2015-09-23
CN104933153B true CN104933153B (en) 2018-04-10

Family

ID=54120320

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510355787.8A Active CN104933153B (en) 2015-06-24 2015-06-24 A kind of solid-state disk performance of storage system based on cooperation improves method

Country Status (1)

Country Link
CN (1) CN104933153B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391774B (en) * 2017-09-15 2019-11-19 厦门大学 The rubbish recovering method of log file system based on data de-duplication
CN108563586B (en) * 2018-04-12 2021-11-02 华中科技大学 Method for separating garbage recovery data and user data in solid-state disk
CN109388579A (en) * 2018-09-18 2019-02-26 深圳市德名利电子有限公司 A kind of flash memory cold data recognition methods
CN109376094A (en) * 2018-09-27 2019-02-22 郑州云海信息技术有限公司 A kind of method of the cold and hot Data Migration of garbage reclamation in storage system
CN112286843B (en) * 2020-08-12 2022-04-08 深圳安捷丽新技术有限公司 System and method for data storage system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902474A (en) * 2014-04-11 2014-07-02 华中科技大学 Mixed storage system and method for supporting solid-state disk cache dynamic distribution

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140289454A1 (en) * 2013-03-21 2014-09-25 Kabushiki Kaisha Toshiba Storage device and controller

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902474A (en) * 2014-04-11 2014-07-02 华中科技大学 Mixed storage system and method for supporting solid-state disk cache dynamic distribution

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于固态盘特征的存储优化研究;黄平;《中国博士学位论文全文数据库 信息科技辑》;20140215;全文 *

Also Published As

Publication number Publication date
CN104933153A (en) 2015-09-23

Similar Documents

Publication Publication Date Title
CN104933153B (en) A kind of solid-state disk performance of storage system based on cooperation improves method
CN109189991B (en) Duplicate video identification method, device, terminal and computer readable storage medium
US7853770B2 (en) Storage system, data relocation method thereof, and recording medium that records data relocation program
CN104216884B (en) Collaborative filtering system and method based on time attenuation
CN104408163B (en) A kind of data classification storage and device
CN103428069A (en) Method and device for adding friends in social network
CN104298736A (en) Method and device for aggregating and connecting data as well as database system
CN102148870A (en) Cloud storage system and implementation method thereof
CN104778271A (en) Video data caching method and device
CN101515286B (en) Image matching method based on image feature multi-level filtration
CN103810300B (en) The data query method and apparatus covered for non-index
CN104572681B (en) A kind of smartcard file management system and its management method based on registration table
CN104166736A (en) Storage method and device of reverse index files
CN110502607A (en) A kind of electronic medical record system, the method and server for inquiring electronic health record
CN113553306A (en) Data processing method and data storage management system
CN103902693B (en) A kind of method of the memory database T tree index structures for reading optimization
CN106257451A (en) The method and device of website visiting
CN105426131A (en) KV (Key Value) storage implementation method and device
CN104469518B (en) The access method and electronic equipment of audio-video document
CN105282206A (en) Method, device and system for processing website resource files
WO2013011728A1 (en) Communication assistance device, communication assistance method, and computer-readable recording medium
CN112364017A (en) Method for filtering black and white lists by utilizing bloom filter
CN107209761A (en) A kind of data access method, apparatus and system
CN106288581A (en) The preextraction method and system of sample in medical treatment refrigerator system
CN104484687A (en) Unit and method for reader information statistics of radio frequency recognition system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant