CN102981969A - Method for deleting repeated data and solid hard disc thereof - Google Patents

Method for deleting repeated data and solid hard disc thereof Download PDF

Info

Publication number
CN102981969A
CN102981969A CN2012104751570A CN201210475157A CN102981969A CN 102981969 A CN102981969 A CN 102981969A CN 2012104751570 A CN2012104751570 A CN 2012104751570A CN 201210475157 A CN201210475157 A CN 201210475157A CN 102981969 A CN102981969 A CN 102981969A
Authority
CN
China
Prior art keywords
data
written
error correction
correction code
code value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012104751570A
Other languages
Chinese (zh)
Inventor
王志波
夏君扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ramaxel Technology Shenzhen Co Ltd
Original Assignee
Ramaxel Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ramaxel Technology Shenzhen Co Ltd filed Critical Ramaxel Technology Shenzhen Co Ltd
Priority to CN2012104751570A priority Critical patent/CN102981969A/en
Publication of CN102981969A publication Critical patent/CN102981969A/en
Priority to PCT/CN2013/074921 priority patent/WO2014079201A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1008Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608Saving storage space on storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/064Management of blocks
    • G06F3/0641De-duplication techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/0679Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention is applicable to the technical field of storagte and provides a method for deleting repeated data and a solid hard disc thereof. The method comprises the following steps of: when data is written, calculating a first error correction code value of the data; and according to the first error correction code value, controlling the writing of the data. Therefore, the invention has the advantages that the repeated data is prevented from being rewritten into the solid hard disc.

Description

The method of data de-duplication and solid state hard disc thereof
Technical field
The present invention relates to technical field of memory, relate in particular to a kind of method and solid state hard disc thereof of data de-duplication.
Background technology
Solid state hard disc (Solid State Disk, SSD) be a kind of memory device of new generation that is based upon on the non-volatile storage medium bases such as standard NAND Flash, complete semiconductor transformation, the machinery-free structure, have low-power consumption, noiselessness, anti-vibration, the characteristics such as low in calories, do not have the disk seek time, data access speed is fast, and data throughout energy and IOPS can reach thousands of times of conventional hard.NAND Flash storer is made of Block (piece), the elementary cell of block is Page (page or leaf), and the memory block of each Page comprises again Data area (data storage area) and Spare area (spare area) is used for storing the information such as ECC.Different vendor, the Page of the Nand Flash of different size, the size of Block and Spare area may be had any different.As shown in Figure 1, take a Nand Flash of Micron Technology as example, the size of a Page is 8KB, and the size of Spare area is 448B, and a Block comprises 256 Page.The read-write of data is take page as unit, and wiping is as unit take block.
Along with NAND Flash process technique improves constantly and the reduction of cost, effectively reduced the cost of SSD, advance the application popularization of SSD.But NAND Flash has a critical defect, programming and erasing times are limited, and data are made mistakes easily, nearly all SSD controller producer, all pass through Wear-Leveling, Chinese " balance abrasion " technology makes each storage unit programming and the erasing times of SSD average as far as possible, to reach the order ground of scrapping simultaneously.Add that ECC (Error correction code, error correcting code) improves the reliability of product.The operation of Flash when data writing, is calculated the ECC value of this page take page or leaf as unit, and ECC is written to the spare area of this page.
Data de-duplication is a kind of logical deleting duplicated data, only keeps a copy of it, thereby eliminates redundant data.This technology can reduce the demand to amount of physical memory to a great extent, for Flash, can reduce write operation, improves the Flash bulk life time.
In summary, existing, in actual use, obviously there are inconvenience and defective, so be necessary to be improved.
Summary of the invention
For above-mentioned defective, the object of the present invention is to provide a kind of method and solid state hard disc thereof of data de-duplication, again be written to solid state hard disc with the data that prevent repetition.
To achieve these goals, the invention provides a kind of method of data de-duplication, described method comprises the steps:
When data writing, calculate the first error correction code value of described data;
According to the first error correction code value of described data, control writing of described data.
According to the method for described data de-duplication, described the first error correction code value according to described data, the step that writes of controlling described data comprises:
Search whether the second error correction code value identical with described the first error correction code value is arranged in the second error correction code value of written data;
When finding the second error correction code value identical with described the first error correction code value, read in described data to be written, carry out the identical judgement of data;
When not finding the second error correction code value identical with described the first error correction code value, write described described data to be written.
According to the method for described data de-duplication, described step of carrying out the identical judgement of data comprises:
Described data to be written and the described data that write are compared;
When described data to be written are not identical with the described data that write, write described data to be written;
When described data to be written are identical with the described data that write, delete described data to be written.
According to the method for described data de-duplication, the step of the described data that said write is to be written comprises:
Described the first error correction code value is write the Hash bucket;
Described data to be written are write storage medium.
According to the method for described data de-duplication, in described step of reading in described data to be written, read in the data under mapping address corresponding to described the first error correction code value;
In the step of described deletion described data to be written, after deleting described data to be written, upgrade the mapping address table.
In order to realize another goal of the invention of the present invention, the present invention also provides a kind of solid state hard disc, comprising:
Computing module is used for calculating the first error correction code value of described data when data writing;
Control module is used for the first error correction code value according to described data, controls writing of described data.
According to described solid state hard disc, described control module comprises:
Search submodule, whether the second error correction code value that is used for searching at written data has the second error correction code value identical with described the first error correction code value;
The first control submodule is used for reading in described data to be written when finding the second error correction code value identical with described the first error correction code value, carries out the identical judgement of data;
The second control submodule is used for writing described described data to be written when not finding the second error correction code value identical with described the first error correction code value.
According to described solid state hard disc, described the first control submodule comprises:
Comparing unit is used for described data to be written and the described data that write are compared;
The first writing unit is used for writing described data to be written when described comparing unit described data more to be written are not identical with the described data that write;
Delete cells is used for deleting described data to be written when described comparing unit described data more to be written are identical with the described data that write.
According to described solid state hard disc, described the second control submodule comprises:
The second writing unit is used for described the first error correction code value is write the Hash bucket;
The 3rd writing unit is used for described data to be written are write described solid state hard disc.
According to described solid state hard disc, described first control submodule described read in described data to be written the time, read in the data under mapping address corresponding to described the first error correction code value;
Described the first control submodule upgrades the mapping address table after deletion described data to be written when described deletion described data to be written.
The present invention is by during to the solid state hard disc data writing, judging tentatively according to the ECC proof test value of every page whether data are identical in host side, if the identical possibility of the identical explanation data of ECC value is very large, further the data of corresponding address being read back compares.If identical, then write operation directly returns main frame, and upgrades mapping table.Reduce the write operation of repeating data to Flash, saved the Flash storage space, can effectively prolong the bulk life time of Nand Flash.Saved the storage space of Flash.Reduce data repeat write.
Description of drawings
Fig. 1 is the structural representation of the NAND Flash that provides of prior art;
Fig. 2 is the structural representation of the solid state hard disc that provides of first embodiment of the invention;
Fig. 3 be the present invention second and third, the structural representation of the solid state hard disc that provides of four embodiment;
Fig. 4 is the method flow diagram of the data de-duplication that provides of fifth embodiment of the invention;
Fig. 5 is the method flow diagram of the data de-duplication that provides of one embodiment of the invention.
Embodiment
In order to make purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, is not intended to limit the present invention.
Referring to Fig. 2, a kind of solid state hard disc 100 is provided in the first embodiment of the present invention, comprising:
Computing module 10 is used for calculating the first error correction code value of described data when data writing;
Control module 20 is used for the first error correction code value according to described data, controls writing of described data.
A kind of solid state hard disc 100 that belongs to data de-duplication among the Nand Flash is provided in this embodiment.Before writing data to solid state hard disc 100, at first calculate the first error correction code value corresponding to described data among this embodiment, judge tentatively according to the ECC proof test value of the Nand Flash that calculates whether data are identical again.And further control writing of data according to judged result.The data of repetition can't be written in the solid state hard disc 100, promote the life-span of solid state hard disc 100.Solved that Flash need carry out first erase operation in the prior art before data writing, in high density Flash equipment, erasing times is about 5000 times.Surpass this value flash with the not long limitation of term of life that lost efficacy.
Referring to Fig. 3, in the second embodiment of the present invention, provide, control module 20 comprises:
Search submodule 21, whether the second error correction code value that is used for searching at written data has the second error correction code value identical with described the first error correction code value;
The first control submodule 22 is used for reading in described data to be written when finding the second error correction code value identical with described the first error correction code value, carries out the identical judgement of data;
The second control submodule 23 is used for writing described described data to be written when not finding the second error correction code value identical with described the first error correction code value.
In this embodiment, search submodule 21 and search whether the second error correction code value identical with described the first error correction code value is arranged in corresponding the second error correction code value of the data that write solid state hard disc 100.If the ECC value is different, then data are certainly different.Then the second control submodule 23 is written to solid state hard disc 100 with these data.If when finding the second error correction code value identical with described the first error correction code value, then the first control submodule 22 reads in described data to be written, carries out the whether identical judgement of next step concrete data; The method can reduce the write operation of repeating data, and the bulk life time of Nand Flash is got a promotion.
Referring to Fig. 3, in the third embodiment of the present invention, provide, the first control submodule 22 comprises:
Comparing unit 221 is used for described data to be written and the described data that write are compared;
The first writing unit 222 is used for writing described data to be written when described comparing unit described data more to be written are not identical with the described data that write;
Delete cells 223 is used for deleting described data to be written when described comparing unit described data more to be written are identical with the described data that write.
Both not identical then first writing units 222 in this embodiment, compare by identical data to be written and the written data of 221 pairs of ECC values of comparing unit, if will write described data to be written; Both identical then delete cells 223 deletions described data to be written.Avoided in solid state hard disc 100, repeatedly writing identical data, promoted the life-span of solid state hard disc 100.
Referring to Fig. 3, in the fourth embodiment of the present invention, provide, the second control submodule 23 comprises:
The second writing unit 231 is used for described the first error correction code value is write the Hash bucket;
The 3rd writing unit 233 is used for described data to be written are write described solid state hard disc.
In one embodiment of the invention, first control submodule 22 described read in described data to be written the time, read in the data under mapping address corresponding to described the first error correction code value;
The first control submodule 22 upgrades the mapping address table after deletion described data to be written when described deletion described data to be written.
In this embodiment, by the second writing unit 231 new described the first error correction code value is write in the Hash bucket; The 3rd writing unit 233 writes new described data to be written in the described solid state hard disc 100 simultaneously.Generally be that the data that will write are used the hash function of encrypting at traditional data de-duplication, calculate collisionless cryptographic hash as fingerprint, come specified data whether identical by fingerprint relatively.Because the method need to be encrypted calculating to data, brings white elephant to main frame.And in this embodiment, need to carry out the characteristics that the ECC verification is calculated when utilizing solid state hard disc 100 data writing, judge tentatively by the ECC value that compares data writing whether data are consistent.If the ECC value is consistent, then the controller of solid state hard disc 100 reads back the data of corresponding address, further judges.Compare with traditional aspect, the method has reduced the burden of Framework computing data fingerprint.
In above-mentioned a plurality of embodiment, a plurality of modules of solid state hard disc 100 can be software units, hardware cell or software and hardware combining unit.
Referring to Fig. 4, in the fifth embodiment of the present invention, provide a kind of method of data de-duplication, described method comprises the steps:
Among the step S401, when data writing, calculate the first error correction code value of described data; This step is realized by computing module 10;
Among the step S402, according to the first error correction code value of described data, control writing of described data; This step is realized by control module 20.
In this embodiment, before data are write solid state hard disc 100, will calculate the error correction code value of described data to be written, and judge according to this error correction code value whether identical data are arranged in the solid state hard disc 100, and then control writing of repeating data.
In one embodiment of the invention, described step S402 comprises:
Search whether the second error correction code value identical with described the first error correction code value is arranged in the second error correction code value of written data; This step realizes by searching submodule 21;
When finding the second error correction code value identical with described the first error correction code value, read in described data to be written, carry out the identical judgement of data; This step is realized by the first control submodule 22;
When not finding the second error correction code value identical with described the first error correction code value, write described described data to be written; This step is realized by the second control submodule 23.
In this embodiment, by in the second error correction code value of written data, searching the second error correction code value identical with described the first error correction code value, if do not find, then show the data that these data to be written are not repetitions.And if when finding the second error correction code value identical with described the first error correction code value, can advance one not data relatively, judge the data whether data to be written repeat.Thus, prevent writing of repeating data, saved the storage space of solid state hard disc 100.
In one embodiment of the invention, described step of carrying out the identical judgement of data comprises:
Described data to be written and the described data that write are compared; This step is realized by comparing unit 221;
When described data to be written are not identical with the described data that write, write described data to be written; This step is realized by the first writing unit 222;
When described data to be written are identical with the described data that write, delete described data to be written; This step is realized by delete cells 223.
In this embodiment, by described data to be written and the described data that write are compared, if when described data to be written are not identical with the described data that write, write described data to be written; If identical data to be written of then deleting this repetition.In addition, described the first control submodule 22 reads in the data under mapping address corresponding to described the first error correction code value in described step of reading in described data to be written; And in the step of described deletion described data to be written, after deleting described data to be written, upgrade the mapping address table.The step of the described data that corresponding said write is to be written comprises: described the first error correction code value is write the Hash bucket; This step is realized by the second writing unit 231; And described data to be written are write storage medium; This step is realized by the 3rd writing unit 233.
Referring to Fig. 5, in one embodiment of the invention, provide the method for data de-duplication, flow process is described below:
Among the step S501, process the process of writing the request of solid state hard disc 100, receive write request;
Among the step S502, calculate the ECC value of data to be written;
Among the step S503, the described ECC value that calculates is searched the ECC value of data in the in store solid state hard disc 100 in the Hash bucket in the Hash bucket;
Among the step S504, judge whether to have found the ECC value identical with the ECC value that calculates; Execution in step S506 then; Otherwise execution in step S505;
Among the step S505, the ECC value is added the Hash bucket, and data to be written are write in the solid state hard disc 100;
Among the step S506, the data of corresponding address are read back, and relatively these data whether with solid state hard disc 100 in the data consistent stored, the i.e. data consistent identical with the ECC value whether; Execution in step S507 then; Otherwise execution in step S505.
Among the step S507, upgrade mapping table, write order directly returns.
In this embodiment, according to the ECC computing function that Flash carries, utilize the ECC value to carry out repeating data and judge that the fingerprint that reduces host side calculates.At first the data of write request are calculated the ECC value by the Flash controller.Then, the ECC value is searched the ECC value of data among the in store SSD in the Hash bucket in the Hash bucket.If found the ECC value of coupling, this means that data are probably consistent, by the Flash controller data of corresponding address are read back, and compare with the data that write, if identical, upgrade mapping table, write request is returned host side.If the ECC value is not identical, then the ECC value is added the Hash bucket, data write SSD.
In sum, the present invention is by in host side during to the solid state hard disc data writing, judge tentatively according to the ECC proof test value of every page whether data are identical, if the identical possibility of the identical explanation data of ECC value is very large, further the data of corresponding address being read back compares.If identical, then write operation directly returns main frame, and upgrades mapping table.Reduce the write operation of repeating data to Flash, saved the Flash storage space, can effectively prolong the bulk life time of Nand Flash.Saved the storage space of Flash.Reduce data repeat write.
Certainly; the present invention also can have other various embodiments; in the situation that does not deviate from spirit of the present invention and essence thereof; those of ordinary skill in the art work as can make according to the present invention various corresponding changes and distortion, but these corresponding changes and distortion all should belong to the protection domain of the appended claim of the present invention.

Claims (10)

1. the method for a data de-duplication is characterized in that, described method comprises the steps:
When data writing, calculate the first error correction code value of described data;
According to the first error correction code value of described data, control writing of described data.
2. the method for data de-duplication according to claim 1 is characterized in that, described the first error correction code value according to described data, and the step that writes of controlling described data comprises:
Search whether the second error correction code value identical with described the first error correction code value is arranged in the second error correction code value of written data;
When finding the second error correction code value identical with described the first error correction code value, read in described data to be written, carry out the identical judgement of data;
When not finding the second error correction code value identical with described the first error correction code value, write described described data to be written.
3. the method for data de-duplication according to claim 2 is characterized in that, described step of carrying out the identical judgement of data comprises:
Described data to be written and the described data that write are compared;
When described data to be written are not identical with the described data that write, write described data to be written;
When described data to be written are identical with the described data that write, delete described data to be written.
4. the method for data de-duplication according to claim 3 is characterized in that, the step of the described data that said write is to be written comprises:
Described the first error correction code value is write the Hash bucket;
Described data to be written are write storage medium.
5. the method for data de-duplication according to claim 3 is characterized in that, reads in the data under mapping address corresponding to described the first error correction code value in described step of reading in described data to be written;
In the step of described deletion described data to be written, after deleting described data to be written, upgrade the mapping address table.
6. a solid state hard disc is characterized in that, comprising:
Computing module is used for calculating the first error correction code value of described data when data writing;
Control module is used for the first error correction code value according to described data, controls writing of described data.
7. solid state hard disc according to claim 6 is characterized in that, described control module comprises:
Search submodule, whether the second error correction code value that is used for searching at written data has the second error correction code value identical with described the first error correction code value;
The first control submodule is used for reading in described data to be written when finding the second error correction code value identical with described the first error correction code value, carries out the identical judgement of data;
The second control submodule is used for writing described described data to be written when not finding the second error correction code value identical with described the first error correction code value.
8. solid state hard disc according to claim 7 is characterized in that, described the first control submodule comprises:
Comparing unit is used for described data to be written and the described data that write are compared;
The first writing unit is used for writing described data to be written when described comparing unit described data more to be written are not identical with the described data that write;
Delete cells is used for deleting described data to be written when described comparing unit described data more to be written are identical with the described data that write.
9. solid state hard disc according to claim 8 is characterized in that, described the second control submodule comprises:
The second writing unit is used for described the first error correction code value is write the Hash bucket;
The 3rd writing unit is used for described data to be written are write described solid state hard disc.
10. solid state hard disc according to claim 8 is characterized in that, described first control submodule described read in described data to be written the time, read in the data under mapping address corresponding to described the first error correction code value;
Described the first control submodule upgrades the mapping address table after deletion described data to be written when described deletion described data to be written.
CN2012104751570A 2012-11-21 2012-11-21 Method for deleting repeated data and solid hard disc thereof Pending CN102981969A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN2012104751570A CN102981969A (en) 2012-11-21 2012-11-21 Method for deleting repeated data and solid hard disc thereof
PCT/CN2013/074921 WO2014079201A1 (en) 2012-11-21 2013-04-28 Method for deleting duplicate data and solid state disk thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012104751570A CN102981969A (en) 2012-11-21 2012-11-21 Method for deleting repeated data and solid hard disc thereof

Publications (1)

Publication Number Publication Date
CN102981969A true CN102981969A (en) 2013-03-20

Family

ID=47856021

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012104751570A Pending CN102981969A (en) 2012-11-21 2012-11-21 Method for deleting repeated data and solid hard disc thereof

Country Status (2)

Country Link
CN (1) CN102981969A (en)
WO (1) WO2014079201A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103473179A (en) * 2013-08-09 2013-12-25 记忆科技(深圳)有限公司 Background system and method for deleting repeating data in solid state disk
WO2014079201A1 (en) * 2012-11-21 2014-05-30 记忆科技(深圳)有限公司 Method for deleting duplicate data and solid state disk thereof
CN105260133A (en) * 2015-09-22 2016-01-20 Tcl移动通信科技(宁波)有限公司 Data writing method and system for EMMC (Embedded Multi Media Card) of mobile terminal
WO2016086411A1 (en) * 2014-12-05 2016-06-09 华为技术有限公司 Controller, flash memory device, method for identifying data block stability and method for storing data on flash memory device
CN107113164A (en) * 2014-12-18 2017-08-29 诺基亚技术有限公司 The deduplication of encryption data
CN107273397A (en) * 2016-03-31 2017-10-20 三星电子株式会社 The many Hash tables of virtual bucket for the online deduplication application of effective memory
CN107704466A (en) * 2016-08-09 2018-02-16 捷鼎国际股份有限公司 Data storage system
CN108027713A (en) * 2015-09-18 2018-05-11 阿里巴巴集团控股有限公司 Data de-duplication for solid state drive controller

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1514440A (en) * 2003-02-10 2004-07-21 威盛电子股份有限公司 Data reading out method
US7085988B1 (en) * 2002-04-08 2006-08-01 Maxtor Corporation Hashing system utilizing error correction coding techniques
US20080186787A1 (en) * 2007-02-05 2008-08-07 Seiko Epson Corporation Storage device
CN102629258A (en) * 2012-02-29 2012-08-08 浪潮(北京)电子信息产业有限公司 Repeating data deleting method and device
CN102650949A (en) * 2012-04-24 2012-08-29 深圳创维数字技术股份有限公司 Method and device for upgrading firmware of storage equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102981969A (en) * 2012-11-21 2013-03-20 记忆科技(深圳)有限公司 Method for deleting repeated data and solid hard disc thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085988B1 (en) * 2002-04-08 2006-08-01 Maxtor Corporation Hashing system utilizing error correction coding techniques
CN1514440A (en) * 2003-02-10 2004-07-21 威盛电子股份有限公司 Data reading out method
US20080186787A1 (en) * 2007-02-05 2008-08-07 Seiko Epson Corporation Storage device
CN102629258A (en) * 2012-02-29 2012-08-08 浪潮(北京)电子信息产业有限公司 Repeating data deleting method and device
CN102650949A (en) * 2012-04-24 2012-08-29 深圳创维数字技术股份有限公司 Method and device for upgrading firmware of storage equipment

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014079201A1 (en) * 2012-11-21 2014-05-30 记忆科技(深圳)有限公司 Method for deleting duplicate data and solid state disk thereof
CN103473179B (en) * 2013-08-09 2017-04-19 记忆科技(深圳)有限公司 Background system and method for deleting repeating data in solid state disk
CN103473179A (en) * 2013-08-09 2013-12-25 记忆科技(深圳)有限公司 Background system and method for deleting repeating data in solid state disk
US9772790B2 (en) 2014-12-05 2017-09-26 Huawei Technologies Co., Ltd. Controller, flash memory apparatus, method for identifying data block stability, and method for storing data in flash memory apparatus
WO2016086411A1 (en) * 2014-12-05 2016-06-09 华为技术有限公司 Controller, flash memory device, method for identifying data block stability and method for storing data on flash memory device
CN107113164A (en) * 2014-12-18 2017-08-29 诺基亚技术有限公司 The deduplication of encryption data
CN107113164B (en) * 2014-12-18 2021-07-06 诺基亚技术有限公司 Method, apparatus and computer readable medium for deduplication of encrypted data
CN108027713A (en) * 2015-09-18 2018-05-11 阿里巴巴集团控股有限公司 Data de-duplication for solid state drive controller
CN105260133A (en) * 2015-09-22 2016-01-20 Tcl移动通信科技(宁波)有限公司 Data writing method and system for EMMC (Embedded Multi Media Card) of mobile terminal
CN105260133B (en) * 2015-09-22 2019-04-30 Tcl移动通信科技(宁波)有限公司 A kind of method for writing data and system of mobile terminal EMMC
CN107273397A (en) * 2016-03-31 2017-10-20 三星电子株式会社 The many Hash tables of virtual bucket for the online deduplication application of effective memory
CN107273397B (en) * 2016-03-31 2022-02-18 三星电子株式会社 Virtual bucket polyhistidine table for efficient memory online deduplication applications
CN107704466A (en) * 2016-08-09 2018-02-16 捷鼎国际股份有限公司 Data storage system
CN107704466B (en) * 2016-08-09 2020-12-11 上海川源信息科技有限公司 Data storage system

Also Published As

Publication number Publication date
WO2014079201A1 (en) 2014-05-30

Similar Documents

Publication Publication Date Title
US8788876B2 (en) Stripe-based memory operation
CN102981969A (en) Method for deleting repeated data and solid hard disc thereof
KR101491943B1 (en) Transaction log recovery
CN107957959B (en) Memory system with file level secure erase and method of operating the same
CN103106143B (en) Solid state storage device and logic thereof are to entity correspondence table method for building up
US20090307412A1 (en) Memory management method for non-volatile memory and controller using the same
TWI470431B (en) Data writing method, memory controller and memory storage apparatus
TWI451249B (en) Data merging method for non-volatile memory and controller and stoarge apparatus using the same
US11269722B2 (en) Apparatus for diagnosing memory system and operating method thereof
US11003587B2 (en) Memory system with configurable NAND to DRAM ratio and method of configuring and using such memory system
US9141530B2 (en) Data writing method, memory controller and memory storage device
TWI423022B (en) Memory management method, memory controller and memory storage apparatus
US20090024787A1 (en) Data writing method and apparatus
US8812772B2 (en) Data merging method for non-volatile memory and controller and storage apparatus using the same
TWI540428B (en) Data writing method, memory controller and memory storage apparatus
US10942678B2 (en) Method of accessing data in storage device, method of managing data in storage device and storage device performing the same
CN102789813B (en) Method and device for controlling use of non-least significant bit page in storage device
US9946644B2 (en) Memory system and operating method thereof
US9778862B2 (en) Data storing method for preventing data losing during flush operation, memory control circuit unit and memory storage apparatus
TWI446170B (en) Data writing method, memory controller and memory storage apparatus
TWI521346B (en) Data merging method for non-volatile memory and controller and stoarge apparatus using the same
US8832358B2 (en) Data writing method, memory controller and memory storage apparatus
JP5908106B2 (en) Device and method for storing validity mask and operating device
US11586379B2 (en) Memory system and method of operating the same
US9009389B2 (en) Memory management table processing method, memory controller, and memory storage apparatus

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130320