AU2014403332A1 - Data deduplication method and storage array - Google Patents

Data deduplication method and storage array

Info

Publication number
AU2014403332A1
AU2014403332A1 AU2014403332A AU2014403332A AU2014403332A1 AU 2014403332 A1 AU2014403332 A1 AU 2014403332A1 AU 2014403332 A AU2014403332 A AU 2014403332A AU 2014403332 A AU2014403332 A AU 2014403332A AU 2014403332 A1 AU2014403332 A1 AU 2014403332A1
Authority
AU
Australia
Prior art keywords
storage array
data deduplication
deduplication method
data
array
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
AU2014403332A
Other versions
AU2014403332B2 (en
Inventor
Xianhong Lv
Mingchang Wei
Chenyi Zhang
Wei Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority claimed from PCT/CN2014/086530 external-priority patent/WO2016041127A1/en
Publication of AU2014403332A1 publication Critical patent/AU2014403332A1/en
Application granted granted Critical
Publication of AU2014403332B2 publication Critical patent/AU2014403332B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

AU2014403332A 2014-09-15 2014-09-15 Data deduplication method and storage array Active AU2014403332B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/086530 WO2016041127A1 (en) 2014-09-15 2014-09-15 Data duplication method and storage array

Publications (2)

Publication Number Publication Date
AU2014403332A1 true AU2014403332A1 (en) 2016-03-31
AU2014403332B2 AU2014403332B2 (en) 2017-04-20

Family

ID=55532419

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2014403332A Active AU2014403332B2 (en) 2014-09-15 2014-09-15 Data deduplication method and storage array

Country Status (9)

Country Link
US (1) US20170177489A1 (en)
EP (1) EP3037949B1 (en)
JP (1) JP6254293B2 (en)
KR (1) KR101716264B1 (en)
CN (1) CN105612489B (en)
AU (1) AU2014403332B2 (en)
BR (1) BR112016003763B1 (en)
CA (1) CA2920004C (en)
WO (1) WO2016041127A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113411398A (en) * 2021-06-18 2021-09-17 全方位智能科技(南京)有限公司 Big data-based file cleaning writing and cleaning management system and method

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2016394896B2 (en) * 2016-09-28 2018-08-09 Huawei Technologies Co.,Ltd. Method for deduplication in storage system, storage system, and controller
US10705969B2 (en) * 2018-01-19 2020-07-07 Samsung Electronics Co., Ltd. Dedupe DRAM cache
CN108897806A (en) * 2018-06-15 2018-11-27 东软集团股份有限公司 Comparison of data consistency method, apparatus, storage medium and electronic equipment
EP3889778B1 (en) * 2018-12-22 2023-05-10 Huawei Cloud Computing Technologies Co., Ltd. Distributed storage system and computer program product
WO2021016728A1 (en) * 2019-07-26 2021-02-04 华为技术有限公司 Data processing method and device in storage system, and computer readable storage medium
CN113253947B (en) * 2021-07-16 2021-10-15 苏州浪潮智能科技有限公司 Deduplication method, deduplication device, deduplication equipment and readable storage medium
CN113627132B (en) * 2021-08-27 2024-04-02 智慧星光(安徽)科技有限公司 Data deduplication marking code generation method, system, electronic equipment and storage medium
CN114003181B (en) * 2022-01-04 2022-05-20 苏州浪潮智能科技有限公司 Data write mirror image system, method, device, electronic equipment and storage medium

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW579463B (en) * 2001-06-30 2004-03-11 Ibm System and method for a caching mechanism for a central synchronization server
US7428613B1 (en) * 2004-06-29 2008-09-23 Crossroads Systems, Inc. System and method for centralized partitioned library mapping
JP4901316B2 (en) * 2006-06-06 2012-03-21 株式会社日立製作所 Storage system and storage control device
JP4394670B2 (en) * 2006-09-28 2010-01-06 株式会社日立製作所 Disk control device and storage system
CN101809559B (en) * 2007-09-05 2013-10-16 伊姆西公司 De-duplication in virtualized server and virtualized storage environments
US8209506B2 (en) * 2007-09-05 2012-06-26 Emc Corporation De-duplication in a virtualized storage environment
JP4480756B2 (en) * 2007-12-05 2010-06-16 富士通株式会社 Storage management device, storage system control device, storage management program, data storage system, and data storage method
JP2009251725A (en) * 2008-04-02 2009-10-29 Hitachi Ltd Storage controller and duplicated data detection method using storage controller
US8185691B2 (en) * 2008-06-30 2012-05-22 Netapp, Inc. Optimized cache coherency in a dual-controller storage array
WO2010045262A1 (en) * 2008-10-14 2010-04-22 Wanova Technologies, Ltd. Storage-network de-duplication
US8595397B2 (en) * 2009-06-09 2013-11-26 Netapp, Inc Storage array assist architecture
JP4838878B2 (en) * 2009-12-04 2011-12-14 富士通株式会社 Data management program, data management apparatus, and data management method
JP4892072B2 (en) * 2010-03-24 2012-03-07 株式会社東芝 Storage device that eliminates duplicate data in cooperation with host device, storage system including the storage device, and deduplication method in the system
US9110936B2 (en) * 2010-12-28 2015-08-18 Microsoft Technology Licensing, Llc Using index partitioning and reconciliation for data deduplication
CN102063274B (en) * 2010-12-30 2013-10-09 华为技术有限公司 Storage array, storage system and data access method
CN102156703A (en) * 2011-01-24 2011-08-17 南开大学 Low-power consumption high-performance repeating data deleting system
CN102833298A (en) * 2011-06-17 2012-12-19 英业达集团(天津)电子技术有限公司 Distributed repeated data deleting system and processing method thereof
CN102866935B (en) * 2011-07-07 2014-11-12 北京飞杰信息技术有限公司 Instant replication method and storage system based on ISCSI (internet small computer system interface)
US8620886B1 (en) * 2011-09-20 2013-12-31 Netapp Inc. Host side deduplication
US9229853B2 (en) * 2011-12-20 2016-01-05 Intel Corporation Method and system for data de-duplication
KR101341995B1 (en) * 2011-12-26 2013-12-16 성균관대학교산학협력단 Apparatus and method for managing shared data storage
US9417811B2 (en) * 2012-03-07 2016-08-16 International Business Machines Corporation Efficient inline data de-duplication on a storage system
US8856443B2 (en) * 2012-03-12 2014-10-07 Infinidat Ltd. Avoiding duplication of data units in a cache memory of a storage system
US8706971B1 (en) * 2012-03-14 2014-04-22 Netapp, Inc. Caching and deduplication of data blocks in cache memory
CN102982122A (en) * 2012-11-13 2013-03-20 浪潮电子信息产业股份有限公司 Repeating data deleting method suitable for mass storage system
US20150363134A1 (en) * 2013-03-04 2015-12-17 Hitachi, Ltd. Storage apparatus and data management
US9602428B2 (en) * 2014-01-29 2017-03-21 Telefonaktiebolaget L M Ericsson (Publ) Method and apparatus for locality sensitive hash-based load balancing
US9760578B2 (en) * 2014-07-23 2017-09-12 International Business Machines Corporation Lookup-based data block alignment for data deduplication
US10013358B2 (en) * 2014-07-24 2018-07-03 Hitachi, Ltd. Computer system and memory allocation management method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113411398A (en) * 2021-06-18 2021-09-17 全方位智能科技(南京)有限公司 Big data-based file cleaning writing and cleaning management system and method
CN113411398B (en) * 2021-06-18 2022-02-18 全方位智能科技(南京)有限公司 Big data-based file cleaning writing and cleaning management system and method

Similar Documents

Publication Publication Date Title
EP3260971A4 (en) Data processing method and nvme storage
EP3230180A4 (en) Storage and retrieval system
EP3229126A4 (en) Data reading method and device
EP3387782A4 (en) Device using secure storage and retrieval of data
EP3171282A4 (en) Data retrieval apparatus, program and recording medium
EP3264285A4 (en) Data deduplication method and storage device
EP3163888A4 (en) Data reproduction method and reproduction device
EP3108374A4 (en) Data management systems and methods
EP3159794A4 (en) Distributed storage replication system and method
EP3168758A4 (en) Data storage method, query method and device
EP3117347A4 (en) Systems and methods for rapid data analysis
EP3234856A4 (en) Systems and methods for diffracted data retrieval
EP3037950A4 (en) Data write request handling method and storage array
EP3105684A4 (en) Data storage device with embedded software
EP3133505A4 (en) Clustering storage method and device
EP3113036A4 (en) Data matching method and apparatus and computer storage medium
EP3376393A4 (en) Data storage method and apparatus
EP3153987A4 (en) Duplicate data deletion method and device
AU2014403332A1 (en) Data deduplication method and storage array
EP3082052A4 (en) Distributed data storage method, device and system
EP3197137A4 (en) Microphone selection method and device, and computer storage medium
EP3016354A4 (en) Cloud-service-based data backup and operation method
EP3104588A4 (en) Information processing device, information processing method and storage medium
EP3037949A4 (en) Data duplication method and storage array
EP3159803A4 (en) Data storage method and network interface card