CA2711273A1 - Mecanisme de deduplication pouvant etre mis a l'echelle - Google Patents
Mecanisme de deduplication pouvant etre mis a l'echelle Download PDFInfo
- Publication number
- CA2711273A1 CA2711273A1 CA2711273A CA2711273A CA2711273A1 CA 2711273 A1 CA2711273 A1 CA 2711273A1 CA 2711273 A CA2711273 A CA 2711273A CA 2711273 A CA2711273 A CA 2711273A CA 2711273 A1 CA2711273 A1 CA 2711273A1
- Authority
- CA
- Canada
- Prior art keywords
- data
- duplication
- data object
- application layer
- domain
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000007246 mechanism Effects 0.000 title description 24
- 238000000034 method Methods 0.000 claims abstract description 128
- 238000003909 pattern recognition Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 description 46
- 238000012545 processing Methods 0.000 description 24
- 239000000835 fiber Substances 0.000 description 21
- 238000010586 diagram Methods 0.000 description 18
- 238000013500 data storage Methods 0.000 description 12
- 230000004048 modification Effects 0.000 description 11
- 238000012986 modification Methods 0.000 description 11
- 238000003491 array Methods 0.000 description 8
- 230000008901 benefit Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 230000007423 decrease Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- JLYFCTQDENRSOL-VIFPVBQESA-N dimethenamid-P Chemical compound COC[C@H](C)N(C(=O)CCl)C=1C(C)=CSC=1C JLYFCTQDENRSOL-VIFPVBQESA-N 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003442 weekly effect Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 239000003999 initiator Substances 0.000 description 2
- 239000003550 marker Substances 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 238000005201 scrubbing Methods 0.000 description 2
- VLCQZHSMCYCDJL-UHFFFAOYSA-N tribenuron methyl Chemical compound COC(=O)C1=CC=CC=C1S(=O)(=O)NC(=O)N(C)C1=NC(C)=NC(OC)=N1 VLCQZHSMCYCDJL-UHFFFAOYSA-N 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000013497 data interchange Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
- G06F3/0641—De-duplication techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0686—Libraries, e.g. tape libraries, jukebox
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Detection And Prevention Of Errors In Transmission (AREA)
- Hardware Redundancy (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US2150108P | 2008-01-16 | 2008-01-16 | |
| US61/021,501 | 2008-01-16 | ||
| PCT/US2009/031222 WO2009091957A2 (fr) | 2008-01-16 | 2009-01-16 | Mécanisme de déduplication pouvant être mis à l'échelle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2711273A1 true CA2711273A1 (fr) | 2009-07-23 |
Family
ID=40885894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2711273A Abandoned CA2711273A1 (fr) | 2008-01-16 | 2009-01-16 | Mecanisme de deduplication pouvant etre mis a l'echelle |
Country Status (6)
| Country | Link |
|---|---|
| EP (1) | EP2235640A2 (fr) |
| JP (1) | JP2011510405A (fr) |
| CN (1) | CN101939737A (fr) |
| AU (1) | AU2009206038A1 (fr) |
| CA (1) | CA2711273A1 (fr) |
| WO (1) | WO2009091957A2 (fr) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8291183B2 (en) | 2009-01-15 | 2012-10-16 | Emc Corporation | Assisted mainframe data de-duplication |
| JP5623239B2 (ja) | 2010-10-28 | 2014-11-12 | インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ | 書込みレコードの重複を排除する記憶装置、及びその書込み方法 |
| US8682873B2 (en) * | 2010-12-01 | 2014-03-25 | International Business Machines Corporation | Efficient construction of synthetic backups within deduplication storage system |
| US8332372B2 (en) * | 2010-12-16 | 2012-12-11 | International Business Machines Corporation | Method and system for processing data |
| US9933978B2 (en) | 2010-12-16 | 2018-04-03 | International Business Machines Corporation | Method and system for processing data |
| KR101583748B1 (ko) * | 2011-12-08 | 2016-01-19 | 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 | 사용자 간의 중복제거를 허용하기 위한 저장소 할인 |
| WO2013153584A1 (fr) * | 2012-04-13 | 2013-10-17 | Hitachi, Ltd. | Dispositif de stockage |
| WO2016115663A1 (fr) | 2015-01-19 | 2016-07-28 | Nokia Technologies Oy | Procédé et appareil de gestion de mémorisation de données hétérogènes dans l'informatique en nuage |
| JP6720612B2 (ja) * | 2016-03-23 | 2020-07-08 | 日本電気株式会社 | 情報処理装置、ストレージシステム、記憶制御方法およびコンピュータプログラム |
| US10235396B2 (en) * | 2016-08-29 | 2019-03-19 | International Business Machines Corporation | Workload optimized data deduplication using ghost fingerprints |
| WO2018226228A1 (fr) * | 2017-06-08 | 2018-12-13 | Hitachi Data Systems Corporation | Déduplication d'objets codés distribués à effacer |
| US11182406B2 (en) | 2020-03-27 | 2021-11-23 | International Business Machines Corporation | Increased data availability during replication |
| CN112632191B (zh) * | 2020-12-29 | 2024-06-11 | 中国农业银行股份有限公司 | 一种数据处理方法及系统 |
| CN114020218B (zh) * | 2021-11-25 | 2023-06-02 | 建信金融科技有限责任公司 | 混合重复数据删除调度方法及系统 |
| CN118159936A (zh) * | 2022-08-31 | 2024-06-07 | 华为技术有限公司 | 顺序存储介质上的并行重复数据删除机制 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6795819B2 (en) * | 2000-08-04 | 2004-09-21 | Infoglide Corporation | System and method for building and maintaining a database |
| KR20020066836A (ko) * | 2001-02-14 | 2002-08-21 | 한국통신정보기술 주식회사 | 계층적 데이터구조를 기록한 기록매체 및 계층적 데이터저장구조를 형성하는 방법 |
| EP1244221A1 (fr) * | 2001-03-23 | 2002-09-25 | Sun Microsystems, Inc. | Procédé et système pour éliminer des données rédondantes |
| KR100700200B1 (ko) * | 2004-12-24 | 2007-03-27 | 주식회사 나우콤 | 파일의 정보를 이용하여 중복된 파일을 저장하고다운로드하는 방법 및 장치 |
| US7840537B2 (en) * | 2006-12-22 | 2010-11-23 | Commvault Systems, Inc. | System and method for storing redundant information |
| US8315984B2 (en) * | 2007-05-22 | 2012-11-20 | Netapp, Inc. | System and method for on-the-fly elimination of redundant data |
-
2009
- 2009-01-16 CA CA2711273A patent/CA2711273A1/fr not_active Abandoned
- 2009-01-16 JP JP2010543270A patent/JP2011510405A/ja not_active Withdrawn
- 2009-01-16 WO PCT/US2009/031222 patent/WO2009091957A2/fr active Application Filing
- 2009-01-16 CN CN2009801016964A patent/CN101939737A/zh active Pending
- 2009-01-16 AU AU2009206038A patent/AU2009206038A1/en not_active Abandoned
- 2009-01-16 EP EP09702041A patent/EP2235640A2/fr not_active Withdrawn
Also Published As
| Publication number | Publication date |
|---|---|
| EP2235640A2 (fr) | 2010-10-06 |
| JP2011510405A (ja) | 2011-03-31 |
| AU2009206038A1 (en) | 2009-07-23 |
| WO2009091957A2 (fr) | 2009-07-23 |
| WO2009091957A3 (fr) | 2009-10-15 |
| CN101939737A (zh) | 2011-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8280926B2 (en) | Scalable de-duplication mechanism | |
| US8938595B2 (en) | Emulated storage system | |
| US8200924B2 (en) | Emulated storage system | |
| CA2711273A1 (fr) | Mecanisme de deduplication pouvant etre mis a l'echelle | |
| US20050108486A1 (en) | Emulated storage system supporting instant volume restore | |
| US8620640B2 (en) | Emulated storage system | |
| US7100008B2 (en) | Long term data protection system and method | |
| US9104622B2 (en) | Retrieval and recovery of data chunks from alternate data stores in a deduplicating system | |
| US8386521B2 (en) | System for backing up and restoring data | |
| US20120197853A1 (en) | System and method for sampling based elimination of duplicate data | |
| WO2005033945A1 (fr) | Systeme memoire emule permettant la restauration instantanee du volume | |
| Zhang et al. | Improving restore performance of packed datasets in deduplication systems via reducing persistent fragmented chunks | |
| JP2007527572A5 (fr) | ||
| US11836388B2 (en) | Intelligent metadata compression | |
| US20240320146A1 (en) | Data reduction in a cloud-based storage system | |
| Gryz | Impact of Data Organization on Distributed Storage System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FZDE | Discontinued |
Effective date: 20130116 |