CA2902868C - Managing operations on stored data units - Google Patents

Managing operations on stored data units Download PDF

Info

Publication number
CA2902868C
CA2902868C CA2902868A CA2902868A CA2902868C CA 2902868 C CA2902868 C CA 2902868C CA 2902868 A CA2902868 A CA 2902868A CA 2902868 A CA2902868 A CA 2902868A CA 2902868 C CA2902868 C CA 2902868C
Authority
CA
Canada
Prior art keywords
data
data units
stored data
read
units
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2902868A
Other languages
French (fr)
Other versions
CA2902868A1 (en
Inventor
Ephraim Meriwether Vishniac
Stephen J. Schmidt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ab Initio Technology LLC
Original Assignee
Ab Initio Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology LLC filed Critical Ab Initio Technology LLC
Publication of CA2902868A1 publication Critical patent/CA2902868A1/en
Application granted granted Critical
Publication of CA2902868C publication Critical patent/CA2902868C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device

Abstract

A system for managing storage of data units includes a data storage system (106) configured to store multiple data blocks (202A-202C), at least some of the data blocks containing multiple data units, with at least a group of the data blocks being stored contiguously, thereby supporting a first read operation (340) that retrieves data units from at least two adjacent data blocks in the group. The system is configured to perform two or more operations with respect to data units. The operations include: a second read operation (320), different from the first read operation, that retrieves a data unit to be read based at least in part on an address of a data block containing the data unit to be read, and a delete operation (300) that replaces a first data block containing a data unit to be deleted with a second data block that does not contain the deleted data unit.
CA2902868A 2013-03-06 2014-02-18 Managing operations on stored data units Active CA2902868C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/787,055 US10133500B2 (en) 2013-03-06 2013-03-06 Managing operations on stored data units
US13/787,055 2013-03-06
PCT/US2014/016848 WO2014137585A1 (en) 2013-03-06 2014-02-18 Managing operations on stored data units

Publications (2)

Publication Number Publication Date
CA2902868A1 CA2902868A1 (en) 2014-09-12
CA2902868C true CA2902868C (en) 2021-05-18

Family

ID=50236304

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2902868A Active CA2902868C (en) 2013-03-06 2014-02-18 Managing operations on stored data units

Country Status (9)

Country Link
US (1) US10133500B2 (en)
EP (1) EP2965187B1 (en)
JP (1) JP6491605B2 (en)
KR (1) KR102275431B1 (en)
CN (1) CN105027071B (en)
AU (1) AU2014226446B2 (en)
CA (1) CA2902868C (en)
HK (1) HK1216267A1 (en)
WO (1) WO2014137585A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9959070B2 (en) 2013-03-06 2018-05-01 Ab Initio Technology Llc Managing operations on stored data units
US9875054B2 (en) 2013-03-06 2018-01-23 Ab Initio Technology Llc Managing operations on stored data units
KR101727508B1 (en) 2015-07-28 2017-04-18 서울과학기술대학교 산학협력단 Apparatus and method for accelerating hardware compression based on hadoop
US10210236B2 (en) 2015-11-23 2019-02-19 Ab Initio Technology Llc Storing and retrieving data of a data cube
CN106982165A (en) * 2016-01-15 2017-07-25 厦门雅迅网络股份有限公司 Data compression method and its system
CN107870727B (en) * 2016-09-23 2021-01-01 伊姆西Ip控股有限责任公司 Method and apparatus for storing data
CN107247562B (en) * 2017-06-30 2020-03-06 郑州云海信息技术有限公司 Compression optimization method and device
SE544272C2 (en) * 2018-11-14 2022-03-22 Zeropoint Tech Ab Accessing compressed computer memory
CN113326001B (en) * 2021-05-20 2023-08-01 锐掣(杭州)科技有限公司 Data processing method, device, apparatus, system, medium, and program
CN114817410B (en) * 2022-06-23 2022-09-13 心鉴智控(深圳)科技有限公司 Service data processing method, device, equipment and storage medium

Family Cites Families (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2688039B2 (en) * 1987-12-19 1997-12-08 富士通株式会社 Memory management device
JPH01175048A (en) 1987-12-29 1989-07-11 Sharp Corp Computer
JPH07160439A (en) 1993-12-03 1995-06-23 Matsushita Electric Ind Co Ltd Data storage device and main controller
KR100276148B1 (en) 1994-03-03 2000-12-15 로버트 에프. 도나휴 Apparatus and method for defect menagement for automatic track processing without id field
US6604236B1 (en) 1998-06-30 2003-08-05 Iora, Ltd. System and method for generating file updates for files stored on read-only media
JP3632543B2 (en) * 1999-02-19 2005-03-23 三菱電機株式会社 Data storage method and information processing apparatus
US6426893B1 (en) * 2000-02-17 2002-07-30 Sandisk Corporation Flash eeprom system with simultaneous multiple data sector programming and storage of physical block characteristics in other designated blocks
JP2002116748A (en) * 2000-10-05 2002-04-19 Yamaha Corp Image data processor
US7882081B2 (en) 2002-08-30 2011-02-01 Netapp, Inc. Optimized disk repository for the storage and retrieval of mostly sequential data
US7890469B1 (en) 2002-12-30 2011-02-15 Symantec Operating Corporation File change log
JP2004258865A (en) 2003-02-25 2004-09-16 Canon Inc Method of processing information
US7472254B2 (en) 2003-10-10 2008-12-30 Iora, Ltd. Systems and methods for modifying a set of data objects
JP3713666B2 (en) 2004-01-13 2005-11-09 理明 中川 File system image compression method and program
JP2005242897A (en) 2004-02-27 2005-09-08 Oki Electric Ind Co Ltd Flash disk drive
US20050198062A1 (en) 2004-03-05 2005-09-08 Shapiro Richard B. Method and apparatus for accelerating data access operations in a database system
US7386663B2 (en) 2004-05-13 2008-06-10 Cousins Robert E Transaction-based storage system and method that uses variable sized objects to store data
US8090691B2 (en) 2004-08-13 2012-01-03 Computer Associates Think, Inc. System and method for variable block logging with log-ahead buffers
US20060184563A1 (en) 2005-02-14 2006-08-17 Potter David H Method and apparatus for temporal database
US7840774B2 (en) 2005-09-09 2010-11-23 International Business Machines Corporation Compressibility checking avoidance
EP2033128A4 (en) * 2006-05-31 2012-08-15 Ibm Method and system for transformation of logical data objects for storage
US9501492B2 (en) 2006-10-24 2016-11-22 Marvell World Trade Ltd. Combination journaling/non-journaling file system
US7885932B2 (en) 2006-11-01 2011-02-08 Ab Initio Technology Llc Managing storage of individually accessible data units
US8229902B2 (en) 2006-11-01 2012-07-24 Ab Initio Technology Llc Managing storage of individually accessible data units
US8738588B2 (en) * 2007-03-26 2014-05-27 International Business Machines Corporation Sequential media reclamation and replication
US8156241B1 (en) * 2007-05-17 2012-04-10 Netapp, Inc. System and method for compressing data transferred over a network for storage purposes
US8457392B2 (en) 2007-07-27 2013-06-04 Sportvision, Inc. Identifying an object in an image using color profiles
US7836099B2 (en) 2007-07-31 2010-11-16 Yahoo! Inc. Mail compression scheme with individual message decompressability
TW200910187A (en) 2007-08-21 2009-03-01 Sunplus Mmobile Inc Logged FAT file system and method of accessing the same
KR100926631B1 (en) 2007-09-14 2009-11-11 (주)밀레니엄 포스 Data security apparatus
US8045285B1 (en) 2008-03-25 2011-10-25 Marvell International Ltd. Data synchronization for bit insertion or deletion
US20090287986A1 (en) 2008-05-14 2009-11-19 Ab Initio Software Corporation Managing storage of individually accessible data units
CN101320372B (en) 2008-05-22 2012-07-04 上海爱数软件有限公司 Compression method for repeated data
JP2010015197A (en) 2008-06-30 2010-01-21 Toshiba Corp Storage controller, data restoration device, and storage system
US8555053B1 (en) * 2008-08-29 2013-10-08 Crossroads Systems, Inc. System and method for adjusting to drive specific criteria
US7987162B2 (en) 2009-03-06 2011-07-26 Bluearc Uk Limited Data compression in a file storage system
JP2010208147A (en) * 2009-03-10 2010-09-24 Ricoh Co Ltd Head cleaning device, image forming apparatus, and head cleaning method
JP2010218147A (en) 2009-03-16 2010-09-30 Toshiba Corp Mobile electronic apparatus and memory control method therein
EP2425324A1 (en) 2009-04-27 2012-03-07 Kamlesh Gandhi Description
US8645337B2 (en) * 2009-04-30 2014-02-04 Oracle International Corporation Storing compression units in relational tables
US8935223B2 (en) 2009-04-30 2015-01-13 Oracle International Corporation Structure of hierarchical compressed data structure for tabular data
US8166258B2 (en) * 2009-07-24 2012-04-24 Lsi Corporation Skip operations for solid state disks
US8990476B2 (en) 2009-10-01 2015-03-24 Micron Technology, Inc. Power interrupt management
CN102043651B (en) * 2009-10-22 2013-07-03 鸿富锦精密工业（深圳）有限公司 NAND flash memory and data updating management method thereof
JP5844554B2 (en) 2011-06-08 2016-01-20 Ｊｆｅシステムズ株式会社 Data management storage system
CN102929884B (en) 2011-08-10 2016-05-04 阿里巴巴集团控股有限公司 A kind of method and device that shrinks virtual disk image file
US8806160B2 (en) 2011-08-16 2014-08-12 Pure Storage, Inc. Mapping in a storage system
US8578112B2 (en) 2012-02-23 2013-11-05 Hitachi, Ltd. Data management system and data management method
US8732403B1 (en) * 2012-03-14 2014-05-20 Netapp, Inc. Deduplication of data blocks on storage devices
US8615500B1 (en) 2012-03-29 2013-12-24 Emc Corporation Partial block allocation for file system block compression using virtual block metadata
US9075710B2 (en) 2012-04-17 2015-07-07 SanDisk Technologies, Inc. Non-volatile key-value store
US9875054B2 (en) 2013-03-06 2018-01-23 Ab Initio Technology Llc Managing operations on stored data units
US9959070B2 (en) 2013-03-06 2018-05-01 Ab Initio Technology Llc Managing operations on stored data units

Also Published As

Publication number Publication date
AU2014226446B2 (en) 2019-10-31
AU2014226446A1 (en) 2015-09-17
CN105027071B (en) 2018-11-09
CA2902868A1 (en) 2014-09-12
HK1216267A1 (en) 2016-10-28
WO2014137585A1 (en) 2014-09-12
EP2965187A1 (en) 2016-01-13
JP6491605B2 (en) 2019-03-27
KR102275431B1 (en) 2021-07-08
JP2016519795A (en) 2016-07-07
US20140258650A1 (en) 2014-09-11
EP2965187B1 (en) 2020-04-08
CN105027071A (en) 2015-11-04
KR20150125010A (en) 2015-11-06
US10133500B2 (en) 2018-11-20

Similar Documents

Publication Publication Date Title
CA2902868C (en) Managing operations on stored data units
MY181563A (en) Systems and methods of managing the capacity of attended delivery/pickup locations
WO2016073625A3 (en) Data management system
GB2484019A (en) An integrated approach for deduplicating data in a distributed environment that involves a source and a target
WO2015026679A3 (en) Disconnected operation for systems utilizing cloud storage
WO2010088148A3 (en) Systems and methods for managing files on a storage device
CN106687911A8 (en) The online data movement of data integrity is not damaged
WO2015066719A3 (en) Use of solid state storage devices and the like in data deduplication
TW200951714A (en) Memory system
WO2011116087A3 (en) Highly scalable and distributed data de-duplication
WO2015108671A3 (en) Storage management of data streamed from a video source device
MY170383A (en) Marking reference pictures in video sequences having broken link pictures
WO2016113636A3 (en) Secure distributed backup for personal device and cloud data
GB0805503D0 (en) Removal
TW200743965A (en) Mechanism and method to snapshot data
MY175611A (en) Information-processing system
WO2012092179A3 (en) Efficient storage tiering
MY176870A (en) Process system management system, server apparatus, management program, and management method
MX2016013227A (en) Method for storage device storing data and storage device.
IN2013CH05362A (en)
WO2015094799A3 (en) System and method of managing tags associated with block read voltages of a non-volatile memory
WO2014177934A3 (en) Chain of custody with release process
WO2018117968A8 (en) Systems and methods for automated bulk user registration spanning both a content management system and any software applications embedded therein
TW201643715A (en) Byte level granularity buffer overflow detection for memory corruption detection architectures
MX370076B (en) Method and apparatus for using label data to assist in performing a retail store function.

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20180305