CN102576321B - Performance storage system in fast photographic system for capacity optimizing memory system performance improvement - Google Patents
Performance storage system in fast photographic system for capacity optimizing memory system performance improvement Download PDFInfo
- Publication number
- CN102576321B CN102576321B CN201080042904.0A CN201080042904A CN102576321B CN 102576321 B CN102576321 B CN 102576321B CN 201080042904 A CN201080042904 A CN 201080042904A CN 102576321 B CN102576321 B CN 102576321B
- Authority
- CN
- China
- Prior art keywords
- storage
- data
- section
- performance
- storage system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/12—Replacement control
- G06F12/121—Replacement control using replacement algorithms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
- G06F3/0641—De-duplication techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of system for data storage includes the performance storage system for storing one or more data items.The data items of one or more of data items include data file or data block.The system also includes the section storage system of the snapshot of the data storage project for storing one or more of data items in performance storage system.The acquirement of the snapshot of the data storage project makes it possible to call the data storage project for such as being stored in snapshot.At least one new section write is stored as the reference to former memory paragraph.
Description
The application is to the entitled PERFORMANCE IMPROVEMENT OF A of submission on the 22nd of September in 2009
U.S. Provisional Patent Application No.61/277271 (the attorney dockets of CAPACITY OPTIMIZED STORAGE SYSTEM
DDOMP033+) claim priority, this application is incorporated herein by reference for all purposes.
Background technology
It is efficient in terms of memory capacity that section removal repeats (deduplication) storage system.Removed in section and repeated
In storage system, data flow or data block are divided into section.Memory paragraph in the case of not stored before section.Before section by
In the case of storage, reference of the storage to the section of former storage.Also store the section of relevant storage how to be used to reconstructing data flow or
The information of data block.However, section removal repeats storage system being deposited for data storage in systems and retrieval in some cases
The data of storage are too slow.Storage can become too slow because before being required to scan for storage section with understand entrance section whether with
The section of preceding storage is identical.Retrieval can become too slow, because data must be reconstructed from multiple data segments of former storage.
Brief description of the drawings
In following the detailed description and the accompanying drawings, different embodiments of the invention are disclosed.
Figure 1A is the block diagram of the embodiment for showing storage system.
Figure 1B is the block diagram of the embodiment for showing storage custom system.
Fig. 2 is the block diagram of the embodiment for showing section storage system.
Fig. 3 is the block diagram of the embodiment for showing performance storage system.
Fig. 4 is the flow chart of the embodiment for showing the process for storage system.
Fig. 5 is the flow chart of the embodiment for showing the process for storage system.
Fig. 6 is the flow chart of an embodiment of the process for showing the data for providing request from storage system.
Fig. 7 is the flow of an embodiment of the process for showing the snapshot for obtaining data items in performance memory location
Figure.
Specific embodiment
The present invention can realize in many ways, including as process, equipment, system, material composition, computer-readable
The computer program product and/or processor implemented in storage media, as such arranged to execution is coupled on the memory of processor
And/or the processor of the instruction provided by the memory.In this description, these are realized or the present invention is adoptable any
Other forms can be described as technology.Generally, the step of disclosed process can be changed within the scope of the present invention is sequentially.Unless otherwise saying
Bright, otherwise, the component that processor and memory etc. are described as being configured to execution task can be realized to be temporarily configured to
Preset time performs the component of the task or is fabricated to the specific components for performing the task.As used herein, term " treatment
Device " assignment is set to one or more devices, circuit and/or the process cores of the data such as treatment computer program instructions.
The detailed description of one or more embodiments of the invention is provided together with the accompanying drawing of the display principle of the invention below.
The present invention is described together with such embodiment, but the present invention is not limited to any embodiment.The scope of the present invention only receives right
It is required that limitation, and the present invention includes many alternative, modifications and equivalent.Many specific details are stated in the following description
To provide of the invention being understood in detail.These details are provided for the purpose of example, and the present invention can some or
Put into practice according to claim in the case of all these specific details are non-existent.It is related to the present invention for clearly purpose
Known technologic material is not described in detail in order to avoid unnecessarily obscuring the present invention in technical field.
Disclosed herein is a kind of system for data storage.The system is included for storing one or more data items
Performance storage system.The data items of one or more of data items include data file or data block.The system is also
The section of the snapshot including the data storage project for storing one or more of data items in performance storage system is deposited
Storage system.The acquirement of the snapshot of the data storage project makes it possible to the storage number for calling (recall) such as to be stored in snapshot
According to project.At least one new section write is stored as the reference to former memory paragraph.
In certain embodiments, a kind of system for data storage is disclosed.The system includes being used for data storage stream
Or the performance memory location of data block.Data flow or data block include one or more data items.The system also includes being used for
The data items of the storage of one or more of data items are stored as the section storage system of section set automatically.The system is also
Performance section including memory paragraph set in the case of for being stored using section storage system in the data items of the storage is deposited
Storage unit.
In certain embodiments, a kind of system for data storage is disclosed.The system include performance memory location and
Performance section memory cell.The system also includes determiner.Determiner determines whether the data of request are stored in performance memory location
In.In the case where the data of request are not stored in performance memory location, determiner determines whether the data of request store
In performance section memory cell.
In certain embodiments, storage system provides performance by the data storage in performance storage system.Performance is deposited
The data stored in storage system are stored automatically in the storage system of memory capacity optimization (for example, section storage system, removal repeated segments
Storage system, compression storage system etc.) in.In various embodiments, expired in performance storage system, file completes to be used,
Period terminates, indicate scheduling transmission or for automatic storage any other appropriate criterion in the case of, there is automatic storage.
In certain embodiments, after one data items of automatic storage in the storage system of capacity optimization, can be from the storage of performance optimization
The system-kill data items.In certain embodiments, user can be used for high-performance from storage system wishing data items
Or in the case of another network-attached system, data items are sent back into performance storage system.In certain embodiments, send back
The data items of performance storage system are stored (for example, as removal repeated segments, being compressed) using capacity optimal way.
In certain embodiments, it is determined that one or more data items need not be used for from storage system by user or another
In the case that one network-attached system carrys out high-performance access, one or more of data item are deleted from performance storage system
Mesh.Before being deleted from performance storage system, determine whether one or more of data items store the storage in capacity optimization
In system, and they be not stored in it is therein in the case of, by one or more of data items storage to capacity optimization
Storage system.
In certain embodiments, stored by using performance, improve the advantage that section removal repeats storage；Section removal is repeated
Store by the case where the new section for receiving is stored, the section of reception to be only stored as the reference of the section to former storage,
So as to be efficient in terms of memory capacity；Performance storage can be stored as remove repeated segments data and to according to
The data for being stored for originally receiving are realized efficiently reading and writing.
In various embodiments, storage system include client/user system in operation performance storage system and individually
The section storage system run in system；In face of multiple performance storage systems of common section storage system；With for the access that is exceedingly fast
Some quick local flash memories a group application server, but section storage device is not on network and is replicated, or in office
The performance run on what appropriate hardware and section system component it is any other appropriately configured.
Although the following examples optimize storage device by the capacity including section storage device being described, also can
The storage system optimized using any other capacity-for example, using compression, removing repetition, increment (delta) using block rank and going
The storage system of any other appropriate capacity optimization except repeating or for storing.
Figure 1A is the block diagram of the embodiment for showing storage system.In the example shown, storage system 100 receives storage
And/or retrieve the request of one or more data items.In various embodiments, one or more of data items are data
Stream or data block or any other proper data structure or a part for packet.Storage system 100 is directly or through network 108 from depositing
Storage custom system 110 receives request.In certain embodiments, storage custom system 110 is can to transmit request to storage system
One of 100 multiple systems.
Storage system 100 includes system interface 102, performance storage system 104 and section storage system 106.System interface 102
Receive the request that data storage project retrieves data items to storage system 100 and/or from storage system 100.System interface 102
The data items that will be retrieved are delivered to network 108 and/or storage custom system 110.System interface 102 from network 108 and/or
Storage custom system 110 transmits the data items to be stored by storage system 100.
Data items performance storage system 104 is stored.Performance storage system 104 can efficiently respond storage and
Retrieve the request of data.Data items are sent to section storage system 106 from performance storage system 104.In certain embodiments, section
Storage system 106 is processed and is divided into by data items from the receiving data item mesh of performance storage system 104, and data items
Section, and repetition is removed to section (for example, to determine that whether each section is stored, and deposited before section in the past
In the case of storage, storage is quoted rather than carrying out memory paragraph according to what is received).In certain embodiments, in section storage system 106
Data items are transferred back to performance storage system 104 and are stored as section set after middle storage.In certain embodiments, according to original
Being stored from performance after these data items are transferred back to performance storage system 104 the source data item mesh that stores for being received be
System 104 is deleted.
In certain embodiments, section storage system 106 including compression section storage system (for example, Lempel-Ziv compressions,
Lempel-Ziv-Welsh compressions, Lempel-Ziv-Renau compressions etc.).
The data items asked through system interface 102 are retrieved from performance storage system 104 or section storage system 106.
In certain embodiments, the data items for being stored in section storage system 106 rather than performance storage system 104 have many asking
In the case of asking, data items can be sent to performance storage system 104, to improve the response performance of storage system 100.
In various embodiments, performance storage system 104 include flash memory device, fiber channel storage device, persistently
Property memory storage apparatus, block addressable memory (for example, similar to addressable 512K blocks such as disk drive memory block,
Different from byte-addressable memories or storage device, fixed size block addressing and/or logical addressable memory), file system
Memory, random access memory or any other appropriate storage system or system component that system is organized.In some embodiments
In, performance storage system 104 includes that being stored as compressed data represents (for example, the set for the section that removal is repeated) and uncompressed data
Represent both data.
In various embodiments, section storage system 106 includes providing together functional system cluster of section storage system.
In various embodiments, section storage system 106 carrys out data storage project using variable length segment, can ground with content
Location section (for example, using the fingerprint of section), is replicated (for example, storage such as section is deposited using duplicate (replica) section storage system 112
The snapshot and/or section of the storage of storage system 106), be replicated according to replication protocol (for example, according to timetable, in the data of scheduled volume
After storing, or according to any other appropriate agreement), represent with the data different from performance storage system 104 (for example,
Duan Jihe compares former data, content addressed compared to logic or physical addressing, and variable-block is represented compared to fixed block, and compression is not compared to pressing
Contracting data), or for any other appropriate feature of section storage system.In various embodiments, section storage system 106 by
Replicated similar to multiple duplicates section storage system of duplicate section storage system 112, the section each self-replication of storage system of these duplicates
Such as the part or all of data items and/or snapshot of the storage of section storage system 106.
Figure 1B is the block diagram of the embodiment for showing storage custom system.In certain embodiments, the storage system of Figure 1B
Similar to the storage system of Figure 1A, but in the different subregions-for example, system interface and raw energy of the functional property of different system band of position
Storage system includes the subsystem in storage custom system, and is communicated with section storage system by network.In some realities
In applying example, can there are several such performance storage subsystems to be run in several different storage custom systems, its it is all with it is single
Section storage system is communicated.In the example shown, storage system 150 receives storage and/or retrieves one or more data item
Purpose is asked.In various embodiments, one or more of data items are data flow or data block or any other appropriate
Data structure or a part for packet.Storage system 150 directly receives request from storage custom system 160.In some embodiments
In, storage custom system 160 is can to transmit request to arrive one of multiple systems of storage system 150.Storage custom system 160 is wrapped
The performance storage system 154 combined with section storage system 150 is included, it includes high speed and efficient data-storage system.Various
In embodiment, performance storage system 154 includes high-speed solid-state memory, ram disc, high speed magnetic memory or any other appropriate
The combination of memory or memory.
Storage system 150 includes system interface 152, performance storage system 154 and section storage system 156.System interface 152
Receive the request that data storage project retrieves data items to storage system 150 and/or from storage system 100.System interface
The data items that 152/ performance storage system 154 will be retrieved are delivered to network 158 and section storage system 156.
Data items performance storage system 154 is stored.Performance storage system 154 can efficiently be responded and stored
With the request of data to be retrieved.Data items are sent to section storage system 156 from performance storage system 154.In some embodiments
In, section storage system 156 is from the receiving data item mesh of performance storage system 154, and data items are processed with by data items
Be divided into section, and section is removed repetition (for example, with determine each section whether before stored, and before section
In the case of stored, storage is quoted rather than carrying out memory paragraph according to what is received).In certain embodiments, stored in section
Data items are transferred back to performance storage system 154 and are stored as section set after being stored in system 156.In certain embodiments,
Stored from performance after these data are transferred back to performance storage system 154 according to the original source data item mesh for being stored for receiving
System 154 is deleted.
In certain embodiments, section storage system 156 including compression section storage system (for example, Lempel-Ziv compressions,
Lempel-Ziv-Welsh compressions, Lempel-Ziv-Renau compressions etc.).
Data items are stored from performance storage system 154 or if not existing in performance storage system 154 from section
System 156 is requested and retrieves.In certain embodiments, deposited in section storage system 156 rather than performance storage system 154
In the case that the data items of storage there are many requests, data items can be sent to performance storage system 154, to improve response
Performance.
In various embodiments, performance storage system 154 include flash memory device, fiber channel storage device, persistently
Property memory storage apparatus, block addressable memory (for example, similar to addressable 512K blocks such as disk drive memory block,
Different from byte-addressable memories or storage device, fixed size block addressing and/or logical addressable memory), file system
Memory, random access memory or any other appropriate storage system or system component that system is organized.In some embodiments
In, performance storage system 154 includes that being stored as compressed data represents (for example, set of removal repeated segments) and uncompressed tables of data
Show both data.
In various embodiments, section storage system 156 carrys out data storage project using variable length segment, can ground with content
Location section (for example, using the fingerprint of section), is replicated (for example, storage such as section storage system 156 using duplicate section storage system 162
The snapshot and/or section of storage), be replicated according to replication protocol (for example, according to timetable, after the data of scheduled volume are stored,
Or according to any other appropriate agreement), with being represented (for example, compared with section set with the different data of performance storage system 154
Former data, content addressed compared to logic or physical addressing, variable-block represents that, compared to fixed block, uncompressed data are compared in compression), or
For any other appropriate feature of section storage system.In various embodiments, section storage system 156 is by similar to duplicate
Multiple duplicates section storage system of section storage system 162 is replicated, and each self-replication such as the section storage of these duplicates section storage system is
The part or all of data items and/or snapshot of the storage of system 156.
Fig. 2 is the block diagram of the embodiment for showing section storage system.In certain embodiments, the system of Fig. 2 is used to realize
The section storage system 106 of Fig. 1.In the example shown, section storage system 200 includes interface 202, sectionaliser 204, repeated elimination device
206th, file system 208, index 210 and section storage device 212.Section storage system 200 uses the receiving data item mesh of interface 202.
Data items are processed by sectionaliser 204 and file system 208.Data items are divided into section by sectionaliser 204.In various embodiments
In, certain (for example, calculating a function in the various positions of data items, is equal in the function by using the technology based on content
It is minimum value, maximum or other relative to other functional values calculated for the data items during individual value or in the value
During extreme value), technology based on non-content (for example, based on data items attribute-for example, byte length, title, date created) or
Any other appropriate technology recognizes segment boundary, so as to data items are divided into section.In various embodiments, section is limited to
Section or any other appropriate limitation of minimum and/or maximum length, the minimum per data items or maximum quantity.File system
Section of 208 processing informations to indicate to be associated with data items.In certain embodiments, fingerprint list is used to indicate and data item
The associated section of mesh.Index 210 is used for the section stored in positioning section storage device 212.
Repeated elimination device 206 recognizes whether the section of new reception is stored in section storage device 212.Exist in section
In section storage device 212 it is stored in the case of, storage is to the reference of the section of former storage rather than the new section for receiving of storage.
Interface 202 receives the request of retrieval data items.Interface 202 is communicated with retrieving data with file system 208
Project.File system 208 determines the section being associated with the data items of request, is communicated with index 210 and is stored with positioning section
The data items of the section stored in device 212, the suitable section stored in reading section storage device 212, and RECONFIGURATION REQUEST.Response
Request, data items are provided through interface 202.
In certain embodiments, with data segment be associated file using pointer tree (such as fingerprint) by file system 208.
In the case that data items are changed, different sections will be associated with data items, and due to readily identified suitable using tree construction
When pointer, therefore, to tree interior joint pointer change will be high from the bottom of the tree (or bibliographic structure) being associated with filename
Effect ground fluctuation (ripple) arrives top.
Fig. 3 is the block diagram of the embodiment for showing performance storage system.In certain embodiments, the performance storage system of Fig. 3
Unite for the performance storage system 104 for realizing Fig. 1.In the example shown, performance storage system 300 includes interface 302, file system
System 304, performance memory location 306, performance section memory cell 308 and performance storage transmission manager 310.Interface 302 is received will
The data items of storage.Data items performance memory cell 306 is stored.File system 304 stores relevant data item
Purpose information is to be conducive to retrieving data items from performance memory location 306.In certain embodiments, file system 304 is not
In the presence of, and Telefile or the data that are stored with file system be used for recognition performance memory cell 306 in file.Property
Transmission manager 310 can be stored and manage data items from performance memory location 306 to the transmission of section memory cell.Performance storage is passed
Manager 310 is sent also to manage the transmission for being stored as the data items of section set to performance section memory cell 308.In some embodiments
In, be stored as the data items of section set be sent to performance section memory cell 308 after, delete performance memory location 306 in deposit
The identical data project of storage.In certain embodiments, performance storage transmission manager 310 can be used sectionaliser or repeated elimination device
Data items are sent to performance section memory cell 308 from performance memory location 306 and data items are not first sent to section and are deposited
Storage system.
Interface 302 receives the request of retrieval data items.Data items are single from performance memory location 306 or performance section storage
Unit 308 or section storage system are retrieved.In certain embodiments, performance section is being checked in the case of request retrieval data items
Before memory cell 308, performance memory location 306 is checked.In certain embodiments, before section storage system is checked, check
Performance section memory cell 308.In certain embodiments, checked to perform inspection by using file system 304.
In certain embodiments, performance storage transmission manager 310 is by obtaining the number stored in performance memory location 306
According to the snapshot of project, data items are sent to a section storage system.Snapshot makes it possible to call the data item stored during such as snapshot
Mesh.In certain embodiments, according to snapshot agreement (for example, indicating when performance memory location has been expired, in performance memory location
306 have a certain amount of space still can use when, within data items are in the period of predetermined be not accessed when, can in process bandwidth
For data items to be sent into data efficient storage system (for example, removal repeated data section storage device, compression storage dress
Put) when etc. certain time occur snapshot agreement, or any other appropriate agreement), or it receive instruction should create soon
According to signal when perform snapshot.
In certain embodiments, section storage device has the complete copy (copy) of snapshot, therefore, it can be excellent with capacity
Change form replicates complete snapshot, the complete copy of the snapshot needed for having disaster recovery so as to remote site.
In certain embodiments, the data items (example that any snapshot to be stored in acquisition performance memory cell 306 is not used
Such as, file or data items are temporary file or data items, and are not deposited in performance memory location 306 during snapshot
；File or data items version are created after snapshot, and are then written over before next snapshot；File or data items are
Updated in the middle of only existing between snapshot twice etc.).In certain embodiments, data item in performance memory cell 306
The daily record of the change of mesh or file performs snapshot.In certain embodiments, snapshot is created by retaining the root of pointer tree.
In certain embodiments, after data items or file have been stored or be sent to section storage system due to snapshot
(for example, certain time immediately or after, the need for this is depending on retention data project in performance system), performance system is deleted
Except data items or file.
Fig. 4 is the flow chart of the embodiment for showing the process for storage system.In certain embodiments, the mistake of Fig. 4
Journey is realized by the storage system 100 of Fig. 1.In the example shown, in 400, performance storage system carrys out data storage stream
Or data block, wherein, data flow or data block include one or more data items.In certain embodiments, performance storage system
Unite and come data storage stream or data block (for example, without compression) according to what is received, and data flow or data block can be provided
Quick storage and call.In various embodiments, performance storage system is including flash memory, fiber channel driver, based on semiconductor
Memory, non-volatile storage or any other appropriate capability store.In 402, taken using section storage system
The snapshot of the data items that must be stored, wherein, snapshot makes it possible to call the data items for such as being stored in snapshot.In various realities
In applying example, according to including periodically obtain in time snapshot (for example, per hour, every 12 hours, daily, weekly, monthly etc.),
Capabilities store obtains snapshot, is obtained when the utilization rate of device is low when having stored block, byte or the file of other predetermined quantity
The snapshot agreement or any other appropriate agreement of the snapshot of block, byte or file that snapshot, acquirement are not accessed recently is carried out
Snapshot.
Fig. 5 is the flow chart of the embodiment for showing the process for storage system.In certain embodiments, the mistake of Fig. 5
Journey is realized by the performance storage system 104 of Fig. 1.In the example shown, in 500, in performance memory location by data flow or
Data block is stored as data items.In 502, determine whether data items will be stored as section collection automatically in section storage system
Close.In various embodiments, the data items that store automatically are one of data items of performance memory location storage, a part
Or all, or any other appropriate data items that performance memory location is stored.In 504, should not be by section in data items
In the case that memory cell is stored, the process waits and controls to be delivered to 502.In various embodiments, according to certain agreement
Storing data automatically project, wherein, the agreement indicates scheduling during storing data automatically project (for example, time, date, cycle
Property etc.) or condition (for example, percentage memory is full, access frequency, memory unit access are loaded, processor is loaded etc.).Each
Plant in embodiment, respond the signal and data storage project for receiving.It is automatic as section set storage in data items in 506
In the case of in the section storage system, the data items of storage are deleted in performance memory location.In certain embodiments, not from
The some or all of data items of performance memory location deletion (for example, it is high in access activity, or for the processor of storage system
In the case of load height).In 508, the section set of data storage project is stored in performance section memory cell.In various realities
Apply in example, performance section memory cell includes flash memory, fiber channel storage device, non-volatile storage or any other appropriate property
Can storage device.In certain embodiments, in the case where wishing that the performance to data items is accessed, for the section of data items
Set is stored in performance section memory cell.
Fig. 6 is the flow chart of an embodiment of the process for showing the data for providing request from storage system.At some
In embodiment, the process of Fig. 6 is realized by the storage system 100 of Fig. 1.In the example shown, received in 600 and read asking for data
Ask.In 602, it is determined that whether the data of request are in performance memory location.In 604, stored in performance in the data of request
In the case of in unit, the data of request are provided from performance memory location.In 606, do not stored in performance in the data of request
In the case of in unit, it is determined that whether the data of request are in performance section memory cell.In 608, in the data asked in property
In the case of in energy section memory cell, the data of request are provided from performance section memory cell.In 610, in the data asked not
Performance section memory cell in the case of, it is determined that request data whether in section storage system.In 612, in request
In the case that data are in the section storage system, the data of request are provided from section storage system.In 614, data quilt in due course
Lifted performance section memory cell (for example, if it is determined that wish performance access-for example, multiple request may be directed to the data),
And the process terminates.In 616, in the case where the data of request are not in section storage system, the data of request are indicated not
Stored by storage system, and the process terminates.
Fig. 7 is the flow of an embodiment of the process for showing the snapshot for obtaining data items in performance memory location
Figure.In certain embodiments, the process of Fig. 7 is realized by the performance storage transmission manager 310 of Fig. 3.In the example shown, exist
New snapshot is created in 700 in performance memory location.In various embodiments, based on snapshot agreement (for example, wherein agreement according to
Utilization rate, memory degree of filling, access, new data project include the condition of data items or criterion being arranged on snapshot, or
Person any other appropriate condition or criterion), the snapshot in performance memory location includes a number of performance memory location storage
According to project, a part of data items or all data items.At 702, it is determined whether have the former snapshot of performance memory location.
In 704, in the case of snapshot before no performance memory location, the pair of new snapshot is stored using section storage system
This.In 706, if the former snapshot of performance memory location, it is determined that the increment before new snapshot and former snapshot.
In 708, the copy of snapshot before creating, and using the increment to the copy creating the pair of new snapshot in section storage system
This.Copy can be virtual repetitions, including to the new pointer of same section, or it can be new physicses copy, or it can be with
It is combination.
In certain embodiments, the section of All Files or data items including for snapshot and associated file or number
Can be used in efficiently recognizing the increment between snapshot according to the pointer tree of project.
Although for clearness of understanding with certain detailed description above-described embodiment, the present invention is not limited to
The details of offer.Implementing the present invention has many alternate ways.Disclosed embodiment is illustrative rather than restricted.
Required right is：
Claims (20)
1. a kind of system for data storage, including：
Performance storage system, including：
Performance memory location for storing at least one data items, at least one data items include containing multiple sections
Data block or data file；With
Performance section memory cell for storing the section that at least one set of removal comprising one or more data items is repeated, wherein
It is described comprising one or more of data items in the case where wishing to access the performance of one or more data items
The section that at least one set of removal is repeated is stored in the performance section memory cell as section set, and wherein, in institute
State after the section that at least one set of removal repeats is transferred back to the performance section memory cell, removed from the performance memory location and made
The one or more of data items stored for primary reception；And
Section storage system, for storing one or more data items described in the performance storage system automatically according to agreement
Storage data items snapshot, wherein the scheduling when agreement indicates to store one or more of data items automatically
Or condition, wherein the acquirement of the snapshot of the data items of the storage makes it possible to call as stored in the snapshot
The data items of the storage, and the new section write of wherein at least one is stored as the reference of the section to former storage,
--- wherein described scheduling is specified periodically,
--- wherein described condition is full including percentage memory,
Wherein, the performance storage system is used for efficiently response storage and the request of retrieval data, while described section of storage system
Unite for compressed data.
2. the system as claimed in claim 1, wherein the performance storage system includes following one or more：Flash memory, optical fiber
Channel storage device, non-volatile storage, block addressable memory, the memory of file system organization or random access memory
Device.
3. the system as claimed in claim 1, wherein any snapshot is not used to capture one or more of data items
The data items of the second storage.
4. the system as claimed in claim 1, wherein storing institute by obtaining the snapshot in described section of storage system
After stating the data items of storage, the performance storage system deletes the data items of the storage.
5. the system as claimed in claim 1, wherein described section of storage system stores the snapshot using variable length segment.
6. the system as claimed in claim 1, wherein described section of storage system has content addressable section.
7. the system as claimed in claim 1, wherein replicating described section of storage system using duplicate section storage system.
8. the system as claimed in claim 1, wherein the data at least a portion of the performance storage system are represented and institute
State the data in section storage system and represent different.
9. the system as claimed in claim 1, wherein described section of storage system includes the complete of all data items comprising snapshot
Whole copy, wherein complete copy of the described section of storage system using all data items, all institutes are replicated in capacity optimization form
State data items.
10. a kind of method for data storage, including：
One or more data items are stored in performance storage system, wherein the data item of one or more of data items
Mesh includes data file or data block；And
One or more of data item in storing the performance storage system automatically in section storage system according to agreement
The snapshot of the data items of purpose storage, wherein the tune when agreement indicates to store one or more of data items automatically
Degree or condition, wherein the acquirement of the snapshot of the data items of the storage makes it possible to call what is stored during snapshot as described
The data items of the storage, and the new section write of wherein at least one is stored as the reference of the section to former storage,
--- wherein described scheduling is specified periodically,
--- wherein described condition is full including percentage memory,
Wherein, the performance storage system is used for efficiently response storage and the request of retrieval data, while described section of storage system
Unite for compressed data.
A kind of 11. systems for data storage, including：
Performance memory location, for being stored in data flow or data block, wherein the data flow or the data block include one or
Multiple data items；
Section storage system, for being stored come the data items of the automatic storage by one or more of data items according to agreement
It is the set of section, wherein scheduling or condition when the agreement indicates to store one or more of data items automatically；
Performance section memory cell, in the case of the data items of the storage are stored using described section of storage system
The set of memory paragraph,
--- wherein described scheduling is specified periodically,
--- wherein described condition is full including percentage memory,
Wherein, the performance storage system is used for efficiently response storage and the request of retrieval data, while described section of storage system
Unite for compressed data.
12. systems as claimed in claim 11, wherein after the data items that described section of storage system stores the storage, institute
State the data items that performance memory location deletes the storage.
13. systems as claimed in claim 11, wherein any snapshot is not used to capture one or more of data items
Second storage data items.
14. systems as claimed in claim 11, wherein upon the number for obtaining in described section of storage system the storage
The data items of the storage are stored according to the snapshot of project, the performance memory location just deletes the data item of the storage
Mesh.
15. systems as claimed in claim 11, wherein described section of storage system stores the storage using variable length segment
Data items snapshot.
16. systems as claimed in claim 11, wherein replicating described section of storage system using duplicate section storage system.
17. systems as claimed in claim 11, wherein the data in the performance memory location are represented and described section of storage system
Data in system represent different.
18. systems as claimed in claim 11, wherein performance section memory cell includes being represented using compressed data being deposited
The data of storage.
19. systems as claimed in claim 11, also including for determining whether the data of request are stored in performance storage
The number of the request is determined in unit and in the case where the data of the request are not stored in the performance memory location
According to whether store the performance section memory cell in determiner.
A kind of 20. methods for data storage, including：
Data storage stream or data block in performance memory location, wherein the data flow or the data block include one or many
Individual data items；
The data items of the storage of one or more of data items are stored automatically according to agreement using section storage system
It is the set of section, wherein scheduling or condition when the agreement indicates to store one or more of data items automatically；And
In the case where the data items of the storage are stored using described section of storage system, in performance section memory cell
The set of memory paragraph,
--- wherein described scheduling is specified periodically,
--- wherein described condition is full including percentage memory,
Wherein, the performance storage system is used for efficiently response storage and the request of retrieval data, while described section of storage system
Unite for compressed data.
Applications Claiming Priority (9)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US27727109P | 2009-09-22 | 2009-09-22 | |
| US61/277271 | 2009-09-22 | ||
| PCT/US2010/002593 WO2011037624A1 (en) | 2009-09-22 | 2010-09-21 | Snapshotting a performance storage system in a system for performance improvement of a capacity optimized storage system |
| US12/887,414 US8447726B2 (en) | 2009-09-22 | 2010-09-21 | Performance improvement of a capacity optimized storage system including a determiner |
| US12/887404 | 2010-09-21 | ||
| US12/887,404 US9141300B2 (en) | 2009-09-22 | 2010-09-21 | Performance improvement of a capacity optimized storage system using a performance segment storage system and a segment storage system |
| US12/887414 | 2010-09-21 | ||
| US12/887402 | 2010-09-21 | ||
| US12/887,402 US8677052B2 (en) | 2009-09-22 | 2010-09-21 | Snapshotting of a performance storage system in a system for performance improvement of a capacity optimized storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102576321A CN102576321A (en) | 2012-07-11 |
| CN102576321B true CN102576321B (en) | 2017-06-09 |
Family
ID=43757494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201080042904.0A Active CN102576321B (en) | 2009-09-22 | 2010-09-21 | Performance storage system in fast photographic system for capacity optimizing memory system performance improvement |
Country Status (4)
| Country | Link |
|---|---|
| US (8) | US9141300B2 (en) |
| EP (1) | EP2480971A4 (en) |
| CN (1) | CN102576321B (en) |
| WO (1) | WO2011037624A1 (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8291183B2 (en) * | 2009-01-15 | 2012-10-16 | Emc Corporation | Assisted mainframe data de-duplication |
| US8452932B2 (en) * | 2010-01-06 | 2013-05-28 | Storsimple, Inc. | System and method for efficiently creating off-site data volume back-ups |
| US8862560B1 (en) | 2010-06-21 | 2014-10-14 | Emc Corporation | Compression system pause and auto-resume |
| US8886901B1 (en) | 2010-12-31 | 2014-11-11 | Emc Corporation | Policy based storage tiering |
| US9280550B1 (en) * | 2010-12-31 | 2016-03-08 | Emc Corporation | Efficient storage tiering |
| US9396242B2 (en) * | 2011-04-11 | 2016-07-19 | Salesforce.Com, Inc. | Multi-master data replication in a distributed multi-tenant system |
| US11184156B2 (en) * | 2011-07-27 | 2021-11-23 | Aon Global Operations Se, Singapore Branch | Impact data manager for dynamic data delivery |
| US9058120B2 (en) * | 2011-11-09 | 2015-06-16 | International Business Machines Corporation | Setting optimal space allocation policy for creating dependent snapshots to enhance application write performance and reduce resource usage |
| CN103403679B (en) * | 2011-12-31 | 2016-08-31 | 华为技术有限公司 | Data-updating method during volatile storage devices persistence and device |
| JP5561303B2 (en) * | 2012-03-30 | 2014-07-30 | 日本電気株式会社 | Data replication system, data replication method, and program thereof |
| US11036392B2 (en) * | 2013-02-26 | 2021-06-15 | Pure Storage, Inc. | Determining when to use convergent encryption |
| JP6229733B2 (en) * | 2013-11-21 | 2017-11-15 | 富士通株式会社 | Information processing apparatus, method, program, and recording medium |
| CN104714755B (en) * | 2013-12-13 | 2020-01-03 | 华为技术有限公司 | Snapshot management method and device |
| CN104751235A (en) * | 2013-12-27 | 2015-07-01 | 伊姆西公司 | Method and device for data mining |
| US10656864B2 (en) | 2014-03-20 | 2020-05-19 | Pure Storage, Inc. | Data replication within a flash storage array |
| US10628380B2 (en) * | 2014-07-24 | 2020-04-21 | Netapp Inc. | Enabling data replication processes between heterogeneous storage systems |
| US9547560B1 (en) | 2015-06-26 | 2017-01-17 | Amazon Technologies, Inc. | Amortized snapshots |
| US10114704B1 (en) * | 2015-10-30 | 2018-10-30 | Intuit Inc. | Updating database records while maintaining accessible temporal history |
| US10296633B1 (en) * | 2016-03-23 | 2019-05-21 | Amazon Technologies, Inc. | Data storage management system |
| US11507597B2 (en) | 2021-03-31 | 2022-11-22 | Pure Storage, Inc. | Data replication to meet a recovery point objective |
| CN113885809B (en) * | 2021-12-07 | 2022-03-18 | 云和恩墨(北京)信息技术有限公司 | Data management system and method |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1504912A (en) * | 2002-12-05 | 2004-06-16 | �Ҵ���˾ | Performance and memory bandwidth utilization for tree searches using tree fragmentation |
Family Cites Families (43)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5721918A (en) | 1996-02-06 | 1998-02-24 | Telefonaktiebolaget Lm Ericsson | Method and system for fast recovery of a primary store database using selective recovery by data type |
| JPH10154101A (en) * | 1996-11-26 | 1998-06-09 | Toshiba Corp | Data storage system and cache controlling method applying to the system |
| JP2000163288A (en) | 1998-11-30 | 2000-06-16 | Nec Corp | Data storage system, data rearranging method, and recording medium |
| JP4186293B2 (en) * | 1999-02-10 | 2008-11-26 | 株式会社ニコン | Electronic camera |
| JP3663075B2 (en) | 1999-04-05 | 2005-06-22 | シャープ株式会社 | Information processing device |
| US6915397B2 (en) * | 2001-06-01 | 2005-07-05 | Hewlett-Packard Development Company, L.P. | System and method for generating point in time storage copy |
| US6959310B2 (en) | 2002-02-15 | 2005-10-25 | International Business Machines Corporation | Generating data set of the first file system by determining a set of changes between data stored in first snapshot of the first file system, and data stored in second snapshot of the first file system |
| US6898667B2 (en) * | 2002-05-23 | 2005-05-24 | Hewlett-Packard Development Company, L.P. | Managing data in a multi-level raid storage array |
| US6934822B2 (en) | 2002-08-06 | 2005-08-23 | Emc Corporation | Organization of multiple snapshot copies in a data storage system |
| US7065619B1 (en) * | 2002-12-20 | 2006-06-20 | Data Domain, Inc. | Efficient data storage system |
| US6928526B1 (en) | 2002-12-20 | 2005-08-09 | Datadomain, Inc. | Efficient data storage system |
| DE60221140T2 (en) | 2002-12-30 | 2008-03-20 | Stmicroelectronics S.R.L., Agrate Brianza | Supply architecture for the supply voltage of several memory modules |
| US20040153481A1 (en) | 2003-01-21 | 2004-08-05 | Srikrishna Talluri | Method and system for effective utilization of data storage capacity |
| US20040153614A1 (en) * | 2003-02-05 | 2004-08-05 | Haim Bitner | Tape storage emulation for open systems environments |
| US7231409B1 (en) | 2003-03-21 | 2007-06-12 | Network Appliance, Inc. | System and method for reallocating blocks in checkpointing bitmap-based file systems |
| US7143251B1 (en) | 2003-06-30 | 2006-11-28 | Data Domain, Inc. | Data storage using identifiers |
| US7353218B2 (en) * | 2003-08-14 | 2008-04-01 | International Business Machines Corporation | Methods and apparatus for clustering evolving data streams through online and offline components |
| JP4907059B2 (en) * | 2004-01-26 | 2012-03-28 | 大日本印刷株式会社 | Computer system and automatic backup method for the data |
| EP1577782B1 (en) | 2004-02-12 | 2010-04-28 | Irdeto Access B.V. | Method and system of external data storage |
| US7634615B2 (en) * | 2004-06-10 | 2009-12-15 | Marvell World Trade Ltd. | Adaptive storage system |
| US7254682B1 (en) | 2004-07-28 | 2007-08-07 | Symantec Corporation | Selective file and folder snapshot image creation |
| US20060123211A1 (en) | 2004-12-08 | 2006-06-08 | International Business Machines Corporation | Method for optimizing a snapshot operation on a file basis |
| TW200708983A (en) | 2005-08-16 | 2007-03-01 | Benq Corp | Mobile electronic device and data processing system utilizing the same |
| US7937269B2 (en) * | 2005-08-22 | 2011-05-03 | International Business Machines Corporation | Systems and methods for providing real-time classification of continuous data streams |
| US7584338B1 (en) | 2005-09-27 | 2009-09-01 | Data Domain, Inc. | Replication of deduplicated storage system |
| US7882064B2 (en) | 2006-07-06 | 2011-02-01 | Emc Corporation | File system replication |
| US7504969B2 (en) * | 2006-07-11 | 2009-03-17 | Data Domain, Inc. | Locality-based stream segmentation for data deduplication |
| US8880480B2 (en) * | 2007-01-03 | 2014-11-04 | Oracle International Corporation | Method and apparatus for data rollback |
| US7853750B2 (en) * | 2007-01-30 | 2010-12-14 | Netapp, Inc. | Method and an apparatus to store data patterns |
| US7769971B2 (en) * | 2007-03-29 | 2010-08-03 | Data Center Technologies | Replication and restoration of single-instance storage pools |
| EP2153340A4 (en) * | 2007-05-08 | 2015-10-21 | Riverbed Technology Inc | A hybrid segment-oriented file server and wan accelerator |
| US8095804B1 (en) | 2007-05-25 | 2012-01-10 | Emc Corporation | Storing deleted data in a file system snapshot |
| JP5194703B2 (en) | 2007-10-16 | 2013-05-08 | ソニー株式会社 | Data processing apparatus and shared memory access method |
| US7567188B1 (en) | 2008-04-10 | 2009-07-28 | International Business Machines Corporation | Policy based tiered data deduplication strategy |
| US20090307329A1 (en) * | 2008-06-06 | 2009-12-10 | Chris Olston | Adaptive file placement in a distributed file system |
| US8316064B2 (en) * | 2008-08-25 | 2012-11-20 | Emc Corporation | Method and apparatus for managing data objects of a data storage system |
| US8495036B2 (en) | 2008-10-24 | 2013-07-23 | Microsoft Corporation | Blob manipulation in an integrated structured storage system |
| US8751462B2 (en) * | 2008-11-14 | 2014-06-10 | Emc Corporation | Delta compression after identity deduplication |
| US8645334B2 (en) * | 2009-02-27 | 2014-02-04 | Andrew LEPPARD | Minimize damage caused by corruption of de-duplicated data |
| US20100257403A1 (en) | 2009-04-03 | 2010-10-07 | Microsoft Corporation | Restoration of a system from a set of full and partial delta system snapshots across a distributed system |
| US8095756B1 (en) * | 2009-04-28 | 2012-01-10 | Netapp, Inc. | System and method for coordinating deduplication operations and backup operations of a storage volume |
| US8176270B2 (en) * | 2009-05-01 | 2012-05-08 | Quantum Corporation | Data allocation system |
| US8051050B2 (en) | 2009-07-16 | 2011-11-01 | Lsi Corporation | Block-level data de-duplication using thinly provisioned data storage volumes |
-
2010
- 2010-09-21 EP EP10819153.7A patent/EP2480971A4/en not_active Ceased
- 2010-09-21 CN CN201080042904.0A patent/CN102576321B/en active Active
- 2010-09-21 US US12/887,404 patent/US9141300B2/en active Active
- 2010-09-21 US US12/887,402 patent/US8677052B2/en active Active
- 2010-09-21 WO PCT/US2010/002593 patent/WO2011037624A1/en active Application Filing
- 2010-09-21 US US12/887,414 patent/US8447726B2/en active Active
-
2013
- 2013-04-18 US US13/865,931 patent/US8880469B2/en active Active
-
2014
- 2014-01-23 US US14/161,910 patent/US9092145B2/en active Active
- 2014-10-06 US US14/507,655 patent/US9875028B2/en active Active
-
2015
- 2015-06-22 US US14/746,546 patent/US9483183B2/en active Active
- 2015-08-13 US US14/825,845 patent/US10013167B2/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1504912A (en) * | 2002-12-05 | 2004-06-16 | �Ҵ���˾ | Performance and memory bandwidth utilization for tree searches using tree fragmentation |
Also Published As
| Publication number | Publication date |
|---|---|
| US10013167B2 (en) | 2018-07-03 |
| EP2480971A4 (en) | 2013-08-07 |
| US20150347049A1 (en) | 2015-12-03 |
| US9092145B2 (en) | 2015-07-28 |
| WO2011037624A1 (en) | 2011-03-31 |
| US8677052B2 (en) | 2014-03-18 |
| US9875028B2 (en) | 2018-01-23 |
| EP2480971A1 (en) | 2012-08-01 |
| US20140201430A1 (en) | 2014-07-17 |
| US20110072226A1 (en) | 2011-03-24 |
| US9141300B2 (en) | 2015-09-22 |
| US20130304969A1 (en) | 2013-11-14 |
| CN102576321A (en) | 2012-07-11 |
| US20160034200A1 (en) | 2016-02-04 |
| US8880469B2 (en) | 2014-11-04 |
| US20150095559A1 (en) | 2015-04-02 |
| US20110071980A1 (en) | 2011-03-24 |
| US8447726B2 (en) | 2013-05-21 |
| US9483183B2 (en) | 2016-11-01 |
| US20110072227A1 (en) | 2011-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102576321B (en) | Performance storage system in fast photographic system for capacity optimizing memory system performance improvement | |
| CN101855619B (en) | Data processing apparatus and method of processing data | |
| CN102736961B (en) | The backup-and-restore strategy of data deduplication | |
| CN103635900B (en) | Time-based data partitioning | |
| CN103562914B (en) | The type that economizes on resources extends file system | |
| CN108255408A (en) | Date storage method and system | |
| GB2383859A (en) | Memory controller managing a file allocation table for a memory card | |
| CN110727406B (en) | Data storage scheduling method and device | |
| US20190026317A1 (en) | Memory use in a distributed index and query system | |
| CN110347643B (en) | Method and device for cloning NTFS (New technology File System) volume between disks | |
| CN104065906A (en) | Video recording method and device of digital video recording equipment | |
| CN116185308B (en) | Data set processing method, device, equipment, medium and model training system | |
| CN105493080B (en) | The method and apparatus of data de-duplication based on context-aware | |
| CN109558270A (en) | Method and apparatus, the method and apparatus of data convert of data backup | |
| CN109074379A (en) | It is supported for the file system of file-level ghost image | |
| CN107977168B (en) | Data dispersed storage system based on cloud storage | |
| CN102253947B (en) | Method capable of progressively transmitting for storing and accessing aggregated vector data | |
| JP7323801B2 (en) | Information processing device and information processing program | |
| CN117472296B (en) | Data processing method, device, electronic equipment and storage medium | |
| CN111339037B (en) | Efficient parallel replication method for parallel distributed file system | |
| CN116069788B (en) | Data processing method, database system, computer device, and storage medium | |
| US20210166165A1 (en) | Computer system | |
| CN114968669A (en) | Real-time data compression backup method and device and storage medium | |
| CN114036104A (en) | Cloud filing method, device and system for re-deleted data based on distributed storage | |
| JP2004094755A (en) | Data transfer device and its method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |