CN102255962A - Distributive storage method, device and system - Google Patents
Distributive storage method, device and system Download PDFInfo
- Publication number
- CN102255962A CN102255962A CN2011101833165A CN201110183316A CN102255962A CN 102255962 A CN102255962 A CN 102255962A CN 2011101833165 A CN2011101833165 A CN 2011101833165A CN 201110183316 A CN201110183316 A CN 201110183316A CN 102255962 A CN102255962 A CN 102255962A
- Authority
- CN
- China
- Prior art keywords
- memory
- resource pool
- logical block
- memory resource
- physical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0605—Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0664—Virtualisation aspects at device level, e.g. emulation of a storage device or system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The invention provides a distributive storage method, and furthermore, provides a distributive storage device and a distributive storage system. In the distributive storage method provided by the invention, objects are stored in a resource storage pool, physical storage spaces are distributed to the resource storage pool only in the process of storing the objects, so that the physical storage spaces can be dynamically flexibly distributed according to the physical storage spaces needed by a user, and the utility ratio of the physical storage spaces is further increased.
Description
Technical field
The present invention relates to the disk storage technology field, be specifically related to a kind of distributed storage method, distributed storage devices and distributed memory system.
Background technology
The cloud storage is in the conceptive extension of cloud computing and develops a new notion of coming out, distributed cloud storage system (hereinafter to be referred as storage system) is meant by functions such as cluster application, grid and distributed store file system, a large amount of various dissimilar memory devices (memory device also is referred to as memory node) in the network are gathered collaborative work by application software or application interface, a storage system of storage and Operational Visit function externally is provided jointly.
At present, the storage means of storage system is: create logical volume, when creating logical volume, just for each logical volume distributes amount of physical memory, this amount of physical memory may be that the disk of certain memory device or certain several memory device is formed.Client is stored data on a certain logical volume, just with storage on file system, file system is divided into mass part with data, each part is an object, object not only comprises data but also comprises Data Identification (ID, extra information such as IDentity), file system writes each object respectively the amount of physical memory of this logical volume, and file system can write down the stored position information of each object, thereby when the client-requested visit data, file system can conduct interviews to data by client according to the stored position information of each object.
Storage system is the process that logical volume distributes amount of physical memory, be specially: estimate (this appraisal often wants the capacity of objects stored that very big surplus is arranged with respect to reality) and raid-array (RAID according to capacity to the object that is stored in logical volume, Redundant Array of Independent Disk) group, in advance amount of physical memory is divided into itemize, a logical volume can be understood as an itemize, thereby has distributed amount of physical memory for logical volume.
Because after amount of physical memory distributes to logical volume, the amount of physical memory that is assigned with can not change, but because the object capacity of actual storage is probably less than the amount of physical memory that is assigned with, in the use afterwards, have in the amount of physical memory that is assigned with and be in idle state greatly for a long time, and these idle amount of physical memory can not be used by other logical volumes, thereby cause the utilance of amount of physical memory low.For example, adopt the RAID5 group of 7+1, and the capacity of the object that is stored in logical volume estimated be 448KB, storage system is provided with 7 itemizes, and the amount of physical memory that each itemize is assigned with is 64KB, and the amount of physical memory that each itemize is assigned with can not change, need only the object capacity of actual storage so less than 448KB, the amount of physical memory that is assigned with will some be in idle state, causes the waste of amount of physical memory, causes the utilance of amount of physical memory low.
Summary of the invention
The embodiment of the invention provides a kind of distributed storage method, distributed storage devices and distributed memory system.
A kind of distributed storage method comprises:
The amount of physical memory of all memory nodes is cut at least two physical blocks, the set of all described physical blocks is videoed into the memory resource pool of a logic;
On described memory resource pool, set up virtual volume;
When client is stored data on described virtual volume, described data are divided at least two objects, deposit each described object in described memory resource pool, be the mapping relations of the logical block of each described Object Creation and described memory resource pool, and described physical block distributed to the logical block that has mapping relations with each described object according to the capacity of each described object;
Be stored as mapping relations each described Object Creation and logical block described memory resource pool.
A kind of distributed storage devices comprises:
Make up the storage resources pool unit, be used for the amount of physical memory of all memory nodes is cut at least two physical blocks, the set of all described physical blocks is videoed into the memory resource pool of a logic;
Set up the virtual volume unit, be used on described memory resource pool, setting up virtual volume;
Distribute the amount of physical memory unit, be used for when client is stored data on virtual volume, described data are divided at least two objects, each described object is write described memory resource pool, be the mapping relations of the logical block of each described Object Creation and described memory resource pool, and described physical block distributed to the logical block that has mapping relations with each described object according to the capacity of each described object;
Storage Mapping concerns the unit, is used to be stored as mapping relations each described Object Creation and logical block described memory resource pool.
A kind of distributed memory system comprises: at least one client, at least one memory node and above-mentioned distributed storage devices.
In the embodiment of the invention, object storage is in the resource storage pool, amount of physical memory has only in the time of storage object, just distribute to the resource storage pool, thereby can be according to the required amount of physical memory of user, the distribution amount of physical memory of dynamic flexible, thus the utilance of amount of physical memory improved.
Description of drawings
Fig. 1 is the schematic flow sheet of an embodiment of distributed storage method in the embodiment of the invention;
Fig. 2 is the logical construction schematic diagram of an embodiment of distributed storage devices in the embodiment of the invention;
Fig. 3 is the logical construction schematic diagram of an embodiment of distributed memory system in the embodiment of the invention.
Embodiment
The embodiment of the invention provides a kind of distributed storage method, and the embodiment of the invention also provides corresponding distributed storage devices and distributed memory system.Below be elaborated respectively.
See also Fig. 1, the embodiment of the invention provides an embodiment of distributed storage method, specifically comprises:
101, the amount of physical memory with all memory nodes cuts at least two physical blocks, the set of all physical blocks is videoed into the memory resource pool of a logic;
Storage system is that the process of logical volume distribution amount of physical memory is static at present, when creating logical volume, just distribute amount of physical memory for each logical volume, if can adopt dynamic method distribution according to need amount of physical memory, undoubtedly, will greatly improve the utilance of amount of physical memory, thereby not increase the capacity that increases storage system under the condition of cost.And to adopt dynamic, the demand assigned method just must be virtual with storage system.
The first step of the Storage Virtualization that the embodiment of the invention is carried out is: the amount of physical memory of all memory nodes is cut at least two physical blocks, the set of all physical blocks is videoed into the memory resource pool of a logic, thereby shielded the difference between the memory node, made up a unified memory resource pool.
Need to prove that aforementioned " amount of physical memory of all memory nodes " refer to total amount of physical memory that the amount of physical memory unification by each memory node constitutes.
Make up memory resource pool detailed process can for: at first the amount of physical memory with all memory nodes is divided at least two physical blocks, again these physical blocks are videoed into logical block, these logical blocks are got up with a data structure organization, just can construct the memory resource pool of a logic.Storage system is divided at least two physical blocks with the amount of physical memory of all memory nodes, is specifically as follows: the amount of physical memory of all memory nodes is divided into anisometric at least two physical blocks; Perhaps in order to improve the processing speed that makes up memory resource pool, the amount of physical memory of all memory nodes such as is divided at least two big physical blocks, for example the amount of physical memory of 1TB is divided into the physical block of 1000 1GB, 1000 logical blocks are arranged in the memory resource pool that constructs, when need using resource, pick out logical block in the memory resource pool and use.
102, on memory resource pool, set up virtual volume, and be each dummy block will in the virtual volume set up and memory resource pool in logical block between mapping relations;
Second step of the Storage Virtualization that the embodiment of the invention is carried out is: set up the virtual volume of storage system on memory resource pool, have mapping relations between each dummy block will in the virtual volume and the logical block in the memory resource pool.
Set up the mapping table between virtual volume and the logical volume, the expression dummy block will is to the mapping relations of logical block (piece in the storage pool), but do not distribute amount of physical memory, the foundation of virtual volume makes storage system just not be used in when not storing in advance for each client provides amount of physical memory, and the amount of physical memory that storage system provided that each client is seen is actually the virtual disk of setting up on virtual volume.
103, deposit each object in memory resource pool, be the mapping relations of the logical block of each Object Creation and memory resource pool, and physical block is distributed to the logical block that each and object have mapping relations according to the capacity of each object;
When the some clients in the multi-client are stored data on virtual volume in the presence of all, data are divided at least two objects, deposit each object in memory resource pool, be the mapping relations of the logical block of each Object Creation and memory resource pool, and physical block distributed to the logical block that each and object have mapping relations according to the capacity of each object.
Above-mentioned mode for logical block distribution physical block makes amount of physical memory only just distribute in use, storage system can be according to the required amount of physical memory of user, the distribution amount of physical memory of dynamic flexible, the amount of physical memory that is assigned with is not changeless, improved the utilance of amount of physical memory, and above-mentioned mode for logical block distribution physical block also makes the user avoid buying temporary transient unwanted memory device, has saved the administrative effort that the user buys those estimated expenditures that also unwanted space spent and manages these temporary transient unwanted spaces greatly; Simultaneously, the minimizing of memory device quantity also makes storage system environmental protection more.
In this step, mapping relations for the logical block of each Object Creation and memory resource pool, be specifically as follows: with big granularities such as object are divided into, such as 8KB, set up a mapping table, a list item of every 8KB correspondence mappings table, write down on the data of certain 8KB on certain logical block that this 8KB is mapped to memory resource pool the inside, begin on the logical block 2 of memory resource pool the 3rd of storage to 16KB above the 8KB such as, object 1 from 8K.
104, be stored as mapping relations each Object Creation and logical block memory resource pool.
Be mapping relations each Object Creation and logical block memory resource pool in the storage system storing step 103, the operation to data all will be retrieved as mapping relations each Object Creation and logical block memory resource pool at every turn.
Optionally, storage system can be stored as mapping relations each Object Creation and logical block memory resource pool in memory resource pool, that is to say, will be in the same place with each object storage for the mapping relations with logical block memory resource pool each Object Creation.
Perhaps, optionally, storage system can also separate, stored be mapping relations each Object Creation and logical block memory resource pool, separate, stored be meant with for the mapping relations of each Object Creation and logical block memory resource pool and storage at different amount of physical memory, thereby caused the logical view of data and Physical View to be separated, will be for the mapping relations of each Object Creation and logical block memory resource pool and each object storage together the time in storage system, the operation to data all will be retrieved as mapping relations each Object Creation and logical block memory resource pool at every turn.When the frequent generation of operation, just become the bottleneck of whole storage system, limited the autgmentability of storage system, and the storage system separate, stored is mapping relations each Object Creation and logical block memory resource pool, can solve the scalability problem of storage system for the memory space of the mapping relations of each Object Creation and logical block memory resource pool by increasing separate, stored, specific implementation can for: will for the mapping relations with logical block memory resource pool each Object Creation be stored in another storage system or with the logical volume of the separate same storage system of memory resource pool.
In the present embodiment, object storage is in the resource storage pool, amount of physical memory has only in the time of storage object, just distribute to the resource storage pool, thereby can be according to the required amount of physical memory of user, the distribution amount of physical memory of dynamic flexible, improved the utilance of amount of physical memory, and since in the prior art to as if be stored on the file system, being equivalent to data need just can be stored on the disk via file system, and in the present embodiment, to as if be stored on the memory resource pool, directly just be stored on the disk, removed the file system link, reduced the complexity of storage system.
In the above-described embodiments, when the client-access data, operating system in the storage system can be according to the mapping relations that are each Object Creation and logical block memory resource pool of these data, and each object that obtains these data is positioned at the particular location of memory resource pool, thus reading of data.
In the above-described embodiments, memory node can be storage area network network (SAN, Storage Area Network) memory device in the array, memory device in the SAN array is a smart machine, also can be referred to as object-based memory device (OSD, Object-based Storage Device), each OSD has the storage medium of oneself, processor, internal memory and network system, OSD is provided object interface, make in the data write process, memory node can pass through OSD object interface and client direct communication, will for the mapping relations separate, stored of each Object Creation and logical block memory resource pool meta data server (Metadata Server, MDS) in.Mapping relations with logical block memory resource pool each Object Creation are metadata, and meta data server comprises catalogue formation, the pairing OSD of each data etc. for client provides the logical view of data.In traditional SAN array, metadata is responsible for maintenance by the file server in the SAN array, all will obtain metadata to the operation of data at every turn.When the frequent generation of operation, metadata operation just becomes the bottleneck of whole storage system, has limited the expansion of performance.But the memory device in the SAN array is OSD, the OSD object interface externally is provided, because each operation is for once to the visit of metadata, concrete transfer of data is all undertaken by directly being connected with client by OSD, significantly reduced the operation of metadata, reduced the burden of meta data server, by increasing the scaling concern that meta data server solves the SAN array.
Need to prove that memory node also can be the network storage equipment (NAS, Network Attached Storage).
Consult Fig. 2, the embodiment of the invention also provides an embodiment of distributed storage devices, and the distributed storage devices 20 in the present embodiment can be applicable in the foregoing description, and carrying out above-mentioned is method among the embodiment.
Distributed storage devices 20 in the present embodiment comprises:
Make up storage resources pool unit 201, be used for the amount of physical memory of all memory nodes is cut at least two physical blocks, the set of all physical blocks is videoed into the memory resource pool of a logic;
Set up virtual volume unit 202, be used on memory resource pool, setting up virtual volume;
Distribute amount of physical memory unit 203, be used for when client is stored data on virtual volume, data are divided at least two objects, each object is write memory resource pool, be the mapping relations of the logical block of each Object Creation and memory resource pool, and physical block distributed to the logical block that has mapping relations with each object according to the capacity of each object;
Storage Mapping concerns unit 204, is used to be stored as mapping relations each Object Creation and logical block memory resource pool.
Optionally, Storage Mapping concerns that unit 204 specifically is used for separate, stored and is mapping relations each Object Creation and logical block memory resource pool.
Optionally, Storage Mapping concern unit 204 specifically be used for be stored in for the mapping relations with logical block memory resource pool each Object Creation another storage system or with the logical volume of separate this storage system of memory resource pool.
Optionally, making up storage resources pool unit 201 specifically is used for the amount of physical memory of all memory nodes is cut at least two physical blocks that grade is big, each physical block is mapped to logical block, and all logical blocks get up with data structure organization, construct the memory resource pool of a logic.
In the present embodiment, memory node can be the memory device in the storage area network network SAN array, and the memory device in the SAN array is based on the memory device (OSD, Object-based Storage Device) of object, and the OSD object interface externally is provided.
In the present embodiment, distribute amount of physical memory unit 203 with object storage in the resource storage pool, and amount of physical memory has only in the time of storage object, just distribute to the resource storage pool, thereby can be according to the required amount of physical memory of user, the distribution amount of physical memory of dynamic flexible has improved the utilance of amount of physical memory.
Consult Fig. 3, the embodiment of the invention also provides an embodiment of distributed memory system, and the distributed memory system in the present embodiment can be applicable in the foregoing description, carries out the method in the foregoing description.
Distributed memory system in the present embodiment comprises: at least one client 301, at least one memory node 302 and distributed storage devices 303;
Distributed storage devices 303 in the present embodiment is identical with distributed storage devices 20 in the foregoing description.
Optionally, distributed memory system also comprises meta data server 304, and meta data server 304 is used for separate, stored distributed storage devices 304 and is mapping relations each Object Creation and logical block memory resource pool.
In the distributed memory system that present embodiment provides, the quantity of meta data server 304 can be at least one, so just can solve the problem of the autgmentability of distributed memory system system.Memory node in meta data server 304 and the distributed storage devices 303 is separate.
Optionally, memory node 302 is specially the memory device in the storage area network network SAN array, and the memory device in the SAN array is based on the memory device OSD of object, the OSD object interface externally is provided, under this application scenarios, meta data server 304 provides the logical view of data for client, comprise that catalogue constitutes, the pairing OSD of each data etc., when client 301 access objects, at first send request to meta data server 304, meta data server 304 is according to the metadata of reflection object to the mapping relations of logical block, and the information such as particular location that object are positioned at memory resource pool send to client 301; After this be positioned at the particular location of memory resource pool according to object, client 301 just directly sends request to the memory node 302 that stores this object and reads and writes data, and does not need with meta data server 304 mutual.
It is the important component part of storage system that network connects.It couples together client 301, meta data server 304 and memory node 302.The continuous progress of network technology makes the network ways of connecting that more more options arranged.Gigabit Ethernet has performance height, cost performance height, be easy to advantage such as management, therefore become to make up the first-selection of storage system.Along with the maturation of optical-fibre channel technology and the reduction of cost, use also more and more widely.In addition, various new network technologies also constantly occur, and as network technologies such as Myrinet, Infiniband, all have higher performance.Especially Infiniband, constantly the performance of expansion makes it have very strong competitiveness.
In the present embodiment, distributed storage devices 303 can be with object storage in the resource storage pool, and amount of physical memory has only in the time of storage object, just distribute to the resource storage pool, thereby can be according to the required amount of physical memory of user, the distribution amount of physical memory of dynamic flexible has improved the utilance of amount of physical memory.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of the foregoing description is to instruct relevant hardware to finish by program, this program can be stored in the computer-readable recording medium, and storage medium can comprise: ROM, RAM, disk or CD etc.
More than distributed storage method, distributed storage devices and distributed memory system that the embodiment of the invention provided are described in detail, used specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (12)
1. a distributed storage method is characterized in that, comprising:
The amount of physical memory of all memory nodes is cut at least two physical blocks, the set of all described physical blocks is videoed into the memory resource pool of a logic;
On described memory resource pool, set up virtual volume;
When client is stored data on described virtual volume, described data are divided at least two objects, deposit each described object in described memory resource pool, be the mapping relations of the logical block of each described Object Creation and described memory resource pool, and described physical block distributed to the logical block that has mapping relations with each described object according to the capacity of each described object;
Be stored as mapping relations each described Object Creation and logical block described memory resource pool.
2. method according to claim 1 is characterized in that, the described step that is stored as the mapping relations of each described Object Creation and logical block described memory resource pool is specially:
Separate, stored is mapping relations each described Object Creation and logical block described memory resource pool.
3. method according to claim 2 is characterized in that,
Described separate, stored is the step of the mapping relations of each described Object Creation and logical block described memory resource pool, is specially:
To be stored in another storage system for the mapping relations with logical block described memory resource pool each described Object Creation; Perhaps,
To be stored in logical volume with the separate described storage system of described memory resource pool for the mapping relations with logical block described memory resource pool each described Object Creation.
4. according to each described method in claim 2 or 3, it is characterized in that,
Described memory node is the memory device in the storage area network network SAN array, and the memory device in the described SAN array is based on the memory device OSD of object, and the OSD object interface externally is provided;
Describedly deposit each described object the step of described memory resource pool in, be specially:
Deposit each described object in described memory resource pool by described OSD object interface.
5. method according to claim 4 is characterized in that,
Described amount of physical memory with all memory nodes cuts at least two physical blocks, and the step of the memory resource pool of a logic is videoed in the set of all described physical blocks, is specially:
The amount of physical memory of all memory nodes is cut at least two physical blocks, described physical block is mapped to logical block, described logical block is got up with data structure organization, construct the memory resource pool of a logic.
6. a distributed storage devices is characterized in that, comprising:
Make up the storage resources pool unit, be used for the amount of physical memory of all memory nodes is cut at least two physical blocks, the set of all described physical blocks is videoed into the memory resource pool of a logic;
Set up the virtual volume unit, be used on described memory resource pool, setting up virtual volume;
Distribute the amount of physical memory unit, be used for when client is stored data on virtual volume, described data are divided at least two objects, each described object is write described memory resource pool, be the mapping relations of the logical block of each described Object Creation and described memory resource pool, and described physical block distributed to the logical block that has mapping relations with each described object according to the capacity of each described object;
Storage Mapping concerns the unit, is used to be stored as mapping relations each described Object Creation and logical block described memory resource pool.
7. distributed storage devices according to claim 6 is characterized in that,
Described Storage Mapping concerns that the unit specifically is used for separate, stored and is mapping relations each described Object Creation and logical block described memory resource pool.
8. distributed storage devices according to claim 7 is characterized in that,
Described Storage Mapping concerns that the unit specifically is used for being stored in another storage system for the mapping relations with logical block described memory resource pool each described Object Creation; Perhaps,
Described Storage Mapping concerns that the unit specifically is used for the logical volume that will be stored in for the mapping relations with logical block described memory resource pool each described Object Creation with the separate described storage system of described memory resource pool.
9. according to claim 7 or 8 described distributed storage devices, it is characterized in that,
Described memory node is specially the memory device in the storage area network network SAN array, and the memory device in the described SAN array is based on the memory device OSD of object, and the OSD object interface externally is provided.
10. distributed storage devices according to claim 9 is characterized in that,
Described structure storage resources pool unit specifically is used for the amount of physical memory of all memory nodes is cut at least two physical blocks that grade is big, described physical block is mapped to logical block, described logical block gets up with data structure organization, constructs the memory resource pool of a logic.
11. a distributed memory system is characterized in that, comprising:
At least one client, at least one memory node, as the described distributed storage devices of claim 6 to 10.
12. system according to claim 9 is characterized in that,
Described memory node is specially the memory device in the storage area network network SAN array, and the memory device in the described SAN array is based on the memory device OSD of object, and the OSD object interface externally is provided.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110183316.5A CN102255962B (en) | 2011-07-01 | 2011-07-01 | Distributive storage method, device and system |
| PCT/CN2012/077584 WO2013004136A1 (en) | 2011-07-01 | 2012-06-27 | Distributed storage method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110183316.5A CN102255962B (en) | 2011-07-01 | 2011-07-01 | Distributive storage method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102255962A true CN102255962A (en) | 2011-11-23 |
| CN102255962B CN102255962B (en) | 2013-11-06 |
Family
ID=44982952
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110183316.5A Active CN102255962B (en) | 2011-07-01 | 2011-07-01 | Distributive storage method, device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102255962B (en) |
| WO (1) | WO2013004136A1 (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102546830A (en) * | 2012-02-27 | 2012-07-04 | 辛旻 | Method and system for realizing storage in server |
| WO2013004136A1 (en) * | 2011-07-01 | 2013-01-10 | 华为数字技术（成都）有限公司 | Distributed storage method, device and system |
| US20130232179A1 (en) * | 2012-03-02 | 2013-09-05 | International Business Machines Corporation | Enhanced storage quota management for cloud computing systems |
| CN103516755A (en) * | 2012-06-27 | 2014-01-15 | 华为技术有限公司 | Virtual storage method and equipment thereof |
| CN103634379A (en) * | 2013-11-13 | 2014-03-12 | 华为技术有限公司 | Management method for distributed storage space and distributed storage system |
| CN103870202A (en) * | 2012-12-10 | 2014-06-18 | 上海优刻得信息科技有限公司 | Distributed storage method and system of block device |
| CN105095290A (en) * | 2014-05-15 | 2015-11-25 | 中国银联股份有限公司 | Data layout method of distributed storage system |
| CN105426125A (en) * | 2015-11-09 | 2016-03-23 | 深圳市迪菲特科技股份有限公司 | Data storage method and apparatus |
| WO2016107167A1 (en) * | 2014-12-31 | 2016-07-07 | 中兴通讯股份有限公司 | Storage architecture creation method, storage access method and storage system |
| CN106302587A (en) * | 2015-05-26 | 2017-01-04 | 阿里巴巴集团控股有限公司 | The dispatching method of a kind of internet information resource and device |
| WO2017113278A1 (en) * | 2015-12-31 | 2017-07-06 | 华为技术有限公司 | Data processing method, apparatus and system |
| CN107566405A (en) * | 2017-10-18 | 2018-01-09 | 成都索贝数码科技股份有限公司 | A kind of quick memory resource pool method for accessing and copying |
| CN107741832A (en) * | 2017-10-18 | 2018-02-27 | 成都索贝数码科技股份有限公司 | A kind of method based on pond isolated storage catalogue |
| WO2018059077A1 (en) * | 2016-09-30 | 2018-04-05 | 华为技术有限公司 | Computer system and storage access device |
| CN108717632A (en) * | 2018-05-29 | 2018-10-30 | 广东通莞科技股份有限公司 | A kind of mobile payment storage protection and recovery system |
| CN109376123A (en) * | 2014-08-12 | 2019-02-22 | 华为技术有限公司 | Manage method, distributed memory system and the management node of file |
| WO2020024588A1 (en) * | 2018-08-02 | 2020-02-06 | Memverge, Inc. | A distributed memory object architecture |
| CN112783419A (en) * | 2019-11-06 | 2021-05-11 | 阿里巴巴集团控股有限公司 | Distributed storage method and device, electronic equipment and storage medium |
| CN112799584A (en) * | 2019-11-13 | 2021-05-14 | 杭州海康威视数字技术股份有限公司 | Data storage method and device |
| CN113312663A (en) * | 2021-05-31 | 2021-08-27 | 尧领有限公司 | Distributed data storage method and system, and computer readable storage medium |
| CN116540949A (en) * | 2023-07-04 | 2023-08-04 | 苏州浪潮智能科技有限公司 | Dynamic allocation method and device for storage space of redundant array of independent disks |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10129357B2 (en) | 2015-08-21 | 2018-11-13 | International Business Machines Corporation | Managing data storage in distributed virtual environment |
| CN110096220B (en) * | 2018-01-31 | 2020-06-26 | 华为技术有限公司 | Distributed storage system, data processing method and storage node |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2469624A1 (en) * | 2001-12-10 | 2003-06-19 | Monosphere Limited | Managing storage resources attached to a data network |
| CN1258713C (en) * | 2003-11-14 | 2006-06-07 | 清华大学 | Data distribution dynamic mapping method based on magnetic disc characteristic |
| CN102209953B (en) * | 2009-01-30 | 2014-04-30 | 株式会社日立制作所 | Storage system and storage control method that compress and store data elements |
| CN102405460B (en) * | 2009-02-11 | 2016-05-04 | 艾梵尼达有限公司 | Virtual storage system and operation method thereof |
| CN102255962B (en) * | 2011-07-01 | 2013-11-06 | 华为数字技术（成都）有限公司 | Distributive storage method, device and system |
-
2011
- 2011-07-01 CN CN201110183316.5A patent/CN102255962B/en active Active
-
2012
- 2012-06-27 WO PCT/CN2012/077584 patent/WO2013004136A1/en active Application Filing
Non-Patent Citations (2)
| Title |
|---|
| 刘镇涛: "存储虚拟化原理分析及其实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
| 谭子军 等: "分布式存储系统中用户磁盘空间分配策略", 《计算机工程》 * |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013004136A1 (en) * | 2011-07-01 | 2013-01-10 | 华为数字技术（成都）有限公司 | Distributed storage method, device and system |
| CN102546830A (en) * | 2012-02-27 | 2012-07-04 | 辛旻 | Method and system for realizing storage in server |
| CN102546830B (en) * | 2012-02-27 | 2015-06-24 | 辛旻 | Method and system for realizing storage in server |
| US10067940B2 (en) * | 2012-03-02 | 2018-09-04 | International Business Machines Corporation | Enhanced storage quota management for cloud computing systems |
| US20130232179A1 (en) * | 2012-03-02 | 2013-09-05 | International Business Machines Corporation | Enhanced storage quota management for cloud computing systems |
| CN103297496A (en) * | 2012-03-02 | 2013-09-11 | 国际商业机器公司 | Method and system of enhanced storage quota management for cloud computing system |
| CN103516755A (en) * | 2012-06-27 | 2014-01-15 | 华为技术有限公司 | Virtual storage method and equipment thereof |
| CN103516755B (en) * | 2012-06-27 | 2017-07-14 | 华为技术有限公司 | Virtual memory method and equipment |
| CN103870202A (en) * | 2012-12-10 | 2014-06-18 | 上海优刻得信息科技有限公司 | Distributed storage method and system of block device |
| CN103634379A (en) * | 2013-11-13 | 2014-03-12 | 华为技术有限公司 | Management method for distributed storage space and distributed storage system |
| CN103634379B (en) * | 2013-11-13 | 2017-02-01 | 华为技术有限公司 | Management method for distributed storage space and distributed storage system |
| CN105095290B (en) * | 2014-05-15 | 2019-02-15 | 中国银联股份有限公司 | A kind of data layout method of distributed memory system |
| CN105095290A (en) * | 2014-05-15 | 2015-11-25 | 中国银联股份有限公司 | Data layout method of distributed storage system |
| US11656763B2 (en) | 2014-08-12 | 2023-05-23 | Huawei Technologies Co., Ltd. | File management method, distributed storage system, and management node |
| CN109376123A (en) * | 2014-08-12 | 2019-02-22 | 华为技术有限公司 | Manage method, distributed memory system and the management node of file |
| WO2016107167A1 (en) * | 2014-12-31 | 2016-07-07 | 中兴通讯股份有限公司 | Storage architecture creation method, storage access method and storage system |
| CN106302587B (en) * | 2015-05-26 | 2019-07-30 | 阿里巴巴集团控股有限公司 | A kind of dispatching method and device of internet information resource |
| CN106302587A (en) * | 2015-05-26 | 2017-01-04 | 阿里巴巴集团控股有限公司 | The dispatching method of a kind of internet information resource and device |
| CN105426125A (en) * | 2015-11-09 | 2016-03-23 | 深圳市迪菲特科技股份有限公司 | Data storage method and apparatus |
| CN105426125B (en) * | 2015-11-09 | 2019-06-14 | 深圳市迪菲特科技股份有限公司 | A kind of date storage method and device |
| WO2017113278A1 (en) * | 2015-12-31 | 2017-07-06 | 华为技术有限公司 | Data processing method, apparatus and system |
| US10915365B2 (en) | 2015-12-31 | 2021-02-09 | Huawei Technologies Co., Ltd. | Determining a quantity of remote shared partitions based on mapper and reducer nodes |
| WO2018059077A1 (en) * | 2016-09-30 | 2018-04-05 | 华为技术有限公司 | Computer system and storage access device |
| CN107741832A (en) * | 2017-10-18 | 2018-02-27 | 成都索贝数码科技股份有限公司 | A kind of method based on pond isolated storage catalogue |
| CN107741832B (en) * | 2017-10-18 | 2021-01-08 | 成都索贝数码科技股份有限公司 | Method for isolating storage directory based on pooling |
| CN107566405B (en) * | 2017-10-18 | 2021-07-27 | 成都索贝数码科技股份有限公司 | Storage resource pooling method for quick access and copy |
| CN107566405A (en) * | 2017-10-18 | 2018-01-09 | 成都索贝数码科技股份有限公司 | A kind of quick memory resource pool method for accessing and copying |
| CN108717632A (en) * | 2018-05-29 | 2018-10-30 | 广东通莞科技股份有限公司 | A kind of mobile payment storage protection and recovery system |
| WO2020024588A1 (en) * | 2018-08-02 | 2020-02-06 | Memverge, Inc. | A distributed memory object architecture |
| CN112783419A (en) * | 2019-11-06 | 2021-05-11 | 阿里巴巴集团控股有限公司 | Distributed storage method and device, electronic equipment and storage medium |
| CN112799584A (en) * | 2019-11-13 | 2021-05-14 | 杭州海康威视数字技术股份有限公司 | Data storage method and device |
| CN112799584B (en) * | 2019-11-13 | 2023-04-07 | 杭州海康威视数字技术股份有限公司 | Data storage method and device |
| CN113312663A (en) * | 2021-05-31 | 2021-08-27 | 尧领有限公司 | Distributed data storage method and system, and computer readable storage medium |
| CN116540949A (en) * | 2023-07-04 | 2023-08-04 | 苏州浪潮智能科技有限公司 | Dynamic allocation method and device for storage space of redundant array of independent disks |
| CN116540949B (en) * | 2023-07-04 | 2024-01-12 | 苏州浪潮智能科技有限公司 | Dynamic allocation method and device for storage space of redundant array of independent disks |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102255962B (en) | 2013-11-06 |
| WO2013004136A1 (en) | 2013-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102255962B (en) | Distributive storage method, device and system | |
| CN101997918B (en) | Method for allocating mass storage resources according to needs in heterogeneous SAN (Storage Area Network) environment | |
| CN103503414B (en) | A kind of group system calculating storage and merge | |
| CN102855294B (en) | Intelligent hash data layout method, cluster storage system and method thereof | |
| WO2020204880A1 (en) | Snapshot-enabled storage system implementing algorithm for efficient reclamation of snapshot storage space | |
| CN104735110B (en) | Metadata management method and system | |
| CN101241476B (en) | Dummy storage system and method | |
| WO2020204882A1 (en) | Snapshot-enabled storage system implementing algorithm for efficient reading of data from stored snapshots | |
| CN107046563A (en) | A kind of implementation method, system and the cloud platform of distribution type high efficient cloud disk | |
| CN102221982B (en) | Method and system for implementing deletion of repeated data on block-level virtual storage equipment | |
| Tarasov et al. | In search of the ideal storage configuration for Docker containers | |
| CN100452046C (en) | Storage method and system for mass file | |
| CN103929500A (en) | Method for data fragmentation of distributed storage system | |
| CN102467408A (en) | Method and device for accessing data of virtual machine | |
| CN102136003A (en) | Large-scale distributed storage system | |
| CN103890738A (en) | System and method for retaining deduplication in a storage object after a clone split operation | |
| CN104111804A (en) | Distributed file system | |
| CN105338118A (en) | Distributed storage system | |
| CN104536903A (en) | Mixed storage method and system for conducting classified storage according to data attributes | |
| CN106570113B (en) | Mass vector slice data cloud storage method and system | |
| CN104050248A (en) | File storage system and storage method | |
| CN104182487A (en) | Unified storage method supporting various storage modes | |
| CN111949210A (en) | Metadata storage method, system and storage medium in distributed storage system | |
| CN105354250A (en) | Data storage method and device for cloud storage | |
| CN105516313A (en) | Distributed storage system used for big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Applicant after: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. Address before: 611731 Chengdu high tech Zone, Sichuan, West Park, Qingshui River Applicant before: CHENGDU HUAWEI SYMANTEC TECHNOLOGIES Co.,Ltd. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: CHENGDU HUAWEI SYMANTEC TECHNOLOGY CO., LTD. TO: HUAWEI DIGITAL TECHNOLOGY (CHENGDU) CO., LTD. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220824 Address after: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee after: HUAWEI TECHNOLOGIES Co.,Ltd. Address before: 611731 Qingshui River District, Chengdu hi tech Zone, Sichuan, China Patentee before: HUAWEI DIGITAL TECHNOLOGIES (CHENG DU) Co.,Ltd. |
|
| TR01 | Transfer of patent right |