CN106293519B - A kind of disk storage management method - Google Patents
A kind of disk storage management method Download PDFInfo
- Publication number
- CN106293519B CN106293519B CN201610617262.1A CN201610617262A CN106293519B CN 106293519 B CN106293519 B CN 106293519B CN 201610617262 A CN201610617262 A CN 201610617262A CN 106293519 B CN106293519 B CN 106293519B
- Authority
- CN
- China
- Prior art keywords
- disk
- management
- rear end
- block
- extent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007726 management method Methods 0.000 title claims abstract description 54
- 238000013507 mapping Methods 0.000 claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 18
- 238000013523 data management Methods 0.000 claims description 8
- 239000006185 dispersion Substances 0.000 claims description 4
- 239000011800 void material Substances 0.000 claims description 3
- 239000000203 mixture Substances 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Abstract
The invention discloses a kind of disk storage management methods, this method comprises: being managed using virtualization layer to rear end disk, rear end disk are added to management mode or mapping mode, is managed collectively；The rear end disk in management mode or mapping mode is divided into multiple block extent by virtualization technology；It organizes the multiple block extent to form virtual disk, virtual disk is supplied to high-level interface.This method, which is realized, improves disk space usage.
Description
Technical field
The present invention relates to computer memory technical fields, more particularly to a kind of disk storage management method.
Background technique
Currently, today's society has been introduced into data society, various data are very big, in such big data
The storage of codes or data is at important problem, and as the parking stall of cell, where is the storage of these data, could preferably
Using memory space, that is, disk space, and again can be very convenient to the management of these data.Disk size is in storage system
It is vital, but most manufacturers think little of depositing the reasonable utilization of disk at present, lead to the use in big data era disk
Rate substantially reduces.Current most of storage plant commercial cities are to be done the single disk or disk array of bottom by virtualization technology
Coiled group, logical volume is then divided on volume group, and logical volume is finally mapped to caching.This operating method is only to rear end
Disk is managed collectively, and certain effect is played to the dilatation of disk, but the space utilization rate of disk does not still have
It obtains and plays to the limit, disk space usage is still lower.
Summary of the invention
The object of the present invention is to provide a kind of disk storage management methods, to realize raising disk space usage.
In order to solve the above technical problems, the present invention provides a kind of disk storage management method, comprising:
Rear end disk is managed using virtualization layer, rear end disk is added to management mode or mapping mode,
It is managed collectively；
The rear end disk in management mode or mapping mode is divided into multiple blocks by virtualization technology
extent；
It organizes the multiple block extent to form virtual disk, virtual disk is supplied to high-level interface.
Preferably, the virtualization layer is arranged between disk array layer and cache layer.
Preferably, the rear end disk includes disk array, single disk or logical volume；The high-level interface is caching
Layer.
It is preferably, described to organize the multiple block extent to form virtual disk, comprising:
It organizes the multiple block extent to form virtual hard disk using block management strategy.
Preferably, the block management strategy includes image policies, serializing strategy or striping strategy.
Preferably, the image policies are as follows: rear end disk space is mapped to virtual disk, IO is carried out by block extent
Data management.
Preferably, the serializing strategy are as follows: be managed continuous block extent composition virtual disk.
Preferably, the striping strategy are as follows: be managed the block extent composition virtual disk of dispersion.
Preferably, the block extent is IO administrative unit, for carrying out I/O data management in virtualization layer；Each area
The data capacity of block extent is equal.
A kind of disk storage management method provided by the present invention is managed rear end disk using virtualization layer, will
Rear end disk is added to management mode or mapping mode, is managed collectively；Management mode will be in by virtualization technology
Or the rear end disk of mapping mode is divided into multiple block extent；It organizes the multiple block extent to form void
Quasi- disk, is supplied to high-level interface for virtual disk.As it can be seen that magnetic disc virtualization is added between cache layer and disk array layer
Layer, from virtualization layer it is seen that disk array or single disk even logical volume, after being handled by virtualization layer
It obtains virtual disk and is supplied to high-level interface, high-level interface is cache layer, and by virtualization technology in management mould
The disk of formula or mapping mode divides block extent, and block extent is the data unit of managing I/O, by rear end disk point
It is cut into different block extent, reaches the maximum of disk space and utilizes, so utilized disk space using virtualization technology
Get up, reach disk space and utilize to greatest extent, realizes improve disk space usage in this way.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of disk storage management method provided by the present invention；
Fig. 2 is virtualization layer data management structure schematic diagram；
Fig. 3 is that Disk Mode switches schematic diagram.
Specific embodiment
Core of the invention is to provide a kind of disk storage management method, to realize raising disk space usage.
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Referring to FIG. 1, Fig. 1 is a kind of flow chart of disk storage management method provided by the present invention, this method comprises:
S11: being managed rear end disk using virtualization layer, and rear end disk is added to management mode or image mould
Formula is managed collectively；
S12: the rear end disk in management mode or mapping mode is divided by multiple blocks by virtualization technology
extent；
S13: it organizes the multiple block extent to form virtual disk, virtual disk is supplied to upper layer and is connect
Mouthful.
As it can be seen that magnetic disc virtualization layer is added between cache layer and disk array layer, from virtualization layer it is seen that disk
Array or single disk even logical volume, obtain virtual disk and are supplied to upper layer connecing after being handled by virtualization layer
Mouthful, high-level interface is cache layer, and by virtualization technology to the disk dividing regions in management mode or mapping mode
Block extent, block extent are the data units of managing I/O, by rear end disk partition at different block extent, reach magnetic
The maximum of disk space utilizes, and so uses disk space using virtualization technology, it is sharp to greatest extent to reach disk space
With, realize in this way improve disk space usage.
Based on the above method, specifically, virtualization layer is arranged between disk array layer and cache layer.
Wherein, rear end disk includes disk array, single disk or logical volume.High-level interface is cache layer.For rear
End disk is divided into multiple blocks, is that each disk in the disk of rear end is divided into multiple blocks, will be divided by a disk
Multiple block organizations at a virtual disk, be supplied to high-level interface.
Specifically, block extent is divided to the disk in management mode or mapping mode by virtualization technology,
Wherein, the data unit of managing I/O is block extent, and the purpose of this management is by disk partition into different blocks, to reach
Maximum to memory space utilizes.By different block extent, then one or more block extent is reflected
It is mapped to upper layer and forms virtual disk i.e. vdisk, provide service by vdisk for high-level interface.This method is in cache layer and disk
Magnetic disc virtualization layer is added between array layer, virtualization layer it is seen that disk array or single disk even logical volume,
Vdisk i.e. virtual disk is supplied to high-level interface, i.e. cache layer after being handled by virtualization layer, it is so empty by storage
Quasi-ization technology gets up space utilization, reaches space and utilizes to greatest extent.
This method mainly passes through in intel Virtualization Technology application to storage equipment such as disk.Pass through in big data era virtual
Change technology is by rear end Disk Mapping to cache module, to achieve the purpose that utilize disk space to greatest extent, this method is improved
Disk utilization reduces the cost of entire storage equipment.Currently, under multiple memory nodes, that is, multiple disks scene, wherein having
A little data are written directly on the corresponding disk of a controller, and in addition the rear end disk of controller is in more idle shape
State, the utilization rate of disk is very low at this time, and load is very unbalanced, and this method makes full use of the i.e. multiple disks of multiple nodes
Memory space, i.e., RAID is unified to rear end disk and manages to form disk array, virtualized on the basis of disk array
Management achievees the purpose that improve disk utilization.
Specifically, being carried out in virtualization layer by disk, logical volume either disk array of the virtualization technology to bottom
Management, the disk that these are managed is set as management mode or mapping mode, then in above two mode
Disk divides IO administrative unit, and IO administrative unit is extent block, then forms virtual disk by block in varying numbers,
It is finally provided to high-level interface, block division is detailed in Fig. 2, and Fig. 2 is virtualization layer data management structure schematic diagram.
Rear end disk is the final medium for realizing data storage, all data, comprising: metadata, management data etc. are most
It will be issued to the consistency and safety that just can guarantee data on disk eventually, again from rear end magnetic when data need to read
Disk is read out.It is various physical disks, logical volume and magnetic to rear end disk compatible type to extend the function of virtualization layer
Disk array.Rear end disk is added to management mode or mapping mode by virtualization layer, is managed collectively, this is not added to
The rear end disk of both of which is not managed by virtualization layer, i.e., cannot be mapped to caching by virtualization technology and used, together
When management mode and mapping mode can switch under certain conditions, thus reach efficiently utilize disk space mesh
's.Disk is in non-management mode before not being managed, non-management mode can enter manager's mode by creation,
Mapping mode can also be entered by creating image；It can be moved into the disk of management mode or mapping mode by data
It moves, i.e., the data in the data block of one storage pool, which move on in another storage pool data block, to be stored, in management mode and image
It is switched between mode, is detailed in Fig. 3 about switching between mode, Fig. 3 is that Disk Mode switches schematic diagram.
It is described that the multiple block extent is organized to the process to form virtual disk specifically: to adopt in step S13
It organizes the multiple block extent to form virtual hard disk with block management strategy.
Wherein, the block management strategy includes image policies, serializing strategy or striping strategy.
Further, image policies are as follows: rear end disk space is mapped to virtual disk, IO number is carried out by block extent
According to management.
Serializing strategy are as follows: be managed continuous block extent composition virtual disk.
Striping strategy are as follows: be managed the block extent composition virtual disk of dispersion.
Further, block extent is IO administrative unit, for carrying out I/O data management in virtualization layer.Each block
The data capacity of extent is equal.
For determining the disk of management mode or mapping mode, these disks are put into a disk management group i.e. first
As storage pool, then can by virtualization technology, by the disk in the same storage pool, it is divided into many block extent,
The size of these blocks must be equal, these blocks are exactly to carry out the data unit of IO management in virtualization layer.Block simultaneously
The size of extent can from 8M, 16M, until 8G size, the size of block determines the size of storage pool total capacity, this
Block size is in storage pool at the beginning of establishment just it has been determined that cannot modify after determining.
Virtualization layer is divided disk by block, but is also needed these block managements.Block
The administrative skill of extent uses three kinds of image, serializing and striping strategies, by above-mentioned three kinds of strategies by block organization
Get up to be formed virtual disk mapped cache.Wherein image policies are that rear end disk space 1:1 is mapped to virtual disk, but IO
Data management unit is still block；Ordered strategy is to be managed continuous block composition virtual disk；Striping plan
Slightly it is to be managed the block composition virtual disk of dispersion, finally is presented to the virtual disk of caching.
To sum up, a kind of disk storage management method provided by the present invention carries out pipe to rear end disk using virtualization layer
Reason, is added to management mode or mapping mode for rear end disk, is managed collectively；It will be in management by virtualization technology
The rear end disk of mode or mapping mode is divided into multiple block extent；The multiple block extent is organized into shape
At virtual disk, virtual disk is supplied to high-level interface.As it can be seen that it is virtual that disk is added between cache layer and disk array layer
Change layer, from virtualization layer it is seen that disk array or single disk even logical volume, are handled by virtualization layer
After obtain virtual disk and be supplied to high-level interface, high-level interface is cache layer, and by virtualization technology in management
The disk of mode or mapping mode divides block extent, and block extent is the data unit of managing I/O, by rear end disk
It is divided into different block extent, reaches the maximum of disk space and utilizes, it is so using virtualization technology that disk space is sharp
It uses, reaches disk space and utilize to greatest extent, realize improve disk space usage in this way.
A kind of disk storage management method provided by the present invention is described in detail above.Tool used herein
Principle and implementation of the present invention are described for body example, the above embodiments are only used to help understand this hair
Bright method and its core concept.It should be pointed out that for those skilled in the art, not departing from the present invention
, can be with several improvements and modifications are made to the present invention under the premise of principle, these improvement and modification also fall into right of the present invention
It is required that protection scope in.
Claims (8)
1. a kind of disk storage management method characterized by comprising
Rear end disk is managed using virtualization layer, rear end disk is added to management mode or mapping mode, is carried out
Unified management；
The rear end disk in management mode or mapping mode is divided into multiple block extent by virtualization technology；
It organizes the multiple block extent to form virtual disk, virtual disk is supplied to high-level interface；
The rear end disk includes disk array, single disk or logical volume；The high-level interface is cache layer.
2. the method as described in claim 1, which is characterized in that virtualization layer setting disk array layer and cache layer it
Between.
3. the method as described in claim 1, which is characterized in that described to organize the multiple block extent to form void
Quasi- disk, comprising:
It organizes the multiple block extent to form virtual hard disk using block management strategy.
4. method as claimed in claim 3, which is characterized in that the block management strategy includes image policies, serializing plan
Summary or striping strategy.
5. method as claimed in claim 4, which is characterized in that the image policies are as follows: rear end disk space is mapped to void
Quasi- disk carries out I/O data management by block extent.
6. method as claimed in claim 4, which is characterized in that the serializing strategy are as follows: by continuous block extent group
It is managed at virtual disk.
7. method as claimed in claim 4, which is characterized in that the striping strategy are as follows: by the block extent group of dispersion
It is managed at virtual disk.
8. method as claimed in any of claims 1 to 7 in one of claims, which is characterized in that the block extent is that IO management is single
Member, for carrying out I/O data management in virtualization layer；The data capacity of each block extent is equal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610617262.1A CN106293519B (en) | 2016-07-29 | 2016-07-29 | A kind of disk storage management method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610617262.1A CN106293519B (en) | 2016-07-29 | 2016-07-29 | A kind of disk storage management method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106293519A CN106293519A (en) | 2017-01-04 |
| CN106293519B true CN106293519B (en) | 2019-05-10 |
Family
ID=57663646
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610617262.1A Active CN106293519B (en) | 2016-07-29 | 2016-07-29 | A kind of disk storage management method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106293519B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102841758A (en) * | 2011-06-20 | 2012-12-26 | 钜贯德科技股份有限公司 | High-effect virtual disk management system |
| CN103348331A (en) * | 2010-10-27 | 2013-10-09 | 尹摩特斯公司 | Tiered data storage system with data management and method of operation thereof |
| CN103685408A (en) * | 2012-09-18 | 2014-03-26 | 英业达科技有限公司 | Server for providing reading base mirror by storage area network, host and method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8959293B2 (en) * | 2010-12-14 | 2015-02-17 | Microsoft Corporation | Data deduplication in a virtualization environment |
| US9519496B2 (en) * | 2011-04-26 | 2016-12-13 | Microsoft Technology Licensing, Llc | Detecting and preventing virtual disk storage linkage faults |
-
2016
- 2016-07-29 CN CN201610617262.1A patent/CN106293519B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103348331A (en) * | 2010-10-27 | 2013-10-09 | 尹摩特斯公司 | Tiered data storage system with data management and method of operation thereof |
| CN102841758A (en) * | 2011-06-20 | 2012-12-26 | 钜贯德科技股份有限公司 | High-effect virtual disk management system |
| CN103685408A (en) * | 2012-09-18 | 2014-03-26 | 英业达科技有限公司 | Server for providing reading base mirror by storage area network, host and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106293519A (en) | 2017-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104317742B (en) | Automatic thin-provisioning method for optimizing space management | |
| CN101458613B (en) | Method for implementing mixed hierarchical array, the hierarchical array and storage system | |
| US8225039B2 (en) | Storage controller and virtual volume control method | |
| CN101241476B (en) | Dummy storage system and method | |
| CN103761053B (en) | A kind of data processing method and device | |
| CN104536903B (en) | A kind of mixing storage method and system stored classifiedly by data attribute | |
| US8745327B1 (en) | Methods, systems, and computer readable medium for controlling prioritization of tiering and spin down features in a data storage system | |
| CN106326133A (en) | A storage system, a storage management device, a storage device, a mixed storage device and a storage management method | |
| GB2377049A (en) | Billing for utilisation of a data storage array | |
| CN103095805A (en) | Cloud storage system of data intelligent and decentralized management | |
| CN101997918A (en) | Method for allocating mass storage resources according to needs in heterogeneous SAN (Storage Area Network) environment | |
| CN107291889A (en) | A kind of date storage method and system | |
| JP5325304B2 (en) | Identify and control performance hot spots in virtual volumes | |
| CN101221485A (en) | Method for establishing redundant magnetic disk array and control device thereof | |
| CN104272242B (en) | Create encryption memory bank | |
| CN103514249A (en) | Method and system for automatic data reduction and storage device | |
| CN105808157A (en) | Storage architecture creating method, storage access method and storage system | |
| CN110377529A (en) | A kind of method, apparatus and equipment of full flash memory storage system data management | |
| CN104516929B (en) | Method and apparatus for file system | |
| CN102520885B (en) | Data management system for hybrid hard disk | |
| CN109815737A (en) | A kind of single-deck multi-user's physical isolation method based on address of cache | |
| CN101997919B (en) | Storage resource management method and device | |
| JP2018197933A (en) | Storage control device, information processing system and program | |
| CN103823641A (en) | Online expanded virtual volume system and realizing method thereof | |
| CN106293519B (en) | A kind of disk storage management method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |