CN103744792B - It is a kind of to realize the system that the automatic simplify configuration of storage system is fully distributed - Google Patents
It is a kind of to realize the system that the automatic simplify configuration of storage system is fully distributed Download PDFInfo
- Publication number
- CN103744792B CN103744792B CN201410011641.7A CN201410011641A CN103744792B CN 103744792 B CN103744792 B CN 103744792B CN 201410011641 A CN201410011641 A CN 201410011641A CN 103744792 B CN103744792 B CN 103744792B
- Authority
- CN
- China
- Prior art keywords
- block
- module
- full
- distribution
- storage pool
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 claims abstract description 22
- 238000013507 mapping Methods 0.000 claims abstract description 19
- 238000011084 recovery Methods 0.000 claims abstract description 14
- 238000005192 partition Methods 0.000 claims abstract description 4
- 238000004458 analytical method Methods 0.000 claims description 12
- 230000006870 function Effects 0.000 claims description 7
- 239000000976 ink Substances 0.000 claims description 6
- 230000006399 behavior Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 5
- 230000015556 catabolic process Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 230000001429 stepping effect Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The system architecture that the automatic simplify configuration of storage system is fully distributed is realized the invention discloses a kind of, on automatic allocation algorithm in full, using the distribution for first completing storage pool physical memory space block, then storage pool is completed again to the mapping process of the block of distribution volume in full, ensure the correctness of assigning process in full, for assigning process in full, using block administrative mechanism, only a data block is allowed to have an allocator, so as to during distribution according to need, the event of same piece of concurrent operations is avoided to occur, ensure the uniqueness of distribution data block, in order to ensure the characteristic fully distributed under automatic simplify configuration system, what shielding distribution in full was rolled up simplifies recovery attribute, ensure the permanent of partition characteristic in full；Using the present invention, the distribution in full of automatic simplify configuration storage pool can be realized, automatic simplify configuration storage pool space is fully distributed by user's request, can be automatic, it is efficiently completed automatic simplify configuration storage pool assignment in full.
Description
Technical field
The system architecture that the automatic simplify configuration of storage system is fully distributed is realized the present invention relates to a kind of, is generally used for storage
In system, it is desirable to provide a kind of system architecture fully distributed automatic simplify configuration storage pool space.Using the system
Framework, the storage pool space that distributing user that can be automatic, in full is specified, the similar traditional logic volume of logical volume attribute of establishment
Attribute.The present invention automatically, by designated capabilities can fully distribute the storage pool space of automatic simplify configuration, can be automatic
In the system of simplify configuration, meet user and use similar conventional attribute logical volume（Non-automatic simplify configuration function）Demand.
Technical background
Automatic simplify configuration storage scheme can provide the virtual drive of Large Copacity to operating system.The core of this technology
The heart is " hollow ".Briefly, actual physical storage device may be so not more, and allow operating system to think there is this
Big memory space.This data being primarily due in enterprise is also often gradually to increase, rather than has this at the very start
It is many.
Automatic simplify configuration extends memory management functions, although the physical capacity of actual distribution is small, but can be operation
System provides the virtual memory space of vast capacity.As the data of application write-in are more and more, the physical memory space can also
Extension in time, without extended by hands.In other words, configuration provides are simplified automatically is " operation time space ", can significantly be subtracted
It is few to have distributed but untapped memory space.
But, in order to improve automatic simplify configuration system architecture, the logical volume of similar conventional attribute should be also provided, because
And not all user is required for the function of automatic simplify configuration.Such as, some users can accurately predict oneself need it is much
Memory space be used to data storage information；Also some steppings preserve the user of data message, it is only necessary to store given data
Within the storage system, without the sustainable growth in the space that looks to the future.
All memory spaces are pooled in a resource pool by automatic simplify configuration, and will using " block " of unified size
Space is divided, and finally, the unit fully distributed is exactly " block " in resource pool.
In automatic simplify configuration fully distribution, using distribution technique in full, the logic that the technology can be specified according to user
Volume Space size, disposably distributes to distribution in full by the corresponding spatial content of storage pool space and rolls up.This method of salary distribution is one
Secondary property, and actual memory space can be taken immediately.
Automatic simplify configuration includes storage pool and distribution volume in full.Wherein storage pool space is to take actual physics space,
And it is exactly the virtual drive that operating system is supplied to by virtual map fully to distribute volume, and take actual physics space.By
Storage pool provides memory space to distribution volume in full, and a storage pool can correspond to multiple distribution volumes in full, but multiple in full
Distribute capacity of the capacity summation no more than storage pool of volume.
The content of the invention
The technical problem to be solved in the present invention is：In order to ensure that automatic simplify configuration is normally run, automatic simplify configuration
Distribution in full is badly in need of solving the problems, such as three aspects, and one is allocation algorithm problem that automatic simplify configuration is fully distributed, in order to ensure
Distribute the correctness of storage pool space, it would be desirable to design an accurately allocation algorithm in full；Another is to solve concurrently to visit
The problem of asking, it is ensured that to the alternative of same piece of distribution in full of same storage pool, it is to avoid concurrently distribute same piece,
Ensure the uniqueness of distribution block；Last is the particular attribute for ensureing distribution volume in full, because the logic of similar conventional attribute
Volume, so can not be with the function of simplifying recovery, it is ensured that fully distributive property is permanent.
By the system architecture, the distribution in full of automatic thin device storage pool can be realized, storage pool space presses user
Designated capabilities are fully distributed, and can be created the distribution logical volume in full with conventional attribute, be met the demand of different users, complete
It is apt to the system architecture of automatic simplify configuration.
The present invention can fully distribute storage pool space, be divided storage pool space automatically by fully being distributed by designated capabilities
Dispensing fully distributes volume so that user uses, and user is without manual intervention assigning process in full.
The technical solution adopted in the present invention is：
A kind of to realize the system architecture that the automatic simplify configuration of storage system is fully distributed, the framework is supported in different operations
System, realizes the distribution in full of automatic simplify configuration storage pool space.
On automatic allocation algorithm in full, using the distribution for first completing storage pool physical memory space block, then complete again
Mapping process of the storage pool to the block of distribution volume in full, it is ensured that the correctness of assigning process in full.For assigning process in full, adopt
Block administrative mechanism is used, only allows a data block to have an allocator, so that during distribution according to need, it is to avoid concurrent operations
Same piece of event occurs, it is ensured that the uniqueness of distribution data block.In order to ensure fully to divide under automatic simplify configuration system
The characteristic matched somebody with somebody, what shielding distribution in full was rolled up simplifies recovery attribute, it is ensured that fully partition characteristic is permanent；
The system architecture includes：1）Parameter analysis processing module；2）Block management module；3）Space authentication module；4）Block point
With module；5）Distribute block mapping block；6）Recovery shroud module is simplified, wherein：
Module 1）Parameter analysis processing module, the parameter specified according to user, including amount of capacity, device id, processing ginseng
Number information, the quantity of storage pool space block needed for analysis is calculated；
Module 2）Block management module, handles concurrent batch operation, for each block, only supports a batch operation；Carry
For data cached refresh operation, data in caching are write with a brush dipped in Chinese ink to disk, providing acquisition for distribution in full writes lock, refresh data
Deng operation；
Module 3）Space authentication module, judges whether automatic simplify configuration storage pool also has remaining space, if do not remained
Complementary space attempts to discharge some useless storage pool spaces, if remaining space returns to 0, if returned without remaining space
Without space（-ENOSPC）；
Module 4）Block distribute module, is the module that block distribution is completed in storage pool, is also the nucleus module fully distributed；Block
Distribute module can find next data block that can be used in storage pool, and judge whether the block is completely covered by I/O Request
Lid, if it is, directly remapping IO to the block；Otherwise, illustrate that the block is only partly taken, therefore the block all reset,
And IO is remapped to the block；
Module 5）Block mapping block is distributed, newly assigned piece of storage pool space and the corresponding behaviour for fully distributing volume mapping is completed
Make, map information can be inserted into the metadata information of automatic simplify configuration by the module, the block set up in storage pool with it is in full
Corresponding piece of incidence relation of volume is distributed, so as to be finally completed the mapping process fully distributed；
Module 6）Recovery shroud module is simplified, shielding distribution volume in full simplifies the function of recovery.
It is as follows that the system architecture fully distributes overall flow：
1st, can calling module 1 when starting to create distribution volume in full）Whether the incoming parameter information of processing, judge parameter
Designated capabilities parameter that is legal, being rolled up according to incoming distribution in full, and the storage pool space block size read by device id
Information etc., quantity and relevant block number of storage pool space block needed for analysis is calculated etc.；
2nd, when module 1）Quantity and relevant block number of storage pool space block etc. are calculated, when preparing distribution memory space, meeting
Calling module 2 first）, obtain and write lock；
3rd, can calling module 2 after fully mapping is assigned）The operation of refresh data, by metadata information write with a brush dipped in Chinese ink to
Disk, whole process is errorless, represents that the operation entirely distributed is completed；
4th, module 4）, can calling module 5 into after the new block of the distribution of work）By newly assigned piece in storage pool and volume space in full
Incidence relation is set up, map operation is completed.
Beneficial effects of the present invention are：
Using the present invention, the distribution in full of automatic simplify configuration storage pool can be realized, is fully dispensed from by user's request
Dynamic simplify configuration storage pool space, the capacity specified according to user distributes memory space, meets user for simplifying automatically automatically
The demand of distribution volume in full, increases the systemic-function of automatic simplify configuration, the system for improving automatic simplify configuration under configuration system
Framework, realizes people-oriented storage system.
Therefore this system architecture is used, can be automatic, it is efficiently completed what automatic simplify configuration storage pool was fully distributed
Work.
Brief description of the drawings
Fig. 1 is data intelligence degradation overall flow schematic diagram of the present invention；
Fig. 2 is data cached degradation policy module schematic flow sheet；
Fig. 3 is degrading data processing module schematic flow sheet.
Embodiment
With reference to the accompanying drawings, by embodiment, the present invention is further described：
A kind of to realize the system architecture that the automatic simplify configuration of storage system is fully distributed, the framework is supported in different operations
System, realizes the distribution in full of automatic simplify configuration storage pool space.
On automatic allocation algorithm in full, using the distribution for first completing storage pool physical memory space block, then complete again
Mapping process of the storage pool to the block of distribution volume in full, it is ensured that the correctness of assigning process in full.For assigning process in full, adopt
Block administrative mechanism is used, only allows a data block to have an allocator, so that during distribution according to need, it is to avoid concurrent operations
Same piece of event occurs, it is ensured that the uniqueness of distribution data block.In order to ensure fully to divide under automatic simplify configuration system
The characteristic matched somebody with somebody, what shielding distribution in full was rolled up simplifies recovery attribute, it is ensured that fully partition characteristic is permanent；
The system architecture includes：1）Parameter analysis processing module；2）Block management module；3）Space authentication module；4）Block point
With module；5）Distribute block mapping block；6）Recovery shroud module is simplified, wherein：
1）Parameter analysis processing module, the parameter specified according to user, including amount of capacity, device id, processing parameter letter
Breath, the quantity of storage pool space block needed for analysis is calculated；
2）Block management module, handles concurrent batch operation, for each block, only supports a batch operation；There is provided slow
The refresh operation of deposit data, data in caching are write with a brush dipped in Chinese ink to disk, and providing acquisition for distribution in full writes the behaviour such as lock, refresh data
Make；
3）Space authentication module, judges whether automatic simplify configuration storage pool also has remaining space, if without remaining empty
Between attempt to discharge some useless storage pool spaces, if remaining space return 0, if without remaining space return without sky
Between（-ENOSPC）；
4）Block distribute module, is the module that block distribution is completed in storage pool, is also the nucleus module fully distributed；Block is distributed
Module can find next data block that can be used in storage pool, and judge whether the block is completely covered by I/O Request,
If it is, directly remapping IO to the block；Otherwise, illustrate that the block is only partly taken, therefore the block is all reset, lay equal stress on
IO is mapped to the block, as shown in Figure 3；
5）Block mapping block is distributed, newly assigned piece of storage pool space and the corresponding operation for fully distributing volume mapping is completed,
Map information can be inserted into the metadata information of automatic simplify configuration by the module, the block set up in storage pool and distribution in full
Corresponding piece of incidence relation of volume, so as to be finally completed the mapping process fully distributed, as shown in Figure 2；
6）Recovery shroud module is simplified, shielding distribution volume in full simplifies the function of recovery.
The overall flow of automatic simplify configuration distribution system in full is as shown in figure 1, flow is as follows：
1st, can calling module 1 when starting to create distribution volume in full）Whether the incoming parameter information of processing, judge parameter
Designated capabilities parameter that is legal, being rolled up according to incoming distribution in full, and the storage pool space block size read by device id
Information etc., quantity and relevant block number of storage pool space block needed for analysis is calculated etc.；
2nd, when module 1）Quantity and relevant block number of storage pool space block etc. are calculated, when preparing distribution memory space, meeting
Calling module 2 first）, obtain and write lock；
3rd, can calling module 2 after fully mapping is assigned）The operation of refresh data, by metadata information write with a brush dipped in Chinese ink to
Disk, whole process is errorless, represents that the operation entirely distributed is completed；
4th, module 4）, can calling module 5 into after the new block of the distribution of work）By newly assigned piece in storage pool and volume space in full
Incidence relation is set up, map operation is completed.
Claims (2)
1. a kind of realize the system that the automatic simplify configuration of storage system is fully distributed, it is characterised in that：Calculated in automatic distribution in full
In method, using the distribution for first completing storage pool physical memory space block, storage pool is then completed again to the block of distribution volume in full
Mapping process, it is ensured that the correctness of assigning process in full, for assigning process in full, using block administrative mechanism, only allows one
Data block has an allocator, so that during distribution according to need, it is to avoid the event that same piece of concurrent operations occurs, it is ensured that
The uniqueness of data block is distributed, in order to ensure the characteristic fully distributed under automatic simplify configuration system, shielding distribution volume in full
Simplify recovery attribute, it is ensured that partition characteristic in full it is permanent；
The system includes：1）Parameter analysis processing module；2）Block management module；3）Space authentication module；4）Block distribute module；5）
Distribute block mapping block；6）Recovery shroud module is simplified, wherein：
Module 1）Parameter analysis processing module, the parameter specified according to user, including amount of capacity, device id, processing parameter letter
Breath, the quantity of storage pool space block needed for analysis is calculated；
Module 2）Block management module, handles concurrent batch operation, for each block, only supports a batch operation；There is provided slow
The refresh operation of deposit data, data in caching are write with a brush dipped in Chinese ink to disk, and providing acquisition for distribution in full writes the behaviour such as lock, refresh data
Make；
Module 3）Space authentication module, judges whether automatic simplify configuration storage pool also has remaining space, if without remaining empty
Between attempt to discharge some useless storage pool spaces, if remaining space return 0, if without remaining space return without sky
Between；
Module 4）Block distribute module, is the module that block distribution is completed in storage pool, is also the nucleus module fully distributed；Block is distributed
Module can find next data block that can be used in storage pool, and judge whether the block is completely covered by I/O Request,
If it is, directly remapping IO to the block；Otherwise, illustrate that the block is only partly taken, therefore the block is all reset, lay equal stress on
IO is mapped to the block；
Module 5）Block mapping block is distributed, newly assigned piece of storage pool space and the corresponding operation for fully distributing volume mapping is completed,
Map information can be inserted into the metadata information of automatic simplify configuration by the module, the block set up in storage pool and distribution in full
Corresponding piece of incidence relation of volume, so as to be finally completed the mapping process fully distributed；
Module 6）Recovery shroud module is simplified, shielding distribution volume in full simplifies the function of recovery.
2. it is according to claim 1 it is a kind of realize the system that the automatic simplify configuration of storage system is fully distributed, its feature exists
In it is as follows that the system fully distributes overall flow：
A, when starting to create distribution volume in full, calling module 1）The incoming parameter information of processing, judges whether parameter is legal, root
The designated capabilities parameter rolled up according to incoming distribution in full, and the storage pool space block size information read by device id, point
The quantity and relevant block number of storage pool space block needed for analysis is calculated；
B, when module 1）The quantity and relevant block number of storage pool space block are calculated, when preparing distribution memory space, is called first
Module 2）, obtain and write lock；
C, when it is in full be assigned mapping after, calling module 2）The operation of refresh data, metadata information is write with a brush dipped in Chinese ink to disk, whole
Individual process is errorless, represents that the operation entirely distributed is completed；
D, module 4）Into after the new block of the distribution of work, calling module 5）Newly assigned piece in storage pool is built with distribution volume space in full
Vertical incidence relation, completes map operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410011641.7A CN103744792B (en) | 2014-01-10 | 2014-01-10 | It is a kind of to realize the system that the automatic simplify configuration of storage system is fully distributed |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410011641.7A CN103744792B (en) | 2014-01-10 | 2014-01-10 | It is a kind of to realize the system that the automatic simplify configuration of storage system is fully distributed |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103744792A CN103744792A (en) | 2014-04-23 |
| CN103744792B true CN103744792B (en) | 2017-10-31 |
Family
ID=50501810
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410011641.7A Active CN103744792B (en) | 2014-01-10 | 2014-01-10 | It is a kind of to realize the system that the automatic simplify configuration of storage system is fully distributed |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103744792B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105740165A (en) * | 2014-12-10 | 2016-07-06 | 国际商业机器公司 | Method and apparatus for managing file system of unified storage system |
| CN107506142A (en) * | 2017-08-18 | 2017-12-22 | 郑州云海信息技术有限公司 | The distribution method and device of a kind of volume space |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968279A (en) * | 2012-11-13 | 2013-03-13 | 浪潮电子信息产业股份有限公司 | Thin provisioning method for storage system |
| CN103106150A (en) * | 2013-02-22 | 2013-05-15 | 浪潮电子信息产业股份有限公司 | Method capable of achieving automatic simplifying configuration and automatic simplifying distribution for storage system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8224782B2 (en) * | 2008-09-29 | 2012-07-17 | Hitachi, Ltd. | System and method for chunk based tiered storage volume migration |
-
2014
- 2014-01-10 CN CN201410011641.7A patent/CN103744792B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968279A (en) * | 2012-11-13 | 2013-03-13 | 浪潮电子信息产业股份有限公司 | Thin provisioning method for storage system |
| CN103106150A (en) * | 2013-02-22 | 2013-05-15 | 浪潮电子信息产业股份有限公司 | Method capable of achieving automatic simplifying configuration and automatic simplifying distribution for storage system |
Non-Patent Citations (2)
| Title |
|---|
| 存储的自动精简配置技术应用研究;邱红飞;《电信科学》;20101115(第11期);全文 * |
| 虚拟化技术中的存储管理问题研究;宋振华;《中国优秀硕士学位论文全文数据库-信息科技辑》;20100115;第2011年卷(第1期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103744792A (en) | 2014-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106385329B (en) | Processing method, device and the equipment of resource pool | |
| CN103106150B (en) | A kind of storage system that realizes simplifies configuration and the method simplifying distribution automatically | |
| CN101997918B (en) | Method for allocating mass storage resources according to needs in heterogeneous SAN (Storage Area Network) environment | |
| CN104636080B (en) | Storage system and the method for it | |
| CN109690500A (en) | The elastic management of heterogeneous storage system is provided using Simulation spatial service quality (QoS) label in system based on by processor | |
| CN101208671B (en) | Managing message queues | |
| CN103218312B (en) | file access method and system | |
| CN104346284B (en) | A kind of EMS memory management process and memory management equipment | |
| CN105892955B (en) | A kind of method and apparatus managing storage system | |
| CN103425538A (en) | Process communication method and process communication system | |
| CN109710175A (en) | Device and method for data storage management | |
| CN110209490A (en) | A kind of EMS memory management process and relevant device | |
| CN108369562A (en) | Intelligently encoding memory architecture with enhanced access scheduling device | |
| CN103116555B (en) | Data access method based on multi-body parallel cache structure | |
| CN103514249A (en) | Method and system for automatic data reduction and storage device | |
| CN105938458A (en) | Software-defined heterogeneous hybrid memory management method | |
| CN101344861A (en) | Smart card internal memory management method | |
| CN103020201B (en) | A kind of system that stores simplifies configuration storage pool and the method for organization and administration automatically | |
| CN109067903B (en) | Cloud platform cascade system | |
| CN110347510A (en) | A kind of management method, system, equipment and medium mixing memory | |
| CN103744792B (en) | It is a kind of to realize the system that the automatic simplify configuration of storage system is fully distributed | |
| US11385900B2 (en) | Accessing queue data | |
| CN109683828A (en) | A kind of rule method, system, device and the readable storage medium storing program for executing of storage system | |
| CN103744622B (en) | It is a kind of to realize the asynchronous method fully distributed of the automatic simplify configuration of storage system | |
| CN109101194A (en) | One kind writing with a brush dipped in Chinese ink performance optimization method and storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |