CN104050014A - Efficient storage management method based on virtualization platform - Google Patents
Efficient storage management method based on virtualization platform Download PDFInfo
- Publication number
- CN104050014A CN104050014A CN201410221805.9A CN201410221805A CN104050014A CN 104050014 A CN104050014 A CN 104050014A CN 201410221805 A CN201410221805 A CN 201410221805A CN 104050014 A CN104050014 A CN 104050014A
- Authority
- CN
- China
- Prior art keywords
- resource pool
- virtual machine
- virtual
- storage management
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention relates to an efficient storage management method based on a virtualization platform. The method comprises the following steps: 1), taking over direct-connection disks on a server by a storage management virtual machine in the virtualization platform; 2) converging the direct-connection disks into a storage resource pool by the storage management virtual machine; 3) after establishing the storage resource pool, adding a solid hard disk into the storage resource pool, and starting a secondary caching function of the storage management virtual machine; 4), providing the storage resource pool to the virtualization platform, and establishing various virtualization application virtual machines on the virtualization platform; 5) performing back-up management on the storage management virtual machine according to a set cycle. Compared with the prior art, the efficient storage management method has the advantages of improving the data storage performance, simplifying the storage facility management and deployment, performing back-up, improving the safety of a storage management system and the like.
Description
Technical field
The present invention relates to a kind of computer memory technical field, especially relate to a kind of efficient storage management method based on virtual platform.
Background technology
Under traditional virtual environment, the physical disk of direct-connected server offers virtual platform with naked disk-form, as the basic resource of virtualization applications, due to the restriction of virtual platform self, physical disk can not be pooled to memory resource pool, if multiple disks are pooled to a memory resource pool, need to be by the hardware RAID function of SAS/SATA HBA card, configuration is entered in third party's configuration tool that this function need to provide in HBA card manufacturer, so just can not be simply, flexibly, efficiently disk is pooled to memory resource pool;
In actual virtualization applications scene, on virtual platform, can move multiple application virtual machines, environment more complicated is higher to performance requirement, virtual platform can not add solid state hard disc as L2 cache, improves the IO readwrite performance of virtual application on virtual platform.
Through retrieval, the Chinese patent that publication number is CN101604226 discloses a kind of method that builds raising performance of storage system in dynamic buffering pond based on virtual RAID, and this storage system formation comprises: physical storage device, storage array, storage array turnkey console, virtual RAID, virtual cache pond.Construction step comprises: set virtual cache pond strategy; Create virtual RAID, create block device mapping table.Create virtual cache pond, create virtual RAID mapping table.Extract hot spot data to cache pool, create virtual cache pond mapping table; Hot spot data is upgraded in timing, amendment hot spot data mapping table; Empty virtual cache pond.Revise virtual RAID, modified block device map.Amendment virtual cache pond, revises virtual RAID mapping table.Its object is not increase under the prerequisite of hardware cost in the limited equipment slots of the system that do not take position, effectively solves the system performance decline problem that buffer memory capacity deficiency causes, and it has solved hardware cache off-capacity problem; But in virtualization applications, its also exist cache resources deficiency, IO readwrite performance poor, hardware performance is required to the problems such as high.
In summary, on virtual platform, use the classic method of direct-connected disk resource, obviously have in actual use inconvenience and defect, so be necessary to be improved.
Summary of the invention
Object of the present invention is exactly to provide a kind of efficient storage management method based on virtual platform in order to overcome the defect that above-mentioned prior art exists, improve data memory property, simplify storage facility management and dispose, because storage management system is virtual machine, can back up it, improve the security of storage management system.
Object of the present invention can be achieved through the following technical solutions:
An efficient storage management method based on virtual platform, is characterized in that, comprises the following steps:
1), in virtual platform, storage administration virtual machine is taken over the direct-connected disk on server;
2) storage administration virtual machine pools memory resource pool direct-connected disk;
3) set up after memory resource pool, solid state hard disc is added in memory resource pool, start the L2 cache function of storage administration virtual machine;
4) memory resource pool is offered to virtual platform, and on virtual platform, set up various virtualization applications virtual machines;
5), according to setting cycle, storage administration virtual machine is carried out to backup management.
The direct-connected disk that described storage administration virtual machine is taken on server is specially:
11) pattern that the SAS/SATA HBA card of carry physical disk is set is direct mode operation;
12) storage administration virtual machine direct detection is to all physical disks on HBA card.
Described memory resource pool is parallel striping resource pool, embodies redundant resource pond, or the resource pool that mixes with redundancy of striping.
Described storage administration virtual machine comprises L2 cache module and resource pool management module.
The machine-readable IO data of described applying virtual are specific as follows:
When the required IO data process storage administration virtual machine reading of described application virtual machine, L2 cache module makes to read IO data and first reads from solid state hard disc, if hit, return data, otherwise, by resource pool management module, the physical disk reading out data from memory resource pool returns again, and data are write to solid state hard disc.
It is specific as follows that described application virtual machine is write IO data:
IO data first write after solid state hard disc, return results, and then asynchronous sync is to the direct-connected disk in memory resource pool, and data after direct-connected disk, then are removed these data of solid state hard disc by asynchronous sync.
Described storage administration virtual machine is the virtual machine that operation has storage management system, can back up storage management system, and after storage management system occurs extremely, quick-recovery soon.
Described virtual platform comprises VMware, KVM, XEN or Hyper-V.
Compared with prior art, the present invention has the following advantages:
(1) direct-connected disk is taken over by storage administration virtual machine, in storage administration virtual machine, disk is converged and configured, can simplify like this, flexibly disk be pooled to memory resource pool, offer virtual platform, as the basic resource of virtualization applications;
(2) increase after L2 cache, can promote greatly IO readwrite performance;
(3) storage management system operates in virtual machine, can very convenient storage management system be backed up, and after storage management system occurs extremely, quick-recovery soon.
Brief description of the drawings
Fig. 1 is the efficient storage management schematic diagram that the present invention is based on virtual platform;
Fig. 2 is storage administration virtual machine schematic diagram of the present invention;
Fig. 3 is memory resource pool access schematic diagram of the present invention;
Fig. 4 is the machine-readable IO schematic diagram data of applying virtual of the present invention;
Fig. 5 is that application virtual machine of the present invention is write IO schematic diagram data.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in detail.
Embodiment
As shown in Figure 1, the present embodiment provides a kind of efficient storage management method based on virtual platform, is applied in virtual platform, and the method comprises:
(1). in virtual platform, the SAS/SATA HBA card of carry physical disk is set, this HBA card is PCI equipment, enables the pass through pattern of this PCI equipment;
(2). dispose a virtual machine on virtual platform, storage management system operates in this virtual machine, now, described storage management system can direct detection to all physical disks on HBA card, virtual platform has made the disk on have more than is needed HBA card.
(3). in the virtual machine of disposing, start the resource pool management function of storage management system, physical disk on all HBA cards is built into a memory resource pool, as shown in Figure 2, according to different storage policies, memory resource pool can be to embody the parallel striping resource pool of performance, can be also the redundant resource pond of embodying data security, can also be the resource pool that striping mixes with redundancy.
(4). set up after memory resource pool, start the L2 cache function of storage management system, solid state hard disc is added in memory resource pool, realize the function of L2 cache.As shown in Figure 2.
(5). as shown in Figure 3, all physical disks, by the storage management system in virtual machine, have pooled memory resource pool.The standard iscsi or the nfs that form by the virtual network based on virtual platform, memory resource pool is offered to virtual platform, now, can be on virtual platform, set up various virtualization applications virtual machines, these virtual machines are to be all stored in above-mentioned resource pool.
(6). as shown in Figure 4, the required IO data that read of application virtual machine system are through storage administration virtual machine, in storage management system, L2 cache module makes to read IO data and first reads from solid state hard disc, if hit, return data, miss, by resource pool management module, the physical disk reading out data from resource pool returns again, and data are write to solid state hard disc;
(7). as shown in Figure 2, what application virtual machine system produced writes IO data, and data first write after solid state hard disc, returns results, and then asynchronous sync is to physical disk, and data after physical disk, then are removed these data of solid state hard disc by asynchronous sync.
(8). storage management system operates in virtual machine, and regular backup storage management virtual machine, after storage administration virtual machine occurs extremely, can recover storage management system in time.
In sum, the present invention is by efficient storage administration, makes under virtual platform the management of direct-connected disk more flexible, easy, and virtualization applications performance also can obtain great lifting, and storage management system can be protected easily.
Certainly; the present invention also can have other various embodiments; in the situation that not deviating from spirit of the present invention and essence thereof, those of ordinary skill in the art are when making according to the present invention various corresponding variations, but these corresponding variations all should belong to the protection domain of the appended claim of the present invention.
Claims (8)
1. the efficient storage management method based on virtual platform, is characterized in that, comprises the following steps:
1), in virtual platform, storage administration virtual machine is taken over the direct-connected disk on server;
2) storage administration virtual machine pools memory resource pool direct-connected disk;
3) set up after memory resource pool, solid state hard disc is added in memory resource pool, start the L2 cache function of storage administration virtual machine;
4) memory resource pool is offered to virtual platform, and on virtual platform, set up various virtualization applications virtual machines;
5), according to setting cycle, storage administration virtual machine is carried out to backup management.
2. a kind of efficient storage management method based on virtual platform according to claim 1, is characterized in that, the direct-connected disk that described storage administration virtual machine is taken on server is specially:
11) pattern that the SAS/SATA HBA card of carry physical disk is set is direct mode operation;
12) storage administration virtual machine direct detection is to all physical disks on HBA card.
3. a kind of efficient storage management method based on virtual platform according to claim 1, is characterized in that, described memory resource pool is parallel striping resource pool, embodies redundant resource pond, or the resource pool that mixes with redundancy of striping.
4. a kind of efficient storage management method based on virtual platform according to claim 1, is characterized in that, described storage administration virtual machine comprises L2 cache module and resource pool management module.
5. a kind of efficient storage management method based on virtual platform according to claim 4, is characterized in that, the machine-readable IO data of described applying virtual are specific as follows:
When the required IO data process storage administration virtual machine reading of described application virtual machine, L2 cache module makes to read IO data and first reads from solid state hard disc, if hit, return data, otherwise, by resource pool management module, the physical disk reading out data from memory resource pool returns again, and data are write to solid state hard disc.
6. a kind of efficient storage management method based on virtual platform according to claim 4, is characterized in that, it is specific as follows that described application virtual machine is write IO data:
IO data first write after solid state hard disc, return results, and then asynchronous sync is to the direct-connected disk in memory resource pool, and data after direct-connected disk, then are removed these data of solid state hard disc by asynchronous sync.
7. a kind of efficient storage management method based on virtual platform according to claim 1, it is characterized in that, described storage administration virtual machine is the virtual machine that operation has storage management system, can back up storage management system, after storage management system occurs extremely, quick-recovery soon.
8. a kind of efficient storage management method based on virtual platform according to claim 1, is characterized in that, described virtual platform comprises VMware, KVM, XEN or Hyper-V.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410221805.9A CN104050014B (en) | 2014-05-23 | 2014-05-23 | Efficient storage management method based on virtual platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410221805.9A CN104050014B (en) | 2014-05-23 | 2014-05-23 | Efficient storage management method based on virtual platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104050014A true CN104050014A (en) | 2014-09-17 |
| CN104050014B CN104050014B (en) | 2017-12-29 |
Family
ID=51502916
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410221805.9A Expired - Fee Related CN104050014B (en) | 2014-05-23 | 2014-05-23 | Efficient storage management method based on virtual platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104050014B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104462389A (en) * | 2014-12-10 | 2015-03-25 | 上海爱数软件有限公司 | Method for implementing distributed file systems on basis of hierarchical storage |
| CN104503825A (en) * | 2014-12-29 | 2015-04-08 | 西安电子科技大学 | Mixed type equipment virtualization method based on KVM (Kernel-based Virtual Machine) |
| CN104820614A (en) * | 2015-05-08 | 2015-08-05 | 浪潮电子信息产业股份有限公司 | Method for using tape library equipment to back up under virtual environment |
| CN106775942A (en) * | 2016-12-09 | 2017-05-31 | 中国科学院软件研究所 | Solid-state disk cache management system and method that a kind of cloud application is oriented to |
| CN107145310A (en) * | 2017-05-24 | 2017-09-08 | 珠海金山网络游戏科技有限公司 | A kind of method for realizing the optimization of network storage I/O bottleneck, apparatus and system |
| CN108182128A (en) * | 2017-12-29 | 2018-06-19 | 广州鼎甲计算机科技有限公司 | Based on XEN without Agent virtual back-up restoring method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101788889A (en) * | 2010-03-03 | 2010-07-28 | 浪潮(北京)电子信息产业有限公司 | Memory virtualization system and method |
| CN102132251A (en) * | 2008-07-17 | 2011-07-20 | Lsi公司 | Systems and methods for booting a bootable virtual storage appliance on a virtualized server platform |
| US20110202728A1 (en) * | 2010-02-17 | 2011-08-18 | Lsi Corporation | Methods and apparatus for managing cache persistence in a storage system using multiple virtual machines |
| CN102521147A (en) * | 2011-11-17 | 2012-06-27 | 曙光信息产业(北京)有限公司 | Management method by using rapid non-volatile medium as cache |
| CN102622189A (en) * | 2011-12-31 | 2012-08-01 | 成都市华为赛门铁克科技有限公司 | Storage virtualization device, data storage method and system |
| CN102945207A (en) * | 2012-10-26 | 2013-02-27 | 浪潮(北京)电子信息产业有限公司 | Cache management method and system for block-level data |
| CN103268252A (en) * | 2013-05-12 | 2013-08-28 | 南京载玄信息科技有限公司 | Virtualization platform system based on distributed storage and achieving method thereof |
-
2014
- 2014-05-23 CN CN201410221805.9A patent/CN104050014B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102132251A (en) * | 2008-07-17 | 2011-07-20 | Lsi公司 | Systems and methods for booting a bootable virtual storage appliance on a virtualized server platform |
| US20110202728A1 (en) * | 2010-02-17 | 2011-08-18 | Lsi Corporation | Methods and apparatus for managing cache persistence in a storage system using multiple virtual machines |
| CN101788889A (en) * | 2010-03-03 | 2010-07-28 | 浪潮(北京)电子信息产业有限公司 | Memory virtualization system and method |
| CN102521147A (en) * | 2011-11-17 | 2012-06-27 | 曙光信息产业(北京)有限公司 | Management method by using rapid non-volatile medium as cache |
| CN102622189A (en) * | 2011-12-31 | 2012-08-01 | 成都市华为赛门铁克科技有限公司 | Storage virtualization device, data storage method and system |
| CN102945207A (en) * | 2012-10-26 | 2013-02-27 | 浪潮(北京)电子信息产业有限公司 | Cache management method and system for block-level data |
| CN103268252A (en) * | 2013-05-12 | 2013-08-28 | 南京载玄信息科技有限公司 | Virtualization platform system based on distributed storage and achieving method thereof |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104462389A (en) * | 2014-12-10 | 2015-03-25 | 上海爱数软件有限公司 | Method for implementing distributed file systems on basis of hierarchical storage |
| CN104462389B (en) * | 2014-12-10 | 2018-01-30 | 上海爱数信息技术股份有限公司 | Distributed file system implementation method based on classification storage |
| CN104503825A (en) * | 2014-12-29 | 2015-04-08 | 西安电子科技大学 | Mixed type equipment virtualization method based on KVM (Kernel-based Virtual Machine) |
| CN104503825B (en) * | 2014-12-29 | 2017-11-24 | 西安电子科技大学 | One kind is based on KVM hybrid apparatus virtual methods |
| CN104820614A (en) * | 2015-05-08 | 2015-08-05 | 浪潮电子信息产业股份有限公司 | Method for using tape library equipment to back up under virtual environment |
| CN106775942A (en) * | 2016-12-09 | 2017-05-31 | 中国科学院软件研究所 | Solid-state disk cache management system and method that a kind of cloud application is oriented to |
| CN106775942B (en) * | 2016-12-09 | 2020-06-16 | 中国科学院软件研究所 | Cloud application-oriented solid-state disk cache management system and method |
| CN107145310A (en) * | 2017-05-24 | 2017-09-08 | 珠海金山网络游戏科技有限公司 | A kind of method for realizing the optimization of network storage I/O bottleneck, apparatus and system |
| CN108182128A (en) * | 2017-12-29 | 2018-06-19 | 广州鼎甲计算机科技有限公司 | Based on XEN without Agent virtual back-up restoring method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104050014B (en) | 2017-12-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9823877B2 (en) | Virtual machine backup from storage snapshot | |
| CN107632939B (en) | Mapping table for storage device | |
| CN104050014A (en) | Efficient storage management method based on virtualization platform | |
| US8135914B2 (en) | Managing cache data and metadata | |
| EP3617867B1 (en) | Fragment management method and fragment management apparatus | |
| US10467044B2 (en) | Transaction processing method and apparatus, and computer system | |
| CN106569742A (en) | Storage management method and storage equipment | |
| US9710283B2 (en) | System and method for pre-storing small data files into a page-cache and performing reading and writing to the page cache during booting | |
| US10261908B2 (en) | Method and apparatus for expanding cache size for cache array | |
| US10365845B1 (en) | Mapped raid restripe for improved drive utilization | |
| EP2836900B1 (en) | Creating encrypted storage volumes | |
| CN105975878B (en) | Method for secure storing and system based on Nand Flash flash memory | |
| CN113220242B (en) | Storage management method, apparatus, and computer readable medium | |
| CN106445832A (en) | Address mapping method and apparatus for flash storage system | |
| CN103473266A (en) | Solid state disk and method for deleting repeating data thereof | |
| CN111666046B (en) | Data storage method, device and equipment | |
| US8271717B2 (en) | Computing machine with virtual machine monitor | |
| US9645946B2 (en) | Encryption for solid state drives (SSDs) | |
| CN109815059A (en) | A kind of data back up method, system and board and storage medium | |
| CN102508743A (en) | Multi-point backup and real-time protection method for Linux file system | |
| CN107451069A (en) | The rubbish recovering method of Solid-state disc array based on headspace | |
| US20230142948A1 (en) | Techniques for managing context information for a storage device | |
| CN106611109A (en) | Software operating method on storage device | |
| CN103064926B (en) | Data processing method and device | |
| US10803109B2 (en) | Method and device for reading and writing video data in NAS device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 201112 Shanghai, Minhang District, United Airlines route 1188, building second layer A-1 unit 8 Applicant after: SHANGHAI EISOO INFORMATION TECHNOLOGY CO., LTD. Address before: 201112 Shanghai, Minhang District, United Airlines route 1188, building second layer A-1 unit 8 Applicant before: Shanghai Eisoo Software Co.,Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20171229 Termination date: 20190523 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |