CN1258715C - Virtual shared storage device and method - Google Patents
Virtual shared storage device and method Download PDFInfo
- Publication number
- CN1258715C CN1258715C CNB031074294A CN03107429A CN1258715C CN 1258715 C CN1258715 C CN 1258715C CN B031074294 A CNB031074294 A CN B031074294A CN 03107429 A CN03107429 A CN 03107429A CN 1258715 C CN1258715 C CN 1258715C
- Authority
- CN
- China
- Prior art keywords
- virtual memory
- memory facilities
- storage equipment
- storage device
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000013507 mapping Methods 0.000 claims abstract description 36
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Abstract
The present invention relates to virtual share storage equipment and a method. The virtual share storage equipment comprises a virtual storage equipment block, equipment block mapping table and a physical storage equipment block, wherein the virtual storage equipment block provides an access interface for the outside; the equipment block mapping table establishes a mapping relationship between the virtual storage equipment block and the physical storage equipment block; the physical storage equipment block is used for storing data, and the physical storage equipment block uses a condition table so as to record information that whether the physical storage equipment block is idle, how much virtual storage equipment uses the physical storage equipment block, which virtual storage equipment uses the physical storage equipment block, etc. By using a virtualization technique on the basis of centralized storage equipment, the present invention can utilize uniform physical storage equipment to provide a plurality of pieces of virtual storage equipment for the outside, rapidly establish snapshots for each virtual storage equipment, increase/decrease capacity and achieve writing copy among the virtual storage equipment. Besides, the same information of the virtual storage equipment can be stored in the physical storage equipment for share; thus, the utilization ratio of the physical storage equipment and the hit rate of a buffer memory are increased, and access efficiency is raised.
Description
Technical field
The present invention relates to areas of information technology, particularly a kind of virtual shared formula memory device and method.
Background technology
Along with the increase of disk size, single computer separately will be more and more lower to the utilization factor of hard disk with the use-pattern (DAS) of one or more disk.At this situation, the centralised storage pattern has occurred: the computing machine of domestic consumer is not with hard disk, all hard disks concentrate to be formed disk array, and the storage space of working environment is provided for each user from the disk array, can also provide privately owned storage space for the user.Under this pattern, disk no longer separates use, use but put together for many computing machines, thus the utilization factor of raising disk.
The disk array of centralised storage pattern externally provides storage device interface, the use pattern of its memory device as shown in Figure 1: physical storage device 1 is partitioned into a plurality of subsets 2,3,4 ..., the independent access interface that externally provides of each subset.This use pattern has following deficiency: each subset has been cut apart amount of physical memory fully, does not support sharing of data and storage space in the equipment one-level.Especially, to preserving the applied environment of a large amount of identical information on the different subsets, these information will take a large amount of different amount of physical memory.In addition, will spend more doubling time, cause the waste of I/O bandwidth, particularly storage space and spatial cache the replicate run of subset.
Summary of the invention
The object of the present invention is to provide and a kind of storage space is carried out virtual management, makes virtual memory facilities share the Apparatus and method for of storage space as far as possible.
For achieving the above object, a kind of virtual shared formula memory device comprises:
Virtual memory facilities, for the outside provides access interface, wherein, described virtual memory facilities externally provides access interface independently of one another;
Storage device block mapping list is described the piece mapping relations between virtual memory facilities and the physical storage device;
Physical storage device, storage resources is used to store data;
Physical storage device block operating position table, describe physical storage device block whether idle, by how many virtual memory facilitieses use, by information such as which virtual memory facilities uses.
On centralized physical storage device,, allow use and share storage space as much as possible by Intel Virtualization Technology.Like this, can effectively utilize amount of physical memory and spatial cache.The system of the inventive method can utilize unified physical storage device that the access interface of a plurality of virtual memory facilitieses externally is provided, can set up snapshot, expansion/dwindle capacity for each virtual memory facilities fast, realize the COW (Copy on Write) between the virtual memory facilities; Simultaneously, identical information can be shared and be stored on the physical storage device on each virtual memory facilities, improves the utilization factor of physical storage device and the hit rate of buffer memory, and then improves access efficiency.
Description of drawings
Fig. 1 is the use pattern diagram of conventional memory device;
Fig. 2 is virtual shared formula memory device structure of the present invention and mapping relations synoptic diagram.
Embodiment
As shown in Figure 2, the present invention externally provides virtual memory facilities (external interface) 1, and the visit of virtual memory facilities interface 1 is mapped as visit to physical storage device 4 by storage device block mapping list 2.
Each virtual memory facilities 1 all has a corresponding storage device block mapping list 2, this table record the mapping relations between the piece of the piece of virtual memory facilities and physical storage device, this table is also preserved relevant access rights.As shown in Figure 2, such mapping relations have been write down in the storage device block mapping list of a virtual memory facilities VDev1: the piece B correspondence of the piece A correspondence of the piece a of virtual memory facilities VDev1 and physical storage device, the piece b of virtual memory facilities VDev1 and physical storage device; Such mapping relations have been write down in the storage device block mapping list of another one virtual memory facilities VDev2: the piece A correspondence of the piece m of virtual memory facilities VDev2 and physical storage device (share, so the read operation of these two virtual memory facilitieses can shared buffer memory), the piece n of virtual memory facilities VDev2 and the piece D correspondence of physical storage device.
In addition, all virtual memory facilitieses are shared physical storage device block operating position table 3.Essential record the operating position of each storage block in the physical storage device block operating position table 3, comprises user's quantity and concrete user.For example, among Fig. 2, this table record such information: the piece A of physical storage device 4 has two virtual memory facilitieses (VDev1 and VDev2) to use, and piece B and piece D have a virtual memory facilities using (being respectively VDev1 and VDev2) respectively, and piece C is a free block.
The preserving type of table information described above is: when the system that uses this method did not move, each virtual memory facilities corresponding equipment piece mapping table and physical storage device block operating position table were kept on the physical storage device and (mark off needed memory capacity specially); When system start-up moved, all these tables all were read in the internal memory, and their operation is all carried out in internal memory; Idle or when preparing to close, all these tables that are kept in the internal memory all are written on the physical storage device when system.
The associative operation of virtual shared formula memory device method is described below:
1. establishment virtual memory facilities: this method is set up a storage device block mapping list for the virtual memory facilities that will newly create, and revises physical storage device block operating position table: the usage count of the physical storage device block of distributing to this virtual memory facilities add in the lump the register virtual memory facilities person of being to use (one of); Just can externally provide this virtual memory facilities then.
2. deletion virtual memory facilities: the external access interface of closing this virtual memory facilities; Delete this virtual memory facilities corresponding equipment piece mapping table, in physical storage device block operating position table, revise respective physical memory device piece usage count (subtracting), cancel the use registration of the corresponding physical storage device block of this virtual memory facilities, so just reclaimed the physical resource of this virtual memory facilities use.
3. read-write virtual memory facilities: when read-write requests was carried out to virtual memory facilities in the outside, the storage device block mapping list of this method by this virtual memory facilities was the read-write requests of the read-write requests of virtual memory facilities piece being translated corresponding physical storage device block; Can check access rights as required.
4. snapshot virtual memory facilities: when certain virtual memory facilities (this is called source device) is created snapshot, only need a newly-built virtual memory facilities, its corresponding equipment piece mapping table duplicates from source device corresponding equipment piece mapping table and obtains getting final product, and revises physical storage device block operating position table then: the usage count of the physical storage device block of distributing to this virtual memory facilities add in the lump the register virtual memory facilities person of being to use (one of); Read-write requests to source device is all moved to newly-built virtual memory facilities, and source device is exactly a snapshot.
5. duplicate: can create a virtual memory facilities earlier according to the mode of snapshot, when later on when this virtual memory facilities carries out write operation, this method is transferred to this physical storage device block to write operation from physical storage device application physical storage device block, thereby realizes the COW operation; This will revise physical unit operating position table: the usage count of the physical storage device block of newly applying for is added register the user in the lump; In addition, the storage device block mapping list of this virtual memory facilities will be revised: the piece of virtual memory facilities is mapped to the physical storage device block of new application.
6. expand the capacity of virtual memory facilities: extended operation only needs to add some new virtual unit pieces and physical storage device block (storage resources) mapping relations list item in the storage device block mapping list, all initiate storage resources all are virtual, do not distribute and make respective physical, when write operation takes place, finish the distribution of physical store resource, revise physical storage device block operating position table this moment.
7. dwindle the capacity of virtual memory facilities: reduction operation realizes dwindling of virtual memory facilities capacity by the satisfied untapped list item that will reduce capacity in the storage device block mapping list is deleted.Distributed the physical store resource as this list item, then in physical storage device block operating position table, revise respective physical memory device piece usage count (subtracting), cancel the use registration of the corresponding physical storage device block of this virtual memory facilities, so just reclaimed corresponding storage resources.
Above-mentioned operations is all carried out in internal memory except that 3, so instantaneous finishing, and system externally just can provide corresponding service afterwards.With regard to having shortened the time that various operations are carried out greatly, improved efficient like this.
For operation 1,2,4,5, the source virtual memory facilities with from its through establishment/duplicate/read operation of the resulting virtual memory facilities of operation such as snapshot is all based on identical physical storage device storage block, so just realized that other storage space of physical storage device level is shared, improved the utilization factor of memory device greatly; Simultaneously, because storage space shares, can shared buffer memory from the different virtual memory device to the read request of these communal space contents, so just improved the hit rate of buffer memory, thus the raising access efficiency.
Claims (9)
1. virtual shared formula memory device comprises:
Virtual memory facilities, for the outside provides access interface, wherein, described virtual memory facilities externally provides access interface independently of one another;
Storage device block mapping list has been described the piece mapping relations between virtual memory facilities and the physical storage device;
Physical storage device, storage resources is used to store data;
Physical storage device block operating position table, describe physical storage device block whether idle, by how many virtual memory facilitieses use, by information such as which virtual memory facilities uses.
2. by the described virtual shared formula memory device of claim 1, it is characterized in that described virtual memory facilities is at least one.
3. by the described virtual shared formula memory device of claim 1, it is characterized in that including in the described storage device block mapping list the corresponding access rights of virtual memory facilities.
4. method that realizes virtual shared formula memory device comprises following various operation:
Create virtual memory facilities, set up the respective resources mapping table, revise physical store resource operating position table for new virtual memory facilities;
Delete virtual memory facilities, close the external access interface of this virtual memory facilities, delete pairing resource mapping table, reclaim employed physical resource;
The read-write virtual memory facilities at the exterior read-write request, will be translated the read-write requests of corresponding physical equipment to the read-write requests of virtual memory facilities by corresponding resource mapping table, and finish data write;
The snapshot virtual memory facilities when certain virtual memory facilities is created snapshot, only needs to create a virtual memory facilities, and its corresponding equipment piece mapping table duplicates from source device corresponding equipment piece mapping table, and revises physical storage device block operating position table;
Duplicate virtual memory facilities, create a virtual memory facilities,, copy data copy source equipment the equipment of new establishment to, and revise physical store block device operating position table from physical storage device application physical block.
5. by the described method of claim 4, it is characterized in that also comprising the method for expansion virtual memory facilities capacity, described method comprises:
Some new virtual store resources and physical resource mapping relations list item will be added in the storage device block mapping list.
6. by the described method of claim 4, it is characterized in that also comprising the method for dwindling the virtual memory facilities capacity, described method comprises:
Satisfying the untapped list item deletion that will reduce capacity in the storage device block mapping list.
7. by the described method of claim 4, it is characterized in that described snapshot virtual memory facilities comprises step:
Create a virtual memory facilities, this storage device block mapping list is duplicated from source device corresponding equipment piece mapping table and is obtained;
The usage count of the physical storage device block of distributing to this virtual memory facilities is added one of register virtual memory facilities person of being to use in the lump;
Read-write requests to source device is all moved to newly-built virtual memory facilities.
8. by the described method of claim 4, it is characterized in that described duplicating comprises method:
From physical storage device application physical block, write operation is moved on to physical block.
9. by the described method of claim 8, it is characterized in that describedly write operation is moved on to physical block using the copy-on-write method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB031074294A CN1258715C (en) | 2003-03-20 | 2003-03-20 | Virtual shared storage device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB031074294A CN1258715C (en) | 2003-03-20 | 2003-03-20 | Virtual shared storage device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1532707A CN1532707A (en) | 2004-09-29 |
| CN1258715C true CN1258715C (en) | 2006-06-07 |
Family
ID=34282964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB031074294A Expired - Fee Related CN1258715C (en) | 2003-03-20 | 2003-03-20 | Virtual shared storage device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1258715C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103823641A (en) * | 2014-03-13 | 2014-05-28 | 深圳市迪菲特科技股份有限公司 | Online expanded virtual volume system and realizing method thereof |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7386687B2 (en) * | 2005-01-07 | 2008-06-10 | Sony Computer Entertainment Inc. | Methods and apparatus for managing a shared memory in a multi-processor system |
| CN100426259C (en) * | 2005-08-18 | 2008-10-15 | 北京中星微电子有限公司 | Virtual access method of storage document data |
| CN100530069C (en) * | 2006-10-13 | 2009-08-19 | 中国科学院计算技术研究所 | Virtualizing system and method for non-homogeny storage device |
| CN101777018B (en) * | 2010-02-08 | 2012-04-25 | 北京同有飞骥科技股份有限公司 | Copying and snapshot combined Windows system protection method |
| CN102419693B (en) * | 2010-09-28 | 2016-03-30 | 联想(北京)有限公司 | A kind of method of disk space of managed storage unit and electronic equipment |
| CN103984609B (en) * | 2014-05-28 | 2017-06-16 | 华为技术有限公司 | A kind of method and apparatus that checkpoint is reclaimed in file system based on copy-on-write |
| WO2016090577A1 (en) * | 2014-12-10 | 2016-06-16 | 华为技术有限公司 | Computer and device accessing method |
| CN108153489B (en) * | 2017-12-19 | 2021-03-09 | 联芸科技（杭州）有限公司 | Virtual data cache management system and method of NAND flash memory controller |
| CN110309100B (en) * | 2018-03-22 | 2023-05-23 | 腾讯科技（深圳）有限公司 | Snapshot object generation method and device |
| CN109521966A (en) * | 2018-11-15 | 2019-03-26 | 郑州云海信息技术有限公司 | Store device virtualization method, apparatus, terminal and computer readable storage medium |
| CN111291426A (en) * | 2020-01-21 | 2020-06-16 | 李岗 | Data interaction method and system of virtual storage and physical storage |
| CN113810467A (en) * | 2021-08-13 | 2021-12-17 | 控福（上海）智能科技有限公司 | Internet of things transmission communication method based on real-time shared storage and micro device |
-
2003
- 2003-03-20 CN CNB031074294A patent/CN1258715C/en not_active Expired - Fee Related
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103823641A (en) * | 2014-03-13 | 2014-05-28 | 深圳市迪菲特科技股份有限公司 | Online expanded virtual volume system and realizing method thereof |
| CN103823641B (en) * | 2014-03-13 | 2017-01-04 | 深圳市迪菲特科技股份有限公司 | The virtual volume system of a kind of on-line rapid estimation and its implementation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1532707A (en) | 2004-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9930118B2 (en) | Systems and methods for granular resource management in a storage network | |
| CN1258715C (en) | Virtual shared storage device and method | |
| CN102460400B (en) | Hypervisor-based management of local and remote virtual memory pages | |
| US8799601B1 (en) | Techniques for managing deduplication based on recently written extents | |
| US6148377A (en) | Shared memory computer networks | |
| US8996783B2 (en) | Managing nodes in a storage system | |
| US6915403B2 (en) | Apparatus and method for logical volume reallocation | |
| US20230280944A1 (en) | Tiering Data Strategy for a Distributed Storage System | |
| US20090228635A1 (en) | Memory Compression Implementation Using Non-Volatile Memory in a Multi-Node Server System With Directly Attached Processor Memory | |
| US7966455B2 (en) | Memory compression implementation in a multi-node server system with directly attached processor memory | |
| US20130232215A1 (en) | Virtualized data storage system architecture using prefetching agent | |
| TW201729101A (en) | Apparatus, method, and multimode storage device for performing selective underlying exposure mapping on user data | |
| JP2005222539A (en) | Storage system with capability to allocate virtual storage segment among multiple controllers | |
| CN109344090A (en) | The virtual hard disk system of KVM virtual machine and data center in data center | |
| DE102012218269A1 (en) | Interface for managing data movement in a thin provisioning storage system | |
| CN107203411A (en) | A kind of virutal machine memory extended method and system based on long-range SSD | |
| CN111324305B (en) | Data writing/reading method in distributed storage system | |
| US20230359374A1 (en) | Method and System for Dynamic Storage Scaling | |
| US20220027309A1 (en) | Data migration in a distributive file system | |
| CN103595799A (en) | Method for achieving distributed shared data bank | |
| Riedel et al. | Data mining on an OLTP system (nearly) for free | |
| US8131966B2 (en) | System and method for storage structure reorganization | |
| US10684799B2 (en) | Flash registry with write leveling | |
| US7424574B1 (en) | Method and apparatus for dynamic striping | |
| CN107948229A (en) | The method, apparatus and system of distributed storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: TIANJIN ZHONGKE BLUE WHALE INFORMATION TECHNOLOGY Free format text: FORMER OWNER: INST. OF COMPUTING TECHN. ACADEMIA SINICA Effective date: 20091204 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20091204 Address after: Tianjin New Technology Industrial Park Huayuan Industrial Park Haitai development 6 Road 6 green industrial base F 5 gate 201. Patentee after: Tianjin Branch Blue Whale Information Technology Co., Ltd. Address before: No. 6 South Road, Zhongguancun Academy of Sciences, Beijing Patentee before: Institute of Computing Technology, Chinese Academy of Sciences |
|
| ASS | Succession or assignment of patent right |
Owner name: BEIJING ZHONGKE BLUEWHALE INFORMATION TECHNOLOGY C Effective date: 20140813 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20140813 Address after: 300384 Tianjin Huayuan Industrial Park New Technology Industrial Park Development Road No. 6 6 Haitai green industry base building F 5 door No. 201 Patentee after: Tianjin Branch Blue Whale Information Technology Co., Ltd. Patentee after: Beijing Zhongke blue whale Information Technology Co., Ltd. Address before: 300384 Tianjin Huayuan Industrial Park New Technology Industrial Park Development Road No. 6 6 Haitai green industry base building F 5 door No. 201 Patentee before: Tianjin Branch Blue Whale Information Technology Co., Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20060607 Termination date: 20180320 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |