CN102521063A - Shared storage method suitable for migration and fault tolerance of virtual machine - Google Patents

Shared storage method suitable for migration and fault tolerance of virtual machine Download PDF

Info

Publication number
CN102521063A
CN102521063A CN2011103905492A CN201110390549A CN102521063A CN 102521063 A CN102521063 A CN 102521063A CN 2011103905492 A CN2011103905492 A CN 2011103905492A CN 201110390549 A CN201110390549 A CN 201110390549A CN 102521063 A CN102521063 A CN 102521063A
Authority
CN
China
Prior art keywords
virtual machine
server
data
image file
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011103905492A
Other languages
Chinese (zh)
Other versions
CN102521063B (en
Inventor
莫展鹏
岳强
季统凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Electronic Industry Institute Co Ltd
Original Assignee
Guangdong Electronic Industry Institute Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Electronic Industry Institute Co Ltd filed Critical Guangdong Electronic Industry Institute Co Ltd
Priority to CN 201110390549 priority Critical patent/CN102521063B/en
Publication of CN102521063A publication Critical patent/CN102521063A/en
Application granted granted Critical
Publication of CN102521063B publication Critical patent/CN102521063B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention relates to the field of cloud calculation, in particular to a shared storage method suitable for migration and fault tolerance of a virtual machine. According to the invention, a data storage server and a metadata server are respectively loaded with a network driving module; the metadata server actively searches each data storage server on the network through a fixed multicast group method; and each data storage server actively adds into a network storage cluster after identifying the metadata server through key words information. By adopting the method, the failure and transmission problems of an integrated storage system can be effectively solved; and the method can be widely used for storage of migration and fault tolerance of the virtual machine.

Description

A kind of virtual machine (vm) migration and fault-tolerant shared storage means of being applicable to
Technical field
The present invention relates to the cloud computing field, especially a kind of virtual machine (vm) migration and fault-tolerant shared storage means of being applicable to.
Background technology
Cloud computing (Cloud Computing) is the new term that is born in 2007, does not still have the definition of generally acknowledging at present.Cloud computing is a kind of commercial computation model, and it on the resource pool that great amount of calculation mechanism becomes, makes the user can obtain computing power, storage space and information service as required calculation task branch.And cloud computing operating system is the holistic management operation system on cloud computing backstage, and it is meant that framework is in the underlying hardware of basic software management magnanimity such as underlying hardware resource such as server, storage, network and single-set operation system, middleware, database, the cloud platform total management system on the soft resources.
Distributed file system (Distributed File System) is meant that the physical store resource of file system management not necessarily directly is connected on the local node, but links to each other with node through computer network.The design of distributed file system is based on Client.A typical network possibly comprise the server of a plurality of confession multi-user accesses.In addition, reciprocity characteristic allows some systems to play the part of the dual role of client-server.For example, the user can " deliver " catalogue that allows other client access, in case visited, this catalogue concerning client computer as using local drive.
Cloud computing platform is when carrying out system migration and System Fault Tolerance, and there is Single Point of Faliure in the traditional centralized storage system, and the not high phenomenon of transmission performance.
Summary of the invention
The technical matters that the present invention solves is to provide a kind of virtual machine (vm) migration and fault-tolerant shared storage means of being applicable to, effectively solves the centralised storage system and has fault, transmission property problem.
The technical scheme that the present invention solves the problems of the technologies described above is:
Data storage server and meta data server be the load networks driver module respectively; By meta data server with each data storage server on the fixing multi-broadcast group mode active searching network; Each data storage server passes through keyword message; Behind the identification meta data server, initiatively add network storage cluster.
Data can be specified a plurality of backups according to configuration file on data storage server; Simultaneously can specify a plurality of meta data servers; The meta data server machine of delaying because of offered load is too high is provided, or fault-tolerant when situation such as reading and writing data mistake takes place on the data storage server.
Specifically comprise the steps:
In the 1st step, physical server is shared storage directory as host's carry of virtual machine, is used to deposit the image file of virtual machine;
The 2nd step, on physical server, to create virtual machine, and be kept at the image file of virtual machine under the shared storage directory of carry, the virtual machine image file form of support comprises Raw and VHD etc.;
The 3rd step; Share the client elder generation accesses meta-data server of storage on the physical server; Meta data server is according to the distributed store record on each data storage server of HASH algorithm statistics; Follow the principle of balanced load rate simultaneously and give virtual machine image file memory allocated space, in addition, virtual machine image file can be created the loss of data of a plurality of backups to prevent that Single Point of Faliure from causing according to configuration;
In the 4th step, physical server carries out IO with data server and communicates by letter according to the space path that distributes, and is kept at virtual machine image file under the specified path under the data server;
The 5th the step, virtual machine (vm) migration and fault-tolerant in, the original physical machine discharges the shared resource of virtual machine earlier;
In the 6th step, the machine-readable listed files of getting under the share directory of target physical finds virtual machine image file;
In the 7th step, the target physical machine is applied for the resource of virtual machine again and is taken over the image file of virtual machine.
Adopt method of the present invention, can improve virtual machine (vm) migration and fault-tolerant speed effectively, not traffic affecting operation, the availability of raising virtual machine image.
Description of drawings
Below in conjunction with accompanying drawing the present invention is further specified:
Fig. 1 is the inventive method synoptic diagram;
Fig. 2 is a customer instance synoptic diagram of the present invention.
Embodiment
As shown in Figure 1, data storage server of the present invention abbreviates DS as, and meta data server abbreviates MS as; DS, MS load this network-driven module respectively, and with each DS on the fixing multi-broadcast group mode active searching network, each DS passes through keyword message by MS; After the identification of MS, initiatively add network storage cluster.
The present invention for sharing the storage system deployment platform, through self-defining operation system kernel characteristic, and the applying virtual patch, makes the network-in-dialing of system's virtual support machine, I/O storage, distributed storage etc. with the Iinux2.6.38.2 kernel.
The present invention adopts linux network distribution type transmission algorithm; Based on the linux operating system characteristic of increasing income; Through the communication module between each node of the form encapsulation network storage that drives, to adapt to the driving of distributed storage, called after gcloud-dnet.ko; Replace original system drive Inet, with the virtual support application.
The present invention on the basis of revising Iinux2.6.38.2 kernel source code, make distributed memory system support beyond the traditional document system format (ext2, ext3, ext4, ntfs fat), also supports the VHD virtual disk form that Microsoft releases.
On the basis of revising Iinux2.6.38.2 kernel source code; Drive through revising original distributed storage I/O; Come the distributed store record of statistics on each DS,, improve client reading of data efficient through fast distributed HASH algorithm; Balancing network I/O load factor improves the overall performance of storage.
The data storage multiple spot ensures that data can be specified a plurality of backups according to configuration file on DS, can specify a plurality of MS simultaneously, and MS is provided the machine of delaying because of offered load is too high, or the fault-tolerant networks of DS when going up situation such as reading and writing data mistake and taking place.
The present invention includes following implementation step:
In the 1st step, physical server is shared storage directory as host's carry of virtual machine, is used to deposit the image file of virtual machine;
The 2nd step, on physical server, to create virtual machine, and be kept at the image file of virtual machine under the shared storage directory of carry, the virtual machine image file form of support comprises Raw and VHD etc.;
The 3rd step; Share the client elder generation accesses meta-data server of storage on the physical server; Meta data server is according to the distributed store record on each DS of HASH algorithm statistics; Follow the principle of balanced load rate simultaneously and give virtual machine image file memory allocated space, in addition, virtual machine image file can be created the loss of data of a plurality of backups to prevent that Single Point of Faliure from causing according to configuration;
In the 4th step, physical server carries out IO with data server and communicates by letter according to the space path that distributes, and is kept at virtual machine image file under the specified path under the database server;
The 5th the step, virtual machine (vm) migration and fault-tolerant in, the original physical machine discharges the shared resource of virtual machine earlier;
In the 6th step, the machine-readable listed files of getting under the share directory of target physical finds virtual machine image file;
In the 7th step, the target physical machine is applied for the resource of virtual machine again and is taken over the image file of virtual machine.
Particularly, the inventive method can have multiple realization, and a kind of implementation will be introduced in this part.Referring to Fig. 2, the present invention is applicable to that the concrete applying step of virtual machine (vm) migration and fault-tolerant shared storage means is following:
In the 1st step, we use the operating system of CentOS x86_64 as host, and the IP of two hosts is 192.168.1.6 and 192.168.1.7; The virtual kernel of operation Xen 4.0 on it; 192.168.1.6 the fully virtualized virtual machine name of last operation is called vm, id is 1, and virtual machine image file leave in/this share directory of vm under; Shared-file system is built with ceph, disposes as follows:
The 2nd step, suppose to have two DS, virtual machine image file has two copies, leaves in so respectively among the DS, and name is called vm.img Part1 and vm.img Part2.
The 3rd step, call the migration order of Libvirt and carry out virtual machine (vm) migration,
# is id that 1 virtual machine (vm) migration is on the host of 192.168.1.7 to the IP address
xm?migrate1?192.168.1.7
In the 4th step, virtual machine vm has operated on this physical machine of 192.168.1.7, and about 2 seconds of time spent, the pilot process network is less than 500 milliseconds trip time, can ignore to the influence of business, proves that the method is applicable to virtual machine (vm) migration and fault-tolerant.

Claims (3)

1. one kind is applicable to virtual machine (vm) migration and fault-tolerant shared storage means; It is characterized in that: data storage server and meta data server be the load networks driver module respectively; By meta data server with each data storage server on the fixing multi-broadcast group mode active searching network; Each data storage server behind the identification meta data server, initiatively adds network storage cluster through keyword message.
2. according to the shared storage means shown in the claim 1; It is characterized in that: data can be specified a plurality of backups according to configuration file on data storage server; Simultaneously can specify a plurality of meta data servers; The meta data server machine of delaying because of offered load is too high is provided, or fault-tolerant when situation such as reading and writing data mistake takes place on the data storage server.
3. shared storage means according to claim 1 and 2 is characterized in that: specifically comprise the steps:
In the 1st step, physical server is shared storage directory as host's carry of virtual machine, is used to deposit the image file of virtual machine;
The 2nd step, on physical server, to create virtual machine, and be kept at the image file of virtual machine under the shared storage directory of carry, the virtual machine image file form of support comprises Raw and VHD etc.;
The 3rd step; Share the client elder generation accesses meta-data server of storage on the physical server; Meta data server is according to the distributed store record on each data storage server of HASH algorithm statistics; Follow the principle of balanced load rate simultaneously and give virtual machine image file memory allocated space, in addition, virtual machine image file can be created the loss of data of a plurality of backups to prevent that Single Point of Faliure from causing according to configuration;
In the 4th step, physical server carries out IO with data server and communicates by letter according to the space path that distributes, and is kept at virtual machine image file under the specified path under the data server;
The 5th the step, virtual machine (vm) migration and fault-tolerant in, the original physical machine discharges the shared resource of virtual machine earlier;
In the 6th step, the machine-readable listed files of getting under the share directory of target physical finds virtual machine image file;
In the 7th step, the target physical machine is applied for the resource of virtual machine again and is taken over the image file of virtual machine.
CN 201110390549 2011-11-30 2011-11-30 Shared storage method suitable for migration and fault tolerance of virtual machine Active CN102521063B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110390549 CN102521063B (en) 2011-11-30 2011-11-30 Shared storage method suitable for migration and fault tolerance of virtual machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110390549 CN102521063B (en) 2011-11-30 2011-11-30 Shared storage method suitable for migration and fault tolerance of virtual machine

Publications (2)

Publication Number Publication Date
CN102521063A true CN102521063A (en) 2012-06-27
CN102521063B CN102521063B (en) 2013-12-25

Family

ID=46291998

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110390549 Active CN102521063B (en) 2011-11-30 2011-11-30 Shared storage method suitable for migration and fault tolerance of virtual machine

Country Status (1)

Country Link
CN (1) CN102521063B (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882864A (en) * 2012-09-21 2013-01-16 南京斯坦德通信股份有限公司 Virtualization system based on InfiniBand cloud computing network
CN102905059A (en) * 2012-09-27 2013-01-30 曙光信息产业(北京)有限公司 Continuous radio and television broadcast system
CN103458055A (en) * 2013-09-22 2013-12-18 广州中国科学院软件应用技术研究所 Clout competing platform
CN103731292A (en) * 2012-10-16 2014-04-16 无锡云捷科技有限公司 Fault-tolerant method enabling server to realize fault seamless recovery
CN103902401A (en) * 2014-03-14 2014-07-02 汉柏科技有限公司 Virtual machine fault tolerance method and device based on monitoring
WO2014101896A1 (en) * 2012-12-31 2014-07-03 华为技术有限公司 Method and system for sharing storage resources
CN105893108A (en) * 2015-01-16 2016-08-24 纬创资通股份有限公司 Methods For Session Failover In Os (Operating System) Level And Systems Using The Same
CN106293994A (en) * 2015-05-15 2017-01-04 株式会社日立制作所 Virtual machine cloning process in NFS and NFS
CN106446159A (en) * 2016-09-23 2017-02-22 华为技术有限公司 Method for storing files, first virtual machine and name node
CN106663042A (en) * 2014-09-12 2017-05-10 微软技术许可有限责任公司 Scalable data storage pools
CN106790713A (en) * 2017-03-08 2017-05-31 中国人民解放军国防科学技术大学 Across data center virtual machine migration method under cloud computing environment
CN107004032A (en) * 2016-11-17 2017-08-01 华为技术有限公司 Image file conversion method and device
CN107018193A (en) * 2017-04-01 2017-08-04 济南浪潮高新科技投资发展有限公司 A kind of VTPM migratory systems and method based on shared storage
CN107967165A (en) * 2016-10-20 2018-04-27 上海盛霄云计算技术有限公司 The offline moving method of virtual machine based on LVM
CN108206750A (en) * 2016-12-16 2018-06-26 北京国双科技有限公司 The configuration method and device of virtual machine network interface card
CN108234551A (en) * 2016-12-15 2018-06-29 腾讯科技(深圳)有限公司 A kind of data processing method and device
CN109213566A (en) * 2017-06-29 2019-01-15 华为技术有限公司 A kind of method, apparatus and equipment of virtual machine (vm) migration
CN109525432A (en) * 2018-12-10 2019-03-26 浙江大华技术股份有限公司 A kind of indoor power method for inspecting, apparatus and system
TWI669605B (en) * 2018-06-29 2019-08-21 財團法人工業技術研究院 Fault tolerance method and system for virtual machine group
US10909002B2 (en) 2018-06-29 2021-02-02 Industrial Technology Research Institute Fault tolerance method and system for virtual machine group

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101667187A (en) * 2009-09-23 2010-03-10 南京邮电大学 Compound intellectual cloud method based on P2P computing technology
CN101937693A (en) * 2010-08-17 2011-01-05 深圳市子栋科技有限公司 Video and audio playing method and system based on voice command
CN101951553A (en) * 2010-08-17 2011-01-19 深圳市子栋科技有限公司 Navigation method and system based on speech command
CN101969475A (en) * 2010-11-15 2011-02-09 张军 Business data controllable distribution and fusion application system based on cloud computing

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101667187A (en) * 2009-09-23 2010-03-10 南京邮电大学 Compound intellectual cloud method based on P2P computing technology
CN101937693A (en) * 2010-08-17 2011-01-05 深圳市子栋科技有限公司 Video and audio playing method and system based on voice command
CN101951553A (en) * 2010-08-17 2011-01-19 深圳市子栋科技有限公司 Navigation method and system based on speech command
CN101969475A (en) * 2010-11-15 2011-02-09 张军 Business data controllable distribution and fusion application system based on cloud computing

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102882864B (en) * 2012-09-21 2015-10-28 南京斯坦德云科技股份有限公司 A kind of virtualization system based on InfiniBand system for cloud computing
CN102882864A (en) * 2012-09-21 2013-01-16 南京斯坦德通信股份有限公司 Virtualization system based on InfiniBand cloud computing network
CN102905059A (en) * 2012-09-27 2013-01-30 曙光信息产业(北京)有限公司 Continuous radio and television broadcast system
CN103731292A (en) * 2012-10-16 2014-04-16 无锡云捷科技有限公司 Fault-tolerant method enabling server to realize fault seamless recovery
US10082972B2 (en) 2012-12-31 2018-09-25 Huawei Technologies Co., Ltd. Method and system for pooling, partitioning, and sharing network storage resources
WO2014101896A1 (en) * 2012-12-31 2014-07-03 华为技术有限公司 Method and system for sharing storage resources
US9733848B2 (en) 2012-12-31 2017-08-15 Huawei Technologies Co., Ltd. Method and system for pooling, partitioning, and sharing network storage resources
US10481804B2 (en) 2012-12-31 2019-11-19 Huawei Technologies Co., Ltd. Cluster system with calculation and storage converged
US11042311B2 (en) 2012-12-31 2021-06-22 Huawei Technologies Co., Ltd. Cluster system with calculation and storage converged
CN103458055A (en) * 2013-09-22 2013-12-18 广州中国科学院软件应用技术研究所 Clout competing platform
CN103902401A (en) * 2014-03-14 2014-07-02 汉柏科技有限公司 Virtual machine fault tolerance method and device based on monitoring
CN103902401B (en) * 2014-03-14 2018-01-12 汉柏科技有限公司 Virtual machine fault-tolerance approach and device based on monitoring
CN106663042B (en) * 2014-09-12 2019-11-22 微软技术许可有限责任公司 Expansible data storage pool
CN106663042A (en) * 2014-09-12 2017-05-10 微软技术许可有限责任公司 Scalable data storage pools
US10409696B2 (en) 2014-09-12 2019-09-10 Microsoft Technology Licensing, Llc Scalable data storage pools
CN105893108A (en) * 2015-01-16 2016-08-24 纬创资通股份有限公司 Methods For Session Failover In Os (Operating System) Level And Systems Using The Same
CN106293994A (en) * 2015-05-15 2017-01-04 株式会社日立制作所 Virtual machine cloning process in NFS and NFS
CN106446159A (en) * 2016-09-23 2017-02-22 华为技术有限公司 Method for storing files, first virtual machine and name node
CN106446159B (en) * 2016-09-23 2019-11-12 华为技术有限公司 A kind of method of storage file, the first virtual machine and name node
CN107967165A (en) * 2016-10-20 2018-04-27 上海盛霄云计算技术有限公司 The offline moving method of virtual machine based on LVM
CN107967165B (en) * 2016-10-20 2021-09-24 上海盛霄云计算技术有限公司 Virtual machine offline migration method based on LVM
US11243792B2 (en) 2016-11-17 2022-02-08 Huawei Technologies Co., Ltd. Image file conversion method and apparatus
CN107004032A (en) * 2016-11-17 2017-08-01 华为技术有限公司 Image file conversion method and device
CN108234551A (en) * 2016-12-15 2018-06-29 腾讯科技(深圳)有限公司 A kind of data processing method and device
CN108206750A (en) * 2016-12-16 2018-06-26 北京国双科技有限公司 The configuration method and device of virtual machine network interface card
CN106790713A (en) * 2017-03-08 2017-05-31 中国人民解放军国防科学技术大学 Across data center virtual machine migration method under cloud computing environment
CN106790713B (en) * 2017-03-08 2019-09-20 中国人民解放军国防科学技术大学 Across data center virtual machine migration method under cloud computing environment
CN107018193A (en) * 2017-04-01 2017-08-04 济南浪潮高新科技投资发展有限公司 A kind of VTPM migratory systems and method based on shared storage
CN109213566A (en) * 2017-06-29 2019-01-15 华为技术有限公司 A kind of method, apparatus and equipment of virtual machine (vm) migration
CN109213566B (en) * 2017-06-29 2022-05-13 华为技术有限公司 Virtual machine migration method, device and equipment
US10909002B2 (en) 2018-06-29 2021-02-02 Industrial Technology Research Institute Fault tolerance method and system for virtual machine group
TWI669605B (en) * 2018-06-29 2019-08-21 財團法人工業技術研究院 Fault tolerance method and system for virtual machine group
CN109525432A (en) * 2018-12-10 2019-03-26 浙江大华技术股份有限公司 A kind of indoor power method for inspecting, apparatus and system

Also Published As

Publication number Publication date
CN102521063B (en) 2013-12-25

Similar Documents

Publication Publication Date Title
CN102521063B (en) Shared storage method suitable for migration and fault tolerance of virtual machine
US10489422B2 (en) Reducing data volume durability state for block-based storage
US9983825B2 (en) Efficient data volume replication for block-based storage
US8972986B2 (en) Locality-aware resource allocation for cloud computing
EP3356937B1 (en) Distributed stream-based database triggers
CN105144121B (en) Cache content addressable data block is for Storage Virtualization
US8370833B2 (en) Method and system for implementing a virtual storage pool in a virtual environment
US9229749B2 (en) Compute and storage provisioning in a cloud environment
US9336132B1 (en) Method and system for implementing a distributed operations log
US9733989B1 (en) Non-disruptive load-balancing of virtual machines between data centers
Yang et al. AutoReplica: automatic data replica manager in distributed caching and data processing systems
CA2813560A1 (en) Automatic replication of virtual machines
US10505862B1 (en) Optimizing for infrastructure diversity constraints in resource placement
US10157214B1 (en) Process for data migration between document stores
CN103581332A (en) HDFS framework and pressure decomposition method for NameNodes in HDFS framework
CN101727496A (en) Method for realizing load balancing cluster of MICROSOFT SQL SERVER database
CN105468296A (en) No-sharing storage management method based on virtualization platform
CN103885811A (en) Device, system and method for system-wide online migration of virtual machine system
US11321283B2 (en) Table and index communications channels
US10102228B1 (en) Table and index communications channels
CN103077055B (en) PNFS system supports the method for the online startup optimization of magnanimity virtual machine
Putra et al. Live migration based on cloud computing to increase load balancing
US11121981B1 (en) Optimistically granting permission to host computing resources
US10817388B1 (en) Recovery of tree data in a geographically distributed environment
US11256669B1 (en) Transaction pipeline materialization schemas

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant