CN105635276A - Method for cloud platform distributed physical volume object migration to non-distributed storage - Google Patents
Method for cloud platform distributed physical volume object migration to non-distributed storage Download PDFInfo
- Publication number
- CN105635276A CN105635276A CN201511017592.9A CN201511017592A CN105635276A CN 105635276 A CN105635276 A CN 105635276A CN 201511017592 A CN201511017592 A CN 201511017592A CN 105635276 A CN105635276 A CN 105635276A
- Authority
- CN
- China
- Prior art keywords
- physical volume
- distributed
- volume
- storage
- memory system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/563—Data redirection of data network streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The invention relates to the technical field of cloud platform storage virtualization, and particularly relates to a method for cloud platform distributed physical volume object migration to non-distributed storage. According to the method, distributed physical volume object information is acquired firstly; distributed storage system information is acquired; whether the number of storage objects of a distributed storage system is greater than 2 is judged, and the migration process is continuously performed if the judgment result is yes, or migration fails; whether available space of the distributed storage system is greater than physical volume total space is judged, and the migration process is continuously performed if the judgment result is yes, or migration fails; the distributed storage system eliminates physical volume objects; physical volumes are created through local volume management; a volume group is expanded; and finally the physical volumes provide a non-distributed storage service. The problems that the planned storage scheme is not adaptive to the use habits of users of a cloud computing platform, operation of physical volume migration is performed through a manual mode and the migration method is not universal can be solved so that the method can be applied to the field of management of replanning of various storage virtualization types.
Description
Technical field
The present invention relates to cloud platform storage virtualization technology field, particularly a kind of cloud platform distributed physical volume object migration is to the method for non-distributed storage.
Background technology
The general cloud computing platform newly built, the more difficult planning of storage space, and the local Cloud Server storing, concentrating storage and distributed storage, respectively have self advantage and shortcoming. Such as the Cloud Server cost performance height of local storage, disk read-write do not rely on network, but reliability is lower, disk read-write performance is lower; And the Cloud Server of distributed storage has high reliability and high-performance, but rely on network and can greatly increase network switch pressure, and have a lot of client not want to be ready the optical fiber exchange board that purchase price is high; Along with cloud platform develops for a long time, bring following problem:
One is user's use habit that the local storage originally planned, concentrated storage and distributed storage have been not suitable with cloud computing platform. The environment of part client is had a large amount of idle distributed storage spaces to occur and the local not enough phenomenon of storage space.
Two is that physical volume migration can only be operated by the mode of craft.
Three is that moving method is general not. Distributed memory system can only move local storage or concentrated storage, can not support both type simultaneously.
In order to solve the above problems, it is necessary to having and a kind of be applicable to the method for cloud platform distributed physical volume object migration to non-distributed storage, user can pass through cloud platform Autonomic Migration Framework physical volume. The distributed physical volume of cloud platform moves to non-distributed storage, as long as distributed memory system has enough available spaces, just can realize physical volume migration.
Summary of the invention
The technical problem that the present invention solves is to provide and a kind of is applicable to the method for cloud platform distributed physical volume object migration to non-distributed storage, solves and has originally planned that storage scheme is not suitable with user's use habit of cloud computing platform, physical volume moves problems such as can only being operated by the mode of craft, moving method is general not.
The technical scheme that the present invention solves the problems of the technologies described above is:
Described method comprises the steps:
Step 1: obtain distributed physical volume object information;
Step 2: obtain distributed memory system information;
Step 3: judge whether that distributed memory system has storage object number and is greater than 2, if performing next step; Otherwise perform step 9;
Step 4: whether distributed memory system available space is greater than the total space of physical volume, if performing next step, otherwise performs step 9;
Step 5: distributed memory system rejects physical volume object;
Step 6: local volume management creates physical volume;
Step 7: expansion volume group;
Step 8: physical volume provides non-distributed stores service, performs step 10;
Step 9: move unsuccessfully;
Step 10: complete flow process.
The distributed physical volume object information of described acquisition, comprises the information such as distributed physical volume object information title, total storage space;
Described physical volume is to the storage object liking distributed storage;
Described physical volume object mainly contains two kinds: this local disk and concentrated storage logical units number;
Described concentrated storage logical units number is the storage unit of the high speed storing network of a centralized management.
Described acquisition distributed memory system information, comprises the information such as the title of distributed memory system, physical volume object number, available storage space and total storage space.
Described distributed memory system rejects physical volume object, is deletion of physically volume object, is not re-used as storage object; Before migration, distributed memory system available space is greater than the total space of physical volume; After rejecting, distributed memory system still has available space, ensures that distributed storage virtual machine can normally use.
Described local volume management creates physical volume, and local volume management is by pvcreate order deletion of physically volume, and order form is: pvcreate physical volume path;
Described local volume management is a kind of mechanism disk partition managed under Linux environment.
Described expansion volume group, volume group increases physical volume, thus expands total storage space; Order form is: vgextend volumegroup name claims physical volume path.
The present invention is by being applicable to the method for cloud platform distributed physical volume object migration to non-distributed storage, and physical volume migrates across automatic mode, reduces artificial misoperation probability, it is to increase cloud platform fortune dimension convenience. The present invention is a kind of software engineering, is not migration physically, the physical volume moving method that region is general; The present invention is applicable to distributed memory system and moves to local storage or concentrated storage, is different from general method general not; The present invention the most at last physical volume move on non-distributed memory system use, be different from general internal migration method.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the present invention is further described:
Fig. 1 is schema;
Fig. 2 is the logical organization figure of the present invention.
Embodiment
Embodiments of the present invention have multiple, for total cloud platform, wherein a kind of implementation method are described here, and as shown in Figure 1, 2, specific implementation process is as follows
1, obtaining distributed physical volume object information, code is as follows:
2, obtaining distributed memory system information, code is as follows:
3, whether distributed memory system has storage object number is greater than 2, and code is as follows:
4, whether distributed memory system available space is greater than the total space of physical volume, and code is as follows:
5, distributed memory system rejects physical volume object, and code is as follows:
6, local volume management creates physical volume, and code is as follows:
7, expanding volume group, code is as follows:
8, physical volume provides non-distributed stores service;
Flow process terminates.
Claims (7)
1. a cloud platform distributed physical volume object migration is to the method for non-distributed storage, it is characterised in that: described method comprises the steps:
Step 1: obtain distributed physical volume object information;
Step 2: obtain distributed memory system information;
Step 3: judge whether that distributed memory system has storage object number and is greater than 2, if performing next step; Otherwise perform step 9;
Step 4: whether distributed memory system available space is greater than the total space of physical volume, if performing next step, otherwise performs step 9;
Step 5: distributed memory system rejects physical volume object;
Step 6: local volume management creates physical volume;
Step 7: expansion volume group;
Step 8: physical volume provides non-distributed stores service, performs step 10;
Step 9: move unsuccessfully;
Step 10: complete flow process.
2. method according to claim 1, it is characterised in that: the distributed physical volume object information of described acquisition, comprises the information such as distributed physical volume object information title, total storage space;
Described physical volume is to the storage object liking distributed storage;
Described physical volume object mainly contains two kinds: this local disk and concentrated storage logical units number;
Described concentrated storage logical units number is the storage unit of the high speed storing network of a centralized management.
Described acquisition distributed memory system information, comprises the information such as the title of distributed memory system, physical volume object number, available storage space and total storage space.
3. method according to claim 1, it is characterised in that: described distributed memory system rejects physical volume object, is deletion of physically volume object, is not re-used as storage object; Before migration, distributed memory system available space is greater than the total space of physical volume; After rejecting, distributed memory system still has available space, ensures that distributed storage virtual machine can normally use.
4. method according to claim 2, it is characterised in that: described distributed memory system rejects physical volume object, is deletion of physically volume object, is not re-used as storage object; Before migration, distributed memory system available space is greater than the total space of physical volume; After rejecting, distributed memory system still has available space, ensures that distributed storage virtual machine can normally use.
5. method according to the arbitrary item of Claims 1-4, it is characterised in that: described local volume management creates physical volume, local volume management by pvcreate order deletion of physically volume, order form master: pvcreate physical volume path;
Described local volume management is a kind of mechanism disk partition managed under Linux environment.
6. method according to the arbitrary item of Claims 1-4, it is characterised in that: described expansion volume group, volume group increases physical volume, thus expands total storage space; Order form is: vgextend volumegroup name claims physical volume path.
7. method according to claim 5, it is characterised in that: described expansion volume group, volume group increases physical volume, thus expands total storage space; Order form is: vgextend volumegroup name claims physical volume path.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511017592.9A CN105635276B (en) | 2015-12-28 | 2015-12-28 | The method that cloud platform distributed physical volume object moves to non-distributed storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511017592.9A CN105635276B (en) | 2015-12-28 | 2015-12-28 | The method that cloud platform distributed physical volume object moves to non-distributed storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105635276A true CN105635276A (en) | 2016-06-01 |
| CN105635276B CN105635276B (en) | 2019-05-21 |
Family
ID=56049748
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511017592.9A Active CN105635276B (en) | 2015-12-28 | 2015-12-28 | The method that cloud platform distributed physical volume object moves to non-distributed storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105635276B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112087493A (en) * | 2017-09-05 | 2020-12-15 | 华为技术有限公司 | Request processing method, system on chip and public cloud management component |
| CN112463879A (en) * | 2020-10-29 | 2021-03-09 | 苏州浪潮智能科技有限公司 | Data volume synchronization method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103475732A (en) * | 2013-09-25 | 2013-12-25 | 浪潮电子信息产业股份有限公司 | Distributed file system data volume deployment method based on virtual address pool |
| US20140007099A1 (en) * | 2011-08-19 | 2014-01-02 | Hitachi, Ltd. | Method and apparatus to improve efficiency in the use of resources in data center |
| CN103562879A (en) * | 2011-05-26 | 2014-02-05 | 国际商业机器公司 | Transparent file system migration to a new physical location |
| CN104270409A (en) * | 2014-09-04 | 2015-01-07 | 国云科技股份有限公司 | Method for efficiently utilizing centralized storage in cloud platform |
| CN104484279A (en) * | 2014-12-05 | 2015-04-01 | 国云科技股份有限公司 | Centralized storage over-allotment using method suitable for cloud computing |
| US20150277803A1 (en) * | 2012-10-18 | 2015-10-01 | Hitachi, Ltd. | Method and apparatus of storage volume migration in cooperation with takeover of storage area network configuration |
-
2015
- 2015-12-28 CN CN201511017592.9A patent/CN105635276B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103562879A (en) * | 2011-05-26 | 2014-02-05 | 国际商业机器公司 | Transparent file system migration to a new physical location |
| US20140007099A1 (en) * | 2011-08-19 | 2014-01-02 | Hitachi, Ltd. | Method and apparatus to improve efficiency in the use of resources in data center |
| US20150277803A1 (en) * | 2012-10-18 | 2015-10-01 | Hitachi, Ltd. | Method and apparatus of storage volume migration in cooperation with takeover of storage area network configuration |
| CN103475732A (en) * | 2013-09-25 | 2013-12-25 | 浪潮电子信息产业股份有限公司 | Distributed file system data volume deployment method based on virtual address pool |
| CN104270409A (en) * | 2014-09-04 | 2015-01-07 | 国云科技股份有限公司 | Method for efficiently utilizing centralized storage in cloud platform |
| CN104484279A (en) * | 2014-12-05 | 2015-04-01 | 国云科技股份有限公司 | Centralized storage over-allotment using method suitable for cloud computing |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112087493A (en) * | 2017-09-05 | 2020-12-15 | 华为技术有限公司 | Request processing method, system on chip and public cloud management component |
| CN112087493B (en) * | 2017-09-05 | 2022-02-22 | 华为技术有限公司 | Request processing method, system on chip and public cloud management component |
| US11775316B2 (en) | 2017-09-05 | 2023-10-03 | Huawei Technologies Co., Ltd. | Request processing method, system on chip, and public cloud management component |
| US11847470B2 (en) | 2017-09-05 | 2023-12-19 | Huawei Technologies Co., Ltd. | Request processing method, system on chip, and public cloud management component |
| CN112463879A (en) * | 2020-10-29 | 2021-03-09 | 苏州浪潮智能科技有限公司 | Data volume synchronization method and device |
| CN112463879B (en) * | 2020-10-29 | 2023-01-06 | 苏州浪潮智能科技有限公司 | Data volume synchronization method and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105635276B (en) | 2019-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Mayer et al. | Fogstore: Toward a distributed data store for fog computing | |
| CN103116596B (en) | System and method of performing snapshot isolation in distributed databases | |
| US9424274B2 (en) | Management of intermediate data spills during the shuffle phase of a map-reduce job | |
| CN102708165B (en) | Document handling method in distributed file system and device | |
| CN101019105B (en) | Method and apparatus for data storage using striping | |
| US9372880B2 (en) | Reclamation of empty pages in database tables | |
| US10157214B1 (en) | Process for data migration between document stores | |
| US9501506B1 (en) | Indexing system | |
| CN106843745A (en) | Capacity expansion method and device | |
| CN103502926A (en) | Extent-based storage architecture | |
| CN104462240A (en) | Method and system for realizing hierarchical storage and management in cloud storage | |
| JP2011516994A (en) | Data placement according to instructions to redundant data storage system | |
| CN102136003A (en) | Large-scale distributed storage system | |
| CN109901786B (en) | Data migration method, system, device and computer readable storage medium | |
| CN103455526A (en) | ETL (extract-transform-load) data processing method, device and system | |
| CN106534308B (en) | Method and device for solving data block access hot spot in distributed storage system | |
| US10031682B1 (en) | Methods for improved data store migrations and devices thereof | |
| US11271800B1 (en) | Leaderless, parallel, and topology-aware protocol for achieving consensus with recovery from failure of all nodes in a group | |
| US10489356B1 (en) | Truncate and append database operation | |
| CN107357522B (en) | Data processing method and device | |
| CN105635311A (en) | Method for synchronizing resource pool information in cloud management platform | |
| CN103631924A (en) | Application method and system for distributive database platform | |
| US20240061712A1 (en) | Method, apparatus, and system for creating training task on ai training platform, and medium | |
| CN106354548A (en) | Virtual cluster creating and management method and device in distributed database system | |
| US20190179807A1 (en) | Table and index communications channels |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 523808 19th Floor, Cloud Computing Center, Chinese Academy of Sciences, No. 1 Kehui Road, Songshan Lake Hi-tech Industrial Development Zone, Dongguan City, Guangdong Province Applicant after: G-Cloud Technology Co., Ltd. Address before: 523808 No. 14 Building, Songke Garden, Songshan Lake Science and Technology Industrial Park, Dongguan City, Guangdong Province Applicant before: G-Cloud Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |