CN115426373A - Method and deployment system for deploying distributed storage system in private cloud - Google Patents
Method and deployment system for deploying distributed storage system in private cloud Download PDFInfo
- Publication number
- CN115426373A CN115426373A CN202211012968.7A CN202211012968A CN115426373A CN 115426373 A CN115426373 A CN 115426373A CN 202211012968 A CN202211012968 A CN 202211012968A CN 115426373 A CN115426373 A CN 115426373A
- Authority
- CN
- China
- Prior art keywords
- toolkit
- ceph
- storage system
- distributed storage
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000009434 installation Methods 0.000 claims description 71
- 241000380131 Ammophila arenaria Species 0.000 claims description 30
- 230000008676 import Effects 0.000 claims description 13
- 238000007726 management method Methods 0.000 claims description 12
- 238000012544 monitoring process Methods 0.000 claims description 6
- 238000012423 maintenance Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000011084 recovery Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Stored Programmes (AREA)
Abstract
Description
技术领域technical field
本发明涉及云计算技术领域，具体地说是私有云中部署分布式存储系统的方法及部署系统。The invention relates to the technical field of cloud computing, in particular to a method and a deployment system for deploying a distributed storage system in a private cloud.
背景技术Background technique
随着容器技术这些年的高速发展，越来越多的厂家将自己的应用和服务容器化部署到Kubernetes中，现在Kubernetes已经成为业界使用最广泛的容器运维平台。而Ceph分布式存储系统近些年也发展迅速，具有部署和运维简单，存储性能优异并且有健全的数据容灾和备份恢复机制，是近几年最热门的分布式存储系统之一，所以存储选择Ceph-16.2.7版本分布式存储。With the rapid development of container technology in recent years, more and more manufacturers have deployed their applications and services containerized on Kubernetes. Now Kubernetes has become the most widely used container operation and maintenance platform in the industry. The Ceph distributed storage system has also developed rapidly in recent years. It has simple deployment and operation and maintenance, excellent storage performance, and a sound data disaster recovery and backup recovery mechanism. It is one of the most popular distributed storage systems in recent years. Therefore, Storage select Ceph-16.2.7 version distributed storage.
传统中的私有云中部署Kubernetes后，会另外再规划服务器专门部署一套后端存储，Kubernetes通过网络来连接这个存储后使用，这样的部署方式要同时部署和运维Kubernetes和存储两套系统，增加了部署和运维的难度，性能还会受到网络的影响，另外因为私有云Kubernetes主要使用内存和CPU这类计算资源，对硬盘这类存储资源使用较少，部署Kubernetes的服务器会有一些硬盘处于空闲状态，造成资源的浪费。After Kubernetes is deployed in the traditional private cloud, another set of back-end storage will be specially planned for the server. Kubernetes will connect to this storage through the network and use it. This deployment method requires the deployment and maintenance of two systems, Kubernetes and storage, at the same time. It increases the difficulty of deployment and operation and maintenance, and the performance will also be affected by the network. In addition, because the private cloud Kubernetes mainly uses computing resources such as memory and CPU, and uses less storage resources such as hard disks, the server where Kubernetes is deployed will have some hard disks. It is in an idle state, resulting in a waste of resources.
在私有云环境中部署Kubernetes集群和存储系统时，通常分别部署Kubernetes集群和存储系统，Kubernetes集群和存储系统再通过网络连接，上述部署方式导致部署和运维困难、性能受网络影响易造成服务器资源的浪费，如何简单高效的在私有云Kubernetes集群中集成存储系统，是需要解决的技术问题。When deploying a Kubernetes cluster and storage system in a private cloud environment, the Kubernetes cluster and storage system are usually deployed separately, and the Kubernetes cluster and storage system are connected through a network. How to easily and efficiently integrate the storage system in the private cloud Kubernetes cluster is a technical problem that needs to be solved.
发明内容Contents of the invention
本发明的技术任务是针对以上不足，提供私有云中部署分布式存储系统的方法及部署系统，来解决如何简单高效的在私有云Kubernetes集群中集成存储系统的技术问题。The technical task of the present invention is to provide a method and a deployment system for deploying a distributed storage system in a private cloud to solve the technical problem of how to integrate a storage system in a private cloud Kubernetes cluster simply and efficiently.
第一方面，本发明的一种私有云中部署分布式存储系统的方法，在私有云环境下的服务器上部署Kubernetes集群后，基于Kubernetes集群服务器上的空闲资源部署分布式存储系统，部署有Kubernetes集群的服务器作为Kubernetes服务器，所述方法包括如下步骤：In the first aspect, a method for deploying a distributed storage system in a private cloud of the present invention, after deploying a Kubernetes cluster on a server in a private cloud environment, deploy a distributed storage system based on idle resources on the Kubernetes cluster server, deploying Kubernetes The server of cluster is as Kubernetes server, and described method comprises the steps:
将Kubernets集群服务器上的空闲硬盘规划给分布式存储系统Ceph；Plan the idle hard disk on the Kubernetes cluster server to the distributed storage system Ceph;
在Kubernets集群服务器上导入与分布式存储系统Ceph版本号适配的工具包，所述工具包用于安装和管理分布式存储系统Ceph；On the Kubernetes cluster server, import a toolkit adapted to the version number of the distributed storage system Ceph, which is used to install and manage the distributed storage system Ceph;
对工具包中的配置文件进行修改配置；Modify the configuration file in the toolkit;
将执行工具包所需的镜像上传至Kubernetes的镜像库中，在Kubernetes集群中安装所述工具包，通过安装所述工具包将分布式存储系统Ceph的管理程序安装到Kubernetes集群中；Upload the image required for executing the toolkit to the mirror library of Kubernetes, install the toolkit in the Kubernetes cluster, and install the management program of the distributed storage system Ceph into the Kubernetes cluster by installing the toolkit;
所述工具包安装完成后，Kubernetes集群通过所述工具包自动创建的存储类StorageClass对所述分布式存储系统Ceph进行管理使用。After the toolkit is installed, the Kubernetes cluster manages and uses the distributed storage system Ceph through the storage class StorageClass automatically created by the toolkit.
作为优选，所述工具包包括两个Helm的chart包；Preferably, the toolkit includes two chart packages of Helm;
在Kubernetes集群中使用helminstall命令安装所述工具包之前，在Kubernets集群中安装与所述工具包版本适配的包管理器Helm，所述包管理器Helm用于执行所述工具包的安装。Before using the helminstall command in the Kubernetes cluster to install the toolkit, a package manager Helm adapted to the version of the toolkit is installed in the Kubernetes cluster, and the package manager Helm is used to execute the installation of the toolkit.
作为优选，所述两个Helm的chart包的安装包分别为rook-ceph安装包和rook-ceph-cluster安装包；As preferably, the installation packages of the chart packages of the two Helms are respectively a rook-ceph installation package and a rook-ceph-cluster installation package;
对工具包中的配置文件进行修改配置，包括对rook-ceph安装包和rook-ceph-cluster安装包的配置文件进行修改配置；Modify and configure the configuration files in the toolkit, including modifying and configuring the configuration files of the rook-ceph installation package and the rook-ceph-cluster installation package;
修改rook-ceph安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、csi中启用的存储类型；Modify the values.yaml configuration file of the rook-ceph installation package, including modifying image mirror information, resources resource usage, and storage types enabled in csi;
修改rook-ceph-cluster安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、toolbox工具箱参数、通过cephClusterSpec修改管理节点和监控节点及副本数参数、通过cephClusterSpec.nodes修改分布式存储系统Ceph需要使用的硬盘、通过cephBlockPools修改块存储池参数、通过cephFileSystems修改文件存储池参数、通过cephObjectStores修改对象存储参数。Modify the values.yaml configuration file of the rook-ceph-cluster installation package, including modifying image mirror information, resources resource usage, toolbox toolbox parameters, modifying management nodes, monitoring nodes and replica number parameters through cephClusterSpec, and modifying distribution through cephClusterSpec.nodes The storage system Ceph needs to use the hard disk, modify the block storage pool parameters through cephBlockPools, modify the file storage pool parameters through cephFileSystems, and modify the object storage parameters through cephObjectStores.
作为优选，所述分布式存储系统Ceph为Ceph-16.2.7版本，对应的，所述工具包为v1.92版本，所述包管理器Helm为v3及以上版本，所述rook-ceph安装包为v1.9.2版本，所述rook-ceph-cluster安装包为v1.9.2版本。Preferably, the distributed storage system Ceph is version Ceph-16.2.7, correspondingly, the toolkit is version v1.92, the package manager Helm is version v3 and above, and the rook-ceph installation package It is version v1.9.2, and the rook-ceph-cluster installation package is version v1.9.2.
作为优选，在Kubernetes集群中使用helminstall命令安装所述工具包。Preferably, the toolkit is installed using the helminstall command in the Kubernetes cluster.
第二方面，本发明的一种私有云中部署分布式存储系统的部署系统，用于通过第一方面任一项所述的一种私有云中部署分布式存储系统的方法、在私有云环境下的服务器上部署Kubernetes集群后，基于Kubernetes集群服务器上的空闲资源部署分布式存储系统，部有Kubernetes集群的服务器作为Kubernetes服务器，所述部署系统包括：In the second aspect, a deployment system for deploying a distributed storage system in a private cloud according to the present invention is used for using the method for deploying a distributed storage system in a private cloud described in any one of the first aspects, in a private cloud environment After the Kubernetes cluster is deployed on the server below, the distributed storage system is deployed based on idle resources on the Kubernetes cluster server, and all servers with the Kubernetes cluster are used as the Kubernetes server. The deployment system includes:
资源规划模块，所述资源规划模块用于将Kubernets集群服务器上的空闲硬盘规划给分布式存储系统Ceph；A resource planning module, the resource planning module is used to plan the idle hard disk on the Kubernetes cluster server to the distributed storage system Ceph;
工具包导入模块，所述工具包导入模块用于在Kubernets集群服务器上导入与分布式存储系统Ceph版本号适配的工具包，所述工具包用于安装和管理分布式存储系统Ceph；Toolkit import module, described toolkit import module is used for importing the toolkit adapted to distributed storage system Ceph version number on Kubernets cluster server, and described toolkit is used for installing and managing distributed storage system Ceph;
工具包配置模块，所述工具包配置模块用于对工具包中的配置文件进行修改配置；A toolkit configuration module, the toolkit configuration module is used to modify and configure configuration files in the toolkit;
工具包安装模块，所述工具包安装模块用于将执行工具包所需的镜像上传至Kubernetes的镜像库中，在Kubernetes集群中安装所述工具包，通过安装所述工具包将分布式存储系统Ceph的管理程序安装到Kubernetes集群中；所述工具包安装完成后，Kubernetes集群通过所述工具包自动创建的存储类StorageClass对所述分布式存储系统Ceph进行管理使用。The toolkit installation module, the toolkit installation module is used to upload the image required for executing the toolkit to the mirror library of Kubernetes, install the toolkit in the Kubernetes cluster, and install the toolkit to distribute the storage system The management program of Ceph is installed in the Kubernetes cluster; after the toolkit is installed, the Kubernetes cluster manages and uses the distributed storage system Ceph through the storage class StorageClass automatically created by the toolkit.
作为优选，所述工具包包括两个Helm的chart包；Preferably, the toolkit includes two chart packages of Helm;
在Kubernetes集群中使用helminstall命令安装所述工具包之前，所述工具包导入模块用于在Kubernets集群中安装与所述工具包版本适配的包管理器Helm，所述包管理器Helm用于执行所述工具包的安装。Before using the helminstall command to install the toolkit in the Kubernetes cluster, the toolkit import module is used to install the package manager Helm adapted to the toolkit version in the Kubernetes cluster, and the package manager Helm is used to execute Installation of the toolkit.
作为优选，所述两个Helm的chart包的安装包分别为rook-ceph安装包和rook-ceph-cluster安装包；As preferably, the installation packages of the chart packages of the two Helms are respectively a rook-ceph installation package and a rook-ceph-cluster installation package;
所述工具包配置模块用于对工具包中的配置文件进行修改配置，包括对rook-ceph安装包和rook-ceph-cluster安装包的配置文件进行修改配置；The toolkit configuration module is used to modify and configure the configuration files in the toolkit, including modifying and configuring the configuration files of the rook-ceph installation package and the rook-ceph-cluster installation package;
所述工具包配置模块用于修改rook-ceph安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、csi中启用的存储类型；The toolkit configuration module is used to modify the values.yaml configuration file of the rook-ceph installation package, including modifying image mirror information, resources resource usage, and storage types enabled in csi;
所述工具包配置模块用于修改rook-ceph-cluster安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、toolbox工具箱参数、通过cephClusterSpec修改管理节点和监控节点及副本数参数、通过cephClusterSpec.nodes修改分布式存储系统Ceph需要使用的硬盘、通过cephBlockPools修改块存储池参数、通过cephFileSystems修改文件存储池参数、通过cephObjectStores修改对象存储参数。The toolkit configuration module is used to modify the values.yaml configuration file of the rook-ceph-cluster installation package, including modifying image mirror information, resources resource usage, toolbox toolbox parameters, modifying management nodes and monitoring nodes and the number of copies by cephClusterSpec Parameters, modify the hard disk that the distributed storage system Ceph needs to use through cephClusterSpec.nodes, modify the block storage pool parameters through cephBlockPools, modify the file storage pool parameters through cephFileSystems, and modify the object storage parameters through cephObjectStores.
作为优选，所述分布式存储系统Ceph为Ceph-16.2.7版本，对应的，所述工具包为v1.92版本，所述包管理器Helm为v3及以上版本，所述rook-ceph安装包为v1.9.2版本，所述rook-ceph-cluster安装包为v1.9.2版本。Preferably, the distributed storage system Ceph is version Ceph-16.2.7, correspondingly, the toolkit is version v1.92, the package manager Helm is version v3 and above, and the rook-ceph installation package It is version v1.9.2, and the rook-ceph-cluster installation package is version v1.9.2.
作为优选，在Kubernetes集群中使用helminstall命令安装所述工具包。Preferably, the toolkit is installed using the helminstall command in the Kubernetes cluster.
本发明的私有云中部署分布式存储系统的方法及部署系统具有以下优点：The method and deployment system for deploying a distributed storage system in a private cloud of the present invention have the following advantages:
1、在私有云环境的服务器上完成Kubernetes集群部署后，不需要再单独部署存储系统后通过网络接入使用，而是直接利用部署Kubernetes集群的服务器上的空闲资源来安装目标版本的分布式存储系统，将Kubernetes集群和目标版本的分布式存储两个系统合二为一，Kubernetes集群不通过网络接入就可以直接使用目标版本的分布式存储作为统一后端存储；1. After the Kubernetes cluster deployment is completed on the server in the private cloud environment, it is not necessary to deploy the storage system separately and use it through network access, but directly use the idle resources on the server where the Kubernetes cluster is deployed to install the distributed storage of the target version system, which combines the Kubernetes cluster and the distributed storage system of the target version into one, and the Kubernetes cluster can directly use the distributed storage of the target version as the unified back-end storage without accessing the network;
2、简化了部署和运维工作，提高了效率和稳定性，节省了服务器的资源。2. It simplifies deployment and operation and maintenance work, improves efficiency and stability, and saves server resources.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only of the present invention. For some embodiments, those skilled in the art can also obtain other drawings based on these drawings without creative effort.
下面结合附图对本发明进一步说明。The present invention will be further described below in conjunction with the accompanying drawings.
图1为实施例1一种私有云中部署分布式存储系统的方法的流程框图；Fig. 1 is a block flow diagram of a method for deploying a distributed storage system in a private cloud in Embodiment 1;
图2为实施例1一种私有云中部署分布式存储系统的方法部署分布式存储系统的部署概览图。FIG. 2 is an overview diagram of deploying a distributed storage system by a method for deploying a distributed storage system in a private cloud according to Embodiment 1. FIG.
具体实施方式detailed description
下面结合附图和具体实施例对本发明作进一步说明，以使本领域的技术人员可以更好地理解本发明并能予以实施，但所举实施例不作为对本发明的限定，在不冲突的情况下，本发明实施例以及实施例中的技术特征可以相互结合。The present invention will be further described below in conjunction with accompanying drawing and specific embodiment, so that those skilled in the art can better understand the present invention and can be implemented, but the embodiment given is not as the limitation of the present invention, in the case of no conflict Next, the embodiments of the present invention and the technical features in the embodiments can be combined with each other.
本发明实施例提供私有云中部署分布式存储系统的方法及部署系统，用于解决如何简单高效的在私有云Kubernetes集群中集成存储系统的技术问题。Embodiments of the present invention provide a method and a deployment system for deploying a distributed storage system in a private cloud, which are used to solve the technical problem of how to simply and efficiently integrate a storage system in a private cloud Kubernetes cluster.
实施例1：Example 1:
本发明一种私有云中部署分布式存储系统的方法，在私有云环境下的服务器上部署Kubernetes集群后，基于Kubernetes集群服务器上的空闲资源部署分布式存储系统，部署有Kubernetes集群的服务器作为Kubernetes服务器，所述方法包括如下步骤：The invention discloses a method for deploying a distributed storage system in a private cloud. After a Kubernetes cluster is deployed on a server in a private cloud environment, the distributed storage system is deployed based on idle resources on the Kubernetes cluster server, and the server with the Kubernetes cluster is deployed as Kubernetes. server, the method includes the steps of:
S100、将Kubernets集群服务器上的空闲硬盘规划给分布式存储系统Ceph；S100, plan the idle hard disk on the Kubernetes cluster server to the distributed storage system Ceph;
S200、在Kubernets集群服务器上导入与分布式存储系统Ceph版本号适配的工具包，所述工具包用于安装和管理分布式存储系统Ceph；S200. Import a toolkit adapted to the version number of the distributed storage system Ceph on the Kubernetes cluster server, the toolkit is used to install and manage the distributed storage system Ceph;
S300、对工具包中的配置文件进行修改配置；S300. Modify and configure the configuration file in the toolkit;
S400、将执行工具包所需的镜像上传至Kubernetes的镜像库中，在Kubernetes集群中安装所述工具包，通过安装所述工具包将分布式存储系统Ceph的管理程序安装到Kubernetes集群中；S400, upload the image required for executing the toolkit to the mirror library of Kubernetes, install the toolkit in the Kubernetes cluster, and install the management program of the distributed storage system Ceph into the Kubernetes cluster by installing the toolkit;
所述工具包安装完成后，Kubernetes集群通过所述工具包自动创建的存储类StorageClass对所述分布式存储系统Ceph进行管理使用。After the toolkit is installed, the Kubernetes cluster manages and uses the distributed storage system Ceph through the storage class StorageClass automatically created by the toolkit.
本实施例步骤S100进行规划，将将私有云Kubernetes集群服务器上的空闲硬盘规划分布式存储系统。In this embodiment, step S100 is used for planning, and the idle hard disk on the Kubernetes cluster server of the private cloud is planned for a distributed storage system.
为了简化安装和管理分布式存储系统，通过步骤S200在Kubernetes集群服务器上导入对应版本的工具包安装和管理分布式存储系统。工具包包括两个Helm的chart包；在Kubernetes集群中使用helminstall命令安装所述工具包之前，在Kubernets集群中安装与所述工具包版本适配的包管理器Helm，所述包管理器Helm用于执行所述工具包的安装。In order to simplify the installation and management of the distributed storage system, a corresponding version of the toolkit is imported on the Kubernetes cluster server through step S200 to install and manage the distributed storage system. The toolkit includes two chart packages of Helm; before using the helminstall command to install the toolkit in the Kubernetes cluster, install the package manager Helm adapted to the toolkit version in the Kubernetes cluster, and the package manager Helm uses to perform the installation of the toolkit.
作为具体实施例，两个Helm的chart包的安装包分别为rook-ceph安装包和rook-ceph-cluster安装包。As a specific embodiment, the installation packages of the two Helm chart packages are rook-ceph installation package and rook-ceph-cluster installation package respectively.
步骤S300对工具包中的配置文件进行修改配置，包括对rook-ceph安装包和rook-ceph-cluster安装包的配置文件进行修改配置。Step S300 is to modify and configure the configuration files in the toolkit, including modifying and configuring the configuration files of the rook-ceph installation package and the rook-ceph-cluster installation package.
修改rook-ceph安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、csi中启用的存储类型。Modify the values.yaml configuration file of the rook-ceph installation package, including modifying image mirror information, resources resource usage, and storage types enabled in csi.
修改rook-ceph-cluster安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、toolbox工具箱参数、通过cephClusterSpec修改管理节点和监控节点及副本数参数、通过cephClusterSpec.nodes修改分布式存储系统Ceph需要使用的硬盘、通过cephBlockPools修改块存储池参数、通过cephFileSystems修改文件存储池参数、通过cephObjectStores修改对象存储参数。Modify the values.yaml configuration file of the rook-ceph-cluster installation package, including modifying image mirror information, resources resource usage, toolbox toolbox parameters, modifying management nodes, monitoring nodes and replica number parameters through cephClusterSpec, and modifying distribution through cephClusterSpec.nodes The storage system Ceph needs to use the hard disk, modify the block storage pool parameters through cephBlockPools, modify the file storage pool parameters through cephFileSystems, and modify the object storage parameters through cephObjectStores.
步骤S400将镜像上传到Kubernetes的镜像库中，在Kubernetes集群中使用helminstall命令分别安装rook-ceph和rook-ceph-cluster两个工具包，安装工具会自动将目标版本的分布式存储的管理程序安装到Kubernetes集群中统一管理。Step S400 uploads the mirror image to the Kubernetes mirror library, and installs rook-ceph and rook-ceph-cluster toolkits respectively in the Kubernetes cluster using the helminstall command, and the installation tool will automatically install the management program of the distributed storage of the target version Unified management in the Kubernetes cluster.
两个包安装完成后，Kubernetes就可以直接通过rook-ceph工具自动创建的存储类StorageClass来使用目标版本的分布式存储了，而无需再人工通过网络接入其他存储。After the two packages are installed, Kubernetes can directly use the distributed storage of the target version through the storage class StorageClass automatically created by the rook-ceph tool, without manually accessing other storage through the network.
现给出一个具体实施，利用部署Kubernetes集群的服务器上空闲的资源来部署Ceph-16.2.7版本分布式存储，将Ceph-16.2.7版本分布式存储的管理程序安装到Kubernetes集群中进行统一管理，将Ceph-16.2.7版本分布式存储所需的硬盘使用Kubernetes集群服务器上的空闲硬盘，这样将Kubernetes集群和Ceph-16.2.7版本分布式存储两个系统集成到一起合二为一，Kubernetes集群不通过网络接入就可以直接使用Ceph-16.2.7版本分布式存储作为统一后端存储。简化了部署和运维工作，提高了存储效率和稳定性，节省了服务器的资源。架构图参见图2部署概览图，具体实现方法如下：Here is a specific implementation, using the idle resources on the server deploying the Kubernetes cluster to deploy the distributed storage of the Ceph-16.2.7 version, and installing the management program of the distributed storage of the Ceph-16.2.7 version into the Kubernetes cluster for unified management , use the hard disk required for the distributed storage of the Ceph-16.2.7 version to use the free hard disk on the Kubernetes cluster server, so that the two systems of the Kubernetes cluster and the distributed storage of the Ceph-16.2.7 version are integrated into one, Kubernetes The cluster can directly use the distributed storage of Ceph-16.2.7 version as the unified back-end storage without network access. It simplifies deployment and operation and maintenance work, improves storage efficiency and stability, and saves server resources. For the architecture diagram, refer to the deployment overview diagram in Figure 2. The specific implementation method is as follows:
(1)做好前期规划，将私有云Kubernetes集群服务器上的空闲硬盘规划给Ceph-16.2.7版本分布式存储，然后将Kubernetes集群安装完成。为了简化安装和管理我们Ceph-16.2.7版本分布式存储通过rook-ceph的v1.92版本工具包，该工具包含rook-ceph和rook-ceph-cluster两个Helm的chart包，所以需要在Kubernetes中安装一个包管理器Helm，需要v3及以上版本；(1) Do a good job in the preliminary planning, plan the idle hard disk on the private cloud Kubernetes cluster server to the distributed storage of Ceph-16.2.7 version, and then complete the installation of the Kubernetes cluster. In order to simplify installation and management, our Ceph-16.2.7 distributed storage uses rook-ceph's v1.92 toolkit, which contains two Helm chart packages, rook-ceph and rook-ceph-cluster, so it needs to be installed in Kubernetes Install a package manager Helm in , which requires v3 and above;
(2)rook-ceph使用v1.9.2版本，修改rook-ceph安装包的values.yaml配置文件，主要修改image镜像信息、resources资源使用量、csi中启用的存储类型等；(2) rook-ceph uses v1.9.2 version, modify the values.yaml configuration file of the rook-ceph installation package, mainly modify image mirror information, resources resource usage, storage types enabled in csi, etc.;
(3)rook-ceph-cluster使用v1.9.2版本，修改rook-ceph-cluster安装包的values.yaml配置文件，主要修改image镜像信息、resources资源使用量、toolbox工具箱参数、cephClusterSpec修改管理节点和监控节点及副本数等参数、cephClusterSpec.nodes修改Ceph存储需要使用哪些服务器上的哪些硬盘、cephBlockPools修改块存储池参数、cephFileSystems修改文件存储池参数、cephObjectStores修改对象存储参数；(3) rook-ceph-cluster uses v1.9.2 version, modify the values.yaml configuration file of the rook-ceph-cluster installation package, mainly modify image mirror information, resources resource usage, toolbox toolbox parameters, cephClusterSpec modify management nodes and Monitor parameters such as the number of nodes and copies, cephClusterSpec.nodes modify which hard disks on which servers need to be used for Ceph storage, cephBlockPools modify block storage pool parameters, cephFileSystems modify file storage pool parameters, cephObjectStores modify object storage parameters;
(4)将镜像上传到Kubernetes的镜像库中，在Kubernetes集群中使用helminstall命令分别安装rook-ceph和rook-ceph-cluster两个工具包，安装工具会自动将Ceph-16.2.7版本分布式存储的管理程序安装到Kubernetes集群中统一管理；(4) Upload the image to the Kubernetes mirror library, and use the helminstall command in the Kubernetes cluster to install the rook-ceph and rook-ceph-cluster toolkits respectively. The installation tool will automatically store the Ceph-16.2.7 version in a distributed manner. The management program is installed in the Kubernetes cluster for unified management;
第4步两个包安装完成后，Kubernetes就可以直接通过rook-ceph工具自动创建的存储类StorageClass来使用Ceph-16.2.7版本分布式存储了，而无需再人工通过网络接入其他存储。Step 4 After the installation of the two packages is complete, Kubernetes can directly use the Ceph-16.2.7 distributed storage through the storage class StorageClass automatically created by the rook-ceph tool, without manually accessing other storage through the network.
实施例2：Example 2:
本发明一种私有云中部署分布式存储系统的部署系统，包括资源规划模块、工具包导入模块、工具包配置模块以及工具包安装模块、该系统用于通过实施例1公开的方法在私有云环境下的服务器上部署Kubernetes集群后，基于Kubernetes集群服务器上的空闲资源部署分布式存储系统，部有Kubernetes集群的服务器作为Kubernetes服务器。The present invention is a deployment system for deploying a distributed storage system in a private cloud, including a resource planning module, a toolkit import module, a toolkit configuration module, and a toolkit installation module. After the Kubernetes cluster is deployed on the servers in the environment, a distributed storage system is deployed based on the idle resources on the Kubernetes cluster servers, and all servers in the Kubernetes cluster serve as Kubernetes servers.
资源规划模块用于将Kubernets集群服务器上的空闲硬盘规划给分布式存储系统Ceph。The resource planning module is used to plan the idle hard disk on the Kubernetes cluster server to the distributed storage system Ceph.
工具包导入模块用于在Kubernets集群服务器上导入与分布式存储系统Ceph版本号适配的工具包，所述工具包用于安装和管理分布式存储系统Ceph。The toolkit import module is used to import a toolkit adapted to the version number of the distributed storage system Ceph on the Kubernetes cluster server, and the toolkit is used to install and manage the distributed storage system Ceph.
本实施例选用的工具包包括两个Helm的chart包；在Kubernetes集群中使用helminstall命令安装所述工具包之前，工具包导入模块用于在Kubernets集群中安装与所述工具包版本适配的包管理器Helm，所述包管理器Helm用于执行所述工具包的安装。The toolkit selected in this embodiment includes two chart packages of Helm; before using the helminstall command to install the toolkit in the Kubernetes cluster, the toolkit import module is used to install a package adapted to the toolkit version in the Kubernetes cluster Manager Helm, the package manager Helm is used to perform the installation of the toolkit.
工具包配置模块用于对工具包中的配置文件进行修改配置。The toolkit configuration module is used to modify and configure the configuration files in the toolkit.
本实施例中两个Helm的chart包的安装包分别为rook-ceph安装包和rook-ceph-cluster安装包。In this embodiment, the installation packages of the two Helm chart packages are the rook-ceph installation package and the rook-ceph-cluster installation package respectively.
工具包配置模块用于对工具包中的配置文件进行修改配置，包括对rook-ceph安装包和rook-ceph-cluster安装包的配置文件进行修改配置。The toolkit configuration module is used to modify and configure the configuration files in the toolkit, including modifying and configuring the configuration files of the rook-ceph installation package and the rook-ceph-cluster installation package.
工具包配置模块用于修改rook-ceph安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、csi中启用的存储类型。The toolkit configuration module is used to modify the values.yaml configuration file of the rook-ceph installation package, including modifying image mirror information, resources resource usage, and storage types enabled in csi.
工具包配置模块用于修改rook-ceph-cluster安装包的values.yaml配置文件，包括修改image镜像信息、resources资源使用量、toolbox工具箱参数、通过cephClusterSpec修改管理节点和监控节点及副本数参数、通过cephClusterSpec.nodes修改分布式存储系统Ceph需要使用的硬盘、通过cephBlockPools修改块存储池参数、通过cephFileSystems修改文件存储池参数、通过cephObjectStores修改对象存储参数。The toolkit configuration module is used to modify the values.yaml configuration file of the rook-ceph-cluster installation package, including modifying image mirror information, resources resource usage, toolbox toolbox parameters, modifying management nodes and monitoring nodes and replica number parameters through cephClusterSpec, Use cephClusterSpec.nodes to modify the hard disk that Ceph needs to use in the distributed storage system, modify block storage pool parameters through cephBlockPools, modify file storage pool parameters through cephFileSystems, and modify object storage parameters through cephObjectStores.
工具包安装模块用于将执行工具包所需的镜像上传至Kubernetes的镜像库中，在Kubernetes集群中安装所述工具包，通过安装所述工具包将分布式存储系统Ceph的管理程序安装到Kubernetes集群中；所述工具包安装完成后，Kubernetes集群通过所述工具包自动创建的存储类StorageClass对所述分布式存储系统Ceph进行管理使用。The toolkit installation module is used to upload the image required for executing the toolkit to the mirror library of Kubernetes, install the toolkit in the Kubernetes cluster, and install the management program of the distributed storage system Ceph to Kubernetes by installing the toolkit In the cluster; after the toolkit is installed, the Kubernetes cluster manages and uses the distributed storage system Ceph through the storage class StorageClass automatically created by the toolkit.
工具包安装模块用于在Kubernetes集群中使用helminstall命令分别安装rook-ceph和rook-ceph-cluster两个工具包。两个包安装完成后，Kubernetes就可以直接通过rook-ceph工具自动创建的存储类StorageClass来使用对应版本的分布式存储了，而无需再人工通过网络接入其他存储。The toolkit installation module is used to install the rook-ceph and rook-ceph-cluster toolkits respectively in the Kubernetes cluster using the helminstall command. After the two packages are installed, Kubernetes can directly use the corresponding version of distributed storage through the storage class StorageClass automatically created by the rook-ceph tool, without the need to manually access other storage through the network.
上文通过附图和优选实施例对本发明进行了详细展示和说明，然而本发明不限于这些已揭示的实施例，基与上述多个实施例本领域技术人员可以知晓，可以组合上述不同实施例中的代码审核手段得到本发明更多的实施例，这些实施例也在本发明的保护范围之内。The present invention has been shown and described in detail through the accompanying drawings and preferred embodiments above, but the present invention is not limited to these disclosed embodiments, and those skilled in the art based on the above-mentioned multiple embodiments can know that the above-mentioned different embodiments can be combined More embodiments of the present invention can be obtained by means of code review in the present invention, and these embodiments are also within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211012968.7A CN115426373B (en) | 2022-08-23 | 2022-08-23 | Method for deploying distributed storage system in private cloud and deployment system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211012968.7A CN115426373B (en) | 2022-08-23 | 2022-08-23 | Method for deploying distributed storage system in private cloud and deployment system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115426373A true CN115426373A (en) | 2022-12-02 |
| CN115426373B CN115426373B (en) | 2024-11-01 |
Family
ID=84198914
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211012968.7A Active CN115426373B (en) | 2022-08-23 | 2022-08-23 | Method for deploying distributed storage system in private cloud and deployment system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115426373B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241426A (en) * | 2017-06-27 | 2017-10-10 | 西安京华科讯软件科技有限公司 | A kind of distributed memory system of the home server hard disk based on cloud computing |
| CN111274191A (en) * | 2020-01-08 | 2020-06-12 | 山东汇贸电子口岸有限公司 | Method for managing ceph cluster and cloud local storage coordinator |
| CN111522639A (en) * | 2020-04-16 | 2020-08-11 | 南京邮电大学 | Multidimensional resource scheduling method under Kubernetes cluster architecture system |
| CN111857735A (en) * | 2020-07-23 | 2020-10-30 | 浪潮云信息技术股份公司 | A method and system for Crush creation based on Rook deployment Ceph |
| WO2021097397A1 (en) * | 2019-11-17 | 2021-05-20 | Trilio Data, Inc. | Container-based application data protection method and system |
| CN113407257A (en) * | 2021-06-09 | 2021-09-17 | 交控科技股份有限公司 | Mysql cluster deployment method and device, electronic equipment and storage medium |
| WO2021237829A1 (en) * | 2020-05-25 | 2021-12-02 | 南栖仙策(南京)科技有限公司 | Method and system for integrating code repository with computing service |
-
2022
- 2022-08-23 CN CN202211012968.7A patent/CN115426373B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107241426A (en) * | 2017-06-27 | 2017-10-10 | 西安京华科讯软件科技有限公司 | A kind of distributed memory system of the home server hard disk based on cloud computing |
| WO2021097397A1 (en) * | 2019-11-17 | 2021-05-20 | Trilio Data, Inc. | Container-based application data protection method and system |
| CN111274191A (en) * | 2020-01-08 | 2020-06-12 | 山东汇贸电子口岸有限公司 | Method for managing ceph cluster and cloud local storage coordinator |
| CN111522639A (en) * | 2020-04-16 | 2020-08-11 | 南京邮电大学 | Multidimensional resource scheduling method under Kubernetes cluster architecture system |
| WO2021237829A1 (en) * | 2020-05-25 | 2021-12-02 | 南栖仙策(南京)科技有限公司 | Method and system for integrating code repository with computing service |
| CN111857735A (en) * | 2020-07-23 | 2020-10-30 | 浪潮云信息技术股份公司 | A method and system for Crush creation based on Rook deployment Ceph |
| CN113407257A (en) * | 2021-06-09 | 2021-09-17 | 交控科技股份有限公司 | Mysql cluster deployment method and device, electronic equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| LOUIS BAUMANN、STEFAN BENZ、LEONARDO MILITANO、THOMAS MICHAEL BOHNERT: ""Monitoring Resilience in a Rook-managed Containerized Cloud Storage System"", 《2019 EUROPEAN CONFERENCE ON NETWORKS AND COMMUNICATIONS (EUCNC)》, 15 August 2019 (2019-08-15) * |
| 余乐: ""基于Kubernetes的DevOps云平台设计与实现"", 《计算机技术》, 16 December 2021 (2021-12-16) * |
| 汪信元: ""基于Kubernetes的容器云平台设计和实现"", 《信息科技》, no. 12, 15 December 2020 (2020-12-15) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115426373B (en) | 2024-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2429529C2 (en) | Dynamic configuration, allocation and deployment of computer systems | |
| CN100461104C (en) | Method and system for creation of operating system partition table | |
| US20100161773A1 (en) | Decoupled installation of data management systems | |
| US7426052B2 (en) | System and method for remotely building an information handling system manufacturing image | |
| US20090328030A1 (en) | Installing a management agent with a virtual machine | |
| CN107566165B (en) | Method and system for discovering and deploying available resources of power cloud data center | |
| US12113905B2 (en) | System and method for computing cluster seeding and security using kubernetes immutable resource log | |
| US8990771B2 (en) | Building and distributing software packages | |
| CN104580519A (en) | Method for rapid deployment of openstack cloud computing platform | |
| US20090013321A1 (en) | Managing virtual computers | |
| US8341599B1 (en) | Environments sharing remote mounted middleware | |
| JP2007172586A (en) | Method, apparatus and computer program for sharing computer data among computers | |
| US20100058319A1 (en) | Agile deployment of server | |
| US20060259594A1 (en) | Progressive deployment and maintenance of applications on a set of peer nodes | |
| CN104360952A (en) | Software test system and software test method | |
| CN117170822B (en) | System model and code joint simulation system using distributed network middleware | |
| US9141368B2 (en) | Managing boot loaders for virtual hard disks | |
| US10572247B2 (en) | Prototype management system | |
| US8688830B2 (en) | Abstracting storage views in a network of computing systems | |
| CA2442795A1 (en) | Software license optimization | |
| CN104063294B (en) | A kind of linux system backup and restoration methods | |
| WO2012131868A1 (en) | Management method and management device for computer system | |
| CN112527325B (en) | Deployment method and system applied to super fusion architecture | |
| CN111984623B (en) | Automatic deployment method and device for database cluster, medium and electronic equipment | |
| CN115426373B (en) | Method for deploying distributed storage system in private cloud and deployment system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |