WO2015139510A1 - Procédé de déploiement de grappe - Google Patents

Procédé de déploiement de grappe Download PDF

Info

Publication number
WO2015139510A1
WO2015139510A1 PCT/CN2015/000159 CN2015000159W WO2015139510A1 WO 2015139510 A1 WO2015139510 A1 WO 2015139510A1 CN 2015000159 W CN2015000159 W CN 2015000159W WO 2015139510 A1 WO2015139510 A1 WO 2015139510A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
subtask
node
dependent
sub
Prior art date
Application number
PCT/CN2015/000159
Other languages
English (en)
Chinese (zh)
Inventor
刘志海
Original Assignee
福建福昕软件开发股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 福建福昕软件开发股份有限公司 filed Critical 福建福昕软件开发股份有限公司
Publication of WO2015139510A1 publication Critical patent/WO2015139510A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]

Definitions

  • the present invention relates to the field of computer clusters, and in particular to a method for cluster deployment.
  • Puppet is a centralized configuration management system for Linux, Unix, windows platform, using its own puppet description language, can manage configuration files, users, cron tasks, software packages and system services, etc.
  • Mcollective Centralized control of the operation of the Puppet system, also used to manage the Puppet system
  • ActiveMQ a powerful open source message bus, multi-language and protocol writing client
  • the present invention aims to provide a method for performing a simple data center migration in a cluster environment, reducing manual participation and reducing an error rate.
  • the present invention provides a cluster deployment method for simply performing data center migration in cluster management, reducing manual participation and reducing error rate.
  • the present invention provides a method for cluster deployment, including the following steps:
  • the master node associates the child task with the child node through the temporary task ID, and the master node Constructing, in its state data source, a state data node of each subtask, the state data of the subtask being fed back to the master node by the child node associated therewith and updating the state data of the corresponding subtask by the master node State data of the subtasks under the node, the master node detecting a dependency relationship between the subtasks, wherein the subtasks without dependencies are allowed to be executed simultaneously;
  • the child node associated with the dependent subtask separates its data portion from the environment portion, and at the same time, mirrors the environment portion and parameterizes the environment configuration file;
  • the master node is deployed through cluster image a template, invoking a virtualization system interface, migrating the mirrored packaged environment data to the child node associated with a subtask dependent on the dependent subtask execution, and executing in dependence on the dependent subtask Retrieving and updating the environment portion according to the parameterized environment configuration file on the child node associated with the subtask;
  • the master node extracts content of the data portion, and parameterizes the data configuration file;
  • the node migrates the data portion to the child node associated with the subtask dependent on the dependent subtask execution through the cluster data migration template, and is associated with the subtask that is dependent on the dependent subtask execution
  • the data node is restored on the child node according to the parameterized data configuration file.
  • the data of the data part is data backup template included in the data backup function of the environment part or data backed up by a user-specified data backup plan.
  • the content of the data part is extracted for full extraction or incremental extraction.
  • restoring the data portion through a data restoration script or a data restoration template.
  • the data backup template used is Mysq1, NFS, Mongodb or TFS.
  • the data restoration part template used is Mysq1, NFS, Mongodb or TFS.
  • the cluster deployment method, the task arrangement, the node state and the script control provided by the invention realize the high degree of automation of the cluster deployment, automatically detect the task state through the machine, automatically run the next task, reduce the manual operation, and detect the subtasks by detecting the subtasks.
  • Dependency multi-task without cross-scheduling, to ensure the accuracy of the task; through the environment part of the image packaging and parameterization of the environment configuration parameters, to achieve rapid system migration; through script control, to achieve rapid and automatic data migration.
  • FIG. 1 is a flowchart of a method for cluster deployment according to an embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for cluster deployment according to an embodiment of the present invention. As shown in FIG. 1, the method for cluster deployment of the present invention includes the following steps:
  • the master node associates the subtask with the child node by using the temporary task ID, and the master node constructs the state data node of the master node and the state data node of each subtask in its state data source, where the The task state data of the master node is stored under the state data node of the master node, and the state data of the child task is fed back to the master node by the child node associated with it, and the corresponding node is updated by the master node.
  • Status data of the subtask under the status data node of the task the master node detects a dependency relationship between the subtasks, and performs scheduling of subtask execution.
  • the child node associated with the dependent subtask separates a data portion from an environment portion
  • S140 performing an environment migration, which includes a migration of an operating system and a common migration of applications installed in the operating system. Since the current environment is a virtualized environment, reverse mirroring of the current environment can be performed.
  • the user can make a directory selection for the migrated application.
  • the operating system and the application selected by the user to be migrated are mirrored and the environment configuration file is parameterized.
  • the environment configuration file is written as a script to control the installation time of the operating system, the installation process, and the installation time of the application. Installation order, installation properties.
  • the primary node deploys the template through the cluster image, invokes the virtualization system interface, and migrates the mirrored packaged environment data to the child node associated with the subtask that depends on the dependent subtask execution, and The environment portion is restored on the child node associated with the subtask that is dependent on the dependent subtask execution.
  • the restored environment parameters are updated according to the parameterized environment configuration file.
  • Data migration is performed.
  • the data may be data of the application or data or other data generated when executed by a dependent subtask.
  • the data generated by the application may have its own storage template, or a specified storage location, or may be stored in a remote server.
  • the user may specify a data backup scheme, so that the primary node determines whether remote download is required.
  • the data can also use the data backup template provided by this solution, such as Mysq1, NFS, Mongodb or TFS.
  • the master node extracts the content of the data part, and parameterizes the data configuration file. In specific implementation, for example, a script is written to control the data restoration time and the restoration order.
  • the master node extracts the content of the data part, which may be full-quantity extraction or incremental extraction, full-quantity extraction, that is, one-time extraction, incremental extraction, that is, on the basis of the previous extraction, extracting the current time and the upper Incremental data generated during the second extraction time.
  • the master node migrates the data portion to the child node associated with the subtask dependent on the dependent subtask execution through the cluster data migration template, and executes the child dependent on the dependent subtask
  • the data portion is restored on the child node associated with the task according to the parameterized data configuration file.
  • the restore data is performed according to the script written by the user, or the data restoration template provided by the scheme, such as Mysq1, NFS, Mongodb or TFS.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

La présente invention concerne un procédé de déploiement de grappe qui comprend les étapes suivantes : un nœud maître associe des sous-tâches à des sous-nœuds respectivement par des identifiants (ID) de tâche temporaires, et établit simultanément, à titre de source de données d'état de ces sous-tâches, des nœuds de données d'état pour chaque sous-tâche; les données d'état des sous-tâches sont renvoyées au nœud maître par les sous-nœuds associés aux sous-tâches; le nœud maître détecte les relations de dépendance entre les sous-tâches, et les sous-tâches sans relation de dépendance sont autorisées à être exécutées simultanément; lorsqu'une sous-tâche à dépendance a été achevée et une sous-tâche qui dépend d'elle doit être exécutée, le sous-nœud associé à la sous-tâche à dépendance sépare sa partie données et sa partie environnement, et effectue un paquetage d'image miroir et un paramétrage de fichier de configuration sur la partie environnement; le nœud maître restaure la partie environnement et la partie données sur le nœud associé à la sous-tâche exécutée d'une manière qui dépend de la sous-tâche à dépendance.
PCT/CN2015/000159 2014-03-19 2015-03-09 Procédé de déploiement de grappe WO2015139510A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410103457.5A CN104935618B (zh) 2014-03-19 2014-03-19 一种集群部署方法
CN201410103457.5 2014-03-19

Publications (1)

Publication Number Publication Date
WO2015139510A1 true WO2015139510A1 (fr) 2015-09-24

Family

ID=54122590

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/000159 WO2015139510A1 (fr) 2014-03-19 2015-03-09 Procédé de déploiement de grappe

Country Status (2)

Country Link
CN (1) CN104935618B (fr)
WO (1) WO2015139510A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095497A (zh) * 2016-06-07 2016-11-09 中国建设银行股份有限公司 一种可执行文件的参数化配置方法及其执行系统
CN111538625A (zh) * 2020-04-29 2020-08-14 西安交通大学 基于Docker技术的Ambari集群部署、数据备份方法及电子设备
CN112055087A (zh) * 2020-09-10 2020-12-08 厦门市美亚柏科信息股份有限公司 一种Mongodb集群快速部署、迁移和维护的方法及系统

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106603592B (zh) * 2015-10-15 2019-10-01 中国电信股份有限公司 一种用于基于服务模型的应用集群迁移的方法和迁移装置
CN105373450A (zh) * 2015-11-30 2016-03-02 国网北京市电力公司 数据备份的方法及装置
CN108664496B (zh) * 2017-03-29 2022-03-25 腾讯科技（深圳）有限公司 数据迁移方法及装置
CN109144791B (zh) * 2018-09-30 2020-12-22 北京金山云网络技术有限公司 数据转存方法、装置和数据管理服务器
CN112003744B (zh) * 2020-08-14 2023-01-10 苏州浪潮智能科技有限公司 一种云平台服务集群的备份恢复方法及系统
CN114924772B (zh) * 2022-07-15 2022-10-25 浙江大华技术股份有限公司 一种算法包的更新方法及设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007061440A2 (fr) * 2005-11-15 2007-05-31 Bea Systems, Inc. Systeme et procede permettant de fournir des services singleton dans une grappe
CN103577122A (zh) * 2013-11-06 2014-02-12 杭州华为数字技术有限公司 分布式应用系统在平台间迁移的实现方法及装置
CN103605561A (zh) * 2013-11-28 2014-02-26 中标软件有限公司 一种云计算集群系统及其在线迁移物理服务器的方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070117949A1 (en) * 2005-11-22 2007-05-24 Palmer Charles F Jr Spandex from poly(tetramethylene-co-ethyleneether) glycols having low ethyleneether content
CN102629906A (zh) * 2012-03-30 2012-08-08 浪潮电子信息产业股份有限公司 一种将集群管理节点做双机实现提高集群业务可用性的设计办法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007061440A2 (fr) * 2005-11-15 2007-05-31 Bea Systems, Inc. Systeme et procede permettant de fournir des services singleton dans une grappe
CN103577122A (zh) * 2013-11-06 2014-02-12 杭州华为数字技术有限公司 分布式应用系统在平台间迁移的实现方法及装置
CN103605561A (zh) * 2013-11-28 2014-02-26 中标软件有限公司 一种云计算集群系统及其在线迁移物理服务器的方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095497A (zh) * 2016-06-07 2016-11-09 中国建设银行股份有限公司 一种可执行文件的参数化配置方法及其执行系统
CN111538625A (zh) * 2020-04-29 2020-08-14 西安交通大学 基于Docker技术的Ambari集群部署、数据备份方法及电子设备
CN111538625B (zh) * 2020-04-29 2023-03-28 西安交通大学 基于Docker技术的Ambari集群部署、数据备份方法及电子设备
CN112055087A (zh) * 2020-09-10 2020-12-08 厦门市美亚柏科信息股份有限公司 一种Mongodb集群快速部署、迁移和维护的方法及系统
CN112055087B (zh) * 2020-09-10 2023-04-07 厦门市美亚柏科信息股份有限公司 一种Mongodb集群快速部署、迁移和维护的方法及系统

Also Published As

Publication number Publication date
CN104935618B (zh) 2018-01-19
CN104935618A (zh) 2015-09-23

Similar Documents

Publication Publication Date Title
WO2015139510A1 (fr) Procédé de déploiement de grappe
CN109120678B (zh) 用于分布式存储系统的服务托管的方法和装置
US9875133B2 (en) Virtual machine disk image installation
US9661071B2 (en) Apparatus, systems and methods for deployment and management of distributed computing systems and applications
US8688642B2 (en) Systems and methods for managing application availability
US8676762B2 (en) Efficient backup and restore of a cluster aware virtual input/output server (VIOS) within a VIOS cluster
KR101970839B1 (ko) 서비스의 2차 위치에서의 작업의 재생 기법
US11086662B2 (en) Method and system of migrating applications to a cloud-computing environment
CN108270726B (zh) 应用实例部署方法及装置
US10579369B2 (en) Container based application reification
CN111641515B (zh) Vnf的生命周期管理方法及装置
US9087001B1 (en) Virtualizing multiple networked machines using a predetermined network recovery policy
US11880282B2 (en) Container-based application data protection method and system
EP3230865B1 (fr) Système d'exécution de récupération par génération programmatique de flux de travaux exploitables
US9485308B2 (en) Zero copy volume reconstruction
Giannakopoulos et al. Recovering from cloud application deployment failures through re-execution
CN113326098B (zh) 支持kvm虚拟化与容器虚拟化的云管平台
CN110618884A (zh) 故障监控方法、虚拟化的网络功能模块管理器和存储介质
US10613789B1 (en) Analytics engine using consistent replication on distributed sites
US20200236146A1 (en) System and method for embedding external infrastructure services into management nodes
US20200301750A1 (en) METHOD FOR MITIGATING THE IMPACT OF NETWORK FUNCTION VIRTUALIZATION INFRASTRUCTURE (NFVI) SOFTWARE MODIFICATIONS ON VIRTUALIZED NETWORK FUNCTIONS (VNFs)
CN110837394A (zh) 一种高可用配置版本仓库配置方法、终端及可读介质
US11880294B2 (en) Real-time cross appliance operational intelligence during management appliance upgrade
CN112214323B (zh) 一种资源回收方法、装置及计算机可读存储介质
CN110377397B (zh) 基于虚机复制的存量应用快速部署扩容的方法

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15765271

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 15765271

Country of ref document: EP

Kind code of ref document: A1