CN110825420B - Method, device, equipment and storage medium for updating configuration parameters of distributed cluster - Google Patents
Method, device, equipment and storage medium for updating configuration parameters of distributed cluster Download PDFInfo
- Publication number
- CN110825420B CN110825420B CN201911173287.7A CN201911173287A CN110825420B CN 110825420 B CN110825420 B CN 110825420B CN 201911173287 A CN201911173287 A CN 201911173287A CN 110825420 B CN110825420 B CN 110825420B
- Authority
- CN
- China
- Prior art keywords
- configuration
- parameter
- file
- distributed cluster
- parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/65—Updates
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The embodiment of the specification provides a method, a device, equipment and a storage medium for updating configuration parameters of a distributed cluster, wherein the method comprises the following steps: generating a parameter configuration file based on the received configuration parameters; sending the parameter configuration file to a target server set of a distributed cluster; acquiring the latest parameter configuration file from the target server set and checking the latest parameter configuration file; and after the latest parameter configuration file passes the verification, sending a restarting instruction to the target server set so as to enable the configuration parameters to be effective on the target server set. The embodiment of the specification can improve the updating efficiency and the application range of the configuration parameters of the distributed cluster and reduce the updating cost of the configuration parameters of the distributed cluster.
Description
Technical Field
The present disclosure relates to the field of distributed cluster technologies, and in particular, to a method, an apparatus, a device, and a storage medium for updating a configuration parameter of a distributed cluster.
Background
The early distributed clusters update the configuration parameters manually, i.e. operators log in to each server in the distributed clusters, and manually edit and modify the configuration parameters. However, there are few two or thirty servers in a distributed clustered environment, up to hundreds of servers (or even more). Of course, if a multi-center and/or multi-active distributed cluster is used, the number of servers in the distributed cluster will typically be greater. The manual updating of the configuration parameters is inefficient and costly.
There are also some configuration parameter updating schemes of distributed clusters based on database technology. The configuration parameters are stored in a database, and each server in the distributed cluster obtains the configuration parameters by accessing the database. However, in some distributed application scenarios (e.g., communicators, head-end messaging systems, sensor data collection, etc.), the distributed clusters themselves do not require a database. If the configuration parameter update is to be implemented based on database technology, an additional database is required. Furthermore, since there are often multiple services in a distributed cluster, and each service may have a separate database environment, the operator needs to modify the parameters separately in different databases. In such a scenario, this way of updating the configuration parameters is still inefficient and costly. Meanwhile, basic information such as a database user name, a password, an IP address and a database instance name cannot be stored in the database and must be externally arranged in a parameter file.
With the development of technology, a configuration parameter subscription updating mechanism based on a Zookeeper distributed coordination service is also developed. Each server in the distributed cluster monitors a configuration parameter updating event broadcasted by the Zookeeper, and then automatically updates the configuration parameters according to the monitored configuration parameter updating event. However, when some servers have network problems or downtime, the servers may not receive the configuration parameter update event, so that the problem that some servers have modified parameters and other servers have not modified parameters, that is, the problem that configuration parameters in clusters are inconsistent, is easy to occur. For a distributed cluster of high availability, high reliability application scenarios, such intra-cluster configuration parameter inconsistencies are not acceptable. Therefore, the application range of the configuration parameter subscription updating mechanism based on the Zookeeper distributed coordination service is limited.
Disclosure of Invention
An object of the embodiments of the present disclosure is to provide a method, an apparatus, a device, and a storage medium for updating configuration parameters of a distributed cluster, so as to improve the efficiency and the application range of updating the configuration parameters of the distributed cluster, and reduce the cost of updating the configuration parameters of the distributed cluster.
In order to achieve the above objective, in one aspect, an embodiment of the present disclosure provides a method for updating a configuration parameter of a distributed cluster, including:
generating a parameter configuration file based on the received configuration parameters;
sending the parameter configuration file to a target server set of a distributed cluster;
acquiring the latest parameter configuration file from the target server set and checking the latest parameter configuration file;
and after the latest parameter configuration file passes the verification, sending a restarting instruction to the target server set so as to enable the configuration parameters to be effective on the target server set.
On the other hand, the embodiment of the specification also provides a configuration parameter updating device of the distributed cluster, which comprises the following components:
the file generation module is used for generating a parameter configuration file based on the received configuration parameters;
the file transmission module is used for sending the parameter configuration file to a target server set of the distributed cluster;
the file verification module is used for acquiring the latest parameter configuration file from the target server set and verifying the latest parameter configuration file;
and the instruction sending module is used for sending a restarting instruction to the target server set after the latest parameter configuration file passes the verification so as to enable the configuration parameters to be effective on the target server set.
In another aspect, embodiments of the present specification further provide an electronic device including a memory, a processor, and a computer program stored on the memory, the computer program when executed by the processor performing the steps of:
generating a parameter configuration file based on the received configuration parameters;
sending the parameter configuration file to a target server set of a distributed cluster;
acquiring the latest parameter configuration file from the target server set and checking the latest parameter configuration file; and after the latest parameter configuration file passes the verification, sending a restarting instruction to the target server set so as to enable the configuration parameters to be effective on the target server set.
In another aspect, the present description also provides a computer storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
generating a parameter configuration file based on the received configuration parameters;
sending the parameter configuration file to a target server set of a distributed cluster;
acquiring the latest parameter configuration file from the target server set and checking the latest parameter configuration file; and after the latest parameter configuration file passes the verification, sending a restarting instruction to the target server set so as to enable the configuration parameters to be effective on the target server set.
The technical scheme provided by the embodiment of the specification can ensure that operation and maintenance personnel can uniformly modify the configuration parameters at the configuration center and automatically synchronize to all servers in the distributed cluster through the configuration center, thereby improving the configuration parameter updating efficiency of the distributed cluster and reducing the configuration parameter updating cost of the distributed cluster. Moreover, the configuration center of the embodiment of the present disclosure has no limitation on the distributed scenario, so that the application range of the configuration parameter update of the distributed cluster is further improved. In addition, the embodiment of the specification can also verify the latest parameter configuration file before updating, thereby being beneficial to improving the success rate of configuration updating.
Drawings
In order to more clearly illustrate the embodiments of the present description or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some of the embodiments described in the present description, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. In the drawings:
FIG. 1 is a schematic diagram illustrating data interaction between a configuration center and a distributed cluster according to some embodiments of the present disclosure;
fig. 2 is a schematic structural diagram of a configuration center in some embodiments of the present disclosure.
FIG. 3 is a block diagram illustrating a configuration parameter updating apparatus for a distributed cluster in some embodiments of the present disclosure;
fig. 4 is a flowchart of a method for updating configuration parameters of a distributed cluster in some embodiments of the present disclosure.
Detailed Description
In order to make the technical solutions in the present specification better understood by those skilled in the art, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present specification, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are intended to be within the scope of the present disclosure.
Referring to fig. 1, in some embodiments of the present description, a configuration center is provided that may interact with a distributed cluster to implement configuration parameter updating of the distributed cluster. For example, the configuration center may generate a parameter configuration file based on the received configuration parameters, send the parameter configuration file to a target server set of the distributed cluster, and then obtain the latest parameter configuration file from the target server set and verify the latest parameter configuration file; and after the latest parameter configuration file passes the verification, a restarting instruction is sent to the target server set so as to enable the configuration parameters to be effective on the target server set. Therefore, operation and maintenance personnel of the distributed cluster can uniformly modify the configuration parameters at the first position of the configuration center and automatically synchronize to all servers in the distributed cluster through the configuration center, so that the configuration parameter updating efficiency of the distributed cluster is improved, and the configuration parameter updating cost of the distributed cluster is reduced. Moreover, the configuration center of the embodiment of the present disclosure has no limitation on the distributed scenario, so that the application range of the configuration parameter update of the distributed cluster is further improved. In addition, the embodiment of the specification can also verify the latest parameter configuration file before updating, thereby being beneficial to improving the success rate of configuration updating. Moreover, the embodiment of the specification does not need to introduce third party software such as Zookeeper and the like, and is not invasive to the system.
The distributed clusters mentioned in the present specification may be distributed systems or clusters. Wherein, a distributed system refers to a system in which a hardware or software component is distributed on different servers, and the hardware or software component is communicated and coordinated with each other only through a network, and a group of independent servers are presented to a user as a unified whole, so that the system is just like a system. Clustering refers to the step of centralizing multiple servers together to perform the same service, and appears to a client as if there is only one server.
In some embodiments of the present disclosure, as shown in fig. 2, the configuration center may be an electronic device with operation and network interaction functions, where the electronic device may include a memory, a processor, and a computer program stored on the memory, where the computer program when executed by the processor may perform the following steps:
generating a parameter configuration file based on the received configuration parameters;
sending the parameter configuration file to a target server set of a distributed cluster;
acquiring the latest parameter configuration file from the target server set and checking the latest parameter configuration file;
and after the latest parameter configuration file passes the verification, sending a restarting instruction to the target server set so as to enable the configuration parameters to be effective on the target server set.
Of course, in other embodiments of the present disclosure, the configuration center may also be software running in the electronic device that provides business logic for data processing and network interactions.
The configuration parameters in the embodiments of the present specification may refer to: some of the environmental variables involved in the software in the distributed cluster. For example, in development, testing and production runs, different values are required that are set from environment to environment. Accordingly, the parameter configuration file in the embodiment of the specification may refer to: the configuration parameters of all servers in the distributed cluster are uniformly written in one file (e.g., text file), and the one file forms a parameter configuration file. Of course, in other embodiments, a portion of the servers in the distributed cluster are written in one parameter configuration file, and another portion of the servers in the distributed cluster are written in another parameter configuration file, i.e., there may be one or more parameter configuration files. However, relatively speaking, the configuration parameters of all servers in the distributed cluster are uniformly written in one parameter configuration file, so that uniform management of all parameters can be more convenient.
In some embodiments of the present description, a configuration center may provide a user interface (e.g., web page, etc.) for configuration operations. The user interface may be provided with configuration items of configuration parameters of all servers in the distributed cluster for configuration operations (e.g., modification, save, etc.) by operation staff of the distributed cluster. In this manner, the configuration center may receive configuration parameters entered by a user through the user interface. Those skilled in the art will appreciate that the configuration parameters are merely exemplary and that in other embodiments, configuration parameters may be received in other ways, and this is not limiting.
In some embodiments of the present description, generating a parameter configuration file based on received configuration parameters may refer to writing the received configuration parameters into a specified format file (e.g., a text file). Typically, the operation staff of the distributed cluster inputs the plain text configuration parameters at the configuration center. In some cases, the plain text configuration parameters may include some sensitive parameters (as to which parameters in the configuration parameters belong to the sensitive parameters, which may be pre-specified), however, the distributed cluster operation and maintenance personnel have difficulty encrypting the configuration parameters, and the manual processing is very cumbersome and error-prone. Therefore, in order to improve the information security of the sensitive parameters, when the received configuration parameters include the sensitive parameters, the configuration center may automatically encrypt the sensitive parameters before generating the parameter configuration file, so that at least the sensitive parameters in the generated parameter configuration file are ciphertext.
In some embodiments of the present disclosure, before generating the parameter configuration file based on the received configuration parameters, the configuration center may further backup the original parameter configuration file of the target server set (i.e., the parameter configuration file generated last time), so that when the parameter configuration fails, rollback may also be performed based on the backup original parameter configuration file. For example, in an exemplary embodiment, before generating a parameter configuration file based on the received configuration parameters, the configuration center may first backup the original parameter configuration file in the working directory to the backup directory, and then read the received new configuration parameters to generate the parameter configuration file to the directory to be distributed; of course, in other exemplary embodiments, the operation staff of the distributed cluster may manually upload the newly generated parameter configuration file to the to-be-distributed directory. Wherein the working directory, the backup directory and the to-be-distributed directory are storage paths specified by operation and maintenance personnel of the distributed cluster (or default of a configuration center).
In some embodiments of the present description, the configuration center may interact with the distributed clusters through file transfer protocols (e.g., FTP, FTPS, SSH, SCP, SFTP, etc.). For example, the configuration center may send the parameter configuration file to a target server set of the distributed cluster through SFTP protocol. In other embodiments, the configuration center may also interact with the distributed cluster through other protocols (such as socket protocol, http protocol, etc.), which is not limited in this specification, and may be specifically selected according to needs.
The set of target servers in this specification may include some or all of the servers in a distributed cluster. The set of target servers may be specified by the operation and maintenance personnel of the distributed cluster, as needed, from a user interface provided by the configuration center. For example, when the configuration parameters are updated in a gray level release manner due to application scene requirements, operation staff of the distributed cluster can firstly select a batch of servers as a target server set to update the configuration parameters from the distributed cluster, and after the batch of servers completes the update of the configuration parameters, the next batch of servers in the distributed cluster is updated with the configuration parameters, so that the update of the configuration parameters of all servers in the distributed cluster can be finally completed. For another example, when configuration parameters are required to be performed on all servers in the distributed cluster at one time, the update can be selected in an idle period of the distributed cluster, so as to avoid or reduce the influence on the normal service operation of the distributed cluster. Correspondingly, the configuration center can read the server ip address list of the distributed cluster, and circularly copy the generated parameter configuration file to the designated directory of each server in the distributed cluster.
In some embodiments of the present disclosure, after the parameter configuration file is sent to the target server set of the distributed cluster, the configuration center may further obtain the latest parameter configuration file from the target server set (i.e., the parameter configuration file received by the target server set last time), and verify the latest parameter configuration file, so as to facilitate improving the success rate of configuration update. The verification is to obtain the latest parameter configuration file from the target server set as a target file, and compare the latest parameter configuration file generated by the configuration center and provided for the target server set as an original file according to the date, size, content (e.g. MD 5) and the like of the file to verify the integrity, consistency and correctness of the target file. Correspondingly, after the latest parameter configuration file of the target server set passes the verification, the configuration center can send a restarting instruction to the target server set. Otherwise, the configuration center may retransmit the parameter configuration file to the target server set and check again after retransmission to ensure that the target file is complete, consistent, and correct with respect to the original file. MD5 is a message digest algorithm, which is a widely used cryptographic hash function that can map values of arbitrary length to smaller values of fixed length.
In some embodiments of the present description, the configuration center sends a restart instruction to the set of target servers to validate the configuration parameters on the set of target servers. Therefore, the problem that the server software is restarted and the configuration parameter update is effective can be solved, and therefore automatic operation and maintenance can be achieved without the need of manually restarting each server in the target server by operation and maintenance personnel. It should be appreciated that since distributed clusters are often provided with multiple services, and the application environment required for each service is different, each server may automatically select the required configuration parameters to configure from the latest parameter configuration file in the local working directory as needed at the time of restart.
In some embodiments of the present description, the restart instruction may be a remote command, i.e., the configuration center may remotely invoke each server command within the distributed cluster. For example, in an exemplary embodiment, the configuration center may remotely invoke shell commands of servers within the distributed cluster via ssh commands to remotely restart service applications of the servers to validate configuration parameters. In other embodiments, the configuration center may also indicate in other ways that the latest configuration parameters of the servers of the distributed cluster are valid. For example, in an exemplary embodiment, the object state may be dynamically modified using a reflection mechanism in a programming language so that parameters may be validated without restarting the application, but this approach has limitations, such as some parameters require a set of parameters to be validated at the same time, which may not be possible.
In some embodiments of the present description, the configuration center may also maintain an updated state of the configuration parameters. For example, after the parameter configuration file is sent to the target server set of the distributed cluster, the configuration center may further determine whether the parameter configuration file is successfully transmitted according to a response returned by the target server set, and update a sending state (such as sending success, sending failure, etc.) of the parameter configuration file according to a determination result. For another example, after sending a restart instruction to the target server set, the configuration center may further determine whether the configuration parameter update is successful according to the response returned by the target server set, and update the configuration parameter update result (e.g., update success, update failure, etc.) according to the determination result. Etc. Correspondingly, when a state query request is received, the configuration center can return a state query result for operation and maintenance personnel to check, so that the operation and maintenance personnel can know the conditions of whether the parameter configuration file of each server in the distributed cluster is successfully issued, whether the application software is restarted, whether the configuration parameters are effective and the like.
Corresponding to the configuration center, the embodiment of the present disclosure further provides a configuration parameter updating device of the distributed cluster, where the configuration parameter updating device of the distributed cluster may be configured in the configuration center. Referring to fig. 3, in some embodiments of the present disclosure, a configuration parameter updating apparatus of a distributed cluster may include:
a file generation module 31, which may be configured to generate a parameter configuration file based on the received configuration parameters;
a file transfer module 32, configured to send the parameter configuration file to a target server set of the distributed cluster;
a file verification module 33, configured to obtain the latest parameter configuration file from the target server set, and verify the latest parameter configuration file;
the instruction sending module 34 may be configured to send a restart instruction to the target server set after the latest parameter configuration file passes the verification, so as to make the configuration parameter take effect on the target server set.
In some embodiments of the present disclosure, the configuration parameter updating apparatus of the distributed cluster may further include:
and the parameter encryption module is used for encrypting the sensitive parameters when the received configuration parameters contain the sensitive parameters before the file generation module generates the parameter configuration file based on the received configuration parameters.
In some embodiments of the present disclosure, the configuration parameter updating apparatus of the distributed cluster may further include:
and the file backup module is used for backing up the original parameter configuration files of the target server set before the file backup module generates the parameter configuration files based on the received configuration parameters.
In some embodiments of the present disclosure, the configuration parameter updating apparatus of the distributed cluster may further include:
and the parameter maintenance module is used for receiving the configuration parameters through a user interface before the configuration parameter receiving module generates the parameter configuration file based on the received configuration parameters.
In some embodiments of the present disclosure, the configuration parameter updating apparatus of the distributed cluster may further include:
and the state query module is used for returning a state query result when receiving the state query request.
For convenience of description, the above devices are described as being functionally divided into various units, respectively. Of course, the functions of each element may be implemented in one or more software and/or hardware elements when implemented in the present specification.
Corresponding to the configuration center, the embodiment of the present disclosure further provides a configuration parameter updating method of the distributed cluster, where an execution body of the configuration parameter updating method of the distributed cluster may be the configuration center. Referring to fig. 4, in some embodiments of the present disclosure, a method for updating configuration parameters of a distributed cluster may include the following steps:
s401, generating a parameter configuration file based on the received configuration parameters.
S402, the parameter configuration file is sent to a target server set of the distributed cluster.
S403, acquiring the latest parameter configuration file from the target server set, and checking the latest parameter configuration file.
S404, after the latest parameter configuration file passes verification, a restarting instruction is sent to the target server set, so that the configuration parameters are effective on the target server set.
In some embodiments of the present disclosure, before generating the parameter configuration file based on the received configuration parameters, the method for updating the configuration parameters of the distributed cluster may further include:
and encrypting the sensitive parameters when the received configuration parameters comprise the sensitive parameters.
In some embodiments of the present disclosure, before generating the parameter configuration file based on the received configuration parameters, the method for updating the configuration parameters of the distributed cluster may further include:
and backing up the original parameter configuration file of the target server set.
In some embodiments of the present description, before generating the parameter configuration file based on the received configuration parameters, the method may further include:
configuration parameters are received through a user interface.
In some embodiments of the present disclosure, after sending a restart instruction to the target server set, the method for updating a configuration parameter of the distributed cluster may further include:
and when receiving the state query request, returning a state query result.
While the process flows described above include a plurality of operations occurring in a particular order, it should be apparent that the processes may include more or fewer operations, which may be performed sequentially or in parallel (e.g., using a parallel processor or a multi-threaded environment).
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method or apparatus comprising such elements.
It will be appreciated by those skilled in the art that embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, the present specification may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present description can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the method embodiments, since they are substantially similar to the apparatus embodiments, the description is relatively simple, with reference to the description of the apparatus embodiments in part.
The foregoing is merely exemplary of the present disclosure and is not intended to limit the disclosure. Various modifications and alterations to this specification will become apparent to those skilled in the art. Any modifications, equivalent substitutions, improvements, or the like, which are within the spirit and principles of the present description, are intended to be included within the scope of the claims of the present description.
Claims (10)
1. A method for updating configuration parameters of a distributed cluster, which is used for a configuration center, and comprises the following steps:
encrypting the sensitive parameters when the received configuration parameters contain the sensitive parameters;
generating a parameter configuration file based on the received configuration parameters;
sending the parameter configuration file to a target server set of a distributed cluster;
acquiring the latest parameter configuration file from the target server set, and comparing the latest parameter configuration file with an original file according to the date, the size and the content of the file to check the integrity, the consistency and the correctness of the latest parameter configuration file, wherein the original file is the parameter configuration file which is latest generated by the configuration center and is provided for the target server set;
and after the latest parameter configuration file passes the integrity, consistency and correctness verification, sending a restarting instruction to the target server set so as to enable the configuration parameters to be effective on the target server set.
2. The method for updating configuration parameters of a distributed cluster according to claim 1, further comprising, before generating a parameter configuration file based on the received configuration parameters:
and backing up the original parameter configuration file of the target server set.
3. The method for updating configuration parameters of a distributed cluster according to claim 1, further comprising, before generating a parameter configuration file based on the received configuration parameters:
configuration parameters are received through a user interface.
4. The method for updating configuration parameters of a distributed cluster according to claim 1, wherein:
and when receiving the state query request, returning a state query result.
5. A configuration parameter updating device of a distributed cluster, wherein the configuration parameter updating device of the distributed cluster is configured in a configuration center, and the configuration parameter updating device of the distributed cluster comprises:
the parameter encryption module is used for encrypting the sensitive parameters when the received configuration parameters comprise the sensitive parameters;
the file generation module is used for generating a parameter configuration file based on the received configuration parameters;
the file transmission module is used for sending the parameter configuration file to a target server set of the distributed cluster;
the file verification module is used for acquiring the latest parameter configuration file from the target server set, comparing the latest parameter configuration file with an original file according to the date, the size and the content of the file to verify the integrity, the consistency and the correctness of the latest parameter configuration file, wherein the original file is the parameter configuration file which is latest generated by the configuration center and is provided for the target server set;
and the instruction sending module is used for sending a restarting instruction to the target server set after the latest parameter configuration file passes the integrity, consistency and correctness verification so as to enable the configuration parameters to be effective on the target server set.
6. The configuration parameter updating apparatus of a distributed cluster according to claim 5, further comprising:
and the file backup module is used for backing up the original parameter configuration files of the target server set before the file backup module generates the parameter configuration files based on the received configuration parameters.
7. The configuration parameter updating apparatus of a distributed cluster according to claim 5, further comprising:
and the parameter maintenance module is used for receiving the configuration parameters through a user interface before the configuration parameter receiving module generates the parameter configuration file based on the received configuration parameters.
8. The configuration parameter updating apparatus of a distributed cluster according to claim 5, further comprising:
and the state query module is used for returning a state query result when receiving the state query request.
9. An electronic device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program when executed by the processor performs the method of any one of claims 1 to 4.
10. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911173287.7A CN110825420B (en) | 2019-11-26 | 2019-11-26 | Method, device, equipment and storage medium for updating configuration parameters of distributed cluster |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911173287.7A CN110825420B (en) | 2019-11-26 | 2019-11-26 | Method, device, equipment and storage medium for updating configuration parameters of distributed cluster |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110825420A CN110825420A (en) | 2020-02-21 |
| CN110825420B true CN110825420B (en) | 2023-09-22 |
Family
ID=69559354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911173287.7A Active CN110825420B (en) | 2019-11-26 | 2019-11-26 | Method, device, equipment and storage medium for updating configuration parameters of distributed cluster |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110825420B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111478812B (en) * | 2020-04-07 | 2023-10-24 | 中国建设银行股份有限公司 | Configuration center server, application method and distributed platform system |
| CN111708557B (en) * | 2020-05-26 | 2024-01-26 | 北京金山云网络技术有限公司 | Method, device and storage medium for updating configuration file |
| CN111737018B (en) * | 2020-08-26 | 2020-12-22 | 腾讯科技（深圳）有限公司 | ZooKeeper configuration file storage processing method, device, equipment and medium thereof |
| CN112532447A (en) * | 2020-11-27 | 2021-03-19 | 锐捷网络股份有限公司 | RDMA parameter configuration method, device and storage medium |
| CN112463887A (en) * | 2020-12-04 | 2021-03-09 | 中国建设银行股份有限公司 | Data processing method, device, equipment and storage medium |
| CN112579205B (en) * | 2020-12-24 | 2023-02-14 | 平安普惠企业管理有限公司 | Configuration file checking method and device, computer equipment and storage medium |
| CN112597134B (en) * | 2020-12-29 | 2024-02-09 | 中国工商银行股份有限公司 | Configuration method, device, electronic equipment and medium of distributed configuration center |
| CN113127016B (en) * | 2021-04-30 | 2024-06-21 | 平安国际智慧城市科技股份有限公司 | Automatic deployment method, device, equipment and medium for Hdp big data platform |
| CN113064672A (en) * | 2021-04-30 | 2021-07-02 | 中国工商银行股份有限公司 | Method and device for verifying configuration information of load balancing equipment |
| CN113342852B (en) * | 2021-06-09 | 2023-06-30 | 上海万物新生环保科技集团有限公司 | Method and equipment for realizing distributed configuration |
| CN113452562B (en) * | 2021-06-28 | 2022-07-12 | 中国建设银行股份有限公司 | Configuration parameter calibration method and device |
| CN114168221A (en) * | 2021-11-30 | 2022-03-11 | 紫光云(南京)数字技术有限公司 | Method for restarting mongodb cluster on cloud management platform |
| CN115001974A (en) * | 2022-05-20 | 2022-09-02 | 中电信数智科技有限公司 | Cluster system consistency detection method, device, system, equipment and storage medium |
| CN115268993A (en) * | 2022-08-29 | 2022-11-01 | 中国建设银行股份有限公司 | Method, service system, device and storage medium for updating configuration parameters |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107948314A (en) * | 2017-12-21 | 2018-04-20 | 泰康保险集团股份有限公司 | Method for processing business, device and the server of rule-based file |
| CN108521342A (en) * | 2018-03-26 | 2018-09-11 | 北京奇艺世纪科技有限公司 | A kind of management method and device of cluster |
| CN109522287A (en) * | 2018-09-18 | 2019-03-26 | 平安科技（深圳）有限公司 | Monitoring method, system, equipment and the medium of distributed document storage cluster |
| CN109861842A (en) * | 2018-11-23 | 2019-06-07 | 阿里巴巴集团控股有限公司 | O&M method, apparatus, electronic equipment and the storage medium of server cluster |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10209982B2 (en) * | 2017-05-16 | 2019-02-19 | Bank Of America Corporation | Distributed storage framework information server platform architecture |
-
2019
- 2019-11-26 CN CN201911173287.7A patent/CN110825420B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107948314A (en) * | 2017-12-21 | 2018-04-20 | 泰康保险集团股份有限公司 | Method for processing business, device and the server of rule-based file |
| CN108521342A (en) * | 2018-03-26 | 2018-09-11 | 北京奇艺世纪科技有限公司 | A kind of management method and device of cluster |
| CN109522287A (en) * | 2018-09-18 | 2019-03-26 | 平安科技（深圳）有限公司 | Monitoring method, system, equipment and the medium of distributed document storage cluster |
| CN109861842A (en) * | 2018-11-23 | 2019-06-07 | 阿里巴巴集团控股有限公司 | O&M method, apparatus, electronic equipment and the storage medium of server cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110825420A (en) | 2020-02-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110825420B (en) | Method, device, equipment and storage medium for updating configuration parameters of distributed cluster | |
| CN110912937B (en) | Block chain-based digital certificate storage platform and certificate storage method | |
| US11868944B2 (en) | Container image management system for distributed clusters | |
| Shraer et al. | Venus: Verification for untrusted cloud storage | |
| US10922303B1 (en) | Early detection of corrupt data partition exports | |
| CN111314479B (en) | Data processing method and equipment | |
| AU2020260153B2 (en) | Version history management using a blockchain | |
| CN107291750B (en) | Data migration method and device | |
| CN106575227B (en) | Automatic software update framework | |
| CN109766330B (en) | Data slicing method and device, electronic equipment and storage medium | |
| CN109522363B (en) | Cloud platform synchronization method, system, equipment and storage medium based on block chain | |
| CN107294750B (en) | Cloud cluster energy self-identification distributed configuration management method and device | |
| US8612799B2 (en) | Method and apparatus of backing up subversion repository | |
| CN109522043B (en) | Method and device for managing configuration data and storage medium | |
| CN112087530A (en) | Method, device, equipment and medium for uploading data to block chain system | |
| CN116257438A (en) | Updating method of interface test case and related equipment | |
| CN111327680B (en) | Authentication data synchronization method, device, system, computer equipment and storage medium | |
| EP3349416B1 (en) | Relationship chain processing method and system, and storage medium | |
| US10152490B2 (en) | Sequential replication with limited number of objects | |
| CN111581285A (en) | Data information synchronization method and device, electronic equipment and medium | |
| CN109587202B (en) | Method, device and system for coprocessing between file verification and data processing | |
| CN115757642A (en) | Data synchronization method and device based on filing log file | |
| CN110493326B (en) | Zookeeper-based cluster configuration file management system and method | |
| CN111596933A (en) | File processing method and device, electronic equipment and computer readable storage medium | |
| CN113449035B (en) | Data synchronization method, device, computer equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |