CN111580884B - Configuration updating method, device, server and electronic equipment - Google Patents

Configuration updating method, device, server and electronic equipment Download PDF

Info

Publication number
CN111580884B
CN111580884B CN202010370245.9A CN202010370245A CN111580884B CN 111580884 B CN111580884 B CN 111580884B CN 202010370245 A CN202010370245 A CN 202010370245A CN 111580884 B CN111580884 B CN 111580884B
Authority
CN
China
Prior art keywords
configuration
node
updated
file
items
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010370245.9A
Other languages
Chinese (zh)
Other versions
CN111580884A (en
Inventor
赵宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kingsoft Cloud Network Technology Co Ltd
Original Assignee
Beijing Kingsoft Cloud Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Kingsoft Cloud Network Technology Co Ltd filed Critical Beijing Kingsoft Cloud Network Technology Co Ltd
Priority to CN202010370245.9A priority Critical patent/CN111580884B/en
Publication of CN111580884A publication Critical patent/CN111580884A/en
Application granted granted Critical
Publication of CN111580884B publication Critical patent/CN111580884B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Stored Programmes (AREA)

Abstract

The invention provides a configuration updating method, a device, a server and electronic equipment, wherein the configuration updating method, the device, the server and the electronic equipment are used for acquiring a configuration file to be updated according to the identification of the configuration file to be updated of target node equipment in a configuration updating request, and generating a current configuration file of the target node equipment according to the updating value of at least one part of configuration items in the configuration file to be updated and the configuration items in the configuration file to be updated, which are contained in the configuration updating request; and sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file. According to the method, the configuration management server is arranged, and the configuration file is updated for the node equipment according to the configuration management request provided by the user, so that an engineer is not required to manually log in the node equipment to change the configuration, or a script is operated on the node equipment to change the configuration, and the configuration updating efficiency is improved.

Description

Configuration updating method, device, server and electronic equipment
Technical Field
The present invention relates to the field of big data processing technologies, and in particular, to a configuration updating method, a device, a server, and an electronic apparatus.
Background
Big data systems generally depend on various big data components to operate, the big data components of which the source is currently open are various, and most big data components are distributed deployment, namely a plurality of node devices operate the big data components at the same time; in the case of distributed deployment, the configuration information of each node device is complex, the node devices may have a part of the general configuration, and each node device may also have some differential configuration; if the configuration of the node devices is required to be updated, the configuration is changed by manually logging in the node devices by an engineer or is changed by adopting a batch operation mode; however, in this manner of batch operation, it is difficult to change the differential configuration of the node device, and an engineer is required to manually operate or run a script on the node device, which results in low efficiency of configuration update.
Disclosure of Invention
In view of the above, the present invention is directed to a configuration updating method, device, server and electronic apparatus, so as to improve the efficiency of configuration updating.
In a first aspect, an embodiment of the present invention provides a configuration update method, where the method is applied to a configuration management server; the configuration management server is connected with a plurality of node devices running with big data components; the configuration management server stores configuration items of each node device in advance; the method comprises the following steps: receiving a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring the configuration file to be updated according to the identification of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated; and sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file.
Further, the plurality of node devices are divided into at least one group of node groups; for each group of the node groups, the configuration management server stores a general configuration item of the group of the node groups; the configuration values of the general configuration items of each node device in the node group are the same; the configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device.
Further, the step of generating the current configuration file of the target node device according to the updated value of the at least one part of configuration items and the configuration items in the configuration file to be updated includes: merging the difference configuration items of the target node equipment and the general configuration items of the node group to which the target node equipment belongs in the configuration file to be updated to obtain the configuration items of the configuration file to be updated of the target node equipment; updating the configuration items in the configuration file to be updated according to the update values of at least a part of the configuration items; and generating a current configuration file of the target node equipment according to the updated configuration items in the configuration file to be updated.
Further, each node group is preset with a configuration template; the configuration template comprises each configuration item of node equipment in the node group; the configuration update request comprises configuration values of all configuration items of the configuration file to be updated; wherein the configuration values of at least a portion of the configuration items are updated values entered by the user; the step of updating the configuration items in the configuration file to be updated according to the update value of the at least one part of configuration items comprises the following steps: filling a configuration value of each configuration item into the configuration item in the configuration template aiming at each configuration item in the configuration updating request; the step of generating the current configuration file of the target node device according to the updated configuration items in the configuration file to be updated includes: and rendering the configuration items in the configuration file to be updated of the target node equipment through the configuration template filled with the configuration values, and generating a current configuration file of the target node equipment in a preset format.
Further, the configuration management server is also pre-stored with a plurality of functions; each of the functions is provided with a function name; the function is used for acquiring preset data; the step of filling the configuration values of the configuration items into the configuration items in the configuration template comprises the following steps: if the configuration value of the configuration item is a preset function name, executing a function corresponding to the function name to acquire the configuration value of the configuration item; and filling the obtained configuration values into the configuration items in the configuration template.
Further, after the step of generating the current configuration file of the target node device, the method includes: updating the configuration items of the target node equipment stored in the configuration management server according to the current configuration file; and generating and storing a configuration operation record corresponding to the configuration update request.
In a second aspect, an embodiment of the present invention provides a configuration updating method, where the method is applied to a node device running a big data component; the node equipment is connected with the configuration management server; the configuration management server stores configuration items of the node equipment in advance; the method comprises the following steps: if a current configuration file sent by the configuration management server is received, acquiring a configuration file to be updated corresponding to the current configuration file stored in the node equipment, and replacing the configuration file to be updated with the current configuration file; the current configuration file is generated by the configuration management server through the following modes: receiving a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring the configuration file to be updated according to the identification of the configuration file to be updated; and generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated.
In a third aspect, an embodiment of the present invention provides a configuration updating apparatus, where the apparatus is disposed in a configuration management server; the configuration management server is connected with a plurality of node devices running with big data components; the configuration management server stores configuration items of each node device in advance; the device comprises: a receiving module, configured to receive a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; the acquisition module is used for acquiring the configuration file to be updated according to the identification of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated; and the first replacing module is used for sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file.
In a fourth aspect, an embodiment of the present invention provides a configuration updating apparatus, where the apparatus is disposed in a node device running a big data component; the node equipment is connected with the configuration management server; the configuration management server stores configuration items of the node equipment in advance; the device comprises: the second replacing module is used for acquiring a configuration file to be updated corresponding to the current configuration file stored in the node equipment and replacing the configuration file to be updated with the current configuration file if the current configuration file sent by the configuration management server is received; the current configuration file is generated by the configuration management server through the following modes: receiving a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring the configuration file to be updated according to the identification of the configuration file to be updated; and generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated.
In a fifth aspect, an embodiment of the present invention provides a server, including a processor and a memory, where the memory stores machine executable instructions executable by the processor, and the processor executes the machine executable instructions to implement the configuration updating method according to any one of the first aspect.
In a sixth aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, where the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the configuration updating method described in the second aspect.
In a seventh aspect, embodiments of the present invention provide a machine-readable storage medium storing machine-executable instructions which, when invoked and executed by a processor, cause the processor to implement the configuration updating method of any one of the first or second aspects.
According to the configuration updating method, the configuration updating device, the server and the electronic equipment, the configuration file to be updated is obtained according to the identification of the configuration file to be updated of the target node equipment in the configuration updating request, and the current configuration file of the target node equipment is generated according to the updating value of at least a part of configuration items in the configuration file to be updated and the configuration items in the configuration file to be updated, which are contained in the configuration updating request; and sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file. According to the method, the configuration management server is arranged, and the configuration file is updated for the node equipment according to the configuration management request provided by the user, so that an engineer is not required to manually log in the node equipment to change the configuration, or a script is operated on the node equipment to change the configuration, and the configuration updating efficiency is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are some embodiments of the invention and that other drawings may be obtained from these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a configuration updating method according to an embodiment of the present invention;
FIG. 2 is a flowchart of another configuration updating method according to an embodiment of the present invention;
FIG. 3 is a flowchart of another configuration updating method according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a configuration management system according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a configuration update according to an embodiment of the present invention;
FIG. 6 is a flowchart of a method for updating and issuing node group configuration according to an embodiment of the present invention;
FIG. 7 is a flowchart of a method for updating and issuing configuration of a single node device according to an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a configuration updating device according to an embodiment of the present invention;
Fig. 9 is a schematic structural diagram of a server or an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
With the development of big data and AI (ARTIFICIAL INTELLIGENCE ) technologies, various industries are increasingly aware of the value of big data technologies for self product services, big data technologies have long been performed by relying on systems and tools contributed by open source communities such as apache, etc., currently there are about 100 or more big data components which are commonly used and at least 30, big data components are various in variety, meanwhile big data components are mostly distributed clusters such as ELASTICSEARCH, HADOOP, etc., many companies build various big data platforms for their own big data component use cases, cloud companies also push EMR (Elastic MapReduce) hosting big data platforms to provide technical services for the outside, such as ali cloud, a system solution for big data processing running on ali cloud platform, KMR (Kingsoft MapReduce) of Jin Shanyun, a scalable general data computing and analyzing platform), KES (Kingsoft cloud ELASTICSEARCH SERVICE, jin Shanyun elastic search service) products, etc.
The big data platform manages different big data components, because the big data components are distributed, the configuration management has complexity compared with single machine deployment, firstly, all node devices can have general configuration, each node device can also have some differentiated configuration, the maintenance and the management of the configuration are very important functions for the big data platform, and the configuration management of the big data components is an important component part of the operation life cycle of the big data components. The big data component configuration management system (module) is also the most important component of the whole big data platform.
For a general self-built big data platform, the platform mainly focuses on the platfonnization of big data components, namely whether a user using the big data components uses the platform to execute own tasks or not is convenient. If configuration updating is required for the node devices, the configuration is changed by manually logging in a machine by an engineer or is changed by batch operations such as scp (secure copy), stable and the like, the main problem of the method is that the differentiated configuration of each node device cannot be solved, the configuration updating efficiency is low, and meanwhile, the whole configuration process is a configuration change record, so that configuration rollback and configuration history inquiry are inconvenient.
In order to solve the problem of differential configuration of each node device, some big data platforms may be implemented by manually executing some complex scripts, if there are 100 node devices, 30 node devices need to be changed into an a configuration, and other 30 node devices need to be changed into a B configuration, so that the whole configuration updating process needs to be implemented by more complex scripts, and the overall efficiency of configuration updating is lower.
Based on the above, the configuration updating method, the device, the server and the electronic equipment provided by the embodiment of the invention can be applied to the scene of the configuration updating of the node equipment running with the big data component, in particular to the scene of the configuration updating of a plurality of node equipment.
For the convenience of understanding the present embodiment, first, a configuration updating method disclosed in the present embodiment is described in detail, and the method is applied to a configuration management server; the configuration management server is connected with a plurality of node devices running with big data components; the configuration management server stores configuration items of each node device in advance; wherein, the big data component can be understood as tools and systems commonly used in the production of Internet big data ecosystems, such as hadoop, hbase or ELASTICSEARH, etc.; the node device can be understood as an electronic device provided with big data components, and the number of the node devices can be multiple; a large data cluster is formed by a plurality of node equipment sets for installing the large data assembly; the above configuration items may be understood as configuration items of each node device that falls into a configuration management category; as shown in fig. 1, the method comprises the steps of:
step S102, receiving a configuration update request for target node equipment; the configuration updating request comprises an identification of a configuration file to be updated of the target node device and an updating value of at least a part of configuration items in the configuration file to be updated.
The target node device may be one or more of a plurality of node devices; the configuration file to be updated can be understood as a configuration file corresponding to a big data component running in the target node device, and the configuration value of at least a part of configuration items in the configuration file needs to be updated; the identification of the configuration file to be updated may include a path or a name of the configuration file to be updated; the updated value of at least a part of the configuration items can be understood as a numerical value of at least a part of the configuration items in the configuration file to be updated after the part of the configuration items are required to be updated; in practical implementation, the configuration management server typically provides a front-end management interface for the outside, through which a user may send a configuration update request for the target node device to the configuration management server, or the user may have a separate user terminal, and the configuration management server may provide an API (Application Programming Interface, application program interface) interface, where the user terminal is communicatively connected to the configuration management server through the API interface, and the user may send the configuration update request for the target node device to the configuration management server through the user terminal and the API interface, where the configuration update request typically includes an identifier such as a path or a name of a configuration file to be updated of the target node device, and an update value of a configuration item to be updated in the configuration file to be updated.
Step S104, obtaining the configuration file to be updated according to the identification of the configuration file to be updated; and generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated.
The current configuration file can be understood as a configuration file after the configuration items to be updated in the configuration file to be updated are updated; in actual implementation, the configuration management server can acquire the corresponding configuration file to be updated according to the path or name and other identifiers of the configuration file to be updated; the configuration management server may also generate an updated current configuration file of the target node device according to the update value of a part of configuration items to be updated in the configuration file to be updated and the configuration items in the pre-stored configuration file to be updated in the received configuration update request.
Step S106, the current configuration file is sent to the target node device, so that the configuration file to be updated in the target node device is replaced by the current configuration file.
In actual implementation, the current configuration file is usually a complete configuration file, after the configuration management server generates the current configuration file of the target node device, the current configuration file is usually sent to the target node device, and the target node device generally does not need to judge or modify the received current configuration file, and can normally use the configuration file to be updated by replacing the configuration file with the current configuration file.
According to the configuration updating method provided by the embodiment of the invention, the configuration file to be updated is obtained according to the identification of the configuration file to be updated of the target node equipment in the configuration updating request, and the current configuration file of the target node equipment is generated according to the updating value of at least a part of configuration items in the configuration file to be updated and the configuration items in the configuration file to be updated, which are contained in the configuration updating request; and sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file. According to the method, the configuration management server is arranged, and the configuration file is updated for the node equipment according to the configuration management request provided by the user, so that an engineer is not required to manually log in the node equipment to change the configuration, or a script is operated on the node equipment to change the configuration, and the configuration updating efficiency is improved.
The embodiment of the invention also provides another configuration updating method which is realized on the basis of the method of the embodiment; the method focuses on the specific process of generating the current configuration file of the target node equipment according to the updated value of at least one part of configuration items and the configuration items in the configuration file to be updated.
In this embodiment, a plurality of node devices are divided into at least one group of node groups; the node group can be understood as a configuration group, and is generally obtained by grouping a plurality of node devices according to the configuration consistency of the node devices, and in actual implementation, in order to reduce the storage space occupied by the configuration items as much as possible and in order to realize rapid configuration update of the plurality of node devices, a node device grouping mode can be adopted, namely, the node devices with basically consistent configuration items and capable of abstracting general configuration items are divided into a node group; for each group of node groups, a general configuration item of the group of node groups is stored in a configuration management server; the configuration values of the general configuration items of each node device in the node group are the same; the general configuration item can be understood as a configuration item with consistent configuration values of all node devices in the same node group; the configuration value can be understood as specific data content corresponding to the configuration item; it is also understood that the common configuration item of each node device in the same node group has the same configuration value.
The configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device; the above-mentioned difference configuration item can be understood as a configuration item in which configuration values of all node devices in the same node group are inconsistent with each other; it may also be understood that in the same node group, the differential configuration item of each node device typically has a different configuration value than the differential configuration items of other node devices except for the node device; for example, a node group includes 100 configuration items, wherein there are 80 general configuration items, i.e., for each node device in the node group, the configuration values of the 80 general configuration items are the same; the other 20 configuration items are difference configuration items corresponding to each node device, and the configuration value of the difference configuration item of each node device is usually different from the configuration values of the difference configuration items of the node devices other than the node device.
Each node group is preset with a configuration template; the configuration template comprises each configuration item of node equipment in the node group, and can be understood as all the configuration items in the corresponding node group; the configuration update request comprises configuration values of all configuration items of the configuration file to be updated; wherein the configuration values of at least a portion of the configuration items are updated values entered by the user; when the user needs to modify the configuration values of a part of the configuration items in the configuration file to be updated, the configuration values of the corresponding configuration items can be modified and updated through a front-end management interface or an API, and the configuration values of all the configuration items of the configuration file to be updated comprise the modified update values in the configuration update request.
The configuration management server also stores a plurality of functions in advance; each function is provided with a function name; the function is used for acquiring preset data; for example, when the function name is node_ip, if labeled ${ }, the meaning of $ { node_ip } can be understood as acquiring the real IP address of the host of the target NODE device.
As shown in fig. 2, the method comprises the steps of:
Step S202, receiving a configuration update request for target node equipment; the configuration updating request comprises an identification of a configuration file to be updated of the target node device and an updating value of at least a part of configuration items in the configuration file to be updated.
The configuration management server may provide REST (Representational state transfer) APIs externally to receive a configuration update request for the target node device, where the configuration update request may generally specify a host name of the target node device to be updated, a name of the node group to be updated, a path or name of the configuration file to be updated, and the like; if the name of the big data component in the target node equipment is OpenSource-6.8.4, the name and the path of the configuration file to be updated are "/root/kibana.yml"; the number of the target node devices may be one or more, and when the number is more than one, the target node devices may belong to the same node group.
Step S204, obtaining the configuration file to be updated according to the identification of the configuration file to be updated.
In actual implementation, a configuration update request input by external operation of a user can be mapped to a mark through an API, the mark can point to a configuration file to be updated of a designated target node device of a designated node group, and the configuration file to be updated can be read from a configuration management database; if the host name of the target node device is specified in the configuration update request, reading a configuration template of a node group to which the target node device belongs, a general configuration item of the node group to which the target node device belongs and a difference configuration item of the target node device from a configuration management database; if the node group name is specified in the configuration update request, then the configuration template for the node group, the generic configuration item for the node group, and the differential configuration item for each target node device in the node group are read from the configuration management database.
Step S206, merging the difference configuration items of the target node equipment and the general configuration items of the node group to which the target node equipment belongs in the configuration file to be updated to obtain the configuration items of the configuration file to be updated of the target node equipment.
In actual implementation, the node group generally only includes a part of common configuration items of node devices in the node group, if the host name of the target node device is specified in the configuration update request, the different configuration items of the target node device, which are not common, and the common configuration items of the node group to which the target node device belongs are combined together to obtain the configuration items of the configuration files to be updated required by the target node device; if the node group name is specified in the configuration update request, the obtained general configuration item of the node group and the difference configuration item of each target node device in the node group can be combined to obtain the configuration item of the corresponding configuration file to be updated of each target node device in the node group. In order to facilitate front-end call, the configuration items of the configuration file to be updated can be in json format language, or in other forms.
Step S208, updating the configuration items in the configuration file to be updated according to the updated values of at least a part of the configuration items.
After obtaining the configuration items of the configuration file to be updated of the target node device, the configuration management server may update the configuration values of the corresponding configuration items in the configuration file to be updated according to the update values of at least a part of the configuration items included in the configuration update request. In actual implementation, this step S208 may include the following step 20:
step 20, for each configuration item in the configuration update request, filling the configuration value of the configuration item into the configuration item in the configuration template.
Because the configuration update request contains the configuration values of all the configuration items of the configuration file to be updated, filling the configuration values of the configuration items into the corresponding configuration templates for each configuration item, wherein the configuration values comprise at least one part of the update values of the configuration items; specifically, the step 20 may be implemented by the following steps one to two:
step one, if the configuration value of the configuration item is a preset function name, executing a function corresponding to the function name to obtain the configuration value of the configuration item.
In actual implementation, the configuration values of the configuration items may at least include two cases, where one is an actual value, for example, the configuration value of the configuration item "server.port" is "5601"; the other is expressed by function names, for example, the function names are marked by ${ }, the function names are stored in ${ }, a plurality of functions are preset by the configuration management server, and the functions can be rendered into the content of the corresponding host according to the host condition of the target node equipment to be issued; if the configuration value of the configuration item 'server.host' is $ { NODE_IP }, the NODE_IP is rendered into the real IP of the host of the target NODE equipment by executing the corresponding function, so that the configuration value '10.100.100.1' of the configuration item 'server.host' is obtained, and the rendering of the differential configuration of the target NODE equipment is realized.
And step two, filling the obtained configuration values into the configuration items in the configuration template.
If the configuration value of the configuration item is an actual value, filling the actual value into the corresponding configuration item in the configuration template; if the configuration value of the configuration item is a preset function name, filling the configuration value of the corresponding configuration item obtained by executing the function corresponding to the function name into the configuration item in the configuration template; if the configuration value '5601' is filled into a 'server' port 'configuration item in the configuration template, the configuration value' 10.100.100.1 'acquired by executing a function corresponding to $ { NODE_IP } is filled into a' server 'host' configuration item in the configuration template; filling the configuration value default into a server.name configuration item in a configuration template; filling the configuration value 'http:// localhost: 9200' into an 'elastiscsearch. Hosts' configuration item in the configuration template; the configuration value "zh-CN" is filled into an "i18n.locale" configuration item in the configuration template, etc.
Step S210, generating a current configuration file of the target node equipment according to the configuration items in the updated configuration file to be updated.
In actual implementation, this step S210 may be implemented by: and rendering the configuration items in the configuration file to be updated of the target node equipment through a configuration template filled with the configuration values, and generating a current configuration file of the target node equipment in a preset format.
The preset format can comprise a plurality of different formats, such as a text format, a yml file format and the like, and can be set according to requirements; rendering the configuration items in the configuration file to be updated of the target node equipment through the configuration template filled with the configuration values, enabling the configuration items in the configuration file to be updated into the configuration values filled in the configuration template, and generating the current configuration file of the target node equipment according to a preset format. When the big data component in each target node device runs, the corresponding current configuration files need to be read, the content of each current configuration file is usually different, and the formats are different.
Step S212, the current configuration file is sent to the target node device, so that the configuration file to be updated in the target node device is replaced by the current configuration file.
The method mainly describes a specific process of generating a current configuration file of target node equipment according to an update value of at least a part of configuration items and the configuration items in the configuration file to be updated, obtains the configuration file to be updated according to the identification of the configuration file to be updated of the target node equipment in the configuration update request, and combines the difference configuration items of the target node equipment and the general configuration items of the node group to which the target node equipment belongs in the configuration file to be updated to obtain the configuration items of the configuration file to be updated of the target node equipment; updating the configuration items in the configuration file to be updated according to the update values of at least a part of the configuration items; and generating a current configuration file of the target node equipment according to the updated configuration items in the configuration file to be updated. And sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file. According to the method, the configuration management server is arranged, and the configuration file is updated for the node equipment according to the configuration management request provided by the user, so that an engineer is not required to manually log in the node equipment to change the configuration, or a script is operated on the node equipment to change the configuration, and the configuration updating efficiency is improved.
In addition, the configuration items of the big data component are basically and consistently divided into node groups, the configuration items with the same configuration values are used as general configuration items for each node device in the node groups, the configuration values of only a few different configuration items of the node devices in the node groups are inconsistent, if the configuration values of the general configuration items are required to be configured, the configuration values of the general configuration items of all the node devices in the node groups can be modified at one time, the operation is convenient, meanwhile, the situation of the different configuration items of single node devices is considered, the whole configuration is rendered into an updated current configuration file through a configuration template, the updated current configuration file is integrally issued to the corresponding node devices to complete the replacement of the configuration file to be updated, and whether one configuration item is replaced or not is not needed to be judged for the single node device of the whole big data cluster.
Moreover, considering that big data components are deployed on each node device and are very dependent on the resources of the node device, in the method, all configuration updating operations are intensively completed through the configuration management server, the operation amount of the node device is small, redundant logic is reduced, the operation is simple, and the node device is lightweight, so that the resources of the node device are not consumed in the configuration updating process, and the pressure of the node device is relieved.
The embodiment of the invention also provides another configuration updating method which is realized on the basis of the method of the embodiment; as shown in fig. 3, the method comprises the steps of:
Step S302, receiving a configuration update request for target node equipment; the configuration update request comprises an identification of a configuration file to be updated of the target node device and an update value of at least a part of configuration items in the configuration file to be updated.
Step S304, obtaining a configuration file to be updated according to the identification of the configuration file to be updated; and generating a current configuration file of the target node equipment according to the updated value of at least a part of the configuration items and the configuration items in the configuration file to be updated.
Step S306, updating the configuration items of the target node equipment stored in the configuration management server according to the current configuration file.
And updating the configuration items of the target node equipment stored in a configuration storage database in the configuration management server according to the generated current configuration file of the target node equipment so as to enable the configuration values of the configuration items of the target node equipment stored in the configuration management server to be the current latest configuration values.
Step S308, a configuration operation record corresponding to the configuration update request is generated and stored.
The configuration operation record may be understood as key operations recorded in the process of executing the configuration update after receiving the configuration update request, such as a hostname, a node group name, an updated configuration item, and a corresponding update value of the updated target node device. After the configuration management server updates the stored configuration items of the target node device, a configuration operation record corresponding to the configuration update request is generated and stored in the configuration management server so as to facilitate configuration rollback and configuration history information query.
Step S310, the current configuration file is sent to the target node device, so that the configuration file to be updated in the target node device is replaced by the current configuration file.
According to the method for updating the configuration of the target node equipment, the configuration file to be updated is obtained according to the identification of the configuration file to be updated of the target node equipment in the configuration updating request, the current configuration file of the target node equipment is generated according to the update value of at least a part of configuration items and the configuration items in the configuration file to be updated, the configuration items of the target node equipment stored in the configuration management server are updated according to the current configuration file, and the configuration operation record corresponding to the configuration updating request is generated and stored. And sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file. According to the method, the configuration management server is arranged, and the configuration file is updated for the node equipment according to the configuration management request provided by the user, so that an engineer is not required to manually log in the node equipment to change the configuration, or a script is operated on the node equipment to change the configuration, and the configuration updating efficiency is improved.
The embodiment of the invention also provides another configuration updating method which is applied to the node equipment running the big data component; the node equipment is connected with the configuration management server; the configuration management server is pre-stored with configuration items of node equipment; the method comprises the following steps:
Step 402, if a current configuration file sent from the configuration management server is received, a configuration file to be updated corresponding to the current configuration file stored in the node device is obtained, and the configuration file to be updated is replaced by the current configuration file.
The current configuration file is generated by the configuration management server through the following modes: receiving a configuration update request for a target node device; the configuration updating request comprises an identifier of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring a configuration file to be updated according to the identification of the configuration file to be updated; and generating a current configuration file of the target node equipment according to the updated value of at least a part of the configuration items and the configuration items in the configuration file to be updated.
In another configuration updating method provided by the embodiment of the invention, if the current configuration file sent by the configuration management server is received, the configuration file to be updated corresponding to the current configuration file stored in the node equipment is obtained, and the configuration file to be updated is replaced by the current configuration file. According to the method, the configuration management server is arranged, and the configuration file is updated for the node equipment according to the configuration management request provided by the user, so that an engineer is not required to manually log in the node equipment to change the configuration, or a script is operated on the node equipment to change the configuration, and the configuration updating efficiency is improved.
To further understand the above embodiments, a schematic architecture of a configuration management system is provided below, as shown in fig. 4, where the configuration management system includes a configuration management server, a configuration storage database, and a plurality of node devices running large data components, and a configuration client is deployed in each node device at the same time; the configuration management server is in communication connection with the configuration clients of the plurality of node devices by using RPC; the configuration management server corresponds to a plurality of configuration clients; the configuration client is equivalent to a software function, is an independent function and is used for issuing updated current configuration files. In the related art, the configuration is changed mainly by an engineer manually logging in the node device or by running scripts on the node device, and the software function of the configuration client is not included.
In the illustration, 6 NODE devices are illustrated as node_0, node_1, node_2, node_3, node_4 and node_5, respectively, and the 6 NODE devices are divided into two NODE groups, namely NODE group 01 consisting of node_0, node_1, node_2 and node_3, and NODE group 02 consisting of node_4 and node_5; the configuration management server is configured to receive a configuration update request for a target NODE device, where the number of target NODE devices may be one, such as node_0; or a plurality of node devices, when the number of the target node devices is a plurality of, configuration updating may need to be performed on a plurality of node devices in the node group, for example, two node devices in the node group 02; the configuration update request generally comprises an identifier of a configuration file to be updated of the target node device and an update value of at least a part of configuration items in the configuration file to be updated; the configuration management server generates a current configuration file of the target node equipment by analyzing the configuration update request; the configuration management server sends the generated current configuration file to the corresponding target node equipment, the current configuration file can be received through a configuration client in the target node equipment, and the target node equipment replaces the corresponding configuration file to be updated with the current configuration file. The configuration management server is further configured to, upon receiving configuration update information in a configuration update request input by an external operation, send the configuration update information to a configuration storage database, such as data input by a user through a front-end interface or an API.
The following further provides a logic schematic diagram of configuration update, as shown in fig. 5, the configuration management server may receive a configuration update request for the target node device through a REST API provided externally, where the configuration update request generally designates a node device host name or a node group name, and identifiers such as a to-be-updated configuration file path and a to-be-updated configuration file name; then according to the configuration updating request, the configuration file to be updated is obtained by interacting with a configuration storage database, wherein the configuration file comprises a configuration template and a configuration item corresponding to the configuration updating request, if the host name of the target node equipment designated in the configuration updating request is the configuration template of the node group to which the target node equipment belongs, the general configuration item of the node group to which the target node equipment belongs and the differential configuration item of the target node equipment are read from the configuration storage database; if the node group name is specified in the configuration update request, reading a configuration template of the node group from a configuration storage database, a general configuration item of the node group, and a differential configuration item of each target node device in the node group; according to the update value of at least one part of configuration items in the configuration file to be updated contained in the configuration update request, modifying the configuration value of the part of configuration items, and then rendering the configuration template and generating the configuration file according to the read configuration template and configuration items.
Rendering the configuration items in the configuration file to be updated of the target node equipment through a configuration template filled with the configuration values, and generating an updated configuration file of the target node equipment; and finally, the generated updated configuration file is configured and issued, an RPC (Remote Procedure Call ) data packet can be generated by the updated configuration file, the RPC data packet is sent to the node group to be changed or target node equipment, if the RPC data packet is issued to the node group, the issuing is equivalent to each node equipment in the node group, and the node group has no physical concept, only some node equipment is divided into a group, some general configuration items exist in the node equipment, and the final change still falls on each node equipment in the node group. And the target node equipment receives the RPC data packet through the configuration client and covers the corresponding configuration file to be updated.
Specifically, if the node group name is specified in the configuration update request, the configuration file of the node device in the node group may be updated by referring to a method for updating and issuing the node group configuration as shown in fig. 6, which is as follows: the user modifies the node group configuration complete set json (corresponding to updating at least a part of configuration items in the general configuration items of the node group by the user), searches n node special configuration json (corresponding to searching the difference configuration items of all n node devices in the node group) of all nodes of the node group, each node special configuration json merge node group configuration (corresponding to combining the difference configuration items of each node device in the node group with the general configuration items of the node group), searches a template corresponding to the configuration (corresponding to searching the configuration template corresponding to the node group), renders n configuration files (corresponding to updated current configuration files of n node devices in the node group) through the configuration template, issues n node coverage configuration files (corresponding to issuing the updated current configuration files of n node devices in the node group to corresponding node devices in the form of RPC data packets), generates and stores corresponding configuration operation records, and returns successful user configuration modification information to a front-end interface of user operation. The configuration of all node devices within a node group can be quickly modified by modifying the node group configuration.
If the node device hostname is specified in the configuration update request, the configuration file of the single node device may be updated by referring to a method for updating and issuing the configuration file of the single node device as shown in fig. 7, where the procedure is as follows: the method comprises the steps of modifying a node configuration complete set json by a user (which is equivalent to updating at least part of configuration items of node equipment by the user), searching the node group configuration json where the node equipment belongs (which is equivalent to searching the general configuration items of the node group to which the node equipment belongs), node special configuration json merge node group configuration (which is equivalent to combining the difference configuration items of the node equipment with the general configuration items of the node group to which the node equipment belongs), searching a template corresponding to the configuration (which is equivalent to searching the configuration template corresponding to the node group to which the node equipment belongs), rendering a configuration file (which is equivalent to the updated current configuration file of the node equipment) through the configuration template, issuing the configuration file to a node overlay configuration file through RPC (which is equivalent to issuing the updated current configuration file of the node equipment to the node equipment in the form of RPC data packets and replacing the corresponding configuration file to be updated), generating and storing a corresponding configuration operation record, and returning information of successful user configuration modification to a front-end interface operated by the user. When a single node device is modified in this way, other node devices in the node group to which the node device belongs are not affected.
By the lightweight configuration management system capable of being pushed in real time and the configuration updating method, the configuration management problem of big data components is solved, and a single node device configuration differentiated issuing function is realized through configuration template management and rendering.
Corresponding to the method embodiment, the embodiment of the invention provides a structural schematic diagram of a configuration updating device, and the device is arranged on a configuration management server; the configuration management server is connected with a plurality of node devices running with big data components; the configuration management server stores configuration items of each node device in advance; as shown in fig. 8, the apparatus includes: a receiving module 80, configured to receive a configuration update request for a target node device; the configuration updating request comprises an identifier of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; the obtaining module 81 is configured to obtain a configuration file to be updated according to the identifier of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least a part of the configuration items and the configuration items in the configuration file to be updated; the first replacing module 82 is configured to send the current configuration file to the target node device, so as to replace the configuration file to be updated in the target node device with the current configuration file.
According to the configuration updating device provided by the embodiment of the invention, the configuration file to be updated is obtained according to the identification of the configuration file to be updated of the target node equipment in the configuration updating request, and the current configuration file of the target node equipment is generated according to the update value of at least a part of configuration items in the configuration file to be updated and the configuration items in the configuration file to be updated, which are contained in the configuration updating request; and sending the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file. The device is provided with the configuration management server, and the configuration file is updated for the node equipment according to the configuration management request provided by the user through the configuration management server.
Further, the plurality of node devices are divided into at least one group of node groups; for each group of node groups, a general configuration item of the group of node groups is stored in a configuration management server; the configuration values of the general configuration items of each node device in the node group are the same; the configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device.
Further, the obtaining module 81 is further configured to: merging the difference configuration items of the target node equipment and the general configuration items of the node group to which the target node equipment belongs in the configuration file to be updated to obtain the configuration items of the configuration file to be updated of the target node equipment; updating the configuration items in the configuration file to be updated according to the updated values of at least a part of the configuration items; and generating a current configuration file of the target node equipment according to the configuration items in the updated configuration file to be updated.
Further, each node group is preset with a configuration template; the configuration template comprises each configuration item of the nodes in the node group; the configuration update request comprises configuration values of all configuration items of the configuration file to be updated; wherein the configuration values of at least a portion of the configuration items are updated values entered by the user; the acquisition module 81 is further configured to: filling the configuration values of the configuration items into the configuration items in the configuration template aiming at each configuration item in the configuration updating request; and rendering the configuration items in the configuration file to be updated of the target node equipment through a configuration template filled with the configuration values, and generating a current configuration file of the target node equipment in a preset format.
Further, a plurality of functions are stored in the configuration management server in advance; each function is provided with a function name; the function is used for acquiring preset data; the acquisition module 81 is further configured to: if the configuration value of the configuration item is a preset function name, executing a function corresponding to the function name to acquire the configuration value of the configuration item; and filling the obtained configuration values into the configuration items in the configuration template.
Further, the device is also used for: updating the configuration items of the target node equipment stored in the configuration management server according to the current configuration file; and generating and storing a configuration operation record corresponding to the configuration update request.
The configuration updating device provided by the embodiment of the present invention has the same implementation principle and technical effects as those of the foregoing method embodiment, and for brevity description, reference may be made to corresponding contents in the foregoing method embodiment where the embodiment of the configuration updating device is not mentioned.
The embodiment of the invention also provides a structural schematic diagram of another configuration updating device, wherein the device is arranged on node equipment running with a big data component; the node equipment is connected with the configuration management server; the configuration management server is pre-stored with configuration items of node equipment; the device comprises: the second replacing module is used for acquiring a configuration file to be updated corresponding to the current configuration file stored in the node equipment if the current configuration file sent by the configuration management server is received, and replacing the configuration file to be updated with the current configuration file; the current configuration file is generated by the configuration management server through the following modes: receiving a configuration update request for a target node device; the configuration updating request comprises an identifier of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring a configuration file to be updated according to the identification of the configuration file to be updated; and generating a current configuration file of the target node equipment according to the updated value of at least a part of the configuration items and the configuration items in the configuration file to be updated.
In the another configuration updating device provided by the embodiment of the invention, if the current configuration file sent by the configuration management server is received, the configuration file to be updated corresponding to the current configuration file stored in the node equipment is obtained, and the configuration file to be updated is replaced by the current configuration file. The device is provided with the configuration management server, and the configuration file is updated for the node equipment according to the configuration management request provided by the user through the configuration management server.
The embodiment of the invention also provides a server or electronic equipment for running the configuration updating method; referring to fig. 9, a processor 101 and a memory 100 are included, the memory 100 storing machine executable instructions that can be executed by the processor 101, the processor 101 executing the machine executable instructions to implement the configuration updating method shown in the above-described embodiment.
Further, the server or the electronic device shown in fig. 9 further includes a bus 102 and a communication interface 103, and the processor 101, the communication interface 103, and the memory 100 are connected through the bus 102.
The memory 100 may include a high-speed random access memory (RAM, random Access Memory), and may further include a non-volatile memory (non-volatile memory), such as at least one disk memory. The communication connection between the system network element and at least one other network element is implemented via at least one communication interface 103 (which may be wired or wireless), and may use the internet, a wide area network, a local network, a metropolitan area network, etc. Bus 102 may be an ISA bus, a PCI bus, an EISA bus, or the like. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in fig. 9, but not only one bus or one type of bus.
The processor 101 may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in the processor 101 or instructions in the form of software. The processor 101 may be a general-purpose processor, including a central processing unit (Central Processing Unit, abbreviated as CPU), a network processor (Network Processor, abbreviated as NP), and the like; but may also be a digital signal processor (DIGITAL SIGNAL Processing, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), off-the-shelf Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be embodied directly in the execution of a hardware decoding processor, or in the execution of a combination of hardware and software modules in a decoding processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in the memory 100 and the processor 101 reads information in the memory 100 and in combination with its hardware performs the steps of the method of the previous embodiments.
The embodiment of the invention also provides a machine-readable storage medium, which stores machine-executable instructions that, when being called and executed by a processor, cause the processor to implement the configuration updating method, and the specific implementation can be referred to the method embodiment and will not be described herein.
The configuration updating method, device, server and computer program product of electronic device provided in the embodiments of the present invention include a computer readable storage medium storing program codes, where the instructions included in the program codes may be used to execute the method described in the foregoing method embodiment, and specific implementation may refer to the method embodiment and will not be repeated herein.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a read-only memory (ROM), a random access memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Finally, it should be noted that: the above examples are only specific embodiments of the present invention for illustrating the technical solution of the present invention, but not for limiting the scope of the present invention, and although the present invention has been described in detail with reference to the foregoing examples, it will be understood by those skilled in the art that the present invention is not limited thereto: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.

Claims (11)

1. A configuration updating method, wherein the method is applied to a configuration management server; the configuration management server is connected with a plurality of node devices running with big data components; the configuration management server stores configuration items of each node device in advance; the method comprises the following steps:
Receiving a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated;
acquiring the configuration file to be updated according to the identification of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated;
Transmitting the current configuration file to the target node equipment so as to replace the configuration file to be updated in the target node equipment with the current configuration file;
dividing a plurality of node devices into at least one group of node groups;
for each group of the node groups, the configuration management server stores a general configuration item of the group of the node groups; the configuration values of the general configuration items of each node device in the node group are the same;
the configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device;
a configuration client is deployed in each node device; the configuration management server is in communication connection with the configuration clients of the plurality of node devices by using RPC;
the configuration update request includes: the host name of the target node equipment to be updated and the name of the node group to be updated;
If the host name of the target node device is specified in the configuration update request, reading a configuration template of a node group to which the target node device belongs, a general configuration item of the node group to which the target node device belongs and a differential configuration item of the target node device from a configuration management database; if the node group name is specified in the configuration update request, then the configuration template for the node group, the generic configuration item for the node group, and the differential configuration item for each target node device in the node group are read from the configuration management database.
2. The method according to claim 1, wherein the step of generating the current configuration file of the target node device based on the updated values of the at least a portion of the configuration items and the configuration items in the configuration file to be updated comprises:
Merging the difference configuration items of the target node equipment and the general configuration items of the node group to which the target node equipment belongs in the configuration file to be updated to obtain the configuration items of the configuration file to be updated of the target node equipment;
Updating the configuration items in the configuration file to be updated according to the update values of at least a part of the configuration items;
And generating a current configuration file of the target node equipment according to the updated configuration items in the configuration file to be updated.
3. The method of claim 2, wherein each of the node groups is pre-configured with a configuration template; the configuration template comprises each configuration item of node equipment in the node group; the configuration update request comprises configuration values of all configuration items of the configuration file to be updated; wherein the configuration values of at least a portion of the configuration items are updated values entered by the user;
the step of updating the configuration items in the configuration file to be updated according to the update value of the at least one part of configuration items comprises the following steps: filling a configuration value of each configuration item into the configuration item in the configuration template aiming at each configuration item in the configuration updating request;
the step of generating the current configuration file of the target node device according to the updated configuration items in the configuration file to be updated includes:
And rendering the configuration items in the configuration file to be updated of the target node equipment through the configuration template filled with the configuration values, and generating a current configuration file of the target node equipment in a preset format.
4. A method according to claim 3, wherein the configuration management server has a plurality of functions stored in advance; each of the functions is provided with a function name; the function is used for acquiring preset data;
the step of filling the configuration values of the configuration items into the configuration items in the configuration template comprises the following steps:
If the configuration value of the configuration item is a preset function name, executing a function corresponding to the function name to acquire the configuration value of the configuration item;
And filling the obtained configuration values into the configuration items in the configuration template.
5. The method of claim 1, wherein after the step of generating the current profile of the target node device, the method comprises:
Updating the configuration items of the target node equipment stored in the configuration management server according to the current configuration file;
and generating and storing a configuration operation record corresponding to the configuration update request.
6. A configuration updating method, characterized in that the method is applied to a node device running big data components; the node equipment is connected with the configuration management server; the configuration management server stores configuration items of the node equipment in advance; the method comprises the following steps:
If a current configuration file sent by the configuration management server is received, acquiring a configuration file to be updated corresponding to the current configuration file stored in the node equipment, and replacing the configuration file to be updated with the current configuration file;
The current configuration file is generated by the configuration management server through the following modes: receiving a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring the configuration file to be updated according to the identification of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated; dividing a plurality of node devices into at least one group of node groups; for each group of the node groups, the configuration management server stores a general configuration item of the group of the node groups; the configuration values of the general configuration items of each node device in the node group are the same; the configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device; a configuration client is deployed in each node device; the configuration management server is in communication connection with the configuration clients of the plurality of node devices by using RPC; the configuration update request includes: the host name of the target node equipment to be updated and the name of the node group to be updated;
If the host name of the target node device is specified in the configuration update request, reading a configuration template of a node group to which the target node device belongs, a general configuration item of the node group to which the target node device belongs and a differential configuration item of the target node device from a configuration management database; if the node group name is specified in the configuration update request, then the configuration template for the node group, the generic configuration item for the node group, and the differential configuration item for each target node device in the node group are read from the configuration management database.
7. A configuration updating device, characterized in that the device is arranged at a configuration management server; the configuration management server is connected with a plurality of node devices running with big data components; the configuration management server stores configuration items of each node device in advance; the device comprises:
a receiving module, configured to receive a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated;
The acquisition module is used for acquiring the configuration file to be updated according to the identification of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated;
a first replacing module, configured to send the current configuration file to the target node device, so as to replace the configuration file to be updated in the target node device with the current configuration file;
dividing a plurality of node devices into at least one group of node groups;
for each group of the node groups, the configuration management server stores a general configuration item of the group of the node groups; the configuration values of the general configuration items of each node device in the node group are the same;
the configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device;
a configuration client is deployed in each node device; the configuration management server is in communication connection with the configuration clients of the plurality of node devices by using RPC;
the configuration update request includes: the host name of the target node equipment to be updated and the name of the node group to be updated;
If the host name of the target node device is specified in the configuration update request, reading a configuration template of a node group to which the target node device belongs, a general configuration item of the node group to which the target node device belongs and a differential configuration item of the target node device from a configuration management database; if the node group name is specified in the configuration update request, then the configuration template for the node group, the generic configuration item for the node group, and the differential configuration item for each target node device in the node group are read from the configuration management database.
8. A configuration updating apparatus, wherein the apparatus is provided to a node device running a big data component; the node equipment is connected with the configuration management server; the configuration management server stores configuration items of the node equipment in advance; the device comprises:
The second replacing module is used for acquiring a configuration file to be updated corresponding to the current configuration file stored in the node equipment and replacing the configuration file to be updated with the current configuration file if the current configuration file sent by the configuration management server is received;
The current configuration file is generated by the configuration management server through the following modes: receiving a configuration update request for a target node device; the configuration updating request comprises an identification of a configuration file to be updated of the target node equipment and an updating value of at least a part of configuration items in the configuration file to be updated; acquiring the configuration file to be updated according to the identification of the configuration file to be updated; generating a current configuration file of the target node equipment according to the updated value of at least one part of the configuration items and the configuration items in the configuration file to be updated; dividing a plurality of node devices into at least one group of node groups; for each group of the node groups, the configuration management server stores a general configuration item of the group of the node groups; the configuration values of the general configuration items of each node device in the node group are the same; the configuration management server also stores a difference configuration item corresponding to each node device in the node group; for each node device in the node group, the configuration value of the differential configuration item of the node device is different from the configuration value of the differential configuration item of the node devices other than the node device; a configuration client is deployed in each node device; the configuration management server is in communication connection with the configuration clients of the plurality of node devices by using RPC; the configuration update request includes: the host name of the target node equipment to be updated and the name of the node group to be updated;
If the host name of the target node device is specified in the configuration update request, reading a configuration template of a node group to which the target node device belongs, a general configuration item of the node group to which the target node device belongs and a differential configuration item of the target node device from a configuration management database; if the node group name is specified in the configuration update request, then the configuration template for the node group, the generic configuration item for the node group, and the differential configuration item for each target node device in the node group are read from the configuration management database.
9. A server comprising a processor and a memory, the memory storing machine executable instructions executable by the processor, the processor executing the machine executable instructions to implement the configuration updating method of any of claims 1 to 5.
10. An electronic device comprising a processor and a memory, the memory storing machine-executable instructions executable by the processor, the processor executing the machine-executable instructions to implement the configuration updating method of claim 6.
11. A machine-readable storage medium storing machine-executable instructions which, when invoked and executed by a processor, cause the processor to implement the configuration updating method of any one of claims 1 to 6.
CN202010370245.9A 2020-04-30 2020-04-30 Configuration updating method, device, server and electronic equipment Active CN111580884B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010370245.9A CN111580884B (en) 2020-04-30 2020-04-30 Configuration updating method, device, server and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010370245.9A CN111580884B (en) 2020-04-30 2020-04-30 Configuration updating method, device, server and electronic equipment

Publications (2)

Publication Number Publication Date
CN111580884A CN111580884A (en) 2020-08-25
CN111580884B true CN111580884B (en) 2024-04-19

Family

ID=72126231

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010370245.9A Active CN111580884B (en) 2020-04-30 2020-04-30 Configuration updating method, device, server and electronic equipment

Country Status (1)

Country Link
CN (1) CN111580884B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112416456A (en) * 2020-11-18 2021-02-26 中国建设银行股份有限公司 Configuration file processing method, device, equipment, storage medium and system
CN112099879B (en) * 2020-11-23 2021-03-12 成都新希望金融信息有限公司 Configuration information management method and device, computer equipment and storage medium
CN114650224B (en) * 2020-12-21 2023-06-30 北京金山云网络技术有限公司 Configuration method, device, electronic equipment and system of node function
CN112765188B (en) * 2020-12-31 2023-09-08 北京奇艺世纪科技有限公司 Configuration information processing method, configuration management system, electronic device and storage medium
CN112732357B (en) * 2021-01-12 2022-07-15 中国科学技术大学 CPU over-partition rate configuration method and device
CN112949272A (en) * 2021-02-26 2021-06-11 中国联合网络通信集团有限公司 Design file generation method and device
CN115499487B (en) * 2022-09-14 2024-04-02 平安壹钱包电子商务有限公司 Updating method and device of server configuration file, storage medium and equipment
CN115632944B (en) * 2022-12-21 2023-03-14 苏州浪潮智能科技有限公司 Node configuration method, device, equipment, readable storage medium and server
CN116450622B (en) * 2023-06-16 2023-09-22 建信金融科技有限责任公司 Method, apparatus, device and computer readable medium for data warehouse entry
CN117574869A (en) * 2023-10-19 2024-02-20 镁佳(北京)科技有限公司 Method, device, equipment and medium for automatically generating diagnostic application data packet

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105897942A (en) * 2015-09-17 2016-08-24 乐视云计算有限公司 Domain name resolution system and domain name resolution method
CN108933681A (en) * 2017-05-22 2018-12-04 贵州白山云科技有限公司 A kind of cloud computing system configuration update method, control centre and cloud computing node
CN109062633A (en) * 2018-07-31 2018-12-21 郑州合撷亨商贸有限公司 A method of realizing multistage wireless asynchronous refresh configurator
CN109597655A (en) * 2017-09-28 2019-04-09 华为技术有限公司 Configure the method and device of application program
WO2019071858A1 (en) * 2017-10-09 2019-04-18 武汉斗鱼网络科技有限公司 File update method, apparatus, and device
CN109901912A (en) * 2019-03-01 2019-06-18 厦门容能科技有限公司 A method of recommending the configuration of cloud host
CN110086640A (en) * 2018-01-26 2019-08-02 华为技术有限公司 The enabled method and apparatus of business
CN110244987A (en) * 2019-06-18 2019-09-17 腾讯科技(深圳)有限公司 Configuration data processing method, device, readable storage medium storing program for executing and computer equipment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9871699B2 (en) * 2015-07-30 2018-01-16 Adtran Inc. Telecommunications node configuration management
US9992305B2 (en) * 2015-08-07 2018-06-05 Hewlett Packard Enterprise Development Lp Cloud models based on network definition data

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105897942A (en) * 2015-09-17 2016-08-24 乐视云计算有限公司 Domain name resolution system and domain name resolution method
CN108933681A (en) * 2017-05-22 2018-12-04 贵州白山云科技有限公司 A kind of cloud computing system configuration update method, control centre and cloud computing node
CN109597655A (en) * 2017-09-28 2019-04-09 华为技术有限公司 Configure the method and device of application program
WO2019071858A1 (en) * 2017-10-09 2019-04-18 武汉斗鱼网络科技有限公司 File update method, apparatus, and device
CN110086640A (en) * 2018-01-26 2019-08-02 华为技术有限公司 The enabled method and apparatus of business
CN109062633A (en) * 2018-07-31 2018-12-21 郑州合撷亨商贸有限公司 A method of realizing multistage wireless asynchronous refresh configurator
CN109901912A (en) * 2019-03-01 2019-06-18 厦门容能科技有限公司 A method of recommending the configuration of cloud host
CN110244987A (en) * 2019-06-18 2019-09-17 腾讯科技(深圳)有限公司 Configuration data processing method, device, readable storage medium storing program for executing and computer equipment

Also Published As

Publication number Publication date
CN111580884A (en) 2020-08-25

Similar Documents

Publication Publication Date Title
CN111580884B (en) Configuration updating method, device, server and electronic equipment
US9020949B2 (en) Method and system for centralized issue tracking
US11042427B2 (en) Automated consolidation of API specifications
CN111061678B (en) Service data processing method, device, computer equipment and storage medium
CN111736775A (en) Multi-source storage method, device, computer system and storage medium
CN110888842A (en) File storage method, file query method, file storage device, file query device and file query equipment
CN111182089A (en) Container cluster system, method and device for accessing big data assembly and server
CN110727417B (en) Data processing method and device
CN111064626B (en) Configuration updating method, device, server and readable storage medium
CN110737425B (en) Method and device for establishing application program of charging platform system
CN113568925B (en) Message data conversion method and device, electronic equipment and storage medium
CN109992279A (en) Method for updating configuration data, calculates equipment and storage medium at device
CN112988409A (en) Interface calling method and device, computer equipment and storage medium
CN116931910A (en) Development method and device based on protocol framework, electronic equipment and storage medium
CN111651417B (en) Log processing method and device
CN113572630A (en) Method and device for generating network configuration information, electronic equipment and medium
CN111324645B (en) Block chain data processing method and device
CN116627751A (en) Service log acquisition method and device and electronic equipment
CN112862245B (en) Data exchange method and device and electronic equipment
CN113934767A (en) Data processing method and device, computer equipment and storage medium
CN109117152B (en) Service generation system and method
CN106993036B (en) Running environment information processing method and switch
US11017032B1 (en) Document recovery utilizing serialized data
CN111158654A (en) Algorithm calling method, device, server and storage medium
KR20210000041A (en) Method and apparatus for analyzing log data in real time

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant