CN110493326B - Zookeeper-based cluster configuration file management system and method - Google Patents
Zookeeper-based cluster configuration file management system and method Download PDFInfo
- Publication number
- CN110493326B CN110493326B CN201910710820.2A CN201910710820A CN110493326B CN 110493326 B CN110493326 B CN 110493326B CN 201910710820 A CN201910710820 A CN 201910710820A CN 110493326 B CN110493326 B CN 110493326B
- Authority
- CN
- China
- Prior art keywords
- zookeeper
- module
- big data
- data
- assembly
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Abstract
The application discloses a zookeeper-based cluster configuration file management system and method, wherein the system comprises the following steps: the system comprises a client, a modification module, a big data component, a monitoring module and a zookeeper module; the client sends a first request for modifying the big data component; the modification module receives a second request for sending a modification big data set by the first request; the modification module sends a second request to the big data assembly, and the program is automatically started after the big data assembly is modified; the big data component receives a second request; the monitoring module monitors the change of the big data assembly in real time and informs the client of the change information of the big data assembly; the zookeeper module receives and stores the change information data sent by the monitoring module to generate corresponding configuration information data; and after receiving the change information sent by the monitoring module, the client reads the configuration information data in the zookeeper module. According to the method and the device, all configuration files of any component can be modified by directly accessing the data interface of the modification module, so that the method and the device are convenient and quick, and the configuration modification time is shortened.
Description
Technical Field
The application relates to the technical field of data processing, in particular to a zookeeper-based cluster configuration file management system and method.
Background
With the development of science and technology and the progress of technology, the data volume is more and more huge, and the data volume is obviously impractical to store in the traditional relational database because not only the problem of disk bottleneck, but also a series of performance problems such as query calculation and the like, the configuration is generated by following the trend of times, such as a server where a Hadoop distributed file system (Hdfs) or an open-source non-relational distributed database (Hbase) is located.
Each component is distributed, at least n configuration files are arranged in n machines, at least m × n configuration files are arranged in m components, one configuration file is very complicated to modify and prone to errors, developers are troublesome, the files need to be copied into a program to be packaged each time, once one configuration is modified, the files need to be copied into the program again to be packaged, and the process is complicated.
Disclosure of Invention
The application discloses a zookeeper-based cluster configuration file management system includes: the system comprises a client, a modification module, a big data component, a monitoring module and a zookeeper module;
the client is coupled with the modification module and used for sending a first request for modifying the big data component;
the modification module is respectively coupled with the client and the big data assembly and used for receiving the first request and sending a second request for modifying the big data assembly to the big data assembly; the modification module comprises a data interface and is used for simultaneously sending a second request to the big data assembly, and the program is automatically started after modification is finished;
the big data assembly comprises a plurality of configuration files, and is respectively coupled with the monitoring module and the modification module and used for receiving the second request;
the monitoring module is respectively coupled with the big data assembly, the zookeeper module and the client, and is used for monitoring the change of the big data assembly in real time, sending the change information data of the big data assembly to the zookeeper module and simultaneously informing the client of the change information of the big data assembly;
the zookeeper module is respectively coupled with the monitoring module and the client and used for receiving and storing the change information data sent by the monitoring module and generating corresponding configuration information data;
the client is further coupled to the monitoring module and the zookeeper module respectively, and is configured to read the configuration information data in the zookeeper module after receiving the change information sent by the monitoring module.
Preferably, the monitoring module is configured to monitor the big data component in real time, monitor a server of each configuration file in real time, and send change information data of the big data component to the zookeeper module when the server is operating normally.
Preferably, the change of the big data component is monitored in real time, and the change information data of the big data component is sent to the zookeeper module, further,
and comparing the data in the big data assembly with the data in the zookeeper module in real time, judging that the big data assembly is changed when the data in the big data assembly is different from the data in the zookeeper module, and sending the change information data of the big data assembly to the zookeeper module.
Preferably, the big data component comprises a plurality of configuration nodes, and the configuration nodes are servers where hdfs or hbase is located.
Preferably, the zookeeper module comprises a plurality of zookeeper nodes, and the zookeeper nodes are servers where the zookeeper is located.
The application also discloses a zookeeper-based cluster configuration file management method, which comprises the following steps:
the client sends a first request for modifying the big data component;
receiving the first request and sending a second request to modify the big data component to the big data component; the modification module comprises a data interface and is used for simultaneously sending a second request to the big data assembly, and the program is automatically started after modification is finished;
the big data component receives the second request;
monitoring the change of the big data assembly in real time, sending the change information data of the big data assembly to the zookeeper module, and simultaneously informing the client of the change information of the big data assembly;
receiving and storing the change information data sent by the monitoring module to generate corresponding configuration information data;
and after receiving the change information sent by the monitoring module, reading the configuration information data in the zookeeper module to complete configuration.
Preferably, the big data assembly is monitored in real time, each configuration file server is monitored in real time, and when the server normally operates, the change information data of the big data assembly is sent to the zookeeper module.
Preferably, the change of the big data component is monitored in real time, and the change information data of the big data component is sent to the zookeeper module, further,
and comparing the data in the big data assembly with the data in the zookeeper module in real time, judging that the big data assembly is changed when the data in the big data assembly is different from the data in the zookeeper module, and sending the change information data of the big data assembly to the zookeeper module.
Preferably, the big data component comprises a plurality of configuration nodes, and the configuration nodes are servers where hdfs or hbase is located.
Preferably, the zookeeper module comprises a plurality of zookeeper nodes, and the zookeeper nodes are servers where the zookeeper is located.
Compared with the prior art, the zookeeper-based cluster configuration file management system and method provided by the invention have the following beneficial effects that:
1. according to the method and the device, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are achieved, and configuration modification time is shortened.
2. According to the invention, the client directly accesses the zookeeper module 5 to obtain the required configuration file without copying all the configuration files, and the operation is simple.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a block diagram of a zookeeper-based system for managing a cluster configuration file in embodiment 1 of the present invention;
fig. 2 is a flowchart of a method for managing a cluster configuration file based on zookeeper in embodiment 3 of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. It should be noted that the described embodiments are merely some embodiments, rather than all embodiments, of the invention and are merely illustrative in nature and in no way intended to limit the invention, its application, or uses. The protection scope of the present application shall be subject to the definitions of the appended claims.
Example 1:
referring to fig. 1, a block diagram of a method for managing a cluster configuration file based on zookeeper in embodiment 1 of the present invention is shown, including:
the system comprises a client 1, a modification module 2, a big data component 3, a monitoring module 4 and a zookeeper module 5;
the client 1 is coupled with the modification module 2 and used for sending a first request for modifying the big data component 3;
the modification module 2 is respectively coupled with the client 1 and the big data component 3 and is used for receiving the first request and sending a second request for modifying the big data component 3 to the big data component 3; the modification module 2 comprises a data interface and is used for simultaneously sending a second request to the big data component 3, and the program is automatically started after modification is finished; development, operation and maintenance personnel can directly access the data interface of the modification module to modify all configuration files without modifying each configuration once, so that the method is convenient and quick, and the configuration modification time is shortened;
the big data component 3 comprises a plurality of configuration files, and the big data component 3 is respectively coupled with the monitoring module 4 and the modification module 2 and is used for receiving a second request;
the monitoring module 4 is respectively coupled with the big data component 3, the zookeeper module 5 and the client 1, and is used for monitoring the change of the big data component 3 in real time, sending the change information data of the big data component 3 to the zookeeper module 5, and simultaneously informing the client 1 that the big data component 3 has change information;
the zookeeper module 5 is respectively coupled with the monitoring module 4 and the client 1, and is used for receiving and storing the change information data sent by the monitoring module 4 and generating corresponding configuration information data;
the client 1 is further coupled to the monitoring module 4 and the zookeeper module 5 respectively, and is used for reading configuration information data in the zookeeper module 5 after receiving the change information sent by the monitoring module 4, and the client 1 can obtain a required configuration file by directly accessing the zookeeper module 5 without copying all the configuration files.
According to the method and the system, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are realized, and the configuration modification time is shortened; meanwhile, the client directly accesses the zookeeper module 5 to obtain the required configuration file without copying all the configuration files, and the operation is simple.
Example 2:
another embodiment of the present application of zookeeper-based system for managing cluster configuration files includes:
the system comprises a client 1, a modification module 2, a big data component 3, a monitoring module 4 and a zookeeper module 5;
the client 1 is coupled with the modification module 2 and used for sending a first request for modifying the big data component 3;
the modification module 2 is respectively coupled with the client 1 and the big data component 3 and is used for receiving the first request and sending a second request for modifying the big data component 3 to the big data component 3; the modification module 2 comprises a data interface and is used for simultaneously sending a second request to the big data component 3, and the program is automatically started after modification is finished; development, operation and maintenance personnel can directly access the data interface of the modification module to modify all configuration files without modifying each configuration once, so that the method is convenient and quick, and the configuration modification time is shortened;
the big data component 3 comprises a plurality of configuration files, and the big data component 3 is respectively coupled with the monitoring module 4 and the modification module 2 and is used for receiving a second request; the big data component 3 comprises a plurality of configuration nodes, and the configuration nodes are servers where hdfs or hbase is located.
The monitoring module 4 is respectively coupled with the big data component 3, the zookeeper module 5 and the client 1, and is used for monitoring the change of the big data component 3 in real time and sending the change information data of the big data component 3 to the zookeeper module 5,
and comparing the data in the big data component 3 with the data in the zookeeper module 5 in real time, judging that the big data component 3 is changed when the data in the big data component 3 is different from the data in the zookeeper module 5, and sending the change information data of the big data component 3 to the zookeeper module 5. Meanwhile, the client 1 is informed that the big data component 3 changes; and the monitoring module 4 is used for monitoring the big data component 3 in real time, monitoring a server of each configuration file in real time, and sending the change information data of the big data component 3 to the zookeeper module 5 when the server normally operates.
The zookeeper module 5 is respectively coupled with the monitoring module 4 and the client 1, and is used for receiving and storing the change information data sent by the monitoring module 4 and generating corresponding configuration information data; the zookeeper module 5 comprises a plurality of zookeeper nodes, and the zookeeper nodes are servers where the zookeeper is located.
The client 1 is further coupled to the monitoring module 4 and the zookeeper module 5 respectively, and is used for reading configuration information data in the zookeeper module 5 after receiving the change information sent by the monitoring module 4, and the client 1 can obtain a required configuration file by directly accessing the zookeeper module 5 without copying all the configuration files.
According to the method and the system, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are realized, and the configuration modification time is shortened; meanwhile, the client directly accesses the zookeeper module 5 to obtain the required configuration file without copying all the configuration files, and the operation is simple.
Example 3:
referring to fig. 2, fig. 2 is a flowchart of a method for managing a cluster configuration file based on zookeeper in embodiment 3 of the present invention, including the steps of:
step 301, a client sends a first request for modifying a big data component;
step 302, receiving a first request and sending a second request for modifying the big data component to the big data component; the modification module comprises a data interface and is used for simultaneously sending a second request to the big data assembly, and the program is automatically started after modification is finished; all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are realized, and the configuration modification time is shortened.
Step 303, the big data component receives a second request;
step 304, monitoring the change of the big data assembly in real time, sending the change information data of the big data assembly to the zookeeper module, and simultaneously informing the client of the change information of the big data assembly;
305, receiving and storing the change information data sent by the monitoring module, and generating corresponding configuration information data;
and step 306, after receiving the change information sent by the monitoring module, reading configuration information data in the zookeeper module, and completing configuration. The client directly accesses the zookeeper module to obtain the required configuration file without copying all the configuration files, and the operation is simple.
According to the method and the system, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are realized, and the configuration modification time is shortened; meanwhile, the client directly accesses the zookeeper module to obtain the required configuration file without copying all the configuration files, and the operation is simple.
Example 4:
another embodiment of the method for managing a cluster configuration file based on zookeeper of the present application includes the steps of:
step 401, a client sends a first request for modifying a big data component;
step 402, receiving a first request and sending a second request for modifying the big data component to the big data component; the modification module comprises a data interface and is used for simultaneously sending a second request to the big data assembly, and the program is automatically started after modification is finished; according to the method and the device, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are achieved, and configuration modification time is shortened.
Step 403, the big data component receives a second request; the big data assembly comprises a plurality of configuration nodes, and the configuration nodes are servers where hdfs or hbase is located.
Step 404, monitoring the change of the big data component in real time, sending the change information data of the big data component to the zookeeper module, further,
and comparing the data in the big data assembly with the data in the zookeeper module in real time, judging that the big data assembly is changed when the data in the big data assembly is different from the data in the zookeeper module, and sending the change information data of the big data assembly to the zookeeper module.
Meanwhile, the client is informed of the change information of the big data assembly;
and monitoring the big data assembly in real time, monitoring each configuration file server in real time, and sending the change information data of the big data assembly to the zookeeper module when the server normally operates.
Step 405, receiving and storing the change information data sent by the monitoring module, and generating corresponding configuration information data;
and 406, after receiving the change information sent by the monitoring module, reading configuration information data in the zookeeper module, and completing configuration. The zookeeper module comprises a plurality of zookeeper nodes, and the zookeeper nodes are servers where the zookeeper is located. The client directly accesses the zookeeper module to obtain the required configuration file without copying all the configuration files, and the operation is simple.
According to the method and the system, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are realized, and the configuration modification time is shortened; meanwhile, the client directly accesses the zookeeper module to obtain the required configuration file without copying all the configuration files, and the operation is simple.
According to the embodiments, the application has the following beneficial effects:
1. according to the method and the device, all configuration files of any component can be modified by directly accessing the data interface of the modification module, development, operation and maintenance personnel do not need to modify each configuration of each component once, convenience and rapidness are achieved, and configuration modification time is shortened.
2. According to the invention, the client directly accesses the zookeeper module to obtain the required configuration file without copying all the configuration files, and the operation is simple.
While the present invention has been described in detail with reference to the drawings and examples, it is to be understood that the foregoing examples are for illustrative purposes only and are not intended to limit the scope of the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention. The scope of the invention is defined by the appended claims.
Claims (10)
1. A zookeeper-based system for managing cluster configuration files, comprising: the system comprises a client, a modification module, a big data component, a monitoring module and a zookeeper module;
the client is coupled with the modification module and used for sending a first request for modifying the big data component;
the modification module is respectively coupled with the client and the big data assembly and used for receiving the first request and sending a second request for modifying the big data assembly to the big data assembly; the modification module comprises a data interface and is used for simultaneously sending a second request to the big data assembly, and the program is automatically started after modification is finished;
the big data assembly comprises a plurality of configuration files, and is respectively coupled with the monitoring module and the modification module and used for receiving the second request;
the monitoring module is respectively coupled with the big data assembly, the zookeeper module and the client, and is used for monitoring the change of the big data assembly in real time, sending the change information data of the big data assembly to the zookeeper module and simultaneously informing the client of the change information of the big data assembly;
the zookeeper module is respectively coupled with the monitoring module and the client and used for receiving and storing the change information data sent by the monitoring module and generating corresponding configuration information data;
the client is further coupled to the monitoring module and the zookeeper module respectively, and is configured to read the configuration information data in the zookeeper module after receiving the change information sent by the monitoring module.
2. The zookeeper-based cluster configuration file management system of claim 1, wherein the monitoring module is configured to monitor the big data component in real time, monitor a server of each configuration file in real time, and send change information data of the big data component to the zookeeper module when the server is in normal operation.
3. The zookeeper-based system for managing cluster profiles of claim 1, wherein the zookeeper module monitors changes of the big data component in real time, sends change information data of the big data component to the zookeeper module, and further,
and comparing the data in the big data assembly with the data in the zookeeper module in real time, judging that the big data assembly is changed when the data in the big data assembly is different from the data in the zookeeper module, and sending the change information data of the big data assembly to the zookeeper module.
4. The zookeeper-based system for managing cluster profiles of claim 1, wherein the big data component comprises a plurality of configuration nodes, and the configuration nodes are servers where hdfs or hbase is located.
5. The zookeeper-based system for managing cluster profiles of claim 1, wherein the zookeeper module comprises a plurality of zookeeper nodes, and the zookeeper nodes are servers where zookeepers are located.
6. A zookeeper-based method for managing cluster configuration files is characterized by comprising the following steps:
the client sends a first request for modifying the big data component;
a modification module receives the first request and sends a second request to modify the big data component to the big data component; the modification module comprises a data interface and is used for simultaneously sending a second request to the big data assembly, and the program is automatically started after modification is finished;
the big data component receives the second request;
the monitoring module monitors the change of the big data assembly in real time, sends the change information data of the big data assembly to the zookeeper module, and simultaneously informs the client of the change information of the big data assembly;
the zookeeper module receives and stores the change information data sent by the monitoring module to generate corresponding configuration information data;
and after receiving the change information sent by the monitoring module, the client reads the configuration information data in the zookeeper module to complete configuration.
7. The zookeeper-based method for managing cluster profiles of claim 6, wherein the big data component is monitored in real time, each profile server is monitored in real time, and when the servers are running normally, the change information data of the big data component is sent to the zookeeper module.
8. The zookeeper-based method for managing cluster configuration files according to claim 6, wherein the monitoring of the change of the big data component in real time, the sending of the change information data of the big data component to the zookeeper module, further,
and comparing the data in the big data assembly with the data in the zookeeper module in real time, judging that the big data assembly is changed when the data in the big data assembly is different from the data in the zookeeper module, and sending the change information data of the big data assembly to the zookeeper module.
9. The zookeeper-based method for managing cluster profiles of claim 6, wherein the big data component comprises a plurality of configuration nodes, and the configuration nodes are servers where hdfs or hbase is located.
10. The zookeeper-based method for managing cluster profiles as claimed in claim 6, wherein said zookeeper module comprises a plurality of zookeeper nodes, and said zookeeper nodes are servers where zookeeper is located.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910710820.2A CN110493326B (en) | 2019-08-02 | 2019-08-02 | Zookeeper-based cluster configuration file management system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910710820.2A CN110493326B (en) | 2019-08-02 | 2019-08-02 | Zookeeper-based cluster configuration file management system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110493326A CN110493326A (en) | 2019-11-22 |
| CN110493326B true CN110493326B (en) | 2021-11-12 |
Family
ID=68549350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910710820.2A Active CN110493326B (en) | 2019-08-02 | 2019-08-02 | Zookeeper-based cluster configuration file management system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110493326B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113630729B (en) * | 2021-10-13 | 2022-02-22 | 广州市玄武无线科技股份有限公司 | Intelligent 5G message transmission system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092718A (en) * | 2013-12-12 | 2014-10-08 | 腾讯数码（天津）有限公司 | Distributed system and configuration information updating method in distributed system |
| CN104216708A (en) * | 2014-08-20 | 2014-12-17 | 北京奇艺世纪科技有限公司 | Method and device for data monitoring |
| CN104486108A (en) * | 2014-12-08 | 2015-04-01 | 畅捷通信息技术股份有限公司 | Node configuration method base on Zookeeper and node configuration system based on Zookeeper |
| CN106375342A (en) * | 2016-10-21 | 2017-02-01 | 用友网络科技股份有限公司 | Zookeeper-technology-based system cluster method and system |
| US9595042B1 (en) * | 2011-09-07 | 2017-03-14 | Datalex (Ireland) Limited | System and method for testing airline revenue optimization and related tools or products for travel |
| CN106603281A (en) * | 2016-12-07 | 2017-04-26 | 乐视控股（北京）有限公司 | Configuration file management method and system |
| CN107643960A (en) * | 2017-09-18 | 2018-01-30 | 浪潮软件集团有限公司 | Solr full-text retrieval dynamic configuration system and method |
| CN107908708A (en) * | 2017-11-09 | 2018-04-13 | 北京锐安科技有限公司 | A kind of method, system, equipment and the storage medium of group document synchronization |
| CN108804119A (en) * | 2018-04-28 | 2018-11-13 | 北京金山云网络技术有限公司 | Configure update method, device, system, configuration center, application node and medium |
| CN109525649A (en) * | 2018-10-29 | 2019-03-26 | 北京神州泰岳软件股份有限公司 | A kind of data processing method and device of zookeeper client |
| CN109729129A (en) * | 2017-10-31 | 2019-05-07 | 华为技术有限公司 | Configuration modification method, storage cluster and the computer system of storage cluster |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9459926B2 (en) * | 2010-06-23 | 2016-10-04 | Twilio, Inc. | System and method for managing a computing cluster |
| US9172608B2 (en) * | 2012-02-07 | 2015-10-27 | Cloudera, Inc. | Centralized configuration and monitoring of a distributed computing cluster |
-
2019
- 2019-08-02 CN CN201910710820.2A patent/CN110493326B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9595042B1 (en) * | 2011-09-07 | 2017-03-14 | Datalex (Ireland) Limited | System and method for testing airline revenue optimization and related tools or products for travel |
| CN104092718A (en) * | 2013-12-12 | 2014-10-08 | 腾讯数码（天津）有限公司 | Distributed system and configuration information updating method in distributed system |
| CN104216708A (en) * | 2014-08-20 | 2014-12-17 | 北京奇艺世纪科技有限公司 | Method and device for data monitoring |
| CN104486108A (en) * | 2014-12-08 | 2015-04-01 | 畅捷通信息技术股份有限公司 | Node configuration method base on Zookeeper and node configuration system based on Zookeeper |
| CN106375342A (en) * | 2016-10-21 | 2017-02-01 | 用友网络科技股份有限公司 | Zookeeper-technology-based system cluster method and system |
| CN106603281A (en) * | 2016-12-07 | 2017-04-26 | 乐视控股（北京）有限公司 | Configuration file management method and system |
| CN107643960A (en) * | 2017-09-18 | 2018-01-30 | 浪潮软件集团有限公司 | Solr full-text retrieval dynamic configuration system and method |
| CN109729129A (en) * | 2017-10-31 | 2019-05-07 | 华为技术有限公司 | Configuration modification method, storage cluster and the computer system of storage cluster |
| CN107908708A (en) * | 2017-11-09 | 2018-04-13 | 北京锐安科技有限公司 | A kind of method, system, equipment and the storage medium of group document synchronization |
| CN108804119A (en) * | 2018-04-28 | 2018-11-13 | 北京金山云网络技术有限公司 | Configure update method, device, system, configuration center, application node and medium |
| CN109525649A (en) * | 2018-10-29 | 2019-03-26 | 北京神州泰岳软件股份有限公司 | A kind of data processing method and device of zookeeper client |
Non-Patent Citations (2)
| Title |
|---|
| "Towards Model Based Approach to Hadoop Deployment and Configuration";Yicheng Huang etal;《2015 12th Web Information System and Application Conference (WISA)》;20160204;全文 * |
| "基于ZooKeeper的集群应用配置管理的设计与实现";袁子淇;《中国优秀硕士学位论文全文数据库（电子期刊）》;20160115;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110493326A (en) | 2019-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11636105B2 (en) | Generating a subquery for an external data system using a configuration file | |
| US11481396B2 (en) | Executing untrusted commands from a distributed execution model | |
| US11663227B2 (en) | Generating a subquery for a distinct data intake and query system | |
| US11604795B2 (en) | Distributing partial results from an external data system between worker nodes | |
| US20190068690A1 (en) | Automated management of resource attributes across network-based services | |
| US11163758B2 (en) | External dataset capability compensation | |
| US10726009B2 (en) | Query processing using query-resource usage and node utilization data | |
| US11281706B2 (en) | Multi-layer partition allocation for query execution | |
| US11416528B2 (en) | Query acceleration data store | |
| US11461334B2 (en) | Data conditioning for dataset destination | |
| US11232100B2 (en) | Resource allocation for multiple datasets | |
| US10733079B2 (en) | Systems and methods for end-to-end testing of applications using dynamically simulated data | |
| US8429256B2 (en) | Systems and methods for generating cached representations of host package inventories in remote package repositories | |
| US10698897B2 (en) | Executing a distributed execution model with untrusted commands | |
| CN110543464B (en) | Big data platform applied to intelligent park and operation method | |
| US20190138638A1 (en) | Task distribution in an execution node of a distributed execution environment | |
| US20180089324A1 (en) | Dynamic resource allocation for real-time search | |
| US9811445B2 (en) | Methods and systems for the use of synthetic users to performance test cloud applications | |
| US8762931B2 (en) | Generating an encoded package profile | |
| CN113254466B (en) | Data processing method and device, electronic equipment and storage medium | |
| US11500755B1 (en) | Database performance degradation detection and prevention | |
| CN110023901A (en) | System and method for updating multilayer application stack based on cloud | |
| US20200250587A1 (en) | Framework for multi-tenant data science experiments at-scale | |
| US10685019B2 (en) | Secure query interface | |
| CN111611276A (en) | Data query method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |