CN109379425A - Distributed cluster deployment management method and device - Google Patents
Distributed cluster deployment management method and device Download PDFInfo
- Publication number
- CN109379425A CN109379425A CN201811203205.4A CN201811203205A CN109379425A CN 109379425 A CN109379425 A CN 109379425A CN 201811203205 A CN201811203205 A CN 201811203205A CN 109379425 A CN109379425 A CN 109379425A
- Authority
- CN
- China
- Prior art keywords
- service
- node
- distributed
- distributed node
- function menu
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 62
- 238000012544 monitoring process Methods 0.000 claims abstract description 32
- 238000009434 installation Methods 0.000 claims description 54
- 238000012800 visualization Methods 0.000 claims description 48
- 230000000712 assembly Effects 0.000 claims description 40
- 238000000429 assembly Methods 0.000 claims description 40
- 239000004744 fabric Substances 0.000 claims description 16
- 238000012986 modification Methods 0.000 claims description 15
- 230000004048 modification Effects 0.000 claims description 15
- 238000012217 deletion Methods 0.000 claims description 7
- 230000037430 deletion Effects 0.000 claims description 7
- 238000000034 method Methods 0.000 abstract description 26
- 230000004382 visual function Effects 0.000 abstract 3
- 230000006870 function Effects 0.000 description 90
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/083—Network architectures or network communication protocols for network security for authentication of entities using passwords
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
Abstract
The invention provides a distributed cluster deployment management method and a distributed cluster deployment management device, which are applied to an InData-Kudu component, and the method comprises the following steps: SSH connection among all distributed nodes is built, and a corresponding visual function menu is generated for each externally configured command/command group; determining the connection relation among all distributed nodes, and distributing corresponding environment deployment files for all the distributed nodes according to the connection relation; deploying a cluster environment for the distributed nodes by using the environment deployment file; based on the cluster environment, when external visual function menu trigger is received, calling a command/command group corresponding to the visual function menu; performing operations of the command/command group for the distributed nodes; and monitoring the running state and the service state of the distributed nodes in real time based on the cluster environment. The scheme provided by the invention realizes the unified management of the distributed nodes and can efficiently acquire various real-time information from each distributed node.
Description
Technical field
The present invention relates to field of computer technology, in particular to a kind of distributed type assemblies deployment management method and device.
Background technique
InData-Kudu component is in Apache Kudu component as an a kind of component independently of hadoop system
On the basis of increase and enhance some functions, form a New Parent independently of Hadoop system.Indata-Kudu passes through
Bottom storage organization engine and unstructured storage engines provide data storage service.Wherein, structuring engine by
Apache Kudu service provides, and unstructured storage engines are provided by object storage service.And Indata-Kudu exists
The storage of the unstructured datas such as file, picture can be supported on the basis of Apache Kudu, meanwhile, Indata-Kudu exists
Efficient distributed query engine is provided on the basis of Apache Kudu, and supports stsndard SQL to structuring and unstructured number
According to being inquired, analyzed.In addition, InData-Kudu fills up the deficiency that Apache Kudu itself stores unstructured data,
Quick unstructured data store function is provided.
Currently, InData-Kudu clustered deploy(ment) management process, needs to log in each of InData-Kudu cluster respectively
Node carries out the management after installation and deployment and deployment, and most information needs to log in each node respectively and goes to carry out in operation
It obtains, can not efficiently obtain various real time information comprehensively.
Summary of the invention
The embodiment of the invention provides a kind of distributed type assemblies deployment management method and devices, realize to distributed node
Unified management, can efficiently obtain various real time information from each distributed node.
A kind of distributed type assemblies dispose management method, are applied to InData-Kudu component, construct between each distributed node
SSH connection, be that each order/order group of exterior arrangement generates corresponding visualization function menu;Further include:
It determines the connection relationship between each distributed node, and according to the connection relationship, is each described point
Cloth node distributes corresponding environment deployment file;
Using the environment deployment file, cluster environment is disposed for the distributed node;
Based on the cluster environment, when receiving the external triggering to the visualization function menu, call described visual
Change the corresponding order/order group of function menu;
For the distributed node, the operation of the order/order group is executed;
Based on the cluster environment, the operating status and service state of the distributed node are monitored in real time.
Preferably,
It is described according to the connection relationship, be that each described distributed node distributes corresponding environment deployment file, packet
It includes:
Using each described distributed node as destination node, execute:
According to the connection relationship, the authentication information of the destination node, which is sent to, has connection with the destination node
The distributed node of relationship, wherein the authentication information, comprising: the essential information of the destination node and the target section
The access key of point;
After receiving the successful information of certification that each distributed node returns, to each distributed node
Send Software Development Kit, service installation kit and corresponding installation instruction.
Preferably,
The visualization function menu, comprising: general view function menu, Service Management Function menu, monitoring function menu and
Cluster management function menu.
Preferably,
It is described when receive it is external the visualization function menu is triggered when, call the visualization function menu corresponding
The order/order group execute the operation of the order/order group for the distributed node, comprising:
When receiving the triggering to the general view function menu, Kudu service type, right that statistics Kudu service includes
The query service type and the Kudu service type pair that the Storage Service Type that includes as storage service, query service include
Distributed node number, the corresponding distributed node number of the Storage Service Type and the query service type answered are corresponding
Distributed node number;The total number of the distributed node is counted, and counts the structuring of all distributed nodes
Storage total capacity and the structured storage capacity occupied;The result counted is shown in graphical form.
Preferably,
It is described when receive it is external the visualization function menu is triggered when, call the visualization function menu corresponding
The order/order group execute the operation of the order/order group for the distributed node, comprising:
When receiving the triggering to the Service Management Function menu, statistical fractals type and each described service
The essential information of the corresponding distributed node of type, wherein the service type includes: Kudu service, query service and clothes
Business installation;It is serviced for the Kudu, counts and show with chart mode the Kudu service of the distributed node installation
Operating condition, and to the distributed node installation the Kudu service carry out start and stop operation and modification service
Setting operation;For the query service, the inquiry clothes of the distributed node installation are counted and shown with chart mode
The operating condition of business and the mounted query service of the distributed node, and the inquiry to the distributed node
Service carries out starting or stoping operation.
Preferably,
It is described when receive it is external the visualization function menu is triggered when, call the visualization function menu corresponding
The order/order group execute the operation of the order/order group for the distributed node, comprising:
When receiving the triggering to the cluster management function menu, increase/deletion distributed node, to described
Distributed node is remotely controlled, described point of installation settings and modification to the Network Time Protocol in the distributed node
The title of cloth node.
Preferably, the above method further comprises:
When receiving the triggering to the monitoring function menu, display real time monitoring arrives the operation of the distributed node
State and service state, and according to the operating status and service state of the distributed node, it counts the distributed node and exists
Run the operating condition and occupation condition when Kudu service.
A kind of distributed type assemblies deployment managing device, is applied to InData-Kudu component, comprising: cluster environment deployment is single
Member, feature operation unit and monitoring unit, wherein
The cluster environment deployment unit determines each described point for constructing the SSH connection between each distributed node
Connection relationship between cloth node, and according to the connection relationship, it is that each described distributed node distributes corresponding environment
Deployment file;Using the environment deployment file, cluster environment is disposed for the distributed node;
The feature operation unit generates corresponding visualization function for each order for exterior arrangement/order group
It can menu;It is external to the visualization function when receiving based on the cluster environment of cluster environment deployment unit deployment
When energy menu triggering, the corresponding order/order group of the visualization function menu is called;For the distributed section
Point executes the operation of the order/order group;
The monitoring unit, the cluster environment for being disposed based on the cluster environment deployment unit, real time monitoring
The operating status and service state of the distributed node.
Preferably, the cluster environment deployment unit, is used for:
Using each described distributed node as destination node, execute:
According to the connection relationship, the authentication information of the destination node, which is sent to, has connection with the destination node
The distributed node of relationship, wherein the authentication information, comprising: the essential information of the destination node and the target section
The access key of point;
After receiving the successful information of certification that each distributed node returns, to each distributed node
Send Software Development Kit, service installation kit and corresponding installation instruction.
Preferably,
The visualization function menu, comprising: general view function menu, Service Management Function menu, monitoring function menu and
Cluster management function menu;
The feature operation unit, is used for:
When receiving the triggering to the general view function menu, Kudu service type, right that statistics Kudu service includes
The query service type and the Kudu service type pair that the Storage Service Type that includes as storage service, query service include
Distributed node number, the corresponding distributed node number of the Storage Service Type and the query service type answered are corresponding
Distributed node number;The total number of the distributed node is counted, and counts the structuring of all distributed nodes
Storage total capacity and the structured storage capacity occupied;The result counted is shown in graphical form;
When receiving the triggering to the Service Management Function menu, statistical fractals type and each described service
The essential information of the corresponding distributed node of type, wherein the service type includes: Kudu service, query service and clothes
Business installation;It is serviced for the Kudu, counts and show with chart mode the Kudu service of the distributed node installation
Operating condition, and to the distributed node installation the Kudu service carry out start and stop operation and modification service
Setting operation;For the query service, the inquiry clothes of the distributed node installation are counted and shown with chart mode
The operating condition of business and the mounted query service of the distributed node, and the inquiry to the distributed node
Service carries out starting or stoping operation;
When receiving the triggering to the cluster management function menu, increase/deletion distributed node, to described
Distributed node is remotely controlled, described point of installation settings and modification to the Network Time Protocol in the distributed node
The title of cloth node.
Preferably, the feature operation unit, is further used for:
When receiving the triggering to the monitoring function menu, described point that the monitoring unit monitors in real time is shown
The operating status and service state of cloth node, and according to the operating status and service state of the distributed node, count institute
State operating condition and occupation condition of the distributed node when running Kudu service.
The embodiment of the invention provides a kind of distributed type assemblies deployment management method and devices, are applied to InData-Kudu
Component constructs the SSH connection between each distributed node, be exterior arrangement each order/order group generate it is corresponding can
Depending on changing function menu;The connection relationship between each distributed node is determined, and according to the connection relationship, for each institute
It states distributed node and distributes corresponding environment deployment file;Using the environment deployment file, disposed for the distributed node
Cluster environment;Based on the cluster environment, when receiving the external triggering to the visualization function menu, call described visual
Change the corresponding order/order group of function menu;For the distributed node, the order/order is executed
The operation of group;Based on the cluster environment, the operating status and service state of the distributed node are monitored in real time.Realize to point
The unified management of cloth node can efficiently obtain various real time information from each distributed node.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is the present invention
Some embodiments for those of ordinary skill in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 is a kind of flow chart of distributed type assemblies deployment management method provided by one embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of distributed type assemblies provided by one embodiment of the present invention;
Fig. 3 is a kind of flow chart for distributed type assemblies deployment management method that another embodiment of the present invention provides;
Fig. 4 is that the structure of framework where a kind of distributed type assemblies deployment managing device provided by one embodiment of the present invention is shown
It is intended to;
Fig. 5 is a kind of structural schematic diagram of distributed type assemblies deployment managing device provided by one embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments, based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
As shown in Figure 1, the embodiment of the invention provides a kind of distributed type assemblies to dispose management method, it is applied to InData-
Kudu component, this method may comprise steps of:
Step 101: constructing the SSH connection between each distributed node, be that each order/order group of exterior arrangement is raw
At corresponding visualization function menu;
Step 102: determining the connection relationship between each distributed node, and be each according to the connection relationship
A distributed node distributes corresponding environment deployment file;
Step 103: utilizing the environment deployment file, dispose cluster environment for the distributed node;
Step 104: being based on the cluster environment, when receiving the external triggering to the visualization function menu, call
The corresponding order/the order group of the visualization function menu;
Step 105: being directed to the distributed node, execute the operation of the order/order group;
Step 106: being based on the cluster environment, monitor the operating status and service state of the distributed node in real time.
It is worth noting that the server that any one node in distributed type assemblies can be used as distributed type assemblies executes
Above-mentioned distributed type assemblies dispose management method.
It in the embodiment shown in fig. 1, is the every of exterior arrangement by constructing the SSH connection between each distributed node
A kind of order/corresponding visualization function menu of order group generation;Determine the connection relationship between each distributed node, and
It is that each described distributed node distributes corresponding environment deployment file according to the connection relationship;Utilize the Ministry of environment
File is affixed one's name to, disposes cluster environment for the distributed node;It is external to the visualization when receiving based on the cluster environment
When function menu triggers, the corresponding order/order group of the visualization function menu is called;For the distribution
Node executes the operation of the order/order group;Based on the cluster environment, the distributed node is monitored in real time
Operating status and service state.It realizes the unified management to distributed node, can efficiently be obtained from each distributed node
Take various real time information.
In an alternative embodiment of the invention, the specific embodiment of above-mentioned steps 102 can include: by each distribution
Formula node is executed as destination node: according to the connection relationship, by the authentication information of the destination node be sent to it is described
Destination node has the distributed node of connection relationship, wherein the authentication information, comprising: the basic letter of the destination node
The access key of breath and the destination node;In the successful information of certification for receiving each distributed node return
Afterwards, Software Development Kit, service installation kit and corresponding installation instruction are sent to each distributed node.By upper
The process of stating realizes the mutual access between the distributed node with connection relationship, while realizing and remotely controlling each distribution
Node receives and installs Software Development Kit and service installation kit etc..
In an alternative embodiment of the invention, the visualization function menu, comprising: general view function menu, service management function
It can menu, monitoring function menu and cluster management function menu.It can be realized by these visualization function menus in server
It is upper to control and check each distributed node.
In an alternative embodiment of the invention, the specific implementation of above-mentioned steps 104 and step 105 may include: and work as to connect
When receiving the triggering to the general view function menu, Kudu service type, the object storage service packet that Kudu service includes are counted
The corresponding distributed section of the query service type and the Kudu service type that the Storage Service Type that contains, query service include
Point number, the corresponding distributed node number of the Storage Service Type and the corresponding distributed node of the query service type
Number;Count the total number of the distributed node, and count the structured storage total capacity of all distributed nodes with
And the structured storage capacity occupied;The result counted is shown in graphical form;It realizes to each distributed node
The statistics of service, object storage service and query service that Kudu is serviced.
In an alternative embodiment of the invention, the specific implementation of above-mentioned steps 104 and step 105 may include: and work as to connect
When receiving the triggering to the Service Management Function menu, statistical fractals type and each corresponding point of described service type
The essential information of cloth node, wherein the service type includes: Kudu service, query service and service installation;For institute
Kudu service is stated, counts and show with chart mode the operating condition of the Kudu service of the distributed node installation, and
Start and stop operation and modification service setting operation are carried out to the Kudu service of distributed node installation;For
The query service counts and shows the query service and described point that the distributed node is installed with chart mode
The operating condition of the mounted query service of cloth node, and to the query service of the distributed node carry out starting or
It stops operation.Realize the remote operation to Kudu service and query service in each distributed node.
In an alternative embodiment of the invention, the specific implementation of above-mentioned steps 104 and step 105 may include: and work as to connect
When receiving the triggering to the cluster management function menu, increase/deletion distributed node, to the distributed node into
The long-range control of row, the name of installation settings and the modification distributed node to the Network Time Protocol in the distributed node
Claim.
In still another embodiment of the process, the above method further comprises: when receiving to the monitoring function menu
When triggering, display real time monitoring arrives the operating status and service state of the distributed node, and according to the distributed node
Operating status and service state, count the distributed node run Kudu service when operating condition and resource occupation feelings
Condition.
In order to clearly demonstrate distributed type assemblies deployment management method, it is with the distributed type assemblies that Fig. 2 is provided below
Explanation is unfolded in example.
As shown in figure 3, the embodiment of the invention provides a kind of distributed type assemblies to dispose management method, it is applied to InData-
Kudu component, this method may comprise steps of:
Step 301: server of the node as distributed type assemblies is selected from distributed type assemblies;
Such as the distributed type assemblies that Fig. 2 is provided, server of the arbitrary distributed node as distributed type assemblies can choose,
For example selecting distributed node 1 as the server of distributed type assemblies, then distributed node 1 can be controlled remotely or remotely be supervised
Control distributed node 2, distributed node 3, distributed node 4 and distributed node 5.
Step 302: constructing the SSH connection between each distributed node;
The step is to realize the subsequent basis to distributed type assemblies deployment management.
Step 303: the connection relationship between each distributed node is determined, using each described distributed node as target
Node executes: according to the connection relationship, the authentication information of the destination node, which is sent to, has company with the destination node
Connect the distributed node of relationship;
Wherein, the authentication information, comprising: the access of the essential information of the destination node and the destination node is close
Key;
Step 304: after receiving the successful information of certification that each distributed node returns, to each described point
Cloth node sends Software Development Kit, service installation kit and corresponding installation instruction;
Step 303 and step 304 are to construct the process of cluster environment, may include the setting of cluster NTP system, JDK's
Installation etc..
Step 305: generating corresponding visualization function menu for each order/order group of exterior arrangement;
It is i.e. external to configure correspondingly order/order group, such as statistics Kudu service type, inquiry according to their own needs
Service type and Storage Service Type, the corresponding distributed node number of various service types in statistic processes, for example unite
The structured storage capacity counting the structured storage total capacity of distributed type assemblies and having occupied;For another example remote operation services such as
Kudu service, query service and service installation etc., below will be to pass through the step as each order/order of exterior arrangement
The visualization function menu that group generates, comprising: general view function menu, Service Management Function menu, monitoring function menu and cluster
Management function menu.Wherein, the corresponding order/order group of each visualization function menu can pass through the function of following the various menus
It is shown.It in addition, user can also need to redefine according to oneself order/order group, and is the fixed order/life again
It enables group generate corresponding visualization function menu, i.e., can be reversed by visualization function menu and execute corresponding order/order
Group.
Wherein, visualization function menu includes the various menu shown in the following table 1.
Table 1
General view | Service management | Cluster management | Monitoring |
Wherein, the function of the various menu is determined by its corresponding order/order group in table 1, will be in following step
Explanation is unfolded.
Step 306: when receiving the external triggering to any one visualization function menu, calling the visualization function dish
Single corresponding order/order group executes the operation of order/order group for distributed node;
Explanation is unfolded in the specific implementation of the step by taking the several menus provided in table 1 as an example.
When receiving the triggering to general view function menu, the statistics Kudu service Kudu service type that includes, object are deposited
The query service type and the corresponding distribution of Kudu service type that the storage service Storage Service Type that includes, query service include
The corresponding distributed node number of formula node number, Storage Service Type and the corresponding distributed node of query service type
Number;The total number of statistical cloth node, and count the structured storage total capacity of all distributed nodes and occupied
Structured storage capacity;The result counted is shown in graphical form;
When receiving the triggering to the Service Management Function menu, statistical fractals type and each described service
The essential information of the corresponding distributed node of type, wherein the service type includes: Kudu service, query service and clothes
Business installation;It is serviced for the Kudu, counts and show with chart mode the Kudu service of the distributed node installation
Operating condition, and to the distributed node installation the Kudu service carry out start and stop operation and modification service
Setting operation;For the query service, the inquiry clothes of the distributed node installation are counted and shown with chart mode
The operating condition of business and the mounted query service of the distributed node, and the inquiry to the distributed node
Service carries out starting or stoping operation;
When receiving the triggering to cluster management function menu, increase/deletion distributed node, to distributed node into
The long-range control of row, the title of installation settings and modification distributed node to the Network Time Protocol in distributed node.
Step 307: being based on cluster environment, monitor the operating status and service state of the distributed node in real time;
Step 308: according to the operating status and service state of distributed node, statistical cloth node is in operation Kudu clothes
Operating condition and occupation condition when business.
In this step, when receiving the triggering of the monitoring function menu provided to table 1, display real time monitoring to distribution
The operating status and service state of formula node, and show operating condition of the distributed node counted when running Kudu service
And occupation condition.
Above-mentioned distributed type assemblies deployment management method can be realized based on browser.
As shown in Figure 4, Figure 5, the embodiment of the invention provides a kind of distributed type assemblies to dispose managing device.Installation practice
It can also be realized by way of hardware or software and hardware combining by software realization.For hardware view, such as Fig. 4
It is shown, a kind of hardware structure diagram of equipment where disposing managing device for distributed type assemblies provided in an embodiment of the present invention, in addition to
Except processor shown in Fig. 4, memory, network interface and nonvolatile memory, the equipment in embodiment where device is logical
It often can also include other hardware, such as be responsible for the forwarding chip of processing message.Taking software implementation as an example, as shown in figure 5, making
It is by the CPU of equipment where it by computer journey corresponding in nonvolatile memory for the device on a logical meaning
Sequence instruction is read into memory what operation was formed.Distributed type assemblies provided in this embodiment dispose managing device, are applied to
InData-Kudu component, comprising: cluster environment deployment unit 501, feature operation unit 502 and monitoring unit 503, wherein
The cluster environment deployment unit 501 determines each institute for constructing the SSH connection between each distributed node
The connection relationship between distributed node is stated, and according to the connection relationship, is that each described distributed node distribution is corresponding
Environment deployment file;Using the environment deployment file, cluster environment is disposed for the distributed node;
The feature operation unit 502 generates corresponding visualization for each order for exterior arrangement/order group
Function menu;It is external to described visual when receiving based on the cluster environment of the cluster environment deployment unit 501 deployment
When changing function menu triggering, the corresponding order/order group of the visualization function menu is called;For the distribution
Formula node executes the operation of the order/order group;
The monitoring unit 503, the cluster environment for being disposed based on the cluster environment deployment unit 501 are real
When monitor the operating status and service state of the distributed node.
In an alternative embodiment of the invention, cluster environment deployment unit 501, for making each described distributed node
For destination node, executes: according to the connection relationship, the authentication information of the destination node being sent to and the destination node
Distributed node with connection relationship, wherein the authentication information, comprising: the essential information of the destination node and institute
State the access key of destination node;After receiving the successful information of certification that each distributed node returns, to each
The distributed node sends Software Development Kit, service installation kit and corresponding installation instruction.
In still another embodiment of the process, the visualization function menu, comprising: general view function menu, service management function
It can menu, monitoring function menu and cluster management function menu;
The feature operation unit 502, is used for:
When receiving the triggering to the general view function menu, Kudu service type, right that statistics Kudu service includes
The query service type and the Kudu service type pair that the Storage Service Type that includes as storage service, query service include
Distributed node number, the corresponding distributed node number of the Storage Service Type and the query service type answered are corresponding
Distributed node number;The total number of the distributed node is counted, and counts the structuring of all distributed nodes
Storage total capacity and the structured storage capacity occupied;The result counted is shown in graphical form;
When receiving the triggering to the Service Management Function menu, statistical fractals type and each described service
The essential information of the corresponding distributed node of type, wherein the service type includes: Kudu service, query service and clothes
Business installation;It is serviced for the Kudu, counts and show with chart mode the Kudu service of the distributed node installation
Operating condition, and to the distributed node installation the Kudu service carry out start and stop operation and modification service
Setting operation;For the query service, the inquiry clothes of the distributed node installation are counted and shown with chart mode
The operating condition of business and the mounted query service of the distributed node, and the inquiry to the distributed node
Service carries out starting or stoping operation;
When receiving the triggering to the cluster management function menu, increase/deletion distributed node, to described
Distributed node is remotely controlled, described point of installation settings and modification to the Network Time Protocol in the distributed node
The title of cloth node.
In still another embodiment of the process, the feature operation unit 502 is further used for receive to the monitoring
When the triggering of function menu, the operating status and service shape of the distributed node that the monitoring unit monitors in real time are shown
State, and according to the operating status and service state of the distributed node, the distributed node is counted in operation Kudu service
When operating condition and occupation condition.
Above-mentioned distributed type assemblies deployment managing device can be realized based on browser.
The contents such as the information exchange between each unit, implementation procedure in above-mentioned apparatus, due to implementing with the method for the present invention
Example is based on same design, and for details, please refer to the description in the embodiment of the method for the present invention, and details are not described herein again.
The embodiment of the invention provides a kind of readable mediums, including execute instruction, when the processor of storage control executes
Described when executing instruction, the storage control executes the method that any of the above-described embodiment of the present invention provides.
The embodiment of the invention provides a kind of storage controls, comprising: processor, memory and bus;The memory
It is executed instruction for storing, the processor is connect with the memory by the bus, when the storage control is run
When, the processor executes the described of memory storage and executes instruction, so that the storage control executes in the present invention
The method that any embodiment offer is provided.
In conclusion more than the present invention each embodiment at least has the following beneficial effects:
It 1, is that each order/order group of exterior arrangement generates by constructing the SSH connection between each distributed node
Corresponding visualization function menu;It determines the connection relationship between each distributed node, and according to the connection relationship, is
Each described distributed node distributes corresponding environment deployment file;It is the distribution using the environment deployment file
Node deployment cluster environment;It is called based on the cluster environment when receiving the external triggering to the visualization function menu
The corresponding order/the order group of the visualization function menu;For the distributed node, the execution order/
The operation of the order group;Based on the cluster environment, the operating status and service state of the distributed node are monitored in real time.
It realizes the unified management to distributed node, various real time information can be efficiently obtained from each distributed node.
2, by executing: according to connection relationship, by recognizing for destination node using each distributed node as destination node
Card information is sent to the distributed node for having connection relationship with destination node, wherein authentication information, comprising: destination node
The access key of essential information and the destination node;In the successful information of certification for receiving each distributed node return
Afterwards, Software Development Kit, service installation kit and corresponding installation instruction are sent to each distributed node.Pass through above-mentioned mistake
Journey realizes the mutual access between the distributed node with connection relationship, while realizing and remotely controlling each distributed node
Receive and install Software Development Kit and service installation kit etc..
3, by general view function menu, Service Management Function menu, monitoring function menu and cluster management function menu, i.e.,
It can be achieved to control and check on the server each distributed node.
4, by operation general view function menu, the service of the Kudu service to each distributed node is realized, object is deposited
The statistics of storage service and query service.
5, it by operation Service Management Function menu, realizes to the Kudu service in each distributed node and inquires clothes
The remote operation of business.
It should be noted that, in this document, such as first and second etc relational terms are used merely to an entity
Or operation is distinguished with another entity or operation, is existed without necessarily requiring or implying between these entities or operation
Any actual relationship or order.Moreover, the terms "include", "comprise" or its any other variant be intended to it is non-
It is exclusive to include, so that the process, method, article or equipment for including a series of elements not only includes those elements,
It but also including other elements that are not explicitly listed, or further include solid by this process, method, article or equipment
Some elements.In the absence of more restrictions, the element limited by sentence " including one ", is not arranged
Except there is also other identical factors in the process, method, article or apparatus that includes the element.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can store in computer-readable storage medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned includes: ROM, RAM, magnetic disk or light
In the various media that can store program code such as disk.
Finally, it should be noted that the foregoing is merely presently preferred embodiments of the present invention, it is merely to illustrate skill of the invention
Art scheme, is not intended to limit the scope of the present invention.Any modification for being made all within the spirits and principles of the present invention,
Equivalent replacement, improvement etc., are included within the scope of protection of the present invention.
Claims (10)
1. a kind of distributed type assemblies dispose management method, which is characterized in that be applied to InData-Kudu component, construct each point
SSH connection between cloth node is that each order/order group of exterior arrangement generates corresponding visualization function menu;Also
Include:
It determines the connection relationship between each distributed node, and is each described distribution according to the connection relationship
Node distributes corresponding environment deployment file;
Using the environment deployment file, cluster environment is disposed for the distributed node;
The visualization function is called when receiving the external triggering to the visualization function menu based on the cluster environment
It can the corresponding order/order group of menu;
For the distributed node, the operation of the order/order group is executed;
Based on the cluster environment, the operating status and service state of the distributed node are monitored in real time.
2. distributed type assemblies according to claim 1 dispose management method, which is characterized in that described to be closed according to the connection
System is that each described distributed node distributes corresponding environment deployment file, comprising:
Using each described distributed node as destination node, execute:
According to the connection relationship, the authentication information of the destination node, which is sent to, has connection relationship with the destination node
Distributed node, wherein the authentication information, comprising: the essential information of the destination node and the destination node
Access key;
After receiving the successful information of certification that each distributed node returns, sent to each distributed node
Software Development Kit, service installation kit and corresponding installation instruction.
3. distributed type assemblies according to claim 1 or 2 dispose management method, which is characterized in that
The visualization function menu, comprising: general view function menu, Service Management Function menu, monitoring function menu and cluster
Management function menu.
4. distributed type assemblies according to claim 3 dispose management method, which is characterized in that described external right when receiving
When the visualization function menu triggers, the corresponding order/order group of the visualization function menu is called, for
The distributed node executes the operation of the order/order group, comprising:
When receiving the triggering to the general view function menu, the statistics Kudu service Kudu service type that includes, object are deposited
The query service type and the Kudu service type that the storage service Storage Service Type that includes, query service include are corresponding
The corresponding distributed node number of distributed node number, the Storage Service Type and corresponding point of the query service type
Cloth node number;The total number of the distributed node is counted, and counts the structured storage of all distributed nodes
Total capacity and the structured storage capacity occupied;The result counted is shown in graphical form.
5. distributed type assemblies according to claim 3 dispose management method, which is characterized in that described external right when receiving
When the visualization function menu triggers, the corresponding order/order group of the visualization function menu is called, for
The distributed node executes the operation of the order/order group, comprising:
When receiving the triggering to the Service Management Function menu, statistical fractals type and each described service type
The essential information of corresponding distributed node, wherein the service type includes: Kudu service, query service and service peace
Dress;It is serviced for the Kudu, counts and show with chart mode the fortune of the Kudu service of the distributed node installation
Market condition, and start and stop operation and modification service setting are carried out to the Kudu service of distributed node installation
Operation;For the query service, the query service of the distributed node installation is counted and shown with chart mode, with
And the operating condition of the mounted query service of distributed node, and to the query service of the distributed node into
Row starts or stops operation;
And/or
When receiving the triggering to the cluster management function menu, increase/deletion distributed node, to the distribution
Formula node is remotely controlled, installation settings and the modification distribution to the Network Time Protocol in the distributed node
The title of node.
6. distributed type assemblies according to claim 3 dispose management method, which is characterized in that further comprise:
When receiving the triggering to the monitoring function menu, display real time monitoring arrives the operating status of the distributed node
And service state, and according to the operating status and service state of the distributed node, it counts the distributed node and is running
Operating condition and occupation condition when Kudu is serviced.
7. a kind of distributed type assemblies dispose managing device, which is characterized in that be applied to InData-Kudu component, comprising: collection group rings
Border deployment unit, feature operation unit and monitoring unit, wherein
The cluster environment deployment unit determines each distribution for constructing the SSH connection between each distributed node
Connection relationship between node, and according to the connection relationship, it is that each described distributed node distributes corresponding environment deployment
File;Using the environment deployment file, cluster environment is disposed for the distributed node;
The feature operation unit generates corresponding visualization function dish for each order for exterior arrangement/order group
It is single;It is external to the visualization function dish when receiving based on the cluster environment of cluster environment deployment unit deployment
When one shot, the corresponding order/order group of the visualization function menu is called;For the distributed node,
Execute the operation of the order/order group;
The monitoring unit, the cluster environment for being disposed based on the cluster environment deployment unit, described in real time monitoring
The operating status and service state of distributed node.
8. distributed type assemblies according to claim 7 dispose managing device, which is characterized in that the cluster environment deployment is single
Member is used for:
Using each described distributed node as destination node, execute:
According to the connection relationship, the authentication information of the destination node, which is sent to, has connection relationship with the destination node
Distributed node, wherein the authentication information, comprising: the essential information of the destination node and the destination node
Access key;
After receiving the successful information of certification that each distributed node returns, sent to each distributed node
Software Development Kit, service installation kit and corresponding installation instruction.
9. distributed type assemblies according to claim 7 or 8 dispose managing device, which is characterized in that
The visualization function menu, comprising: general view function menu, Service Management Function menu, monitoring function menu and cluster
Management function menu;
The feature operation unit, is used for:
When receiving the triggering to the general view function menu, the statistics Kudu service Kudu service type that includes, object are deposited
The query service type and the Kudu service type that the storage service Storage Service Type that includes, query service include are corresponding
The corresponding distributed node number of distributed node number, the Storage Service Type and corresponding point of the query service type
Cloth node number;The total number of the distributed node is counted, and counts the structured storage of all distributed nodes
Total capacity and the structured storage capacity occupied;The result counted is shown in graphical form;
When receiving the triggering to the Service Management Function menu, statistical fractals type and each described service type
The essential information of corresponding distributed node, wherein the service type includes: Kudu service, query service and service peace
Dress;It is serviced for the Kudu, counts and show with chart mode the fortune of the Kudu service of the distributed node installation
Market condition, and start and stop operation and modification service setting are carried out to the Kudu service of distributed node installation
Operation;For the query service, the query service of the distributed node installation is counted and shown with chart mode, with
And the operating condition of the mounted query service of distributed node, and to the query service of the distributed node into
Row starts or stops operation;
When receiving the triggering to the cluster management function menu, increase/deletion distributed node, to the distribution
Formula node is remotely controlled, installation settings and the modification distribution to the Network Time Protocol in the distributed node
The title of node.
10. distributed type assemblies according to claim 9 dispose managing device, which is characterized in that the feature operation unit,
It is further used for:
When receiving the triggering to the monitoring function menu, the distribution that the monitoring unit monitors in real time is shown
The operating status and service state of node, and according to the operating status and service state of the distributed node, statistics is described to divide
Operating condition and occupation condition of the cloth node when running Kudu service.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811203205.4A CN109379425A (en) | 2018-10-16 | 2018-10-16 | Distributed cluster deployment management method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811203205.4A CN109379425A (en) | 2018-10-16 | 2018-10-16 | Distributed cluster deployment management method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109379425A true CN109379425A (en) | 2019-02-22 |
Family
ID=65399973
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811203205.4A Pending CN109379425A (en) | 2018-10-16 | 2018-10-16 | Distributed cluster deployment management method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109379425A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110083649A (en) * | 2019-04-24 | 2019-08-02 | 北京电子工程总体研究所 | It is a kind of based on cold, warm, dsc data data management system and data managing method |
CN110233767A (en) * | 2019-07-26 | 2019-09-13 | 苏州浪潮智能科技有限公司 | Service configuration method, system, device and the readable storage medium storing program for executing of distributed type assemblies |
CN110493061A (en) * | 2019-08-30 | 2019-11-22 | 浪潮软件股份有限公司 | A kind of management method and system of NTP cluster |
CN110995871A (en) * | 2019-12-24 | 2020-04-10 | 浪潮云信息技术有限公司 | Method for realizing high availability of KV storage service |
CN112559186A (en) * | 2020-12-22 | 2021-03-26 | 北京云思畅想科技有限公司 | Novel Kubernetes container resource expansion and contraction method |
CN113448947A (en) * | 2021-07-09 | 2021-09-28 | 烽火通信科技股份有限公司 | Method and device for distributed deployment, operation and maintenance of mongo database |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101499027A (en) * | 2009-03-06 | 2009-08-05 | 赵晓宇 | Intelligent memory system based on independent kernel and distributed architecture |
CN103581935A (en) * | 2012-07-20 | 2014-02-12 | 上海泛创通信技术有限公司 | Femtocell test equipment performance expansion method based on distributed architecture |
CN106101213A (en) * | 2016-06-08 | 2016-11-09 | 四川新环佳科技发展有限公司 | Information-distribution type storage method |
CN106921742A (en) * | 2017-03-09 | 2017-07-04 | 郑州云海信息技术有限公司 | The system and method for storm Distributed Application clusters is built in a kind of K UX3.0 operating systems |
CN108228796A (en) * | 2017-12-29 | 2018-06-29 | 百度在线网络技术(北京)有限公司 | Management method, device, system, server and the medium of MPP databases |
-
2018
- 2018-10-16 CN CN201811203205.4A patent/CN109379425A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101499027A (en) * | 2009-03-06 | 2009-08-05 | 赵晓宇 | Intelligent memory system based on independent kernel and distributed architecture |
CN103581935A (en) * | 2012-07-20 | 2014-02-12 | 上海泛创通信技术有限公司 | Femtocell test equipment performance expansion method based on distributed architecture |
CN106101213A (en) * | 2016-06-08 | 2016-11-09 | 四川新环佳科技发展有限公司 | Information-distribution type storage method |
CN106921742A (en) * | 2017-03-09 | 2017-07-04 | 郑州云海信息技术有限公司 | The system and method for storm Distributed Application clusters is built in a kind of K UX3.0 operating systems |
CN108228796A (en) * | 2017-12-29 | 2018-06-29 | 百度在线网络技术(北京)有限公司 | Management method, device, system, server and the medium of MPP databases |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110083649A (en) * | 2019-04-24 | 2019-08-02 | 北京电子工程总体研究所 | It is a kind of based on cold, warm, dsc data data management system and data managing method |
CN110233767A (en) * | 2019-07-26 | 2019-09-13 | 苏州浪潮智能科技有限公司 | Service configuration method, system, device and the readable storage medium storing program for executing of distributed type assemblies |
CN110493061A (en) * | 2019-08-30 | 2019-11-22 | 浪潮软件股份有限公司 | A kind of management method and system of NTP cluster |
CN110995871A (en) * | 2019-12-24 | 2020-04-10 | 浪潮云信息技术有限公司 | Method for realizing high availability of KV storage service |
CN112559186A (en) * | 2020-12-22 | 2021-03-26 | 北京云思畅想科技有限公司 | Novel Kubernetes container resource expansion and contraction method |
CN113448947A (en) * | 2021-07-09 | 2021-09-28 | 烽火通信科技股份有限公司 | Method and device for distributed deployment, operation and maintenance of mongo database |
CN113448947B (en) * | 2021-07-09 | 2023-10-27 | 烽火通信科技股份有限公司 | Method and device for distributed deployment operation and maintenance of mongo database |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109379425A (en) | Distributed cluster deployment management method and device | |
WO2021017301A1 (en) | Management method and apparatus based on kubernetes cluster, and computer-readable storage medium | |
WO2018113556A1 (en) | Network operation support system and network device management method | |
US8265973B2 (en) | Analytic-based scaling of information technology resources | |
JP4304535B2 (en) | Information processing apparatus, program, modular system operation management system, and component selection method | |
CN106487574A (en) | Automatic operating safeguards monitoring system | |
CN104360878B (en) | A kind of method and device of application software deployment | |
WO2023142054A1 (en) | Container microservice-oriented performance monitoring and alarm method and alarm system | |
CN109697153A (en) | Monitoring method, monitoring system and computer readable storage medium | |
Trihinas et al. | Monitoring elastically adaptive multi-cloud services | |
US10318333B2 (en) | Optimizing allocation of virtual machines in cloud computing environment | |
CN105471671A (en) | Method for customizing monitoring rules of cloud platform resources | |
CN104022903A (en) | One-stop automatic operation and maintaining system | |
CN104009883A (en) | Computer resource centralized remote real-time monitoring system and method | |
CN105653425A (en) | Complicated event processing engine based monitoring system | |
CN110519100A (en) | A kind of more cluster management methods, terminal and computer readable storage medium | |
CN110365762A (en) | Service processing method, device, equipment and storage medium | |
EP3011474A1 (en) | Monitoring a computing network | |
US20120259960A1 (en) | Dynamic Self-Configuration of Heterogenous Monitoring Agent Networks | |
CN113220422B (en) | Method and system for modifying Pod network interface based on operation of CNI plug-in K8s | |
CN109361525A (en) | Restart method, apparatus, controlling terminal and medium that distributed deployment services more | |
US20220182851A1 (en) | Communication Method and Apparatus for Plurality of Administrative Domains | |
CN111984505A (en) | Operation and maintenance data acquisition engine and acquisition method | |
CN114168297A (en) | Method, device, equipment and medium for scheduling collection tasks | |
CN110740047B (en) | Network slice management arrangement system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190222 |
|
RJ01 | Rejection of invention patent application after publication |