CN111866048A - Management method, agent equipment, management equipment, main server and system - Google Patents

Management method, agent equipment, management equipment, main server and system Download PDF

Info

Publication number
CN111866048A
CN111866048A CN201910365151.XA CN201910365151A CN111866048A CN 111866048 A CN111866048 A CN 111866048A CN 201910365151 A CN201910365151 A CN 201910365151A CN 111866048 A CN111866048 A CN 111866048A
Authority
CN
China
Prior art keywords
server
equipment
slave
agent
management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910365151.XA
Other languages
Chinese (zh)
Other versions
CN111866048B (en
Inventor
王杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Suzhou Software Technology Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Suzhou Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Suzhou Software Technology Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201910365151.XA priority Critical patent/CN111866048B/en
Publication of CN111866048A publication Critical patent/CN111866048A/en
Application granted granted Critical
Publication of CN111866048B publication Critical patent/CN111866048B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1034Reaction to server failures by a load balancer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/101Server selection for load balancing based on network conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1029Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer And Data Communications (AREA)
  • Hardware Redundancy (AREA)

Abstract

The embodiment of the invention provides a management method, agent equipment, a main server, management equipment, a system and a computer readable storage medium, wherein the method comprises the following steps: acquiring a main server corresponding to the agent equipment from management equipment; wherein the master server manages at least one slave server; acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device; and executing the processing of the current task with the slave server. Therefore, the balance management of a plurality of servers is realized, and the problem that corresponding services cannot be provided under the condition that a single-point server fails is solved.

Description

Management method, agent equipment, management equipment, main server and system
Technical Field
The present invention relates to the field of information processing technologies, and in particular, to a management method, an agent device, a management device, a main server, a system, and a computer-readable storage medium.
Background
The Apache Ambari is a free open source distributed Hadoop management tool, can conveniently create, manage and monitor a Hadoop cluster, wherein the Hadoop cluster is in a broad sense, refers to the whole ecological circle of Hadoop (such as Hive, Hbase, Sqoop, Zookeeper and the like), and not only refers to Hadoop. Ambari provides an intuitive and easy-to-use web page administration page through its Restful APIs.
Ambari can bring the following convenience to Hadoop users: simplified installation, configuration and management; centralized security settings; visualizing the health state of the cluster; high expansibility and customization.
However, the Ambari management platform has single-point fault risk and management problems for super-large cluster nodes.
Disclosure of Invention
To solve the foregoing technical problem, embodiments of the present invention provide a management method, an agent device, a management device, a main server, a system, and a computer-readable storage medium.
In a first aspect, a management method is provided, which is applied to a proxy device, and the method includes:
acquiring a main server corresponding to the agent equipment from management equipment; wherein the master server manages at least one slave server;
acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device;
and executing the processing of the current task with the slave server.
In a second aspect, a management method is provided, which is applied to a management device, and the method includes:
distributing a corresponding main server for the agent equipment; wherein the master server is configured to manage at least one slave server, and the slave server is configured to manage the agent device.
In a third aspect, a management method is provided, which is applied to a master server, where the master server is used to manage at least one slave server, and the method includes:
distributing a slave server for the agent equipment; the slave server is used for managing the proxy equipment.
In a fourth aspect, there is provided a proxy device comprising:
the first communication interface acquires the corresponding main server from the management equipment; acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device;
and the first processor and the slave server execute the processing of the current task.
In a fifth aspect, there is provided a management device, comprising:
the second communication interface is used for distributing a corresponding main server for the agent equipment; wherein the master server is configured to manage at least one slave server, and the slave server is configured to manage the agent device.
In a sixth aspect, there is provided a master server for managing at least one slave server, the master server comprising:
a third communication interface for distributing the slave server to the agent device; the slave server is used for managing the proxy equipment.
In a seventh aspect, a computer-readable storage medium is provided for storing a computer program, where the computer program makes a computer execute the method in any one of the first to third aspects or its implementation manners.
According to the technical scheme of the embodiment of the invention, the main server and the slave servers are flexibly distributed to the proxy equipment, so that the proxy equipment is managed through the main server and the slave servers, the balanced management of a plurality of servers is realized, and the problem that corresponding services cannot be provided under the condition that a single-point server fails is solved because the corresponding slave servers and the main server flexibly specified by the management equipment can be flexibly configured.
Drawings
FIG. 1 is a first schematic flow chart of a management method according to an embodiment of the present invention;
FIG. 2 is a system architecture diagram according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart diagram II of a management method according to an embodiment of the present invention;
FIG. 4 is a third schematic flow chart of a management method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a proxy device composition structure according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a management device according to an embodiment of the present invention;
Fig. 7 is a schematic structural diagram of a main server according to an embodiment of the present invention.
Detailed Description
Technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
As shown in fig. 1, an embodiment of the present invention provides a management method, which is applied to a proxy device, where the method includes:
step 11: acquiring a main server corresponding to the agent equipment from management equipment; wherein the master server manages at least one slave server;
step 12: acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device;
step 13: and executing the processing of the current task with the slave server.
It should be noted that this embodiment may be applied to Ambari provisioning, in which a plurality of independent servers (Ambari servers) are used to manage proxy devices, which may be referred to as Ambari Agents.
The federation is mainly based on a management device, such as Zookeeper, and selects one of a plurality of servers AmbariServers as a main server, such as called Leader; the remaining Servers, Ambari Servers, all act as slave Servers and may be referred to as Follower Servers, for example.
And distributing the Agent equipment Ambari Agent managed by each slave Server Follower Server by the master Server Leader Server.
The management device, that is, the Zookeeper can be realized by embedding the Zookeeper in Ambari Server, that is, one of the servers can be used as the management device; of course, an external Zookeeper may also be used as the management device.
The method further comprises the following steps:
acquiring a connection address of the configured management equipment; and connecting the management equipment based on the connection address of the management equipment.
That is, the connection address of the federation Zookeeper is configured in the proxy device Ambari Agent.
Still further, the acquiring, by the slave management device, the master server corresponding to the agent device includes:
and when the proxy equipment is started for the first time, acquiring the main server corresponding to the proxy equipment from the management equipment.
When the agent device is started for the first time, acquiring the main server corresponding to the agent device from the management device includes:
When the agent equipment is started for the first time, address information of a local reported heartbeat slave server cached locally is loaded;
and if the local cache does not exist or the heartbeat return information cannot be received, the connection management equipment acquires the main server corresponding to the proxy equipment from the management equipment.
Before the obtaining of the slave server allocated by the master server for the agent device, the method further includes:
and sending request information for requesting to distribute a new slave server to the master server.
The heartbeat return information cannot be received, that is, the mode that the proxy device determines that the heartbeat return information cannot be received can be that the heartbeat return information cannot be received for N times, and the heartbeat return information cannot be received; wherein N is an integer. The method can be understood as that the heartbeat return information cannot be received once, that is, the heartbeat return information cannot be received, or can be understood as that the channel return information cannot be received at least twice, that is, the heartbeat return information cannot be received.
Taking the case that the heartbeat return information cannot be received for multiple times as an example, the explanation is as follows: when the proxy equipment, namely the Ambari Agent, is started, the current report heartbeat Ambari Server address of the local cache is actively loaded, if the local cache does not exist or heartbeat return information can not be received for many times, the Zookeeper is connected to obtain the current Leader Server, a request is sent to the Leader Ambari Server to distribute a new Ambari Server, and the new Ambari Server is updated to the Zookeeper and cached to the local.
It is further noted that the method further comprises: the heartbeat is reported to the slave server.
And determining that one of the slave servers connected with the proxy equipment is unavailable through the heartbeat information, and judging whether to regenerate the Leader Server or not by a management equipment such as a Zookeeper when one of the Server services is unavailable, and redistributing the AmbaroAgents. That is, when the agent device confirms that the slave server is not available, the management device may reassign the master server to the agent device, and reassign a new server to the agent device by the master server.
In this embodiment, based on the federation scheme, a master Server Leader provides a web page and an API interface externally, and when a request is sent to a Follower Server node, the Follower Server forwards the request to the Leader Server, and the Leader Server executes related operations and distributes the operations to each Follower Server.
Further describing the function of the proxy equipment, taking the proxy equipment as Ambari Agent in Ambari federation model as an example to specifically describe:
configuring a federation Zookeeper connection address in Ambari Agent;
the Ambari Agent is started for the first time to obtain the current Leader Ambari Server from the Zookeeper;
the Ambari Agent requests a Leader Ambari Server to distribute and manage Ambari Server nodes for the Leader Ambari Server;
The Ambari Agent reports the heartbeat to the Ambari Server managed by the Ambari Agent;
managing the Ambari Server to receive the heartbeat and returning to the operation required by the next step (the operation is mainly triggered by a Web front end and RestAPI and is distributed to each FollowerAmbari Server through a Leader Ambari Server, and each Ambari Server is accompanied with the heartbeat Response to each Ambari Agent);
the Ambari Agent executes the relevant operation, feeds back the relevant result to the management Ambari Server along with the heartbeat, and the management Ambari Server is updated to the relevant database.
Regarding the architecture diagram of Ambari federation system for the present embodiment, referring to fig. 2, a master server and at least one slave server are determined from Ambari servers; the master server and at least one slave server then serve the plurality of proxy devices.
By adopting the scheme, the agent equipment can be managed by adopting the master server and the slave servers, so that the balanced management of a plurality of servers is realized, and the problem that corresponding services cannot be provided under the condition that a single-point server fails is solved because the corresponding slave servers and the master server flexibly specified by the management equipment can be flexibly configured.
As shown in fig. 3, an embodiment of the present invention provides a management method, which is applied to a management device, and the method includes:
Step 21: distributing a corresponding main server for the agent equipment; wherein the master server is configured to manage at least one slave server, and the slave server is configured to manage the agent device.
It should be noted that this embodiment may be applied to Ambari provisioning, in which a plurality of independent servers (Ambari servers) are used to manage proxy devices, which may be referred to as Ambari Agents.
The federation is mainly based on a management device, such as Zookeeper, and selects one of a plurality of servers AmbariServers as a main server, such as called Leader; the remaining Servers, Ambari Servers, all act as slave Servers and may be referred to as Follower Servers, for example.
And distributing the Agent equipment Ambari Agent managed by each slave Server Follower Server by the master Server Leader Server.
The management device, that is, the Zookeeper can be realized by embedding the Zookeeper in Ambari Server, that is, one of the servers can be used as the management device; of course, an external Zookeeper may also be used as the management device.
The method further comprises the following steps:
and configuring the connection address of the management device for the agent device.
That is, the connection address of the federation Zookeeper is configured in the proxy device Ambari Agent.
In this embodiment, based on the federation scheme, a master Server Leader provides a web page and an API interface externally, and when a request is sent to a Follower Server node, the Follower Server forwards the request to the Leader Server, and the Leader Server executes related operations and distributes the operations to each Follower Server.
By adopting the scheme, the agent equipment can be managed by adopting the master server and the slave servers, so that a plurality of servers are balanced to manage the cluster, and the problem that corresponding services cannot be provided under the condition that the servers have faults is solved because the corresponding slave servers and the master servers flexibly specified by the management equipment can be flexibly configured.
As shown in fig. 4, an embodiment of the present invention provides a management method, which is applied to a master server, where the master server is configured to manage at least one slave server, and the method includes:
step 31: distributing a slave server for the agent equipment; the slave server is used for managing the proxy equipment.
It should be noted that this embodiment may be applied to Ambari provisioning, in which a plurality of independent servers (Ambari servers) are used to manage proxy devices, which may be referred to as Ambari Agents.
The federation is mainly based on a management device, such as Zookeeper, and selects one of a plurality of servers AmbariServers as a main server, such as called Leader; the remaining Servers, Ambari Servers, all act as slave Servers and may be referred to as Follower Servers, for example.
And distributing the Agent equipment Ambari Agent managed by each slave Server Follower Server by the master Server Leader Server.
The management device, that is, the Zookeeper can be realized by embedding the Zookeeper in Ambari Server, that is, one of the servers can be used as the management device; of course, an external Zookeeper may also be used as the management device.
The method further comprises the following steps:
receiving request information which is sent by the agent equipment and used for requesting to distribute a new slave server;
and allocating a new slave server for the proxy equipment based on the request information.
The method further comprises the following steps:
receiving a processing request forwarded from the server, executing a processing operation based on the processing request, and distributing a processing result to the slave server.
That is to say, when the proxy device, namely Ambari Agent, starts, it actively loads the current reported heartbeat Ambari Server address of the local cache, if the local cache does not exist or cannot receive the heartbeat return information many times, it connects to the Zookeeper to obtain the current Leader Server, and sends a request to the Leader Ambari Server to allocate a new Ambari Server, and updates to the Zookeeper and caches to the local.
The method further comprises the following steps: providing an interface of the web page with the API. In this embodiment, based on the federation scheme, a master Server Leader provides a web page and an API interface externally, and when a request is sent to a Follower Server node, the Follower Server forwards the request to the Leader Server, and the Leader Server executes related operations and distributes the operations to the Follower servers.
By adopting the scheme, the agent equipment can be managed by adopting the master server and the slave servers, so that the balanced management of a plurality of servers is realized, and the problem that corresponding services cannot be provided under the condition that a single-point server fails is solved because the corresponding slave servers and the master server flexibly specified by the management equipment can be flexibly configured.
As shown in fig. 5, an embodiment of the present invention provides a proxy device, including:
a first communication interface 41 that acquires a corresponding master server from the management apparatus; acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device;
and a first processor 42 for performing a process of a current task with the slave server.
It should be noted that this embodiment may be applied to Ambari provisioning, in which a plurality of independent servers (Ambari servers) are used to manage proxy devices, which may be referred to as Ambari Agents.
The federation is mainly based on a management device, such as Zookeeper, and selects one of a plurality of servers AmbariServers as a main server, such as called Leader; the remaining Servers, Ambari Servers, all act as slave Servers and may be referred to as Follower Servers, for example.
And distributing the Agent equipment Ambari Agent managed by each slave Server Follower Server by the master Server Leader Server.
The management device, that is, the Zookeeper can be realized by embedding the Zookeeper in Ambari Server, that is, one of the servers can be used as the management device; of course, an external Zookeeper may also be used as the management device.
The first communication interface 41 acquires a connection address of the configured management device; and connecting the management equipment based on the connection address of the management equipment.
That is, the connection address of the federation Zookeeper is configured in the proxy device Ambari Agent.
Still further, when the first processor 42 is initially started, the primary server corresponding to the agent device is acquired from the management device.
The first processor 42, when initially started, loads the address information of the local reported heartbeat slave server cached locally; and if the local cache does not exist or the heartbeat return information cannot be received, the connection management equipment acquires the main server corresponding to the proxy equipment from the management equipment.
The first communication interface transmits request information requesting allocation of a new slave server to the master server.
The heartbeat return information cannot be received, that is, the mode that the proxy device determines that the heartbeat return information cannot be received can be that the heartbeat return information cannot be received for N times, and the heartbeat return information cannot be received; wherein N is an integer. The method can be understood as that the heartbeat return information cannot be received once, that is, the heartbeat return information cannot be received, or can be understood as that the channel return information cannot be received at least twice, that is, the heartbeat return information cannot be received.
Taking the case that the heartbeat return information cannot be received for multiple times as an example, the explanation is as follows: when the proxy equipment, namely the Ambari Agent, is started, the current report heartbeat Ambari Server address of the local cache is actively loaded, if the local cache does not exist or heartbeat return information can not be received for many times, the Zookeeper is connected to obtain the current Leader Server, a request is sent to the Leader Ambari Server to distribute a new Ambari Server, and the new Ambari Server is updated to the Zookeeper and cached to the local.
It is further noted that the first communication interface reports heartbeats to the slave server.
And determining that one of the slave servers connected with the proxy equipment is unavailable through the heartbeat information, and judging whether to regenerate the Leader Server or not by a management equipment such as a Zookeeper when one of the Server services is unavailable, and redistributing the AmbaroAgents. That is, when the agent device confirms that the slave server is not available, the management device may reassign the master server to the agent device, and reassign a new server to the agent device by the master server.
In this embodiment, based on the federation scheme, a master Server Leader provides a web page and an API interface externally, and when a request is sent to a Follower Server node, the Follower Server forwards the request to the Leader Server, and the Leader Server executes related operations and distributes the operations to each Follower Server.
By adopting the scheme, the agent equipment can be managed by adopting the master server and the slave servers, so that the balanced management of a plurality of servers is realized, and the problem that corresponding services cannot be provided under the condition that the servers have faults is solved because the corresponding slave servers and the master servers flexibly specified by the management equipment can be flexibly configured.
As shown in fig. 6, an embodiment of the present invention provides a management device, including:
a second communication interface 51 for allocating a corresponding master server to the agent device; wherein the master server is configured to manage at least one slave server, and the slave server is configured to manage the agent device.
It should be noted that this embodiment may be applied to Ambari provisioning, in which a plurality of independent servers (Ambari servers) are used to manage proxy devices, which may be referred to as Ambari Agents.
The federation is mainly based on a management device, such as Zookeeper, and selects one of a plurality of servers AmbariServers as a main server, such as called Leader; the remaining Servers, Ambari Servers, all act as slave Servers and may be referred to as Follower Servers, for example.
And distributing the Agent equipment Ambari Agent managed by each slave Server Follower Server by the master Server Leader Server.
The management device, that is, the Zookeeper can be realized by embedding the Zookeeper in Ambari Server, that is, one of the servers can be used as the management device; of course, an external Zookeeper may also be used as the management device.
And a second communication interface 51 configured to configure a connection address of the management device for the agent device.
That is, the connection address of the federation Zookeeper is configured in the proxy device Ambari Agent.
In this embodiment, based on the federation scheme, a master Server Leader provides a web page and an API interface externally, and when a request is sent to a Follower Server node, the Follower Server forwards the request to the Leader Server, and the Leader Server executes related operations and distributes the operations to each Follower Server.
By adopting the scheme, the agent equipment can be managed by adopting the master server and the slave servers, so that a plurality of servers are balanced to manage the cluster, and the problem that corresponding services cannot be provided under the condition that a single-point server fails is solved because the corresponding slave servers and the master server flexibly specified by the management equipment can be flexibly configured.
As shown in fig. 7, an embodiment of the present invention provides a master server, where the master server is configured to manage at least one slave server, and the master server includes:
a third communication interface 61 for allocating a slave server to the agent apparatus; the slave server is used for managing the proxy equipment.
It should be noted that this embodiment may be applied to Ambari provisioning, in which a plurality of independent servers (Ambari servers) are used to manage proxy devices, which may be referred to as Ambari Agents.
The federation is mainly based on a management device, such as Zookeeper, and selects one of a plurality of servers AmbariServers as a main server, such as called Leader; the remaining Servers, Ambari Servers, all act as slave Servers and may be referred to as Follower Servers, for example.
And distributing the Agent equipment Ambari Agent managed by each slave Server Follower Server by the master Server Leader Server.
The management device, that is, the Zookeeper can be realized by embedding the Zookeeper in Ambari Server, that is, one of the servers can be used as the management device; of course, an external Zookeeper may also be used as the management device.
The third communication interface 61 receives the request information of requesting to distribute a new slave server sent by the agent device; and allocating a new slave server for the proxy equipment based on the request information.
The main server further includes:
a third processor 62 for performing processing operations based on the processing request;
the third communication interface 61 receives a processing request forwarded from the server; and distributing the processing result to the slave server.
That is to say, when the proxy device, namely Ambari Agent, starts, it actively loads the current reported heartbeat Ambari Server address of the local cache, if the local cache does not exist or cannot receive the heartbeat return information many times, it connects to the Zookeeper to obtain the current Leader Server, and sends a request to the Leader Ambari Server to allocate a new Ambari Server, and updates to the Zookeeper and caches to the local.
And the third communication interface provides an interface between the web page of the webpage and the API. In this embodiment, based on the federation scheme, a master Server Leader provides a web page and an API interface externally, and when a request is sent to a Follower Server node, the Follower Server forwards the request to the Leader Server, and the Leader Server executes related operations and distributes the operations to the Follower servers.
By adopting the scheme, the agent equipment can be managed by adopting the master server and the slave servers, so that a plurality of servers are balanced to manage the cluster, and the problem that corresponding services cannot be provided under the condition that a single-point server fails is solved because the corresponding slave servers and the master server flexibly specified by the management equipment can be flexibly configured.
The embodiment of the application also provides a computer readable storage medium for storing the computer program.
Optionally, the computer-readable storage medium may be applied to any device in the embodiments of the present application, and the computer program enables a computer to execute corresponding processes implemented by a network device and a terminal device in the methods in the embodiments of the present application, which are not described herein again for brevity.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processor, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A management method is applied to a proxy device, and comprises the following steps:
acquiring a main server corresponding to the agent equipment from management equipment; wherein the master server manages at least one slave server;
acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device;
and executing the processing of the current task with the slave server.
2. The method of claim 1, wherein the obtaining, from the management device, the master server corresponding to the agent device includes:
and when the proxy equipment is started for the first time, acquiring the main server corresponding to the proxy equipment from the management equipment.
3. The method according to claim 2, wherein the obtaining, from a management device, the primary server corresponding to the proxy device when the proxy device is initially started comprises:
when the agent equipment is started for the first time, address information of a local reported heartbeat slave server cached locally is loaded;
and if the local cache does not exist or the heartbeat return information cannot be received, the connection management equipment acquires the main server corresponding to the proxy equipment from the management equipment.
4. The method of claim 1, wherein before the obtaining the slave server assigned by the master server for the agent device, the method further comprises:
and sending request information for requesting to distribute a new slave server to the master server.
5. A management method is applied to a management device, and comprises the following steps:
distributing a corresponding main server for the agent equipment; wherein the master server is configured to manage at least one slave server, and the slave server is configured to manage the agent device.
6. A management method applied to a master server for managing at least one slave server, the method comprising:
distributing a slave server for the agent equipment; the slave server is used for managing the proxy equipment.
7. The method of claim 6, further comprising:
receiving request information which is sent by the agent equipment and used for requesting to distribute a new slave server;
and allocating a new slave server for the proxy equipment based on the request information.
8. The method of claim 6, further comprising:
providing an interface of the web page with the API.
9. A proxy device, comprising:
the first communication interface acquires the corresponding main server from the management equipment; acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device;
and the first processor and the slave server execute the processing of the current task.
10. The proxy device of claim 9, wherein the first processor, when initially started, loads locally cached address information for a slave server that locally reports heartbeats; and if the local cache does not exist or the heartbeat return information cannot be received, the first communication interface is connected with the management equipment to acquire the main server corresponding to the proxy equipment from the management equipment.
11. A management device, comprising:
the second communication interface is used for distributing a corresponding main server for the agent equipment; wherein the master server is configured to manage at least one slave server, and the slave server is configured to manage the agent device.
12. A master server for managing at least one slave server, the master server comprising:
a third communication interface for distributing the slave server to the agent device; the slave server is used for managing the proxy equipment.
13. A management system, the system comprising:
the proxy equipment is used for acquiring the main server corresponding to the proxy equipment from the management equipment; acquiring a slave server distributed by the master server for the agent equipment; wherein the slave server is used for managing the agent device; performing processing of a current task with the slave server;
the management equipment is used for distributing the main server for the agent equipment;
the main server is used for distributing the slave servers for the agent equipment;
and the slave server is used for executing the processing of the current task together with the proxy equipment.
14. The system of claim 13, wherein the host server is configured to provide an interface between a web page of a web page and an API; receiving a processing request forwarded from a server, executing processing operation based on the processing request, and distributing a processing result to the slave server;
and the slave server is used for forwarding the processing request to the main server and receiving the processing result fed back by the main server.
15. A computer storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements the steps of the method of any one of claims 1-8.
CN201910365151.XA 2019-04-30 2019-04-30 Management method, agent equipment, management equipment, main server and system Active CN111866048B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910365151.XA CN111866048B (en) 2019-04-30 2019-04-30 Management method, agent equipment, management equipment, main server and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910365151.XA CN111866048B (en) 2019-04-30 2019-04-30 Management method, agent equipment, management equipment, main server and system

Publications (2)

Publication Number Publication Date
CN111866048A true CN111866048A (en) 2020-10-30
CN111866048B CN111866048B (en) 2022-07-01

Family

ID=72965946

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910365151.XA Active CN111866048B (en) 2019-04-30 2019-04-30 Management method, agent equipment, management equipment, main server and system

Country Status (1)

Country Link
CN (1) CN111866048B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112416969A (en) * 2020-11-12 2021-02-26 北京偶数科技有限公司 Parallel task scheduling system in distributed database

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105208090A (en) * 2015-08-19 2015-12-30 江苏农牧人电子商务股份有限公司 Zookeeper-based Leader selection method
CN106878472A (en) * 2017-04-20 2017-06-20 广东马良行科技发展有限公司 A kind of distributed type assemblies data service method and system
CN106961359A (en) * 2017-05-22 2017-07-18 郑州云海信息技术有限公司 A kind of automatic deployment and monitoring method and device of Solr services
CN107332880A (en) * 2017-06-05 2017-11-07 深圳市酷开网络科技有限公司 Method, device and computer-readable recording medium that information is pushed

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105208090A (en) * 2015-08-19 2015-12-30 江苏农牧人电子商务股份有限公司 Zookeeper-based Leader selection method
CN106878472A (en) * 2017-04-20 2017-06-20 广东马良行科技发展有限公司 A kind of distributed type assemblies data service method and system
CN106961359A (en) * 2017-05-22 2017-07-18 郑州云海信息技术有限公司 A kind of automatic deployment and monitoring method and device of Solr services
CN107332880A (en) * 2017-06-05 2017-11-07 深圳市酷开网络科技有限公司 Method, device and computer-readable recording medium that information is pushed

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112416969A (en) * 2020-11-12 2021-02-26 北京偶数科技有限公司 Parallel task scheduling system in distributed database

Also Published As

Publication number Publication date
CN111866048B (en) 2022-07-01

Similar Documents

Publication Publication Date Title
CN110365748B (en) Service data processing method and device, storage medium and electronic device
CN108920670A (en) Cache synchronization method, device, system and storage medium
CN105141400B (en) A kind of high availability cluster management method and relevant device
CN104796445B (en) Server node carries out the method, apparatus of source synchronous
CN109586969A (en) Content distributing network disaster recovery method, device, computer equipment and storage medium
CN105450705B (en) Business data processing method and equipment
CN108989430B (en) Load balancing method, device and storage medium
CN102187315A (en) Methods and apparatus to get feedback information in virtual environment for server load balancing
CN104506654B (en) Cloud computing system and Dynamic Host Configuration Protocol server backup method
CN108111628B (en) Dynamic capacity-expansion storage method and system
CN107211003A (en) Distributed memory system and the method for managing metadata
CN105794182B (en) The processing method and its system of server failure are locked in distributed system
CN108038005A (en) Shared resource access method, client, server-side, system based on zookeeper
DE102015015196A1 (en) Management system and management system management system
CN110244901B (en) Task allocation method and device and distributed storage system
JP6582445B2 (en) Thin client system, connection management device, virtual machine operating device, method, and program
US20160234129A1 (en) Communication system, queue management server, and communication method
JP5647561B2 (en) Power system supervisory control system
CN111866048B (en) Management method, agent equipment, management equipment, main server and system
CN113726546B (en) Configuration method, device, system, computing equipment and storage medium
CN104869166A (en) Desktop cloud cluster system and desktop cloud cluster system information interaction method
CN107741994A (en) A kind of data-updating method and device
CN107770296B (en) Method and device for allocating addresses
CN108055342A (en) A kind of data monitoring method and device
CN107547622B (en) Resource adjusting method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant