CN110198225A - A kind of management method and management server of more clusters - Google Patents

A kind of management method and management server of more clusters Download PDF

Info

Publication number
CN110198225A
CN110198225A CN201810162337.0A CN201810162337A CN110198225A CN 110198225 A CN110198225 A CN 110198225A CN 201810162337 A CN201810162337 A CN 201810162337A CN 110198225 A CN110198225 A CN 110198225A
Authority
CN
China
Prior art keywords
cluster
unit
plug
managed
management server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810162337.0A
Other languages
Chinese (zh)
Inventor
吴宽展
沈国栋
徐硕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Suzhou Software Technology Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Suzhou Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Suzhou Software Technology Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201810162337.0A priority Critical patent/CN110198225A/en
Publication of CN110198225A publication Critical patent/CN110198225A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/04Network management architectures or arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/133Protocols for remote procedure calls [RPC]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/34Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters 

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses the management methods and management server of a kind of more clusters, the utilization rate of the hardware resource for improving more clusters.The management method of more clusters therein includes: the first request message that management server receives the first cluster of access, and the identification information of the first cluster of unique mark is obtained from first request message;The management server determines the first cluster plug-in unit corresponding with first cluster according to the identification information and mapping relations;Wherein, the mapping relations are used to indicate the identification information of each cluster and the corresponding relationship of cluster plug-in unit, and each cluster plug-in unit corresponds at least one cluster, and the type of cluster corresponding to same cluster plug-in unit is identical;The management server calls the first cluster plug-in unit, realizes the service function that first cluster includes.

Description

A kind of management method and management server of more clusters
Technical field
The present invention relates to cluster management technical field, in particular to a kind of the management method and management server of more clusters.
Background technique
Since clustering operation can reduce Single Point of Faliure data, present a fairly large number of server is with server The form of cluster occurs.Even under some complex situations, multiple clusters can be existed simultaneously, this just needs to carry out pipe to cluster Reason.
The way to manage of current more clusters is to pass through the management system pair for one management system of a Cluster Exploitation The cluster is managed.But under this way to manage, a cluster corresponds to a management system, is between each management system It is independent, data and resource-sharing can not be carried out, so that the utilization rate of hardware resource is lower.
As it can be seen that the way to manage of current more clusters causes the utilization rate of the hardware resource of more clusters lower.
Summary of the invention
The embodiment of the present invention provides the management method and management server of a kind of more clusters, for improving the hardware of more clusters The utilization rate of resource.
In a first aspect, providing a kind of management method of more clusters, which includes:
Management server receives the first request message of the first cluster of access, obtains only from first request message The identification information of one mark first cluster;
For the management server according to the identification information and mapping relations, determination is corresponding with first cluster First cluster plug-in unit;Wherein, the mapping relations be used to indicate each cluster identification information it is corresponding with cluster plug-in unit Relationship, each cluster plug-in unit correspond at least one cluster, and the type of cluster corresponding to same cluster plug-in unit is identical;
The management server calls the first cluster plug-in unit, realizes the service function that first cluster includes.
Using the management method of more clusters provided in an embodiment of the present invention, can be inserted for each Cluster Exploitation is corresponding Part, the institute which can integrate cluster is functional, is called correspond to by the management system of carrying on the management server in this way Plug-in unit can realize the management to cluster by managing corresponding plug-in unit.And the plug-in unit of each cluster can belong to one A management system, such a management system can correspond to multiple plug-in units, and each plug-in unit may correspond to one or more clusters, Multiple clusters can be managed based on a management system to realize.And since all clusters also are located at the same management system System, so that it may the data and resource-sharing between each cluster are realized, to improve the utilization rate of hardware resource.
Optionally, the method also includes:
The management server receives the second request message for adding cluster to be managed, from second request message Determine the type of the cluster to be managed;
The management server determines whether there is the second cluster plug-in unit, wherein the corresponding collection of the second cluster plug-in unit The type of group is identical as the type of the cluster to be managed;
The second cluster plug-in unit if it exists, then the cluster to be managed is mapped to described second by the management server Cluster plug-in unit, and update the mapping relations.
Optionally, the method also includes:
The management server determines the version information of the cluster to be managed from second request message;
If the management server determines that there are the second cluster plug-in units, and with the second cluster plug-in unit corresponding The version information of one cluster and the version information of the cluster to be managed are inconsistent, then obtain the program bag of third cluster plug-in unit, Wherein, the service function that described program packet includes for realizing the cluster to be managed;
The management server loads the program bag of the third cluster plug-in unit;
The cluster to be managed is mapped to the third cluster plug-in unit by the management server, and is updated the mapping and closed System.
Optionally, the method also includes:
If the management server, which determines, is not present the second cluster plug-in unit, the program of the 4th cluster plug-in unit is obtained Packet, wherein the service function that described program packet includes for realizing the cluster to be managed;
The program bag of the management server load and the 4th cluster plug-in unit;
The cluster to be managed is mapped to the 4th cluster plug-in unit by the management server, and is updated the mapping and closed System.
When above-mentioned three kinds optional modes describe and need to manage if there is new cluster to be managed under management system, more The process of new management system.When there is new cluster to be managed to need to manage, management system can be according to the class of cluster to be managed Type and version number determine whether to reload the plug-in unit of the cluster to be managed of exploitation.There are following three kinds of situations: first, if to Type and the version number for managing cluster are identical as the type of plug-in unit existing under management system and version number, then being just not required at this time Again the plug-in unit of cluster to be managed is developed, directly cluster to be managed can be mapped under existing plug-in unit, pass through the plug-in unit It can realize the service function that cluster to be managed includes.Second, if had under the type and management system of cluster to be managed Plug-in unit type it is not identical, then the plug-in unit under management system cannot achieve the service function that cluster to be managed includes, at this time It just needs to develop the plug-in unit of cluster to be managed again, and cluster to be managed is mapped under plug-in unit newly developed, by newly opening The plug-in unit of hair realizes the service function that cluster to be managed includes.Third, if under the type and management system of cluster to be managed The type of some plug-in units is identical, but the version of existing plug-in unit is not identical under the version and management system of cluster to be managed, that Existing plug-in unit usually cannot achieve the service function that cluster to be managed includes under management system, just need to develop again at this time The plug-in unit of cluster to be managed, and cluster to be managed is mapped under plug-in unit newly developed, with by plug-in unit newly developed realize to The service function that management cluster includes.
Optionally, the management server and first cluster pass through declarative state transmitting REST or remote process RPC is called to establish communication connection.
This optional mode describes the management system of carrying on the management server and establishes communication connection with cluster Mode.When establishing communication connection, can be transmitted by declarative state (Representational State Transfer, REST), it can also be established and be communicated to connect by remote procedure call (Remote Procedure Call, RPC).And REST and RPC be all based on hypertext transfer protocol (HyperText Transfer Protocol, HTTP) or transmission control protocol/because Special net interconnection protocol (Transmission Control Protocol/Internet Protocol, TCP/IP) it is further Optimization architecture is more convenient for realizing and be safeguarded for developer.
Second aspect, provides a kind of management server of more clusters, which includes:
Receiving unit is obtained from first request message for receiving the first request message of the first cluster of access Take the identification information for uniquely indicating first cluster;
Determination unit, for according to the identification information and mapping relations, determination to be corresponding with first cluster First cluster plug-in unit;Wherein, the mapping relations be used to indicate each cluster identification information it is corresponding with cluster plug-in unit Relationship, each cluster plug-in unit correspond at least one cluster, and the type of cluster corresponding to same cluster plug-in unit is identical;
Call unit realizes the service function that first cluster includes for calling the first cluster plug-in unit.
Optionally, the management server further includes updating unit;
Wherein, the receiving unit is also used to: the second request message for adding cluster to be managed is received, from described second The type of the cluster to be managed is determined in request message;
The determination unit is also used to: determining whether there is the second cluster plug-in unit, wherein the second cluster plug-in unit institute is right Answer the type of cluster identical as the type of the cluster to be managed;
The updating unit then maps to the cluster to be managed described for the second cluster plug-in unit if it exists Second cluster plug-in unit, and update the mapping relations.
Optionally, the management server further includes loading unit;
Wherein, the determination unit is also used to: the version of the cluster to be managed is determined from second request message This information;
If it is determined that there are the second cluster plug-in units, and the version letter of any cluster corresponding with the second cluster plug-in unit Breath is inconsistent with the version information of the cluster to be managed, then obtains the program bag of third cluster plug-in unit, wherein described program packet The service function for including for realizing the cluster to be managed;
The loading unit is used to load the program bag of the third cluster plug-in unit;
The updating unit is also used to: the cluster to be managed being mapped to the third cluster plug-in unit, and described in update Mapping relations.
Optionally, the management server further includes loading unit;
Wherein, the determination unit if it is determined that be not present the second cluster plug-in unit, then obtain the 4th cluster plug-in unit journey Sequence packet, wherein the service function that described program packet includes for realizing the cluster to be managed;
The loading unit is also used to load the program bag with the 4th cluster plug-in unit;
The updating unit is also used to map to the cluster to be managed the 4th cluster plug-in unit, and reflects described in update Penetrate relationship.
Optionally, the management server and first cluster pass through declarative state transmitting REST or remote process RPC is called to establish communication connection.
The technical effect of management server provided by the present application may refer to each implementation of above-mentioned first aspect Technical effect, details are not described herein again.
The third aspect, provides a kind of management server of more clusters, which includes:
At least one processor, and
The memory being connect at least one described processor;
Wherein, the memory is stored with the instruction that can be executed by least one described processor, described at least one It manages device and realizes such as the described in any item methods of first aspect by executing the instruction of the memory storage.
The technical effect of management server provided by the present application may refer to each implementation of above-mentioned first aspect Technical effect, details are not described herein again.
Fourth aspect provides a kind of computer storage medium, is stored thereon with computer program, the computer program quilt Such as first aspect described in any item methods are realized when processor executes.
5th aspect, additionally provide a kind of computer program product comprising instruction makes when run on a computer It obtains computer and executes method described in above-mentioned first aspect.
The embodiment of the invention provides a kind of management methods of new more clusters, can be for the integrated collection of each developing plug The functional corresponding plug-in unit of institute of group, calls corresponding plug-in unit can by the management system of carrying on the management server in this way To realize the management to cluster by managing corresponding plug-in unit.Such a management system can correspond to multiple plug-in units, often A plug-in unit may correspond to one or more clusters, so that multiple clusters can be managed based on a management system by realizing.And due to All clusters also are located at the same management system, so that it may the data and resource-sharing between each cluster are realized, to mention The high utilization rate of hardware resource.
Detailed description of the invention
Fig. 1 is a kind of structural schematic diagram of the management system for more clusters that the prior art provides;
Fig. 2 is the schematic architectural diagram of the management system of more clusters provided in an embodiment of the present invention;
Fig. 3 is a kind of flow diagram of the management method of more clusters provided in an embodiment of the present invention;
Fig. 4 is a kind of structural schematic diagram of the management server of more clusters provided in an embodiment of the present invention;
Fig. 5 is a kind of structural schematic diagram of the management server of more clusters provided in an embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction in the embodiment of the present invention Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described.
Referring to Figure 1, Fig. 1 is a kind of structural schematic diagram of the management system for more clusters that the prior art provides.Such as Fig. 1 institute Show, Fig. 1 is right respectively by there are for three clusters, naming to obtain 1# cluster, 2# cluster and 3# cluster according to sequencing respectively 1# management server, 2# management server and 3# management server are answered, deploys management application software in management server, is managed Corresponding cluster.If certain function may be implemented in 1# cluster, and the function cannot be achieved in 2# cluster, wants now real on 2# cluster The now function, this may need to by the data or resource stored on 1# cluster, but due between 1# cluster and 2# cluster Be it is independent, data and resource-sharing can not be carried out, therefore just need to redeploy 2# cluster, in addition replacement 2# cluster, it is seen then that The way to manage of current more clusters makes the utilization rate of hardware resource lower.
In consideration of it, the embodiment of the invention provides the management methods and system of a kind of new more clusters, it is intended to improve more collection The utilization rate of the hardware resource of group.
The management method of more clusters provided in an embodiment of the present invention, can be applied on computer, which includes can To be server, the program code of the management method of more clusters provided in an embodiment of the present invention can be run on server, according to The management method of more clusters realizes the management to more clusters.
Technical solution provided in an embodiment of the present invention is introduced with reference to the accompanying drawings of the specification.
Fig. 2 is referred to, Fig. 2 shows the schematic of the management system that can be applicable in more clusters provided in an embodiment of the present invention Architecture diagram, as shown in Fig. 2, the program generation that a separate server disposes the management method of more clusters can be used in management system Code, and then manage multiple clusters.The management system includes cluster management subsystem, cluster configuration management subsystem and plug-in management Subsystem.It can certainly include user right subsystem, serve resources management subsystem etc..Wherein, cluster management subsystem For adding or deleting cluster.Cluster configuration management subsystem is for configuring all clusters, such as the Identity Code of cluster Id information etc..Plug-in management subsystem is opened for multiple plug-in units in management system, such as addition cluster, modification cluster information Dynamic cluster or stopping cluster etc..Wherein, the corresponding one or more clusters of each plug-in unit, can integrate service included by cluster Function.The service function that management system calls some plug-in unit that can realize that the corresponding cluster of the plug-in unit includes.As shown in Fig. 2, Fig. 2 according to sequencing by there are for 8 clusters, naming to obtain 1# cluster, 2# cluster, 3# cluster ..., 8# cluster respectively, often A cluster has respectively corresponded plug-in unit, and a plug-in unit can correspond to one or more clusters.As shown in Fig. 2, 1# plug-in unit can correspond to 1# cluster and 2# cluster, 2# plug-in unit can correspond to 3# cluster, and 3# plug-in unit can correspond to 4# cluster, 5# cluster and 6# cluster, and 4# is inserted Part can correspond to 7# cluster and 8# cluster.Whole plug-in units are all managed by plug-in management subsystem, real by management plug-in unit Now to the management of more clusters.
Fig. 3 is referred to, is carried out below with reference to management method of the Fig. 2 and Fig. 3 to more clusters provided in an embodiment of the present invention detailed It describes in detail bright.Management method as shown in Figure 3 can be applicable in framework as shown in Figure 2, can be executed by management server.
In S301, management server can receive the first request message of the first cluster of access.
In embodiments of the present invention, cluster is registered in management server in advance, cluster management as shown in Figure 2 System is realized.It when there is new cluster to need to add, can be registered by cluster management subsystem, cluster management subsystem note ID number can be distributed for cluster after volume cluster, and inform cluster configuration management subsystem.After cluster addition, management server can To load the plug-in unit of added cluster, that is, the program bag of cluster plug-in unit is loaded, load is inserted by plug-in management subsystem Part is registered, and informs the ID number of the loaded plug-in unit of cluster configuration management subsystem, and such cluster configuration management subsystem is just It can establish and save the mapping relations of cluster ID number and corresponding plug-in unit ID number, it, can be according to visiting thus when accessing cluster The ID number for the cluster asked and the mapping relations know which corresponding plug-in unit of the calling.
After management server receives the first request message, unique mark first can be obtained from the first request message The identification information of cluster, the i.e. ID number of cluster, thus, in S302, management server can according to identification information and Mapping relations determine the first cluster plug-in unit corresponding with the first cluster.Wherein, mapping relations are used to indicate the identity of each cluster The corresponding relationship of identification information and cluster plug-in unit, each cluster plug-in unit correspond at least one cluster, corresponding to same cluster plug-in unit Cluster type it is identical, for example, hadoop cluster and the type of storm cluster be not just identical.
In possible embodiment, mapping relations may include the identification information of each cluster and the type of cluster The corresponding relationship of the type of corresponding relationship and cluster and cluster plug-in unit.To which management server can be according to the identity of each cluster The identification information of the corresponding relationship of the type of identification information and cluster and the first cluster determines the type of the first cluster, The corresponding relationship of type and cluster plug-in unit further according to cluster, determines the first cluster plug-in unit corresponding with the first cluster.Wherein, A kind of cluster plug-in unit can correspond at least one cluster, and the type of cluster and the corresponding relationship of cluster plug-in unit can be in load plug-in units When, the ID number of the plug-in unit of load is informed into cluster configuration management subsystem by plug-in management subsystem, passes through cluster configuration management Subsystem establishes the mapping relations of the ID number of plug-in unit and the type of corresponding cluster.
The first cluster plug-in unit corresponding with the first cluster is determined, in S303, management server can call the first cluster Plug-in unit realizes the service function that the first cluster includes.Specifically, management server can call the by plug-in management subsystem One cluster plug-in unit.And the institute of the first cluster of the first cluster plug-in unit is functional, and then the first cluster may be implemented and include Service function.
The mode of plug-in unit is applied in more cluster management systems by the embodiment of the present invention, so that each subsystem of management system Functional independence, the degree of coupling reduce.In cluster management method provided in an embodiment of the present invention, the plug-in unit to cluster is mainly realized Change management.Specifically, each cluster plug-in unit may include multiple card i/fs, and each card i/f can correspond to the one of cluster A or multiple functions, so each cluster plug-in unit may be implemented cluster management institute it is functional.Each card i/f can pass through A series of functions are defined to realize.After the card i/f of each cluster plug-in unit is write, corresponding compiling platform can be used, such as Maven compiling platform is compiled, and generates program bag.Plug-in management subsystem can be added by java ClassLoader mechanism Cluster plug-in card program packet is carried, and the type of one cluster of corresponding addition is key, while establishing the type key of cluster plug-in unit and inserting The mapping relations of part, in order to manage cluster.
The embodiment of the present invention can integrate the functional corresponding plug-in unit of institute of cluster for each developing plug, pass through in this way The management system of carrying on the management server can correspond to multiple plug-in units, and each plug-in unit may correspond to one or more Cluster so that multiple clusters can be managed based on a management system by realizing, and realizes the data and resource between each cluster It is shared.In compared to the prior art, a management system corresponds to a cluster, and hardware can be improved in mutual independence between cluster The utilization rate of resource.
In addition, the present invention is directed to realize the management to more clusters, and as data volume to be processed is more and more, cluster Constantly increasing.The embodiment of the present invention can realize the addition of corresponding plug-in unit by plug-in management subsystem, thus may be used To realize the upgrading of management system.And the way to manage of current more clusters is for a plurality of types of Cluster Exploitations one management System is managed a plurality of types of clusters by the management system, wherein each type of cluster corresponds to the management system A functional module.And since a type of cluster corresponds to a functional module of management system, when needing to dispose new class When the cluster of type, it is necessary to develop the new functional module of the management system, i.e. upgrading management system, just need first to deactivate at this time Management server where management system after adding new functional module, restarts management server.I.e. in this manager Under formula, if necessary to upgrade to some management system, management server must be first deactivated, is directed to management server again later Upgraded.As it can be seen that the way to manage of more clusters provided by the invention realizes corresponding plug-in unit by plug-in management subsystem Addition, realizes the upgrading of management system, compared to the way to manage of current more clusters, is not required to when realizing the upgrading of management system Management server is deactivated, scalability is preferable.
When there is cluster to be managed to need to be added to management system, user can be by the operation interface of management system to pipe It manages server and sends the second request message, which can serve to indicate that registration cluster to be managed, and the second request disappears Breath can carry the identification information of cluster to be managed.It, can be from and after management server receives the second request message The identification information of cluster to be managed is determined in two request messages, so that it is determined that the type of cluster to be managed, and then realize to Manage the addition of cluster.Non-limiting as example, management server can realize cluster to be managed based on following three kinds of situations Addition, i.e. the upgrading of management server.
The first situation:
The service function that the cluster of same type is included is generally also identical, the service function that different types of cluster is included It can be generally also different.In the embodiment of the present invention, management server can be true according to the identification information in the second request message The type of fixed cluster to be managed, if management server has existed second cluster identical with the type of cluster to be managed at this time Corresponding second cluster plug-in unit passes through then cluster to be managed directly can be mapped to the second cluster plug-in unit by management server Call the second cluster plug-in unit that can realize the service function that cluster to be managed includes.Management server maps cluster to be managed To the second cluster plug-in unit, mapping relations can be updated, all clusters that management server is registered are managed to realize.
For example, having been registered with a hadoop cluster under management server, and it is loaded with the corresponding hadoop cluster Plug-in unit, if cluster to be managed at this time is also a hadoop cluster, that is, the type and management clothes of cluster to be managed The type for some cluster registered on business device is identical, then management server can directly map to cluster to be managed at this time Under the corresponding plug-in unit of chartered hadoop cluster.
Second situation:
In the first scenario, if management server, which determines, is not present second cluster identical with the type of cluster to be managed Corresponding second cluster plug-in unit can then determine that needs load plug-in unit corresponding with cluster to be managed.And cluster to be managed at this time Corresponding plug-in unit may be not present, it is necessary to develop the plug-in unit.Such as the program code for realizing the plug-in unit is write by developer And generation program bag is compiled, which can be used to implement the service function that cluster to be managed includes.Management server can be with The program bag of 4th cluster plug-in unit corresponding with cluster to be managed is obtained, and loads the program bag with the 4th cluster plug-in unit.4th Although cluster plug-in unit is loaded with, but be not aware that the 4th cluster plug-in unit is corresponding with which cluster in management server, because This, cluster to be managed can be mapped to the 4th cluster plug-in unit by management server, and update mapping relations, to realize to management All clusters of server registration are managed.
For example, having been registered with a hadoop cluster under management server, and it is loaded with the corresponding hadoop cluster Plug-in unit, if needing cluster to be managed at this time is a storm cluster, that is, the type and management clothes of cluster to be managed The type of all clusters registered on business device is different from, then can to load storm cluster corresponding for management server at this time The program bag of 4th cluster plug-in unit, and storm cluster is directly mapped to the 4th cluster plug-in unit of load.
The third situation:
Sometimes, the service function that the cluster of same type different manufacturers or same type different editions is included also owns It is different.For example, have the cluster of the different editions such as Cloudera Hadoop and CMH Hadoop for hadoop cluster, In, although type is identical, version number is possible to be different these type clusters, then the service function for being included also has It may be different.Management server is once it is determined that in the presence of second cluster corresponding second identical with the type of cluster to be managed Cluster to be managed is just directly mapped to the second cluster plug-in unit by cluster plug-in unit, be may result in and is lost the certain of cluster to be managed Function.
Therefore, after management server has determined the type of cluster to be managed, it can continue to determine and be taken in the second request message The version information of the cluster to be managed of band, the version information can serve to indicate that the version number etc. of cluster to be managed.If management The plug-in unit registered on server exist second cluster plug-in unit corresponding with the type of cluster to be managed, and with the second cluster plug-in unit pair The version information of the version information and cluster to be managed of any cluster answered is inconsistent, then the second cluster in management server Plug-in unit is possible to that the function that cluster to be managed includes cannot be achieved.At this point, the available third cluster plug-in unit of management server Program bag, wherein the program bag of third cluster plug-in unit can be the program bag obtained after developer edits, for realizing to pipe The service function that reason cluster includes.The type of third cluster plug-in unit is identical as the type of the second cluster plug-in unit, and third cluster is inserted The version number of part is identical as the version number of cluster to be managed.Management server can load the journey with third cluster plug-in unit of acquisition Sequence packet, and cluster to be managed is mapped into third cluster plug-in unit, and update mapping relations, management server is registered to realize All clusters be managed.
The embodiment of the present invention manages multiple clusters by way of plug-in unit, so that each plug-in unit of each cluster can be with Using the same standardized card i/f, when needing to be updated management system, can be connect by standardized plug-in unit Cause for gossip now upgrades, and scalability is more preferable, and does not need to deactivate management server.In compared to the prior art, to management server When upgrading, need to deactivate management server, it is clear that applicability is stronger.
It is non-limiting as example, management server in the embodiment of the present invention and the first cluster can by REST or RPC establishes communication connection.Since REST and RPC are all based on the framework that advanced optimizes of http protocol or ICP/IP protocol Agreement is more convenient for realizing and be safeguarded in development management system for developer.
Conventionally, as the corresponding management system of a cluster, and be independent of each other between multiple clusters, Data and resource-sharing can not be carried out, so that the utilization rate of hardware resource is lower.
In contrast, using the management method of more clusters provided in an embodiment of the present invention, each Cluster Exploitation can be directed to Corresponding plug-in unit, the institute which can integrate cluster are functional.The plug-in unit of each cluster can belong to a management system, Such a management system can correspond to multiple plug-in units, and each plug-in unit may correspond to one or more clusters, so that realizing can To manage multiple clusters based on a management system.And since all clusters also are located at the same management system, so that it may real Data and resource-sharing between existing each cluster, to improve the utilization rate of hardware resource.
In the prior art, each type of cluster corresponds to a functional module of management system, when group type is more When, management system will be made complex, scalability and maintainability are poor, and system performance is relatively low.
In contrast, using the management method of more clusters provided in an embodiment of the present invention, pass through a management system management Multiple plug-in units realize the management of more clusters.The same standardized card i/f can be used in each plug-in unit, is needing to management When system is updated, it can be realized and be upgraded by standardized card i/f, scalability and maintainability are more preferable.
Equipment provided in an embodiment of the present invention is introduced with reference to the accompanying drawings of the specification.
Fig. 4 is referred to, based on the same inventive concept, one embodiment of the invention provides a kind of management server, management clothes Business device includes receiving unit 401, determination unit 402 and call unit 403.Receiving unit 401 is for supporting management server to hold Step 301 in row Fig. 3.Determination unit 402 is for supporting management server to execute the step 302 in Fig. 3.Call unit 403 For supporting management server to execute the step 303 in Fig. 3.Wherein, all phases for each step that above method embodiment is related to Hold the function description that can quote corresponding function module inside the Pass, details are not described herein.
Using integrated unit, Fig. 5 is referred to, based on the same inventive concept, one embodiment of the invention provides A kind of management server, the management server may include: at least one processor 501, and processor 501 is for executing memory The step of management method of more clusters as shown in Figure 3 provided in an embodiment of the present invention is realized when the computer program of middle storage.
Processor 501 specifically can be central processing unit, application-specific integrated circuit (English: Application Specific Integrated Circuit, referred to as: ASIC), it can be one or more for controlling the integrated of program execution Circuit carries out control management for the movement to management server, and management server is supported to execute method step as shown in Figure 3 Suddenly.
Optionally, which further includes the memory 502 connecting at least one processor, and memory 502 can To include read-only memory (English: Read Only Memory, abbreviation: ROM), random access memory (English: Random Access Memory, referred to as: RAM) and magnetic disk storage.The number required when being run for storage processor 501 of memory 502 According to being stored with the instruction that can be executed by least one processor 501, at least one processor 501 is by executing memory 502 The instruction of storage executes method as shown in Figure 3.Wherein, the quantity of memory 502 is one or more.Wherein, memory 502 show together in Fig. 5, but it is understood that memory 502 is not essential functional module, therefore with void in Fig. 5 Line is shown.
Wherein, entity device corresponding to receiving unit 401, determination unit 402 and call unit 403 may each be aforementioned Processor 501.The management server can be used for executing method provided by embodiment shown in Fig. 3.Therefore it is set about this The function that each functional module can be realized in standby, can refer to the corresponding description in embodiment shown in Fig. 3, seldom repeats.
The embodiment of the present invention also provides a kind of computer storage medium, wherein computer storage medium is stored with computer Instruction, when computer instruction is run on computers, so that computer executes method as described in Figure 3.
It is apparent to those skilled in the art that for convenience and simplicity of description, only with above-mentioned each function The division progress of module can according to need and for example, in practical application by above-mentioned function distribution by different function moulds Block is completed, i.e., the internal structure of device is divided into different functional modules, to complete all or part of function described above Energy.The specific work process of the system, apparatus, and unit of foregoing description, can be with reference to corresponding in preceding method embodiment Journey, details are not described herein.
In several embodiments provided by the present invention, it should be understood that disclosed device and method can pass through it Its mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the module or unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a storage medium, including some instructions are used so that a computer It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the application The all or part of the steps of embodiment the method.And storage medium above-mentioned includes: general serial bus USB (Universal Serial Bus flash disk), mobile hard disk, read-only memory (Read-Only Memory, ROM), Random access memory (Random Access Memory, RAM), magnetic or disk etc. be various to can store program code Medium.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to include these modifications and variations.

Claims (11)

1. a kind of management method of more clusters characterized by comprising
Management server receives the first request message of the first cluster of access, and unique mark is obtained from first request message Show the identification information of first cluster;
The management server determines and first cluster corresponding first according to the identification information and mapping relations Cluster plug-in unit;Wherein, the mapping relations are used to indicate the identification information of each cluster and the corresponding relationship of cluster plug-in unit, Each cluster plug-in unit corresponds at least one cluster, and the type of cluster corresponding to same cluster plug-in unit is identical;
The management server calls the first cluster plug-in unit, realizes the service function that first cluster includes.
2. the method as described in claim 1, which is characterized in that the method also includes:
The management server receives the second request message for adding cluster to be managed, determines from second request message The type of the cluster to be managed out;
The management server determines whether there is the second cluster plug-in unit, wherein cluster corresponding to the second cluster plug-in unit Type is identical as the type of the cluster to be managed;
The second cluster plug-in unit if it exists, then the cluster to be managed is mapped to second cluster by the management server Plug-in unit, and update the mapping relations.
3. method according to claim 2, which is characterized in that the method also includes:
The management server determines the version information of the cluster to be managed from second request message;
If the management server determines that there are the second cluster plug-in units, and any collection corresponding with the second cluster plug-in unit The version information of the version information and the cluster to be managed of group is inconsistent, then obtains the program bag of third cluster plug-in unit, wherein The service function that described program packet includes for realizing the cluster to be managed;
The management server loads the program bag of the third cluster plug-in unit;
The cluster to be managed is mapped to the third cluster plug-in unit by the management server, and updates the mapping relations.
4. method according to claim 2, which is characterized in that the method also includes:
If the management server, which determines, is not present the second cluster plug-in unit, the program bag of the 4th cluster plug-in unit is obtained, In, service function that described program packet includes for realizing the cluster to be managed;
The program bag of the management server load and the 4th cluster plug-in unit;
The cluster to be managed is mapped to the 4th cluster plug-in unit by the management server, and updates the mapping relations.
5. the method as described in claim 1-4 is any, which is characterized in that the management server passes through with first cluster Declarative state transmitting REST or remote procedure call establish communication connection.
6. a kind of management server of more clusters characterized by comprising
Receiving unit obtains only from first request message for receiving the first request message of the first cluster of access The identification information of one mark first cluster;
Determination unit, for determining and first cluster corresponding first according to the identification information and mapping relations Cluster plug-in unit;Wherein, the mapping relations are used to indicate the identification information of each cluster and the corresponding relationship of cluster plug-in unit, Each cluster plug-in unit corresponds at least one cluster, and the type of cluster corresponding to same cluster plug-in unit is identical;
Call unit realizes the service function that first cluster includes for calling the first cluster plug-in unit.
7. server as claimed in claim 6, which is characterized in that the management server further includes updating unit;
Wherein, the receiving unit is also used to: the second request message for adding cluster to be managed is received, from second request The type of the cluster to be managed is determined in message;
The determination unit is also used to: determining whether there is the second cluster plug-in unit, wherein the corresponding collection of the second cluster plug-in unit The type of group is identical as the type of the cluster to be managed;
The cluster to be managed is then mapped to described second for the second cluster plug-in unit if it exists by the updating unit Cluster plug-in unit, and update the mapping relations.
8. server as claimed in claim 7, which is characterized in that the management server further includes loading unit;
Wherein, the determination unit is also used to: the version letter of the cluster to be managed is determined from second request message Breath;
If it is determined that there are the second cluster plug-in units, and the version information of any cluster corresponding with the second cluster plug-in unit with The version information of the cluster to be managed is inconsistent, then obtains the program bag of third cluster plug-in unit, wherein described program packet is used for Realize the service function that the cluster to be managed includes;
The loading unit is used to load the program bag of the third cluster plug-in unit;
The updating unit is also used to: the cluster to be managed being mapped to the third cluster plug-in unit, and updates the mapping Relationship.
9. server as claimed in claim 7, which is characterized in that the management server further includes loading unit;
Wherein, the determination unit if it is determined that be not present the second cluster plug-in unit, then obtain the 4th cluster plug-in unit program bag, Wherein, the service function that described program packet includes for realizing the cluster to be managed;
The loading unit is also used to load the program bag with the 4th cluster plug-in unit;
The updating unit is also used to the cluster to be managed mapping to the 4th cluster plug-in unit, and updates the mapping and close System.
10. a kind of management server of more clusters characterized by comprising
At least one processor, and
The memory being connect at least one described processor;
Wherein, the memory is stored with the instruction that can be executed by least one described processor, at least one described processor The method according to claim 1 to 5 is realized in instruction by executing the memory storage.
11. a kind of computer storage medium, is stored thereon with computer program, which is characterized in that the computer program is located Reason device realizes the method according to claim 1 to 5 when executing.
CN201810162337.0A 2018-02-27 2018-02-27 A kind of management method and management server of more clusters Pending CN110198225A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810162337.0A CN110198225A (en) 2018-02-27 2018-02-27 A kind of management method and management server of more clusters

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810162337.0A CN110198225A (en) 2018-02-27 2018-02-27 A kind of management method and management server of more clusters

Publications (1)

Publication Number Publication Date
CN110198225A true CN110198225A (en) 2019-09-03

Family

ID=67750885

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810162337.0A Pending CN110198225A (en) 2018-02-27 2018-02-27 A kind of management method and management server of more clusters

Country Status (1)

Country Link
CN (1) CN110198225A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112162707A (en) * 2020-10-15 2021-01-01 科大讯飞股份有限公司 Storage method, electronic device and storage medium for distributed storage system
CN113364892A (en) * 2020-03-04 2021-09-07 阿里巴巴集团控股有限公司 Domain name resolution method, related method, device and system for cross-multi-cluster service

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070226359A1 (en) * 2002-10-31 2007-09-27 Bea Systems, Inc. System and method for providing java based high availability clustering framework
US20090307246A1 (en) * 2008-06-04 2009-12-10 Klaus Schuler System and Method for a Genetic Integration of a Database into a High Availability Cluster
CN103888550A (en) * 2014-04-22 2014-06-25 北京搜狐新媒体信息技术有限公司 Plug-in deployment method, device and system based on server cluster system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070226359A1 (en) * 2002-10-31 2007-09-27 Bea Systems, Inc. System and method for providing java based high availability clustering framework
US20090307246A1 (en) * 2008-06-04 2009-12-10 Klaus Schuler System and Method for a Genetic Integration of a Database into a High Availability Cluster
CN103888550A (en) * 2014-04-22 2014-06-25 北京搜狐新媒体信息技术有限公司 Plug-in deployment method, device and system based on server cluster system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113364892A (en) * 2020-03-04 2021-09-07 阿里巴巴集团控股有限公司 Domain name resolution method, related method, device and system for cross-multi-cluster service
CN113364892B (en) * 2020-03-04 2023-03-24 阿里巴巴集团控股有限公司 Domain name resolution method, related method, device and system for cross-multi-cluster service
CN112162707A (en) * 2020-10-15 2021-01-01 科大讯飞股份有限公司 Storage method, electronic device and storage medium for distributed storage system

Similar Documents

Publication Publication Date Title
US8103760B2 (en) Dynamic provisioning of service components in a distributed system
US8788580B2 (en) Event broker for an improved application server platform for telecom-based applications
KR101882426B1 (en) Software updating method, system, and device
CN110557357B (en) Remote procedure call protocol self-adaption method, related device and server
CN101360127A (en) File updating method and transmission system
US8387039B2 (en) System and method for customized provisioning of application content
CN109104368B (en) Connection request method, device, server and computer readable storage medium
US8887181B1 (en) Application add-on platform
CN113691635B (en) Method and device for calling microservice, electronic equipment and readable storage medium
CN112202874B (en) Extensible Internet of things bottom equipment adapter and construction method
CN114363402B (en) Shooting range interconnection method, shooting range interconnection system and electronic equipment
CN110198225A (en) A kind of management method and management server of more clusters
CN112698930B (en) Method, device, equipment and medium for obtaining server identification
CN114565502A (en) GPU resource management method, scheduling method, device, electronic equipment and storage medium
CN112256351B (en) Method for realizing Feign component, method and device for calling micro-service
CN105144085A (en) Software framework for a storage device
KR20080024751A (en) Apparatus for lightweighting application through duplicating management of application in environment of osgi middleware for embedded terminal and method thereof
CN105122209A (en) Web services provided from software framework
Iyer et al. Extending android application programming framework for seamless cloud integration
Plebani et al. MicroMAIS: executing and orchestrating Web services on constrained mobile devices
CN114625479A (en) Cloud edge collaborative application management method in edge computing and corresponding device
CN106559454B (en) Resource access method, device and system
CN113760447A (en) Service management method, device, equipment, storage medium and program product
CN115604333B (en) Distributed big data analysis service scheduling method and system based on dubbo
CN113703878B (en) Component starting method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190903

RJ01 Rejection of invention patent application after publication