CN113132148A - Service sharing system, method, apparatus, and computer-readable storage medium - Google Patents
Service sharing system, method, apparatus, and computer-readable storage medium Download PDFInfo
- Publication number
- CN113132148A CN113132148A CN202010044013.4A CN202010044013A CN113132148A CN 113132148 A CN113132148 A CN 113132148A CN 202010044013 A CN202010044013 A CN 202010044013A CN 113132148 A CN113132148 A CN 113132148A
- Authority
- CN
- China
- Prior art keywords
- cluster
- service unit
- system service
- information
- slave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
- H04L41/0826—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for reduction of network costs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5041—Network service management, e.g. ensuring proper service fulfilment according to agreements characterised by the time relationship between creation and deployment of a service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a service sharing system, a service sharing method, a service sharing device and a computer readable storage medium. The system comprises: the system comprises a cluster deployment management platform and a plurality of clusters; the cluster deployment management platform is used for maintaining configuration information of the consistent system service unit of each cluster and machine set information of the consistent system service unit; and a consistency system service unit configuration daemon is arranged in each client of the cluster and used for synchronizing the consistency system service unit machine group information in the cluster deployment management platform to the local in a preset period and generating a configuration file containing a mapping relation between a cluster name and a consistency system service unit machine group. The operation and maintenance cost is reduced, and the stability and the operability of the consistency service are improved.
Description
Technical Field
The present invention relates to the field of distributed cluster technologies, and in particular, to a service sharing system, a service sharing method, a service sharing apparatus, and a computer-readable storage medium.
Background
The consistency system service unit is realized based on a consistency protocol, generally exists as a basic distributed coordination service unit in a cluster, and provides access services such as highly reliable service discovery, distributed locks, metadata reading and writing and the like.
Cloud services typically deploy operations and maintenance in units of clusters. In a typical storage-computation separation scenario, a computation cluster and a storage cluster rely on two sets of consistency system service units respectively. As shown in fig. 1, a storage cluster provides block storage access service through a master node generated by election, and a consistency system service unit of the storage cluster content provides distributed lock service; the computing cluster accesses the master node of the corresponding storage cluster to read and write data, the computing cluster also relies on the consistency system service unit in the storage cluster to provide service discovery service, and in addition, the computing cluster also relies on the consistency system service unit in the cluster to maintain information such as metadata related to the mirror image file.
When a plurality of application programs need to share one consistency system service unit, a common scheme is as shown in fig. 2, the shared consistency system service unit provides a common access entry through a uniform DNS domain name, and the application programs need to maintain DNS addresses of the consistency system service unit by themselves; the applications then need to negotiate with each other to resolve the namespace conflict. For example, applications A1 and B1 both want to register an application service address, and if the resource paths are both "/sys/app/master", then there is clearly a naming conflict problem. After negotiation, the service address resource paths of the applications a1 and B1 may be "/sys/app/a 1/master" and "/sys/app/B1/master", respectively, isolated from using the shared consistent system service unit.
However, with the rapid development of services, in the above scheme, the service capacity of a single consistent system service unit easily reaches the upper limit, so that more consistent system service units need to be built, DNS domain names of a plurality of or even hundreds of consistent system service units need to be maintained, which is a high access cost for services and a heavy operation and maintenance burden; on the other hand, the business side is relied on to control the resource access isolation of the service unit of the shared consistency system, and the possibility of resource conflict exists, so that the business side becomes a potential risk point of on-line stability.
Therefore, it is very necessary to provide a new solution for sharing the service unit of the consistency system, so as to reduce the operation and maintenance cost increase, and the stability and the operability of the consistency service.
Disclosure of Invention
An object of the present invention is to provide a new solution for service sharing.
According to a first aspect of the present invention, there is provided a service sharing system, the system comprising: the system comprises a cluster deployment management platform and a plurality of clusters;
the cluster deployment management platform is used for maintaining configuration information of the consistent system service unit of each cluster and machine set information of the consistent system service unit;
and a consistency system service unit configuration daemon is arranged in each client of the cluster and used for synchronizing the consistency system service unit machine group information in the cluster deployment management platform to the local in a preset period and generating a configuration file containing a mapping relation between a cluster name and a consistency system service unit machine group.
Optionally, the configuration file in the client further includes a mapping relationship between a preset keyword and a corresponding cluster name.
Optionally, an access path of the service unit of the consistency system is configured with a path prefix including a path prefix based on the cluster name.
Optionally, the cluster deployment management platform is further configured to: and configuring one cluster in the plurality of clusters as a master cluster, and configuring other clusters as slave clusters.
Optionally, when configuring other clusters as slave clusters, the cluster deployment management platform pushes information of a master cluster to which the slave cluster belongs to a consistency system service unit configuration daemon of each slave cluster.
Optionally, the consistency system service unit configuration daemon in each slave cluster is further configured to: and synchronizing the information of the consistent system service unit machine set of the main cluster in the cluster deployment management platform to the local according to the information of the main cluster to which the slave cluster belongs, and generating a configuration file of the mapping relation between the cluster name and the consistent system service unit machine set.
Optionally, a global routing table from the cluster to the master cluster is also maintained in the cluster deployment management platform.
Optionally, the cluster deployment management platform is further configured to configure a consistency system service unit for each cluster, and divide a plurality of service machines in each cluster into different server groups.
Optionally, the cluster deployment management platform is further configured to: and when the information of the consistent system service unit machine group is updated, pushing new information of the consistent system service unit machine group to a configuration daemon process of the consistent system service unit.
Optionally, the cluster deployment management platform configures the cluster deployment management platform to include only the multiple consistency system service units as a master cluster, and configures all the service clusters as slave clusters.
According to a second aspect of the present invention, there is provided a service sharing method, including:
receiving the information of the consistent system service unit machine group sent by the cluster deployment management platform at a preset time interval;
and generating a configuration file containing the mapping relation between the cluster name and the consistent system service unit machine group according to the consistent system service unit machine group information.
Optionally, the configuration file further includes a mapping relationship between a preset keyword and a corresponding cluster name.
Optionally, wherein the method further comprises:
receiving master-slave mapping configuration information;
and after the slave cluster is configured according to the master-slave mapping configuration information, receiving the information of the affiliated master cluster.
According to a third aspect of the present invention, there is provided a service sharing method, comprising:
sending configuration information to the cluster; the configuration information is used for configuring a consistent system service unit to the cluster;
and sending the corresponding machine group information of the consistency system service unit to the consistency system service unit of the cluster at a preset time interval.
Optionally, wherein the method further comprises:
sending master-slave mapping configuration information to the cluster;
wherein the master-slave mapping configuration information is used to configure the cluster as a master cluster; or the master-slave mapping configuration information is used for configuring the cluster into a slave cluster and pushing information of a master cluster to which the slave cluster belongs to a consistency system service unit configuration daemon of the slave cluster.
According to a fourth aspect of the present invention, there is provided a service sharing apparatus comprising:
the sending module is used for receiving the information of the consistent system service unit machine group sent by the cluster deployment management platform at a preset time interval;
and the generating module is used for generating a configuration file containing the mapping relation between the cluster name and the consistent system service unit machine group according to the consistent system service unit machine group information.
According to a fifth aspect of the present invention, there is provided a service sharing apparatus comprising:
the configuration information sending module is used for sending configuration information to the cluster; the configuration information is used for configuring a consistent system service unit to the cluster;
and the machine group information sending module is used for sending the machine group information of the corresponding consistency system service unit to the consistency system service unit of the cluster at a preset time interval.
According to a sixth aspect of the present invention, there is provided a computer-readable storage medium storing executable instructions that, when executed by a processor, perform the service sharing method according to any one of the second aspects of the present invention.
According to a seventh aspect of the present invention, there is provided a computer-readable storage medium storing executable instructions that, when executed by a processor, perform the service sharing method according to any one of the third aspects of the present invention.
The service sharing system has the advantages that the service sharing mechanism of the consistency system based on the master-slave mapping solves the problem of access entry of the service unit of the manual operation and maintenance consistency system by introducing the cluster name to the route configuration self-synchronization mechanism of the service unit of the consistency system on the one hand, and introduces the path prefix based on the cluster name on the access path of the service unit of the consistency system and further introduces the master-slave cluster mapping on the other hand, so that the service sharing of the distributed consistency system is transparent to the service, the operation and maintenance cost is reduced, and the stability and the operation and maintenance performance of the consistency service are improved.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic diagram illustrating a service dependency on a distributed consistency service unit in an existing storage and computation separation scenario.
Fig. 2 shows a schematic diagram of a service sharing scheme commonly used in the prior art.
Fig. 3 shows a schematic structural diagram of a service sharing system according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating a mapping configuration for maintaining cluster names to consistent system service unit machine groups within a cluster, according to an embodiment of the invention.
FIG. 5 illustrates a diagram of a reserved prefix design for a consistent system service unit access path, according to an embodiment of the invention.
FIG. 6 is a diagram illustrating synchronization of coherent system service unit machine group information on which slave and master clusters depend according to an embodiment of the present invention.
Fig. 7 shows a flow chart of a service sharing method of the embodiment of the service unit of the consistency system of the invention.
Fig. 8 shows a schematic structural diagram of a service sharing apparatus of an embodiment of the service unit of the consistency system of the invention.
Fig. 9 is a flowchart illustrating a service sharing method according to an embodiment of the cluster deployment management platform of the present invention.
Fig. 10 shows a schematic structural diagram of a service sharing device in an embodiment of the cluster deployment management platform of the present invention.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< System embodiment >
With the high-speed development of cloud services, a large number of computing clusters and storage clusters are built, and a consistent system service unit needing to be built in a matching way is increased, so that two pain points are generated: 1. each calculation cluster or storage cluster built by a business party needs to be matched with a consistent system service unit, so that a large number of machines need to be purchased, and the cost is huge; 2. the output scale on the consistency service line is increased, the operation and maintenance cost which needs to be consumed is increased, and the potential stability risk is brought to the whole service. In fact, whether a compute cluster or a storage cluster, traffic dependency on a coherence service is on the policing path, but access to service units is relatively lightweight. Based on this background, a strong service requirement for storing and computing the service units of the consistent system is generated on the premise that the existing access mode is not changed.
In the embodiment of the present invention, the service sharing system according to the present invention is described according to three parts, i.e., mapping configuration synchronization between a cluster name and a consistency system service unit, introducing a fixed prefix based on the cluster name to an access path of the consistency system service unit, deploying and multiplexing a master cluster consistency system service unit based on mapping configuration by a slave cluster, and the like.
Specifically, the service sharing system of the present embodiment includes: the cluster deployment management platform and the plurality of clusters need to be described in that the cluster management deployment platform is used as an infrastructure for deploying, operating and maintaining cluster services, and manages and maintains information such as a server group, a service version, service configuration and the like of each cluster.
As shown in fig. 3, the service sharing system includes a cluster immature management platform, a computing cluster a and a storage cluster B. The computing cluster A comprises an application program A1, an application program A2, an application program A3 and an application program A4, an access path of the computing cluster A can be/sys/cluster-a/xxx, and the cluster deployment management platform can push master-slave cluster mapping configuration to the computing cluster A and regularly update the information of the consistent system service unit machine group of the computing cluster A. The storage cluster B account comprises an application program B1, an application program B2, an application program B3 and an application program B4, the access path of the storage cluster B can be/sys/cluster-B/xxx, and the cluster immature management platform can deploy, change and periodically update the consistency system service unit machine group information of the storage cluster B to the storage cluster B.
Specifically, as shown in fig. 4, the cluster deployment management platform maintains configuration information of the consistent system service unit of each cluster and machine group information of the consistent system service unit. In practical application, the cluster deployment management platform may be further configured to configure a consistent system service unit for each cluster, and divide a plurality of service machines in each cluster into different server groups.
In order to achieve the purpose of minimum access cost of a service, in this embodiment, a configuration synchronization role is introduced to each client of a cluster, that is, a consistency system service unit configuration daemon is set in each client of the cluster, and the consistency system service unit configuration daemon is used for synchronizing information of a consistency system service unit machine set in the cluster deployment management platform to a local area in a preset period and generating a configuration file including a mapping relationship between a cluster name and the consistency system service unit machine set, so that an access service of the consistency system service unit can be made transparent. The cluster deployment management platform may be further configured to push new information of the consistent system service unit machine group to the consistent system service unit configuration daemon when the information of the consistent system service unit machine group is updated.
Further, in order to minimize the access cost of the service unit of the consistency system, the configuration file in the client further includes a mapping relationship between a preset keyword and a corresponding cluster name. For example, the cluster includes an application a1, an application a2, an application A3, and an application a4, a preset keyword "localcluster" is added to a configuration file of the service unit configuration daemon of the consistency system to map to the cluster name, and the configuration file after the preset keyword is added is, for example:
thus, the applications A1, A2, A3 and A4 do not care about the consistent system service unit access address in the cluster, but can load the local configuration file through the client with the similar access address dcc:// localcluster/sys/app/master, and further access the consistent service unit of the cluster through protocol conversion.
Further, in this embodiment, the access path of the service unit of the consistency system is configured with a path prefix including a path prefix based on the cluster name.
Specifically, a client side which is served by the consistency system accesses the consistency system service unit, an access address which is transmitted by a service user is, for example, dcc:// localclustre/sys/app/master, the client side can find the consistency system service unit machine set of the cluster by the localclustre according to a protocol, a specifically sent resource access path needs to be further added with a prefix based on the cluster name, and the above access address is taken as an example, the access path after conversion is as follows: /$ clustername/sys/app/master. It is to be noted that such a transition is not visible for the access service. Of course, the above conversion from the access address to the access path is applicable to all request interfaces of the client.
As shown in fig. 5, when two clusters are required to share a set of consistency system service unit, the dependency of the application programs from the two clusters on the consistency service can be smoothly supported and directly isolated from the data plane on the premise that the service end is not sensitive.
Further, in this embodiment, a mapping mechanism between the slave cluster and the master cluster is introduced, that is, when the cluster deployment management center deploys the slave cluster, the cluster deployment management center issues the master-slave mapping configuration, so that the consistent system service unit configuration daemon process on each client side reads the mapping configuration, synchronizes the consistent system service unit machine group information of the master cluster to the cluster deployment management center, and further generates a configuration file of mapping relationship from the cluster name to the master cluster consistent system service unit machine group, so that a plurality of clusters can share one set of distributed consistent system service unit.
As shown in fig. 6, the cluster deployment management platform configures one cluster of the plurality of clusters as a master cluster, and configures the other clusters as slave clusters. And when other clusters are configured as slave clusters, pushing information of a master cluster to which the slave clusters belong to a consistency system service unit configuration daemon of each slave cluster.
The consistency system service unit configuration daemon in each slave cluster can synchronize the consistency system service unit machine set information of the master cluster in the cluster deployment management platform to the local according to the information of the master cluster to which the slave cluster belongs, and generate a configuration file of a mapping relation between a cluster name and the consistency system service unit machine set.
As shown in fig. 6, the local configuration file finally generated from the client in the cluster is:
the local configuration file finally generated by the client in the master cluster is as follows:
it can be seen that the local configuration file finally generated by each client in the master-slave cluster only differs in the "localcluster" item, and the information about the machine group is completely the same, which, in combination with the above-mentioned scheme of configuring the path prefix based on the cluster name in the access path, can allow the traffic to transparently share the consistent system service.
In this embodiment, the master-slave mapping configuration is pushed when the slave cluster is deployed, and indicates the home master cluster, so that the configuration daemon of the consistent system service unit on the slave cluster client can correctly synchronize to the information of the master cluster consistent system service unit machine group. Although the method can enable multiple clusters to share the distributed consistency system service under the condition of no service sense, the mapping configuration is dispersed on each slave cluster, the maintenance cost is high, and particularly under the condition of large number of slave clusters.
Therefore, in this embodiment, a global routing table from the cluster to the master cluster may be further maintained in the cluster deployment management platform. And the configuration daemon of the consistency system service unit on the slave cluster client synchronizes to the global routing table periodically, queries the affiliated main cluster and further acquires the machine group information of the consistency system service unit.
In one example, the cluster deployment management platform may configure each of the service clusters as a slave cluster, and configure a cluster containing only a plurality of consistent system service units as a master cluster. Therefore, the global master-slave mapping table can be managed in a centralized mode, and the operation and maintenance performance is high.
According to the service sharing system of the embodiment of the invention, the problem of access entry of the service unit of the consistency system of manual operation and maintenance is solved by introducing a cluster name to a routing configuration self-synchronization mechanism of the service unit of the consistency system based on a master-slave mapping consistency system service unit sharing mechanism, and a cluster name-based path prefix is introduced to an access path of the service unit of the consistency system and master-slave cluster mapping is further introduced to ensure that the service sharing of the distributed consistency system is transparent to the service, thereby reducing the operation and maintenance cost and improving the stability and the operation and maintenance performance of the consistency service.
< consistency System service Unit embodiments >
< method >
In this embodiment, to achieve the purpose of minimum access cost of a service, a configuration synchronization role is introduced to each client of a cluster, that is, a consistent system service unit configuration daemon is set in the client of each cluster. The service sharing method of this embodiment may be executed by the consistency system service unit configuration daemon, for example.
As shown in fig. 7, the method of the present embodiment may include steps 1100 and 1200 as follows:
It can be understood that, when the information of the consistent system service unit machine group is updated, the consistent system service unit configuration daemon further receives new information of the consistent system service unit machine group sent by the cluster deployment management platform.
Further, in order to minimize the access cost of the service unit of the consistency system, the configuration file may further include a mapping relationship between a preset keyword and a corresponding cluster name.
For example, a preset keyword "localcluster" is added to the configuration file to map the cluster name, so that the application program does not care about the access address of the consistent system service unit in the cluster, and can load the local configuration file through the client and further access the consistent service unit of the cluster through protocol conversion by using a similar access address dcc:// localcluster/sys/app/master.
The method of the embodiment can reduce operation and maintenance cost and improve the stability and the operability of the consistency service.
< apparatus >
The present embodiment provides a service sharing apparatus, for example, the service sharing apparatus 2000 shown in fig. 8, and the service sharing apparatus 2000 may include a sending module 2100 and a generating module 2200.
The sending module 2100 is configured to receive, at a preset time interval, information of a consistent system service unit group sent by a cluster deployment management platform.
A generating module 2200, configured to generate, according to the information about the consistent system service unit machine group, a configuration file containing a mapping relationship between the cluster name and the consistent system service unit machine group.
Optionally, the configuration file may further include a mapping relationship between a preset keyword and a corresponding cluster name.
The service sharing apparatus of this embodiment may be configured to implement the technical solutions of the above method embodiments, and the implementation principles and technical effects are similar, which are not described herein again.
< computer-readable storage Medium >
A computer-readable storage medium storing executable instructions that, when executed by a processor, perform the service sharing method described in the present embodiment.
< embodiments of Cluster deployment management platform >
< method >
The present embodiment provides a service sharing method, which may be executed by a cluster deployment management platform in the service sharing system.
As shown in fig. 9, the method of the present embodiment may include steps 3100 and 3200, and a service sharing method includes:
3100, sending configuration information to the cluster; the configuration information is used to configure a consistent system service unit to the cluster.
In practical application, the cluster deployment management platform is used as an infrastructure for deploying, operating and maintaining cluster services, and manages and maintains information such as a server group, a service version, service configuration and the like of each cluster. In the cluster deployment management platform, configuration information of the consistent system service units of each cluster and machine group information of the consistent system service units are maintained, and corresponding configuration information is sent to each cluster through the configuration information so as to configure the consistent system service units of the clusters.
Further, in the present embodiment, a slave cluster and master cluster mapping mechanism is introduced. That is, the method of this embodiment may further include: and sending master-slave mapping configuration information to the cluster. Wherein the master-slave mapping configuration information is used to configure the cluster as a master cluster; or the master-slave mapping configuration information is used for configuring the cluster into a slave cluster and pushing information of a master cluster to which the slave cluster belongs to a consistency system service unit configuration daemon of the slave cluster.
Specifically, when the cluster deployment management center deploys the slave cluster, the cluster deployment management center issues master-slave mapping configuration, such that the consistency system service unit configuration daemon on each client synchronizes the consistency system service unit machine group information of the master cluster to the cluster deployment management center, and further generates a configuration file of a mapping relation from a cluster name to a master cluster consistency system service unit machine group, so that a plurality of clusters can be supported to share one set of distributed consistency system service unit.
In one example, the cluster deployment management platform configures one cluster of the plurality of clusters as a master cluster and configures the other clusters as slave clusters. And when other clusters are configured as slave clusters, pushing information of a master cluster to which the slave clusters belong to a consistency system service unit configuration daemon of each slave cluster. According to the information of the master cluster to which the slave cluster belongs, the consistency system service unit configuration daemon in each slave cluster can synchronize the consistency system service unit machine group information of the master cluster in the cluster deployment management platform to the local and generate a configuration file of the mapping relation between the cluster name and the consistency system service unit machine group.
In this embodiment, the master-slave mapping configuration is pushed when the slave cluster is deployed, and indicates the home master cluster, so that the configuration daemon of the consistent system service unit on the slave cluster client can correctly synchronize to the information of the master cluster consistent system service unit machine group. Although the method can enable multiple clusters to share the distributed consistency system service under the condition of no service sense, the mapping configuration is dispersed on each slave cluster, the maintenance cost is high, and particularly under the condition of large number of slave clusters.
Therefore, in this embodiment, a global routing table from the cluster to the master cluster may be further maintained in the cluster deployment management platform. And the configuration daemon of the consistency system service unit on the slave cluster client synchronizes to the global routing table periodically, queries the affiliated main cluster and further acquires the machine group information of the consistency system service unit.
In one example, the cluster deployment management platform may configure each of the service clusters as a slave cluster, and configure a cluster containing only a plurality of consistent system service units as a master cluster. Therefore, the global master-slave mapping table can be managed in a centralized mode, and the operation and maintenance performance is high.
The method of the embodiment can reduce operation and maintenance cost and improve the stability and the operability of the consistency service.
< apparatus >
The present embodiment provides a service sharing apparatus, for example, a service sharing apparatus 4000 shown in fig. 10, and the service sharing apparatus 4000 may include a configuration information transmitting module 4100 and a machine group information transmitting module 4200.
A configuration information sending module 4100, configured to send configuration information to the cluster; the configuration information is used for configuring a consistent system service unit to the cluster;
a machine group information sending module 4200, configured to send, at preset time intervals, machine group information of the corresponding consistent system service unit to the consistent system service unit of the cluster.
Optionally, the configuration information sending module 4100 may be further configured to send master-slave mapping configuration information to the cluster; wherein the master-slave mapping configuration information is used to configure the cluster as a master cluster; or the master-slave mapping configuration information is used for configuring the cluster into a slave cluster and pushing information of a master cluster to which the slave cluster belongs to a consistency system service unit configuration daemon of the slave cluster.
The service sharing apparatus of this embodiment may be configured to implement the technical solutions of the above method embodiments, and the implementation principles and technical effects are similar, which are not described herein again.
< computer-readable storage Medium >
A computer-readable storage medium storing executable instructions that, when executed by a processor, perform the service sharing method described in the present embodiment.
The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.
Claims (19)
1. A service sharing system, the system comprising: the system comprises a cluster deployment management platform and a plurality of clusters;
the cluster deployment management platform is used for maintaining configuration information of the consistent system service unit of each cluster and machine set information of the consistent system service unit;
and a consistency system service unit configuration daemon is arranged in each client of the cluster and used for synchronizing the consistency system service unit machine group information in the cluster deployment management platform to the local in a preset period and generating a configuration file containing a mapping relation between a cluster name and a consistency system service unit machine group.
2. The system according to claim 1, wherein the configuration file in the client further includes a mapping relationship between a preset keyword and a corresponding cluster name.
3. The system of claim 1, wherein an access path of the coherent system services unit is configured with a path prefix that includes a prefix based on the cluster name.
4. The system of claim 3, wherein the cluster deployment management platform is further to: and configuring one cluster in the plurality of clusters as a master cluster, and configuring other clusters as slave clusters.
5. The system of claim 4, wherein the cluster deployment management platform pushes information of a master cluster to which the slave cluster belongs to a consistency system service unit configuration daemon of each slave cluster when configuring other clusters as slave clusters.
6. The system of claim 5, wherein the consistency system service unit configuration daemon in each of the slave clusters is further to: and synchronizing the information of the consistent system service unit machine set of the main cluster in the cluster deployment management platform to the local according to the information of the main cluster to which the slave cluster belongs, and generating a configuration file of the mapping relation between the cluster name and the consistent system service unit machine set.
7. The system of claim 4, wherein a global routing table from cluster to master cluster is also maintained in the cluster deployment management platform.
8. The system of claim 1, wherein the cluster deployment management platform is further configured to configure a consistent system service unit for each of the clusters, and to partition the plurality of service machines in each of the clusters into different groups of server machines.
9. The system of claim 1, wherein the cluster deployment management platform is further to: and when the information of the consistent system service unit machine group is updated, pushing new information of the consistent system service unit machine group to a configuration daemon process of the consistent system service unit.
10. The system of claim 4, wherein the cluster deployment management platform configures a cluster containing only the plurality of coherent system service units as a master cluster and all traffic clusters as the slave clusters.
11. A service sharing method, comprising:
receiving the information of the consistent system service unit machine group sent by the cluster deployment management platform at a preset time interval;
and generating a configuration file containing the mapping relation between the cluster name and the consistent system service unit machine group according to the consistent system service unit machine group information.
12. The method of claim 11, wherein the configuration file further includes a mapping relationship between a preset keyword and a corresponding cluster name.
13. The method of claim 11, wherein the method further comprises:
receiving master-slave mapping configuration information;
and after the slave cluster is configured according to the master-slave mapping configuration information, receiving the information of the affiliated master cluster.
14. A service sharing method, comprising:
sending configuration information to the cluster; the configuration information is used for configuring a consistent system service unit to the cluster;
and sending the corresponding machine group information of the consistency system service unit to the consistency system service unit of the cluster at a preset time interval.
15. The method of claim 14, wherein the method further comprises:
sending master-slave mapping configuration information to the cluster;
wherein the master-slave mapping configuration information is used to configure the cluster as a master cluster; or the master-slave mapping configuration information is used for configuring the cluster into a slave cluster and pushing information of a master cluster to which the slave cluster belongs to a consistency system service unit configuration daemon of the slave cluster.
16. A service sharing apparatus, comprising:
the sending module is used for receiving the information of the consistent system service unit machine group sent by the cluster deployment management platform at a preset time interval;
and the generating module is used for generating a configuration file containing the mapping relation between the cluster name and the consistent system service unit machine group according to the consistent system service unit machine group information.
17. A service sharing apparatus, comprising:
the configuration information sending module is used for sending configuration information to the cluster; the configuration information is used for configuring a consistent system service unit to the cluster;
and the machine group information sending module is used for sending the machine group information of the corresponding consistency system service unit to the consistency system service unit of the cluster at a preset time interval.
18. A computer readable storage medium storing executable instructions which, when executed by a processor, perform a service sharing method as claimed in any one of claims 11 to 13.
19. A computer readable storage medium storing executable instructions which, when executed by a processor, perform the service sharing method of claim 14 or 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010044013.4A CN113132148A (en) | 2020-01-15 | 2020-01-15 | Service sharing system, method, apparatus, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010044013.4A CN113132148A (en) | 2020-01-15 | 2020-01-15 | Service sharing system, method, apparatus, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113132148A true CN113132148A (en) | 2021-07-16 |
Family
ID=76772134
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010044013.4A Pending CN113132148A (en) | 2020-01-15 | 2020-01-15 | Service sharing system, method, apparatus, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113132148A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105812488A (en) * | 2016-05-06 | 2016-07-27 | 深圳前海大数点科技有限公司 | Cloud computing distributed service cluster system and method of using the system |
| US20170177448A1 (en) * | 2015-12-16 | 2017-06-22 | Netapp, Inc. | Optimized file system layout for distributed consensus protocol |
| CN107908708A (en) * | 2017-11-09 | 2018-04-13 | 北京锐安科技有限公司 | A kind of method, system, equipment and the storage medium of group document synchronization |
| CN109639489A (en) * | 2018-12-18 | 2019-04-16 | 郑州云海信息技术有限公司 | A kind of RabbitMQ clustered deploy(ment) method, system, equipment and medium |
| CN110120961A (en) * | 2018-02-06 | 2019-08-13 | 北京京东尚科信息技术有限公司 | A kind of method of Distributed Services cluster and its route synchronization |
-
2020
- 2020-01-15 CN CN202010044013.4A patent/CN113132148A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170177448A1 (en) * | 2015-12-16 | 2017-06-22 | Netapp, Inc. | Optimized file system layout for distributed consensus protocol |
| CN105812488A (en) * | 2016-05-06 | 2016-07-27 | 深圳前海大数点科技有限公司 | Cloud computing distributed service cluster system and method of using the system |
| CN107908708A (en) * | 2017-11-09 | 2018-04-13 | 北京锐安科技有限公司 | A kind of method, system, equipment and the storage medium of group document synchronization |
| CN110120961A (en) * | 2018-02-06 | 2019-08-13 | 北京京东尚科信息技术有限公司 | A kind of method of Distributed Services cluster and its route synchronization |
| CN109639489A (en) * | 2018-12-18 | 2019-04-16 | 郑州云海信息技术有限公司 | A kind of RabbitMQ clustered deploy(ment) method, system, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109889621B (en) | Configuration method and device of virtual private cloud service | |
| US10545914B2 (en) | Distributed object storage | |
| CN111246397B (en) | Cluster system, service access method, device and server | |
| CN110262902B (en) | Information processing method and system, medium, and computing device | |
| EP3238096B1 (en) | System and method for discovering a lan synchronization candidate for a synchronized content management system | |
| CN107172214B (en) | Service node discovery method and device with load balancing function | |
| US11177974B2 (en) | Consistent provision of member node group information on virtual overlay network | |
| EP3866022A2 (en) | Transaction processing method and device, electronic device and readable storage medium | |
| CN102664922A (en) | High-speed network starting method based on Linux system | |
| CN111435341A (en) | Enhanced management of repository availability in a virtual environment | |
| CN110945496A (en) | System and method for state object data store | |
| CN112035244A (en) | Deployment of virtual node clusters in a multi-tenant environment | |
| CN113660315B (en) | Cloud computing service providing method, device, equipment and readable storage medium | |
| CN113079098B (en) | Method, device, equipment and computer readable medium for updating route | |
| CN115517009B (en) | Cluster management method, cluster management device, storage medium and electronic equipment | |
| CN113132148A (en) | Service sharing system, method, apparatus, and computer-readable storage medium | |
| CN112804366A (en) | Method and device for resolving domain name | |
| CN116155978A (en) | Multi-registry adaptation method, device, electronic equipment and storage medium | |
| CN114745757B (en) | Cluster switching method, device, equipment and medium | |
| CN113179332B (en) | Method, electronic device and storage medium for acquiring configuration information | |
| CN115189931A (en) | Distributed key management method, device, equipment and storage medium | |
| CN110661857B (en) | Data synchronization method and device | |
| CN112306984A (en) | Data source routing method and device | |
| CN114072768A (en) | Controller for bridging database architectures | |
| US11323512B2 (en) | Peer to peer infrastructure management architecture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40056169 Country of ref document: HK |