CN109039767A - A kind of distributed resource management and deployment platform - Google Patents
A kind of distributed resource management and deployment platform Download PDFInfo
- Publication number
- CN109039767A CN109039767A CN201810996708.5A CN201810996708A CN109039767A CN 109039767 A CN109039767 A CN 109039767A CN 201810996708 A CN201810996708 A CN 201810996708A CN 109039767 A CN109039767 A CN 109039767A
- Authority
- CN
- China
- Prior art keywords
- deployment
- component
- resource management
- node
- management module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/04—Network management architectures or arrangements
- H04L41/042—Network management architectures or arrangements comprising distributed management centres cooperatively managing the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
- H04L41/5041—Network service management, e.g. ensuring proper service fulfilment according to agreements characterised by the time relationship between creation and deployment of a service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer And Data Communications (AREA)
- Multi Processors (AREA)
Abstract
A kind of distributed resource management and deployment platform are disclosed in the present invention, including distributed system resource management module, component pool submodule and deployment and service management module, the distributed system resource management module provides a lightweight, general, expansible interface with service management module for component pool submodule and deployment, and the interface can be used for system resource and resource service condition for obtaining current cluster interior joint.The present invention has abandoned the mode that traditional exploitation is mutually separated with deployment management, and service is disposed and managed in the form of component, and the exploitation of service and deployment management are closely combined together；And use customized resource statistics strategy and customized allocation strategy, while increasing the scalability of system, automation node distribution should be carried out to the requirement serviced to different resource and reasonably, be can be realized and externally provided the automatically dispose to distributed type assemblies service and the function of management.
Description
Technical field
The present invention relates to field of computer, in particular to a kind of distributed resource management and deployment platform.
Background technique
With the development of internet and the arrival of mobile internet era, ICP IDC are expected
The year two thousand twenty global metadata total amount will be more than 40ZB, and global total amount of data will be tens times in 2010.At previous several years, entirely
The data volume of ball all increasing with explosion type have not been able to satisfy completely using traditional processing mode using single machine serialization
People are to the requirement under big data environment, and in order to cope with the explosive growth of data volume, distribution has obtained the pass of vast industry
Note.Distributed system has obtained unprecedented development, in order to obtain more powerful storage and computing capability, cluster interior joint
The problem of number is also increasing, the automatically dispose and automatic management of distributed system becomes increasingly conspicuous.A kind of distribution hereby
Formula resource management and deployment platform.
Summary of the invention
It is an object of the invention to solve the problem in above-mentioned technology, a kind of distributed resource management and deployment are provided
Platform, the platform have abandoned the mode that traditional exploitation is mutually separated with deployment management, service have been disposed in the form of component
And management, and the exploitation of service and deployment management are closely combined together；And use customized resource statistics strategy with
And customized allocation strategy, while increasing the scalability of system, requirement and conjunction of the reply service to different resource
The carry out automation node distribution of reason can be realized the automatically dispose and management externally provided to distributed type assemblies service
Function.
In order to solve the above technical problems, The technical solution adopted by the invention is as follows:
A kind of distributed resource management and deployment platform, including distributed system resource management module, component pool submodule
With deployment and service management module, the distributed system resource management module is that component pool submodule and deployment are managed with service
Reason module provides a lightweight, general, expansible interface, and the interface can be used for for obtaining in current cluster
The system resource and resource service condition of node.
Further, as a preferred technical solution, the distributed system resource management module by way of P2P
Node in cluster is organized and managed, the distributed system resource management module uses Chord algorithm and comes from group
P2P network is knitted, and using Gossip agreement come the information between synchronization node and node.
It further, in the distributed system resource management module include as a preferred technical solution, in one
Heart node, the central node is as Global center node.
Further, the component pool submodule externally provides a unified note as a preferred technical solution,
Volume component, more New Parent, the interface for deleting component and securing component.
Further, the deployment and service management module passes through node serve deployment as a preferred technical solution,
With node all in the interface connecting platform of management.
Possessed by of the invention the utility model has the advantages that
The present invention has abandoned the mode that traditional exploitation is mutually separated with deployment management, will service the carry out portion in the form of component
Administration and management, and the exploitation of service and deployment management are closely combined together；And use customized resource statistics strategy
And customized allocation strategy, while increasing the scalability of system, reply requirement of the service to different resource and
It is reasonable to carry out automation node distribution, it can be realized the automatically dispose and management externally provided to distributed type assemblies service
Function.
Detailed description of the invention
Fig. 1 is schematic structural view of the invention.
Specific embodiment
The present invention is further illustrated in the following with reference to the drawings and specific embodiments.
Embodiment 1
As shown in Figure 1, a kind of distributed resource management and deployment platform, including distributed system resource management module, group
Part pond module and deployment and service management module, the distributed system resource management module are component pool submodule and portion
Administration provides a lightweight, general, expansible interface with service management module, and the interface can be used for for obtaining
The system resource and resource service condition of current cluster interior joint, the distributed system resource management module pass through P2P
Mode the node in cluster is organized and managed, the distributed system resource management module use Chord algorithm
Carry out self-organizing P2P network, and using Gossip agreement come the information between synchronization node and node, the distributed system
It include a central node in resource management module, the central node is as Global center node, the component pool submodule
Block externally provide a unified component registration, more New Parent, delete component and securing component interface, the deployment with
Service management module passes through node all in node serve deployment and the interface connecting platform managed.
Node administration in cluster is got up and provides a unified, expansible distribution to outside by system resource management
Formula system asset information interface.Its main function are as follows: obtain nodal information, the information of node is the variation with the time and changes
, in order to more accurately get the information of node, the status information of this node of the update of node meeting timing, and synchronize
To other nodes；Resource statistics strategy is set, in order to define the system resource of user oneself dependence according to the demand of user, is used
Family can realize the information of cluster statistical demand by the different resource statistics strategy of setting；Synchronizing information completes information
It is synchronous, and summary information, the unified interface for obtaining all nodal informations in cluster is provided to external.
Component pool submodule provides the management function of distributed component, user can to distributed system resource management and
Deployment platform registration updates, deletes component.Component registration is used for the component registration into component pool submodule.It is provided by client
The information of component, component pool submodule checking assembly information, and by the component register into component pool.If there is the component,
Then component registration will fail；More New Parent is used to update in component pool submodule chartered component.Group is provided by client
The information of part, whether component pool submodule checking assembly information registered by component, updates the component in component pool.If
There is no the components, then component registration will fail；It deletes component and is used to delete in component pool submodule chartered component.By
Client provides the information that delete component, and whether component pool submodule checking assembly information registered by component, deletes
Component in component pool, if there is no the component, then delete operation will fail；Securing component is used for securing component pond module
In chartered component.The information for needing securing component is provided by client, component pool submodule checking assembly information is
Whether component has been registered, and obtains the component and its relevant information, returns to client.
Deployment and service management are the cores of entire distributed system resource management and deployment platform, complete service oneself
Dynamicization deployment and management work.Its main function are as follows: obtain information on services and be used for distributed system resource management and deployment platform
Need to safeguard the service arrangement situation of all nodes in cluster, and client can obtain the part by corresponding interface
Information；Distribution node is carried out according to the service condition of the demand of client and the system resource of allocation strategy and present node
The distribution of node, the deployment that these nodes will be used to service；Part of nodes deploying client of the deployment services into cluster is specified
Service.Client needs to register corresponding group of service for needing to dispose with deployment platform to distributed system resource management first
Part, then will be on the node of the service arrangement to distribution；Unloading service is for by distributed system resource management and deployment platform
In deployed service carry out unloading or partial relief.
Preferably, in order to according to the demand of the resource service condition of current cluster interior joint and different user not
It is distributed with to carry out node when deployment task, whole system needs the system resource to node all in cluster and works as
Preceding service condition is counted, and is needed in system comprising a distributed system resource management module, to complete to current collection
The case where all nodes, is counted in group, and the synchronizing information of timing, is provided for the distribution of subsequent node and is obtained institute in cluster
There is the interface of the system resource situation of node.Secondly, all services and strategy in platform are all to come portion in the form of component
Administration and operation, so need component pool module that all components in cluster are carried out with unified management in whole system, and to
Other external and system modules provide basic to interfaces such as the registration of component, update, deletion and acquisitions.Finally,
Deployment platform module on the basis of distributed system resource management module and component pool module is to complete final automation
Deployment and managerial role, and connecing for a unified service management is provided to external.
According to the difference of module and function, distributed system resource management and deployment platform are by three subsystems and client
It constitutes, three subsystems are respectively as follows:
Distributed system resource management module: in it is undermost be distributed system resource management module, the subsystem
The node in cluster is organized and managed by way of P2P, wherein using Chord algorithm carrys out self-organizing P2P network,
And using Gossip agreement come the information between synchronization node and node.Have in one in distributed system resource management module
Heart node.It as global central node, externally provides the subsystem and provides the information of all nodes in statistical cluster, save
Point information includes: the system resource of host and the information of service condition where node；Other nodes then only maintain in cluster
The information of part of nodes.Distributed system resource management module is one layer of a basic system resource management, is other moulds
Block provide one it is general, expansible, for obtaining the system resource of present node and the interface of resource service condition.
As simple distributed system resource management system, central node is not necessary.But as the basic of deployment platform
Subsystem provides the case where obtaining the system asset information of all nodes in entire cluster for upper layer.Believe obtaining the part
When breath, we can not initiate to request or until all nodes and the node of inquiry are completed together to all nodes
Step.We need a unified central node to save the partial information, so increasing above-mentioned central node.It is distributed
System resource management module is the deployment platform service for upper layer, due to the resource of node in cluster service condition natively
It is with time change, so not being directed to especially strong consistency in distributed system resource management module.
Component pool submodule: all services and strategy in platform are disposed and are run in the form of component,
Component pool submodule provides the management function of distributed component.User or other modules can to component pool component registration,
More New Parent deletes component and securing component.Since entire project is that mode component-based carrys out tissue, component pool will be at
The center of component is managed collectively for distributed system resource management and deployment platform, and component needed for whole system is provided.For
There is single-point in whole system in reply component pool, and when deployment node is more, due to all execution deployment task
Node require to component pool module securing component, the problem for causing component pool module pressure larger, component pool submodule will
Use the mode of multi-host hot swap to improve reliability, since the component in component pool frequently intensive will not be updated
Operation, can also be by slave node come securing component and its relevant information, to reduce component when disposing in large-scale cluster
Pond module becomes the possibility of bottleneck.
Deployment and service management module: it is constructed in the upper surface of distributed system resource management module and component pool submodule
Our distributed deployment platform completes the tasks such as deployment and the unloading of service, and all nodes are both provided to this in cluster
The interface of node serve deployment and management, the management that can be serviced according to their own needs so as to user.As base
Plinth, deployment and service management module are there are one the control node at center, the service of all nodes in node maintenance cluster
Information；Since the service of cluster interior joint can also have unexpected termination, so control node can be fixed according to other nodes
When synchronous information update the partial information.On those bases, the control node for disposing subsystem receives user's
Request, then generates corresponding task, is issued to specified node and executes, to provide the Automation to distributed type assemblies
The function of administration and management.
Pre-selection, the asynchronous operation side based entirely on readjustment is used due to the communication component Channel of the lower layer of dependence
Formula, in addition to three subsystems above, client here can be sudden and violent to client with deployment platform to distributed system resource management
The interface of dew is packaged, and provides a more friendly, convenient interface to user.
The description and the appended drawings of the invention be considered as it is illustrative and not restrictive, on the basis of the present invention, ability
According to disclosed technology contents, some of technical characteristics can be made field technique personnel by not needing creative labor
Some replacements and deformation, are within the scope of the invention.
Claims (5)
1. a kind of distributed resource management and deployment platform, including distributed system resource management module, component pool submodule and
Deployment and service management module, which is characterized in that the distributed system resource management module is component pool submodule and portion
Administration provides a lightweight, general, expansible interface with service management module, and the interface can be used for for obtaining
The system resource and resource service condition of current cluster interior joint.
2. a kind of distributed resource management according to claim 1 and deployment platform, which is characterized in that the distribution
The node in cluster is organized and managed by way of P2P for system resource management module, the distributed system resource
Management module uses Chord algorithm and carrys out self-organizing P2P network, and using Gossip agreement come between synchronization node and node
Information.
3. a kind of distributed resource management according to claim 1 and deployment platform, which is characterized in that the distribution
It include a central node in system resource management module, the central node is as Global center node.
4. a kind of distributed resource management according to claim 1 and deployment platform, which is characterized in that the component pool
Submodule externally provides a unified component registration, more New Parent, the interface for deleting component and securing component.
5. a kind of distributed resource management according to claim 1 and deployment platform, which is characterized in that the deployment with
Service management module passes through node all in node serve deployment and the interface connecting platform managed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810996708.5A CN109039767A (en) | 2018-08-29 | 2018-08-29 | A kind of distributed resource management and deployment platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810996708.5A CN109039767A (en) | 2018-08-29 | 2018-08-29 | A kind of distributed resource management and deployment platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109039767A true CN109039767A (en) | 2018-12-18 |
Family
ID=64625302
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810996708.5A Withdrawn CN109039767A (en) | 2018-08-29 | 2018-08-29 | A kind of distributed resource management and deployment platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109039767A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109712A (en) * | 2019-04-04 | 2019-08-09 | 平安科技（深圳）有限公司 | Service Component loading method, device, computer equipment and storage medium |
| CN110166538A (en) * | 2019-05-08 | 2019-08-23 | 中国电子科技集团公司第二十九研究所 | A kind of distributive resource managing method |
| CN111984623A (en) * | 2020-08-14 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Database cluster automatic deployment method, device, medium and electronic equipment |
-
2018
- 2018-08-29 CN CN201810996708.5A patent/CN109039767A/en not_active Withdrawn
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109712A (en) * | 2019-04-04 | 2019-08-09 | 平安科技（深圳）有限公司 | Service Component loading method, device, computer equipment and storage medium |
| CN110166538A (en) * | 2019-05-08 | 2019-08-23 | 中国电子科技集团公司第二十九研究所 | A kind of distributive resource managing method |
| CN111984623A (en) * | 2020-08-14 | 2020-11-24 | 北京人大金仓信息技术股份有限公司 | Database cluster automatic deployment method, device, medium and electronic equipment |
| CN111984623B (en) * | 2020-08-14 | 2024-02-09 | 北京人大金仓信息技术股份有限公司 | Automatic deployment method and device for database cluster, medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Mayer et al. | Fogstore: Toward a distributed data store for fog computing | |
| CN102855284B (en) | The data managing method of a kind of cluster storage system and system | |
| EP2932370B1 (en) | System and method for performing a transaction in a massively parallel processing database | |
| US8386540B1 (en) | Scalable relational database service | |
| CN101763347B (en) | GIS (Geographical Information System) interface platform as well as network GIS management system and management method | |
| US8392482B1 (en) | Versioning of database partition maps | |
| CN111858097A (en) | Distributed database system and database access method | |
| CN103150304B (en) | Cloud Database Systems | |
| CN111881223B (en) | Data management method, device, system and storage medium | |
| CN109039767A (en) | A kind of distributed resource management and deployment platform | |
| CN103379159B (en) | A kind of method that distributed Web station data synchronizes | |
| CN106506605A (en) | A kind of SaaS application construction methods based on micro services framework | |
| WO2018036324A1 (en) | Smart city information sharing method and device | |
| CN102164184A (en) | Computer entity access and management method for cloud computing network and cloud computing network | |
| CN103458044A (en) | Metadata sharing management method for multi-storage clusters under wide area network environment | |
| CN102855239A (en) | Distributed geographical file system | |
| CN106856438B (en) | Network service instantiation method, device and NFV system | |
| CN103399894A (en) | Distributed transaction processing method on basis of shared storage pool | |
| CN104050276A (en) | Cache processing method and system of distributed database | |
| CN106953910A (en) | A kind of Hadoop calculates storage separation method | |
| CN105339899A (en) | Method and controller for clustering applications in a software-defined network | |
| CN102937964A (en) | Intelligent data service method based on distributed system | |
| CN104348913A (en) | Tight-coupling extensible big data interaction method | |
| CN106126583A (en) | The collection group strong compatibility processing method of a kind of distributed chart database and system | |
| CN104504128A (en) | Construction method for database system asymmetric deployment based on federated clusters |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20181218 |