CN110266787B - Hybrid cloud management system and method and computer equipment - Google Patents
Hybrid cloud management system and method and computer equipment Download PDFInfo
- Publication number
- CN110266787B CN110266787B CN201910514677.XA CN201910514677A CN110266787B CN 110266787 B CN110266787 B CN 110266787B CN 201910514677 A CN201910514677 A CN 201910514677A CN 110266787 B CN110266787 B CN 110266787B
- Authority
- CN
- China
- Prior art keywords
- data
- analysis
- cloud
- module
- hybrid cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/20—Network architectures or network communication protocols for network security for managing network security; network security policies in general
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a hybrid cloud management system, a hybrid cloud management method and computer equipment, wherein the hybrid cloud management system mainly comprises a task scheduling module for issuing acquisition and analysis tasks, a data analysis module for analyzing cloud data center data and embedded devices, the embedded devices are deployed in clouds managed by the hybrid cloud management system and used for executing the acquisition and analysis tasks issued by the hybrid cloud system aiming at the cloud where the embedded devices are located and sending analysis results to the data analysis module, and each embedded device corresponds to one cloud data center. Compared with the existing mixed cloud system, the method and the system have the advantages that partial data collection and analysis are put into each nanotube platform, so that the affairs related to the data security and the transmission efficiency of the managed party are processed in the data center, the acceptance of users is higher in terms of data security, and the transmission and analysis efficiency is higher in terms of efficiency.
Description
Technical Field
The invention relates to the technical field of intersection of computer technology and information security, in particular to a hybrid cloud management system and a hybrid cloud management method for guaranteeing computation and data security of a multi-party cloud platform.
Background
The hybrid cloud integrates public cloud and private cloud, and is a main mode and development direction of cloud computing in recent years. Private clouds provide a secure data storage and computing environment, while public clouds can provide more flexible, lower cost computing, storage, network resources for enterprises. The hybrid cloud integrates the advantages of the two, the differences of all private cloud platforms and the public cloud platforms at the bottom layer are shielded through abstracting computing, storage and network resources, and the capabilities of unified resource scheduling and cloud service management are realized through adapting the API (application programming interface) of all the platforms.
With the deepening of the production practice of the hybrid cloud, in addition to basic resource management and control, the hybrid cloud platform often needs to provide some data analysis and prediction capabilities for users, for example, security compliance inspection is performed on a virtual machine disk, analysis is performed on a cloud environment host, a log and performance data, resource and fault trend prediction is made, and the like, which all relate to data that a hybrid cloud management system needs to be capable of accessing private cloud and public cloud, and in terms of performance, as the hybrid cloud has the characteristics of cross-region and cross-data center in construction, the problems of low bandwidth, high delay and the like need to be overcome in data transmission, so that the performance is low; from the aspect of security, the data transmission of the private cloud and the public cloud on the public network has high security risk.
Disclosure of Invention
In order to solve the above problems, the present invention provides a hybrid cloud management system, a hybrid cloud management method, and a computer device.
According to a first aspect of the present invention, the present invention provides a hybrid cloud management platform, which mainly includes the following modules:
the task scheduling module is used for issuing acquisition and analysis tasks;
the data analysis module is used for analyzing the cloud data center data;
the embedded device is deployed in the cloud managed by the hybrid cloud management system and used for executing acquisition and analysis tasks issued by the hybrid cloud system aiming at the cloud where the embedded device is located and sending an analysis result to the data analysis module.
Wherein the embedded device comprises:
the control scheduling module is used for receiving acquisition and analysis tasks issued by the hybrid cloud management system and issuing the tasks through messages;
the acquisition module is used for receiving the task information issued by the control scheduling module, analyzing the task parameters, acquiring the task information, inquiring and reading data according to the requirement of the task information, and transmitting the inquired and read data to the analysis module through the information;
the analysis module receives the data sent by the acquisition module, analyzes and processes the data, stores an analysis result in a database, and extracts the analysis result according to the requirement;
the message module is used for realizing message queue and message transmission;
the database is used for storing data analysis results;
and the interface adaptation layer is used for adapting the I/O interfaces of various data storage media, and comprises a data mounting protocol and a reading protocol.
The hybrid cloud management system comprises a cluster consisting of 2 or more than 2 embedded devices, and each embedded device corresponds to one cloud data center.
According to another aspect of the present invention, there is provided a hybrid cloud management method, including the steps of:
s1, deploying a hybrid cloud management system in the hybrid cloud data centers, deploying one embedded device in each cloud data center, forming an embedded device cluster by all the embedded devices, and uniformly scheduling and managing by the hybrid cloud management system;
s2, the hybrid cloud system manages different cloud data centers through the embedded device cluster, calls the embedded device API through the task scheduling module, and issues acquisition and analysis tasks;
and s3, each cloud data center executes the acquisition and analysis tasks of the cloud where the cloud data center is located by the hybrid cloud system through the embedded device on the cloud data center, and sends the analysis result to the data analysis module.
s4, periodically and alternately training and acquiring the analysis result of the embedded device in the embedded device cluster through the data analysis module;
s5, performing overall analysis and tidying display on the analysis result in the step s 4.
Wherein the step s3 includes the steps of:
s31, each cloud data center analyzes the task parameters through a control scheduling module of the embedded device on the cloud data center, and sends a data acquisition message instruction;
s32, receiving the instruction in the step s31 through the acquisition module, initiating a data operation request to the managed cloud data center, reading data, and if the data operation request is successful, sending an analysis instruction; if the task fails, saving the reason of the task failure;
s33, receiving the analysis instruction through the analysis module, analyzing the read data, and storing the analysis result in the database;
and s34, realizing message queue through the message module, and completing message transmission of the embedded device and the data analysis module.
The method can effectively solve the multi-party data security problem and the efficiency problem in the floor practice process of the hybrid cloud, the original data of the user cannot flow out of the data center, calculation and processing are executed in the data center of the user, only the final analysis result is submitted to the hybrid cloud management system, the data security risk of the user is greatly reduced, the acceptance degree of the user on the hybrid cloud architecture is improved, and the method is beneficial to the development of the hybrid cloud.
Drawings
FIG. 1 is a schematic diagram of a hybrid cloud management system architecture according to an embodiment of the present invention;
fig. 2 is a schematic deployment diagram of a hybrid cloud management system according to an embodiment of the present invention.
Detailed Description
For a better understanding of the present invention, reference is made to the following detailed description taken in conjunction with the accompanying drawings.
As shown in fig. 1, the hybrid cloud management platform of the present invention mainly includes the following modules:
the task scheduling module is used for issuing acquisition and analysis tasks;
the data analysis module is used for analyzing the cloud data center data;
the embedded device is deployed in the cloud managed by the hybrid cloud management system and used for executing acquisition and analysis tasks issued by the hybrid cloud system aiming at the cloud where the embedded device is located and sending an analysis result to the data analysis module. The hybrid cloud management system comprises a cluster consisting of 2 or more than 2 embedded devices, and each embedded device corresponds to one cloud data center.
Wherein the embedded device comprises:
the control scheduling module is used for receiving acquisition and analysis tasks issued by the hybrid cloud management system and issuing the tasks through messages;
the acquisition module is used for receiving the task information issued by the control scheduling module, analyzing the task parameters, acquiring the task information, inquiring and reading data according to the requirement of the task information, and transmitting the inquired and read data to the analysis module through the information;
the analysis module receives the data sent by the acquisition module, analyzes and processes the data, stores an analysis result in a database, and extracts the analysis result according to the requirement;
the message module is used for realizing message queue and message transmission;
the database is used for storing data analysis results;
and the interface adaptation layer is used for adapting the I/O interfaces of various data storage media, and comprises a data mounting protocol and a reading protocol.
According to an embodiment of the present invention, as shown in fig. 2, in the hybrid cloud management system for hosting a hybrid cloud platform composed of a public cloud and a private cloud, an embedded device is deployed in a public cloud data center, and an embedded device is deployed in a private cloud data center. Wherein, the embedded device can be a virtual machine or a container, is deployed and operated in the managed public cloud or Private cloud, and is responsible for receiving the collection and analysis tasks of the hybrid cloud system, and performs data request and reading with the public cloud/Private cloud management platform, the embedded device performs data analysis processing, and returns the final analysis result to the hybrid cloud system, the hybrid cloud system integrates the result, and finally shows the result to the user for the public cloud and Private cloud, there is a certain difference in architecture and deployment, when the hybrid cloud system manages the public cloud resources, it usually manages a VPC virtual Private cloud with the authority of a tenant, so the embedded device can be deployed in the VPC in the form of a virtual machine, the network needs to ensure the connectivity to the hybrid cloud system (can be realized by float IP), connectivity to internal and public cloud management system data interface services (which may be achieved through NAT). For a private cloud, a hybrid cloud system is usually managed under the authority of an administrator, so an embedded device can be directly deployed in a private cloud data center in a virtual machine manner, and the network needs to ensure the connectivity (which can be realized through float IP) between the external and the hybrid cloud system and the connectivity (which can be realized through NAT) between the internal and the private cloud management system data interface service.
According to another embodiment of the present invention, a hybrid cloud management method of the present invention includes the steps of:
s1, deploying a hybrid cloud management system in the hybrid cloud data centers, deploying one embedded device in each cloud data center, forming an embedded device cluster by all the embedded devices, and uniformly scheduling and managing by the hybrid cloud management system;
s2, the hybrid cloud system manages different cloud data centers through the embedded device cluster, calls the embedded device API through the task scheduling module, and issues acquisition and analysis tasks;
and s3, each cloud data center executes the acquisition and analysis tasks of the cloud where the cloud data center is located by the hybrid cloud system through the embedded device on the cloud data center, and sends the analysis result to the data analysis module.
s4, periodically and alternately training and acquiring the analysis result of the embedded device in the embedded device cluster through the data analysis module;
s5, performing overall analysis and tidying display on the analysis result in the step s 4.
Wherein the step s3 includes the steps of:
s31, each cloud data center analyzes the task parameters through a control scheduling module of the embedded device on the cloud data center, and sends a data acquisition message instruction;
s32, receiving the instruction in the step s31 through the acquisition module, initiating a data operation request to the managed cloud data center, reading data, and if the data operation request is successful, sending an analysis instruction; if the task fails, saving the reason of the task failure;
s33, receiving the analysis instruction through the analysis module, analyzing the read data, and storing the analysis result in the database;
and s34, realizing message queue through the message module, and completing message transmission of the embedded device and the data analysis module.
Compared with the existing hybrid cloud system, the hybrid cloud management system and the hybrid cloud management method have the advantages that partial data collection and analysis are put into each nanotube platform, so that the affairs related to the data security and the transmission efficiency of the managed party are processed in the data center, the acceptance of users is higher in the aspect of data security, and the transmission and analysis efficiency is higher in the aspect of efficiency.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be able to cover the technical solutions and the inventive concepts of the present invention within the technical scope of the present invention.
Claims (4)
1. A hybrid cloud management system, comprising:
the task scheduling module is used for issuing acquisition and analysis tasks;
the data analysis module is used for analyzing the cloud data center data;
the embedded device is deployed in the cloud managed by the hybrid cloud management system, and is used for executing acquisition and analysis tasks issued by the hybrid cloud system aiming at the cloud where the embedded device is located and sending an analysis result to the data analysis module;
the embedded device includes:
the control scheduling module is used for receiving acquisition and analysis tasks issued by the hybrid cloud management system and issuing the tasks through messages;
the acquisition module is used for receiving the task information issued by the control scheduling module, analyzing the task parameters, acquiring the task information, inquiring and reading data according to the requirement of the task information, and transmitting the inquired and read data to the analysis module through the information;
the analysis module receives the data sent by the acquisition module, analyzes and processes the data, stores an analysis result in a database, and extracts the analysis result according to the requirement;
the message module is used for realizing message queue and message transmission;
the database is used for storing data analysis results;
and the interface adaptation layer is used for adapting the I/O interfaces of various data storage media, and comprises a data mounting protocol and a reading protocol.
2. The hybrid cloud management system of claim 1,
the hybrid cloud management system comprises a cluster consisting of 2 or more than 2 embedded devices, and each embedded device corresponds to one cloud data center.
3. A management method of the hybrid cloud management system according to claim 1 or 2, comprising the steps of:
s1, deploying a hybrid cloud management system in the hybrid cloud data centers, deploying one embedded device in each cloud data center, forming an embedded device cluster by all the embedded devices, and uniformly scheduling and managing by the hybrid cloud management system;
s2, the hybrid cloud system manages different cloud data centers through the embedded device cluster, calls the embedded device API through the task scheduling module, and issues acquisition and analysis tasks;
s3, each cloud data center executes the acquisition and analysis tasks of the cloud where the cloud data center is located by the mixed cloud system through the embedded device on the cloud data center, and sends the analysis result to the data analysis module;
s4, periodically and alternately training and acquiring the analysis result of the embedded device in the embedded device cluster through the data analysis module;
s5, performing overall analysis and sorting display on the analysis result in the step s 4;
the step s3 includes the steps of:
s31, each cloud data center analyzes the task parameters through a control scheduling module of the embedded device on the cloud data center, and sends a data acquisition message instruction;
s32, receiving the instruction in the step s31 through the acquisition module, initiating a data operation request to the managed cloud data center, reading data, and if the data operation request is successful, sending an analysis instruction; if the task fails, saving the reason of the task failure;
s33, receiving the analysis instruction through the analysis module, analyzing the read data, and storing the analysis result in the database;
and s34, realizing message queue through the message module, and completing message transmission of the embedded device and the data analysis module.
4. A computer device for hybrid cloud management, comprising a memory and a processor, on which a computer program is stored that is executable on the processor, characterized in that the processor implements the steps of the method of claim 3 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910514677.XA CN110266787B (en) | 2019-06-14 | 2019-06-14 | Hybrid cloud management system and method and computer equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910514677.XA CN110266787B (en) | 2019-06-14 | 2019-06-14 | Hybrid cloud management system and method and computer equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110266787A CN110266787A (en) | 2019-09-20 |
| CN110266787B true CN110266787B (en) | 2022-03-18 |
Family
ID=67918318
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910514677.XA Active CN110266787B (en) | 2019-06-14 | 2019-06-14 | Hybrid cloud management system and method and computer equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110266787B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078411A (en) * | 2019-12-12 | 2020-04-28 | 创新奇智(青岛)科技有限公司 | Task scheduling system and scheduling method based on hybrid cloud |
| CN116136801B (en) * | 2021-11-12 | 2024-02-23 | 中国联合网络通信集团有限公司 | Cloud platform data processing method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106210124A (en) * | 2016-08-03 | 2016-12-07 | 浪潮电子信息产业股份有限公司 | Unified cloud data center monitoring system |
| CN107171818A (en) * | 2016-03-07 | 2017-09-15 | 阿里巴巴集团控股有限公司 | Control method, system and device for mixed cloud |
| CN109672709A (en) * | 2017-10-17 | 2019-04-23 | 上海仪电（集团）有限公司中央研究院 | A kind of mixed cloud service scheduling system and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104508627B (en) * | 2012-10-08 | 2017-12-15 | 慧与发展有限责任合伙企业 | Mix cloud environment |
-
2019
- 2019-06-14 CN CN201910514677.XA patent/CN110266787B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107171818A (en) * | 2016-03-07 | 2017-09-15 | 阿里巴巴集团控股有限公司 | Control method, system and device for mixed cloud |
| CN106210124A (en) * | 2016-08-03 | 2016-12-07 | 浪潮电子信息产业股份有限公司 | Unified cloud data center monitoring system |
| CN109672709A (en) * | 2017-10-17 | 2019-04-23 | 上海仪电（集团）有限公司中央研究院 | A kind of mixed cloud service scheduling system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110266787A (en) | 2019-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8713177B2 (en) | Remote management of networked systems using secure modular platform | |
| WO2023077952A1 (en) | Data processing method and system, related device, storage medium and product | |
| CN101969391B (en) | Cloud platform supporting fusion network service and operating method thereof | |
| AU2018370848A1 (en) | Auto-scaling hosted machine learning models for production inference | |
| CN110545260A (en) | Cloud management platform construction method based on mimicry structure | |
| US7818752B2 (en) | Interface for application components | |
| CN103685608A (en) | Method and device for automatically configuring IP (Internet Protocol) address of security virtual machine | |
| CN112698838B (en) | Multi-cloud container deployment system and container deployment method thereof | |
| CN110266787B (en) | Hybrid cloud management system and method and computer equipment | |
| US8954584B1 (en) | Policy engine for automating management of scalable distributed persistent applications in a grid | |
| JP2023046248A (en) | Metrics and security-based accelerator service rescheduling and auto-scaling using programmable network device | |
| CN111200606A (en) | Deep learning model task processing method, system, server and storage medium | |
| CN112313627A (en) | Mapping mechanism of events to serverless function workflow instances | |
| CN112948133A (en) | Resource scheduling management method and device and cloud platform | |
| CN113703997A (en) | Bidirectional asynchronous communication middleware system integrating multiple message agents and implementation method | |
| CN113806097A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN116204307A (en) | Federal learning method and federal learning system compatible with different computing frameworks | |
| Böhm et al. | Cloud-edge orchestration for smart cities: A review of kubernetes-based orchestration architectures | |
| CN109756490A (en) | A kind of MDC implementation method and device | |
| CN102902593B (en) | Agreement distributing and processing system based on caching mechanism | |
| CN112351106A (en) | Service grid platform containing event grid and communication method thereof | |
| CN109525443B (en) | processing method and device for distributed pre-acquisition communication link and computer equipment | |
| CN112068953A (en) | Cloud resource fine management traceability system and method | |
| US11595471B1 (en) | Method and system for electing a master in a cloud based distributed system using a serverless framework | |
| CN111190731A (en) | Cluster task scheduling system based on weight |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |