CN112559128A - Apache Kylin hosting system and method based on cloud computing - Google Patents
Apache Kylin hosting system and method based on cloud computing Download PDFInfo
- Publication number
- CN112559128A CN112559128A CN202011483291.6A CN202011483291A CN112559128A CN 112559128 A CN112559128 A CN 112559128A CN 202011483291 A CN202011483291 A CN 202011483291A CN 112559128 A CN112559128 A CN 112559128A
- Authority
- CN
- China
- Prior art keywords
- computing
- module
- cloud
- monitoring
- application module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000004364 calculation method Methods 0.000 claims abstract description 33
- 238000007405 data analysis Methods 0.000 claims abstract description 8
- 238000004458 analytical method Methods 0.000 claims abstract description 7
- 238000012544 monitoring process Methods 0.000 claims description 40
- 238000012423 maintenance Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 5
- 238000013079 data visualisation Methods 0.000 claims description 3
- 238000000926 separation method Methods 0.000 abstract description 2
- 238000003032 molecular docking Methods 0.000 description 3
- 239000002699 waste material Substances 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000008602 contraction Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45579—I/O management, e.g. providing access to device drivers or storage
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- Debugging And Monitoring (AREA)
- Stored Programmes (AREA)
Abstract
The invention provides an Apache Kylin hosting system and method based on cloud computing.A management module is arranged on a virtual machine and is responsible for application and creation of infrastructure on a cloud, and the management module automatically creates required computing, storage and network resources in a cloud platform account of a user by calling a public interface provided by a cloud platform; nodes in the calculation and storage separation cluster only provide calculation resources, and object storage is used as storage resources; apache Kylin is taken as an OLAP engine, and data visualization software is built in the OLAP engine. Based on the invention, an OLAP analysis platform with low threshold, low cost and high performance can be quickly constructed on the cloud, and the data analysis requirements of enterprises on the cloud are met.
Description
Technical Field
The invention relates to the technical field of data analysis, in particular to an Apache Kylin hosting system and method based on cloud computing.
Background
At present, Apache Kylin is an open-source distributed analysis engine, provides an SQL (structured query language) query interface and multidimensional analysis (OLAP) capability above Hadoop/Spark, supports sub-second-level query on super-large-scale data, and is adopted by thousands of enterprises in the world at present. At present, when an enterprise performs data analysis by adopting Apache Kylin, three problems are mainly encountered, firstly, Apache Kylin needs to be operated on a Hadoop cluster, and for the enterprise without the Hadoop cluster, the difficulty of deploying an operation and maintenance cluster is high, the use threshold is also high, and a corresponding big data talent is needed. Secondly, in the face of increasing mass data and access flow, IT is necessary to continuously increase IT infrastructure, and the investment is large. Thirdly, compared with the traditional data center, cloud computing has many advantages such as low cost, expandability and safety, cloud on an IT infrastructure is a current trend, and enterprises must consider a data analysis solution after the cloud on data.
Disclosure of Invention
In view of this, the present disclosure provides a cloud computing-based Apache Kylin hosting system and method for the pain point and demand encountered when an enterprise uses Apache Kylin at present, and the technical scheme is as follows:
in one aspect, the invention provides an Apache Kylin hosting system based on cloud computing, which comprises a management module, a computing module, an application module and a monitoring module, wherein the management module is arranged on a virtual machine, the application and the creation of infrastructure on the cloud are applied and created by using button operation, the Apache Kylin and a cluster are deployed and used for managing the deployment, the operation and the maintenance of the computing module, the application module and the monitoring module, the computing module is a distributed computing cluster consisting of a plurality of at least 4 nodes and used for providing computing and storage resources for the application module, and has the capability of automatic expansion and contraction, the application module is used for providing OLAP analysis capability and data visualization capability, and the monitoring module is used for monitoring the computing module and the application module.
Further, the management module automatically creates needed infrastructure on the cloud in the cloud platform account of the user, including computing, storage and network resources, by calling a public interface provided by the cloud platform, deploys computing module programs on at least 4 nodes, constructs a computing module, deploys application module programs on at least 1 node, constructs an application module, deploys monitoring programs on the computing module and the application module nodes, and constructs a monitoring module of the full platform.
Furthermore, the computing module adopts a framework with separated computing and storage, nodes in the cluster only provide computing resources, and object storage is used as storage resources.
Furthermore, the computing module has the automatic scaling capability, and according to the load state of the current cluster and a corresponding scaling strategy, when the cluster has computing tasks and is in a waiting state due to insufficient resources, the computing module automatically increases the computing load of the computing nodes, and when the cluster has nodes without tasks and is in an idle state, the computing module automatically releases idle computing nodes.
Furthermore, the application module submits the calculation task to the calculation module, and after the calculation module completes the calculation, the result is returned to the application module or persistently stored.
Furthermore, the application module takes Apache Kylin as an OLAP engine and is internally provided with data visualization software.
Furthermore, the application module provides full-link one-stop data analysis capability from data access and modeling to report display and provides docking capability with mainstream BI software.
Further, the monitoring operation of the monitoring module includes monitoring system indexes of all nodes and setting threshold values of all indexes for email alarm, and also includes collecting system logs of all modules and displaying and querying support logs.
In another aspect, the present invention provides an Apache Kylin hosting method based on cloud computing, where the method is applied to the above-mentioned Apache Kylin hosting system based on cloud computing, and includes the following steps:
step 1: the management module applies for and creates infrastructure on the cloud, and deploys a computing module, an application module and a monitoring module;
step 2: the application module takes Apache Kylin as an OLAP engine to submit a calculation task to the calculation module;
and step 3: the computing module automatically stretches computing nodes and executes computing tasks;
and 4, step 4: the calculation module returns the calculation result to the application module and stores the calculation result in an object storage of the calculation module;
and 5: the monitoring module monitors the operation process of the computing module and the application module;
step 6: and outputting index monitoring alarm and collecting monitoring logs.
The invention provides an Apache Kylin hosting system and method based on cloud computing, wherein the mode of deploying Apache Kylin on the cloud is matched with the trend of an enterprise IT facility and the cloud on the data, an OLAP analysis platform based on Apache Kylin can be quickly constructed on the cloud, the requirement of large data analysis on the cloud of the enterprise is met, a management module is used, a plurality of buttons can be simply clicked to complete application and creation of infrastructure on the cloud, Apache Kylin and a cluster are deployed, the deployment and the operation of the computing module, the application module and a monitoring module are further managed, the difficulty of operation and maintenance deployment is greatly reduced, and the use threshold is reduced; the automatic telescopic function of the computing module can automatically increase computing nodes when the computing load is large, the requirement of increasing the nodes when the flow is increased is met, meanwhile, after the flow is reduced, the computing nodes can be automatically reduced, and unnecessary resource waste is avoided.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, serve to provide a further understanding of the application and to enable other features, objects, and advantages of the application to be more apparent. The drawings and their description illustrate the embodiments of the invention and do not limit it. In the drawings:
FIG. 1 is a schematic diagram of an Apache Kylin hosting system based on cloud computing according to the present invention;
fig. 2 is a schematic diagram of an Apache Kylin hosting method based on cloud computing according to the present invention.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In this application, the terms "upper", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings. These terms are used primarily to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to a particular orientation or to be constructed and operated in a particular orientation.
Moreover, some of the above terms may be used to indicate other meanings besides the orientation or positional relationship, for example, the term "on" may also be used to indicate some kind of attachment or connection relationship in some cases. The specific meaning of these terms in this application will be understood by those of ordinary skill in the art as appropriate.
In addition, the term "plurality" shall mean two as well as more than two.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
Example one
An embodiment of the present invention provides an Apache Kylin hosting system based on cloud computing, as shown in fig. 1, which includes a management module, a computing module, an application module, and a monitoring module, where the management module is set on a virtual machine, and is responsible for application and creation of infrastructure on the cloud, and is used to manage deployment, operation, and maintenance of the computing module, the application module, and the monitoring module, the computing module is a distributed computing cluster composed of at least 4 nodes and is used to provide computing and storage resources for the application module, the application module is used to provide OLAP analysis capability and data visualization capability, and the monitoring module is used to monitor the computing module and the application module.
The management module runs on an independent virtual machine, and automatically creates required infrastructure on the cloud including computing, storage and network resources in a cloud platform account of a user by calling a public interface provided by a cloud platform, wherein the created infrastructure includes but is not limited to the virtual machine, a database and the like during specific implementation. The management module is responsible for deploying computing modules, application modules and monitoring modules, deploying computing module programs on at least 4 nodes by the management module based on the created infrastructure on the cloud, constructing the computing modules, deploying application module programs on at least 1 node, constructing the application modules, deploying the monitoring programs on the computing modules and the nodes of the application modules, constructing the monitoring modules of a full platform, and managing the operation and maintenance of the computing modules, the application modules and the monitoring modules.
The computing module adopts a structure with separated computing and storage, nodes in the cluster only provide computing resources, and object storage is used as storage resources. The architecture with the separated computing and storage greatly improves the expandability of a computing module, the storage uses the object storage provided on the cloud, and compared with the traditional HDFS, the cloud-based HDFS has higher stability and lower cost, theoretically has no capacity limitation, and can store mass data. The computing module has the automatic expansion capability, and according to the load state of the current cluster and a corresponding expansion strategy, when the cluster has computing tasks and is in a waiting state due to insufficient resources, computing nodes are automatically increased to deal with the computing loads, when the cluster has nodes without tasks, and when the cluster is in an idle state, idle computing nodes are automatically released, so that resource waste is avoided. The computing module improves the expandability of the whole system and reduces the use cost through the design of separation of computing and storage and automatic expansion.
And the application module submits the calculation task to the calculation module, and after the calculation module finishes calculation, the result is returned to the application module or persistently stored.
The application module takes Apache Kylin as an OLAP engine, and is internally provided with data visualization software, so that the full-link one-stop data analysis capability from data access and modeling to report display is provided, the docking capability with mainstream BI software is provided, and the seamless docking with the mainstream BI software such as Microsoft Power BI and Tableau is supported. In specific implementation, desktop applications of Tableau and Microsoft Power BI are connected by installing a Kylin ODBC driver and a Kylin data source connector.
Monitoring work of the monitoring module is to monitor system indexes of all nodes, wherein in specific implementation, the monitored indexes comprise information such as a CPU (central processing unit), a memory and the like, and can set threshold values of all indexes to carry out mail alarming, and on the other hand, system logs of all modules are collected to display and inquire support logs, so that problems are conveniently checked.
Example two
An embodiment of the present invention provides a cloud-computing-based Apache Kylin hosting method, which is applied to the cloud-computing-based Apache Kylin hosting system, as shown in fig. 2, and includes the following steps:
step 1: the management module applies for and creates infrastructure on the cloud, and deploys a computing module, an application module and a monitoring module;
during implementation, the management module is used for simply clicking a plurality of buttons to deploy the Apache Kylin and the clusters on the cloud, so that the difficulty of operation and maintenance deployment is greatly reduced, and the use threshold is lowered.
Step 2: the application module takes Apache Kylin as an OLAP engine to submit a calculation task to the calculation module;
and step 3: the computing module automatically stretches computing nodes and executes computing tasks;
during specific implementation, according to the load state of the current cluster and a corresponding expansion strategy, the corresponding calculation load of the calculation node is automatically increased when the cluster load is heavy, and the idle calculation node is automatically released when the cluster load is low, so that resource waste is avoided.
And 4, step 4: the calculation module returns the calculation result to the application module and stores the calculation result in an object storage of the calculation module;
when the method is implemented specifically, visual software is arranged in the application module, the report shows the calculation result, and the calculation result can also be shown through mainstream BI software.
And 5: the monitoring module monitors the operation process of the computing module and the application module;
step 6: and outputting index monitoring alarm and collecting monitoring logs.
In specific implementation, on one hand, system indexes of all nodes are monitored, the monitored indexes comprise information such as a CPU (central processing unit), a memory and the like, threshold values of all indexes can be set for mail alarming, and on the other hand, system logs of all modules are collected, display and query of support logs are carried out, and problems are conveniently checked.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. An Apache Kylin hosting system based on cloud computing is characterized by comprising a management module, a computing module, an application module and a monitoring module, wherein the management module is arranged on a virtual machine, a button is used for operating and applying and creating infrastructure on the cloud, Apache Kylin and a cluster are deployed and used for managing deployment, operation and maintenance of the computing module, the application module and the monitoring module, the computing module is a distributed computing cluster consisting of at least 4 nodes and used for providing computing and storage resources for the application module, the computing module has automatic stretching capacity, the application module is used for providing OLAP analysis capacity and data visualization capacity, and the monitoring module is used for monitoring the computing module and the application module.
2. The cloud-computing-based Apache Kylin hosting system of claim 1, wherein the management module automatically creates required on-cloud infrastructure, including computing, storage, and network resources, within a user's cloud platform account by invoking a public interface provided by the cloud platform.
3. The cloud-computing-based Apache Kylin hosting system of claim 1, wherein the management module deploys computing module programs on at least 4 nodes to build a computing module, deploys application module programs on at least 1 node to build an application module, deploys monitoring programs on the nodes of the computing module and the application module to build a full-platform monitoring module.
4. The cloud-computing-based Apache Kylin hosting system of claim 1, wherein the computing modules employ a separate computing and storage architecture, nodes in a cluster provide only computing resources, and object storage is used as storage resources.
5. The cloud computing-based Apache Kylin hosting system of claim 1, wherein the computing modules automatically increase the computing nodes to handle the computing load when a cluster has a computing task in a waiting state due to insufficient resources, and automatically release idle computing nodes when the cluster has no task and is in an idle state, according to a load state of a current cluster and a corresponding scaling strategy.
6. The cloud-computing-based Apache Kylin hosting system according to claim 1, wherein the application module submits computing tasks to the computing module, and after the computing module completes computing, the results are returned to the application module or persistently stored.
7. The cloud-based Apache Kylin hosting system of claim 1, wherein the application module uses Apache Kylin as an OLAP engine and is embedded with data visualization software.
8. The cloud-computing-based Apache Kylin hosting system of claim 1, wherein the application module provides full-link one-stop data analysis capability from data access, modeling to report presentation, providing interfacing capability with mainstream BI software.
9. The cloud-computing-based Apache Kylin hosting system according to claim 1, wherein the monitoring of the monitoring modules includes monitoring system metrics of all nodes and setting thresholds of each metric for email alert, and further includes collecting system logs of all modules, and displaying and querying support logs.
10. A cloud-based Apache Kylin hosting method applied to the cloud-based Apache Kylin hosting system according to any one of claims 1 to 9, comprising the steps of:
step 1: the management module applies for and creates infrastructure on the cloud, and deploys a computing module, an application module and a monitoring module;
step 2: the application module takes Apache Kylin as an OLAP engine to submit a calculation task to the calculation module;
and step 3: the computing module automatically stretches computing nodes and executes computing tasks;
and 4, step 4: the calculation module returns the calculation result to the application module and stores the calculation result in an object storage of the calculation module;
and 5: the monitoring module monitors the operation process of the computing module and the application module;
step 6: and outputting index monitoring alarm and collecting monitoring logs.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011483291.6A CN112559128B (en) | 2020-12-15 | 2020-12-15 | APACHE KYLIN hosting system and method based on cloud computing |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011483291.6A CN112559128B (en) | 2020-12-15 | 2020-12-15 | APACHE KYLIN hosting system and method based on cloud computing |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112559128A true CN112559128A (en) | 2021-03-26 |
CN112559128B CN112559128B (en) | 2024-06-14 |
Family
ID=75063931
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011483291.6A Active CN112559128B (en) | 2020-12-15 | 2020-12-15 | APACHE KYLIN hosting system and method based on cloud computing |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112559128B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117009038A (en) * | 2023-10-07 | 2023-11-07 | 之江实验室 | Graph computing platform based on cloud native technology |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103092698A (en) * | 2012-12-24 | 2013-05-08 | 中国科学院深圳先进技术研究院 | System and method of cloud computing application automatic deployment |
CN104579761A (en) * | 2014-12-24 | 2015-04-29 | 西安工程大学 | Automatic nosql cluster configuration system and method based on cloud computing |
CN104618693A (en) * | 2015-02-09 | 2015-05-13 | 北京邮电大学 | Cloud computing based online processing task management method and system for monitoring video |
CN105701200A (en) * | 2016-01-12 | 2016-06-22 | 中国人民大学 | Data warehouse security OLAP method on memory cloud computing platform |
US20170011298A1 (en) * | 2015-02-23 | 2017-01-12 | Biplab Pal | Internet of things based determination of machine reliability and automated maintainenace, repair and operation (mro) logs |
CN106776005A (en) * | 2016-11-23 | 2017-05-31 | 华中科技大学 | A kind of resource management system and method towards containerization application |
CN107734035A (en) * | 2017-10-17 | 2018-02-23 | 华南理工大学 | A kind of Virtual Cluster automatic telescopic method under cloud computing environment |
CN107943555A (en) * | 2017-10-17 | 2018-04-20 | 华南理工大学 | Big data storage and processing platform and processing method under a kind of cloud computing environment |
CN107959588A (en) * | 2017-12-07 | 2018-04-24 | 郑州云海信息技术有限公司 | Cloud resource management method, cloud resource management platform and the management system of data center |
CN108449383A (en) * | 2018-02-11 | 2018-08-24 | 西南电子技术研究所(中国电子科技集团公司第十研究所) | Distributed thin cloud computing system mobile in real time |
WO2018209594A1 (en) * | 2017-05-17 | 2018-11-22 | Ebay Inc. | Olap cube optimization using weightings |
CN109600269A (en) * | 2019-01-21 | 2019-04-09 | 云南电网有限责任公司信息中心 | A kind of cloud management platform based on DCOS |
CN110875833A (en) * | 2018-08-31 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Cluster hybrid cloud, job processing method and device and electronic equipment |
-
2020
- 2020-12-15 CN CN202011483291.6A patent/CN112559128B/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103092698A (en) * | 2012-12-24 | 2013-05-08 | 中国科学院深圳先进技术研究院 | System and method of cloud computing application automatic deployment |
CN104579761A (en) * | 2014-12-24 | 2015-04-29 | 西安工程大学 | Automatic nosql cluster configuration system and method based on cloud computing |
CN104618693A (en) * | 2015-02-09 | 2015-05-13 | 北京邮电大学 | Cloud computing based online processing task management method and system for monitoring video |
US20170011298A1 (en) * | 2015-02-23 | 2017-01-12 | Biplab Pal | Internet of things based determination of machine reliability and automated maintainenace, repair and operation (mro) logs |
CN105701200A (en) * | 2016-01-12 | 2016-06-22 | 中国人民大学 | Data warehouse security OLAP method on memory cloud computing platform |
CN106776005A (en) * | 2016-11-23 | 2017-05-31 | 华中科技大学 | A kind of resource management system and method towards containerization application |
WO2018209594A1 (en) * | 2017-05-17 | 2018-11-22 | Ebay Inc. | Olap cube optimization using weightings |
CN107734035A (en) * | 2017-10-17 | 2018-02-23 | 华南理工大学 | A kind of Virtual Cluster automatic telescopic method under cloud computing environment |
CN107943555A (en) * | 2017-10-17 | 2018-04-20 | 华南理工大学 | Big data storage and processing platform and processing method under a kind of cloud computing environment |
CN107959588A (en) * | 2017-12-07 | 2018-04-24 | 郑州云海信息技术有限公司 | Cloud resource management method, cloud resource management platform and the management system of data center |
CN108449383A (en) * | 2018-02-11 | 2018-08-24 | 西南电子技术研究所(中国电子科技集团公司第十研究所) | Distributed thin cloud computing system mobile in real time |
CN110875833A (en) * | 2018-08-31 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Cluster hybrid cloud, job processing method and device and electronic equipment |
CN109600269A (en) * | 2019-01-21 | 2019-04-09 | 云南电网有限责任公司信息中心 | A kind of cloud management platform based on DCOS |
Non-Patent Citations (4)
Title |
---|
ALFREDO CUZZOCREA: ""A Cloud-Based Framework for Supporting Effective and Efficient OLAP in Big Data Environments"", 《2014 14TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING》 * |
亚马逊云科技: ""Data lake系列:如何在AWS云上使用Apache Kylin"", Retrieved from the Internet <URL:《知网,https://zhuanlan.zhihu.com/p/113526402》> * |
刘瑜: ""基于云平台的OLAP系统研究与实现"", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
林诚: ""基于大数据技术的国家级医院节能监管平台设计"", 《中国卫生信息管理杂志》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117009038A (en) * | 2023-10-07 | 2023-11-07 | 之江实验室 | Graph computing platform based on cloud native technology |
CN117009038B (en) * | 2023-10-07 | 2024-02-13 | 之江实验室 | Graph computing platform based on cloud native technology |
Also Published As
Publication number | Publication date |
---|---|
CN112559128B (en) | 2024-06-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9275172B2 (en) | Systems and methods for analyzing performance of virtual environments | |
CN104618693B (en) | A kind of monitor video based on cloud computing handles task management method and system online | |
CN110417613B (en) | Distributed performance testing method, device, equipment and storage medium based on Jmeter | |
CN102508639B (en) | Distributed parallel processing method based on satellite remote sensing data characteristics | |
CN105024851A (en) | Cloud computing-based monitoring management system | |
CN114598586B (en) | Multi-cloud scene computing power gridding method and system | |
CN107682209A (en) | A kind of SDP big datas automatically dispose monitor supervision platform | |
CN109871384A (en) | Method, system, equipment and the storage medium of container migration are carried out based on PaaS platform | |
CN112579267A (en) | Decentralized big data job flow scheduling method and device | |
CN112579287B (en) | Cloud arrangement system and method based on read-write separation and automatic expansion | |
CN103345386A (en) | Software production method, device and operation system | |
CN112579288A (en) | Cloud computing-based intelligent security data management system | |
CN111082521A (en) | Operation and maintenance data monitoring method and operation and maintenance system of power grid regulation and control system | |
CN114691050B (en) | Cloud native storage method, device, equipment and medium based on kubernets | |
CN112559128A (en) | Apache Kylin hosting system and method based on cloud computing | |
CN103326880B (en) | Genesys calling system high availability cloud computing monitoring system and method | |
CN117608754A (en) | Processing method and device for multi-resource pool application, electronic equipment and storage medium | |
CN107306190A (en) | A kind of computing resource topological system virtualized based on vmware | |
CN108205531B (en) | Data extraction method and data extraction system | |
Baginyan et al. | Multi-level monitoring system for multifunctional information and computing complex at JINR | |
CN104486447A (en) | Large platform cluster system based on Big-Cluster | |
CN112241872A (en) | Distributed data calculation analysis method, device, equipment and storage medium | |
CN104462581A (en) | Micro-channel memory mapping and Smart-Slice based ultrafast file fingerprint extraction system and method | |
Peng et al. | A resource elastic scheduling algorithm of service platform for cloud robotics | |
CN107844571A (en) | The realization device that a kind of intelligent data center is built |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |