CN111796838A - MPP database automatic deployment method and device - Google Patents

MPP database automatic deployment method and device Download PDF

Info

Publication number
CN111796838A
CN111796838A CN202010623526.0A CN202010623526A CN111796838A CN 111796838 A CN111796838 A CN 111796838A CN 202010623526 A CN202010623526 A CN 202010623526A CN 111796838 A CN111796838 A CN 111796838A
Authority
CN
China
Prior art keywords
mpp database
target
image file
mpp
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010623526.0A
Other languages
Chinese (zh)
Other versions
CN111796838B (en
Inventor
潘添
雷经纬
熊辉
于子烨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202010623526.0A priority Critical patent/CN111796838B/en
Publication of CN111796838A publication Critical patent/CN111796838A/en
Application granted granted Critical
Publication of CN111796838B publication Critical patent/CN111796838B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment
    • G06F8/61Installation
    • G06F8/63Image based installation; Cloning; Build to order
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/214Database migration support
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the application provides an automatic MPP database deployment method and device, and the method comprises the following steps: receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request; automatically deploying a target MPP database in a corresponding container in a distributed resource management system by applying a prestored MPP database mirror image file to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, wherein each MPP database node is provided with a block storage client and a service unit for providing storage service; and storing data generated by the target MPP database in the running process on a corresponding disk. The method and the device can realize automatic deployment of the MPP database in the distributed resource management framework, and can effectively improve efficiency and effectiveness of deployment of the MPP database to the distributed resource management framework.

Description

MPP database automatic deployment method and device
Technical Field
The application relates to the technical field of data processing, in particular to an MPP database automatic deployment method and device.
Background
In the big data era, a great deal of data is generated every moment in various industries, and the data becomes a production data and promotes the development of social productivity. In the data storage process, the MPP database is used as a large-scale parallel processing database supporting PB-level data real-time analysis, and has the advantages of complete scalability, high availability, high performance, excellent cost performance, resource sharing and the like. The MPP database provides good guarantee for storage and analysis of a large amount of data.
The traditional MPP database deployment mode is that a database is installed through manual operation of plug-ins or scripts, and the defects that the operation, configuration and management of the database and all life cycles are bound with a current operating system, and all installation and deployment need manual operation and verification, so that the transportability of the database is poor and the installation is very complicated. Specifically, the current way of deploying the MPP database on the cluster has the following problems: firstly, the deployment speed is low, and corresponding configuration and operation are required to be carried out in each deployment; and secondly, the coupling between the deployed solution and the bottom layer of the machine is strong, so that the migration between different environments is not facilitated. Even if a distributed resource management framework such as the Mesos is applied, the MPP database cannot be directly deployed, because the database belongs to a stateful application with a specific data storage function and does not need to store data like a stateless application, and therefore cannot be deployed on the existing distributed resource management system such as the Mesos framework.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides an MPP database automatic deployment method and device, which can realize the automatic deployment of an MPP database in a distributed resource management framework and can effectively improve the efficiency and effectiveness of the MPP database deployment in the distributed resource management framework.
In order to solve the technical problem, the application provides the following technical scheme:
in a first aspect, the present application provides an MPP database automatic deployment method, including:
receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request;
automatically deploying the target MPP database in a corresponding container in a distributed resource management system by applying a prestored MPP database mirror image file to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, wherein each MPP database node is pre-provided with a block storage client and a service unit for providing storage service;
and storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
Further, still include:
receiving an MPP database migration and deployment request aiming at the target MPP database, and acquiring an original container cluster and a target container cluster of the target MPP database, which correspond to the same distributed resource management system, based on the MPP database migration and deployment request;
in the original container cluster, storing a container corresponding to the target MPP database as a target migration image file, and storing the target migration image file into the private image warehouse;
in a target container cluster, pulling the target migration image file stored in the private image repository;
and automatically deploying the target MPP database in the target container cluster by applying the target migration image file.
Further, before the receiving the MPP database initialization deployment request, the method further includes:
creating and storing an MPP database mirror image file;
establishing the private mirror image warehouse;
and respectively installing the block storage client and the service unit on each slave node in the distributed resource management system.
Further, the creating and storing an MPP database image file includes:
establishing a basic image file of an operating system corresponding to the container, and receiving user information of the container and various instructions for installing an MPP database;
creating a container for deploying the MPP database based on the basic image file and each instruction for installing the MPP database, and acquiring an image file of the container for deploying the MPP database;
adding a label containing user information of a container in the mirror image file of the container for deploying the MPP database, and storing the mirror image file added with the label into a mirror image library.
Further, the establishing the private mirror repository includes:
acquiring a preset official registry mirror image file, and modifying and configuring a configuration file corresponding to the official registry mirror image file to obtain a configuration file of a private mirror image warehouse;
receiving a starting module for adding a private mirror repository;
and calling the official registry mirror image file, and establishing a corresponding private mirror image warehouse based on the configuration file of the private mirror image warehouse and the starting module.
In a second aspect, the present application provides an MPP database automatic deployment apparatus, including:
the system comprises a first request receiving module, a first data storage module and a second request receiving module, wherein the first request receiving module is used for receiving an MPP database initialization deployment request and acquiring a target MPP database which has a data storage function and corresponds to the MPP database initialization deployment request;
the system comprises a first automatic deployment module, a second automatic deployment module and a third automatic deployment module, wherein the first automatic deployment module is used for automatically deploying a target MPP database in a corresponding container in a distributed resource management system by applying a pre-stored MPP database mirror image file so as to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, and each MPP database node is pre-provided with a block storage client and a service unit for providing storage service;
the first data storage module is used for storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
Further, still include:
a second request receiving module, configured to receive an MPP database migration and deployment request for the target MPP database, and obtain, based on the MPP database migration and deployment request, an original container cluster and a target container cluster of the target MPP database, which correspond to the same distributed resource management system;
the second data storage module is used for storing a container corresponding to the target MPP database as a target migration image file in the original container cluster and storing the target migration image file into the private image warehouse;
a file pull module, configured to pull the target migration image file stored in the private image repository in a target container cluster;
and the second automatic deployment module is used for applying the target migration image file and automatically deploying the target MPP database in the target container cluster.
Further, still include:
the mirror image creating module is used for creating and storing an MPP database mirror image file;
the warehouse establishing module is used for establishing the private mirror image warehouse;
and the node installation module is used for respectively installing the block storage client and the service unit on each slave node in the distributed resource management system.
Further, the image creation module is configured to perform the following:
establishing a basic image file of an operating system corresponding to the container, and receiving user information of the container and various instructions for installing an MPP database;
creating a container for deploying the MPP database based on the basic image file and each instruction for installing the MPP database, and acquiring an image file of the container for deploying the MPP database;
adding a label containing user information of a container in the mirror image file of the container for deploying the MPP database, and storing the mirror image file added with the label into a mirror image library.
Further, the repository establishment module is configured to perform the following:
acquiring a preset official registry mirror image file, and modifying and configuring a configuration file corresponding to the official registry mirror image file to obtain a configuration file of a private mirror image warehouse;
receiving a starting module for adding a private mirror repository;
and calling the official registry mirror image file, and establishing a corresponding private mirror image warehouse based on the configuration file of the private mirror image warehouse and the starting module.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the MPP database automatic deployment method when executing the program.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the MPP database automatic deployment method.
According to the technical scheme, the MPP database automatic deployment method and the device provided by the application comprise the following steps: receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request; automatically deploying the target MPP database in a corresponding container in a distributed resource management system by applying a prestored MPP database mirror image file to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, wherein each MPP database node is pre-provided with a block storage client and a service unit for providing storage service; storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, storing the image file in a preset private image warehouse, pre-installing a block storage client and a service unit for providing storage service on each MPP database node, solving the problem that a distributed resource management framework such as meso and the like cannot deploy stateful service, realizing automatic deployment of the MPP database in a distributed resource management framework, effectively improving the efficiency and effectiveness of deploying the MPP database in the distributed resource management framework, and more quickly and conveniently realizing initial installation and migration of the MPP database in different environments, and then can effectively improve usability, pluralism and the portability that the MPP database was deployed to can effectively promote MPP database data storage's security and high efficiency, and effectively improve the personnel's of deploying the MPP database user experience, effectively practice thrift human cost and time cost.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of an MPP database automatic deployment method in an embodiment of the present application.
Fig. 2 is a schematic flowchart of steps 400 to 700 in an MPP database automatic deployment method in an embodiment of the present application.
Fig. 3 is a schematic flow chart of steps 010 to 030 in the MPP database automatic deployment method in the embodiment of the present application.
Fig. 4 is a schematic flowchart of a specific step 010 in an MPP database automatic deployment method in the embodiment of the present application.
Fig. 5 is a schematic flowchart of step 020 in the MPP database automatic deployment method in the embodiment of the present application.
Fig. 6 is a schematic specific flowchart of an MPP database automatic deployment method provided by an application example of the present application.
Fig. 7 is a schematic specific flowchart of S1 in the MPP database automatic deployment method provided by the application example of the present application.
Fig. 8 is a schematic specific flowchart of S2 in the MPP database automatic deployment method provided by the application example of the present application.
Fig. 9 is a schematic specific flowchart of S3 in the MPP database automatic deployment method provided by the application example of the present application.
Fig. 10 is a schematic specific flowchart of S4 in the MPP database automatic deployment method provided by the application example of the present application.
Fig. 11 is a schematic structural diagram of a first MPP database automatic deployment apparatus in an embodiment of the present application.
Fig. 12 is a schematic structural diagram of a second MPP database automatic deployment apparatus in an embodiment of the present application.
Fig. 13 is a schematic structural diagram of a third example of an MPP database automatic deployment apparatus in an embodiment of the present application.
Fig. 14 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In consideration of the problem that the MPP cannot be deployed on the existing distributed resource management system such as a mess framework, the application provides an MPP database automatic deployment method, an MPP database automatic deployment device, an electronic device and a computer readable storage medium, and the MPP database automatic deployment method, the MPP database automatic deployment device, the electronic device and the computer readable storage medium receive an MPP database initialization deployment request and acquire a target MPP database which has a data storage function and corresponds to the MPP database initialization deployment request; the method comprises the steps of automatically deploying a target MPP database in a corresponding container in a distributed resource management system by applying pre-stored MPP database mirror image files to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, wherein each MPP database node is pre-provided with a block storage client and a service unit for providing storage service, storing data generated in the operation process of the target MPP database on a corresponding disk, packing the data generated in the operation process of the target MPP database and a system where the target MPP database is located to generate a corresponding mirror image file when the target MPP database needs to be migrated, storing the mirror image file in a preset private mirror image warehouse, and pre-installing a block storage client and a service unit for providing storage service on each MPP database node, the problem that a distributed resource management framework such as the Mesos cannot deploy stateful services is solved, automatic deployment of the MPP database in the distributed resource management framework can be achieved, efficiency and effectiveness of deployment of the MPP database to the distributed resource management framework can be effectively improved, initial installation deployment and migration deployment of the MPP database in different environments can be achieved more quickly and conveniently, usability, diversification and portability of deployment of the MPP database can be effectively improved, safety and efficiency of data storage of the MPP database can be effectively improved, user experience of staff deploying the MPP database is effectively improved, and labor cost and time cost are effectively saved.
Specifically, the following examples are given to illustrate the respective embodiments.
In order to solve the problem that the MPP cannot be deployed on the existing distributed resource management system such as a mess framework, the present application provides an embodiment of an MPP database automatic deployment method, and referring to fig. 1, the MPP database automatic deployment method specifically includes the following contents:
step 100: and receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request.
It is understood that the MPP database refers to a massively parallel processing MPP (massively parallelprocessing) database.
Step 200: in a corresponding container in the distributed resource management system, a plurality of MPP database nodes which are independent from each other are formed in a corresponding container cluster, wherein each MPP database node is provided with a block storage client and a service unit for providing storage service in advance.
In one or more embodiments of the present application, the distributed resource management system may be mess, which is a complete distributed resource management framework, and projects may easily implement automated scheduling of distributed applications. Meanwhile, the Mesos also well combines the Docker and other related container technologies, provides a series of complete functions such as deployment operation, resource scheduling, service discovery, dynamic expansion and the like for containerized application, and improves the convenience of large-scale container cluster management. The messes do only one thing from beginning to end, namely the allocation of distributed cluster resources. The scheduling and the execution of the tasks are completed by each computing Framework (Framework) per se, so that the expansibility and the stability of the Mesos can be easily realized.
It is understood that the container is an open source application container engine Docker, so that developers can package their applications and dependencies into a portable image and then distribute the image to any popular Linux or Windows machine, and virtualization can also be achieved. The containers are fully sandboxed without any interface between each other.
In step 200, the MPP database node refers to a slave node selected to deploy the MPP database in the distributed resource management system. And if the distributed resource management system is the facilities, the facilities slave node is the facilities-agent. Correspondingly, the block storage client may be a ceph block storage client, and the block storage is called RADOS block device (RADOS block device), which is an ordered byte sequence block, so as to provide a block storage disk with high reliability, distribution and performance; the service unit for providing the storage service is a rexray service to provide continuous storage service for the container operation environment.
Step 300: and storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
In step 300, the private mirror repository may also be referred to as a private docker repository.
As can be seen from the above description, the MPP database automatic deployment method provided in the embodiment of the present application solves the problem that a distributed resource management framework such as messes cannot deploy stateful services by pre-installing a block storage client and a service unit for providing storage services on each MPP database node, can implement automatic deployment of an MPP database in the distributed resource management framework, can effectively improve efficiency and effectiveness of the MPP database deployment in the distributed resource management framework, can more quickly and conveniently implement initial installation deployment and migration deployment of the MPP database in different environments, can further effectively improve ease of deployment, diversification and portability of the MPP database, can effectively improve security and efficiency of data storage of the MPP database, and effectively improve user experience of a person deploying the MPP database, manpower cost and time cost are effectively saved.
In order to provide a database migration process on the basis of initial installation of a database, in an embodiment of the MPP database automatic deployment method provided by the present application, referring to fig. 2, the MPP database automatic deployment method specifically further includes the following steps:
step 400: and receiving an MPP database migration and deployment request aiming at the target MPP database, and acquiring an original container cluster and a target container cluster of the target MPP database, which correspond to the same distributed resource management system, based on the MPP database migration and deployment request.
Step 500: and in the original container cluster, storing a container corresponding to the target MPP database as a target migration image file, and storing the target migration image file into the private image warehouse.
Step 600: in a target container cluster, pulling the target migration image file stored in the private image repository.
Step 700: and automatically deploying the target MPP database in the target container cluster by applying the target migration image file.
As can be seen from the above description, the MPP database automatic deployment method provided in the embodiment of the present application can further implement the migration and deployment process of MMP in the distributed resource management framework on the basis of effectively implementing the initialization, installation, and deployment process of MMP in the container cluster corresponding to the distributed resource management framework, and further can effectively improve the applicability and reliability of the MPP database deployment to the distributed resource management framework.
In order to provide an environment configuration process executed before the MPP database is automatically deployed, in an embodiment of the MPP database automatic deployment method provided in the present application, referring to fig. 3, before step 100 or step 400 of the MPP database automatic deployment method, the following is further specifically included:
step 010: and creating and storing the MPP database mirror image file.
Step 020: and establishing the private mirror image warehouse.
Step 030: and respectively installing the block storage client and the service unit on each slave node in the distributed resource management system.
It should be understood that the sequential execution of steps 010 to 030 in fig. 3 is only an example, and in practical applications, the execution sequence between steps 010 to 030 is not limited, and may be executed in parallel, or any one of steps 010 to 030 may be executed first.
As can be seen from the above description, according to the MPP database automatic deployment method provided in the embodiment of the present application, by presetting the MPP database image file, the private image warehouse, the block storage client, and the service unit, validity and reliability of the MPP database deployment to the distributed resource management framework can be effectively ensured, and efficiency of the MPP database deployment to the distributed resource management framework can be effectively improved.
In order to provide a preferred way to establish an MPP database image file, in an embodiment of the MPP database automatic deployment method provided in the present application, referring to fig. 4, step 010 of the MPP database automatic deployment method further includes the following steps:
step 011: and establishing a basic image file of an operating system corresponding to the container, and receiving user information of the container and various instructions for installing the MPP database.
Step 012: and creating a container for deploying the MPP database based on the basic image file and each instruction for installing the MPP database, and acquiring the image file of the container for deploying the MPP database.
Step 013: adding a label containing user information of a container in the mirror image file of the container for deploying the MPP database, and storing the mirror image file added with the label into a mirror image library.
From the above description, the MPP database automatic deployment method provided in the embodiment of the present application can effectively improve reliability and efficiency of establishing the MPP database image file, and further can further improve effectiveness and efficiency of deploying the MPP database to the distributed resource management framework.
In order to provide a preferred way to establish a private mirror repository, in an embodiment of the MPP database automatic deployment method provided in the present application, referring to fig. 5, step 020 of the MPP database automatic deployment method further includes the following specific steps:
step 021: the method comprises the steps of obtaining a preset official registry mirror image file, and modifying and configuring a configuration file corresponding to the official registry mirror image file to obtain a configuration file of a private mirror image warehouse.
Step 022: a boot module for adding a private image repository is received.
Step 023: and calling the official registry mirror image file, and establishing a corresponding private mirror image warehouse based on the configuration file of the private mirror image warehouse and the starting module.
As can be seen from the above description, the MPP database automatic deployment method provided in the embodiment of the present application can effectively improve reliability and efficiency of establishing the private mirror image warehouse, and further can further improve effectiveness and efficiency of deploying the MPP database to the distributed resource management framework.
In order to further explain the scheme, the application also provides a specific application example of the MPP database automatic deployment method, and the application example relates to the field of database management system containerized deployment. The method specifically relates to the related technologies of Docker mirror image manufacturing and construction, Docker container management, meso container management and the like, and more specifically relates to an MPP database automatic deployment method based on meso. The application example of the application provides a simple and easy-to-operate MPP database automatic deployment method based on Mesos through data persistence transformation.
Referring to fig. 6, the MPP database automatic deployment method specifically includes the following steps:
s1: firstly, making and constructing a mirror image file required by an automatic deployment MPP database: by means of the Docker technology, mirror files required for automatically deploying the MPP database are manufactured and constructed by compiling Dockerfile.
S2: and (3) utilizing an application deployment framework Marathon of the Mesos to create a private docker warehouse in an API mode.
S3: and (3) installing a ceph client and a rexray service by using an application deployment framework Marathon of the messs, and designing and realizing MPP database clustering and data persistence so as to ensure normal deployment of the database. In containerization deployment, each container is isolated from each other, each container has a file system, processes among the containers cannot be influenced mutually, and the independent file systems enable data persistence to be more perfect and ensure data safety.
S4: the MPP database is automatically deployed by using instructions in a meso environment, a cluster mode is achieved by finding that one master and a plurality of slave containers are started on a plurality of nodes through checking, and a data directory of the MPP database is formed on a specified data disk, so that the data persistence effect is achieved.
Specifically, referring to fig. 7, the step S1 includes the following steps:
s1.1: the base image is made based on the SUSE12sp3 operating system.
S1.2: and establishing user information of the mirror image, and appointing a maintainer to facilitate subsequent maintenance.
S1.3: and compiling various instructions for installing the MPP database in the dockerfile.
S1.4: the MPP database image is created on the previous base image using the build dockerfile command.
S1.5: and adding tag (user name/MPPD DB) to the image, and uploading the image to an image library.
Referring to fig. 8, the step S2 specifically includes the following steps:
s2.1: yml, adding delete true configuration items in storage configuration, allowing the mirror image to be deleted, and configuring other mirror images according to a default mode; only a warehouse for placing mirror images is built, and the corresponding specific information is not needed.
S2.2: writing a module for adding a private docker warehouse, namely writing a private docker starting step in a default mode.
S2.3: and calling the registry mirror image in a curl mode to establish a private docker warehouse.
Referring to fig. 9, the step S3 includes the following steps:
s3.1: the ceph block storage client is installed on all the meso slave nodes mess-agent to provide a block storage disk with high reliability, distribution and performance.
S3.2: and installing a rexray service on all the meso slave nodes meso-agent to provide continuous storage service for the container operation environment.
S3.3: the json file is configured with parameter parameters configured as parameter settings as shown in table 1.
TABLE 1
Figure BDA0002561463680000111
Referring to fig. 10, the migration step in step S4 includes the following steps:
s4.1: executing a command on a cluster needing to be migrated, saving a current container as a specific image file and uploading the image file to a docker warehouse;
s4.2: and executing a mirror image pulling command in the new cluster, automatically deploying the MPP database, wherein the deployed MPP database is completely the same as the previous cluster, and completing the migration.
From the above description, it can be seen that the MPP database automatic deployment method provided by the application example of the present application implements automatic deployment of a stateful MPP database in a manner of deploying containers on a mess through a Marathon framework, in the containerized deployment, each container is isolated from another container, each container has its own file system, processes between the containers do not affect each other, and the containers can distinguish computing resources, that is, each MPP database node deployed and other containers are independent from each other, operations between each node of the MPP database are also not affected from each other, and the independent file systems make persistent work of data more perfect and ensure data security. Compared with the traditional MPP database deployment method, the MPP database is deployed in a container through a Marathon framework, and can be deployed and migrated under different environments more quickly and conveniently. Through the ceph client, the reray service solves the problem that the messos cannot deploy stateful services. Through setting in the mess, when a certain node of the MPP database is hung, another new container can be restarted, so that the whole MPP database service is normally carried out. The usability, the diversification and the portability of the MPP database deployment are improved in general, and the safety and the efficiency of data storage of the MPP database are improved.
In terms of software, in order to solve the problem that the MPP cannot be deployed on the existing distributed resource management system such as the mess framework, the present application provides an embodiment of an MPP database automatic deployment apparatus for implementing all or part of the contents in the MPP database automatic deployment method, and referring to fig. 11, the MPP database automatic deployment apparatus specifically includes the following contents:
the first request receiving module 10 is configured to receive an MPP database initialization deployment request, and acquire a target MPP database having a data storage function and corresponding to the MPP database initialization deployment request.
The first automatic deployment module 20 is configured to apply a pre-stored MPP database image file, and automatically deploy the target MPP database in a corresponding container in the distributed resource management system, so as to form a plurality of MPP database nodes that are independent from each other in a corresponding container cluster, where each MPP database node is pre-installed with a block storage client and a service unit for providing storage service.
The first data storage module 30 is configured to store data generated in the running process of the target MPP database on a corresponding disk, and when the target MPP database needs to be migrated, package the data generated in the running process of the target MPP database and a system where the data is located to generate a corresponding image file, and store the image file in a preset private image repository.
As can be seen from the above description, the MPP database automatic deployment apparatus provided in the embodiment of the present application solves the problem that a distributed resource management framework such as messes cannot deploy stateful services by pre-installing a block storage client and a service unit for providing storage services on each of the MPP database nodes, can implement automatic deployment of an MPP database in the distributed resource management framework, can effectively improve efficiency and effectiveness of the MPP database deployment in the distributed resource management framework, can more quickly and conveniently implement initial installation deployment and migration deployment of the MPP database in different environments, can further effectively improve ease of deployment, diversification and portability of the MPP database, can effectively improve security and efficiency of data storage of the MPP database, and effectively improve user experience of a person deploying the MPP database, manpower cost and time cost are effectively saved.
In order to provide a database migration process based on the initial installation of the database, in an embodiment of the MPP database automatic deployment apparatus provided in the present application, referring to fig. 12, the MPP database automatic deployment apparatus further includes the following contents:
a second request receiving module 40, configured to receive an MPP database migration and deployment request for the target MPP database, and obtain, based on the MPP database migration and deployment request, an original container cluster and a target container cluster of the target MPP database, which correspond to the same distributed resource management system.
A second data storage module 50, configured to store, in the primary container cluster, a container corresponding to the target MPP database as a target migration image file, and store the target migration image file in the private image repository.
A file pulling module 60, configured to pull the target migration image file stored in the private image repository in a target container cluster.
And a second automatic deployment module 70, configured to apply the target migration image file to automatically deploy the target MPP database in the target container cluster.
As can be seen from the above description, the MPP database automatic deployment apparatus provided in this embodiment of the present application can further implement a migration deployment process of MMP in the distributed resource management framework on the basis of effectively implementing an initialization installation deployment process of MMP in a container cluster corresponding to the distributed resource management framework, and thus can effectively improve the applicability and reliability of the MPP database deployment to the distributed resource management framework.
In order to provide an environment configuration process executed before the MPP database is automatically deployed, in an embodiment of the MPP database automatic deployment apparatus provided in the present application, referring to fig. 13, the MPP database automatic deployment apparatus further specifically includes the following:
and the mirror image creating module 01 is used for creating and storing the MPP database mirror image file.
And the warehouse establishing module 02 is used for establishing the private mirror image warehouse.
A node installation module 03, configured to install the block storage client and the service unit on each slave node in the distributed resource management system, respectively.
As can be seen from the above description, the MPP database automatic deployment apparatus provided in the embodiment of the present application can effectively ensure validity and reliability of the MPP database deployment to the distributed resource management framework and effectively improve efficiency of the MPP database deployment to the distributed resource management framework by presetting the MPP database image file, the private image warehouse, the block storage client, and the service unit.
In order to provide a preferred way to establish an MPP database image file, in an embodiment of the MPP database automatic deployment apparatus provided in the present application, the image creating module 01 of the MPP database automatic deployment apparatus is specifically configured to execute the following:
step 011: and establishing a basic image file of an operating system corresponding to the container, and receiving user information of the container and various instructions for installing the MPP database.
Step 012: and creating a container for deploying the MPP database based on the basic image file and each instruction for installing the MPP database, and acquiring the image file of the container for deploying the MPP database.
Step 013: adding a label containing user information of a container in the mirror image file of the container for deploying the MPP database, and storing the mirror image file added with the label into a mirror image library.
From the above description, the MPP database automatic deployment device provided in the embodiment of the present application can effectively improve reliability and efficiency of establishing the MPP database image file, and further can further improve effectiveness and efficiency of deploying the MPP database to the distributed resource management framework.
In order to provide a preferred way to establish a private mirror warehouse, in an embodiment of the MPP database automatic deployment apparatus provided in the present application, the warehouse establishing module 02 of the MPP database automatic deployment apparatus is specifically configured to perform the following:
step 021: the method comprises the steps of obtaining a preset official registry mirror image file, and modifying and configuring a configuration file corresponding to the official registry mirror image file to obtain a configuration file of a private mirror image warehouse.
Step 022: a boot module for adding a private image repository is received.
Step 023: and calling the official registry mirror image file, and establishing a corresponding private mirror image warehouse based on the configuration file of the private mirror image warehouse and the starting module.
As can be seen from the above description, the MPP database automatic deployment device provided in the embodiment of the present application can effectively improve reliability and efficiency of establishing the private mirror image warehouse, and further can further improve effectiveness and efficiency of deploying the MPP database to the distributed resource management framework.
In terms of hardware, in order to solve the problem that the MPP cannot be deployed on the existing distributed resource management system such as the mess framework, the present application provides an embodiment of an electronic device for implementing all or part of the contents in the MPP database automatic deployment method, where the electronic device specifically includes the following contents:
fig. 14 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 14, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this FIG. 14 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one embodiment, the MPP database auto-deployment functionality may be integrated into the central processor. Wherein the central processor may be configured to control:
step 100: and receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request.
It is understood that the MPP database refers to a massively parallel processing MPP (massively parallelprocessing) database.
Step 200: in a corresponding container in the distributed resource management system, a plurality of MPP database nodes which are independent from each other are formed in a corresponding container cluster, wherein each MPP database node is provided with a block storage client and a service unit for providing storage service in advance.
In one or more embodiments of the present application, the distributed resource management system may be mess, which is a complete distributed resource management framework, and projects may easily implement automated scheduling of distributed applications. Meanwhile, the Mesos also well combines the Docker and other related container technologies, provides a series of complete functions such as deployment operation, resource scheduling, service discovery, dynamic expansion and the like for containerized application, and improves the convenience of large-scale container cluster management. The messes do only one thing from beginning to end, namely the allocation of distributed cluster resources. The scheduling and the execution of the tasks are completed by each computing Framework (Framework) per se, so that the expansibility and the stability of the Mesos can be easily realized.
It is understood that the container is an open source application container engine Docker, so that developers can package their applications and dependencies into a portable image and then distribute the image to any popular Linux or Windows machine, and virtualization can also be achieved. The containers are fully sandboxed without any interface between each other.
In step 200, the MPP database node refers to a slave node selected to deploy the MPP database in the distributed resource management system. And if the distributed resource management system is the facilities, the facilities slave node is the facilities-agent. Correspondingly, the block storage client may be a ceph block storage client, and the block storage is called RADOS block device (RADOS block device), which is an ordered byte sequence block, so as to provide a block storage disk with high reliability, distribution and performance; the service unit for providing the storage service is a rexray service to provide continuous storage service for the container operation environment.
Step 300: and storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
In step 300, the private mirror repository may also be referred to as a private docker repository.
As can be seen from the above description, in the electronic device provided in the embodiment of the present application, by pre-installing the block storage client and the service unit for providing the storage service on each of the MPP database nodes, the problem that the distributed resource management framework such as the messs cannot be deployed with the stateful service is solved, the automatic deployment of the MPP database in the distributed resource management framework can be implemented, and can effectively improve the efficiency and effectiveness of the MPP database deployment to the distributed resource management framework, can more quickly and conveniently realize the initial installation deployment and the migration deployment of the MPP database in different environments, thereby effectively improving the usability, diversification and portability of the MPP database deployment, effectively improving the safety and high efficiency of the MPP database data storage, user experience of personnel deploying the MPP database is effectively improved, and labor cost and time cost are effectively saved.
In another embodiment, the MPP database automatic deployment device may be configured separately from the central processor 9100, for example, the MPP database automatic deployment device may be configured as a chip connected to the central processor 9100, and the MPP database automatic deployment function is realized by the control of the central processor.
As shown in fig. 14, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 14; further, the electronic device 9600 may further include components not shown in fig. 14, which can be referred to in the related art.
As shown in fig. 14, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.
The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.
The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.
An embodiment of the present application further provides a computer-readable storage medium capable of implementing all the steps in the MPP database automatic deployment method in the foregoing embodiment, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements all the steps of the MPP database automatic deployment method in the foregoing embodiment, where the execution subject of the computer program is a server or a client, for example, when the processor executes the computer program, the processor implements the following steps:
step 100: and receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request.
It is understood that the MPP database refers to a massively parallel processing MPP (massively parallelprocessing) database.
Step 200: in a corresponding container in the distributed resource management system, a plurality of MPP database nodes which are independent from each other are formed in a corresponding container cluster, wherein each MPP database node is provided with a block storage client and a service unit for providing storage service in advance.
In one or more embodiments of the present application, the distributed resource management system may be mess, which is a complete distributed resource management framework, and projects may easily implement automated scheduling of distributed applications. Meanwhile, the Mesos also well combines the Docker and other related container technologies, provides a series of complete functions such as deployment operation, resource scheduling, service discovery, dynamic expansion and the like for containerized application, and improves the convenience of large-scale container cluster management. The messes do only one thing from beginning to end, namely the allocation of distributed cluster resources. The scheduling and the execution of the tasks are completed by each computing Framework (Framework) per se, so that the expansibility and the stability of the Mesos can be easily realized.
It is understood that the container is an open source application container engine Docker, so that developers can package their applications and dependencies into a portable image and then distribute the image to any popular Linux or Windows machine, and virtualization can also be achieved. The containers are fully sandboxed without any interface between each other.
In step 200, the MPP database node refers to a slave node selected to deploy the MPP database in the distributed resource management system. And if the distributed resource management system is the facilities, the facilities slave node is the facilities-agent. Correspondingly, the block storage client may be a ceph block storage client, and the block storage is called RADOS block device (RADOS block device), which is an ordered byte sequence block, so as to provide a block storage disk with high reliability, distribution and performance; the service unit for providing the storage service is a rexray service to provide continuous storage service for the container operation environment.
Step 300: and storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
In step 300, the private mirror repository may also be referred to as a private docker repository.
As can be seen from the above description, the computer-readable storage medium provided in the embodiment of the present application solves the problem that a distributed resource management framework such as messes cannot deploy stateful services by pre-installing a block storage client and a service unit for providing storage services on each MPP database node, can implement automatic deployment of an MPP database in the distributed resource management framework, and can effectively improve efficiency and effectiveness of the MPP database deployment in the distributed resource management framework, and can more quickly and conveniently implement initial installation deployment and migration deployment of the MPP database in different environments, thereby effectively improving ease of deployment, diversification and portability of the MPP database, and effectively improving security and efficiency of data storage of the MPP database, and effectively improving user experience of a person deploying the MPP database, manpower cost and time cost are effectively saved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (12)

1. An MPP database automatic deployment method is characterized by comprising the following steps:
receiving an MPP database initialization deployment request, and acquiring a target MPP database with a data storage function corresponding to the MPP database initialization deployment request;
automatically deploying the target MPP database in a corresponding container in a distributed resource management system by applying a prestored MPP database mirror image file to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, wherein each MPP database node is pre-provided with a block storage client and a service unit for providing storage service;
and storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
2. The MPP database automatic deployment method of claim 1, further comprising:
receiving an MPP database migration and deployment request aiming at the target MPP database, and acquiring an original container cluster and a target container cluster of the target MPP database, which correspond to the same distributed resource management system, based on the MPP database migration and deployment request;
in the original container cluster, storing a container corresponding to the target MPP database as a target migration image file, and storing the target migration image file into the private image warehouse;
in a target container cluster, pulling the target migration image file stored in the private image repository;
and automatically deploying the target MPP database in the target container cluster by applying the target migration image file.
3. The MPP database automatic deployment method of claim 1, prior to the receiving an MPP database initialization deployment request, further comprising:
creating and storing an MPP database mirror image file;
establishing the private mirror image warehouse;
and respectively installing the block storage client and the service unit on each slave node in the distributed resource management system.
4. The MPP database automatic deployment method of claim 3, wherein the creating and storing an MPP database image file comprises:
establishing a basic image file of an operating system corresponding to the container, and receiving user information of the container and various instructions for installing an MPP database;
creating a container for deploying the MPP database based on the basic image file and each instruction for installing the MPP database, and acquiring an image file of the container for deploying the MPP database;
adding a label containing user information of a container in the mirror image file of the container for deploying the MPP database, and storing the mirror image file added with the label into a mirror image library.
5. The MPP database automatic deployment method of claim 3, wherein the establishing the private mirror repository comprises:
acquiring a preset official registry mirror image file, and modifying and configuring a configuration file corresponding to the official registry mirror image file to obtain a configuration file of a private mirror image warehouse;
receiving a starting module for adding a private mirror repository;
and calling the official registry mirror image file, and establishing a corresponding private mirror image warehouse based on the configuration file of the private mirror image warehouse and the starting module.
6. An automatic MPP database deployment device, comprising:
the system comprises a first request receiving module, a first data storage module and a second request receiving module, wherein the first request receiving module is used for receiving an MPP database initialization deployment request and acquiring a target MPP database which has a data storage function and corresponds to the MPP database initialization deployment request;
the system comprises a first automatic deployment module, a second automatic deployment module and a third automatic deployment module, wherein the first automatic deployment module is used for automatically deploying a target MPP database in a corresponding container in a distributed resource management system by applying a pre-stored MPP database mirror image file so as to form a plurality of MPP database nodes which are independent from each other in a corresponding container cluster, and each MPP database node is pre-provided with a block storage client and a service unit for providing storage service;
the first data storage module is used for storing data generated in the running process of the target MPP database on a corresponding disk, packaging the data generated in the running process of the target MPP database and a system where the data are located to generate a corresponding image file when the target MPP database needs to be migrated, and storing the image file into a preset private image warehouse.
7. The MPP database automatic deployment device of claim 6, further comprising:
a second request receiving module, configured to receive an MPP database migration and deployment request for the target MPP database, and obtain, based on the MPP database migration and deployment request, an original container cluster and a target container cluster of the target MPP database, which correspond to the same distributed resource management system;
the second data storage module is used for storing a container corresponding to the target MPP database as a target migration image file in the original container cluster and storing the target migration image file into the private image warehouse;
a file pull module, configured to pull the target migration image file stored in the private image repository in a target container cluster;
and the second automatic deployment module is used for applying the target migration image file and automatically deploying the target MPP database in the target container cluster.
8. The MPP database automatic deployment device of claim 6, further comprising:
the mirror image creating module is used for creating and storing an MPP database mirror image file;
the warehouse establishing module is used for establishing the private mirror image warehouse;
and the node installation module is used for respectively installing the block storage client and the service unit on each slave node in the distributed resource management system.
9. The MPP database auto-deployment device of claim 8, wherein the mirror creation module is configured to perform the following:
establishing a basic image file of an operating system corresponding to the container, and receiving user information of the container and various instructions for installing an MPP database;
creating a container for deploying the MPP database based on the basic image file and each instruction for installing the MPP database, and acquiring an image file of the container for deploying the MPP database;
adding a label containing user information of a container in the mirror image file of the container for deploying the MPP database, and storing the mirror image file added with the label into a mirror image library.
10. The MPP database automatic deployment device of claim 8, wherein the warehouse establishment module is configured to perform the following:
acquiring a preset official registry mirror image file, and modifying and configuring a configuration file corresponding to the official registry mirror image file to obtain a configuration file of a private mirror image warehouse;
receiving a starting module for adding a private mirror repository;
and calling the official registry mirror image file, and establishing a corresponding private mirror image warehouse based on the configuration file of the private mirror image warehouse and the starting module.
11. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the MPP database auto-deployment method of any of claims 1 to 5 when executing the program.
12. A computer-readable storage medium, on which a computer program is stored, the computer program, when being executed by a processor, implementing the MPP database automatic deployment method according to any one of claims 1 to 5.
CN202010623526.0A 2020-06-30 2020-06-30 Automatic deployment method and device for MPP database Active CN111796838B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010623526.0A CN111796838B (en) 2020-06-30 2020-06-30 Automatic deployment method and device for MPP database

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010623526.0A CN111796838B (en) 2020-06-30 2020-06-30 Automatic deployment method and device for MPP database

Publications (2)

Publication Number Publication Date
CN111796838A true CN111796838A (en) 2020-10-20
CN111796838B CN111796838B (en) 2023-08-11

Family

ID=72809958

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010623526.0A Active CN111796838B (en) 2020-06-30 2020-06-30 Automatic deployment method and device for MPP database

Country Status (1)

Country Link
CN (1) CN111796838B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113641456A (en) * 2021-08-18 2021-11-12 中国联合网络通信集团有限公司 Data cluster deployment method, device and system
CN114064148A (en) * 2021-11-17 2022-02-18 北京百度网讯科技有限公司 Data processing method and device, electronic equipment and storage medium
CN114490588A (en) * 2022-02-11 2022-05-13 京东科技信息技术有限公司 Database deployment method and device, electronic equipment and computer readable medium
WO2023116420A1 (en) * 2021-12-22 2023-06-29 中兴通讯股份有限公司 Database deployment methods, database processing methods, related devices and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105912596A (en) * 2016-04-05 2016-08-31 中国银联股份有限公司 Method and device for operation of databases
CN109033334A (en) * 2018-07-20 2018-12-18 郑州云海信息技术有限公司 A kind of method, apparatus and computer storage medium creating database
CN109976771A (en) * 2019-03-28 2019-07-05 新华三技术有限公司 A kind of dispositions method and device of application
US20190394302A1 (en) * 2017-01-31 2019-12-26 Telefonaktiebolaget Lm Ericsson (Publ) Security for a Software Container

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105912596A (en) * 2016-04-05 2016-08-31 中国银联股份有限公司 Method and device for operation of databases
US20190394302A1 (en) * 2017-01-31 2019-12-26 Telefonaktiebolaget Lm Ericsson (Publ) Security for a Software Container
CN109033334A (en) * 2018-07-20 2018-12-18 郑州云海信息技术有限公司 A kind of method, apparatus and computer storage medium creating database
CN109976771A (en) * 2019-03-28 2019-07-05 新华三技术有限公司 A kind of dispositions method and device of application

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
开心自由天使: ""Mesos+Marathon上数据库实现无状态化实战"", Retrieved from the Internet <URL:https://blog.csdn.net/happyfreeangel/article/details/86593569?ops_request_misc=&request_id=&biz_id=102&utm_term=mesos%20rexray&utm_medium=distribute.pc_search_result.none-task-blog-2~all~sobaiduweb~default-1-86593569.142^v88^insert_down1, 239^v2^insert_chatgpt&spm=1018.2226.3001.4187> *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113641456A (en) * 2021-08-18 2021-11-12 中国联合网络通信集团有限公司 Data cluster deployment method, device and system
CN113641456B (en) * 2021-08-18 2023-06-13 中国联合网络通信集团有限公司 Deployment method, device and system of data cluster
CN114064148A (en) * 2021-11-17 2022-02-18 北京百度网讯科技有限公司 Data processing method and device, electronic equipment and storage medium
CN114064148B (en) * 2021-11-17 2023-09-01 北京百度网讯科技有限公司 Data processing method, device, electronic equipment and storage medium
WO2023116420A1 (en) * 2021-12-22 2023-06-29 中兴通讯股份有限公司 Database deployment methods, database processing methods, related devices and storage medium
CN114490588A (en) * 2022-02-11 2022-05-13 京东科技信息技术有限公司 Database deployment method and device, electronic equipment and computer readable medium

Also Published As

Publication number Publication date
CN111796838B (en) 2023-08-11

Similar Documents

Publication Publication Date Title
CN108809722B (en) Method, device and storage medium for deploying Kubernetes cluster
CN112019475B (en) Resource access method, device, system and storage medium under server-free architecture
CN111796838A (en) MPP database automatic deployment method and device
WO2017031954A1 (en) Data communication method, user equipment, and server
CN112214330A (en) Method and device for deploying master nodes in cluster and computer-readable storage medium
CN111459539B (en) Continuous integration pipeline operation method and device based on mirror layering
CN111813601B (en) Micro-service rollback method and device for stateful distributed cluster
CN111352653B (en) System development method based on PaaS cloud platform server and server
CN111966384B (en) System updating method, device, equipment and computer readable storage medium
US10324701B1 (en) Rapid deployment of computing instances
CN112783646A (en) Stateful application containerization deployment method and device
WO2024077885A1 (en) Management method, apparatus and device for container cluster, and non-volatile readable storage medium
CN112631728A (en) Method, device, equipment and storage medium for managing chain code container of alliance chain
CN112835524A (en) Storage resource allocation method, storage resource controller and scheduling system
CN112905337A (en) Software and hardware hybrid deployment MySQL cluster scheduling method and device
CN112114939A (en) Distributed system deployment equipment and method
CN111679790A (en) Remote software development storage space distribution method and device
CN117112122A (en) Cluster deployment method and device
CN116028163A (en) Method, device and storage medium for scheduling dynamic link library of container group
US20090300609A1 (en) Combining system blueprints, functional layer, and software bits in parallel development of machines
US20090300610A1 (en) Self-replicating machines
CN113419813A (en) Method and device for deploying bare engine management service based on container platform
CN111367561A (en) Software program remote development method and device
CN107301089B (en) APP deployment and calling method and terminal
CN113268272B (en) Application delivery method, device and system based on private cloud

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant