CN110389766A - HBase container cluster dispositions method, system, equipment and computer readable storage medium - Google Patents
HBase container cluster dispositions method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110389766A CN110389766A CN201910543672.XA CN201910543672A CN110389766A CN 110389766 A CN110389766 A CN 110389766A CN 201910543672 A CN201910543672 A CN 201910543672A CN 110389766 A CN110389766 A CN 110389766A
- Authority
- CN
- China
- Prior art keywords
- hbase
- container
- cluster
- mirror image
- configuration information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
- G06F8/63—Image based installation; Cloning; Build to order
Abstract
The embodiment of the invention provides a kind of HBase container cluster dispositions method, system, equipment and storage mediums, the described method includes: management node mirror image and back end mirror image of the creation based on the privately owned container application shop of HBase, and the management node mirror image and back end mirror image are uploaded into mirror image warehouse, the management node mirror image and back end mirror image include identical starting script；The application item is simultaneously uploaded to Rancher platform by creation application item, the application item is for generating the deployment page, and by configuration information needed for deployment page acquisition deployment HBase container cluster, the configuration information includes the mirror image title pulled；The Rancher platform is set to execute the application item and create new HBase container cluster according to the configuration information of acquisition or carry out dilatation to existing HBase container cluster.The embodiment of the present invention can substantially reduce the threshold of the containerization deployment of Hadoop and HBase, reduce and expend the time.
Description
Technical field
The present embodiments relate to HBase containerization technique fields, more specifically to a kind of HBase container cluster
Dispositions method, system, equipment and computer readable storage medium.
Background technique
Rancher is the enterprise-level Container Management platform of an open source, provides the management used in production environment
The full stack container deployment of Docker and Kubernetes and management platform.By Rancher, enterprise oneself need not again be used
A series of open source software goes from the beginning to build container service platform.
The user of Rancher can dispose the application being made of multiple containers by a key in application shop.User can manage
Manage the application of this deployment, and the upgrading that can be automated when this application has new available edition.In addition,
The user of Rancher can also create the privately owned application shop of oneself, thus the exploitation of related application.
HBase is the distributed system of a client/server, can provide quick random access massive structured data (hundred million
Ten thousand row data).In general, before disposing HBase, it is necessary to Hadoop and Zookeeper is first disposed, so that HBase is available
HDFS (Hadoop Distributed File System, Hadoop distributed file system) provide data fault-tolerant ability and
The High Availabitity ability that ZooKeeper is provided.
HBase containerization technique is very mature at present, but it has lower planar defect:
(1) containerization deployment is cumbersome, generally requires creation mirror image, upload mirror image, container layout and container and disposes this several step,
Technical threshold is high, and time-consuming；
(2) container application upgrade trouble, when needing to upgrade, will often remodify mirror image, redeploy, and imitate
Rate is low, and time-consuming.
Summary of the invention
The embodiment of the present invention disposes the problem of cumbersome application upgrade trouble for above-mentioned current HBase containerization, provides one
Kind HBase container cluster dispositions method, system, equipment and storage medium.
The technical solution that the present invention solves above-mentioned technical problem is to provide a kind of HBase container cluster dispositions method, wraps
It includes:
Management node mirror image and back end mirror image based on the privately owned container application shop of HBase are created, and by the pipe
Reason node mirror image and back end mirror image upload to mirror image warehouse, and the management node mirror image and back end mirror image include identical
Starting script, and the starting script is when executed, makes the main management container created based on the management node mirror image
The data storage container of node mirror image creation carries out two-way communication after actuation based on the data；
The application item is simultaneously uploaded to Rancher platform, the application program item by creation application item
Mesh passes through configuration information needed for the deployment page obtains deployment HBase container cluster for generating the deployment page, described
Configuration information includes the mirror image title pulled, and the mirror image title pulled includes the management node mirror image and data section of creation
The corresponding title of point mirror image；
The Rancher platform is set to execute the application item and be created newly according to the configuration information of acquisition
HBase container cluster carries out dilatation to existing HBase container cluster.
Preferably, the configuration information includes operation mode and environmental variance, and the operation mode is creation HBase collection
Group or HBase cluster dilatation；
When the operation mode is creation HBase cluster, the environmental variance includes the end of number of clusters and configuration
Mouthful；
When the operation mode is the dilatation of HBase cluster, the environmental variance includes the port numbers, initial of initial cluster
Number of clusters, the quantity of dilatation.
Preferably, the method includes the main management containers according to the starting script execution following steps:
The information of host where receiving the data storage container sent as the data storage container；
The deployment HBase container cluster obtained by the deployment page is broadcasted to all data storage containers in real time
Required configuration information；
When operation mode in the configuration information is creation HBase cluster, according to the cluster in the configuration information
The port of quantity and configuration starts HDFS program, and starts HBase program after waiting preset time；
Operation mode in the configuration information is the dilatation of HBase cluster, and receives the data storage from dilatation
When the dilatation success message of container, make the HDFS program updating data memory node list and equally loaded.
Preferably, the method includes the data storage containers according to the starting script execution following steps:
The information of host where sending current data storage container to the main management container in real time；
The configuration information of the main management container broadcast is received, and according to the port of the initial cluster in the configuration information
Number modification HDFS program and HBase program；
When operation mode in the configuration information is the dilatation of HBase cluster, node image starting based on the data
Data storage container, and dilatation success message is sent to the main management container after the data storage container starts successfully.
The embodiment of the present invention also provides a kind of HBase container cluster deployment system, including mirror image creating unit, establishment of item
Unit and deployment execution unit, in which:
The mirror image creating unit, for creating the management node mirror image sum number based on the privately owned container application shop of HBase
Mirror image warehouse, the management node mirror image are uploaded to according to node mirror image, and by the management node mirror image and back end mirror image
It include identical starting script with back end mirror image；
The establishment of item unit, for creating application item and uploading to the application item
Rancher platform, the application item obtain deployment HBase for generating the deployment page, and by the deployment page
Configuration information needed for container cluster, the configuration information include the mirror image title pulled, and the mirror image title packet pulled
Include the management node mirror image and the corresponding title of back end mirror image of creation；
The deployment execution unit, for making the Rancher platform execute the application item and according to obtaining
The configuration information taken creates new HBase container cluster or carries out dilatation to existing HBase container cluster, and is opened by described
Dynamic script makes the main management container created based on the management node mirror image and the based on the data data of node mirror image creation
Storage container carries out two-way communication after actuation.
Preferably, the configuration information includes operation mode and environmental variance, and the operation mode is creation HBase collection
Group or HBase cluster dilatation；
When the operation mode is creation HBase cluster, the environmental variance includes the end of number of clusters and configuration
Mouthful；
When the operation mode is the dilatation of HBase cluster, the environmental variance includes the port numbers, initial of initial cluster
Number of clusters, the quantity of dilatation.
Preferably, the starting script defines the following steps executed by the main management container:
The information of host where receiving the data storage container sent as the data storage container；
The deployment HBase container cluster obtained by the deployment page is broadcasted to all data storage containers in real time
Required configuration information；
When operation mode in the configuration information is creation HBase cluster, according to the cluster in the configuration information
The port of quantity and configuration starts HDFS program, and starts HBase program after waiting preset time；
Operation mode in the configuration information is the dilatation of HBase cluster, and receives the data storage from dilatation
When the dilatation success message of container, make the HDFS program updating data memory node list and equally loaded.
Preferably, the starting script defines the following steps executed by the data storage container:
The information of host where sending current data storage container to the main management container in real time；
The configuration information of the main management container broadcast is received, and according to the port of the initial cluster in the configuration information
Number modification HDFS program and HBase program；
When operation mode in the configuration information is the dilatation of HBase cluster, node image starting based on the data
Data storage container, and dilatation success message is sent to the main management container after the data storage container starts successfully.
The embodiment of the present invention also provides a kind of HBase container cluster deployment facility, including memory and processor, described to deposit
The computer program that can be executed in the processor is stored in reservoir, and real when the processor execution computer program
Now the step of HBase container cluster dispositions method any one of as above.
The embodiment of the present invention also provides a kind of computer readable storage medium, which is characterized in that deposits on the storage medium
Computer program is contained, when the computer program is executed by processor, realizes the as above any one HBase container cluster portion
The step of arranging method.
HBase container cluster dispositions method, system, equipment and the storage medium of the embodiment of the present invention, it is privately owned by HBase
Container application shop greatly reduces the threshold of the containerization deployment of Hadoop and HBase, reduces and expend the time, as long as that is,
Simple parameter configuration is carried out in application shop can dispose the container cluster for possessing Hadoop and HBase the second grade, and
It can achieve second grade dilatation, and do not influence cluster regular traffic when dilatation.
Detailed description of the invention
Fig. 1 is the flow diagram of HBase container cluster dispositions method provided in an embodiment of the present invention；
Fig. 2 is that main management container executes showing for operation in HBase container cluster dispositions method provided in an embodiment of the present invention
It is intended to；
Fig. 3 is that data storage container executes operation in HBase container cluster dispositions method provided in an embodiment of the present invention
Schematic diagram；
Fig. 4 is the schematic diagram of HBase container cluster deployment system provided in an embodiment of the present invention；
Fig. 5 is the schematic diagram of HBase container cluster deployment facility provided in an embodiment of the present invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
As shown in Figure 1, be the flow diagram of HBase container cluster dispositions method provided in an embodiment of the present invention, it is above-mentioned
HBase container cluster is based on the privately owned container application shop of HBase and is disposed by Rancher platform, above-mentioned HBase container
Clustered deploy(ment) includes the new HBase container cluster of creation and carries out dilatation to original HBase container cluster.The present embodiment
The client device that HBase container cluster dispositions method can be equipped with Rancher platform and container software for editing by one executes,
And the HBase container cluster dispositions method includes:
Step S11: management node mirror image and back end mirror image of the creation based on the privately owned container application shop of HBase, and
By the management node mirror image of above-mentioned creation and back end mirror image upload to mirror image warehouse (such as by docker build and
Push order), and above-mentioned management node mirror image and back end mirror image include identical starting script.
Different from existing scheme, the starting script of management node mirror image and back end mirror image in the present embodiment is not only wanted
The configuration of user when reading starting application shop will also realize the main management node (place that Master, i.e. operation have main management container
Host) and data memory node (Slave, i.e. operation have the host of data storage container) between two-way communication.It is based on
Management node mirror image creation main management container and based on back end mirror image creation data storage container after actuation, first
Judge that present node is that main management node (runs the place of main management container according to host name (being specified by Rancher platform)
Host) or data memory node (i.e. the host of operation data storage container), and allow two kinds of nodes (to be responsible for after determination
Reason node and data memory node) it is always maintained at communication, and two-way registration host machine information and data management node file (HDFS
With needed for HBase program).
Particularly, before mirror image is packaged upload, Dockerfile need to first be write.Dockerfile is by series of orders
The script constituted with parameter.When writing Dockerfile, relevant Hbase cluster component installation kit can be put to
In catalogue where Dockerfile, and management node mirror image and back end mirror image have different Dockerfile.
Step S12: the application item of creation is simultaneously uploaded to Rancher platform by creation application item.It is above-mentioned
Application item, which is used to generate the deployment page in Rancher platform, (has dialog box, check box, single choice in the deployment page
One or more of frame, drop-down list etc., to realize that user inputs), and deployment HBase is obtained by the deployment page and is held
Configuration information needed for device cluster, above-mentioned configuration information includes the mirror image title pulled, and the above-mentioned mirror image title pulled is at least
Management node mirror image and the corresponding title of back end mirror image including step S11 creation.
Step S13: making Rancher platform executing application project and (passes through and answers according to the configuration information of acquisition
The configuration information obtained with the deployment page of program items) create new HBase container cluster or to existing HBase container cluster
Carry out dilatation.
Specifically, in this step, user can create new HBase container cluster or right by the WEB service of client
Existing HBase container cluster carries out dilatation, i.e., makes application item creation by deployment page by the WEB service of client
Face, and the configuration information inputted in the deployment page according to user can create the container for possessing Hadoop and HBase the second grade
Cluster, and can achieve second grade dilatation, and do not influence cluster regular traffic when dilatation, greatly reduce Hadoop's and HBase
The threshold of containerization deployment, reduces and expends the time.
It in one embodiment of the invention, include operation mode and ring above by the configuration information that the deployment page obtains
Border variable.Operation mode specifically includes creation HBase cluster (deploy) and HBase cluster dilatation (expansion), wherein creating
It builds HBase cluster and creates a Hbase container cluster, HBase cluster dilatation increases by one in former Hbase container cluster
Or multiple data storage containers, it can choose one in two above in the deployment page.
When operation mode is creation HBase cluster, above-mentioned environmental variance further comprises number of clusters (HBase
RegionServer Number) and configuration port (HBase Master WebUI Port)；It is HBase in operation mode
When cluster dilatation, above-mentioned environmental variance further comprise initial cluster port numbers (HBase Master WebUI Port), just
Beginning number of clusters (Origin Cluster Number), the quantity (Expanxion Cluster Number) of dilatation.
When creating application item, Rancher deployment Page Template can be first generated, and compiled based on the template
Volume.Specifically, editable Rancher disposes the questions.yaml file in Page Template, thus in deployment HBase container
When cluster, operation mode can be obtained by questions.yaml, and on the basis of operation mode, configuration number of clusters is matched
The port set, or port numbers, initial cluster quantity, the quantity of dilatation of configuration initial cluster.Also, can also it pass through
The default parameters of the above-mentioned environmental variance of values.yaml document definition (i.e. when above-mentioned parameter is not configured in client, directly uses
Default parameters in values.yaml file is as environmental variance).
When creating application item, also container layout need to be write in the templates catalogue of application item
Program, and in above procedure carry out operation mode matching.Specifically, corresponding when operation mode is creation HBase cluster
Container editor Deployment class in need to obtain the incoming institute of the HBase container cluster starting page (i.e. deployment the page)
The number of clusters of configuration, and be incremented by Container Name serial number with number of clusters, such as configuration RegionServer quantity is 3, then
Create four containers, i.e. a main management container, data storage container 1, data storage container 2 and data storage container 3.Finally
The parameter of above-mentioned configuration is all injected in environmental variance (thus the starting script of main management container and data storage container
Read these values), and HDFS data are mounted to host.It is also needed in the Service class of above-mentioned corresponding container editor
Read configured port (since port is to be mapped in the same host cluster, can only be unique, so port numbers are external
It maps and with the increased number of data memory node.Such as number of clusters is when being 3, then three ports can for 2181,2182,
2183)。
When operation mode is the dilatation of HBase cluster, need to obtain HBase container in the Deployment class of corresponding program
Cluster starts the incoming initial cluster quantity configured of the page, the quantity of dilatation.Similarly, need to make container sequence number be incremented by and
Configuration information need to be injected container environmental variance.In the Service class of the program under HBase cluster Diffuse Dimension model, need to obtain
The port numbers of initial cluster are taken, and according to the quantity of initial cluster port numbers, initial cluster quantity and dilatation come to dilatation container
Port carry out incremental, such as the port of two data memory nodes of dilatation is respectively 2184,2185.
As shown in Fig. 2, being that the execution of main management container is opened in HBase container cluster dispositions method provided in an embodiment of the present invention
The flow diagram of dynamic script.Based on management node mirror image creation main management container after actuation according to starting script execution with
Lower operation:
Step S21: the information of the host where receiving the data storage container sent as each data storage container,
Such as host name etc..
Step S22: it broadcasts to all data storage containers obtained by the deployment page that application item creates in real time
Creation HBase container cluster needed for configuration information.Specifically, the environment that main management container can be read that the deployment page obtains becomes
Amount (specifically comes from Deployment class), and the environmental variance is injected to the configuration file of Zookeeper.
Step S23: judge whether the operation mode in configuration information is creation HBase cluster, and in configuration information
Operation mode executes step S24 when being creation HBase cluster, no to then follow the steps S25.
Step S24: HDFS program is started according to the port of number of clusters and configuration in configuration information, and pre- waiting
If the time (such as several seconds) starts HBase program afterwards, the creation of HBase container cluster is completed.
Step S25: in the dilatation success message for receiving the data storage container from dilatation, make HDFS program updating
The cluster dilatation of HBase container is completed in data memory node list and equally loaded.
As shown in figure 3, being that data storage container executes in HBase container cluster dispositions method provided in an embodiment of the present invention
Start the flow diagram of script.Data storage container based on the creation of back end mirror image is held according to starting script after actuation
The following operation of row:
Step S31: the information of the host where sending current data storage container to main management container in real time, such as place
Host name etc..
Step S32: the configuration information of main management container broadcast is received, and according to the port numbers of initial cluster in configuration information
Modify HDFS program and HBase program.
Step S33: when the operation mode in configuration information is the dilatation of HBase cluster, it is based on back end image starting
Data storage container, and dilatation success message is sent to main management container after data storage container starts successfully, complete HBase
Container cluster dilatation.Operation mode in configuration information does not execute operation then when being creation HBase cluster.
As shown in figure 4, the embodiment of the present invention also provides a kind of HBase container cluster deployment system, the HBase of the present embodiment
Container cluster deployment system can be mounted with the client device of Rancher platform and container software for editing, and the system for one
Including mirror image creating unit 41, establishment of item unit 42 and deployment execution unit 43, above-mentioned image creating unit 41, establishment of item
Unit 42 and deployment execution unit 43 (such as above-mentioned are equipped with Rancher platform and appearance in combination with the equipment such as computer are run on
The client device of device software for editing) on software realization.
Mirror image creating unit 41 is for creating management node mirror image and data section based on the privately owned container application shop of HBase
Point mirror image, and management node mirror image and back end mirror image are uploaded into mirror image warehouse, above-mentioned management node mirror image and data section
Point mirror image includes identical starting script.
The configuration of user, will also realize main management node when above-mentioned starting script will not only read starting application shop
(Slave, i.e. operation have data storage container for (Master, i.e. operation have the host of main management container) and data memory node
Host) between two-way communication.Specifically, main management node and data memory node be when executing starting, first basis
Host name (being specified by Rancher platform) judges that present node is main management node (running the host of main management container)
Or data memory node (i.e. the host of operation data storage container), and allow two kinds of node (i.e. main management sections after determination
Point and data memory node) be always maintained at communication, and two-way registration host machine information and data management node file (HDFS with
Needed for HBase program).
Also, before mirror image is packaged upload, mirror image creating unit 41 also needs first to write Dockerfile.Dockerfile
It is the script being made of series of orders and parameter.When writing Dockerfile, relevant HBase cluster component can be installed
In catalogue where Bao Fangzhi Dockerfile, and management node mirror image and back end mirror image are with different
Dockerfile。
Establishment of item unit 42 is used to create application item and application item is uploaded to Rancher platform,
Above-mentioned application item (has dialog box, check box, radio box, drop-down column for generating the deployment page in the deployment page
One or more of table etc., to realize that user inputs), and obtained needed for deployment HBase container cluster by the deployment page
Configuration information, above-mentioned configuration information includes the mirror image title pulled, and the above-mentioned mirror image title pulled includes the management of creation
Node mirror image and the corresponding title of back end mirror image.
Deployment execution unit 43 is for making Rancher platform executing application project and the configuration information according to acquisition
(configuration information obtained by the deployment page of application program item) creates new HBase container cluster or to existing
HBase container cluster carries out dilatation.
It in one embodiment of the invention, include operation mode and ring above by the configuration information that the deployment page obtains
Border variable.Operation mode specifically includes creation HBase cluster and HBase cluster dilatation, can choose in the deployment page above
One in two.Also, when operation mode is creation HBase cluster, above-mentioned environmental variance includes number of clusters and matches
The port set；When operation mode is the dilatation of HBase cluster, above-mentioned environmental variance includes the port numbers of initial cluster, initial set
Group quantity, the quantity of dilatation.
Particularly, above-mentioned starting script defines the following steps executed by main management container: receiving to be stored by data and hold
The information of host where the data storage container that device is sent；Pass through the deployment page to data storage container broadcast in real time
Configuration information needed for the deployment HBase container cluster of acquisition；Operation mode in configuration information is creation HBase cluster
When, HDFS program is started according to the port of number of clusters and configuration in configuration information, and start after waiting preset time
HBase program；Operation mode in configuration information is the dilatation of HBase cluster, and receives the data storage from dilatation and hold
When the dilatation success message of device, make HDFS program updating data memory node list and equally loaded.
In addition, above-mentioned starting script also defines the following steps executed from data storage container: holding in real time to main management
Device sends the information of the host where current data storage container；The configuration information of reception main management container broadcast, and according to
The port numbers modification HDFS program and HBase program of initial cluster in configuration information；Operation mode in configuration information is
When HBase cluster dilatation, it is based on back end image starting data storage container, and start successfully in the data storage container
Dilatation success message is sent to the main management container afterwards.
The HBase sets of containers in HBase container cluster deployment system and above-mentioned Fig. 1-3 corresponding embodiment in the present embodiment
Group's dispositions method belongs to same design, and specific implementation process is shown in corresponding embodiment of the method in detail, and in embodiment of the method
Technical characteristic is corresponding in this apparatus embodiments to be applicable in, and which is not described herein again.
The embodiment of the present invention also provides a kind of HBase container cluster deployment facility 5, which specifically can be and deploy
The client of Rancher platform, as shown in figure 5, the HBase container cluster deployment facility 5 includes memory 51 and processor 52,
It is stored with the computer program that can be executed in processor 52 in memory 51, and is realized such as when the execution computer program of processor 52
The step of upper HBase container cluster dispositions method.
The HBase container in HBase container cluster deployment facility 4 and above-mentioned Fig. 1-3 corresponding embodiment in the present embodiment
Clustered deploy(ment) method belongs to same design, and specific implementation process is shown in corresponding embodiment of the method in detail, and in embodiment of the method
Technical characteristic it is corresponding in this apparatus embodiments be applicable in, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and computer journey is stored on the storage medium
Sequence, when computer program is executed by processor, the step of realizing HBase container cluster dispositions method as described above.The present embodiment
In computer readable storage medium belong to the HBase container cluster dispositions method in above-mentioned Fig. 1-3 corresponding embodiment it is same
Design, specific implementation process are shown in corresponding embodiment of the method in detail, and the technical characteristic in embodiment of the method is in this equipment reality
It applies to correspond in example and be applicable in, which is not described herein again.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application constitutes any limit
It is fixed.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed.Each functional unit in embodiment, module can integrate in a processor, be also possible to each
A unit physically exists alone, and can also be integrated in one unit with two or more units, and above-mentioned integrated unit was both
It can take the form of hardware realization, can also realize in the form of software functional units.In addition, each functional unit, module
Specific name be also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Unit in above system,
The specific work process of module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
In embodiment provided herein, it should be understood that disclosed Application Container cluster, which is alarmed, to be realized
Method, system and equipment, may be implemented in other ways.For example, Application Container cluster described above is alarmed
Realize that system embodiment is only schematical.
In addition, each functional unit in each embodiment of the application can integrate in a processor, it is also possible to
Each unit physically exists alone, and can also be integrated in one unit with two or more units.Above-mentioned integrated unit
Both it can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the application realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It may include: any entity or changing interface equipment, recording medium, USB flash disk, the movement that can carry the computer program code
Hard disk, magnetic disk, CD, computer storage, read-only memory (Read-Only Memory, ROM), random access memory
(Random Access Memory, RAM), electric carrier signal, telecommunication signal and software distribution medium etc..It needs to illustrate
It is that the content that the computer-readable medium includes can be fitted according to the requirement made laws in jurisdiction with patent practice
When increase and decrease, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier wave
Signal and telecommunication signal.
Embodiment described above is only to illustrate the technical solution of the application, rather than its limitations；Although referring to aforementioned reality
Example is applied the application is described in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution should all
Comprising within the scope of protection of this application.
Claims (10)
1. a kind of HBase container cluster dispositions method characterized by comprising
Management node mirror image and back end mirror image based on the privately owned container application shop of HBase are created, and the management is saved
Point mirror image and back end mirror image upload to mirror image warehouse, and the management node mirror image and back end mirror image include identical open
Dynamic script, and the starting script is when executed, makes the main management container created based on the management node mirror image and is based on
The data storage container of the back end mirror image creation carries out two-way communication after actuation；
The application item is simultaneously uploaded to Rancher platform by creation application item, and the application item is used
The page is disposed in generating, and passes through configuration information needed for deployment page acquisition deployment HBase container cluster, the configuration
Information includes the mirror image title pulled, and the mirror image title pulled includes the management node mirror image and back end mirror of creation
As corresponding title；
So that the Rancher platform is executed the application item and creates new HBase according to the configuration information of acquisition
Container cluster carries out dilatation to existing HBase container cluster.
2. HBase container cluster dispositions method according to claim 1, which is characterized in that the configuration information includes behaviour
Operation mode and environmental variance, and the operation mode is creation HBase cluster or HBase cluster dilatation；
When the operation mode is creation HBase cluster, the environmental variance includes the port of number of clusters and configuration；
When the operation mode is the dilatation of HBase cluster, the environmental variance includes the port numbers of initial cluster, initial cluster
Quantity, the quantity of dilatation.
3. HBase container cluster dispositions method according to claim 2, which is characterized in that the method includes the masters
Container is managed according to the starting script execution following steps:
The information of host where receiving the data storage container sent as the data storage container；
It is broadcasted in real time to all data storage containers needed for the deployment HBase container cluster obtained by the deployment page
Configuration information；
When operation mode in the configuration information is creation HBase cluster, according to the number of clusters in the configuration information
And the port of configuration starts HDFS program, and starts HBase program after waiting preset time；
Operation mode in the configuration information is the dilatation of HBase cluster, and receives the data storage container from dilatation
Dilatation success message when, make the HDFS program updating data memory node list and equally loaded.
4. HBase container cluster dispositions method according to claim 3, which is characterized in that the method includes the numbers
According to storage container according to the starting script execution following steps:
The information of host where sending current data storage container to the main management container in real time；
The configuration information of the main management container broadcast is received, and is repaired according to the port numbers of the initial cluster in the configuration information
Change HDFS program and HBase program；
When operation mode in the configuration information is the dilatation of HBase cluster, node image starting data based on the data
Storage container, and dilatation success message is sent to the main management container after the data storage container starts successfully.
5. a kind of HBase container cluster deployment system, which is characterized in that including mirror image creating unit, establishment of item unit and portion
Affix one's name to execution unit, in which:
The mirror image creating unit, for creating management node mirror image and data section based on the privately owned container application shop of HBase
Point mirror image, and the management node mirror image and back end mirror image are uploaded into mirror image warehouse, the management node mirror image sum number
It include identical starting script according to node mirror image；
The establishment of item unit is put down for creating application item and the application item being uploaded to Rancher
Platform, the application item obtain deployment HBase container cluster institute for generating the deployment page, and by the deployment page
The configuration information needed, the configuration information includes the mirror image title pulled, and the mirror image title pulled includes the pipe of creation
Manage node mirror image and the corresponding title of back end mirror image；
The deployment execution unit, for making the Rancher platform execute the application item and according to acquisition
Configuration information creates new HBase container cluster or carries out dilatation to existing HBase container cluster, and passes through the starting foot
Originally make the main management container created based on the management node mirror image and based on the data the data storage of node mirror image creation
Container carries out two-way communication after actuation.
6. HBase container cluster deployment system according to claim 5, which is characterized in that the configuration information includes behaviour
Operation mode and environmental variance, and the operation mode is creation HBase cluster or HBase cluster dilatation；
When the operation mode is creation Hbase cluster, the environmental variance includes the port of number of clusters and configuration；
When the operation mode is the dilatation of HBase cluster, the environmental variance includes the port numbers of initial cluster, initial cluster
Quantity, the quantity of dilatation.
7. HBase container cluster deployment system according to claim 6, which is characterized in that the starting script defines
The following steps executed by the main management container:
The information of host where receiving the data storage container sent as the data storage container；
It is broadcasted in real time to all data storage containers needed for the deployment HBase container cluster obtained by the deployment page
Configuration information；
When operation mode in the configuration information is creation HBase cluster, according to the number of clusters in the configuration information
And the port of configuration starts HDFS program, and starts HBase program after waiting preset time；
Operation mode in the configuration information is the dilatation of HBase cluster, and receives the data storage container from dilatation
Dilatation success message when, make the HDFS program updating data memory node list and equally loaded.
8. HBase container cluster deployment system according to claim 7, which is characterized in that the starting script defines
The following steps executed by the data storage container:
The information of host where sending current data storage container to the main management container in real time；
The configuration information of the main management container broadcast is received, and is repaired according to the port numbers of the initial cluster in the configuration information
Change HDFS program and HBase program；
When operation mode in the configuration information is the dilatation of HBase cluster, node image starting data based on the data
Storage container, and dilatation success message is sent to the main management container after the data storage container starts successfully.
9. a kind of HBase container cluster deployment facility, which is characterized in that including memory and processor, deposited in the memory
The computer program that can be executed in the processor is contained, and realizes such as right when the processor execution computer program
It is required that described in any one of 1-4 the step of HBase container cluster dispositions method.
10. a kind of computer readable storage medium, which is characterized in that computer program is stored on the storage medium, it is described
When computer program is executed by processor, the HBase container cluster dispositions method as described in any one of claims 1 to 4 is realized
The step of.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910543672.XA CN110389766B (en) | 2019-06-21 | 2019-06-21 | HBase container cluster deployment method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910543672.XA CN110389766B (en) | 2019-06-21 | 2019-06-21 | HBase container cluster deployment method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110389766A true CN110389766A (en) | 2019-10-29 |
| CN110389766B CN110389766B (en) | 2022-12-27 |
Family
ID=68285733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910543672.XA Active CN110389766B (en) | 2019-06-21 | 2019-06-21 | HBase container cluster deployment method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110389766B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110806881A (en) * | 2019-11-05 | 2020-02-18 | 浪潮云信息技术有限公司 | Method for deploying different CPU architectures by kubernets |
| CN111552908A (en) * | 2020-04-30 | 2020-08-18 | 深信服科技股份有限公司 | Terminal, system and running method of application program |
| CN112187925A (en) * | 2020-09-28 | 2021-01-05 | 江苏银承网络科技股份有限公司 | Offline cluster management method and device for big data platform |
| CN112328184A (en) * | 2020-12-03 | 2021-02-05 | 北京联创信安科技股份有限公司 | Cluster capacity expansion method, device, equipment and storage medium |
| CN113419819A (en) * | 2021-06-25 | 2021-09-21 | 重庆紫光华山智安科技有限公司 | Container management method, device, equipment and medium |
| CN116909581A (en) * | 2023-09-11 | 2023-10-20 | 中移(苏州)软件技术有限公司 | HBase service multi-instance management method, device, equipment and storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412768A (en) * | 2013-07-19 | 2013-11-27 | 蓝盾信息安全技术股份有限公司 | Zookeeper cluster automatic-deployment method based on script program |
| CN104679717A (en) * | 2015-02-15 | 2015-06-03 | 北京京东尚科信息技术有限公司 | Method and management system of elastic cluster deployment |
| CN106294886A (en) * | 2016-10-17 | 2017-01-04 | 北京集奥聚合科技有限公司 | A kind of method and system of full dose extracted data from HBase |
| WO2017045424A1 (en) * | 2015-09-18 | 2017-03-23 | 乐视控股（北京）有限公司 | Application program deployment system and deployment method |
| CN106873975A (en) * | 2016-12-30 | 2017-06-20 | 武汉默联股份有限公司 | Devops based on Docker persistently pays and automated system and method |
| WO2017161984A1 (en) * | 2016-03-24 | 2017-09-28 | 中兴通讯股份有限公司 | Method, device and system for deploying data clusters, and computer storage medium |
| WO2017206667A1 (en) * | 2016-06-03 | 2017-12-07 | 中兴通讯股份有限公司 | Method and device for distributively deploying hadoop cluster |
| CN109327509A (en) * | 2018-09-11 | 2019-02-12 | 武汉魅瞳科技有限公司 | A kind of distributive type Computational frame of the lower coupling of master/slave framework |
| CN109491859A (en) * | 2018-10-16 | 2019-03-19 | 华南理工大学 | For the collection method of container log in Kubernetes cluster |
| US20190095599A1 (en) * | 2017-09-25 | 2019-03-28 | Splunk Inc. | Customizing a user behavior analytics deployment |
| CN109814881A (en) * | 2017-11-21 | 2019-05-28 | 北京京东尚科信息技术有限公司 | Method and apparatus for disposing data-base cluster |
| CN109828953A (en) * | 2019-01-30 | 2019-05-31 | 武汉虹旭信息技术有限责任公司 | Picture retrieval system and its method based on distributed memory database |
| CN109857516A (en) * | 2018-12-29 | 2019-06-07 | 航天信息股份有限公司 | Cluster moving method and device based on container |
| CN109885316A (en) * | 2019-02-18 | 2019-06-14 | 国家计算机网络与信息安全管理中心 | Hdfs-hbase dispositions method and device based on kubernetes |
-
2019
- 2019-06-21 CN CN201910543672.XA patent/CN110389766B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412768A (en) * | 2013-07-19 | 2013-11-27 | 蓝盾信息安全技术股份有限公司 | Zookeeper cluster automatic-deployment method based on script program |
| CN104679717A (en) * | 2015-02-15 | 2015-06-03 | 北京京东尚科信息技术有限公司 | Method and management system of elastic cluster deployment |
| WO2017045424A1 (en) * | 2015-09-18 | 2017-03-23 | 乐视控股（北京）有限公司 | Application program deployment system and deployment method |
| WO2017161984A1 (en) * | 2016-03-24 | 2017-09-28 | 中兴通讯股份有限公司 | Method, device and system for deploying data clusters, and computer storage medium |
| WO2017206667A1 (en) * | 2016-06-03 | 2017-12-07 | 中兴通讯股份有限公司 | Method and device for distributively deploying hadoop cluster |
| CN106294886A (en) * | 2016-10-17 | 2017-01-04 | 北京集奥聚合科技有限公司 | A kind of method and system of full dose extracted data from HBase |
| CN106873975A (en) * | 2016-12-30 | 2017-06-20 | 武汉默联股份有限公司 | Devops based on Docker persistently pays and automated system and method |
| US20190095599A1 (en) * | 2017-09-25 | 2019-03-28 | Splunk Inc. | Customizing a user behavior analytics deployment |
| CN109814881A (en) * | 2017-11-21 | 2019-05-28 | 北京京东尚科信息技术有限公司 | Method and apparatus for disposing data-base cluster |
| CN109327509A (en) * | 2018-09-11 | 2019-02-12 | 武汉魅瞳科技有限公司 | A kind of distributive type Computational frame of the lower coupling of master/slave framework |
| CN109491859A (en) * | 2018-10-16 | 2019-03-19 | 华南理工大学 | For the collection method of container log in Kubernetes cluster |
| CN109857516A (en) * | 2018-12-29 | 2019-06-07 | 航天信息股份有限公司 | Cluster moving method and device based on container |
| CN109828953A (en) * | 2019-01-30 | 2019-05-31 | 武汉虹旭信息技术有限责任公司 | Picture retrieval system and its method based on distributed memory database |
| CN109885316A (en) * | 2019-02-18 | 2019-06-14 | 国家计算机网络与信息安全管理中心 | Hdfs-hbase dispositions method and device based on kubernetes |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110806881A (en) * | 2019-11-05 | 2020-02-18 | 浪潮云信息技术有限公司 | Method for deploying different CPU architectures by kubernets |
| CN110806881B (en) * | 2019-11-05 | 2023-07-04 | 浪潮云信息技术股份公司 | Method for deploying different CPU architectures by kubernetes |
| CN111552908A (en) * | 2020-04-30 | 2020-08-18 | 深信服科技股份有限公司 | Terminal, system and running method of application program |
| CN112187925A (en) * | 2020-09-28 | 2021-01-05 | 江苏银承网络科技股份有限公司 | Offline cluster management method and device for big data platform |
| CN112328184A (en) * | 2020-12-03 | 2021-02-05 | 北京联创信安科技股份有限公司 | Cluster capacity expansion method, device, equipment and storage medium |
| CN112328184B (en) * | 2020-12-03 | 2023-11-21 | 北京联创信安科技股份有限公司 | Cluster capacity expansion method, device, equipment and storage medium |
| CN113419819A (en) * | 2021-06-25 | 2021-09-21 | 重庆紫光华山智安科技有限公司 | Container management method, device, equipment and medium |
| CN113419819B (en) * | 2021-06-25 | 2023-09-08 | 重庆紫光华山智安科技有限公司 | Container management method, device, equipment and medium |
| CN116909581A (en) * | 2023-09-11 | 2023-10-20 | 中移(苏州)软件技术有限公司 | HBase service multi-instance management method, device, equipment and storage medium |
| CN116909581B (en) * | 2023-09-11 | 2024-01-26 | 中移(苏州)软件技术有限公司 | HBase service multi-instance management method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110389766B (en) | 2022-12-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110389766A (en) | HBase container cluster dispositions method, system, equipment and computer readable storage medium | |
| CN110389832A (en) | ZooKeeper container cluster dispositions method, system, equipment and storage medium | |
| CN101504672B (en) | Method and system for dynamically configuring physical data table | |
| CN109947773A (en) | Change of the deployment to key mode in multi-tenant database system | |
| CN105487864A (en) | Method and device for automatically generating code | |
| US20070300217A1 (en) | Data Container for User Interface Content Data | |
| CN105608203A (en) | Internet of things log processing method and device based on Hadoop platform | |
| US20170168801A1 (en) | Version control for customized applications | |
| CN104516738A (en) | Integrated implementing method for development and release of APP | |
| CN1591445A (en) | Generic method for defining resource configuration profiles in provisioning systems | |
| CN103701856A (en) | Method for defining and acquiring upgrade package of terminal equipment | |
| CN105959390A (en) | Unified management system and method of micro services | |
| CN107783816A (en) | The method and device that creation method and device, the big data cluster of virtual machine create | |
| CN110659261A (en) | Data mining model publishing method, model and model service management method | |
| CN109062568A (en) | A kind of project generation method and tool | |
| CN106033388A (en) | A test use case library management method and system | |
| CN102571400A (en) | Method, system and device for updating communication network resource model | |
| CN106878363A (en) | A kind of information processing method, apparatus and system | |
| CN108572845A (en) | The upgrade method and related system of distributed micro services cluster | |
| CN108469953A (en) | A kind of generation method of page table list, server and storage medium | |
| CN107294750A (en) | A kind of distribution configuring management method and device for converging group energy self-identifying | |
| CN102857949A (en) | Method and device for planning data consistency guarantees | |
| CN115878092A (en) | Code generation method, device and medium based on micro-service architecture | |
| CN103107919A (en) | Method and system for network resource modeling | |
| CN101820354B (en) | Collocation method based on TNDS (Total Network Data System) object, terminal equipment and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |