CN112328184B - Cluster capacity expansion method, device, equipment and storage medium - Google Patents
Cluster capacity expansion method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN112328184B CN112328184B CN202011412300.2A CN202011412300A CN112328184B CN 112328184 B CN112328184 B CN 112328184B CN 202011412300 A CN202011412300 A CN 202011412300A CN 112328184 B CN112328184 B CN 112328184B
- Authority
- CN
- China
- Prior art keywords
- frame
- newly
- container
- framework
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000004590 computer program Methods 0.000 claims description 7
- 238000012986 modification Methods 0.000 claims description 7
- 230000004048 modification Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 5
- 235000002905 Rumex vesicarius Nutrition 0.000 description 44
- 239000003795 chemical substances by application Substances 0.000 description 44
- 240000000797 Hibiscus cannabinus Species 0.000 description 41
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 244000207667 Rumex vesicarius Species 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0605—Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Stored Programmes (AREA)
Abstract
The embodiment of the invention discloses a cluster capacity expansion method, which comprises the following steps: establishing a framework proxy mirror in a container having a set distributed framework base environment; creating at least one newly added frame agent node according to the frame agent image; modifying configuration information in at least one newly added frame agent node; registering at least one newly-added frame proxy node to a frame server to obtain the expanded distributed frame cluster. According to the cluster capacity expansion method disclosed by the embodiment of the invention, the container mirror image is used for expanding the cluster nodes, so that the quick capacity expansion of the clusters can be realized, the time cost is saved, and the working efficiency is improved.
Description
Technical Field
The present invention relates to the field of cloud computing technologies, and in particular, to a cluster capacity expansion method, device, equipment, and storage medium.
Background
Apache Ambari is a Web-based tool that supports the creation, management and monitoring of multiple big data components, such as Hadoop, hbase, zookeeper.
Ambari itself is also a distributed architecture software, consisting essentially of two parts: ambari Server and Ambari Agent. In brief, a user informs an Ambari Agent to install corresponding software through an Ambari Server; the Agent can send the state of each software module of each machine to the Ambari Server regularly, and finally the state information can be displayed on the GUI of the Ambari, so that a user can conveniently know various states of the cluster and maintain the state correspondingly.
Ambari Server gathers information from the entire cluster. Each host has an Ambari Agent thereon, and the Ambari Server controls each host through the Ambari Agent.
Ambari Metrics, ambari Infra, zookeeper are all components of Ambari cluster support monitoring. The Ambari Metrics is a functional component in Ambari, which is responsible for monitoring cluster states and information, and Ambari Infra provides a public index service for an installation component and a convenient tool for managing logs. Zookeeper is a distributed application coordination service, and both Ambari Metrics and Ambari Infra require Zookeeper coordination management. The three components are installed in the Ambari basic environment, so that a user can know the running condition of the components in the cluster through the page diagram conveniently, and log information of the platform and the components can be clearly checked.
The LXC container technology is a kernel-level virtualization, and has a higher running speed compared with other virtualization technologies, so that in the deployment and capacity expansion of a large data cluster, the LXC container is used for achieving rapid deployment and rapid capacity expansion.
When Ambari clusters are used in containers to manage service components related to big data, due to the continuous increase of the business scale and the number of users of the companies, the data volume in the clusters is increased, and the clusters need to be expanded laterally to bear more data volume. The existing container-based large data cluster environment deployment technology does not comprise a container expansion technology, and in the large data cluster-based expansion technology, the expansion flow is complicated.
Disclosure of Invention
The embodiment of the invention provides a cluster capacity expansion method, device, equipment and storage medium, which can realize the rapid capacity expansion of a cluster.
In a first aspect, an embodiment of the present invention provides a cluster expansion method, including:
establishing a framework proxy mirror in a container having a set distributed framework base environment;
creating at least one newly added frame proxy node according to the frame proxy image;
modifying configuration information in the at least one newly added frame agent node;
registering the at least one newly-added frame proxy node to a frame server to obtain the expanded distributed frame cluster.
Further, establishing a framework proxy image in a container having a set distributed framework infrastructure, comprising:
acquiring an original container mirror image of the set distributed framework;
creating a new frame container from the original container image; the framework container has the set distributed framework base environment therein;
and establishing a frame agent mirror image in the new frame container.
Further, modifying configuration information in the at least one newly added frame proxy node includes:
modifying the host name and IP configuration in the at least one newly-added frame proxy node, and configuring a password-free login in the at least one newly-added frame proxy node.
Further, registering the at least one newly added frame proxy node with a frame server to obtain a distributed frame cluster after capacity expansion, and further comprising:
and if other components are added in the original cluster, installing the other components in the at least one newly-added frame proxy node.
In a second aspect, an embodiment of the present invention further provides a cluster expansion device, including:
the system comprises a frame agent mirror image establishing module, a frame agent mirror image generating module and a frame agent mirror image generating module, wherein the frame agent mirror image establishing module is used for establishing a frame agent mirror image in a container with a set distributed frame base environment; the frame proxy image comprises at least one newly-added frame proxy node;
the newly-added frame agent node creation module is used for creating at least one newly-added frame agent node according to the frame agent mirror image;
a configuration information modification module, configured to modify configuration information in the at least one newly-added frame proxy node;
and the node registration module is used for registering the at least one newly-added framework proxy node to the framework server to obtain the expanded distributed framework cluster.
Optionally, the framework proxy mirror image establishment module is further configured to:
acquiring an original container mirror image of the set distributed framework;
creating a new frame container from the original container image; the framework container has the set distributed framework base environment therein;
and establishing a frame agent mirror image in the new frame container.
Optionally, the configuration information modification module is further configured to:
modifying the host name and IP configuration in the at least one newly-added frame proxy node, and configuring a password-free login in the at least one newly-added frame proxy node.
Optionally, the node registration module is further configured to:
and if other components are added in the original cluster, installing the other components in the at least one newly-added frame proxy node.
In a third aspect, an embodiment of the present invention further provides a cluster expansion device, where the device includes:
the cluster expansion method comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the cluster expansion method according to any one of the embodiments of the invention when executing the program.
In a fourth aspect, an embodiment of the present invention further provides a cluster expansion storage medium, where a computer program is stored, where the program when executed by a processing device implements a cluster expansion method according to any one of the embodiments of the present invention.
The embodiment of the invention firstly establishes a framework agent mirror image in a container with a set distributed framework base environment; wherein the framework proxy image comprises at least one newly added framework proxy node; then modifying configuration information in at least one newly added frame agent node; and finally registering at least one newly-added frame proxy node to the frame server to obtain the expanded distributed frame cluster. According to the cluster capacity expansion method disclosed by the embodiment of the invention, the container mirror image is used for expanding the cluster nodes, so that the quick capacity expansion of the clusters can be realized, the time cost is saved, and the working efficiency is improved.
Drawings
FIG. 1 is a flow chart of a cluster expansion method according to a first embodiment of the invention;
FIG. 2 is a schematic diagram of a logical relationship between cluster expansion in accordance with a first embodiment of the present invention;
fig. 3 is a schematic structural diagram of a cluster expansion device in a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device in a third embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a flowchart of a cluster expansion method according to a first embodiment of the present invention, where the method may be applied to a case of expanding a large data cluster, and the method may be performed by a cluster expansion device, where the device may be composed of hardware and/or software, and may generally be integrated in a device having a cluster expansion function, where the device may be a server or an electronic device such as a server cluster. As shown in fig. 1, the method specifically comprises the following steps:
step 110, establishing a framework proxy image in a container having a set distributed framework infrastructure.
In this embodiment, the manner of establishing the framework proxy image in the container with the set distributed framework base environment may be: acquiring an original container mirror image of a set distributed framework; creating a new frame container from the original container image; the frame container is provided with a set distributed frame foundation environment; a framework proxy image is established in the new framework container.
Preferably, the setting distributed framework in the embodiment of the invention can be Apache Ambari, which is a Web-based tool and supports the supply, management and monitoring of Apache Hadoop clusters; the container may be a LXC (Linux Container) container, which is a kernel virtualization technology that can provide lightweight virtualization to isolate processes and resources; the framework Agent may be Ambari Agent, which is a core module of Ambari, mainly responsible for executing commands (install/start/stop) and reporting status (status/alert) on cluster nodes. Specifically, an original container mirror image of the original Ambari can be obtained; a new LXC container is created from the original container image, and then an Agent image is created in the container with the Ambari base environment in the container, where the Ambari base environment in the container may include Ambari Metrics, ambari Inra, and Zookeepers.
And 120, creating at least one newly-added frame proxy node according to the frame proxy image.
Specifically, at least one newly added Ambari Agent node may be created based on the mirror image.
Further, when a plurality of nodes need to be expanded, a new LXC container can be directly created through container mirror images, and a new Ambari Agent node is built, so that rapid expansion and deployment are realized.
And 130, modifying configuration information in at least one newly-added frame proxy node.
Wherein the configuration information includes, but is not limited to, hostname and IP configuration.
In this embodiment, the manner of modifying the configuration information in the at least one newly added frame proxy node may be: and modifying the host name and IP configuration in the at least one newly-added frame proxy node, and configuring password-free login in the at least one newly-added frame proxy node.
Specifically, the hostname and IP configuration in at least one newly added Ambari Agent node can be modified, and a password-free login is configured in the newly added Ambari Agent node, so that the newly added node can normally communicate with the original node.
And 140, registering at least one newly-added framework proxy node to a framework server to obtain the expanded distributed framework cluster.
Specifically, the newly added Ambari Agent node can be registered with the Ambari Server by using the Ambari Rest API to construct an expanded Ambari cluster. Wherein the API (Application Programming Interface, application program interface) is a predefined function or refers to the engagement of different components of the software system; the Ammori Server is an Ammori Server, the Ammori Server collects information from the whole cluster, and a user informs the Ammori Agent of installing corresponding software through the Ammori Server; the Agent will send the state of each software module of each machine to the Ambari Server periodically. The newly added Agent node is registered to the Ambari Server through the Ambari Rest API, and the expanded Ambari cluster can be obtained.
In this embodiment, registering at least one newly added frame proxy node to the frame server to obtain the expanded distributed frame cluster may be: if other components are added in the original cluster, other components are installed in at least one newly-added frame proxy node.
Specifically, if the user adds other components in the original cluster, the user can operate the Ammori platform page to add the required components in the newly added Ammori Agent node according to the needs.
Fig. 2 is a schematic diagram of a cluster expansion logic relationship in the first embodiment of the present invention, as shown in fig. 2, on the basis of a big data cluster built based on a container, the present invention creates a new Ambari Agent node based on a container mirror image in a container with an Ambari basic environment, so as to implement rapid expansion deployment.
The embodiment of the invention firstly establishes a framework agent mirror image in a container with a set distributed framework base environment; then creating at least one newly-added frame agent node according to the frame agent image; then modifying configuration information in at least one newly added frame agent node; and finally registering at least one newly-added frame proxy node to the frame server to obtain the expanded distributed frame cluster. According to the cluster capacity expansion method disclosed by the embodiment of the invention, the container mirror image is used for expanding the cluster nodes, so that the quick capacity expansion of the clusters can be realized, the time cost is saved, and the working efficiency is improved.
Example two
Fig. 3 is a schematic structural diagram of a cluster expansion device according to a second embodiment of the present invention. As shown in fig. 3, the apparatus includes: the system comprises a framework agent mirror image establishment module 210, a newly added framework agent node creation module 220, a configuration information modification module 230 and a node registration module 240.
The framework proxy image creation module 210 is configured to create a framework proxy image in a container having a set distributed framework base environment.
Optionally, the framework proxy image creation module 210 is further configured to:
acquiring an original container mirror image of a set distributed framework; creating a new frame container from the original container image; the frame container is provided with a set distributed frame foundation environment; a framework proxy image is established in the new framework container.
The newly added frame agent node creation module 220 is configured to create at least one newly added frame agent node according to the frame agent image.
A configuration information modification module 230, configured to modify configuration information in at least one newly added frame agent node.
Optionally, the configuration information modification module 230 is further configured to:
and modifying the host name and IP configuration in the at least one newly-added frame proxy node, and configuring password-free login in the at least one newly-added frame proxy node.
The node registration module 240 is configured to register at least one newly added framework proxy node with the framework server to obtain a distributed framework cluster after capacity expansion.
Optionally, the node registration module 240 is further configured to:
if other components are added in the original cluster, the other components are installed in at least one newly-added frame proxy node.
The device can execute the method provided by all the embodiments of the disclosure, and has the corresponding functional modules and beneficial effects of executing the method. Technical details not described in detail in this embodiment can be found in the methods provided by all of the foregoing embodiments of the present disclosure.
Example III
Fig. 4 is a schematic structural diagram of a computer device according to a third embodiment of the present invention. FIG. 4 illustrates a block diagram of a computer device 312 suitable for use in implementing embodiments of the present invention. The computer device 312 shown in fig. 4 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention. Device 312 is a typical clustered flash computing device.
As shown in FIG. 4, computer device 312 is in the form of a general purpose computing device. Components of computer device 312 may include, but are not limited to: one or more processors 316, a storage device 328, and a bus 318 that connects the different system components (including the storage device 328 and the processor 316).
Bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry standard architecture (Industry Standard Architecture, ISA) bus, micro channel architecture (Micro Channel Architecture, MCA) bus, enhanced ISA bus, video electronics standards association (Video Electronics Standards Association, VESA) local bus, and peripheral component interconnect (Peripheral Component Interconnect, PCI) bus.
Computer device 312 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 312 and includes both volatile and nonvolatile media, removable and non-removable media.
The storage 328 may include computer system-readable media in the form of volatile memory, such as random access memory (Random Access Memory, RAM) 330 and/or cache memory 332. The computer device 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 4, commonly referred to as a "hard disk drive"). Although not shown in fig. 4, a disk drive for reading from and writing to a removable nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from and writing to a removable nonvolatile optical disk (e.g., a Compact Disc-Read Only Memory (CD-ROM), digital versatile Disc (Digital Video Disc-Read Only Memory, DVD-ROM), or other optical media) may be provided. In such cases, each drive may be coupled to bus 318 through one or more data medium interfaces. Storage 328 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
Programs 336 having a set (at least one) of program modules 326 may be stored, for example, in storage 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 326 generally perform the functions and/or methods in the described embodiments of the invention.
The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), one or more devices that enable a user to interact with the computer device 312, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 312 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 322. Moreover, the computer device 312 may also communicate with one or more networks such as a local area network (Local Area Network, LAN), a wide area network Wide Area Network, a WAN) and/or a public network such as the internet via the network adapter 320. As shown, network adapter 320 communicates with other modules of computer device 312 via bus 318. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computer device 312, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disk array (Redundant Arrays of Independent Disks, RAID) systems, tape drives, data backup storage systems, and the like.
Processor 316 executes programs stored in storage 328 to perform various functional applications and data processing, such as implementing the cluster expansion methods provided by the above-described embodiments of the present invention.
Example IV
The embodiment of the invention provides a computer readable storage medium, and a computer program is stored on the computer readable storage medium, and when the program is executed by a processing device, the method for cluster expansion in the embodiment of the invention is realized. The computer readable medium of the present invention described above may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: establishing a framework proxy mirror in a container having a set distributed framework base environment; creating at least one newly added frame agent node according to the frame agent image; modifying configuration information in at least one newly added frame agent node; registering at least one newly-added frame proxy node to a frame server to obtain the expanded distributed frame cluster.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (8)
1. A cluster expansion method, comprising:
establishing a framework proxy mirror in a container having a set distributed framework base environment;
creating at least one newly added frame proxy node according to the frame proxy image;
modifying configuration information in the at least one newly added frame agent node;
registering the at least one newly-added frame proxy node to a frame server to obtain a distributed frame cluster after capacity expansion;
the establishing a framework proxy mirror in a container with a set distributed framework base environment includes:
acquiring an original container mirror image of the set distributed framework;
creating a new frame container from the original container image; the framework container has the set distributed framework base environment therein;
and establishing a frame agent mirror image in the new frame container.
2. The method of claim 1, wherein modifying configuration information in the at least one newly added framework agent node comprises:
modifying the host name and IP configuration in the at least one newly-added frame proxy node, and configuring a password-free login in the at least one newly-added frame proxy node.
3. The method of claim 1, wherein registering the at least one newly added framework proxy node with a framework server to obtain a scaled-up distributed framework cluster, further comprises:
and if other components are added in the original cluster, installing the other components in the at least one newly-added frame proxy node.
4. A cluster expansion device, comprising:
the system comprises a frame agent mirror image establishing module, a frame agent mirror image generating module and a frame agent mirror image generating module, wherein the frame agent mirror image establishing module is used for establishing a frame agent mirror image in a container with a set distributed frame base environment;
the newly-added frame agent node creation module is used for creating at least one newly-added frame agent node according to the frame agent mirror image;
a configuration information modification module, configured to modify configuration information in the at least one newly-added frame proxy node;
the node registration module is used for registering the at least one newly-added frame proxy node to the frame server to obtain a distributed frame cluster after capacity expansion;
the framework agent mirror image establishment module is further configured to:
acquiring an original container mirror image of the set distributed framework;
creating a new frame container from the original container image; the framework container has the set distributed framework base environment therein;
and establishing a frame agent mirror image in the new frame container.
5. The apparatus of claim 4, wherein the configuration information modification module is further configured to:
modifying the host name and IP configuration in the at least one newly-added frame proxy node, and configuring a password-free login in the at least one newly-added frame proxy node.
6. The apparatus of claim 4, wherein the node registration module is further configured to:
and if other components are added in the original cluster, installing the other components in the at least one newly-added frame proxy node.
7. A computer device, the device comprising: comprising a memory, a processor and a computer program stored on the memory and executable on the processor, said processor implementing the cluster expansion method according to any of claims 1-3 when said program is executed.
8. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processing device, implements a cluster expansion method according to any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011412300.2A CN112328184B (en) | 2020-12-03 | 2020-12-03 | Cluster capacity expansion method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011412300.2A CN112328184B (en) | 2020-12-03 | 2020-12-03 | Cluster capacity expansion method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112328184A CN112328184A (en) | 2021-02-05 |
| CN112328184B true CN112328184B (en) | 2023-11-21 |
Family
ID=74302487
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011412300.2A Active CN112328184B (en) | 2020-12-03 | 2020-12-03 | Cluster capacity expansion method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112328184B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114143196B (en) * | 2021-11-25 | 2023-07-28 | 北京百度网讯科技有限公司 | Instance configuration updating method, device, equipment, storage medium and program product |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107766157A (en) * | 2017-11-02 | 2018-03-06 | 山东浪潮云服务信息科技有限公司 | Distributed container cluster framework implementation method based on domestic CPU and OS |
| CN109656686A (en) * | 2018-12-17 | 2019-04-19 | 武汉烽火信息集成技术有限公司 | The upper deployment container cloud method of OpenStack, storage medium, electronic equipment and system |
| CN109814881A (en) * | 2017-11-21 | 2019-05-28 | 北京京东尚科信息技术有限公司 | Method and apparatus for disposing data-base cluster |
| CN110389832A (en) * | 2019-06-21 | 2019-10-29 | 深圳市汇川技术股份有限公司 | ZooKeeper container cluster dispositions method, system, equipment and storage medium |
| CN110389766A (en) * | 2019-06-21 | 2019-10-29 | 深圳市汇川技术股份有限公司 | HBase container cluster dispositions method, system, equipment and computer readable storage medium |
| CN111176834A (en) * | 2019-12-09 | 2020-05-19 | 中国平安财产保险股份有限公司 | Automatic scaling strategy operation and maintenance method, system and readable storage medium |
| CN111339055A (en) * | 2020-02-07 | 2020-06-26 | 浪潮软件股份有限公司 | Big data cluster capacity expansion method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8180747B2 (en) * | 2007-11-12 | 2012-05-15 | F5 Networks, Inc. | Load sharing cluster file systems |
-
2020
- 2020-12-03 CN CN202011412300.2A patent/CN112328184B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107766157A (en) * | 2017-11-02 | 2018-03-06 | 山东浪潮云服务信息科技有限公司 | Distributed container cluster framework implementation method based on domestic CPU and OS |
| CN109814881A (en) * | 2017-11-21 | 2019-05-28 | 北京京东尚科信息技术有限公司 | Method and apparatus for disposing data-base cluster |
| CN109656686A (en) * | 2018-12-17 | 2019-04-19 | 武汉烽火信息集成技术有限公司 | The upper deployment container cloud method of OpenStack, storage medium, electronic equipment and system |
| CN110389832A (en) * | 2019-06-21 | 2019-10-29 | 深圳市汇川技术股份有限公司 | ZooKeeper container cluster dispositions method, system, equipment and storage medium |
| CN110389766A (en) * | 2019-06-21 | 2019-10-29 | 深圳市汇川技术股份有限公司 | HBase container cluster dispositions method, system, equipment and computer readable storage medium |
| CN111176834A (en) * | 2019-12-09 | 2020-05-19 | 中国平安财产保险股份有限公司 | Automatic scaling strategy operation and maintenance method, system and readable storage medium |
| CN111339055A (en) * | 2020-02-07 | 2020-06-26 | 浪潮软件股份有限公司 | Big data cluster capacity expansion method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112328184A (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11210204B2 (en) | Agentless distributed monitoring of microservices through a virtual switch | |
| CN112119374B (en) | Selectively providing mutual transport layer security using alternate server names | |
| US11625281B2 (en) | Serverless platform request routing | |
| US11755452B2 (en) | Log data collection method based on log data generated by container in application container environment, log data collection device, storage medium, and log data collection system | |
| US10013301B2 (en) | Adjusting an operation of a computer using generated correct dependency metadata | |
| CN113742031B (en) | Node state information acquisition method and device, electronic equipment and readable storage medium | |
| US9317380B2 (en) | Preserving management services with self-contained metadata through the disaster recovery life cycle | |
| WO2023024629A1 (en) | Service access across kubernetes clusters | |
| CN115280325A (en) | Parameter sharing in federated learning | |
| US9166869B2 (en) | Management of distributed network switching cluster | |
| US8543680B2 (en) | Migrating device management between object managers | |
| US20150355892A1 (en) | Resources provisioning based on a set of discrete configurations | |
| US9571350B2 (en) | Network element diagnostic evaluation | |
| CN103118073A (en) | Virtual machine data persistence storage system and method in cloud environment | |
| CN112328184B (en) | Cluster capacity expansion method, device, equipment and storage medium | |
| US20210081265A1 (en) | Intelligent cluster auto-scaler | |
| CN114489954A (en) | Tenant creation method based on virtualization platform, tenant access method and equipment | |
| CN110868324A (en) | Service configuration method, device, equipment and storage medium | |
| US11526379B2 (en) | Application building in a distributed computing environment | |
| CN113726638B (en) | Method, device and equipment for managing multi-cloud multi-core container and storage medium | |
| CN116155978A (en) | Multi-registry adaptation method, device, electronic equipment and storage medium | |
| CN115248680A (en) | Software construction method, system, device, medium, and program product | |
| US20180189088A1 (en) | Attaching a pluggable agent to a virtual machine (vm) in a networked computing environment | |
| CN114201508A (en) | Data processing method, data processing apparatus, electronic device, and storage medium | |
| CN115485677A (en) | Secure data replication in a distributed data storage environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |