CN108363589A - Method for operating etcd node in memory - Google Patents
Method for operating etcd node in memory Download PDFInfo
- Publication number
- CN108363589A CN108363589A CN201810049200.4A CN201810049200A CN108363589A CN 108363589 A CN108363589 A CN 108363589A CN 201810049200 A CN201810049200 A CN 201810049200A CN 108363589 A CN108363589 A CN 108363589A
- Authority
- CN
- China
- Prior art keywords
- etcd
- memory
- linux
- memory operation
- establish
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000015654 memory Effects 0.000 title claims abstract description 69
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000005516 engineering process Methods 0.000 claims abstract description 15
- 238000004519 manufacturing process Methods 0.000 claims abstract description 4
- 230000005055 memory storage Effects 0.000 claims abstract description 4
- 238000003860 storage Methods 0.000 claims description 13
- 238000009434 installation Methods 0.000 claims description 9
- 238000013515 script Methods 0.000 claims description 9
- 230000006399 behavior Effects 0.000 claims description 4
- 230000006855 networking Effects 0.000 claims description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005192 partition Methods 0.000 description 2
- 230000002688 persistence Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4406—Loading of operating system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a method for operating an etcd node by a memory, which relates to the technical field of operating systems, and is characterized in that an L inux system customization technology and a memory system mirror image manufacturing technology are adopted to deploy customization support to the etcd node, the loading of an etcd node mirror image is realized through a memory mirror image loading technology, the loading of a memory storage disk is realized through a memory disk loading technology, an etcd cluster is established through a Raft protocol, and the operating system of the etcd node cluster operated in the memory is realized.
Description
Technical field
The present invention relates to operation system technology field, specifically a kind of method of memory operation etcd nodes.
Background technology
Etcd is the key assignments storage system of a High Availabitity, is mainly used for configuration sharing and service discovery.Pass through Raft mono-
Cause property algorithm process daily record reproduction is to ensure strong consistency.Raft is suitable for the daily record reproduction of distributed system, passes through election
Mode realizes consistency.Container cluster management system Kubernetes, PaaS platform of the increasing income Cloud Foundry of Google
Etcd has been widely used with the Fleet of CoreOS.
Etcd is deployed on physical machine and operating system.Influence container application operation speed principal element be respectively
CPU, memory, hard disk, network and mirror image operation system, wherein hard disk speed is main bottleneck.
Invention content
The present invention is directed to the deficiency of existing method, provides a kind of method of memory operation etcd nodes, is realized by Raft
Cluster distributed storage information, makes the etcd on all nodes all run in memory, avoids disk read-write bottleneck, realizes cluster
The efficient storage of interior information and distribution.
Concrete scheme proposed by the present invention is：
A kind of method of memory operation etcd nodes, will using linux system custom technology and memory system mirror image manufacturing technology
It customizes and supports deployment etcd nodes；It is loaded by memory mirror, realizes load etcd node mirror images；It is loaded by ram disk,
Realize load memory storage disk；Etcd clusters are established by Raft agreements, realize the behaviour of the etcd node clusters run in memory
Make system.
Its specific implementation step is as follows：
S1：Establish Linux customizing operating systems；
S2：Compile etcd；
S3：Establish etcd memory system mirror images；
S4：The installation operation system in physical machine, including installation procedure and installation procedure execute step；
S5：Start internal memory operation system, the BootLoader loads kernel module, loading system software package；
S6：Start service and script, Configuration network loads etcd；
S7：Establish etcd clusters.
Wherein, Linux customizing operating systems are established to include compiling linux kernel file, establish (SuSE) Linux OS root text
Part system, compiling (SuSE) Linux OS system file and compiling Linux drive file.
Further, it includes kernel initialization load document, internal memory operation system image to establish etcd memory system mirror images
And initialization loading procedure.
Further, the internal memory operation system, etcd are run in memory completely.
Further, etcd networkings use Raft agreements in etcd clusters.
Structure internal memory operation system specific steps include：
S1：Establish workspace；
S2：Ram disk image file is established in workspace；
S3：Format image file；
S4：Establish root file system bibliographic structure；
S5：It compiles linux kernel and supports ram disk；
S6：Make root file system；
S7：Configuration initialization load；
S8：Etcd is installed；
S9：Check dependence；
S10：Prepare to start script；
S11：Generate system software package.
Etcd node systems load specific steps：
S1：Host power-up starts, and processor first searches BIOS in system storage, then BIOS detecting system resources are found
First guiding equipment, is set as hard disk here；
S2：Search the Master Boot Record of hard disk；
S3：BIOS is loaded into memory and gives MBR control；
S4：Master boot record the BootLoader, by boot program loads kernel module；
S5：Catalogue is mounted in ram disk by bootstrap in memory operating system, and the kernel module in specified physical disks
Position；
S6：Kernel is searched init programs and is executed；Init becomes the parent process of linux system from here on；
S7：Init reads system software package and unzips in ram disk；
S8：It is initialized according to/etc/inittab, the runtime class of our (SuSE) Linux OS is can determine whether by its init
Not；
S9：Init searches partition table information in file/etc/fstab and then does corresponding carry；In startup/etc/init.d
It includes network configuration that specified acquiescence, which starts all service/scripts of rank,；
S10：Load etcd.
Etcd is initialised by init, and etcd and finger daemon are all executed and managed by init, etcd pairs on backstage
The read-write of file carries out all in ram disk.Host disk can be mounted to memory disk operating system by way of mount
In, the data storage of persistence is provided for running container.It can also will be lasting by way of load networks storage driving
Change data to be stored in network storage service.
Compared with prior art, a kind of method of memory of the invention operation etcd nodes has beneficial effect following prominent
Fruit：
The present invention provides a kind of memory dispositions method of highly practical, efficient support etcd, this method is run in memory
Etcd node clusters operating system realize, cluster distributed storage information is realized by Raft, avoid single-unit point failure believe
Breath is lost；But also with the high speed characteristics of memory system, realize the efficient storage of information and distribution in cluster, be it is a kind of simple,
The method for efficiently promoting etcd cluster operational efficiency.
This method makes the etcd on all nodes all run in memory, so as to avoid the bottleneck of disk read-write, accelerates
The reading distribution of information is stored, while information caused by avoiding single point failure is lost.
This method realizes that full internal memory operation system, etcd are all run in memory, and network collection is established by Raft agreements
Group avoids the bottleneck of disk read-write, supports host or network storage perdurable data.
Description of the drawings
Fig. 1 is the system architecture diagram of memory operation etcd nodal methods of the present invention；
Fig. 2 is the schematic diagram that embodiment interior joint system read-write speed compares.
In Fig. 1,1, system framework, 2, host disk, 3, initialization service initrd, 4, system software package package,
5, perdurable data, 6, system initialization generate ram disk, 7, system initialization loading system file, 8, system operation frame,
9, ram disk, 10, operating system, 11, etcd, 12, host A, 13, host B, 14, host N, 15, Raft network clusters.
Specific implementation mode
The present invention provides a kind of method of memory operation etcd nodes：
A kind of method of memory operation etcd nodes, will using linux system custom technology and memory system mirror image manufacturing technology
It customizes and supports deployment etcd nodes；It is loaded into technology by memory mirror, realizes load etcd node mirror images；By ram disk plus
Load technology realizes load memory storage disk；Etcd clusters are established by Raft agreements；Realize the etcd sets of node run in memory
The operating system of group.
Its specific implementation step is as follows：
S1：Linux customizing operating systems are established, including compiles linux kernel file, establish (SuSE) Linux OS root file system
System, compiling (SuSE) Linux OS system file and compiling Linux drive file；
S2：Compile etcd；
S3：Etcd memory system mirror images are established, it includes kernel initialization load document, memory behaviour to establish etcd memory system mirror images
Make system image and initialization loading procedure；
S4：The installation operation system in physical machine, including installation procedure and installation procedure execute step；
S5：Start internal memory operation system, the BootLoader loads kernel module, loading system software package；
S6：Start service and script, Configuration network loads etcd；
S7：Establish etcd clusters.
The internal memory operation system, etcd are run in memory completely；Etcd networkings use Raft agreements.
Structure internal memory operation system specific steps include：
S1：Establish workspace；
S2：Ram disk image file is established in workspace；
S3：Format image file；
S4：Establish root file system bibliographic structure；
S5：It compiles linux kernel and supports ram disk；
S6：Make root file system；
S7：Configuration initialization load；
S8：Etcd is installed；
S9：Check dependence；
S10：Prepare to start script；
S11：Generate system software package.
The load of etcd node systems is as follows：Start when host powers up, processor can be first in system storage
BIOS is searched, then BIOS detecting system resources find first guiding equipment, are set as hard disk here；Then it can search hard
The Master Boot Record of disk；BIOS is loaded into memory and gives MBR control；Master boot record the BootLoader,
By boot program loads kernel module；Catalogue is mounted in ram disk by bootstrap in memory operating system, and specified object
Manage the kernel module position on disk；Kernel is searched init programs and is executed；Init becomes the father of linux system from here on
Process.
Init reads system software package and unzips in ram disk；Then basis/etc/inittab is initialized, and is led to
Cross the runlevel that its init can determine whether our (SuSE) Linux OS.
Init searches partition table information in file/etc/fstab and then does corresponding carry；Then init can start/
The acquiescence specified in etc/init.d starts all service/scripts of rank, including network configuration.
Etcd is initialised here by init, and etcd and finger daemon are all executed on backstage and managed by init,
Etcd carries out the read-write of file in ram disk.Host disk can be mounted to ram disk behaviour by way of mount
Make in system, the data storage of persistence is provided for running container.It can also be by way of load networks storage driving
Perdurable data is stored in network storage service.
As shown in Fig. 2, using the method for memory of the present invention operation etcd nodes, etcd memory nodes read and write speed at runtime
Degree is ten times or more of common SSD hard disks node.
The technical personnel in the technical field can readily realize the present invention with the above specific embodiments,.But it answers
Work as understanding, the present invention is not limited to above-mentioned specific implementation modes.On the basis of the disclosed embodiments, the technical field
Technical staff can arbitrarily combine different technical features, to realize different technical solutions.
It is the known technology of those skilled in the art in addition to the technical characteristic described in specification.
Claims (8)
1. a kind of method of memory operation etcd nodes, it is characterised in that use linux system custom technology and memory system mirror
Deployment etcd nodes are supported as manufacturing technology will customize；It is loaded by memory mirror, realizes load etcd node mirror images；Pass through
Ram disk loads, and realizes load memory storage disk；Etcd clusters are established by Raft agreements, realize the etcd sections run in memory
The operating system of point cluster.
2. a kind of method of memory operation etcd nodes according to claim 1, it is characterised in that its specific implementation step
It is as follows：
S1：Establish Linux customizing operating systems；
S2：Compile etcd；
S3：Establish etcd memory system mirror images；
S4：The installation operation system in physical machine, including installation procedure and installation procedure execute step；
S5：Start internal memory operation system, the BootLoader loads kernel module, loading system software package；
S6：Start service and script, Configuration network loads etcd；
S7：Establish etcd clusters.
3. a kind of method of memory operation etcd nodes according to claim 2, it is characterised in that establish Linux customization behaviour
Make system to include compiling linux kernel file, establish (SuSE) Linux OS root file system, compiling (SuSE) Linux OS system
File and compiling Linux drive file.
4. a kind of method of memory operation etcd nodes according to claim 2, it is characterised in that establish etcd memories system
System mirror image includes kernel initialization load document, internal memory operation system image and initialization loading procedure.
5. a kind of method of memory operation etcd nodes according to claim 2, it is characterised in that the internal memory operation system
System, etcd are run in memory completely.
6. a kind of method of memory operation etcd nodes according to claim 2, it is characterised in that etcd in etcd clusters
Networking uses Raft agreements.
7. a kind of method of memory operation etcd nodes according to claim 2 or 5, it is characterised in that structure internal memory operation
The specific steps of system include：
S1：Establish workspace；
S2：Ram disk image file is established in workspace；
S3：Format image file；
S4：Establish root file system bibliographic structure；
S5：It compiles linux kernel and supports ram disk；
S6：Make root file system；
S7：Configuration initialization load；
S8：Etcd is installed；
S9：Check dependence；
S10：Prepare to start script；
S11：Generate system software package.
8. a kind of method of memory operation etcd nodes according to claim 2, it is characterised in that etcd node systems add
Carrying specific steps includes：
S1：Host power-up starts, and processor first searches BIOS in system storage, then BIOS detecting system resources are found
First guiding equipment, is set as hard disk here；
S2：Search the Master Boot Record of hard disk；
S3：BIOS is loaded into memory and gives MBR control；
S4：Master boot record the BootLoader, by boot program loads kernel module；
S5：Catalogue is mounted in ram disk by bootstrap in memory operating system, and the kernel module in specified physical disks
Position；
S6：Kernel is searched init programs and is executed；
S7：Init reads system software package and unzips in ram disk；
S8：It is initialized according to/etc/inittab；
S9：The acquiescence specified in startup/etc/init.d starts all service/scripts and network configuration of rank；
S10：Load etcd.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810049200.4A CN108363589A (en) | 2018-01-18 | 2018-01-18 | Method for operating etcd node in memory |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810049200.4A CN108363589A (en) | 2018-01-18 | 2018-01-18 | Method for operating etcd node in memory |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108363589A true CN108363589A (en) | 2018-08-03 |
Family
ID=63006664
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810049200.4A Pending CN108363589A (en) | 2018-01-18 | 2018-01-18 | Method for operating etcd node in memory |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108363589A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109726211A (en) * | 2018-12-27 | 2019-05-07 | 无锡华云数据技术服务有限公司 | A kind of distribution time series database |
| CN113076149A (en) * | 2021-04-09 | 2021-07-06 | 北京明略昭辉科技有限公司 | Method and system for building computing cluster, computer equipment and storage medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391141A (en) * | 2017-07-26 | 2017-11-24 | 浪潮软件集团有限公司 | Full-memory operating system supporting container operation |
-
2018
- 2018-01-18 CN CN201810049200.4A patent/CN108363589A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107391141A (en) * | 2017-07-26 | 2017-11-24 | 浪潮软件集团有限公司 | Full-memory operating system supporting container operation |
Non-Patent Citations (1)
| Title |
|---|
| 杜军: "基于Kubernetes的云端资源调度器改进", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109726211A (en) * | 2018-12-27 | 2019-05-07 | 无锡华云数据技术服务有限公司 | A kind of distribution time series database |
| CN109726211B (en) * | 2018-12-27 | 2020-02-04 | 无锡华云数据技术服务有限公司 | Distributed time sequence database |
| CN113076149A (en) * | 2021-04-09 | 2021-07-06 | 北京明略昭辉科技有限公司 | Method and system for building computing cluster, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200310774A1 (en) | System and Method to Install Firmware Volumes from NVMe Boot Partition | |
| US8762999B2 (en) | Guest-initiated resource allocation request based on comparison of host hardware information and projected workload requirement | |
| CN104011677B (en) | Method and system for deployment of a software image on multiple targets with streaming technique | |
| US8863125B2 (en) | Optimization of virtual appliance deployment | |
| US8595723B2 (en) | Method and apparatus for configuring a hypervisor during a downtime state | |
| US11403146B2 (en) | Method, apparatus, and server for managing image across cloud servers | |
| US8695011B2 (en) | Mixed operating performance modes including a shared cache mode | |
| US9965288B2 (en) | Preconfiguring hardware and speeding up server discovery prior to bios boot | |
| US10474484B2 (en) | Offline management of virtualization software installed on a host computer | |
| US20130024857A1 (en) | Method and system for flexible resource mapping for virtual storage appliances | |
| CN108089913A (en) | A kind of virtual machine deployment method of super emerging system | |
| US20200379843A1 (en) | System and Method to Reduce Address Range Scrub Execution Time in Non-volatile Dual Inline Memory Modules | |
| CN111857840A (en) | BIOS starting method and device | |
| US7668938B1 (en) | Method and system for dynamically purposing a computing device | |
| CN108363589A (en) | Method for operating etcd node in memory | |
| Mavridis et al. | Lightweight virtualization approaches for software-defined systems and cloud computing: An evaluation of unikernels and containers | |
| CN117193936B (en) | Virtual machine management method, device and equipment under super fusion architecture | |
| US11221766B2 (en) | System and method for persistent memory rotation based on remaining write endurance | |
| US20200364040A1 (en) | System and Method for Restoring a Previously Functional Firmware Image on a Non-Volatile Dual Inline Memory Module | |
| CN116467043A (en) | K8s containerization differentiation-based automatic deployment method, device and medium | |
| CN111600753B (en) | Intelligent agent management system in cloud computing environment | |
| US11687356B2 (en) | Techniques for concurrently supporting virtual NUMA and CPU/memory hot-add in a virtual machine | |
| CN115408064A (en) | Method, server and related equipment for supporting kernel online update | |
| US11003778B2 (en) | System and method for storing operating life history on a non-volatile dual inline memory module | |
| US20210303332A1 (en) | Control device and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180803 |
|
| RJ01 | Rejection of invention patent application after publication |