CN117075817B - Data center virtualized storage optimization method, system, equipment and medium - Google Patents
Data center virtualized storage optimization method, system, equipment and medium Download PDFInfo
- Publication number
- CN117075817B CN117075817B CN202311118340.XA CN202311118340A CN117075817B CN 117075817 B CN117075817 B CN 117075817B CN 202311118340 A CN202311118340 A CN 202311118340A CN 117075817 B CN117075817 B CN 117075817B
- Authority
- CN
- China
- Prior art keywords
- computing node
- position information
- data center
- ipxe
- physical position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000005457 optimization Methods 0.000 title claims abstract description 31
- 238000013507 mapping Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 13
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 239000000758 substrate Substances 0.000 claims description 2
- 238000009434 installation Methods 0.000 claims 1
- 238000007726 management method Methods 0.000 abstract description 24
- 238000013500 data storage Methods 0.000 abstract description 8
- 230000006870 function Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 3
- 108010028984 3-isopropylmalate dehydratase Proteins 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0625—Power saving in storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4403—Processor initialisation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Stored Programmes (AREA)
Abstract
The invention provides a data center virtualized storage optimization method, a system, equipment and a medium, wherein the method comprises the following steps: after the computing nodes of each data center acquire physical position information from the storage pool manager through the baseboard management controller, starting the basic input/output system, storing the physical position information acquired from the baseboard management controller into the SMBIOS data structure table through the basic input/output system, after corresponding guidance is completed, running IPXE a bootstrap program to interact with the DHCP server to complete IP configuration, generating a protocol address request according to the acquired physical position information and sending the protocol address request to the DHCP server, and installing a corresponding operating system mirror file according to the received logical volume address to execute operating system bootstrap operation until the starting is completed. The invention can not only greatly reduce the hard disk consumption and the power consumption of the computing node deployment, but also ensure the safety and the reliability of data storage, and can also promote the maintainability and the expandability of the system.
Description
Technical Field
The present invention relates to the field of data storage optimization technologies, and in particular, to a data center virtualized storage optimization method, system, computer device, and storage medium based on shared guidance.
Background
The data center is composed of a huge number of computing nodes, each computing node can be understood as a system composed of a CPU and a Memory, and the image file size of each operating system is different from hundreds of megabytes to tens of G (gigabytes), so that a great deal of storage resources are consumed as storage media of the corresponding operating system.
Existing data center deployment schemes typically provide storage support by configuring each compute node with either a SATA hard disk or an SD card of m.2. However, the deployment of a large number of computing nodes by adopting the scheme not only needs to consume excessive hard disk resources, but also needs to consume a large amount of power resources, and the security and reliability of data storage cannot be ensured.
Disclosure of Invention
The invention aims to provide a virtualized storage optimization method of a data center, which is characterized in that physical position information of computing nodes is introduced and stored in a storage pool manager of the whole data center, and an operating system mirror image file required for starting is distributed for each computing node in a disk array according to logical volume address storage corresponding to the physical position information, so that remote IPXE (Intelligence Preboot eXecutionEnvironment) sharing guidance (shareboot) starting of the computing nodes is supported, the application defect of a computing node deployment scheme of the existing data center is overcome, the hard disk consumption and the power consumption of computing node deployment are greatly reduced, the safety and the reliability of data storage are ensured, and the maintainability and the expandability of a system are improved.
In order to achieve the above objective, it is necessary to provide a data center virtualized storage optimization method, system, device and medium for solving the above technical problems.
In a first aspect, an embodiment of the present invention provides a data center virtualized storage optimization method, applied to a computing node of a data center, the method including the steps of:
After the substrate management controller of the computing node obtains the pre-stored physical position information from the storage pool manager, starting a basic input/output system corresponding to the computing node;
Acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input output system of the computing node, and running IPXE bootstrap programs of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input output system of the computing node is booted;
Responding to IPXE bootstrap program of the computing node to interact with a DHCP server to complete IP configuration, acquiring corresponding physical position information through IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logical volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and mounting a corresponding operating system image file according to the logical volume address by using a IPXE bootstrap program of the computing node, and executing operating system bootstrap operation by using the operating system image file after mounting is completed until starting is completed.
Further, the physical location information is generated in advance according to the computing node deployment requirements of the data center and stored in the storage pool manager.
Further, the logical volume addresses are obtained by dividing the logical volumes of a preset data center disk array in advance according to the total number of the computing nodes; and the mapping relation between the physical position information and the logical volume address is stored in the DHCP server.
Further, an operating system image is pre-installed on any one of the logical volumes of the data center disk array, and image snapshots created according to the operating system image are stored in other logical volumes.
Further, the step of acquiring corresponding physical location information by the IPXE bootstrap of the computing node includes:
scanning a memory space with a preset size through IPXE bootstrap program of the computing node to obtain the memory position of the SMBIOS data structure table;
and acquiring corresponding physical position information stored in the SMBIOS data structure table according to the memory position of the SMBIOS data structure table.
Further, the step of generating a protocol address request according to the physical location information comprises:
and setting a request option field in a request message as preset request content through IPXE guide program of the computing node, packaging the physical position information into a corresponding sub-option field, and generating the protocol address request.
Further, the logical volume address responded by the DHCP server analyzes the protocol address request through the DHCP server, and when the analyzed request option field is the preset request content, the logical volume address is obtained according to the physical position information in the corresponding sub-option field.
In a second aspect, an embodiment of the present invention provides a data center virtualized storage optimization system applied to a computing node of a data center, the system comprising:
The physical information acquisition module is used for starting a basic input/output system corresponding to the computing node after acquiring the pre-stored physical position information from the storage pool manager through the baseboard management controller of the computing node;
The physical information storage module is used for acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input/output system of the computing node, and running IPXE bootstrap programs of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input/output system of the computing node is booted;
The logic address acquisition module is used for responding to the IPXE bootstrap program of the computing node to interact with the DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logic volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
And the mirror image mounting module is used for mounting the corresponding operating system mirror image file according to the logical volume address through the IPXE bootstrap program of the computing node, and executing the operating system bootstrap operation through the operating system mirror image file after the mounting is completed until the starting is completed.
In a third aspect, embodiments of the present invention further provide a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.
In a fourth aspect, embodiments of the present invention also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the above method.
The application provides a data center virtualized storage optimization method, a system, equipment and a medium, through the method, after each computing node obtains pre-stored physical position information from a storage pool manager through a baseboard management controller, a basic input output system corresponding to the computing node is started, corresponding physical position information is obtained from the baseboard management controller through the basic input output system and is stored in a corresponding SMBIOS data structure table, after the basic input output system is guided, IPXE bootstrap program of the computing node is operated, after IP configuration is completed through IPXE bootstrap program and a DHCP server, corresponding physical position information is obtained through IPXE bootstrap program, a protocol address request generated according to the physical position information is sent to the DHCP server, after a logical volume address of an operating system mirror file with an ISCSI protocol is stored in response of the DHCP server is received, a corresponding operating system mirror file is mounted according to the logical volume address, and operating system bootstrap operation is executed through the operating system mirror file until a shared bootstrap technical scheme is started. Compared with the prior art, the method can greatly reduce the hard disk consumption and the power consumption of the computing node deployment, ensure the safety and the reliability of data storage, and improve the maintainability and the expandability of the system.
Drawings
FIG. 1 is a flow chart of a data center virtualized storage optimization method based on shared boot in an embodiment of the invention;
FIG. 2 is another flow diagram of a data center virtualized storage optimization method based on shared boot in an embodiment of the invention;
FIG. 3 is a schematic diagram of a data center virtualized storage optimization system based on shared boot in an embodiment of the invention;
fig. 4 is an internal structural view of a computer device in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantageous effects of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples, and it is apparent that the examples described below are part of the examples of the present application, which are provided for illustration only and are not intended to limit the scope of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The data center virtualization storage optimization method based on shared guidance is based on the application situation that each data center uses a plurality of RACKs, each RACK is composed of a plurality of groups of channels (2U server nodes), each channel is composed of a plurality of computing nodes, each computing node needs to be deployed with one OS (operating system), the image file size of each OS is different, if the existing computing node storage resource allocation method is adopted, the deployment of massive computing nodes consumes excessive hard disk resources and power resources, and the LUN (Logic unit number) address of ISCSI (INTERNET SMALL Computer SYSTEM INTERFACE) protocol in a disk array is allocated to each computing node by introducing the physical position information of the computing nodes so as to support remote IPXE shared guidance starting, and the shared guidance-based data center virtualization storage optimization scheme based on shared guidance is effectively reduced in hard disk resources and power resources consumption. The following examples will describe the data center virtualized storage optimization method of the present invention in detail.
In one embodiment, as shown in fig. 1, there is provided a data center virtualized storage optimization method applied to a computing node of a data center, including the steps of:
S11, after a baseboard management controller of a computing node obtains pre-stored physical position information from a storage pool manager, starting a basic input/output system corresponding to the computing node; wherein, the baseboard management controller (Board management controller, BMC) is deployed on each computing node to realize firmware upgrade, remote operation and the like of the computing nodes; a storage pool manager (POD manager) may be understood as a global storage resource manager of a data center, and may also provide DHCP services of the data center by integrating DHCP (Dynamic Host Configuration Protocol) server functions in order to save server resources; the Basic input/output system is a BIOS (Basic input/output system) system, and specific functions thereof are not described herein.
The above physical location information may be understood as information corresponding to the computing nodes, which may embody the physical location of each computing node, in practical application, the cabinet, the server node and the corresponding computing nodes to be used are determined in advance according to the deployment requirement of the data center, and the corresponding physical location information is generated according to the determined cabinet number, the server node number, the node number and other physical information of each computing node, and in order to facilitate unified storage and flexible maintenance of the physical location information of all computing nodes, the physical location information of all computing nodes is uniformly stored into a location information table, where the format of the location information table is not limited and may be stored in the form of an excel table; in order to facilitate unified and secure management of physical location information of all computing nodes by a data center, efficient inquiry is provided for starting each BMC, and further reliable guarantee is provided for reasonably distributing corresponding logical volume addresses according to the physical location information, in the embodiment, when a storage pool manager starts to operate, a location information table storing the physical location information of the computing nodes is preferably loaded into a corresponding memory for inquiry use when the BMC starts; specifically, the physical location information is generated in advance according to the deployment requirement of the computing nodes of the data center and is stored in the storage pool manager; namely, the step of storing the physical location information in advance includes:
generating corresponding physical position information for each computing node according to the computing node deployment requirements of the data center, and storing the physical position information of all the computing nodes in the storage pool manager; the specific content format of the physical location information can be set in a self-defined manner according to the actual application requirements, and is not particularly limited herein; for example, the physical location information of the computing node No. 0 of the server node No. 0 in the No. 0 cabinet may be set as: RACK 0/CHASSIS/NODE 0.
In this embodiment, the computing node needs to start the BMC through IPXE shared boot, and the BMC communicates with the storage pool manager to obtain physical location information (Geography ID, abbreviated as GID) of the computing node, so as to support the location information transfer between the BMC and a Basic input/output system (BIOS) and a shared boot program IPXE (Intelligence Preboot eXecutionEnvironment), so as to provide reliable technical support for implementing storage resource sharing and remote shared boot starting of the computing node based on the physical location information; it should be noted that, the BMC obtains the corresponding physical location information from the POD manager through the OEM command of the IPMI.
In addition, in consideration of meeting the requirement of saving disk resources, improving the data read-write efficiency, storage safety and reliability of the computing nodes, in the embodiment, preferably, a disk array (Just bunch of Disk, JBOD) is deployed in a data center to uniformly provide shared disk space for each computing node, and logical volume addresses are mapped according to physical location information, so that reasonable allocation of disk space based on the physical location information is realized, and data storage management, redundancy backup and error recovery are facilitated; specifically, the logical volume addresses are obtained by dividing logical volumes of a preset data center disk array in advance according to the total number of computing nodes; the mapping relation between the physical position information and the logical volume address is stored in a DHCP server; that is, the computing nodes of the data center are started up, and the following steps are also required:
Carrying out logic volume division on a preset data center disk array according to the total number of the computing nodes to obtain logic volume addresses corresponding to all the computing nodes, and storing the mapping relation between the physical position information of all the computing nodes and the logic volume addresses in a DHCP server; the method comprises the steps that the total number of computing nodes is determined according to the deployment requirement of a data center, a plurality of logic volumes are created on a disk array JBOD (just a BOD) by using targetcli partitioning tools based on the total number of the computing nodes, each logic volume has a LUN address (the logic volume address of ISCSI), each logic volume provides storage service for a corresponding computing node through a preset mapping relation, and the obtained logic volume addresses which can be accessed through an ISCSI protocol have a preset one-to-one correspondence relation with physical position information; in order to facilitate unified storage and flexible management of the mapping relationship between the logical volume address and the physical location information, and provide basic support for subsequent use IPXE of remote sharing boot, in this embodiment, preferably, the mapping relationship between the physical location information and the logical volume address is stored and maintained in a mapping relationship table (for example, EXCEl table maintenance is adopted), and when the DHCP server is started, the mapping relationship table is loaded into the memory, so that subsequent execution IPXE of remote sharing boot is facilitated to allocate accurate through logical volume addresses (ISCSI-LUNs) for each computing node;
It should be noted that, each logical volume created on the disk array has a function of providing a transparent disk access to the upper layer application, and each logical volume can also provide redundancy backup and security monitoring for the data storage object by deploying ceph management software, so that any disk fault can be replaced and deleted seamlessly, thereby greatly improving the maintainability of the system; at the same time, each logical volume on the disk array can also provide high availability, high performance, low cost cluster services through LVS (Linux VirtualServer) cluster software.
In addition, in order to further reduce the occupation of the actual hard disk resources in the disk array, in this embodiment, preferably, after the required number of logical volumes are created on the disk array, the storage occupation of the actual disk space is saved by storing only the OS image on one logical volume and storing only the snapshot of the OS image on the other logical volumes; specifically, an operating system image is pre-installed on any one logical volume of the data center disk array, and image snapshots created according to the operating system image are stored in other logical volumes, that is, the method further includes the following steps:
An operating system image is pre-installed on any logic volume of the disk array, and an image snapshot created according to the operating system image is copied to other logic volumes; the specific type of the operating system image and the specific mode of generating the image snapshot can be selected according to the actual application requirements, and are not particularly limited herein; in practical application, if the sizes of the logical volumes are the same, any one logical volume can be used as a master disk for installing and deploying the OS image, and after image snapshots meeting the use number of all other logical volumes are created on the master disk, each image snapshot is respectively copied into a corresponding logical volume address so as to facilitate subsequent remote sharing and guiding use; meanwhile, when the logical volumes are divided, a certain logical volume is divided into larger spaces and is specially used for installing the OS mirror images, and other logical volumes are divided into the OS mirror images according to the smaller spaces and are used for storing the OS mirror images, so that the OS mirror images and each mirror image snapshot (snapshot) have ISCSI addresses corresponding to the physical position information of each calculation stage, the ISCSI addresses are the logical volume addresses stored in a mapping relation table on a DHCP server in advance, and the required mirror image file mounting addresses can be provided when each calculation node applies for boot starting in a IPXE mode; for example, the size of the logical volume is not particularly limited, and the first logical volume is allocated 4G of space, the other logical volumes are allocated 512M of space, and the like.
The physical location information configuration, logical volume address allocation, mapping relation table generation and the like of each computing node corresponding to the above embodiment belong to the system configuration preparation work according to the computing node deployment requirement of the data center, that is, after the physical location information loading of the storage pool manager, the mapping relation loading of the physical location information and the logical volume address by the DHCP server and the like are completed, the boot process of starting the computing node can be formally started after the BMCs of each computing node are started to acquire the corresponding physical location information in the storage pool manager.
S12, acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input output system of the computing node, and operating IPXE bootstrap programs of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input output system of the computing node is booted; the method for acquiring the corresponding physical location information from the baseboard management controller by the basic input output system may also be implemented by invoking an OEM command of IPMI, which is not described herein again;
The SMBIOS (SYSTEM MANAGEMENT BIOS) data structure table is understood to be a data table of a system management basic input/output system, and is generally stored in a region within 1M of a memory address; in order to realize reliable transfer of physical location information of a computing node between a BIOS and IPXE bootstrap program, and further provide effective guarantee for a subsequent IPXE bootstrap program to acquire a logical volume address of a required mounting mirror image file based on interaction of the physical location information and a DHCP, in this embodiment, optionally, a manner of adding a corresponding physical location information storage table entry at a preset location of an SMBIOS data structure table by the BIOS is adopted, so as to realize sharing of physical location information data; it should be noted that, the preset position of the specific storage physical location information storage table entry may be configured according to the actual application requirement, and only needs to satisfy the condition that does not affect the normal BIOS system boot flow, for example, may be stored at the rearmost side of the SMBIOS data structure table, which is not limited herein specifically.
S13, responding to the IPXE bootstrap program of the computing node to interact with a DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logical volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol; the DHCP server has a normal IP configuration function, and integrates a function of supporting IPXE shared boot initiation, and may be deployed on a server device that specifically provides a DHCP service function, or may be deployed on the foregoing storage pool manager, which is not specifically limited herein.
In this embodiment, the support IPXE of the shared boot flow is implemented by matching physical location information in the SMBIOS data structure table with a mapping relationship table pre-stored in the DHCP server, which can be understood that after the boot of the BIOS system is completed and the boot control authority is given to the IPXE boot program, the IPXE boot program discovers a packet to the DHCP server according to normal broadcasting DHCP, and the DHCP server allocates an effective IP address to the IP configuration of the computing node, where the IP configuration flow is implemented by referring to the prior art and is not repeated herein; after the computing node completes IP address configuration through IPXE bootstrap program, the physical position information of the computing node needs to be acquired, and then the physical position information of the computing node is sent to a DHCP server to acquire a corresponding logical volume address; specifically, the step of acquiring, by the IPXE bootstrap of the computing node, the corresponding physical location information includes:
Scanning a memory space with a preset size through IPXE bootstrap program of the computing node to obtain the memory position of the SMBIOS data structure table; the memory space with the preset size can be set according to the storage position of the SMBIOS data structure table and the actual application requirement, for example, in the case that the SMBIOS data structure table is stored in the 1M memory, the preset size can be set to be 1M or a value slightly larger than 1M; the address of an SMBIOS table is determined by scanning the character string of SM32, if the character string is found, the data in the table is read out, and then a table item with physical position information (GID) is found in the table, namely the physical position information of the computing node itself which needs to be acquired;
acquiring corresponding physical position information stored in the SMBIOS data structure table according to the memory position of the SMBIOS data structure table; the memory location is the positioning information of the SMBIOS data structure table, and after the accurate location information of the SMBIOS data structure table is obtained, the required data information can be extracted according to the preset location of the physical location information stored in the table;
In this embodiment, by using the SMBIOS data structure table as a storage location of physical location information, not only can security and reliability of the physical location information be ensured, but also efficient and reliable data sharing between the BIOS and IPXE boot program can be realized.
In practical application, a large number of computing nodes are used as IPXE clients to request the image file address from the DHCP server in the same local area network, and in order to ensure the high efficiency and accuracy of the processing request of the DHCP server, in this embodiment, preferably, a IPXE bootstrap program of the computing node packages and generates a request message according to the acquired physical location information of the computing node to send a corresponding protocol address request to the DHCP server, that is, a custom option field of the DHCP sending request in the existing DHCP 4-stage discovery protocol flow needs to be reasonably set so as to ensure that each computing node can accurately acquire the corresponding mount image address without affecting the normal IP configuration flow; specifically, the step of generating a protocol address request according to the physical location information includes:
Setting a request option field in a request message as preset request content through IPXE bootstrap program of the computing node, and packing the physical position information into a corresponding sub-option field to generate the protocol address request; the request option field may use a custom field specified by the DHCP protocol, so long as the request option field does not conflict with a defined general option field, for example, the physical location information for allocating the logical volume address may be transferred by using the option 100 preset at the computing node and the DHCP server; it should be noted that, the preset request content used in the request option field in the protocol address request may also be determined according to specific use requirements, for example, set to "iscsi-lun" or "disk space", and only the DHCP server needs to be able to recognize and perceive the specific meaning of the setting content of the field;
Correspondingly, as described above, in order to ensure the high efficiency and reliability of the DHCP service, the DHCP server needs to cooperate with the setting mode of the computing node about the request option field to determine the data object requested by the computing node and provide the matched data object for the computing node by analyzing the protocol address request; specifically, the logical volume address responded by the DHCP server analyzes the protocol address request through the DHCP server, and obtains the physical location information in the corresponding sub-option field when the request option field obtained by analysis is the preset request content; that is, after the step of transmitting the protocol address request generated according to the physical location information to the DHCP server, it further includes:
The DHCP server receives and analyzes the protocol address request, and when the analyzed request option field is the preset request content, the DHCP server acquires the corresponding logical volume address according to the physical position information in the corresponding sub-option field; the method for obtaining the logical volume address can be understood as traversing an address relation mapping table pre-stored in the physical location information according to the physical location information, and finding the logical volume address corresponding to the physical location information in the table to obtain an ISCSI protocol address (Uniform Resource Locator, URL) which needs the DHCP server to send to the computing node through a corresponding response message; for example, the DHCP server receives the RACK 0/CHASSIS/NODE 0 as the physical location information of the computing NODE, and the logical volume address corresponding to the physical location information in the mapping relationship table stored in the DHCP server is: after resolving the physical position information, the DHCP server checks the address relation mapping table of the physical position information, and returns an iscsi 10.10.10:snapshot10 address to IPXE bootstrap program of the computing node according to the table lookup matching result; it should be noted that, the logical volumes directly installed with the OS image may also be mapped to a certain computing node for use, and the corresponding logical volume addresses may be given in a similar form of iscsi: x.x.x: OSimage.
S14, mounting a corresponding operating system image file according to the logical volume address through IPXE bootstrap program of the computing node, and executing operating system bootstrap operation through the operating system image file after mounting is completed until starting is completed; wherein, the logical volume address includes the mirror name or the mirror snapshot name as described above, and after the IPXE bootstrap program receives the corresponding logical volume address, the mount command provided by IPXE may be directly used to mount the OS mirror file located on the remote disk array: if the logical volume address stores the OS mirror image, the mirror image file is directly mounted; if the logical volume address stores the mirror snapshot, directly mounting the mirror snapshot; after IPXE bootstrap program of the computing node completes the mounting task of the OS image or the image snapshot, the bootstrap control right can be given to the image file of the OS, and then the operating system is booted like the local bootstrap OS, wherein the specific booting method of the operating system is realized by referring to the prior art and is not repeated herein;
In practical application, the size of the mirror image snapshot is much smaller than that of the mirror image file of the operating system, and the method and the device for realizing remote loading and guiding of the operating system by providing the mirror image snapshot for the computing nodes are adopted in the embodiment, compared with the traditional scheme of realizing system guiding by completely adopting the OS mirror image, the method and the device for realizing remote loading and guiding of the operating system by installing a large amount of OS mirror images can effectively avoid disk consumption caused by installing a large amount of OS mirror images, greatly save disk space, save power consumption of the whole system, flexibly cooperate with the augmentation of the computing nodes in a mode of increasing the number of the mirror image snapshot, and provide reliable guarantee for flexible expansion and deployment of a subsequent data center.
After each computing node provided in the embodiment of the application obtains the pre-stored physical location information from the storage pool manager through the baseboard management controller, the basic input output system corresponding to the computing node is started, the corresponding physical location information is obtained from the baseboard management controller through the basic input output system and stored in the corresponding SMBIOS data structure table, after the basic input output system is guided, IPXE guiding programs of the computing node are operated, after the IPXE guiding programs and the DHCP server are interacted to complete IP configuration, the corresponding physical location information is obtained through the IPXE guiding programs, a protocol address request generated according to the physical location information is sent to the DHCP server, after receiving a logical volume address of the operating system image file with ISCSI protocol which is responded by the DHCP server according to the protocol address request, the corresponding operating system image file is mounted according to the logical volume address, and executing operating system boot operation through operating system image files until the boot is completed IPXE sharing boot method, realizing that physical location information of the introduced computing nodes is stored in a storage pool manager of the whole data center as shown in fig. 2, and distributing logical volume addresses corresponding to the physical location information for each computing node in a disk array to store a data center virtualized storage optimization scheme of operating system image snapshots required by the boot of the computing nodes, not only providing a safe and reliable storage system comprising a backup mechanism and an error recovery mechanism through the combined use of ceph management software and LVS technology, so that any disk failures can be replaced and deleted seamlessly, greatly improving the maintainability of the system, but also greatly reducing the utilization rate of hard disks and the power consumption of the whole data center through a mechanism of creating image snapshots for the computing nodes, the method can also provide reliable technical support for flexible expansion of the data center and deployment of any other virtualized cloud service, and has high expandability.
Although the steps in the flowcharts described above are shown in order as indicated by arrows, these steps are not necessarily executed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders.
In one embodiment, as shown in FIG. 3, a data center virtualized storage optimization system is provided for use with computing nodes of a data center, the system comprising:
The physical information acquisition module 1 is used for starting a basic input/output system corresponding to a computing node after acquiring pre-stored physical position information from a storage pool manager through a baseboard management controller of the computing node;
The physical information storage module 2 is configured to obtain corresponding physical location information from a baseboard management controller of the computing node through a basic input/output system of the computing node, and operate IPXE boot procedures of the computing node after the physical location information is stored in a corresponding SMBIOS data structure table and the basic input/output system of the computing node is booted;
The logic address acquisition module 3 is used for responding to the IPXE bootstrap program of the computing node to interact with the DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logic volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and the mirror image mounting module 4 is used for mounting the corresponding operating system mirror image file according to the logical volume address through the IPXE bootstrap program of the computing node, and executing the operating system bootstrap operation through the operating system mirror image file after the mounting is completed until the starting is completed.
For specific limitation of a data center virtualized storage optimization system, reference may be made to the limitation of a data center virtualized storage optimization method, and corresponding technical effects may be equally obtained, which is not described herein. The modules in the data center virtualized storage optimization system can be implemented in whole or in part by software, hardware and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
Fig. 4 shows an internal structural diagram of a computer device, which may be a terminal or a server in particular, in one embodiment. As shown in fig. 4, the computer device includes a processor, a memory, a network interface, a display, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements a data center virtualized storage optimization method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those of ordinary skill in the art that the architecture shown in fig. 4 is merely a block diagram of some of the structures associated with the present inventive arrangements and is not limiting of the computer device to which the present inventive arrangements may be implemented, and that a particular computing device may include more or less components than those shown, or may be combined with some of the components, or have the same arrangement of components.
In one embodiment, a computer device is provided comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the above method when the computer program is executed.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, implements the steps of the above method.
In summary, the data center virtualized storage optimization method of the embodiment of the invention realizes that after each computing node of the data center obtains pre-stored physical position information from a storage pool manager through a baseboard management controller, a basic input output system corresponding to the computing node is started, corresponding physical position information is obtained from the baseboard management controller through the basic input output system and is stored in a corresponding SMBIOS data structure table, after the basic input output system is guided, a IPXE guiding program of the computing node is operated, after the IPXE guiding program and a DHCP server are interacted to complete IP configuration, corresponding physical position information is obtained through a IPXE guiding program, a protocol address request generated according to the physical position information is sent to the DHCP server, and receiving the logical volume address of the operating system mirror image file with ISCSI protocol, which is responded by the DHCP server according to the protocol address request, mounting the corresponding operating system mirror image file according to the logical volume address, and executing the operating system guiding operation through the operating system mirror image file until the starting is completed, wherein the method saves the physical position information of the computing nodes in a storage pool manager of the whole data center through introducing the physical position information, distributes the logical volume address corresponding to the physical position information for each computing node in a disk array to store the data center virtualized storage optimization scheme of the operating system mirror image snapshot required by the starting of the computing node guiding, provides a safe and reliable storage system comprising a backup mechanism and an error recovery mechanism through the combination of ceph management software and LVS technology, enables any disk faults to be replaced and deleted seamlessly, greatly improves the maintainability of the system, the system has the advantages that the utilization rate of the hard disk is greatly reduced, the power consumption of the whole data center is reduced, the flexible expansion of the data center and the deployment of any virtualized cloud service are provided with reliable technical support, the system has high expandability, namely, the hard disk consumption and the power consumption of the computing node deployment can be greatly reduced, the safety and the reliability of data storage can be ensured, and the maintainability and the expandability of the system can be improved.
In this specification, each embodiment is described in a progressive manner, and all the embodiments are directly the same or similar parts referring to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments. It should be noted that, any combination of the technical features of the foregoing embodiments may be used, and for brevity, all of the possible combinations of the technical features of the foregoing embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples represent only a few preferred embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the application. It should be noted that modifications and substitutions can be made by those skilled in the art without departing from the technical principles of the present application, and such modifications and substitutions should also be considered to be within the scope of the present application. Therefore, the protection scope of the patent of the application is subject to the protection scope of the claims.
Claims (9)
1. A method of data center virtualized storage optimization, applied to a compute node of a data center, the method comprising the steps of:
After the substrate management controller of the computing node obtains the pre-stored physical position information from the storage pool manager, starting a basic input/output system corresponding to the computing node; the physical location information comprises a cabinet number, a server node number and a computing node number;
Acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input output system of the computing node, and running IPXE bootstrap programs of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input output system of the computing node is booted;
Responding to IPXE bootstrap program of the computing node to interact with a DHCP server to complete IP configuration, acquiring corresponding physical position information through IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logical volume address responded by the DHCP server according to the content of the protocol address request; the logical volume address stores an operating system image file with an ISCSI protocol; the mapping relation between the physical position information and the logical volume address is stored in a DHCP server;
Installing a corresponding operating system image file according to the logical volume address by using IPXE bootstrap program of the computing node, and executing operating system bootstrap operation by using the operating system image file after the installation is completed until the starting is completed;
wherein the step of generating a protocol address request from the physical location information comprises:
and setting a request option field in a request message as preset request content through IPXE guide program of the computing node, packaging the physical position information into a corresponding sub-option field, and generating the protocol address request.
2. The data center virtualized storage optimization method of claim 1, wherein the physical location information is generated by pre-fetching computing node deployment requirements of the data center and stored in the storage pool manager.
3. The method for optimizing virtualized storage of a data center according to claim 2, wherein the logical volume addresses are obtained by performing logical volume division on a preset data center disk array in advance according to the total number of computing nodes.
4. The data center virtualized storage optimization method of claim 3 wherein an operating system image is pre-installed on any logical volume of the data center disk array and wherein other logical volumes store image snapshots created from the operating system image.
5. The data center virtualized storage optimization method of claim 1, wherein the step of obtaining corresponding physical location information by a IPXE bootstrap of the computing node comprises:
scanning a memory space with a preset size through IPXE bootstrap program of the computing node to obtain the memory position of the SMBIOS data structure table;
and acquiring corresponding physical position information stored in the SMBIOS data structure table according to the memory position of the SMBIOS data structure table.
6. The virtualized storage optimization method of data center of claim 1, wherein the logical volume address responded by the DHCP server analyzes the protocol address request through the DHCP server, and obtains according to the physical location information in the corresponding sub-option field when the analyzed request option field is the preset request content.
7. A data center virtualized storage optimization system applied to a compute node of a data center, the system comprising:
The physical information acquisition module is used for starting a basic input/output system corresponding to the computing node after acquiring the pre-stored physical position information from the storage pool manager through the baseboard management controller of the computing node; the physical location information comprises a cabinet number, a server node number and a computing node number;
The physical information storage module is used for acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input/output system of the computing node, and running IPXE bootstrap programs of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input/output system of the computing node is booted;
the logic address acquisition module is used for responding to the IPXE bootstrap program of the computing node to interact with the DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logic volume address responded by the DHCP server according to the protocol address request content; the logical volume address stores an operating system image file with an ISCSI protocol; the mapping relation between the physical position information and the logical volume address is stored in a DHCP server;
The mirror image mounting module is used for mounting a corresponding operating system mirror image file according to the logical volume address through a IPXE bootstrap program of the computing node, and executing operating system bootstrap operation through the operating system mirror image file after the mounting is completed until the starting is completed;
wherein generating a protocol address request according to the physical location information comprises:
and setting a request option field in a request message as preset request content through IPXE guide program of the computing node, packaging the physical position information into a corresponding sub-option field, and generating the protocol address request.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311118340.XA CN117075817B (en) | 2023-08-31 | 2023-08-31 | Data center virtualized storage optimization method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311118340.XA CN117075817B (en) | 2023-08-31 | 2023-08-31 | Data center virtualized storage optimization method, system, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117075817A CN117075817A (en) | 2023-11-17 |
| CN117075817B true CN117075817B (en) | 2024-05-07 |
Family
ID=88707895
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311118340.XA Active CN117075817B (en) | 2023-08-31 | 2023-08-31 | Data center virtualized storage optimization method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117075817B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6883083B1 (en) * | 2002-12-20 | 2005-04-19 | Veritas Operating Corporation | System and method for maintaining and accessing information regarding virtual storage devices |
| JP2009176213A (en) * | 2008-01-28 | 2009-08-06 | Hitachi Software Eng Co Ltd | Network boot system |
| CN105335168A (en) * | 2014-05-27 | 2016-02-17 | 阿里巴巴集团控股有限公司 | System, method and apparatus for remotely configuring operating system |
| CN105721534A (en) * | 2014-12-17 | 2016-06-29 | 广达电脑股份有限公司 | System and method for network-based iscsi boot parameter deployment |
| CN109951325A (en) * | 2019-02-28 | 2019-06-28 | 华为技术有限公司 | A kind of network cable connection inspection method and device |
| CN110740609A (en) * | 2019-10-25 | 2020-01-31 | 上海中通吉网络技术有限公司 | Server information processing method and device for internet data center and controller |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002259062A (en) * | 2001-02-28 | 2002-09-13 | Hitachi Ltd | Storage device system and data copying method for data for the same |
| US10516760B2 (en) * | 2017-03-17 | 2019-12-24 | Verizon Patent And Licensing Inc. | Automatic bootstrapping and dynamic configuration of data center nodes |
| US11150845B2 (en) * | 2019-11-01 | 2021-10-19 | EMC IP Holding Company LLC | Methods and systems for servicing data requests in a multi-node system |
-
2023
- 2023-08-31 CN CN202311118340.XA patent/CN117075817B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6883083B1 (en) * | 2002-12-20 | 2005-04-19 | Veritas Operating Corporation | System and method for maintaining and accessing information regarding virtual storage devices |
| JP2009176213A (en) * | 2008-01-28 | 2009-08-06 | Hitachi Software Eng Co Ltd | Network boot system |
| CN105335168A (en) * | 2014-05-27 | 2016-02-17 | 阿里巴巴集团控股有限公司 | System, method and apparatus for remotely configuring operating system |
| CN105721534A (en) * | 2014-12-17 | 2016-06-29 | 广达电脑股份有限公司 | System and method for network-based iscsi boot parameter deployment |
| CN109951325A (en) * | 2019-02-28 | 2019-06-28 | 华为技术有限公司 | A kind of network cable connection inspection method and device |
| CN110740609A (en) * | 2019-10-25 | 2020-01-31 | 上海中通吉网络技术有限公司 | Server information processing method and device for internet data center and controller |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117075817A (en) | 2023-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7624262B2 (en) | Apparatus, system, and method for booting using an external disk through a virtual SCSI connection | |
| US7653794B2 (en) | Converting physical machines to virtual machines | |
| US7725559B2 (en) | Virtual data center that allocates and manages system resources across multiple nodes | |
| US7043604B2 (en) | Disk array system | |
| US8677111B2 (en) | Booting devices using virtual storage arrays over wide-area networks | |
| US20190334765A1 (en) | Apparatuses and methods for site configuration management | |
| US20120198076A1 (en) | Migrating Logical Partitions | |
| US20070061441A1 (en) | Para-virtualized computer system with I/0 server partitions that map physical host hardware for access by guest partitions | |
| US20070067366A1 (en) | Scalable partition memory mapping system | |
| US20050172040A1 (en) | Computer system, control apparatus, storage system and computer device | |
| CN102693230B (en) | For the file system of storage area network | |
| JP2014093072A (en) | Hypervisor-based server duplication system and method and storage medium storing server duplication computer program | |
| CN111538561B (en) | OpenStack large-scale cluster deployment test method and system based on KVM virtualization technology | |
| CN110806911B (en) | Cloud desktop management and control method, device and system | |
| US20160224263A1 (en) | Controlling partner partitions in a clustered storage system | |
| US20200326956A1 (en) | Computing nodes performing automatic remote boot operations | |
| CN111857956A (en) | Virtual machine starting method and equipment | |
| CN107810475B (en) | Method and apparatus for software lifecycle management for virtual computing environments | |
| CN117075817B (en) | Data center virtualized storage optimization method, system, equipment and medium | |
| US8700832B1 (en) | Automated addition of file based hardware and file based access services in a data storage system | |
| US20070083653A1 (en) | System and method for deploying information handling system images through fibre channel | |
| US11086615B2 (en) | Virtual appliance upgrades in high-availability (HA) computing clusters | |
| US10747567B2 (en) | Cluster check services for computing clusters | |
| WO2016070641A1 (en) | Data storage method and device, and data reading method and device | |
| KR20150063244A (en) | Method for driving verture machine and and system thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |