CN117075817A - Data center virtualized storage optimization method, system, equipment and medium - Google Patents
Data center virtualized storage optimization method, system, equipment and medium Download PDFInfo
- Publication number
- CN117075817A CN117075817A CN202311118340.XA CN202311118340A CN117075817A CN 117075817 A CN117075817 A CN 117075817A CN 202311118340 A CN202311118340 A CN 202311118340A CN 117075817 A CN117075817 A CN 117075817A
- Authority
- CN
- China
- Prior art keywords
- computing node
- data center
- position information
- ipxe
- logical volume
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000005457 optimization Methods 0.000 title claims abstract description 33
- 238000013507 mapping Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 13
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 238000000638 solvent extraction Methods 0.000 claims description 2
- 239000000758 substrate Substances 0.000 claims description 2
- 238000007726 management method Methods 0.000 abstract description 24
- 238000013500 data storage Methods 0.000 abstract description 8
- 230000006870 function Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 3
- 108010028984 3-isopropylmalate dehydratase Proteins 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0625—Power saving in storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4403—Processor initialisation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application provides a data center virtualized storage optimization method, a system, equipment and a medium, wherein the method comprises the following steps: after the computing nodes of each data center acquire physical position information from the storage pool manager through the baseboard management controller, starting the basic input/output system, storing the physical position information acquired from the baseboard management controller into the SMBIOS data structure table through the basic input/output system, after corresponding guidance is completed, running the IPXE bootstrap program to interact with the DHCP server to complete IP configuration, generating a protocol address request according to the acquired physical position information and sending the protocol address request to the DHCP server, and installing a corresponding operating system mirror file according to the received logical volume address to execute operating system bootstrap operation until the starting is completed. The application can not only greatly reduce the hard disk consumption and the power consumption of the computing node deployment, but also ensure the safety and the reliability of data storage, and can also promote the maintainability and the expandability of the system.
Description
Technical Field
The present application relates to the field of data storage optimization technologies, and in particular, to a data center virtualized storage optimization method, system, computer device, and storage medium based on shared guidance.
Background
The data center is composed of a huge number of computing nodes, each computing node can be understood as a system composed of a CPU and a Memory, and the image file size of each operating system is different from hundreds of megabytes to tens of G (gigabytes), so that a great deal of storage resources are consumed as storage media of the corresponding operating system.
Existing data center deployment schemes typically provide storage support by configuring each compute node with either a SATA hard disk or an SD card of m.2. However, the deployment of a large number of computing nodes by adopting the scheme not only needs to consume excessive hard disk resources, but also needs to consume a large amount of power resources, and the security and reliability of data storage cannot be ensured.
Disclosure of Invention
The application aims to provide a virtualized storage optimization method of a data center, which is characterized in that physical position information of computing nodes is introduced and stored in a storage pool manager of the whole data center, and an operating system image file required for starting is distributed for each computing node in a disk array by storing a logical volume address corresponding to the physical position information, so that remote IPXE (Intelligence Preboot eXecutionEnvironment) shared boot (shareboot) starting of the computing nodes is supported, the application defect of a computing node deployment scheme of the existing data center is overcome, the hard disk consumption and the power consumption of computing node deployment are greatly reduced, the safety and reliability of data storage are ensured, and the maintainability and the expandability of a system are improved.
In order to achieve the above objective, it is necessary to provide a data center virtualized storage optimization method, system, device and medium for solving the above technical problems.
In a first aspect, an embodiment of the present application provides a data center virtualized storage optimization method, applied to a computing node of a data center, the method including the steps of:
after the substrate management controller of the computing node obtains the pre-stored physical position information from the storage pool manager, starting a basic input/output system corresponding to the computing node;
acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input output system of the computing node, and operating an IPXE bootstrap program of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input output system of the computing node is booted;
responding to the IPXE bootstrap program of the computing node to interact with a DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logical volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and mounting a corresponding operating system image file according to the logical volume address by the IPXE bootstrap program of the computing node, and executing operating system bootstrap operation by the operating system image file after mounting is completed until starting is completed.
Further, the physical location information is generated in advance according to the computing node deployment requirements of the data center and stored in the storage pool manager.
Further, the logical volume addresses are obtained by dividing the logical volumes of a preset data center disk array in advance according to the total number of the computing nodes; and the mapping relation between the physical position information and the logical volume address is stored in the DHCP server.
Further, an operating system image is pre-installed on any one of the logical volumes of the data center disk array, and image snapshots created according to the operating system image are stored in other logical volumes.
Further, the step of acquiring corresponding physical location information by the IPXE bootstrap of the computing node includes:
scanning a memory space with a preset size through an IPXE bootstrap program of the computing node to obtain a memory position of the SMBIOS data structure table;
and acquiring corresponding physical position information stored in the SMBIOS data structure table according to the memory position of the SMBIOS data structure table.
Further, the step of generating a protocol address request according to the physical location information comprises:
and setting a request option field in a request message as preset request content through an IPXE bootstrap program of the computing node, packaging the physical location information into a corresponding sub-option field, and generating the protocol address request.
Further, the logical volume address responded by the DHCP server analyzes the protocol address request through the DHCP server, and when the analyzed request option field is the preset request content, the logical volume address is obtained according to the physical position information in the corresponding sub-option field.
In a second aspect, an embodiment of the present application provides a data center virtualized storage optimization system applied to a computing node of a data center, the system comprising:
the physical information acquisition module is used for starting a basic input/output system corresponding to the computing node after acquiring the pre-stored physical position information from the storage pool manager through the baseboard management controller of the computing node;
the physical information storage module is used for acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input/output system of the computing node, and running an IPXE bootstrap program of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input/output system of the computing node is booted;
the logic address acquisition module is used for responding to the IPXE bootstrap program of the computing node to interact with the DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logic volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and the mirror image mounting module is used for mounting the corresponding operating system mirror image file according to the logical volume address through the IPXE bootstrap program of the computing node, and executing the operating system bootstrap operation through the operating system mirror image file after the mounting is completed until the starting is completed.
In a third aspect, embodiments of the present application further provide a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.
In a fourth aspect, embodiments of the present application also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the above method.
The application provides a data center virtualized storage optimization method, a system, equipment and a medium, through the method, after each computing node obtains pre-stored physical position information from a storage pool manager through a baseboard management controller, a basic input output system corresponding to the computing node is started, corresponding physical position information is obtained from the baseboard management controller through the basic input output system and is stored in a corresponding SMBIOS data structure table, after the basic input output system is guided, an IPXE bootstrap program of the computing node is operated, after the IPXE bootstrap program and a DHCP server are interacted to complete IP configuration, corresponding physical position information is obtained through the IPXE bootstrap program, a protocol address request generated according to the physical position information is sent to the DHCP server, after a logical volume address of an operating system mirror file with an ISCSI protocol is stored, which is responded by the DHCP server is received, a corresponding operating system mirror file is mounted according to the logical volume address, and operating system bootstrap operation is executed through the operating system mirror file until a sharing bootstrap technical scheme is started. Compared with the prior art, the method can greatly reduce the hard disk consumption and the power consumption of the computing node deployment, ensure the safety and the reliability of data storage, and improve the maintainability and the expandability of the system.
Drawings
FIG. 1 is a flow chart of a data center virtualized storage optimization method based on shared boot in an embodiment of the application;
FIG. 2 is another flow diagram of a data center virtualized storage optimization method based on shared boot in an embodiment of the application;
FIG. 3 is a schematic diagram of a data center virtualized storage optimization system based on shared boot in an embodiment of the application;
fig. 4 is an internal structural view of a computer device in an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantageous effects of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples, and it is apparent that the examples described below are part of the examples of the present application, which are provided for illustration only and are not intended to limit the scope of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The data center virtualization storage optimization method based on shared guidance is based on the application situation that each data center uses a plurality of RACKs, each RACK is composed of a plurality of groups of chassis (server nodes of 2U), each chassis is composed of a plurality of computing nodes, each computing node needs to be deployed with one OS (operating system), the image file of each OS is different in size, if the existing computing node storage resource allocation method is adopted, the deployment of massive computing nodes is likely to consume excessive hard disk resources and power resources, and the LUN (Logic unit number) addresses of ISCSI (Internet Small Computer System Interface) protocols in a disk array are allocated to each computing node by introducing physical position information of the computing nodes so as to support remote IPXE shared guidance starting, and the shared guidance-based data center virtualization storage optimization scheme for effectively reducing hard disk resources and power resource consumption is provided. The following examples will describe the data center virtualized storage optimization method of the present application in detail.
In one embodiment, as shown in fig. 1, there is provided a data center virtualized storage optimization method applied to a computing node of a data center, including the steps of:
s11, after a baseboard management controller of a computing node obtains pre-stored physical position information from a storage pool manager, starting a basic input/output system corresponding to the computing node; wherein, the baseboard management controller (Board management controller, BMC) is deployed on each computing node to realize firmware upgrade, remote operation and the like of the computing nodes; a storage pool manager (POD manager) may be understood as a global storage resource manager of the data center, and may also provide DHCP services of the data center by integrating DHCP (Dynamic Host Configuration Protocol) server functions in order to save server resources; the Basic input/output system is a BIOS (Basic input/output system) system, and specific functions thereof are not described herein.
The above physical location information may be understood as information corresponding to the computing nodes, which may embody the physical location of each computing node, in practical application, the cabinet, the server node and the corresponding computing nodes to be used are determined in advance according to the deployment requirement of the data center, and the corresponding physical location information is generated according to the determined cabinet number, the server node number, the node number and other physical information of each computing node, and in order to facilitate unified storage and flexible maintenance of the physical location information of all computing nodes, the physical location information of all computing nodes is uniformly stored into a location information table, where the format of the location information table is not limited and may be stored in the form of an excel table; in order to facilitate unified and secure management of physical location information of all computing nodes by a data center, efficient inquiry is provided for starting each BMC, and further reliable guarantee is provided for reasonably distributing corresponding logical volume addresses according to the physical location information, in the embodiment, when a storage pool manager starts to operate, a location information table storing the physical location information of the computing nodes is preferably loaded into a corresponding memory for inquiry use when the BMC starts; specifically, the physical location information is generated in advance according to the deployment requirement of the computing nodes of the data center and is stored in the storage pool manager; namely, the step of storing the physical location information in advance includes:
generating corresponding physical position information for each computing node according to the computing node deployment requirements of the data center, and storing the physical position information of all the computing nodes in the storage pool manager; the specific content format of the physical location information can be set in a self-defined manner according to the actual application requirements, and is not particularly limited herein; for example, the physical location information of the computing node No. 0 of the server node No. 0 in the No. 0 cabinet may be set as: RACK0/CHASSIS0/NODE0.
In this embodiment, the computing node needs to start the BMC first through the IPXE shared boot, and the BMC communicates with the storage pool manager to obtain physical location information (GID) of the computing node, so as to support the location information transfer between the BMC and a Basic input/output system (BIOS) and a shared boot program IPXE (Intelligence Preboot eXecutionEnvironment), so as to provide reliable technical support for implementing storage resource sharing and remote shared boot starting of the computing node based on the physical location information; it should be noted that, the BMC obtains the corresponding physical location information from the POD manager through the OEM command of the IPMI.
In addition, in consideration of meeting the requirement of saving disk resources, improving the data read-write efficiency, storage safety and reliability of the computing nodes, in the embodiment, preferably, a disk array (Just bunch of Disk, JBOD) is deployed in a data center to uniformly provide shared disk space for each computing node, and logical volume addresses are mapped according to physical location information, so that reasonable allocation of disk space based on the physical location information is realized, and data storage management, redundancy backup and error recovery are facilitated; specifically, the logical volume addresses are obtained by dividing logical volumes of a preset data center disk array in advance according to the total number of computing nodes; the mapping relation between the physical position information and the logical volume address is stored in a DHCP server; that is, the computing nodes of the data center are started up, and the following steps are also required:
carrying out logic volume division on a preset data center disk array according to the total number of the computing nodes to obtain logic volume addresses corresponding to all the computing nodes, and storing the mapping relation between the physical position information of all the computing nodes and the logic volume addresses in a DHCP server; the method comprises the steps that the total number of computing nodes is determined according to the deployment requirement of a data center, a plurality of logic volumes are created on a disk array JBOD (just a BOD) by using a targettli partitioning tool based on the total number of computing nodes, each logic volume has a LUN address (ISCSI logic volume address), each logic volume provides storage service for a corresponding computing node through a preset mapping relation, and the obtained logic volume addresses which can be accessed through an ISCSI protocol have a preset one-to-one correspondence with physical position information; in order to facilitate unified storage and flexible management of the mapping relationship between the logical volume address and the physical location information, and provide basic support for subsequent use of the IPXE remote sharing guide, in this embodiment, preferably, the mapping relationship between the physical location information and the logical volume address is stored and maintained in a mapping relationship table (for example, by adopting exel table maintenance), and when the DHCP server is started, the mapping relationship table is loaded into the memory, so that the subsequent execution of the IPXE remote sharing guide is facilitated to allocate accurate logical volume addresses (ISCSI-LUNs) for each computing node for use;
it should be noted that, each logical volume created on the disk array has a function of providing a transparent disk access to the upper layer application, and each logical volume can also provide redundancy backup and security monitoring for the data storage object by deploying ceph management software, so that any disk fault can be replaced and deleted seamlessly, thereby greatly improving the maintainability of the system; at the same time, each logical volume on the disk array can also provide high availability, high performance, low cost cluster services through LVS (Linux VirtualServer) cluster software.
In addition, in order to further reduce the occupation of the actual hard disk resources in the disk array, in this embodiment, preferably, after the required number of logical volumes are created on the disk array, the storage occupation of the actual disk space is saved by storing only the OS image on one logical volume and storing only the snapshot of the OS image on the other logical volumes; specifically, an operating system image is pre-installed on any one logical volume of the data center disk array, and image snapshots created according to the operating system image are stored in other logical volumes, that is, the method further includes the following steps:
an operating system image is pre-installed on any logic volume of the disk array, and an image snapshot created according to the operating system image is copied to other logic volumes; the specific type of the operating system image and the specific mode of generating the image snapshot can be selected according to the actual application requirements, and are not particularly limited herein; in practical application, if the sizes of the logical volumes are the same, any one logical volume can be used as a master disk for installing and deploying the OS image, and after image snapshots meeting the use number of all other logical volumes are created on the master disk, each image snapshot is respectively copied into a corresponding logical volume address so as to facilitate subsequent remote sharing and guiding use; meanwhile, when the logical volumes are divided, a certain logical volume is divided into larger spaces and is specially used for installing the OS mirror images, and other logical volumes are divided into the OS mirror images according to the smaller spaces and are used for storing the OS mirror images, so that the OS mirror images and each mirror image snapshot (snapshot) have ISCSI addresses corresponding to the physical position information of each calculation stage, the ISCSI addresses are the logical volume addresses stored in a mapping relation table on a DHCP server in advance, and the required mirror image file mounting addresses can be provided when each calculation node applies for boot starting in an IPXE mode; for example, the size of the logical volume is not particularly limited, and the first logical volume is allocated 4G of space, the other logical volumes are allocated 512M of space, and the like.
The physical location information configuration, logical volume address allocation, mapping relation table generation and the like of each computing node corresponding to the above embodiment belong to the system configuration preparation work according to the computing node deployment requirement of the data center, that is, after the physical location information loading of the storage pool manager, the mapping relation loading of the physical location information and the logical volume address by the DHCP server and the like are completed, the boot process of starting the computing node can be formally started after the BMCs of each computing node are started to acquire the corresponding physical location information in the storage pool manager.
S12, acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input output system of the computing node, and operating an IPXE bootstrap program of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input output system of the computing node is booted; the method for acquiring the corresponding physical location information from the baseboard management controller by the basic input output system may also be implemented by invoking an OEM command of IPMI, which is not described herein again;
the SMBIOS (System Management BIOS) data structure table is understood to be a data table of the system management basic input/output system, and is generally stored in an area within 1M of the memory address; in order to realize reliable transfer of physical location information of a computing node between a BIOS and an IPXE bootstrap program, and further provide effective guarantee for a subsequent IPXE bootstrap program to acquire a logical volume address of a required mounting mirror image file based on interaction of the physical location information and a DHCP, the method of adding a corresponding physical location information storage table entry at a preset location of an SMBIOS data structure table by the BIOS is adopted to realize sharing of physical location information data; it should be noted that, the preset position of the specific storage physical location information storage table entry may be configured according to the actual application requirement, and only needs to satisfy the condition that does not affect the normal BIOS system boot flow, for example, may be stored at the rearmost side of the SMBIOS data structure table, which is not limited herein specifically.
S13, responding to interaction of the IPXE bootstrap program of the computing node and a DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logical volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol; the DHCP server has a normal IP configuration function, and integrates a function of supporting the IPXE shared boot start, and may be deployed on a server device that specifically provides a DHCP service function, or may be deployed on the foregoing storage pool manager, which is not specifically limited herein.
In this embodiment, supporting the IPXE shared boot flow is realized by cooperating physical location information in the SMBIOS data structure table and a mapping relation table pre-stored in the DHCP server, which can be understood that after the BIOS system boot is finished and the boot control authority is given to the IPXE boot program, the IPXE boot program will find a packet to the DHCP server according to normal broadcasting DHCP, and the DHCP server allocates an effective IP address to the IP configuration of the completion computing node, wherein the IP configuration flow is realized by referring to the prior art and is not repeated herein; after the computing node completes IP address configuration through the IPXE bootstrap program, the physical position information of the computing node needs to be acquired, and then the physical position information of the computing node is sent to a DHCP server to acquire a corresponding logical volume address; specifically, the step of acquiring, by the IPXE bootstrap of the computing node, the corresponding physical location information includes:
scanning a memory space with a preset size through an IPXE bootstrap program of the computing node to obtain a memory position of the SMBIOS data structure table; the memory space with the preset size can be set according to the storage position of the SMBIOS data structure table and the actual application requirement, for example, in the case that the SMBIOS data structure table is stored in the 1M memory, the preset size can be set to be 1M or a value slightly larger than 1M; the address of an SMBIOS table is determined by scanning the character string of SM32, if the character string is found, the data in the table is read out, and then a table item with physical position information (GID) is found in the table, namely the physical position information of the computing node itself which needs to be acquired;
acquiring corresponding physical position information stored in the SMBIOS data structure table according to the memory position of the SMBIOS data structure table; the memory location is the positioning information of the SMBIOS data structure table, and after the accurate location information of the SMBIOS data structure table is obtained, the required data information can be extracted according to the preset location of the physical location information stored in the table;
in this embodiment, by using the SMBIOS data structure table as a storage location of physical location information, not only can security and reliability of the physical location information be ensured, but also efficient and reliable data sharing between the BIOS and the IPXE boot program can be realized.
In practical application, a large number of computing nodes are used as IPXE clients to request image file addresses to a DHCP server at the same time in the same local area network, and in order to ensure the high efficiency and accuracy of the processing request of the DHCP server, in this embodiment, preferably, an IPXE bootstrap program of a computing node packages and generates a request message according to the acquired own physical position information to send a corresponding protocol address request to the DHCP server, that is, a custom option field of a DHCP sending request in the existing DHCP 4-stage discovery protocol flow needs to be reasonably set so as to ensure that each computing node can accurately acquire a corresponding mount image address under the condition that the normal IP configuration flow is not influenced; specifically, the step of generating a protocol address request according to the physical location information includes:
setting a request option field in a request message as preset request content through an IPXE bootstrap program of the computing node, packaging the physical position information into a corresponding sub-option field, and generating the protocol address request; the request option field may use a custom field specified by the DHCP protocol, so long as the request option field does not conflict with a defined general option field, for example, the physical location information for allocating the logical volume address may be transferred by using the option 100 preset at the computing node and the DHCP server; it should be noted that, the preset request content used in the request option field in the protocol address request may also be determined according to specific use requirements, for example, set to "iscsi-lun" or "disk space", and only the DHCP server needs to be able to recognize and perceive the specific meaning of the setting content of the field;
correspondingly, as described above, in order to ensure the high efficiency and reliability of the DHCP service, the DHCP server needs to cooperate with the setting mode of the computing node about the request option field to determine the data object requested by the computing node and provide the matched data object for the computing node by analyzing the protocol address request; specifically, the logical volume address responded by the DHCP server analyzes the protocol address request through the DHCP server, and obtains the physical location information in the corresponding sub-option field when the request option field obtained by analysis is the preset request content; that is, after the step of transmitting the protocol address request generated according to the physical location information to the DHCP server, it further includes:
the DHCP server receives and analyzes the protocol address request, and when the analyzed request option field is the preset request content, the DHCP server acquires the corresponding logical volume address according to the physical position information in the corresponding sub-option field; the method for obtaining the logical volume address can be understood as traversing an address relation mapping table pre-stored in the physical location information according to the physical location information, and finding the logical volume address corresponding to the physical location information in the table to obtain an ISCSI protocol address (Uniform Resource Locator, URL) which needs the DHCP server to send to the computing node through a corresponding response message; for example, the DHCP server receives the physical location information of the computing NODE as RACK 0/passis 0/NODE0, and the logical volume address corresponding to the physical location information in the mapping relationship table stored in the DHCP server is: after resolving the physical position information, the DHCP server checks the address relation mapping table of the physical position information, and returns an iscsi 10.10.10:snapshot10 address to the IPXE bootstrap program of the computing node according to the table lookup matching result; it should be noted that, the logical volume directly installed with the OS image may also be mapped to a certain computing node for use, and the corresponding logical volume address may be given in a similar form of iscsi: x.x.x: oscage.
S14, mounting a corresponding operating system image file according to the logical volume address through an IPXE bootstrap program of the computing node, and executing operating system bootstrap operation through the operating system image file after mounting is completed until starting is completed; the logical volume address includes the mirror name or the mirror snapshot name, and after the IPXE boot program receives the corresponding logical volume address, the mounting command provided by the IPXE may be directly used to mount the OS mirror file located on the remote disk array: if the logical volume address stores the OS mirror image, the mirror image file is directly mounted; if the logical volume address stores the mirror snapshot, directly mounting the mirror snapshot; after the IPXE bootstrap program of the computing node completes the mounting task of the OS image or the image snapshot, the bootstrap control right can be given to the image file of the OS, and then the operating system is booted like the local bootstrap OS, wherein the specific method for booting the operating system is realized by referring to the prior art and is not repeated herein;
in practical application, the size of the mirror image snapshot is much smaller than that of the mirror image file of the operating system, and the method and the device for realizing remote loading and guiding of the operating system by providing the mirror image snapshot for the computing nodes are adopted in the embodiment, compared with the traditional scheme of realizing system guiding by completely adopting the OS mirror image, the method and the device for realizing remote loading and guiding of the operating system by installing a large amount of OS mirror images can effectively avoid disk consumption caused by installing a large amount of OS mirror images, greatly save disk space, save power consumption of the whole system, flexibly cooperate with the augmentation of the computing nodes in a mode of increasing the number of the mirror image snapshot, and provide reliable guarantee for flexible expansion and deployment of a subsequent data center.
After each computing node provided in the embodiment of the application obtains the pre-stored physical location information from the storage pool manager through the baseboard management controller, the basic input output system corresponding to the computing node is started, the corresponding physical location information is obtained from the baseboard management controller through the basic input output system and stored in the corresponding SMBIOS data structure table, after the basic input output system is guided, the IPXE guiding program of the computing node is operated, after the IPXE guiding program and the DHCP server are interacted to complete IP configuration, the corresponding physical location information is obtained through the IPXE guiding program, a protocol address request generated according to the physical location information is sent to the DHCP server, after receiving the logical volume address of the operating system image file with ISCSI protocol which is responded by the DHCP server according to the protocol address request is stored, the corresponding operating system image file is mounted according to the logical volume address, and executing the operating system boot operation through the operating system image file until the boot-up is completed, realizing that the physical location information of the introduced computing nodes is stored in a storage pool manager of the whole data center as shown in fig. 2, and distributing logical volume addresses corresponding to the physical location information for each computing node in a disk array to store a data center virtualized storage optimization scheme of the operating system image snapshot required by the boot-up of the computing nodes, not only providing a safe and reliable storage system comprising a backup mechanism and an error recovery mechanism through the combined use of ceph management software and LVS technology, so that any disk failure can be replaced and deleted seamlessly, greatly improving the maintainability of the system, but also greatly reducing the utilization rate of a hard disk and the power consumption of the whole data center through the mechanism of creating the image snapshot for the computing nodes, the method can also provide reliable technical support for flexible expansion of the data center and deployment of any other virtualized cloud service, and has high expandability.
Although the steps in the flowcharts described above are shown in order as indicated by arrows, these steps are not necessarily executed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders.
In one embodiment, as shown in FIG. 3, a data center virtualized storage optimization system is provided for use with computing nodes of a data center, the system comprising:
the physical information acquisition module 1 is used for starting a basic input/output system corresponding to a computing node after acquiring pre-stored physical position information from a storage pool manager through a baseboard management controller of the computing node;
the physical information storage module 2 is configured to obtain corresponding physical location information from a baseboard management controller of the computing node through a basic input/output system of the computing node, and operate an IPXE bootstrap program of the computing node after the physical location information is stored in a corresponding SMBIOS data structure table and the basic input/output system of the computing node is booted;
the logic address acquisition module 3 is used for responding to the IPXE bootstrap program of the computing node to interact with the DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logic volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and the image mounting module 4 is used for mounting the corresponding operating system image file according to the logical volume address through the IPXE bootstrap program of the computing node, and executing the operating system bootstrap operation through the operating system image file after the mounting is completed until the starting is completed.
For specific limitation of a data center virtualized storage optimization system, reference may be made to the limitation of a data center virtualized storage optimization method, and corresponding technical effects may be equally obtained, which is not described herein. The modules in the data center virtualized storage optimization system can be implemented in whole or in part by software, hardware and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
Fig. 4 shows an internal structural diagram of a computer device, which may be a terminal or a server in particular, in one embodiment. As shown in fig. 4, the computer device includes a processor, a memory, a network interface, a display, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements a data center virtualized storage optimization method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those of ordinary skill in the art that the architecture shown in fig. 4 is merely a block diagram of some of the structures associated with the present inventive arrangements and is not limiting of the computer device to which the present inventive arrangements may be implemented, and that a particular computing device may include more or less components than those shown, or may be combined with some of the components, or have the same arrangement of components.
In one embodiment, a computer device is provided comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the above method when the computer program is executed.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, implements the steps of the above method.
In summary, the data center virtualized storage optimization method of the embodiment of the application realizes that after each computing node of the data center obtains pre-stored physical position information from a storage pool manager through a baseboard management controller, a basic input output system corresponding to the computing node is started, corresponding physical position information is obtained from the baseboard management controller through the basic input output system and is stored in a corresponding SMBIOS data structure table, after the basic input output system is guided, an IPXE guiding program of the computing node is operated, after the IPXE guiding program and a DHCP server are interacted to complete IP configuration, corresponding physical position information is obtained through the IPXE guiding program, a protocol address request generated according to the physical position information is sent to the DHCP server, and receiving a logical volume address of the operating system image file with ISCSI protocol, which is responded by the DHCP server according to the protocol address request, mounting the corresponding operating system image file according to the logical volume address, and executing operating system guiding operation through the operating system image file until the starting is completed, wherein the method saves the physical position information of the compute nodes in a storage pool manager of the whole data center through introducing the physical position information, distributes the logical volume address corresponding to the physical position information for each compute node in a disk array to store the data center virtualized storage optimization scheme of the operating system image snapshot required by the boot starting of the compute node, provides a safe and reliable storage system comprising a backup mechanism and an error recovery mechanism through the combination of ceph management software and LVS technology, enables any disk faults to be replaced and deleted seamlessly, greatly improves the maintainability of the system, the system has the advantages that the utilization rate of the hard disk is greatly reduced, the power consumption of the whole data center is reduced, the flexible expansion of the data center and the deployment of any virtualized cloud service are provided with reliable technical support, the system has high expandability, namely, the hard disk consumption and the power consumption of the computing node deployment can be greatly reduced, the safety and the reliability of data storage can be ensured, and the maintainability and the expandability of the system can be improved.
In this specification, each embodiment is described in a progressive manner, and all the embodiments are directly the same or similar parts referring to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments. It should be noted that, any combination of the technical features of the foregoing embodiments may be used, and for brevity, all of the possible combinations of the technical features of the foregoing embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The foregoing examples represent only a few preferred embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the application. It should be noted that modifications and substitutions can be made by those skilled in the art without departing from the technical principles of the present application, and such modifications and substitutions should also be considered to be within the scope of the present application. Therefore, the protection scope of the patent of the application is subject to the protection scope of the claims.
Claims (10)
1. A method of data center virtualized storage optimization, applied to a compute node of a data center, the method comprising the steps of:
after the substrate management controller of the computing node obtains the pre-stored physical position information from the storage pool manager, starting a basic input/output system corresponding to the computing node;
acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input output system of the computing node, and operating an IPXE bootstrap program of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input output system of the computing node is booted;
responding to the IPXE bootstrap program of the computing node to interact with a DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logical volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and mounting a corresponding operating system image file according to the logical volume address by the IPXE bootstrap program of the computing node, and executing operating system bootstrap operation by the operating system image file after mounting is completed until starting is completed.
2. The data center virtualized storage optimization method of claim 1, wherein the physical location information is generated by pre-fetching computing node deployment requirements of the data center and stored in the storage pool manager.
3. The data center virtualized storage optimization method of claim 2, wherein the logical volume addresses are obtained by performing logical volume partitioning on a preset data center disk array in advance according to the total number of computing nodes; and the mapping relation between the physical position information and the logical volume address is stored in the DHCP server.
4. The data center virtualized storage optimization method of claim 3 wherein an operating system image is pre-installed on any logical volume of the data center disk array and wherein other logical volumes store image snapshots created from the operating system image.
5. The data center virtualized storage optimization method of claim 1, wherein the step of obtaining corresponding physical location information by an IPXE bootstrap of the computing node comprises:
scanning a memory space with a preset size through an IPXE bootstrap program of the computing node to obtain a memory position of the SMBIOS data structure table;
and acquiring corresponding physical position information stored in the SMBIOS data structure table according to the memory position of the SMBIOS data structure table.
6. The data center virtualized storage optimization method of claim 3, wherein generating a protocol address request from the physical location information comprises:
and setting a request option field in a request message as preset request content through an IPXE bootstrap program of the computing node, packaging the physical location information into a corresponding sub-option field, and generating the protocol address request.
7. The virtualized storage optimization method of data center of claim 6, wherein the logical volume address responded by the DHCP server resolves the protocol address request through the DHCP server, and obtains according to the physical location information in the corresponding sub-option field when the resolved request option field is the preset request content.
8. A data center virtualized storage optimization system applied to a compute node of a data center, the system comprising:
the physical information acquisition module is used for starting a basic input/output system corresponding to the computing node after acquiring the pre-stored physical position information from the storage pool manager through the baseboard management controller of the computing node;
the physical information storage module is used for acquiring corresponding physical position information from a baseboard management controller of the computing node through a basic input/output system of the computing node, and running an IPXE bootstrap program of the computing node after the physical position information is stored in a corresponding SMBIOS data structure table and the basic input/output system of the computing node is booted;
the logic address acquisition module is used for responding to the IPXE bootstrap program of the computing node to interact with the DHCP server to complete IP configuration, acquiring corresponding physical position information through the IPXE bootstrap program of the computing node, sending a protocol address request generated according to the physical position information to the DHCP server, and receiving a logic volume address responded by the DHCP server; the logical volume address stores an operating system image file with an ISCSI protocol;
and the mirror image mounting module is used for mounting the corresponding operating system mirror image file according to the logical volume address through the IPXE bootstrap program of the computing node, and executing the operating system bootstrap operation through the operating system mirror image file after the mounting is completed until the starting is completed.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the method of any of claims 1 to 7 when the computer program is executed.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311118340.XA CN117075817B (en) | 2023-08-31 | 2023-08-31 | Data center virtualized storage optimization method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311118340.XA CN117075817B (en) | 2023-08-31 | 2023-08-31 | Data center virtualized storage optimization method, system, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117075817A true CN117075817A (en) | 2023-11-17 |
| CN117075817B CN117075817B (en) | 2024-05-07 |
Family
ID=88707895
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311118340.XA Active CN117075817B (en) | 2023-08-31 | 2023-08-31 | Data center virtualized storage optimization method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117075817B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020188802A1 (en) * | 2001-02-28 | 2002-12-12 | Hitachi, Ltd. | Memory device system and method for copying data in memory device system |
| US6883083B1 (en) * | 2002-12-20 | 2005-04-19 | Veritas Operating Corporation | System and method for maintaining and accessing information regarding virtual storage devices |
| JP2009176213A (en) * | 2008-01-28 | 2009-08-06 | Hitachi Software Eng Co Ltd | Network boot system |
| CN105335168A (en) * | 2014-05-27 | 2016-02-17 | 阿里巴巴集团控股有限公司 | System, method and apparatus for remotely configuring operating system |
| CN105721534A (en) * | 2014-12-17 | 2016-06-29 | 广达电脑股份有限公司 | System and method for network-based iscsi boot parameter deployment |
| US20180270110A1 (en) * | 2017-03-17 | 2018-09-20 | Verizon Patent And Licensing Inc. | Automatic bootstrapping and dynamic configuration of data center nodes |
| CN109951325A (en) * | 2019-02-28 | 2019-06-28 | 华为技术有限公司 | A kind of network cable connection inspection method and device |
| CN110740609A (en) * | 2019-10-25 | 2020-01-31 | 上海中通吉网络技术有限公司 | Server information processing method and device for internet data center and controller |
| US20210132870A1 (en) * | 2019-11-01 | 2021-05-06 | EMC IP Holding Company LLC | Methods and systems for servicing data requests in a multi-node system |
-
2023
- 2023-08-31 CN CN202311118340.XA patent/CN117075817B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020188802A1 (en) * | 2001-02-28 | 2002-12-12 | Hitachi, Ltd. | Memory device system and method for copying data in memory device system |
| US6883083B1 (en) * | 2002-12-20 | 2005-04-19 | Veritas Operating Corporation | System and method for maintaining and accessing information regarding virtual storage devices |
| JP2009176213A (en) * | 2008-01-28 | 2009-08-06 | Hitachi Software Eng Co Ltd | Network boot system |
| CN105335168A (en) * | 2014-05-27 | 2016-02-17 | 阿里巴巴集团控股有限公司 | System, method and apparatus for remotely configuring operating system |
| CN105721534A (en) * | 2014-12-17 | 2016-06-29 | 广达电脑股份有限公司 | System and method for network-based iscsi boot parameter deployment |
| US20180270110A1 (en) * | 2017-03-17 | 2018-09-20 | Verizon Patent And Licensing Inc. | Automatic bootstrapping and dynamic configuration of data center nodes |
| CN109951325A (en) * | 2019-02-28 | 2019-06-28 | 华为技术有限公司 | A kind of network cable connection inspection method and device |
| CN110740609A (en) * | 2019-10-25 | 2020-01-31 | 上海中通吉网络技术有限公司 | Server information processing method and device for internet data center and controller |
| US20210132870A1 (en) * | 2019-11-01 | 2021-05-06 | EMC IP Holding Company LLC | Methods and systems for servicing data requests in a multi-node system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117075817B (en) | 2024-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7725559B2 (en) | Virtual data center that allocates and manages system resources across multiple nodes | |
| US8336047B2 (en) | Provisioning virtual resources using name resolution | |
| US7330967B1 (en) | System and method for injecting drivers and setup information into pre-created images for image-based provisioning | |
| US20080155243A1 (en) | Apparatus, system, and method for booting using an external disk through a virtual scsi connection | |
| US20070067366A1 (en) | Scalable partition memory mapping system | |
| US20070061441A1 (en) | Para-virtualized computer system with I/0 server partitions that map physical host hardware for access by guest partitions | |
| US20120198076A1 (en) | Migrating Logical Partitions | |
| CN102693230B (en) | For the file system of storage area network | |
| US10372639B2 (en) | System and method to avoid SMBus address conflicts via a baseboard management controller | |
| CN107710160B (en) | Computer and storage area management method | |
| NO342885B1 (en) | To turn machines into virtual machines | |
| US10817378B2 (en) | Managing boot failures in an information handling system | |
| US20160371107A1 (en) | System and Method to Discover Virtual Machines from a Management Controller | |
| CN113741914B (en) | Operating system installation mechanism | |
| US20200326956A1 (en) | Computing nodes performing automatic remote boot operations | |
| CN112732289A (en) | Server management method and server | |
| CN111857956A (en) | Virtual machine starting method and equipment | |
| US11349721B2 (en) | Discovering switch port locations and internet protocol addresses of compute nodes | |
| US10838861B1 (en) | Distribution of memory address resources to bus devices in a multi-processor computing system | |
| CN1834912A (en) | ISCSI bootstrap driving system and method for expandable internet engine | |
| CN107810475B (en) | Method and apparatus for software lifecycle management for virtual computing environments | |
| CN117075817B (en) | Data center virtualized storage optimization method, system, equipment and medium | |
| US8700832B1 (en) | Automated addition of file based hardware and file based access services in a data storage system | |
| US20070083653A1 (en) | System and method for deploying information handling system images through fibre channel | |
| US11086615B2 (en) | Virtual appliance upgrades in high-availability (HA) computing clusters |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |