CN107844274B - Hardware resource management method, device and terminal based on super-fusion storage system - Google Patents
Hardware resource management method, device and terminal based on super-fusion storage system Download PDFInfo
- Publication number
- CN107844274B CN107844274B CN201711148411.5A CN201711148411A CN107844274B CN 107844274 B CN107844274 B CN 107844274B CN 201711148411 A CN201711148411 A CN 201711148411A CN 107844274 B CN107844274 B CN 107844274B
- Authority
- CN
- China
- Prior art keywords
- hardware resource
- identification information
- resource
- management
- storage system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0667—Virtualisation aspects at data level, e.g. file, record or object virtualisation
Abstract
The invention discloses a hardware resource management method, a device and a terminal based on a super-fusion storage system, relates to the technical field of data processing, and mainly aims to quickly identify hardware resources and effectively manage newly-added hardware resources. The main technical scheme of the invention is as follows: periodically scanning whether new hardware resources exist in a local server by using a hardware resource management service; if yes, loading the new hardware resource into a management virtual machine in a local server; judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system; if the new hardware resource exists, the new hardware resource is added to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information; and if the new hardware resource does not exist, marking identification information for the new hardware resource, and adding the new hardware resource into a hardware resource pool of the super-fusion storage system through the management virtual machine.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a hardware resource management method, a hardware resource management device and a hardware resource management terminal based on a super-fusion storage system.
Background
The super-fusion storage system is an object-oriented distributed storage system. The super-fusion means that resources and technologies such as computing, network, storage and server virtualization and the like are provided in the same set of unit equipment, and the super-fusion also comprises elements such as cloud management software, data reconstruction, multiple copies and snapshot technology, and multiple nodes can be aggregated through the network, so that modular seamless transverse expansion is realized, and a uniform resource pool is formed.
In the super-fusion storage system, the most core hardware resources include server resources and disk resources. Due to the distributed and high-expansion characteristics of the super-fusion storage system, the operations of identifying and adding the expanded hardware resources to the system in the system consume system resources, particularly for heterogeneous hardware resources, the system needs to perform detailed scanning and identification on the heterogeneous hardware resources, and can add the heterogeneous hardware resources to the system after being confirmed to be correct, meanwhile, the most important resources for the super-fusion storage system are data information stored on a disk, and for the expanded disk resources, the system needs to effectively identify and protect the data information in the disk resources and also consumes a large amount of system processing resources, so how to efficiently discover and manage the hardware resources of the super-fusion storage system directly affects the data processing efficiency of the super-fusion storage system.
Disclosure of Invention
In view of this, the present invention provides a hardware resource management method, apparatus and terminal based on a super-fusion storage system, and mainly aims to quickly identify hardware resources and effectively manage newly added hardware resources.
In order to achieve the purpose, the invention mainly provides the following technical scheme:
in one aspect, the present invention provides a hardware resource management method based on a hyper-converged storage system, including:
periodically scanning whether new hardware resources exist in a local server by using a hardware resource management service;
if yes, loading the new hardware resource into a management virtual machine in a local server;
judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system;
if the new hardware resource exists, the new hardware resource is added to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information;
and if the new hardware resource does not exist, marking identification information for the new hardware resource, and adding the new hardware resource into a hardware resource pool of the super-fusion storage system through the management virtual machine.
Preferably, the method further comprises:
and dividing virtual resource units for the new hardware resources by the hardware resource pool according to the identification information and preset rules, wherein the virtual resource units are marked with unique unit names and access path information.
Preferably, adding the new hardware resource to the hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information includes:
acquiring a hardware identifier and/or a virtual resource identifier in the identification information;
determining a corresponding virtual resource unit based on the hardware identifier and/or the virtual resource identifier;
and loading the virtual resource unit into a hardware resource pool of the super-fusion storage system through a management virtual machine.
Preferably, marking identification information for the new hardware resource includes:
formatting the disk resources in the new hardware resources;
analyzing the type of the processed disk resource;
and marking corresponding identification information according to the type of the disk resource.
Preferably, the loading the new hardware resource into the management virtual machine in the local server includes:
and loading the new hardware resource into the management virtual machine in a transparent transmission mode, so that a virtual resource unit in the management virtual machine corresponds to the new hardware resource in the server.
Preferably, the method further comprises:
regularly scanning whether the original hardware resources in the local server are deleted by using a hardware resource management service;
and if the virtual hardware resources are deleted, deleting the corresponding virtual hardware resources in the management virtual machine.
On the other hand, the invention also provides a hardware resource management terminal based on the super-fusion storage system, wherein the terminal comprises a processor, a storage medium and a transceiver;
the processor is used for periodically scanning the terminal by using a hardware resource management service, and loading a new hardware resource into a management virtual machine in the terminal when the new hardware resource exists in the terminal; judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system; if the hardware resources exist, the transceiver is used for adding the new hardware resources into a hardware resource pool of the hyper-converged storage system through the management virtual machine according to the identification information; if the new hardware resource does not exist, marking identification information for the new hardware resource, and adding the new hardware resource into a hardware resource pool of the hyper-converged storage system through the management virtual machine by using the transceiver;
the storage medium is used for storing a program executed by the processor and storage data of the super-fusion storage system;
the transceiver is used for transceiving the processing instruction executed by the processor so as to enable the terminal to perform data interaction with other terminals in the super-convergence storage system.
Preferably, the program executed by the processor further includes:
and dividing virtual resource units for the new hardware resources according to the identification information and preset rules based on the hardware resource pool, wherein the virtual resource units are marked with unique unit names and access path information.
Preferably, the terminal is further configured to,
acquiring a hardware identifier and/or a virtual resource identifier in the identification information by the processor, and determining a corresponding virtual resource unit based on the hardware identifier and/or the virtual resource identifier;
loading, by the transceiver, the virtual resource units into a hardware resource pool of a hyper-converged storage system.
On the other hand, the invention also provides a hardware resource management device based on the super-fusion storage system, which comprises:
the query unit is used for regularly scanning whether new hardware resources exist in the local server by using the hardware resource management service;
the first loading unit is used for loading the new hardware resource into a management virtual machine in a local server when the inquiry unit scans the new hardware resource;
the judging unit is used for judging whether the new hardware resources inquired by the inquiring unit have identification information, and the identification information is identification information of the hardware resource label in the management system used by the super-fusion storage system;
the second loading unit is used for adding the new hardware resource to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information when the judging unit judges that the identification information exists in the new hardware resource;
the marking unit is used for marking the identification information for the new hardware resource when the judging unit judges that the identification information does not exist in the new hardware resource;
the second loading unit is further configured to add the new hardware resource marked by the marking unit to a hardware resource pool of the hyper-converged storage system through the management virtual machine.
Preferably, the apparatus further comprises:
and the dividing unit is used for dividing the new hardware resources loaded by the second loading unit into virtual resource units by the hardware resource pool according to the identification information and preset rules, and the virtual resource units are marked with unique unit names and access path information.
Preferably, the second loading unit includes:
an obtaining module, configured to obtain a hardware identifier and/or a virtual resource identifier in the identifier information;
a determining module, configured to determine a corresponding virtual resource unit based on the hardware identifier and/or the virtual resource identifier acquired by the acquiring module;
and the loading module is used for loading the virtual resource unit into a hardware resource pool of the super-fusion storage system through the management virtual machine.
Preferably, the marking unit includes:
the processing module is used for formatting the disk resources in the new hardware resources;
the analysis module is used for analyzing the type of the disk resource processed by the processing module;
and the marking module is used for marking the corresponding identification information according to the type of the disk resource obtained by the analysis module.
Preferably, the first loading unit is further configured to load the new hardware resource into the management virtual machine in a transparent manner, so that a virtual resource unit in the management virtual machine corresponds to the new hardware resource in the server.
Preferably, the apparatus further comprises:
the query unit is further used for periodically scanning whether the original hardware resources in the local server are deleted by using the hardware resource management service;
and the deleting unit is used for deleting the corresponding virtual hardware resource in the management virtual machine when the inquiring unit determines that the original hardware resource in the local server is deleted.
According to the hardware resource management method, device and terminal based on the super-fusion storage system, the hardware resources in the super-fusion storage system are scanned and found in real time, whether the loaded hardware resources are new resources or not is determined, the new hardware resources are quickly integrated into the system through the management virtual machine, a uniform hardware resource pool is formed, and the non-new hardware resources can be identified through the existing identification information in the hardware resources and are loaded into the system according to the original resource dividing mode, so that the data in the hardware resources can be reserved and the same storage service can be provided. Compared with the existing resource management mode, the hardware resource management scheme provided by the invention reduces repeated query of the whole storage system through matching of the identification information, reduces the workload of scanning and identifying resources and data in the storage system, and meanwhile, the application efficiency of the hardware resources is improved through integrated management of the management virtual machine on new hardware resources in each node of the system, so that the data access of a user is facilitated, and the data processing efficiency of the system and the application experience of the user are improved.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a flowchart illustrating a hardware resource management method based on a hyper-converged storage system according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a service relationship of a super-converged storage system according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating another hardware resource management method based on a hyper-converged storage system according to an embodiment of the present invention;
fig. 4 illustrates a schematic diagram of managing a virtual machine transparent transmission loading disk according to an embodiment of the present invention;
FIG. 5 is a block diagram illustrating a hardware resource management apparatus based on a hyper-converged storage system according to an embodiment of the present invention;
FIG. 6 is a block diagram illustrating another hardware resource management apparatus based on a hyper-converged storage system according to an embodiment of the present invention;
fig. 7 shows a block diagram of a hardware resource management terminal based on a super-fusion storage system according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
An embodiment of the present invention provides a hardware resource management method based on a super-fusion storage system, and as shown in fig. 1, the method is an implementation scheme for rapidly fusing each node server in the super-fusion storage system into the system and performing efficient management when increasing hardware resources. The method comprises the following specific steps:
101. and periodically scanning whether new hardware resources exist in the local server by using the hardware resource management service.
The super-fusion storage system in the embodiment of the invention adopts a distributed system composed of a plurality of node servers, each node server in the storage system can add some hardware resources, such as magnetic disks, internal memories and other hardware resources in real time, and the hardware resources, particularly the magnetic disks, support hot plug operation. For this reason, a system is required to monitor whether newly added hardware resources exist in the node server in real time. The embodiment of the invention adopts a hardware resource management service which is operated in each node server of the super-fusion storage system and is used for periodically scanning the hardware resources in the local server so as to judge whether the local server has new hardware resources.
It should be noted that the hardware resource management service is run in each node server and is a service content for starting up the server, generally, running the hardware resource management service requires setting a management virtual machine in the server, running the hardware resource management service through the management virtual machine, and a scanning period of the hardware resource management service is set according to a user's requirement and a specific application scenario.
In addition, in the super-fusion storage system in the embodiment of the present invention, in addition to the hardware resource management service operated in each node server, a cluster hardware resource pool service and a cluster storage resource management service are also operated in the server cluster of the whole super-fusion storage system. The cluster hardware resource pool service is used for integrating all hardware resources in the system, performing virtualization processing on the hardware resources in each node server according to corresponding attributes of the hardware resources, and reporting a processed result to the cluster storage resource management service. And the cluster storage resource management service provides storage service for users according to the virtual storage resources in the system obtained by statistics, and responds to the access request and operation of the users to the storage data through the hardware resource management service in each node server. For the relationship among the three, see the service relationship diagram of the super-converged storage system shown in fig. 2.
102. And if so, loading the new hardware resource into the management virtual machine in the local server.
According to the content described in step 101, when the hardware resource management service queries that a new hardware resource exists in the local node, the hardware resource management service reads the new hardware resource through a management virtual machine running in the local server, so as to identify the resource and determine the type of the resource, for example, it is necessary to determine that the resource is a disk storage resource or a cache processing resource.
When the new hardware resource is loaded through the management virtual machine, the virtual resource is correspondingly generated in the management virtual machine, so that subsequent partitioning and management operations can be conveniently carried out through the generated virtual resource.
103. And judging whether the new hardware resources have the identification information or not.
After the new hardware resource is loaded into the management virtual machine, the management virtual machine will further read the identification information of the new hardware resource, and identify it through the identification information. The identification information is identification information used by the super-fusion storage system for hardware resource marking in the management system, namely, all resources added into the super-fusion storage system are marked with one piece of identification information by the system, and the identification information is unique in the system. Therefore, whether the new hardware resource is added into the super-fusion storage system once can be determined by judging whether the identification information exists in the new hardware resource, and for the hardware resource added into the system once, particularly for the storage hardware resources such as a disk, the super-fusion storage system can protect the data stored in the hardware, so that the adverse effect caused by data loss is prevented.
And executing step 104 when the identification information of the super-fusion storage system exists in the new hardware resource, and executing step 105 when the identification information of the super-fusion storage system does not exist in the new hardware resource.
104. And adding the new hardware resources into a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information.
When the identification information exists, it is stated that the hardware resource is a hardware resource added to the super-fusion storage system, and for the added hardware resource, the system loads the virtualization processing information for the hardware resource into the identification information in the form of identification, that is, the management virtual machine can directly determine the corresponding virtualization resource through the identification information, for example, for one disk, the management virtual machine can determine the division mode of the virtual disk corresponding to the disk in the super-fusion storage system according to the identification information, that is, determine to divide the virtual disk into several virtual disks, and determine the use of each virtual disk, that is, the virtual disk is used for storing hot data or cold data.
By reading the identification information, the virtual resources corresponding to the hardware resources can be quickly determined, so that the hardware resources can be quickly loaded into a hardware resource pool of the super-fusion storage system, and service resources for providing storage services for users by the system are formed.
105. And marking identification information for the new hardware resources, and adding the identification information into a hardware resource pool of the super-fusion storage system through the management virtual machine.
When the identification information does not exist, it is indicated that the new hardware resource is a new resource, and there is no corresponding identification information, so the management virtual machine will apply for the new hardware resource for the new unique identification information to the super-fusion storage system, and at the same time, perform identification detection on the new hardware resource, for example, for a disk storage resource, it is necessary to detect whether the type of the disk is a Solid State Disk (SSD) or a mechanical hard disk (HDD), where the solid state disk is generally used for storing hot data and the mechanical hard disk is used for storing cold data. For the specific way of identification and detection, the storage rate or storage capacity of the disk may be determined, and the embodiment of the present invention is not limited specifically. After the detection result is obtained, the management virtual machine adds the detection result to the unique identification information applied for the new hardware resource in the form of a label, and the identification information and the hardware resource form a one-to-one correspondence relationship.
After the new hardware resource is marked with the identification information, the management virtual machine will load the hardware resource into the hardware resource pool of the super-fusion storage system, and the operation is the same as the loading process in step 104, and therefore, the description is omitted here.
It can be seen from the foregoing implementation manner that the hardware resource management method based on the super-fusion storage system according to the embodiment of the present invention mainly implements real-time scanning and discovery of hardware resources in the super-fusion storage system, determines whether the loaded hardware resources are new resources, and quickly integrates the new hardware resources into the system through the management virtual machine to form a uniform hardware resource pool, and for non-new hardware resources, the non-new hardware resources can be identified through the existing identification information in the hardware resources and loaded into the system according to the original resource partitioning manner, so as to ensure that data in the hardware resources can be retained and provide the same storage service. Compared with the existing resource management mode, the hardware resource management scheme provided by the embodiment of the invention reduces repeated query of the whole storage system through matching of the identification information, reduces the workload of scanning and identifying resources and data in the storage system, and simultaneously, the application efficiency of the hardware resources is improved through integrated management of the management virtual machine on new hardware resources in each node of the system, so that the data access of a user is facilitated, and the data processing efficiency of the system and the application experience of the user are improved.
In order to describe in more detail the hardware resource management method based on the super-fusion storage system, especially for the specific process of managing the loading and virtualization of the hardware resources by the virtual machine, details will be described through the flowchart shown in fig. 3, in this embodiment, the hardware resources will be specifically described by taking a disk as an example, and the specific steps include:
201. and periodically scanning whether new disk resources exist in the local server by using a hardware resource management service.
For a disk capable of performing hot plug operation, the system needs to perform real-time scanning to determine whether a new disk is added, and performing real-time scanning consumes a large amount of processing resources in the local node server, so to balance the two, the scanning period needs to be set according to the actual condition of the node, for example, when the current node is a server that needs to frequently replace a disk, the period needs to be set shorter to ensure that the new disk can be found in real time. In the embodiment of the present invention, the scan disk may perform the detection operation through a SCSI (Small Computer System Interface) bus.
In addition, in the embodiment of the present invention, through the above scanning detection, it may be found whether there is a disk that is newly added, and when there is a removed disk, the corresponding virtual disk cannot perform the corresponding data access operation, so that when there is such a situation, the hardware resource management service that manages the running in the virtual machine deletes the corresponding virtual disk according to the detection result, and prevents the access operation of the user to the disk.
202. And if so, loading the new disk resource into the management virtual machine in a transparent transmission mode.
The execution process of this step is the same as that of step 102, except that what is used to load the disk into the management virtual machine is transparent transmission, that is, the transmission network is responsible for transmitting the service to be transmitted to the destination node regardless of the transmitted service, and at the same time, the transmission quality is guaranteed, and the transmitted service is not processed.
Loading the disk in the transparent transmission mode does not need to identify the content in the disk, so that the loading efficiency is greatly improved, and virtual disks corresponding to newly added disks one to one are established in the management virtual machine, which can be specifically shown in fig. 4. The management virtual machine B in the figure creates virtual disks corresponding to the loaded disks one by one, that is, the virtual disk F corresponds to the physical disk C, the virtual disk G corresponds to the physical disk D, and the virtual disk H corresponds to the physical disk E.
Further, the correspondence relationship established by the transparent transmission may further include specific data stored in the disk and related identification information.
203. And judging whether the new disk resources have the identification information or not.
The disk loaded into the management virtual machine in the transparent transmission manner, and the management virtual machine reads the identification information in the disk, and the specific determination may refer to step 103 described above, which is not described herein again.
If the identification information is read, step 204 is executed, otherwise step 205 is executed.
204. And adding the new disk resources into a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information.
When identification information exists in a disk is read, a system firstly obtains a disk name (namely a hardware identification) and a resource name (namely a virtual resource identification) in the identification information through a management virtual machine, wherein the disk name is an overall name of the disk, and the resource name is a name of a virtual storage unit redefined after a virtual disk corresponding to the disk is divided by the system, for example, if the virtual disk A is divided into two virtual resource units after being added into a super-fusion storage system: unit1 and Unit2, then A is the disk name and Unit1 and Unit2 are the resource names. When reading the name information, the name information also includes corresponding resource information, such as type information of the disk (SSD or HDD), or capacity information of the disk.
Then, according to the obtained disk name and resource name, the management virtual machine will directly determine the virtual storage unit corresponding to the disk, and add the virtual storage unit to the hardware resource pool of the super-fusion storage system, and for this, the adding operation will be implemented by the communication connection of the hardware management service in the node server to the cluster hardware resource pool service.
205. And marking identification information for the new disk resources, and adding the new disk resources into a hardware resource pool of the super-fusion storage system through the management virtual machine.
When the identification information exists in the disk which is not read, the disk is loaded into the super-fusion storage system for the first time, or the data content required by the super-fusion storage system does not exist on the disk. At this time, the hardware management service in the local node server formats the disk to ensure that the disk is added to the super-fusion storage system in a new disk form, and then loads the disk after the formatting processing to the management virtual machine for virtualization processing, at this time, the type of the disk resource is analyzed, in this step, it is specifically determined whether the disk is a disk of an SSD type or an HDD type, according to the analyzed disk type result, the system marks identification information for the disk, and the specific identification operation flow may refer to step 105, which is not described herein again. The purpose of marking the identification information in the disk is not only to identify the specific location and path information of the disk, but also to facilitate the cluster storage resource service to determine the storage service provided by the disk, i.e. to store hot data or cold data, by the type of the disk.
After the marking of the new disk is completed, the system adds the new disk to the hardware resource pool of the super-fusion storage system through the management virtual machine, and the specific manner is described in detail in step 204 and is not described here again.
206. And dividing the virtual resource units of the new disk resources by the hardware resource pool according to the identification information and preset rules.
After a new disk is added to a hardware resource pool of the super-fusion storage system, a cluster hardware resource pool service corresponding to the hardware resource pool divides the new disk into a plurality of virtual resource units according to identification information in the disk and a certain rule, where the division rule is not limited to a preset rule determined by a disk type and a disk capacity in the identification information, for example, the disk type is SSD and the disk capacity is 500G, the cluster hardware resource pool service divides the disk into two 250G virtual resource units according to a set storage requirement and sets corresponding names, such as Unit1 and Unit2, for the disk. Meanwhile, the system also marks corresponding access path information for the newly created virtual resource unit to determine that the virtual resource unit can provide corresponding data access service.
Thus, all physical disks in the super-converged storage system will have at least one virtual resource unit mapped in the hardware resource pool.
Further, as an implementation of the foregoing method, an embodiment of the present invention provides a hardware resource management apparatus based on a super-fusion storage system, where the apparatus embodiment corresponds to the foregoing method embodiment, and for convenience of reading, details in the foregoing method embodiment are not repeated in this apparatus embodiment one by one, but it should be clear that the apparatus in this embodiment can correspondingly implement all the contents in the foregoing method embodiment. The device is mainly used for optimizing the discovery and management mode of hardware resources in a hyper-converged storage system, so that the system has high-efficiency data processing capability, and provides more efficient operation response for user access operation, specifically as shown in fig. 5, the device comprises:
an inquiring unit 31, configured to periodically scan whether a new hardware resource exists in the local server by using the hardware resource management service;
a first loading unit 32, configured to load a new hardware resource into a management virtual machine in a local server when the new hardware resource is scanned by the querying unit 31;
a determining unit 33, configured to determine whether there is identification information in the new hardware resource queried by the querying unit 31, where the identification information is identification information used by the super-fusion storage system for hardware resource tagging in a management system;
a second loading unit 34, configured to, when the determining unit 33 determines that the new hardware resource has the identification information, add the new hardware resource to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information;
a marking unit 35, configured to mark identification information for the new hardware resource when the determining unit 33 determines that the identification information does not exist in the new hardware resource;
the second loading unit 34 is further configured to add the new hardware resource marked by the marking unit 35 to a hardware resource pool of the super-fusion storage system through the management virtual machine.
Further, as shown in fig. 6, the apparatus further includes:
a dividing unit 36, configured to divide, by the hardware resource pool, a virtual resource unit for the new hardware resource loaded by the second loading unit 34 according to the identification information and a preset rule, where the virtual resource unit is marked with a unique unit name and access path information.
Further, as shown in fig. 6, the second loading unit 34 includes:
an obtaining module 341, configured to obtain a hardware identifier and/or a virtual resource identifier in the identifier information;
a determining module 342, configured to determine a corresponding virtual resource unit according to the hardware identifier and/or the virtual resource identifier acquired by the acquiring module 341;
a loading module 343, configured to load the virtual resource unit determined by the determining module 342 into a hardware resource pool of the super-fusion storage system through a management virtual machine.
Further, as shown in fig. 6, the marking unit 35 includes:
the processing module 351 is configured to format the disk resource in the new hardware resource;
an analysis module 352, configured to analyze the type of the disk resource processed by the processing module 351;
the marking module 353 is configured to mark the corresponding identification information according to the type of the disk resource obtained by the analyzing module 352.
Further, the first loading unit 32 is further configured to load the new hardware resource into the management virtual machine in a transparent manner, so that a virtual resource unit in the management virtual machine corresponds to the new hardware resource in the server.
Further, as shown in fig. 6, the apparatus further includes:
the query unit 31 is further configured to periodically scan, by using a hardware resource management service, whether an original hardware resource in the local server is deleted;
a deleting unit 37, configured to delete the corresponding virtual hardware resource in the management virtual machine when the querying unit 31 determines that the original hardware resource in the local server is deleted.
Further, an embodiment of the present invention provides a hardware resource management terminal based on a super-fusion storage system, where the terminal is provided with the above hardware resource management device based on a super-fusion storage system, and the terminal is mainly applied to each node in the super-fusion storage system to monitor the change condition of the hardware resource in the node in real time, and in particular, for a disk storage resource and a hot-plugged disk, the terminal can more effectively identify whether the hot-plugged disk is a disk in the system, so as to effectively protect data in the disk. As shown in fig. 7, the terminal specifically includes a processor 41, a storage medium 42, and a transceiver 43:
the processor 41 is configured to periodically scan the terminal by using a hardware resource management service, and when a new hardware resource exists in the terminal, load the new hardware resource into a management virtual machine in the terminal; judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system; if the hardware resource exists, the transceiver 43 is utilized to add the new hardware resource to a hardware resource pool of the hyper-converged storage system through the management virtual machine according to the identification information; if not, marking identification information for the new hardware resource, and adding the identification information to a hardware resource pool of the hyper-converged storage system through the management virtual machine by using the transceiver 43;
the storage medium 42 is used for storing the program executed by the processor 41 and the storage data of the super-fusion storage system;
the transceiver 43 is configured to transceive the processing instructions executed by the processor 41, so that the terminal performs data interaction with other terminals in the super-convergence storage system.
Further, the program executed by the processor 41 further includes:
and dividing virtual resource units for the new hardware resources according to the identification information and preset rules based on the hardware resource pool, wherein the virtual resource units are marked with unique unit names and access path information.
Further, the terminal is further configured to, in the process of managing local hardware resources, obtain, by the processor 41, a hardware identifier and/or a virtual resource identifier in the identification information, and determine a corresponding virtual resource unit based on the hardware identifier and/or the virtual resource identifier; and the virtual resource unit is loaded into the hardware resource pool of the super-converged storage system by the transceiver 43.
In summary, the hardware resource management method, apparatus, and terminal based on the super-fusion storage system according to the embodiments of the present invention mainly implement real-time scanning and discovery of hardware resources in the super-fusion storage system, determine whether the loaded hardware resources are new resources, quickly integrate the new hardware resources into the system in a transparent transmission manner through the management virtual machine, form a uniform hardware resource pool, and identify non-new hardware resources through the identification information existing in the hardware resources, and load the hardware resources into the system according to the original resource partitioning manner, thereby ensuring that data in the hardware resources can be retained and provide the same storage service. Compared with the existing resource management mode, the hardware resource management scheme provided by the embodiment of the invention reduces repeated query of the whole storage system through matching of the identification information, reduces the workload of scanning and identifying resources and data in the storage system, and simultaneously, the application efficiency of the hardware resources is improved through integrated management of the management virtual machine on new hardware resources in each node of the system, so that the data access of a user is facilitated, and the data processing efficiency of the system and the application experience of the user are improved.
The hardware resource management device based on the super-fusion storage system comprises a processor and a memory, wherein the query unit, the first loading unit, the judgment unit, the second loading unit, the marking unit and the like are stored in the memory as program units, and the processor executes the program units stored in the memory to realize corresponding functions.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can be set to be one or more than one, the hardware resources can be rapidly identified by adjusting kernel parameters, and the newly added hardware resources are effectively managed.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The present application further provides a computer program product adapted to perform program code for initializing the following method steps when executed on a data processing device: periodically scanning whether new hardware resources exist in a local server by using a hardware resource management service; if yes, loading the new hardware resource into a management virtual machine in a local server; judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system; if the new hardware resource exists, the new hardware resource is added to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information; and if the new hardware resource does not exist, marking identification information for the new hardware resource, and adding the new hardware resource into a hardware resource pool of the super-fusion storage system through the management virtual machine.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A hardware resource management method based on a hyper-converged storage system is characterized by comprising the following steps:
periodically scanning whether new hardware resources exist in a local server by using a hardware resource management service;
if yes, loading the new hardware resource into a management virtual machine in a local server;
judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system;
if the new hardware resource exists, the new hardware resource is added to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information;
and if the new hardware resource does not exist, marking identification information for the new hardware resource, and adding the new hardware resource into a hardware resource pool of the super-fusion storage system through the management virtual machine.
2. The method of claim 1, further comprising:
and dividing virtual resource units for the new hardware resources by the hardware resource pool according to the identification information and preset rules, wherein the virtual resource units are marked with unique unit names and access path information.
3. The method of claim 1, wherein adding the new hardware resource to a hardware resource pool of a hyper-converged storage system via the management virtual machine according to the identification information comprises:
acquiring a hardware identifier and/or a virtual resource identifier in the identification information;
determining a corresponding virtual resource unit based on the hardware identifier and/or the virtual resource identifier;
and loading the virtual resource unit into a hardware resource pool of the super-fusion storage system through a management virtual machine.
4. The method according to any of claims 1-3, wherein tagging identification information for the new hardware resource comprises:
formatting the disk resources in the new hardware resources;
analyzing the type of the processed disk resource;
and marking corresponding identification information according to the type of the disk resource.
5. The method of claim 4, wherein loading the new hardware resource into a management virtual machine in a local server comprises:
and loading the new hardware resource into the management virtual machine in a transparent transmission mode, so that a virtual resource unit in the management virtual machine corresponds to the new hardware resource in the local server.
6. The method of claim 1, further comprising:
regularly scanning whether the original hardware resources in the local server are deleted by using a hardware resource management service;
and if the virtual hardware resources are deleted, deleting the corresponding virtual hardware resources in the management virtual machine.
7. A hardware resource management terminal based on a super-fusion storage system is characterized by comprising a processor, a storage medium and a transceiver;
the processor is used for periodically scanning the terminal by using a hardware resource management service, and loading a new hardware resource into a management virtual machine in the terminal when the new hardware resource exists in the terminal; judging whether the new hardware resources have identification information, wherein the identification information is identification information of hardware resource labels in a management system used by the super-fusion storage system; if the hardware resources exist, the transceiver is used for adding the new hardware resources into a hardware resource pool of the hyper-converged storage system through the management virtual machine according to the identification information; if the new hardware resource does not exist, marking identification information for the new hardware resource, and adding the new hardware resource into a hardware resource pool of the hyper-converged storage system through the management virtual machine by using the transceiver;
the storage medium is used for storing a program executed by the processor and storage data of the super-fusion storage system;
the transceiver is used for transceiving the processing instruction executed by the processor so as to enable the terminal to perform data interaction with other terminals in the super-convergence storage system.
8. The terminal of claim 7, wherein the processor executes the program further comprising:
and dividing virtual resource units for the new hardware resources according to the identification information and preset rules based on the hardware resource pool, wherein the virtual resource units are marked with unique unit names and access path information.
9. The terminal according to claim 7 or 8,
acquiring a hardware identifier and/or a virtual resource identifier in the identification information by the processor, and determining a corresponding virtual resource unit based on the hardware identifier and/or the virtual resource identifier;
loading, by the transceiver, the virtual resource units into a hardware resource pool of a hyper-converged storage system.
10. A hardware resource management device based on a super-converged storage system, wherein the device is arranged in the hardware resource management terminal based on a super-converged storage system according to any one of claims 7 to 9, and the device specifically comprises:
the query unit is used for regularly scanning whether new hardware resources exist in the local server by using the hardware resource management service;
the first loading unit is used for loading the new hardware resource into a management virtual machine in a local server when the inquiry unit scans the new hardware resource;
the judging unit is used for judging whether the new hardware resources inquired by the inquiring unit have identification information, and the identification information is identification information of the hardware resource label in the management system used by the super-fusion storage system;
the second loading unit is used for adding the new hardware resource to a hardware resource pool of the super-fusion storage system through the management virtual machine according to the identification information when the judging unit judges that the identification information exists in the new hardware resource;
the marking unit is used for marking the identification information for the new hardware resource when the judging unit judges that the identification information does not exist in the new hardware resource;
the second loading unit is further configured to add the new hardware resource marked by the marking unit to a hardware resource pool of the hyper-converged storage system through the management virtual machine.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711148411.5A CN107844274B (en) | 2017-11-17 | 2017-11-17 | Hardware resource management method, device and terminal based on super-fusion storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711148411.5A CN107844274B (en) | 2017-11-17 | 2017-11-17 | Hardware resource management method, device and terminal based on super-fusion storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107844274A CN107844274A (en) | 2018-03-27 |
| CN107844274B true CN107844274B (en) | 2021-03-16 |
Family
ID=61679648
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711148411.5A Active CN107844274B (en) | 2017-11-17 | 2017-11-17 | Hardware resource management method, device and terminal based on super-fusion storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107844274B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209466B (en) * | 2018-05-17 | 2023-10-13 | 腾讯科技（深圳）有限公司 | Resource allocation method, resource allocation device and storage medium |
| CN109375874B (en) * | 2018-09-28 | 2021-12-21 | 深信服科技股份有限公司 | Method, device and equipment for calling distributed storage |
| CN110389966B (en) * | 2019-06-28 | 2022-07-12 | 苏州浪潮智能科技有限公司 | Information processing method and device |
| CN112416495B (en) * | 2020-11-23 | 2023-05-26 | 山东乾云启创信息科技股份有限公司 | Unified management system and method for super-fusion cloud terminal resources |
| CN112434300B (en) * | 2020-11-23 | 2024-03-12 | 山东可信云信息技术研究院 | Trusted super-fusion system and control method |
| CN112433675B (en) * | 2020-11-23 | 2024-03-08 | 山东可信云信息技术研究院 | Storage space optimization method and system for super fusion architecture |
| CN113590033B (en) * | 2021-06-30 | 2023-11-03 | 郑州云海信息技术有限公司 | Information synchronization method and device of super fusion system |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7177267B2 (en) * | 2001-11-09 | 2007-02-13 | Adc Dsl Systems, Inc. | Hardware monitoring and configuration management |
| CN100351828C (en) * | 2002-06-06 | 2007-11-28 | 联想(北京)有限公司 | File access method based on a distributed file storage system |
| US7747831B2 (en) * | 2006-03-20 | 2010-06-29 | Emc Corporation | High efficiency portable archive and data protection using a virtualization layer |
| CA2886511A1 (en) * | 2013-06-11 | 2014-12-18 | Yin Sheng Zhang | Assembling of isolated remote data |
| US20160055579A1 (en) * | 2014-08-22 | 2016-02-25 | Vmware, Inc. | Decreasing time to market of a pre-configured hyper-converged computing device |
| US9557936B2 (en) * | 2014-12-31 | 2017-01-31 | Texas Instruments Incorporated | Protection of memories, datapath and pipeline registers, and other storage elements by distributed delayed detection and correction of soft errors |
| US9778865B1 (en) * | 2015-09-08 | 2017-10-03 | EMC IP Holding Company LLC | Hyper-converged infrastructure based on server pairs |
| CN106411574B (en) * | 2016-09-05 | 2020-01-03 | 新华三信息技术有限公司 | Management control method and device |
-
2017
- 2017-11-17 CN CN201711148411.5A patent/CN107844274B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107844274A (en) | 2018-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107844274B (en) | Hardware resource management method, device and terminal based on super-fusion storage system | |
| US10831562B2 (en) | Method and system for operating a data center by reducing an amount of data to be processed | |
| CN107807796B (en) | Data layering method, terminal and system based on super-fusion storage system | |
| CN107145489B (en) | Information statistics method and device for client application based on cloud platform | |
| CN107729219B (en) | Resource monitoring method, device and terminal based on super-fusion storage system | |
| CN112346829B (en) | Method and equipment for task scheduling | |
| CN112506659A (en) | Management method of edge device and related device | |
| CN110287696B (en) | Detection method, device and equipment for rebound shell process | |
| US20210037072A1 (en) | Managed distribution of data stream contents | |
| CN110928851B (en) | Method, device and equipment for processing log information and storage medium | |
| CN106331075B (en) | Method for storing file, metadata server and manager | |
| US10182104B1 (en) | Automatic propagation of resource attributes in a provider network according to propagation criteria | |
| CN111209256A (en) | File monitoring method and device, electronic equipment and storage medium | |
| CN111090440B (en) | Information processing method, system, device and storage medium | |
| CN112597151A (en) | Data processing method, device, equipment and storage medium | |
| CN115022198B (en) | Resource information acquisition method, equipment and storage medium | |
| CN112491943A (en) | Data request method, device, storage medium and electronic equipment | |
| CN115062092A (en) | Database access method, device, system and storage medium | |
| CN111600771B (en) | Network resource detection system and method | |
| CN114860432A (en) | Method and device for determining information of memory fault | |
| US20170364454A1 (en) | Method, apparatus, and computer program stored in computer readable medium for reading block in database system | |
| CN108810299B (en) | Information analysis method, medium and equipment | |
| WO2016067370A1 (en) | Information processing device, method, and program | |
| CN107862006B (en) | Method and device for realizing data source switching | |
| CN112597105A (en) | Processing method of file associated object, server side equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |