CN107844274A - Hardware resource management method, apparatus and terminal based on super fusion storage system - Google Patents

Hardware resource management method, apparatus and terminal based on super fusion storage system Download PDF

Info

Publication number
CN107844274A
CN107844274A CN201711148411.5A CN201711148411A CN107844274A CN 107844274 A CN107844274 A CN 107844274A CN 201711148411 A CN201711148411 A CN 201711148411A CN 107844274 A CN107844274 A CN 107844274A
Authority
CN
China
Prior art keywords
hardware resource
resource
management
identification information
storage system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711148411.5A
Other languages
Chinese (zh)
Other versions
CN107844274B (en
Inventor
张雅哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Lenovo Super Fusion Technology Co Ltd
Original Assignee
Beijing Lenovo Super Fusion Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Lenovo Super Fusion Technology Co Ltd filed Critical Beijing Lenovo Super Fusion Technology Co Ltd
Priority to CN201711148411.5A priority Critical patent/CN107844274B/en
Publication of CN107844274A publication Critical patent/CN107844274A/en
Application granted granted Critical
Publication of CN107844274B publication Critical patent/CN107844274B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0631Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662Virtualisation aspects
    • G06F3/0667Virtualisation aspects at data level, e.g. file, record or object virtualisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of hardware resource management method, apparatus and terminal based on super fusion storage system, it is related to technical field of data processing, main purpose is quickly to identify hardware resource, and newly-increased hardware resource is effectively managed.The main technical scheme of the present invention is:Serviced using hardware resource management in periodic scanning home server and whether there is new hardware resource;If in the presence of the new hardware resource is loaded onto in the management virtual machine in home server;Judge to whether there is identification information in the new hardware resource, the identification information for the hardware resource mark that the identification information is used in management system for the super fusion storage system;If in the presence of, according to the identification information by the new hardware resource by the management virtual machine added in the hardware resource pool of super fusion storage system;If being not present, identification information is marked for the new hardware resource, and be added in the hardware resource pool of super fusion storage system by the management virtual machine.

Description

Hardware resource management method, apparatus and terminal based on super fusion storage system
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of hardware resource pipe based on super fusion storage system Manage method, apparatus and terminal.
Background technology
Super fusion storage system is a kind of distributed memory system of object-oriented.Super fusion refers to set in same set of unit Not only possess the resources such as calculating, network, storage and server virtualization and technology in standby, but also including cloud management software, The elements such as data reconstruction, more copies, snapping technique, and multinode can be got up by network polymerization, be realized modular seamless It is extending transversely, form unified resource pool.
In super fusion storage system, most crucial hardware resource includes server resource and disk resource.And due to super Distributed, the high extended attribute of storage system is merged, causes the hardware resource that is extended is identified and added in system Operation to system will extremely consume system resource, and especially for isomerization hardware resource, system is carried out in detail with greater need for it Scanning recognition, confirm it is errorless after can add it to system, meanwhile, for the super fusion most important money of storage system Source is stored in the data message on disk, and for the disk resource of extension, system needs to believe the data in the disk resource Breath effectively identify and protection can also consume substantial amounts of system processing resources, therefore, how efficiently to find and manages super melt The hardware resource for closing storage system will directly affect the data-handling efficiency of super fusion storage system.
The content of the invention
In view of this, the present invention provides a kind of hardware resource management method, apparatus based on super fusion storage system and end End, main purpose are quickly to identify hardware resource, and newly-increased hardware resource is effectively managed.
To reach above-mentioned purpose, present invention generally provides following technical scheme:
On the one hand, the invention provides a kind of hardware resource management method based on super fusion storage system, this method bag Include:
Serviced using hardware resource management in periodic scanning home server and whether there is new hardware resource;
If in the presence of the new hardware resource is loaded onto in the management virtual machine in home server;
Judge to whether there is identification information in the new hardware resource, the identification information is the super fusion storage system Identification information for the hardware resource mark in management system;
If in the presence of the new hardware resource is melted by the management virtual machine added to super according to the identification information In the hardware resource pool for closing storage system;
If being not present, identification information is marked for the new hardware resource, and be added to and surpass by the management virtual machine In the hardware resource pool for merging storage system.
Preferably, methods described also includes:
The new hardware resource is divided virtually according to presetting rule according to the identification information by the hardware resource pool Resource unit, the virtual resource unit are marked with unique unit title and access path information.
Preferably, the new hardware resource is merged by the management virtual machine added to super according to the identification information The hardware resource pool of storage system includes:
Obtain the hardware identifier and/or virtual resource mark in the identification information;
Based on virtual resource unit corresponding to the hardware identifier and/or virtual resource mark determination;
The virtual resource unit is loaded onto in the hardware resource pool of super fusion storage system by managing virtual machine.
Preferably, identification information is marked to include for the new hardware resource:
Processing is formatted to the disk resource in the new hardware resource;
The type of disk resource after analyzing and processing;
According to identification information corresponding to the type mark of the disk resource.
Preferably, the management virtual machine that the new hardware resource is loaded onto in home server is included:
The new hardware resource is loaded in a manner of transparent transmission in the management virtual machine, to cause the management virtual Virtual resource unit in machine is corresponding with the new hardware resource in the server.
Preferably, methods described also includes:
Service whether the former hardware resource in periodic scanning home server is deleted using hardware resource management;
If being deleted, the virtual hardware resource corresponding to deletion in the management virtual machine.
On the other hand, it is described present invention also offers a kind of hardware resource management terminal based on super fusion storage system Terminal includes processor, storage medium and transceiver;
The processor is used for using terminal described in hardware resource management service periodic scanning, new when existing in the terminal During hardware resource, the new hardware resource is loaded onto in the management virtual machine in the terminal;Judge the new hardware resource In whether there is identification information, the hardware resource mark that the identification information is used in management system for the super fusion storage system The identification information of note;If in the presence of the utilization transceiver passes through the new hardware resource according to the identification information described Virtual machine is managed to be added in the hardware resource pool of super fusion storage system;If being not present, marked for the new hardware resource Identification information, and the hardware resource pool using the transceiver by the management virtual machine added to super fusion storage system In;
The storage medium is used for the program for storing the computing device, and the storage of the super fusion storage system Data;
The transceiver is used to receive and dispatch process instruction performed by the processor, with cause the terminal with it is described surpass melt The other-end closed in storage system carries out data interaction.
Preferably, the program of the computing device also includes:
Void is divided to the new hardware resource according to presetting rule according to the identification information based on the hardware resource pool Intend resource unit, the virtual resource unit is marked with unique unit title and access path information.
Preferably, the terminal is additionally operable to,
The hardware identifier and/or virtual resource mark in the identification information are obtained by the processor, and based on described Virtual resource unit corresponding to hardware identifier and/or virtual resource mark determination;
The virtual resource unit is loaded onto in the hardware resource pool of super fusion storage system by the transceiver.
On the other hand, present invention also offers a kind of hardware resource management device based on super fusion storage system, the dress Put including:
Query unit, for being provided using in hardware resource management service periodic scanning home server with the presence or absence of new hardware Source;
First loading unit, for when new hardware resource is arrived in query unit scanning, the new hardware resource to be added It is loaded onto in the management virtual machine in home server;
Judging unit, it whether there is identification information, institute in the new hardware resource inquired for judging the query unit State the identification information for the hardware resource mark that identification information is used in management system for the super fusion storage system;
Second loading unit, for when the judging unit judges identification information to be present in the new hardware resource, root The new hardware resource is provided by the management virtual machine added to the hardware of super fusion storage system according to the identification information In the pond of source;
Indexing unit, for when the judging unit judges identification information is not present in the new hardware resource, for institute State new hardware resource mark identification information;
Second loading unit is additionally operable to, and the labeled new hardware resource of the indexing unit is passed through into the pipe Virtual machine is managed to be added in the hardware resource pool of super fusion storage system.
Preferably, described device also includes:
Division unit, for being added by the hardware resource pool according to the identification information according to presetting rule to described second Carrier unit loading new hardware resource division virtual resource unit, the virtual resource unit be marked with unique unit title and Access path information.
Preferably, second loading unit includes:
Acquisition module, for obtaining hardware identifier and/or virtual resource mark in the identification information;
Determining module, hardware identifier and/or the virtual resource mark for being obtained based on the acquisition module determine corresponding Virtual resource unit;
Load-on module, for the virtual resource unit to be loaded onto into the hard of super fusion storage system by managing virtual machine In part resource pool.
Preferably, the indexing unit includes:
Processing module, for being formatted processing to the disk resource in the new hardware resource;
Analysis module, for analyzing the type of the disk resource after the processing module is handled;
Mark module, for identification information corresponding to the type mark of the disk resource obtained according to the analysis module.
Preferably, first loading unit is additionally operable to, and the new hardware resource is loaded in a manner of transparent transmission described Manage in virtual machine, to cause the virtual resource unit in the management virtual machine and the new hardware resource phase in the server It is corresponding.
Preferably, described device also includes:
The query unit is additionally operable to, and the former hardware serviced using hardware resource management in periodic scanning home server is provided Whether source is deleted;
Unit is deleted, during for determining that the former hardware resource in home server is deleted when the query unit, in institute State virtual hardware resource corresponding to being deleted in management virtual machine.
According to the invention described above proposed it is a kind of based on it is super fusion storage system hardware resource management method, apparatus and Terminal, mainly realize and the real time scan of hardware resource in super fusion storage system is found, and determine the hardware resource of loading Whether it is new resources, new hardware resource is quickly incorporated into system by managing virtual machine, forms unified hardware resource pool, And for non-new hardware resource, can also be by its identification of existing identification information pair in the hardware resource, and by it according to original Some resource dividing modes are loaded into system, so as to which the data ensured in the hardware resource can retain and provide same deposit Storage service.It is proposed by the invention that identification information is passed through to hardware resource management scheme relatively with existing resource management mode Matching reduce the repetition inquiry to whole storage system, reduce scanning to the resource in storage system and data and know Other workload, meanwhile, the integration management carried out by managing virtual machine in each node of system to new hardware resource, So that the application efficiency of hardware resource is improved, it is easy to access of the user to data, so as to improve the data processing of system Efficiency and the application experience of user.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings:
Fig. 1 shows a kind of hardware resource management method based on super fusion storage system that the embodiment of the present invention proposes Flow chart;
Fig. 2 shows the super fusion storage system service graph of a relation that the embodiment of the present invention proposes;
Fig. 3 shows another hardware resource management method based on super fusion storage system that the embodiment of the present invention proposes Flow chart;
Fig. 4 shows the management virtual machine transparent transmission loading disk schematic diagram that the embodiment of the present invention proposes;
Fig. 5 shows a kind of hardware resource management device based on super fusion storage system that the embodiment of the present invention proposes Composition frame chart;
Fig. 6 shows another hardware resource management device based on super fusion storage system that the embodiment of the present invention proposes Composition frame chart;
Fig. 7 shows a kind of hardware resource management terminal based on super fusion storage system that the embodiment of the present invention proposes Composition frame chart.
Embodiment
The exemplary embodiment of the present invention is more fully described below with reference to accompanying drawings.Although the present invention is shown in accompanying drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the present invention without should be by embodiments set forth here Limited.Conversely, there is provided these embodiments are to be able to be best understood from the present invention, and can be by the scope of the present invention Completely it is communicated to those skilled in the art.
The embodiments of the invention provide a kind of hardware resource management method based on super fusion storage system, as shown in figure 1, This method can be rapidly melted when increasing hardware resource for each node server in super fusion storage system The implementation for being bonded in system and efficiently being managed.The specific steps of this method include:
101st, serviced using hardware resource management in periodic scanning home server and whether there is new hardware resource.
Super fusion storage system in the embodiment of the present invention is by multiple node server institutes group using distributed arrangement Into system, each node server can add some hardware resources in real time in the storage system, such as, disk, The hardware resources such as internal memory, and these hardware resources particularly disk is all to support hot plug operations.Therefore, just need system energy Whether there is in enough monitor node servers in real time has the hardware resource newly increased.And be used by the embodiment of the present invention A hardware resource management service is run in each node server of super fusion storage system, the service is used for periodic scanning sheet Hardware resource in ground server, so as to judge to whether there is new hardware resource in home server.
It should be noted that hardware resource management service operation is started shooting in each node server, and for server The service content of startup, in general, running the hardware resource management service needs to set a management virtual machine in the server, Hardware resource management service is run by the management virtual machine, and the scan period of the hardware resource management service is according to user Demand and specific application scenarios and set.
In addition, super fusion storage system in embodiments of the present invention has one except being run in each node server Outside hardware resource management services, also being run in the server cluster of whole super fusion storage system has a cluster hardware resource Pond services and a cluster-based storage resource management service.Wherein, cluster hardware resource pool is serviced for all in integration system Hardware resource, virtualization process is carried out according to its corresponding attribute to the hardware resource in each node server, and will processing Result afterwards reports cluster-based storage resource management service.And the system that cluster-based storage resource management service then obtains according to statistics In virtual storage resource provide a user storage service, meanwhile, pass through the hardware resource management in each node server Access request and operation of the service response user to data storage.It is can be found in for the relation between above-mentioned three shown in Fig. 2 Super fusion storage system service graph of a relation.
If the 102nd, in the presence of new hardware resource is loaded onto in the management virtual machine in home server.
According to the content described in step 101, when hardware resource management service-seeking there are newly firmly into local node During part resource, hardware resource management service will read the new hardware resource by the management virtual machine run in home server, So that the resource be identified, its type is judged, such as, it is necessary to judge that the resource is disk storage resource, or caching Process resource etc..
And when loading the new hardware resource by managing virtual machine, it is corresponding to generate virtual money by corresponding in virtual machine is managed Source, follow-up division and management operation are carried out in order to pass through generated virtual resource.
103rd, judge to whether there is identification information in new hardware resource.
After new hardware resource is loaded into management virtual machine, management virtual machine will further read the new hardware money The identification information in source, by identification information pair, it is identified.Wherein, the identification information is used to manage for super fusion storage system The identification information of hardware resource mark in system, that is, all resources being added in super fusion storage system all will be by system mark One identification information of note, and the identification information is unique within the system.Therefore, by judging whether deposited in new hardware resource In identification information, it is possible to determine whether the new hardware resource is once to add the super fusion storage system, and for once Through adding the hardware resource of the system, especially for the storage hardware resource such as disk, surpassing fusion storage system will be to hard The data stored in part are protected, prevent loss of data and caused adverse effect.
When judging to exist in new hardware resource the identification information of super fusion storage system, step 104 is performed, it is new when judging When the identification information of super fusion storage system being not present in hardware resource, then step 105 is performed.
The 104th, new hardware resource is added to the hardware of super fusion storage system according to identification information by managing virtual machine In resource pool.
When identification information be present, it is the hardware resource added in super fusion storage system to illustrate the hardware resource, and To the hardware resource of crossing of addition, system will be loaded into mark according to the virtualization process information to the hardware resource in the form of identifying To know in information, that is to say, that management virtual machine can directly determine its corresponding virtual resources by the identification information, than Such as, for a disk, virtual disk is adding super melt according to corresponding to identification information management virtual machine can determine the disk Close the dividing mode in storage system, that is, determine to be divided into several virtual disks, while determine the purposes of each virtual disk, i.e., it is empty Intend disk to be used to store dsc data or cold data.
By the reading to identification information, the virtual resource corresponding to hardware resource can be quickly determined, so as to Quickly the hardware resource is loaded into the hardware resource pool of super fusion storage system, forms the system and provide a user storage The Service Source of service.
105th, identification information is marked for new hardware resource, and by managing virtual machine added to the hard of super fusion storage system In part resource pool.
When in the absence of identification information, it is new resources to illustrate the new hardware resource, the identification information without corresponding to, therefore, Management virtual machine will correspond to new unique identification information for the new hardware resource to super fusion storage system application, meanwhile, to this Detection is identified in new hardware resource, such as, for disk storage resource, it is necessary to which the type for detecting the disk is solid state hard disc (SSD) or mechanical hard disk (HDD), and solid state hard disc is generally used for storing dsc data, mechanical hard disk is then used to store cold data. For the concrete mode of recognition detection, the index such as memory rate or memory capacity that can be by judging disk, to this present invention Embodiment is not specifically limited.After testing result is obtained, the testing result is added in the form of a label by management virtual machine Into the unique identification information for the new hardware resource application, and the identification information will be formed correspondingly with the hardware resource Relation.
After new hardware resource labeled upper identification information, the hardware resource can be loaded into super fusion and deposit by management virtual machine In the hardware resource pool of storage system, the operation is identical with the loading procedure in step 104, and therefore, here is omitted.
It is can be seen that with reference to above-mentioned implementation used by the embodiment of the present invention based on the hard of super fusion storage system Part method for managing resource, mainly realize and the real time scan of hardware resource in super fusion storage system is found, and determine to load Hardware resource whether be new resources, new hardware resource is quickly incorporated into system by managing virtual machine, formed unified Hardware resource pool, and for non-new hardware resource, can also by its identification of existing identification information pair in the hardware resource, and It is loaded into system according to original resource dividing mode, so as to which the data ensured in the hardware resource can retain and carry For same storage service.It is relative with existing resource management mode, the embodiment of the present invention proposed to hardware resource management Scheme is inquired about by the matching of identification information come the repetition reduced to whole storage system, is reduced to the resource in storage system And the workload of the scanning recognition of data, meanwhile, by managing virtual machine in each node of system to new hardware resource The integration management of progress, also the application efficiency of hardware resource is improved, is easy to access of the user to data, so as to be lifted The data-handling efficiency of system and the application experience of user.
In order to which a kind of hardware resource management side based on super fusion storage system proposed by the present invention is explained in more detail Method, especially for management virtual machine loading hardware resource and the detailed process virtualized to it, stream shown in Fig. 3 will be passed through Journey figure is described in detail, and specifically will be illustrated in this embodiment for hardware resource by taking disk as an example, its specific steps Including:
201st, serviced using hardware resource management in periodic scanning home server and whether there is new disk resource.
For it can carry out the disk of hot plug operations, system needs to carry out scanning in real time to judge whether New disk adds, and to accomplish a large amount of process resources that real time scan will be consumed in local node server, therefore, in order to take Balance between the two is obtained, the scan period just needs to be set according to the actual conditions of node, such as, present node is one When needing often to change the server of disk, it is necessary to newly-increased to guarantee to find in real time by the shorter of cycle setting Disk.In the embodiment of the present invention, scanning disk can pass through SCSI (small computer system interface, Small Computer System Interface) operation of bus perform detection.
In addition, in embodiments of the present invention, by above-mentioned Scanning Detction, in addition to the disk for finding newly to add, may be used also To discover whether to exist the disk pulled out, and when removed disk be present, its corresponding virtual disk will be unable to perform Corresponding data access operation, therefore, when the situation be present, the hardware resource management service that runs is managed in virtual machine by root According to testing result delete corresponding to virtual disk, prevent user for the disk access operate.
If the 202nd, in the presence of, by new disk resource be loaded in a manner of transparent transmission management virtual machine in.
With the 102 of above-mentioned steps, it is distinguished in disk to be loaded into institute in management virtual machine the implementation procedure of this step Using transparent transmission mode, transparent transmission is transparent transmission, that is, transmission network, regardless of the business of transmission, being only responsible for need to The business to be transmitted is sent to destination node, while ensures the quality of transmission, without handling the business of transmission.
Disk is loaded without the content in disk is identified by transparent transmission mode, the loading efficiency greatly improved, and And the one-to-one virtual disk of disk that will be established and newly add in virtual machine is managed, Fig. 4 is for details, reference can be made to, management is virtual Machine transparent transmission loads disk schematic diagram.Management virtual machine B in figure creates the one-to-one virtual disk of disk with loading, i.e., Virtual disk F corresponds to physical disk C, and virtual disk G corresponds to physical disk D, and virtual disk H corresponds to physical disk E.
Further, the corresponding relation established by transparent transmission can also include the specific data stored in disk, with And related identification information.
203rd, judge to whether there is identification information in new disk resource.
Disk in management virtual machine is loaded into by transparent transmission mode, management virtual machine believes the mark read in the disk Breath, specific to judge to refer to above-mentioned steps 103, here is omitted.
Step 204 is performed if identification information is read, otherwise performs step 205.
The 204th, new disk resource is added to the hardware of super fusion storage system according to identification information by managing virtual machine In resource pool.
When read identification information be present in disk when, system first pass through management virtual machine obtain in the identification information Disk name (i.e. hardware identifier) and resource name (i.e. virtual resource identify), wherein Disk name is the overall name of the disk Claim, and resource name be then the disk corresponding to virtual disk divided by system after the name of virtual memory cell that redefines Claim, such as, if virtual disk A has been divided into two virtual resource units again after super fusion storage system is added:Unit1 and Unit2, then A is Disk name, and Unit1 and Unit2 are exactly resource name.It should be noted that reading above-mentioned name When claiming information, corresponding resource information is also recorded in these name informations, such as the type information (being SSD or HDD) of disk, Either capacity information of disk etc..
Afterwards, will directly be determined corresponding to the disk according to acquired Disk name and resource name, management virtual machine Virtual memory cell, and by the virtual memory cell be added to it is super fusion storage system hardware resource pool in, on the other hand, this adds Add operation connects the communication that cluster hardware resource pool service is served by the hardware management in node server to realize, right Then it is not especially limited in the specific data transfer mode embodiment of the present invention.
205th, identification information is marked for new disk resource, and by managing virtual machine added to the hard of super fusion storage system In part resource pool.
When do not read identification information be present in disk when, it is to load the super fusion storage system for the first time to illustrate the disk In, or the super data content merged required for storage system is not present on the disk.Now, in local node server Hardware management service will be formatted processing to the disk, it is ensured that the disk is added to super fusion storage in the form of new disk In system, then disk after formatting is handled is loaded into management virtual machine and carries out virtualization process, and now the disk is provided The type in source is analyzed, and is specially to judge that the disk is the disk of SSD types or HDD types in this step, according to analysis The disk type result gone out, it is the disk label identification information by system, is specifically identified operating process and refers to step 105, this Place repeats no more.Purpose of the identification information mark in disk is applied not only to identify to the particular location and path letter of the disk Breath, in addition to be easy to cluster-based storage resource service to determine the storage service that the disk provides by the type of the disk type, i.e., For storing dsc data or cold data.
After completing to the mark of new disk, system is by by managing virtual machine added to the hardware of super fusion storage system In resource pool, concrete mode is described in detail in step 204, and here is omitted.
206th, virtual resource unit is divided to new disk resource according to presetting rule according to identification information by hardware resource pool.
After in the hardware resource pool that new disk is added into super fusion storage system, the collection corresponding to hardware resource pool Identification information in the disk is divided into multiple virtual resources by group's hardware resource pool service according to certain rule Unit, and it is the presetting rule determined by the disk type in identification information and disk size that the rule divided, which does not limit, For example the type of disk is SSD, and the disk size is 500G, then the service of cluster hardware resource pool is according to the storage of setting Demand, the disk is divided into two 250G virtual resource unit, and is title corresponding to its setting, such as Unit1 and Unit2. Meanwhile system will also for newly create virtual resource unit mark corresponding to access path information, to determine the virtual resource list Member can provide corresponding data access service.
In this way, all physical disks in super fusion storage system will be all mapped with hardware resource pool it is at least one Virtual resource unit.
Further, as the realization to the above method, the embodiments of the invention provide one kind based on super fusion storage system The hardware resource management device of system, the device embodiment is corresponding with preceding method embodiment, for ease of reading, present apparatus embodiment No longer the detail content in preceding method embodiment is repeated one by one, it should be understood that the device in the present embodiment can The corresponding full content realized in preceding method embodiment.The device is mainly used in super fusion storage system to hardware resource It was found that the optimization processing with way to manage, allows system to have efficient data processing ability, while access operation for user and provide more Efficient operation response, specifically as shown in figure 5, the device includes:
Query unit 31, it whether there is new hardware for being serviced using hardware resource management in periodic scanning home server Resource;
First loading unit 32, for when new hardware resource is arrived in the query unit 31 scanning, the new hardware to be provided Source is loaded onto in the management virtual machine in home server;
Judging unit 33, with the presence or absence of mark letter in the new hardware resource inquired for judging the query unit 31 Breath, the identification information for the hardware resource mark that the identification information is used in management system for the super fusion storage system;
Second loading unit 34, for judging identification information be present in the new hardware resource when the judging unit 33 When, the new hardware resource is merged by the hard of storage system added to super by the management virtual machine according to the identification information In part resource pool;
Indexing unit 35, for when the judging unit 33 judges identification information is not present in the new hardware resource, Identification information is marked for the new hardware resource;
Second loading unit 34 is additionally operable to, and the labeled new hardware resource of the indexing unit 35 is passed through into institute Management virtual machine is stated to be added in the hardware resource pool of super fusion storage system.
Further, as shown in fig. 6, described device also includes:
Division unit 36, for by the hardware resource pool according to the identification information according to presetting rule to described second The new hardware resource division virtual resource unit that loading unit 34 loads, the virtual resource unit are marked with unique unit name Claim and access path information.
Further, as shown in fig. 6, second loading unit 34 includes:
Acquisition module 341, for obtaining hardware identifier and/or virtual resource mark in the identification information;
Determining module 342, hardware identifier and/or the virtual resource mark for being obtained according to the acquisition module 341 are true Virtual resource unit corresponding to fixed;
Load-on module 343, for the virtual resource unit that the determining module 342 determines to be loaded by managing virtual machine Into the hardware resource pool of super fusion storage system.
Further, as shown in fig. 6, the indexing unit 35 includes:
Processing module 351, for being formatted processing to the disk resource in the new hardware resource;
Analysis module 352, for analyzing the type of the disk resource after the processing module 351 is handled;
Mark module 353, for mark corresponding to the type mark of the disk resource obtained according to the analysis module 352 Information.
Further, first loading unit 32 is additionally operable to, and the new hardware resource is loaded in a manner of transparent transmission In the management virtual machine, to cause the virtual resource unit in the management virtual machine to be provided with the new hardware in the server Source is corresponding.
Further, as shown in fig. 6, described device also includes:
The query unit 31 is additionally operable to, and the former hardware in periodic scanning home server is serviced using hardware resource management Whether resource is deleted;
Unit 37 is deleted, when the former hardware resource for being determined when the query unit 31 in home server is deleted, Virtual hardware resource corresponding to being deleted in the management virtual machine.
Further, the embodiments of the invention provide it is a kind of based on it is super fusion storage system hardware resource management terminal, The above-mentioned hardware resource management device based on super fusion storage system is provided with the terminal, the terminal is mainly used in super melt Close in each node in storage system, the situation of change of hardware resource in real-time monitoring node, especially for disk storage Resource, for the disk of hot plug, it more can effectively identify whether it is once the disk in the system, is had by the terminal Effect is protected by the data in disk.Wherein, as shown in fig. 7, specifically including processor 41, storage medium 42 in the terminal And transceiver 43:
The processor 41 is used to, using terminal described in hardware resource management service periodic scanning, when in the terminal exist During new hardware resource, the new hardware resource is loaded onto in the management virtual machine in the terminal;Judge the new hardware money It whether there is identification information, the hardware resource that the identification information is used in management system for the super fusion storage system in source The identification information of mark;If in the presence of the new hardware resource is passed through according to the identification information using the transceiver 43 The management virtual machine is added in the hardware resource pool of super fusion storage system;If being not present, for the new hardware resource Identification information is marked, and is provided using the transceiver 43 by the management virtual machine added to the hardware of super fusion storage system In the pond of source;
The program that the storage medium 42 performs for storing the processor 41, and the super fusion storage system Data storage;
The transceiver 43 is used to receive and dispatch process instruction performed by the processor 41, with cause the terminal with it is described Other-end in super fusion storage system carries out data interaction.
Further, the program that processor 41 performs also includes:
Void is divided to the new hardware resource according to presetting rule according to the identification information based on the hardware resource pool Intend resource unit, the virtual resource unit is marked with unique unit title and access path information.
Further, the terminal is additionally operable to during local hardware resources are managed, and is obtained by the processor 41 Hardware identifier and/or virtual resource mark in the identification information, and identified based on the hardware identifier and/or virtual resource It is determined that corresponding virtual resource unit;And the virtual resource unit is loaded onto super fusion storage system by the transceiver 43 Hardware resource pool in.
In summary, the hardware resource management method based on super fusion storage system used by the embodiment of the present invention, dress Put and terminal, mainly realize and the real time scan of hardware resource in super fusion storage system is found, and determine the hardware of loading Whether resource is new resources, and new hardware resource is quickly incorporated into system in a manner of transparent transmission by managing virtual machine, forms system One hardware resource pool, and for non-new hardware resource, its knowledge of existing identification information pair in the hardware resource can also be passed through Not, and by it according to original resource dividing mode it is loaded into system, so as to which the data ensured in the hardware resource can protect Stay and same storage service is provided.Relatively with existing resource management mode, what the embodiment of the present invention was proposed provides to hardware Power management schemes are inquired about by the matching of identification information come the repetition reduced to whole storage system, are reduced in storage system Resource and data scanning recognition workload, meanwhile, by managing virtual machine in each node of system to new hard The integration management that part resource is carried out, also the application efficiency of hardware resource is improved, is easy to access of the user to data, from And improve the data-handling efficiency of system and the application experience of user.
The hardware resource management device based on super fusion storage system includes processor and memory, above-mentioned cargo tracer Member, the first loading unit, judging unit, the second loading unit and indexing unit etc. are stored in memory as program unit In, corresponding function is realized by the said procedure unit of computing device storage in memory.
Kernel is included in processor, is gone in memory to transfer corresponding program unit by kernel.Kernel can set one Or more, quick identification hardware resource is realized by adjusting kernel parameter, and newly-increased hardware resource is effectively managed.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/ Or the form such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM), memory includes at least one deposit Store up chip.
Present invention also provides a kind of computer program product, when being performed on data processing equipment, is adapted for carrying out just The program code of beginningization there are as below methods step:Serviced in periodic scanning home server and whether there is using hardware resource management New hardware resource;If in the presence of the new hardware resource is loaded onto in the management virtual machine in home server;Described in judgement It whether there is identification information in new hardware resource, the identification information is used in management system for the super fusion storage system The identification information of hardware resource mark;If in the presence of the new hardware resource is passed through into the management according to the identification information Virtual machine is added in the hardware resource pool of super fusion storage system;If being not present, for the new hardware resource mark mark Information, and be added to by the management virtual machine in the hardware resource pool of super fusion storage system.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program Product.Therefore, the application can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.Moreover, the application can use the computer for wherein including computer usable program code in one or more The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) The form of product.
The application is with reference to the flow according to the method for the embodiment of the present application, equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net Network interface and internal memory.
Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/ Or the form such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Memory is computer-readable Jie The example of matter.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moved State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM), Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus Or any other non-transmission medium, the information that can be accessed by a computing device available for storage.Define, calculate according to herein Machine computer-readable recording medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
It should also be noted that, term " comprising ", "comprising" or its any other variant are intended to nonexcludability Comprising so that process, method, commodity or equipment including a series of elements not only include those key elements, but also wrapping Include the other element being not expressly set out, or also include for this process, method, commodity or equipment intrinsic want Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including key element Other identical element in process, method, commodity or equipment also be present.
It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer program product. Therefore, the application can be using the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Form.Deposited moreover, the application can use to can use in one or more computers for wherein including computer usable program code The shape for the computer program product that storage media is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) Formula.
Embodiments herein is these are only, is not limited to the application.To those skilled in the art, The application can have various modifications and variations.All any modifications made within spirit herein and principle, equivalent substitution, Improve etc., it should be included within the scope of claims hereof.

Claims (10)

  1. A kind of 1. hardware resource management method based on super fusion storage system, it is characterised in that methods described includes:
    Serviced using hardware resource management in periodic scanning home server and whether there is new hardware resource;
    If in the presence of the new hardware resource is loaded onto in the management virtual machine in home server;
    Judge to whether there is identification information in the new hardware resource, the identification information is used for for the super fusion storage system The identification information of hardware resource mark in management system;
    If in the presence of, according to the identification information by the new hardware resource by it is described management virtual machine deposited added to super fusion In the hardware resource pool of storage system;
    If being not present, identification information is marked for the new hardware resource, and merged added to super by the management virtual machine In the hardware resource pool of storage system.
  2. 2. according to the method for claim 1, it is characterised in that methods described also includes:
    Virtual resource is divided to the new hardware resource according to presetting rule according to the identification information by the hardware resource pool Unit, the virtual resource unit are marked with unique unit title and access path information.
  3. 3. according to the method for claim 1, it is characterised in that passed through the new hardware resource according to the identification information The management virtual machine includes added to the hardware resource pool of super fusion storage system:
    Obtain the hardware identifier and/or virtual resource mark in the identification information;
    Based on virtual resource unit corresponding to the hardware identifier and/or virtual resource mark determination;
    The virtual resource unit is loaded onto in the hardware resource pool of super fusion storage system by managing virtual machine.
  4. 4. according to the method any one of claim 1-3, it is characterised in that for the new hardware resource mark mark letter Breath includes:
    Processing is formatted to the disk resource in the new hardware resource;
    The type of disk resource after analyzing and processing;
    According to identification information corresponding to the type mark of the disk resource.
  5. 5. according to the method for claim 4, it is characterised in that the new hardware resource is loaded onto in home server Management virtual machine includes:
    The new hardware resource is loaded in a manner of transparent transmission in the management virtual machine, to cause in the management virtual machine Virtual resource unit it is corresponding with the new hardware resource in the server.
  6. 6. according to the method for claim 1, it is characterised in that methods described also includes:
    Service whether the former hardware resource in periodic scanning home server is deleted using hardware resource management;
    If being deleted, the virtual hardware resource corresponding to deletion in the management virtual machine.
  7. 7. it is a kind of based on it is super fusion storage system hardware resource management terminal, it is characterised in that the terminal include processor, Storage medium and transceiver;
    The processor is used for using terminal described in hardware resource management service periodic scanning, when new hardware in the terminal being present During resource, the new hardware resource is loaded onto in the management virtual machine in the terminal;Judge be in the new hardware resource It is no identification information to be present, the hardware resource mark that the identification information is used in management system for the super fusion storage system Identification information;If in the presence of the new hardware resource is passed through the management by the utilization transceiver according to the identification information Virtual machine is added in the hardware resource pool of super fusion storage system;If being not present, for the new hardware resource mark mark Information, and be added to using the transceiver by the management virtual machine in the hardware resource pool of super fusion storage system;
    The storage medium is used for the program for storing the computing device, and the storage number of the super fusion storage system According to;
    The transceiver is used to receive and dispatch the process instruction performed by the processor, to cause the terminal to be deposited with super merge Other-end in storage system carries out data interaction.
  8. 8. terminal according to claim 7, it is characterised in that the program of the computing device also includes:
    Provided based on the hardware resource pool according to the identification information according to presetting rule is virtual to the new hardware resource division Source unit, the virtual resource unit are marked with unique unit title and access path information.
  9. 9. the terminal according to claim 7 or 8, it is characterised in that
    The hardware identifier and/or virtual resource mark in the identification information are obtained by the processor, and is based on the hardware Virtual resource unit corresponding to mark and/or virtual resource mark determination;
    The virtual resource unit is loaded onto in the hardware resource pool of super fusion storage system by the transceiver.
  10. 10. a kind of hardware resource management device based on super fusion storage system, it is characterised in that described device is arranged on such as power Profit require any one of 7-9 based on it is super fusion storage system hardware resource management terminal in, wherein, described device tool Body includes:
    Query unit, it whether there is new hardware resource for being serviced using hardware resource management in periodic scanning home server;
    First loading unit, for when new hardware resource is arrived in query unit scanning, the new hardware resource to be loaded onto In management virtual machine in home server;
    Judging unit, it whether there is identification information, the mark in the new hardware resource inquired for judging the query unit Know the identification information for the hardware resource mark that information is used in management system for the super fusion storage system;
    Second loading unit, for when the judging unit judges identification information to be present in the new hardware resource, according to institute State hardware resource pool of the identification information by the new hardware resource by the management virtual machine added to super fusion storage system In;
    Indexing unit, for when the judging unit judges identification information is not present in the new hardware resource, being described new Hardware resource marks identification information;
    Second loading unit is additionally operable to, and the labeled new hardware resource of the indexing unit is empty by the management Plan machine is added in the hardware resource pool of super fusion storage system.
CN201711148411.5A 2017-11-17 2017-11-17 Hardware resource management method, device and terminal based on super-fusion storage system Active CN107844274B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711148411.5A CN107844274B (en) 2017-11-17 2017-11-17 Hardware resource management method, device and terminal based on super-fusion storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711148411.5A CN107844274B (en) 2017-11-17 2017-11-17 Hardware resource management method, device and terminal based on super-fusion storage system

Publications (2)

Publication Number Publication Date
CN107844274A true CN107844274A (en) 2018-03-27
CN107844274B CN107844274B (en) 2021-03-16

Family

ID=61679648

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711148411.5A Active CN107844274B (en) 2017-11-17 2017-11-17 Hardware resource management method, device and terminal based on super-fusion storage system

Country Status (1)

Country Link
CN (1) CN107844274B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109375874A (en) * 2018-09-28 2019-02-22 深信服科技股份有限公司 A kind of call method of distributed storage, device and equipment
CN110209466A (en) * 2018-05-17 2019-09-06 腾讯科技(深圳)有限公司 Resource allocation method, device for allocating resources and storage medium
CN110389966A (en) * 2019-06-28 2019-10-29 苏州浪潮智能科技有限公司 A kind of information processing method and device
CN112416495A (en) * 2020-11-23 2021-02-26 山东乾云启创信息科技股份有限公司 Super-fusion cloud terminal resource unified management system and method
CN112433675A (en) * 2020-11-23 2021-03-02 山东可信云信息技术研究院 Storage space optimization method and system for super-fusion architecture
CN112434300A (en) * 2020-11-23 2021-03-02 山东可信云信息技术研究院 Credible super-fusion system and control method
CN113590033A (en) * 2021-06-30 2021-11-02 郑州云海信息技术有限公司 Information synchronization method and device of super-fusion system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1464453A (en) * 2002-06-06 2003-12-31 联想(北京)有限公司 File access method based on a distributed file storage system
CN1613214A (en) * 2001-11-09 2005-05-04 Adcdsl系统公司 Hardware controller and monitor
CN101473309A (en) * 2006-03-20 2009-07-01 伊姆西公司 High efficiency portable archive
CN105027498A (en) * 2013-06-11 2015-11-04 章寅生 A method, system and device for securely storing data files at a remote location by splitting and reassembling said files
US20160055078A1 (en) * 2014-08-22 2016-02-25 Vmware, Inc. Decreasing user management of an appliance
US20160188408A1 (en) * 2014-12-31 2016-06-30 Texas Instruments Incorporated Protection of memories, datapath and pipeline registers, and other storage elements by distributed delayed detection and correction of soft errors
CN106411574A (en) * 2016-09-05 2017-02-15 杭州昆海信息技术有限公司 Management control method and device
US9778865B1 (en) * 2015-09-08 2017-10-03 EMC IP Holding Company LLC Hyper-converged infrastructure based on server pairs

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1613214A (en) * 2001-11-09 2005-05-04 Adcdsl系统公司 Hardware controller and monitor
CN1464453A (en) * 2002-06-06 2003-12-31 联想(北京)有限公司 File access method based on a distributed file storage system
CN101473309A (en) * 2006-03-20 2009-07-01 伊姆西公司 High efficiency portable archive
CN105027498A (en) * 2013-06-11 2015-11-04 章寅生 A method, system and device for securely storing data files at a remote location by splitting and reassembling said files
US20160055078A1 (en) * 2014-08-22 2016-02-25 Vmware, Inc. Decreasing user management of an appliance
US20160188408A1 (en) * 2014-12-31 2016-06-30 Texas Instruments Incorporated Protection of memories, datapath and pipeline registers, and other storage elements by distributed delayed detection and correction of soft errors
US9778865B1 (en) * 2015-09-08 2017-10-03 EMC IP Holding Company LLC Hyper-converged infrastructure based on server pairs
CN106411574A (en) * 2016-09-05 2017-02-15 杭州昆海信息技术有限公司 Management control method and device

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110209466A (en) * 2018-05-17 2019-09-06 腾讯科技(深圳)有限公司 Resource allocation method, device for allocating resources and storage medium
CN110209466B (en) * 2018-05-17 2023-10-13 腾讯科技(深圳)有限公司 Resource allocation method, resource allocation device and storage medium
CN109375874A (en) * 2018-09-28 2019-02-22 深信服科技股份有限公司 A kind of call method of distributed storage, device and equipment
CN109375874B (en) * 2018-09-28 2021-12-21 深信服科技股份有限公司 Method, device and equipment for calling distributed storage
CN110389966A (en) * 2019-06-28 2019-10-29 苏州浪潮智能科技有限公司 A kind of information processing method and device
CN112416495A (en) * 2020-11-23 2021-02-26 山东乾云启创信息科技股份有限公司 Super-fusion cloud terminal resource unified management system and method
CN112433675A (en) * 2020-11-23 2021-03-02 山东可信云信息技术研究院 Storage space optimization method and system for super-fusion architecture
CN112434300A (en) * 2020-11-23 2021-03-02 山东可信云信息技术研究院 Credible super-fusion system and control method
CN112433675B (en) * 2020-11-23 2024-03-08 山东可信云信息技术研究院 Storage space optimization method and system for super fusion architecture
CN112434300B (en) * 2020-11-23 2024-03-12 山东可信云信息技术研究院 Trusted super-fusion system and control method
CN113590033A (en) * 2021-06-30 2021-11-02 郑州云海信息技术有限公司 Information synchronization method and device of super-fusion system
CN113590033B (en) * 2021-06-30 2023-11-03 郑州云海信息技术有限公司 Information synchronization method and device of super fusion system

Also Published As

Publication number Publication date
CN107844274B (en) 2021-03-16

Similar Documents

Publication Publication Date Title
CN107844274A (en) Hardware resource management method, apparatus and terminal based on super fusion storage system
US10649988B1 (en) Artificial intelligence and machine learning infrastructure
US9740706B2 (en) Management of intermediate data spills during the shuffle phase of a map-reduce job
CN103812939B (en) Big data storage system
US8972986B2 (en) Locality-aware resource allocation for cloud computing
CN104025054B (en) Dynamic memory layering in virtual environment
CN104537076B (en) A kind of file read/write method and device
US10339123B2 (en) Data management for tenants
CN107807796A (en) A kind of data hierarchy method, terminal and system based on super fusion storage system
US20210263667A1 (en) Multi-cloud orchestration as-a-service
US20100058108A1 (en) Method for analyzing fault caused in virtualized environment, and management server
US10356150B1 (en) Automated repartitioning of streaming data
CN111381928B (en) Virtual machine migration method, cloud computing management platform and storage medium
US11811839B2 (en) Managed distribution of data stream contents
CN103890738A (en) System and method for preserving deduplication in storage objects after clone split operations
US10223146B2 (en) Rearrangement management for a shared pool of configurable computing resources
US20220207043A1 (en) Entity data services for virtualized computing and data systems
CN108268609A (en) A kind of foundation of file path, access method and device
CN116450620B (en) Database design method and system for multi-source multi-domain space-time reference data
CN110134646B (en) Knowledge platform service data storage and integration method and system
CN107092525A (en) data cache method and device
CN110019440B (en) Data processing method and device
WO2022188573A1 (en) Soft deletion of data in sharded databases
CN107704618A (en) A kind of heat based on aufs file system migrates method and system
KR20160145250A (en) Shuffle Embedded Distributed Storage System Supporting Virtual Merge and Method Thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant