CN109213565A - Management method, relevant device and the storage medium of isomery virtual computing resource - Google Patents
Management method, relevant device and the storage medium of isomery virtual computing resource Download PDFInfo
- Publication number
- CN109213565A CN109213565A CN201710513659.0A CN201710513659A CN109213565A CN 109213565 A CN109213565 A CN 109213565A CN 201710513659 A CN201710513659 A CN 201710513659A CN 109213565 A CN109213565 A CN 109213565A
- Authority
- CN
- China
- Prior art keywords
- fictitious host
- host computer
- virtual machine
- information
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007726 management method Methods 0.000 title claims abstract description 32
- 238000000034 method Methods 0.000 claims abstract description 9
- 238000004891 communication Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 4
- 230000032258 transport Effects 0.000 claims 1
- 238000004364 calculation method Methods 0.000 description 11
- 239000011800 void material Substances 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000796 flavoring agent Substances 0.000 description 1
- 235000019634 flavors Nutrition 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0895—Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/22—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks comprising specially adapted graphical user interfaces [GUI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5011—Pool
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Stored Programmes (AREA)
Abstract
The present invention provides management method, relevant device and the storage medium of isomery virtual computing resource, this method comprises: creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and the attribute information of the fictitious host computer set is arranged；The corresponding clustered node information of the fictitious host computer set is added in the metadata table of the fictitious host computer set, and the nodal information of the multiple fictitious host computer is added in the metadata table.By the nodal information for the multiple fictitious host computers being added in the metadata table of the fictitious host computer set created in the corresponding clustered node information of fictitious host computer set and fictitious host computer set, so as to see the other virtual computing resource of cluster rank host-level below, OpenStack is reduced to the management complexity in the virtual computing resource pond of isomery.
Description
Technical field
The present invention relates to field of communication technology, in particular to a kind of management method, the correlation of isomery virtual computing resource are set
Standby and storage medium.
Background technique
Open protocol stack (OpenStack) is as one it is intended that public and private clound construction provides software with management
Cloud computing of increasing income manages platform project, and development is swift and violent, is favored by more and more users, OpenStack is in resource management
Aspect has the advantage of intelligent scheduling and overall scheduling, can be used for managing the virtual computing resource pond of numerous isomeries.It utilizes
When OpenStack is managed the virtual computing resource pond of isomery, it is necessary first to by corresponding virtualization system with
OpenStack is docked.Currently, virtualization system when being docked with OpenStack, is mostly with cluster (cluster)
It is docked for unit, i.e., the smallest virtual computing resource that can be seen in OpenStack at this time can only just arrive cluster rank,
Such as virtualization system vmware and OpenStack integrate OpenStack (VMware Integrated by external member VMware
OpenStack, VIO) when being docked, vmware is docked in OpenStack as unit of cluster, so
The smallest vmware computing resource that can be seen in OpenStack can only also arrive cluster rank, so as to cause OpenStack to different
Complexity is higher when the virtual computing resource pond of structure is managed.
Summary of the invention
It a kind of management method for being designed to provide isomery virtual computing resource of the embodiment of the present invention, relevant device and deposits
Storage media solves the problems, such as that complexity is higher when OpenStack is managed the virtual computing resource pond of isomery.
In order to achieve the above object, the embodiment of the present invention provides a kind of management method of isomery virtual computing resource, comprising:
Creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and the fictitious host computer set is arranged
Attribute information；
The corresponding clustered node information of the fictitious host computer set is added in the metadata table of the fictitious host computer set,
And the nodal information of the multiple fictitious host computer is added in the metadata table.
The embodiment of the present invention also provides a kind of managing device of isomery virtual computing resource, comprising:
First creation module for creating the fictitious host computer set including the identical multiple fictitious host computers of attribute, and is arranged
The attribute information of the fictitious host computer set；
First information adding module, for adding the fictitious host computer collection in the metadata table of the fictitious host computer set
Corresponding clustered node information is closed, and adds the nodal information of the multiple fictitious host computer in the metadata table.
The embodiment of the present invention also provides a kind of communication equipment, including memory, processor and is stored on the memory
And the computer program that can be run on the processor；It is characterized in that, the processor is realized such as when executing described program
The management method of the described in any item isomery virtual computing resources of claim 1-5.
The embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer program, feature
It is, which realizes the management of isomery virtual computing resource as described in any one in claim 1-5 when being executed by processor
Step in method.
A technical solution in above-mentioned technical proposal have the following advantages that or the utility model has the advantages that
The embodiment of the present invention, creation include the fictitious host computer set of the identical multiple fictitious host computers of attribute, and described in setting
The attribute information of fictitious host computer set；It is corresponding that the fictitious host computer set is added in the metadata table of the fictitious host computer set
Clustered node information, and add in the metadata table nodal information of the multiple fictitious host computer.By being created
The corresponding clustered node information of fictitious host computer set and fictitious host computer collection are added in the metadata table for the fictitious host computer set built
The nodal information of multiple fictitious host computers in conjunction, so as to see the other virtual computing money of cluster rank host-level below
Source reduces OpenStack to the management complexity in the virtual computing resource pond of isomery.
Detailed description of the invention
Fig. 1 is the structure chart of the management system of the applicable isomery virtual computing resource of the embodiment of the present invention；
Fig. 2 is a kind of flow chart of the management method of isomery virtual computing resource provided in an embodiment of the present invention；
Fig. 3 is the exemplary graph of the management method for the isomery virtual computing resource that embodiment illustrated in fig. 2 provides；
Fig. 4 is the flow chart of the management method of another isomery virtual computing resource provided in an embodiment of the present invention；
Fig. 5 is one of the exemplary graph of management method for the isomery virtual computing resource that embodiment illustrated in fig. 4 provides；
Fig. 6 is the two of the exemplary graph of the management method for the isomery virtual computing resource that embodiment illustrated in fig. 4 provides；
Fig. 7 is a kind of one of structure chart of managing device of isomery virtual computing resource provided in an embodiment of the present invention；
Fig. 8 is the two of a kind of structure chart of the managing device of isomery virtual computing resource provided in an embodiment of the present invention；
Fig. 9 is the three of a kind of structure chart of the managing device of isomery virtual computing resource provided in an embodiment of the present invention；
Figure 10 is a kind of structure chart of communication equipment provided in an embodiment of the present invention.
Specific embodiment
To keep the technical problem to be solved in the present invention, technical solution and advantage clearer, below in conjunction with attached drawing and tool
Body embodiment is described in detail.
As shown in Figure 1, being a kind of applicable structure of the management system of isomery virtual computing resource of the embodiment of the present invention
Figure, including OpenStack11 and virtualization system 12.Wherein, above-mentioned virtualization system 12 can be VMware, hyper-v etc.
The virtualization system that may be docked to as unit of cluster on OpenStack.In this regard, the present invention is not construed as limiting.
As shown in Fig. 2, the embodiment of the present invention provides a kind of management method of isomery virtual computing resource, including following step
It is rapid:
Step S201, creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and is arranged described virtual
The attribute information of host complexes；
Wherein, above-mentioned fictitious host computer can be the ESXi host under the cluster of VMware data center.It is above-mentioned multiple virtual
Host can be located in the same cluster.Above-mentioned attribute is identical can to refer to there is a certain predicable, may also mean that tool
There is certain several predicable.Above-mentioned attribute information can be attribute key-value pair.The attribute of the above-mentioned setting fictitious host computer set
Information can be the attribute key-value pair of setting fictitious host computer set (host aggregate, HA), such as setting fictitious host computer collection
The attribute key-value pair of conjunction be " using graphics processor=true (use Graphics Processing Unit=true,
UseGPU=true) " or the attribute key-value pair of setting fictitious host computer set is " (the use of graphics processor=vacation to be not used
Graphics Processing Unit=false, useGPU=false).
Step S202, the corresponding cluster of the fictitious host computer set is added in the metadata table of the fictitious host computer set
Nodal information, and add in the metadata table nodal information of the multiple fictitious host computer.
Wherein, above-mentioned metadata table, which can be, defines polymerization-member number that additional attribute uses for above-mentioned fictitious host computer set
According to (aggregate-metadata) table.Above-mentioned cluster can be the cluster of VMware data center.Above-mentioned clustered node information
The title that can be cluster is also possible to the number of cluster, can also be other clusters that can be used for finding corresponding cluster
Nodal information.The nodal information of above-mentioned fictitious host computer can be the title of fictitious host computer, is also possible to the IP of fictitious host computer, may be used also
To be the number etc. of other fictitious host computer nodal information such as fictitious host computers that can be used for finding corresponding fictitious host computer.It needs to infuse
Meaning, the same cluster can correspond to a fictitious host computer set, can also correspond to multiple fictitious host computer set, real to this present invention
Example is applied to be not construed as limiting.
In this way, due to by multiple virtual masters in the corresponding clustered node information of fictitious host computer set and fictitious host computer set
The nodal information of machine has been added in the metadata table of fictitious host computer set, so that it can be seen that cluster grade in OpenStack
Host rank virtual computing resource not below, facilitates OpenStack to be managed the other virtual computing resource of host-level, drop
Low management complexity of the OpenStack to the virtual computing resource pond of isomery.Simultaneously as above-mentioned clustered node information and void
The nodal information of quasi- host is added in metadata table, so the addition of two kinds of information of above- mentioned information will not change
OpenStack legacy data library structure, it can the compatible original function of OpenStack well.
Optionally, described that the corresponding collection of the fictitious host computer set is added in the metadata table of the fictitious host computer set
Group node information, and before adding in the metadata table nodal information of the multiple fictitious host computer, further includes:
The corresponding calculate node of the fictitious host computer set is added in the host data table of the fictitious host computer set
Nodal information.
Wherein, above-mentioned host data table can be polymerization-host (aggregate-host) table.Above-mentioned calculate node can be with
It is calculation server (nova-compute) node in OpenStack, wherein OpenStack is carried out with virtualization system
, can be by the central server of calculation server node link to virtualization system when docking, and each calculation server
Node can be responsible for managing the cluster or multiple clusters of virtualization system, such as the calculating service of an OpenStack
Device node can manage a cluster of vmware, can also manage multiple clusters of vmware, but this multiple cluster should be
Under the administration of the same VMware central server (VMware vCenter Server, vCenter).Above-mentioned calculate node
Nodal information can be the title or number of calculation server node.
It is that vmware illustrates with virtualization system, comprising the following steps:
6 ESXi masters including the identical n of attribute (n is more than or equal to 1 integer) a ESXi host are respectively created
Machine set, and the attribute information of the ESXi host complexes is set, while this 6 ESXi host complexes are respectively designated as host
Set 1-1, host complexes 1-2, host complexes 1-3, host complexes 2-1, host complexes 2-2, host complexes 2-3；
Respectively host complexes 1-1, host complexes 1-2, host complexes 1-3 polymerization-host table in add host complexes
1-1, host complexes 1-2, the corresponding calculate node of host complexes 1-3 nodal information " calculation server 1 ", while respectively in master
Machine set 2-1, host complexes 2-2, host complexes 2-3 polymerization-host table in add host complexes 2-1, host complexes 2-2,
Nodal information " calculation server 2 " (correspondence between host complexes and calculate node of the corresponding calculate node of host complexes 2-3
Relationship is referring to Fig. 3)；
Its corresponding clustered node information " cluster 1-1 " is added in polymerization-metadata table of host complexes 1-1, in master
Its corresponding clustered node information " cluster 1-2 " is added in polymerization-metadata table of machine set 1-2, in the poly- of host complexes 1-3
Its corresponding clustered node information " cluster 1-3 " is added in conjunction-metadata table, in polymerization-metadata table of host complexes 2-1
Its corresponding clustered node information " cluster 2-1 " is added, it is corresponding to add its in polymerization-metadata table of host complexes 2-2
Clustered node information " cluster 2-2 " adds its corresponding clustered node information in polymerization-metadata table of host complexes 2-3
" cluster 2-3 " (corresponding relationship between host complexes and cluster is referring to Fig. 3)；
Respectively in host complexes 1-1, host complexes 1-2, host complexes 1-3, host complexes 2-1, host complexes 2-2, master
Host node information (the host complexes of its corresponding n ESXi host are added in polymerization-metadata table of machine set 2-3
Corresponding relationship between ESXi host is referring to Fig. 3).
The embodiment of the present invention, creation include the fictitious host computer set of the identical multiple fictitious host computers of attribute, and described in setting
The attribute information of fictitious host computer set；It is corresponding that the fictitious host computer set is added in the metadata table of the fictitious host computer set
Clustered node information, and add in the metadata table nodal information of the multiple fictitious host computer.By being created
The corresponding clustered node information of fictitious host computer set and fictitious host computer collection are added in the metadata table for the fictitious host computer set built
The nodal information of multiple fictitious host computers in conjunction, so as to see the other virtual computing money of cluster rank host-level below
Source reduces OpenStack to the management complexity in the virtual computing resource pond of isomery.
As shown in figure 4, the embodiment of the present invention also provides a kind of management method of isomery virtual computing resource, including following step
It is rapid:
Step S401, creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and is arranged described virtual
The attribute information of host complexes；
Step S402, the corresponding cluster of the fictitious host computer set is added in the metadata table of the fictitious host computer set
Nodal information, and add in the metadata table nodal information of the multiple fictitious host computer.
Wherein, above-mentioned steps S401 and step S402 is identical as the step S201 of embodiment illustrated in fig. 2 and step S202, because
This can refer in embodiment illustrated in fig. 2 to step S201 and step S202 the understanding of above-mentioned steps S401 and step S402
Related description, do not repeat herein.
Step S403, type of virtual machine is set, and adds virtual machine attribute requirement；
Wherein, parameters such as processor core needed for above-mentioned setting type of virtual machine can refer to setting creation virtual machine
Number, hard disk size etc. are also possible to directly select from pre-set more set type of virtual machine templates, not to this present invention
It limits.Above-mentioned virtual machine attribute requires to refer to the attribute that the fictitious host computer for disposing virtual machine must have, specifically
It can be attribute information described in abovementioned steps S401.
Step S404, the virtual machine attribute is required and the attribute information of the fictitious host computer set matches, looked for
The corresponding destination virtual host complexes of the attribute information of matched fictitious host computer set are required with the virtual machine attribute out；
Wherein, it is above-mentioned by the virtual machine attribute require and the attribute information of the fictitious host computer set carry out matching can be with
It is to require virtual machine attribute and the attribute information of fictitious host computer set is compared, if the two is consistent, it is determined that the two is
It is matched.
Step S405, virtual machine is created according to the type of virtual machine, and the deploying virtual machine is empty to the target
On multiple fictitious host computers in quasi- host complexes.
Optionally, described that the corresponding collection of the fictitious host computer set is added in the metadata table of the fictitious host computer set
Group node information, and before adding in the metadata table nodal information of the multiple fictitious host computer, further includes:
The corresponding calculate node of the fictitious host computer set is added in the host data table of the fictitious host computer set
Nodal information.
Wherein, the description of nodal information of above-mentioned host data table, calculate node and calculate node is referred to shown in Fig. 2
Related description in embodiment, does not repeat herein.
It is optionally, described by the deploying virtual machine to multiple fictitious host computers in the destination virtual host complexes,
Include:
According to the nodal information of the clustered node information of the destination virtual host complexes and multiple fictitious host computers, institute is found
Multiple fictitious host computers in destination virtual host complexes are stated, and will be in the deploying virtual machine to the destination virtual host complexes
Multiple fictitious host computers on.
It is wherein, above-mentioned according to the clustered node information of the destination virtual host complexes and the nodal information of fictitious host computer,
The multiple fictitious host computers found in the destination virtual host complexes can be, first according to the cluster of destination virtual host complexes
Nodal information finds the corresponding cluster of destination virtual host complexes, then further according to the nodal information of multiple fictitious host computers in correspondence
Cluster in find corresponding multiple fictitious host computers.
It is optionally, described by the deploying virtual machine to multiple fictitious host computers in the destination virtual host complexes,
Include:
According to the nodal information of the calculate node of the destination virtual host complexes, clustered node information and multiple virtual masters
The nodal information of machine, finds multiple fictitious host computers in the destination virtual host complexes, and by the deploying virtual machine to institute
It states on multiple fictitious host computers in destination virtual host complexes.
Wherein, the nodal information of the above-mentioned calculate node according to the destination virtual host complexes, clustered node information and
The nodal information of multiple fictitious host computers, the multiple fictitious host computers found in the destination virtual host complexes can be, first root
The corresponding calculate node of destination virtual host complexes is found according to the nodal information of the calculate node of destination virtual host complexes, then
Target void is found in multiple clusters that corresponding calculate node is taken over according to the clustered node information of destination virtual host complexes
The quasi- corresponding cluster of host complexes is finally found in corresponding cluster further according to the nodal information of multiple fictitious host computers corresponding more
A fictitious host computer.
It is vmware with virtualization system, and assumes to include 8 ESXi hosts in a cluster A in the vmware,
Four ESXi hosts of middle host entitled A, B, C, D be not used graphics processor (Graphics Processing Unit,
GPU), and four ESXi hosts of host entitled E, F, G, H have used GPU to illustrate, comprising the following steps:
As shown in figure 5, two titles of creation are respectively the ESXi host complexes of host complexes A-1 and host complexes A-2, and
The attribute key-value pair that host complexes A-1 is arranged is useGPU=false, and the attribute key-value pair of setting host complexes A-2 is
UseGPU=true；
The nodal information of the corresponding calculate node of host complexes A-1 is added in polymerization-host table of host complexes A-1
" calculation server 3 " adds the node of the corresponding calculate node of host complexes A-2 in polymerization-host table of host complexes A-2
Information " calculation server 3 "；
The corresponding clustered node information " cluster of host complexes A-1 is added in polymerization-metadata table of host complexes A-1
A " adds the corresponding clustered node information " cluster A " of host complexes A-2 in polymerization-metadata table of host complexes A-2；
Added in polymerization-metadata table of host complexes A-1 Hostname A, B of its corresponding 4 ESXi host, C,
D adds Hostname E, F, G, H of its corresponding 4 ESXi host in polymerization-metadata table of host complexes A-2；
Parameters needed for creation virtual machine is arranged include processor nucleus number, hard disk size etc., and OpenStack's
Addition virtual machine attribute requires useGPU=true in type of virtual machine template (flavor)；
By virtual machine attribute require useGPU=true with host complexes A-1 and host complexes A-2 attribute key-value pair into
Row compares, and is required unanimously, to find target ESXi host set according to the attribute key-value pair of host complexes A-2 and virtual machine attribute
Close --- host complexes A-2；
Virtual machine is created according to parameters needed for the creation virtual machine of aforementioned setting, and according to host complexes A-2's
The nodal information " calculation server 3 " of calculate node finds calculation server 3, is driven by the vmware- above calculation server 3
Dynamic (vmware-driver) is linked on the central server of vmware, then according to the clustered node information of host complexes A-2
" cluster A " is linked on cluster A, is linked to collection further according to Hostname E, F, G, H of 4 ESXi hosts of host complexes A-2
Group A in 4 ESXi hosts E, F, G, H it is upper (linking relationship is referring to Fig. 6), by the deploying virtual machine to ESXi host E, F, G,
On H.
The embodiment of the present invention, creation include the fictitious host computer set of the identical multiple fictitious host computers of attribute, and described in setting
The attribute information of fictitious host computer set；It is corresponding that the fictitious host computer set is added in the metadata table of the fictitious host computer set
Clustered node information, and add in the metadata table nodal information of the multiple fictitious host computer；Create virtual machine
Type, and add virtual machine attribute requirement；By the virtual machine attribute require and the fictitious host computer set attribute information into
Row matching, and the corresponding fictitious host computer set of the attribute information of matched fictitious host computer set will be required with the virtual machine attribute
As destination virtual host complexes；Virtual machine is created according to type of virtual machine, and the deploying virtual machine is empty to the target
On multiple fictitious host computers in quasi- host complexes.Due to adding the fictitious host computer collection in the metadata table of fictitious host computer set
The nodal information of corresponding clustered node information and multiple fictitious host computers is closed, thus not influencing OpenStack existing database
Under the premise of design and other frameworks change, it can be seen that the other virtual computing resource of cluster rank host-level below, into
And will need above the deploying virtual machine of special resource to the host with special resource, so that void of the OpenStack to isomery
Quasi- computing resource carries out more flexible scheduling, reduces the complexity of management.
As shown in fig. 7, the embodiment of the present invention provides a kind of managing device 700 of isomery virtual computing resource, before being able to achieve
The details of the management method of the isomery virtual computing resource in each embodiment is stated, and reaches identical technical effect.The isomery is empty
The managing device 700 of quasi- computing resource includes:
For creating the fictitious host computer set including the identical multiple fictitious host computers of attribute, and institute is arranged in creation module 701
State the attribute information of fictitious host computer set；
First information adding module 702, for adding the virtual master in the metadata table of the fictitious host computer set
The corresponding clustered node information of machine set, and add in the metadata table nodal information of the multiple fictitious host computer.
Optionally, as shown in figure 8, described device 700 further include:
Second information adding module 703, it is described virtual for being added in the host data table of the fictitious host computer set
The nodal information of the corresponding calculate node of host complexes.
Optionally, as shown in figure 9, described device 700 further include:
Setup module 704 for type of virtual machine to be arranged, and adds virtual machine attribute requirement；
Matching module 705, for requiring to carry out the virtual machine attribute with the attribute information of the fictitious host computer set
Matching is found out and requires the corresponding destination virtual host set of the attribute information of matched fictitious host computer set with the virtual machine attribute
It closes；
Deployment module 706, for creating virtual machine according to the type of virtual machine, and by the deploying virtual machine described in
On multiple fictitious host computers in destination virtual host complexes.
Optionally, the deployment module 706 is used to create virtual machine according to the type of virtual machine, and according to the target
The clustered node information of fictitious host computer set and the nodal information of multiple fictitious host computers, find in the destination virtual host complexes
Multiple fictitious host computers, and will be on the deploying virtual machine to multiple fictitious host computers in the destination virtual host complexes.
Optionally, the deployment module 706 is used to create virtual machine according to the type of virtual machine, and according to the target
The nodal information of the nodal information of the calculate node of fictitious host computer set, clustered node information and multiple fictitious host computers, finds institute
Multiple fictitious host computers in destination virtual host complexes are stated, and will be in the deploying virtual machine to the destination virtual host complexes
Multiple fictitious host computers on.
In the managing device of isomery virtual computing resource provided in an embodiment of the present invention, creation module creation includes attribute phase
The fictitious host computer set of same multiple fictitious host computers, and the attribute information of the fictitious host computer set is set；First information addition
Module adds the corresponding clustered node information of the fictitious host computer set in the metadata table of the fictitious host computer set, and
The nodal information of the multiple fictitious host computer is added in the metadata table.By the member in the fictitious host computer set created
The corresponding clustered node information of fictitious host computer set and multiple fictitious host computers in fictitious host computer set are added in tables of data
Nodal information reduces OpenStack to different so as to see the other virtual computing resource of cluster rank host-level below
The management complexity in the virtual computing resource pond of structure.
Referring to Fig. 10, Figure 10 is the structure chart of the communication equipment of application of the embodiment of the present invention.It may be noted that the communication is set
It is standby to can be the network equipments such as server, computer, mobile phone, plate, this present invention is not construed as limiting.As shown in Figure 10, the communication
Equipment 1000 includes: processor 1001, transceiver 1002, memory 1003, user interface 1004 and bus interface, in which:
Processor 1001 executes following process for reading the program in memory 1003:
Creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and the fictitious host computer set is arranged
Attribute information；
The corresponding clustered node information of the fictitious host computer set is added in the metadata table of the fictitious host computer set,
And the nodal information of the multiple fictitious host computer is added in the metadata table.
Wherein, transceiver 1002, for sending and receiving data under the control of processor 1001.
In Figure 10, bus architecture may include the bus and bridge of any number of interconnection, specifically by 1001 generation of processor
The various circuits for the memory that the one or more processors and memory 1003 of table represent link together.Bus architecture may be used also
To link together various other circuits of such as peripheral equipment, voltage-stablizer and management circuit or the like, these are all
It is known in the art, therefore, it will not be further described herein.Bus interface provides interface.Transceiver 1002 can
To be multiple element, that is, includes transmitter and receiver, the list for communicating over a transmission medium with various other devices is provided
Member.For different user equipmenies, user interface 1004, which can also be, external the interface for needing equipment is inscribed, and connection is set
Standby including but not limited to keypad, display, loudspeaker, microphone, control stick etc..
Processor 1001, which is responsible for management bus architecture and common processing, memory 1003, can store processor 1001 and exists
Execute used data when operation.
Optionally, processor 1001 is also used to:
The corresponding calculate node of the fictitious host computer set is added in the host data table of the fictitious host computer set
Nodal information.
Optionally, processor 1001 is also used to:
Type of virtual machine is set, and adds virtual machine attribute requirement；
The virtual machine attribute is required and the attribute information of the fictitious host computer set matches, is found out and the void
The corresponding destination virtual host complexes of attribute information of the quasi- matched fictitious host computer set of machine attribute specification；
Virtual machine is created according to the type of virtual machine, and by the deploying virtual machine to the destination virtual host complexes
On interior multiple fictitious host computers.
Optionally, what processor 1001 executed will be multiple in the deploying virtual machine to the destination virtual host complexes
On fictitious host computer, comprising:
According to the nodal information of the clustered node information of the destination virtual host complexes and multiple fictitious host computers, institute is found
Multiple fictitious host computers in destination virtual host complexes are stated, and will be in the deploying virtual machine to the destination virtual host complexes
Multiple fictitious host computers on.
Optionally, what processor 1001 executed will be multiple in the deploying virtual machine to the destination virtual host complexes
On fictitious host computer, comprising:
According to the nodal information of the calculate node of the destination virtual host complexes, clustered node information and multiple virtual masters
The nodal information of machine, finds multiple fictitious host computers in the destination virtual host complexes, and by the deploying virtual machine to institute
It states on multiple fictitious host computers in destination virtual host complexes.
Communication equipment provided in an embodiment of the present invention, creation include the fictitious host computer collection of the identical multiple fictitious host computers of attribute
It closes, and the attribute information of the fictitious host computer set is set；The void is added in the metadata table of the fictitious host computer set
Intend the corresponding clustered node information of host complexes, and adds the node letter of the multiple fictitious host computer in the metadata table
Breath.By being added to the corresponding clustered node information of fictitious host computer set in the metadata table of the fictitious host computer set created
With the nodal information of multiple fictitious host computers in fictitious host computer set, so as to see that cluster rank host-level below is other
Virtual computing resource reduces OpenStack to the management complexity in the virtual computing resource pond of isomery.
It can be with those of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment method is
It is done through the relevant hardware of the program instructions, the program can store in a computer-readable access medium, the journey
Sequence is when being executed, comprising the following steps:
Creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and the fictitious host computer set is arranged
Attribute information；
The corresponding clustered node information of the fictitious host computer set is added in the metadata table of the fictitious host computer set,
And the nodal information of the multiple fictitious host computer is added in the metadata table.
Optionally, described that the corresponding collection of the fictitious host computer set is added in the metadata table of the fictitious host computer set
Group node information, and before adding in the metadata table nodal information of the multiple fictitious host computer, further includes:
The corresponding calculate node of the fictitious host computer set is added in the host data table of the fictitious host computer set
Nodal information.
Optionally, described that the corresponding collection of the fictitious host computer set is added in the metadata table of the fictitious host computer set
Group node information, and after adding in the metadata table nodal information of the multiple fictitious host computer, further includes:
Type of virtual machine is set, and adds virtual machine attribute requirement；
The virtual machine attribute is required and the attribute information of the fictitious host computer set matches, is found out and the void
The corresponding destination virtual host complexes of attribute information of the quasi- matched fictitious host computer set of machine attribute specification；
Virtual machine is created according to the type of virtual machine, and by the deploying virtual machine to the destination virtual host complexes
On interior multiple fictitious host computers.
It is optionally, described by the deploying virtual machine to multiple fictitious host computers in the destination virtual host complexes,
Include:
According to the nodal information of the clustered node information of the destination virtual host complexes and multiple fictitious host computers, institute is found
Multiple fictitious host computers in destination virtual host complexes are stated, and will be in the deploying virtual machine to the destination virtual host complexes
Multiple fictitious host computers on.
It is optionally, described by the deploying virtual machine to multiple fictitious host computers in the destination virtual host complexes,
Include:
According to the nodal information of the calculate node of the destination virtual host complexes, clustered node information and multiple virtual masters
The nodal information of machine, finds multiple fictitious host computers in the destination virtual host complexes, and by the deploying virtual machine to institute
It states on multiple fictitious host computers in destination virtual host complexes.
The storage medium, such as read-only memory (Read-Only Memory, abbreviation ROM), random access memory
(Random Access Memory, abbreviation RAM), magnetic or disk etc..
The above is a preferred embodiment of the present invention, it is noted that for those skilled in the art
For, without departing from the principles of the present invention, it can also make several improvements and retouch, these improvements and modifications
It should be regarded as protection scope of the present invention.
Claims (12)
1. a kind of management method of isomery virtual computing resource characterized by comprising
Creation includes the fictitious host computer set of the identical multiple fictitious host computers of attribute, and the attribute of the fictitious host computer set is arranged
Information；
The corresponding clustered node information of the fictitious host computer set is added in the metadata table of the fictitious host computer set, and
The nodal information of the multiple fictitious host computer is added in the metadata table.
2. the method according to claim 1, wherein described add in the metadata table of the fictitious host computer set
Add the corresponding clustered node information of the fictitious host computer set, and adds the multiple fictitious host computer in the metadata table
Nodal information before, further includes:
The node of the corresponding calculate node of the fictitious host computer set is added in the host data table of the fictitious host computer set
Information.
3. method according to claim 1 or 2, which is characterized in that the metadata table in the fictitious host computer set
The corresponding clustered node information of the middle addition fictitious host computer set, and add in the metadata table the multiple virtual
After the nodal information of host, further includes:
Type of virtual machine is set, and adds virtual machine attribute requirement；
The virtual machine attribute is required and the attribute information of the fictitious host computer set matches, is found out and the virtual machine
The corresponding destination virtual host complexes of attribute information of the matched fictitious host computer set of attribute specification；
Virtual machine is created according to the type of virtual machine, and will be in the deploying virtual machine to the destination virtual host complexes
On multiple fictitious host computers.
4. according to the method described in claim 3, it is characterized in that, described by the deploying virtual machine to the destination virtual master
On multiple fictitious host computers in machine set, comprising:
According to the nodal information of the clustered node information of the destination virtual host complexes and multiple fictitious host computers, the mesh is found
Multiple fictitious host computers in fictitious host computer set are marked, and will be more in the deploying virtual machine to the destination virtual host complexes
On a fictitious host computer.
5. according to the method described in claim 3, it is characterized in that, described by the deploying virtual machine to the destination virtual master
On multiple fictitious host computers in machine set, comprising:
According to the nodal information of the calculate node of the destination virtual host complexes, clustered node information and multiple fictitious host computers
Nodal information, finds multiple fictitious host computers in the destination virtual host complexes, and by the deploying virtual machine to the mesh
It marks on multiple fictitious host computers in fictitious host computer set.
6. a kind of managing device of isomery virtual computing resource characterized by comprising
Creation module for creating the fictitious host computer set including the identical multiple fictitious host computers of attribute, and is arranged described virtual
The attribute information of host complexes；
First information adding module, for adding the fictitious host computer set pair in the metadata table of the fictitious host computer set
The clustered node information answered, and add in the metadata table nodal information of the multiple fictitious host computer.
7. device according to claim 6, which is characterized in that further include:
Second information adding module, for adding the fictitious host computer set in the host data table of the fictitious host computer set
The nodal information of corresponding calculate node.
8. device according to claim 6 or 7, which is characterized in that further include:
Setup module for type of virtual machine to be arranged, and adds virtual machine attribute requirement；
Matching module is looked for for requiring to match the virtual machine attribute with the attribute information of the fictitious host computer set
The corresponding destination virtual host complexes of the attribute information of matched fictitious host computer set are required with the virtual machine attribute out；
Deployment module, for creating virtual machine according to the type of virtual machine, and the deploying virtual machine is empty to the target
On multiple fictitious host computers in quasi- host complexes.
9. device according to claim 8, which is characterized in that the deployment module is used to be created according to the type of virtual machine
Virtual machine is built, and according to the nodal information of the clustered node information of the destination virtual host complexes and multiple fictitious host computers, is looked for
To multiple fictitious host computers in the destination virtual host complexes, and by the deploying virtual machine to the destination virtual host set
On multiple fictitious host computers in conjunction.
10. device according to claim 8, which is characterized in that the deployment module is used for according to the type of virtual machine
Virtual machine is created, and according to the nodal information of the calculate node of the destination virtual host complexes, clustered node information and multiple
The nodal information of fictitious host computer, finds multiple fictitious host computers in the destination virtual host complexes, and by the virtual machine portion
It affixes one's name on multiple fictitious host computers in the destination virtual host complexes.
11. a kind of communication equipment, including memory, processor and it is stored on the memory and can transports on the processor
Capable computer program, which is characterized in that the processor is realized as described in claim any one of 1-5 when executing described program
Isomery virtual computing resource management method.
12. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The step in the management method of isomery virtual computing resource as described in any one in claim 1-5 is realized when execution.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710513659.0A CN109213565B (en) | 2017-06-29 | 2017-06-29 | Management method of heterogeneous virtual computing resources, related equipment and storage medium |
| PCT/CN2018/091144 WO2019001280A1 (en) | 2017-06-29 | 2018-06-13 | Heterogeneous virtual computing resource management method, related device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710513659.0A CN109213565B (en) | 2017-06-29 | 2017-06-29 | Management method of heterogeneous virtual computing resources, related equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109213565A true CN109213565A (en) | 2019-01-15 |
| CN109213565B CN109213565B (en) | 2023-08-11 |
Family
ID=64742726
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710513659.0A Active CN109213565B (en) | 2017-06-29 | 2017-06-29 | Management method of heterogeneous virtual computing resources, related equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109213565B (en) |
| WO (1) | WO2019001280A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108037977A (en) * | 2017-12-08 | 2018-05-15 | 上海市信息网络有限公司 | Management method, equipment, computer media and the system of virtual machine resource |
| CN111352701A (en) * | 2020-03-05 | 2020-06-30 | 山东汇贸电子口岸有限公司 | Method for arranging Redis cluster in Openstack environment |
| CN112579258A (en) * | 2020-12-14 | 2021-03-30 | 科东(广州)软件科技有限公司 | Virtual machine management method, device, equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102521012A (en) * | 2011-11-24 | 2012-06-27 | 华中科技大学 | Virtual machine-based general processing unit (GPU) cluster management system |
| CN103036986A (en) * | 2011-12-15 | 2013-04-10 | 微软公司 | Update notification provided on distributed application object |
| CN104219318A (en) * | 2014-09-15 | 2014-12-17 | 北京联创信安科技有限公司 | Distributed file storage system and method thereof |
| CN104424013A (en) * | 2013-08-26 | 2015-03-18 | 国际商业机器公司 | Method and device for deploying virtual machine in computing environment |
| CN104506589A (en) * | 2014-12-10 | 2015-04-08 | 上海爱数软件有限公司 | Resource migration scheduling method based on super fusion storage |
| US20150324236A1 (en) * | 2014-05-12 | 2015-11-12 | The Research Foundation For The State University Of New York | Gang migration of virtual machines using cluster-wide deduplication |
| US20160320996A1 (en) * | 2015-04-28 | 2016-11-03 | Vmware, Inc. | Power management for distributed storage systems |
| CN106354548A (en) * | 2016-08-31 | 2017-01-25 | 天津南大通用数据技术股份有限公司 | Virtual cluster creating and management method and device in distributed database system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080192643A1 (en) * | 2007-02-13 | 2008-08-14 | International Business Machines Corporation | Method for managing shared resources |
| CN102143215B (en) * | 2011-01-20 | 2013-04-10 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
| CN103701890A (en) * | 2013-12-20 | 2014-04-02 | 浪潮(北京)电子信息产业有限公司 | Virtual cluster processing method and system based on cloud computing |
| CN105471607A (en) * | 2014-09-04 | 2016-04-06 | 中国石油化工股份有限公司 | Tree-shaped monitoring method for large-scale cluster nodes dynamic information |
-
2017
- 2017-06-29 CN CN201710513659.0A patent/CN109213565B/en active Active
-
2018
- 2018-06-13 WO PCT/CN2018/091144 patent/WO2019001280A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102521012A (en) * | 2011-11-24 | 2012-06-27 | 华中科技大学 | Virtual machine-based general processing unit (GPU) cluster management system |
| CN103036986A (en) * | 2011-12-15 | 2013-04-10 | 微软公司 | Update notification provided on distributed application object |
| CN104424013A (en) * | 2013-08-26 | 2015-03-18 | 国际商业机器公司 | Method and device for deploying virtual machine in computing environment |
| US20150324236A1 (en) * | 2014-05-12 | 2015-11-12 | The Research Foundation For The State University Of New York | Gang migration of virtual machines using cluster-wide deduplication |
| CN104219318A (en) * | 2014-09-15 | 2014-12-17 | 北京联创信安科技有限公司 | Distributed file storage system and method thereof |
| CN104506589A (en) * | 2014-12-10 | 2015-04-08 | 上海爱数软件有限公司 | Resource migration scheduling method based on super fusion storage |
| US20160320996A1 (en) * | 2015-04-28 | 2016-11-03 | Vmware, Inc. | Power management for distributed storage systems |
| CN106354548A (en) * | 2016-08-31 | 2017-01-25 | 天津南大通用数据技术股份有限公司 | Virtual cluster creating and management method and device in distributed database system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108037977A (en) * | 2017-12-08 | 2018-05-15 | 上海市信息网络有限公司 | Management method, equipment, computer media and the system of virtual machine resource |
| CN108037977B (en) * | 2017-12-08 | 2021-10-29 | 上海市信息网络有限公司 | Virtual computer resource management method, device, computer medium, and system |
| CN111352701A (en) * | 2020-03-05 | 2020-06-30 | 山东汇贸电子口岸有限公司 | Method for arranging Redis cluster in Openstack environment |
| CN112579258A (en) * | 2020-12-14 | 2021-03-30 | 科东(广州)软件科技有限公司 | Virtual machine management method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019001280A1 (en) | 2019-01-03 |
| CN109213565B (en) | 2023-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11842322B2 (en) | Smart contract interpreter | |
| CN110580197B (en) | Distributed computing architecture for large model deep learning | |
| US11093216B2 (en) | Automatic discovery of microservices from monolithic applications | |
| US9703890B2 (en) | Method and system that determine whether or not two graph-like representations of two systems describe equivalent systems | |
| CN104573115B (en) | Support the realization method and system of the integrated interface of multi-type database operation | |
| US11172022B2 (en) | Migrating cloud resources | |
| US9582319B2 (en) | Migrating virtual machines across network separated data centers | |
| US9813423B2 (en) | Trust-based computing resource authorization in a networked computing environment | |
| CN107301022A (en) | A kind of storage access method and system based on container technique | |
| CN104933173B (en) | It is a kind of for the data processing method of isomery multi-data source, device and server | |
| CN105573830B (en) | A kind of virtual machine migration method | |
| CN111859638A (en) | Real-time efficient distributed virtual-real combined simulation system and construction method | |
| CN114073058B (en) | Method, apparatus and computer medium for network-based media processing (NBMP) | |
| CN109213565A (en) | Management method, relevant device and the storage medium of isomery virtual computing resource | |
| CN110737425B (en) | Method and device for establishing application program of charging platform system | |
| CN106569896A (en) | Data distribution and parallel processing method and system | |
| WO2020081587A1 (en) | System and method for auto-completion of ics flow using artificial intelligence/machine learning | |
| WO2013185166A1 (en) | System management tool | |
| WO2014108769A1 (en) | Management of distributed network switching cluster | |
| US11704327B2 (en) | Querying distributed databases | |
| CN109542398A (en) | A kind of operation system generation method, device and computer readable storage medium | |
| US11727022B2 (en) | Generating a global delta in distributed databases | |
| CN104023056B (en) | The method and relevant device updated the data | |
| KR101378348B1 (en) | Basic prototype of hadoop cluster based on private cloud infrastructure | |
| US20220374424A1 (en) | Join queries in data virtualization-based architecture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |